Actions

Ontolog Forum

Ontology Summit 2013: (Track-D) "Software Environments for Evaluating Ontologies" Community Input

Track Co-champions: Michael Denny, Ken Baclawski & PeterYim

Mission Statement

Through this track, we aim to coordinate the following:   

  • provide a venue to bring together individuals and communities who can help define and advance the state-of-the-art in software and systems for evaluating ontologies   
  • the collection and enumeration of software environments and tools for evaluating ontologies (with emphasis on those that are open efforts and those that are publicly available)   
  • investigations and development work (software prototyping and implementation) focused on the ontology evaluation theme, leading to interim presentations at the symposium, and possibly continued after this Ontology Summit ... (this bullet, which was on our original mission statement is now handled by the Hackathon-Clinics Activities champions - see: OntologySummit2013_Hackathon_Clinics)   

see also: OntologySummit2013_Software_Environments_For_Evaluating_Ontologies_Synthesis

Enter your input below ... (please identify yourself and date your entry)

  • ...

Ontology Summit 2013 Hackathon-Clinic Contributor confcall (n.05) - Fri 2013.03.19

  • Date / Start time: Tuesday 2013.03.19 - 9:00am PDT / 12:00pm EDT / 1:00pm ART / 5:00pm CET / 16:00 GMT/UTC (worldclock)
  • Duration: ~1.5 Hour
  • Dial-in:
    • Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
      • ... [ backup nbr: (415) 671-4335 ]
    • Skype: joinconference ... PIN: 141184#
  • Expecting: all leads of submitted hackathon-clinics projects; all independent contributors who have signed up
    • (optional) all Ontology Summit 2013 organizing committee members, invitees, and all who are interested or considering to participate ... this meeting is open to all (as observers).

Agenda Idea

  • collaboratively align and tweak the projects and the teams, so we pare the number down to a few very interesting projects to work on, during the (community picked) Hackathon-Clinics weekends.
  • picking the dates of the Hackathon-Clinics weekend(s) and scheduling projects to those dates
  • prepare for the Thu 2013.03.28 - session-11 - Getting the "hackathon," "clinics" and related activities going virtual session
  • discussing next steps on rolling out the Ontology Summit 2013 Hackathon-Clinics;

Ref.

Agenda & Proceedings

1. Roll call, review and adopt agenda.

2. Collaboratively align and tweak the projects and the teams, so we pare the number down to a few very interesting projects to work on, during the (community picked) Hackathon-Clinics weekends.

  • Consolidation consensus - ref. Hackathon_Clinics page at: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Hackathon_Clinics#nid3OAS
    • H1+H2+A1 -> A1
    • H3 and O1 will not be featured this time, and will be pursued outside of the H-C activities
    • H5 -> A3
    • O3+O4 -> O3
    • A2 -> H8
    • H2 & H7 will be featured if there is enough programing support for them (other than the proposers)
    • therefore the selected project (and point-of-contact) are as follows:
      • H4. Ontohub-OOR-OOPS!-OQuaRE (TillMossakowski)
      • H6. OSummit-content-hack (KenBaclawski)
      • H8. Ontology-of-Ontology-Evaluation (AmandaVizedom)
      • O2. 15926-ref-data-validation (VictorAgroskin)
      • O3. FIBO-Clinic (MikeBennett)
      • A1. GOEF-I-Choose (JoanneLuciano)
      • A3. BACnet Clinic (JoelBender)
    • The project point person(s) - TillMossakowski(H4), KenBaclawski(H6), AmandaVizedom(H8), VictorAgroskin(O2), MikeBennett(O3), JoanneLuciano(A1) and JoelBender(A3) are kindly requested to update their project documents and send them in within this week (by Friday 3/22 if you please) ... please send to [ontology-summit] list, or direct to wiki (then advise the list) and also mail the co-champions a pdf version of the project document for archival purposes.

3. Picking the dates of the Hackathon-Clinics weekend(s) and scheduling projects to those dates

  • Candidate-1: Sat(-Sun) 2013.03.30~31
  • Candidate-2: Sat(-Sun) 2013.04.06~07
  • Candidate-3: Sat(-Sun) 2013.04.13~14
we will assume that each project will take up one day (the Saturday will be the main event day, the Sunday will be an optional extension day, if the team wants to spend more time finishing up.)

4. Prepare for the Thu 2013.03.28 - session-11 - Getting the "hackathon," "clinics" and related activities going virtual session

  • Session plan for the Mar-28 session-11 - developing session page on: http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2013_03_28
    • for the 3/28 session - after overview by Mike-Ken-Peter, the 7 project point persons will each do a short presentation (~8 min, 3~5 slides) on their projects
    • [action] project point-persons, please be prepared to present on 3/28, slides due 3/26

5. Discussing next steps on rolling out the Ontology Summit 2013 Hackathon-Clinics;

  • Peter P. Yim will harmonize the schedule input received and post a proposed hackathon-clinics calendar for everyone on the [ontology-summit] list to review and adopt

6. Any other business

7. Follow-up, next meeting, adjournment.

  • let's discuss over the [ontology-summit] (for general and proposal-related issues) and [ontolog-dev] (for low level hackathon details) mailing lists

-- session ended: 10:32 am PDT --

Ontology Summit 2013 Hackathon-Clinic Proposal confcall (n.04) - Fri 2013.03.05

  • Date / Start time: Tuesday 2013.03.05 - 7:00am PST / 10:00 am EST / 12:00pm ART / 4:00pm CET / 15:00 GMT/UTC (worldclock)
  • Duration: ~1.25 Hour
  • Dial-in:
    • Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
      • ... [ backup nbr: (415) 671-4335 ]
    • Skype: joinconference ... PIN: 141184#
  • Expecting: Mike Dean (co-chair), Peter P. Yim (co-chair), Ken Baclawski, and all who plan to participate in the Ontology Summit 2013 "Hackathon" and "Clinics" activities ... (anyone else from the summit organizing team interested and can commit time and effort into this are welcome.)
  • Attended:
    • Regrets:

Ref. Call for Proposals to the the "hackathon" and "clinics" activities - http://ontolog.cim3.net/forum/ontology-summit/2013-02/msg00056.html

Agenda Idea

  • Make explicit that proposals may include slots for which they want/need additional help (what expertise). Also, there should be a call for, and way for, willing contributors who are not affiliated with one of these projects to register themselves and their skills, for proposers to see (and to generate additional energy/excitement). Having these separate, explicitly, may help with proposal speed / number (suggested by AmandaVizedom)
  • encouraging collaboration and partnering in putting together a proposal
  • any remaining issues, Q&A ref. the making of a "hackathon" or "clinic" proposal
  • re-assess planned timeline and milestones

Ref. 2013.02.21 presentation on the "Hackathon-Clinics" Approach, and the 2013.03.01 clarification

Agenda & Proceedings

1. Roll call, review and adopt agenda.

2. Taking inventory on candidate projects, and Q&A ...

  • Any question on what are projects under: "Hackathon," "Ontology Clinic-A," "Ontology-Clinic-B" & "Application Clinic" ... questions on the proposal writing?

3. Possible coordination to make as many of these projects into reality as we can

4. Reviewing the Calendar again - slides#13:

  • Announcement of the call for proposals: Thu 2013.02.21
  • Deadline for proposal submission: Thu 2013.03.08 (2 weeks to prepare proposal)
  • Alignment of projects and teams: 2013.03.09~03.19 (10 days to tweak proposals/projects)
  • Announcement of selected projects: Thu 2013.03.21
  • Hackathon-Clinics project plan debut: session-11 - Thu 2013.03.28
  • Staging of projects: Fri 2013.03.22 to hackathon-clinics weekend (see below; 1 week+)
  • Hackathon-Clinics Weekends:
    • Candidate-1: Fri-Sat 2013.03.30~31
    • Candidate-2: Fri-Sat 2013.04.06~07
    • Candidate-3: Fri-Sat 2013.04.13~14
  • preparation of writeup/presentation/demo - 2013.04.15~29 (2 weeks+)
  • writeup/presentation/demo material due - 2013.04.30 (2 days before event)
  • Presentation / Demo: Thu 2013.05.02 (Symposium Day-1)
  • (?)Award Ceremony: Fri 2013.05.03 (Symposium Day-2)
  • do we want/need to extend the 2013.03.08 (this Thursday) proposal submission deadline?
    • Peter P. Yim: looks like we don't need to ... however, Again, proposal deadline is 2013.03.08 (this Thursday) ... anyone who needs an extra day or two for this, should write <peter.yim@cim3.com> offline about it.

5. Any other business

  • Yuriy Milov: why limit the hackathon to 1 or 2 days ... why not 4 weeks?
    • Answer: [ppy] the constraint is in our ability to sustain an open distributed collaboration workspace for intensive work for a long time ... we should recognize the project partner can (and would) be working independent of those 1 or 2 days; just treat those 1 or 2 days as the "community collaboration" days.

6. Action items

7. Follow-up, next meeting, adjournment

  • let's discuss over the [ontology-summit] (for general and proposal-related issues) and [ontolog-dev] (for low level hackathon details) mailing lists

-- session ended: 8:30 am PST --

Ontology Summit 2013 Survey and Website sub-team confcall (n.03) - Fri 2013.02.22

  • Date / Start time: Friday 2013.02.22 - 6:00am PST / 9:00 am EST / 11:00am ART / 3:00pm CET / 14:00 GMT/UTC
  • Duration: ~1.0 Hours (for survey); maybe another 30 minutes on website planning
  • Dial-in:
    • Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
      • ... [ backup nbr: (415) 671-4335 ]
    • Skype: joinconference ... PIN: 141184#

Ref. 2013.02.15 organizing committee discussion: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013/GettingOrganized#nid3M2R

Agenda & Proceedings

1. Roll call, review and adopt agenda.

  • attendees - see above
  • we ran into problems with the chat-room (soaphub server seems to be down), please go to the google-doc here

2. 2013-Survey design, implementation and deployment discussion - we want to come away with a plan for: (ref.)

  • 1) finalizing the list of software capabilities;
    • Mike Denny: feedback collected, looks like only minor changes needed. Mike Denny will get a revised list out by cob Thu 2013.02.28 [action: MikeDenny]
        • Mike Denny: I will be traveling for 10 days starting Fri 2013.03.01 (will miss the organizing committee meeting on Mar-1 too)
  • 2) reviewing prototypes from candidate software providers;
  • 3) publishing the survey in a convenient form ... reviewing:
  • 4) collecting and publishing the survey results.
    • [action - KenBaclawski] will have the initial survey ready by Mon 2013.02.25 ... Mike will provide comments to Ken (in fact, Mike Denny can even edit the survey himself, if he wants to; afterall it is on a wiki).
    • [action - Mike Denny, KenBaclawski] will aim at having the survey instrument done (all questions and content finalized) by - Thu 2013.02.28
    • [action - Mike Denny, et al.] will also discuss how to circulate and promote the survey over [ontology-summit-org] list
      • Peter will add Ken to the [ontology-summit-org] list
    • [action - MikeDenny] we will aim to release on Wed 2013.03.13

3. Website design, implementation and deployment discussion

4. Any other business

  • exposing/publishing 2012-survey work ... [discussion deferred]

5. Action items

  • see above

6. Follow-up, next meeting, adjournment

    • no real-time meeting planned. We'll do it asynchronously on the mailing lists (as discussed above.)

-- session ended: 7:57am PST --

OOR Ontology Summit 2013 Hackathon-Clinic Team Meeting (n.02) - Tue 2013.02.05

  • Date / Start time: Tuesday 2013.02.05 - 7:30am PST / 10:30am EST / 4:30pm CET / 15:30 GMT/UTC
  • Duration: 1.5 Hours

Full details at: OOR/ConferenceCall_2013_02_05

Software for Ontology Evaluation: Exploratory Meeting - Fri 2013.01.25

Conference call details:

  • Date / Start time: Friday 2013.01.25 - starting 8:00am PST / 11:00am EST / 5:00pm CET / 4:00pm GMT/UTC
  • Dial-in:
    • Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
      • ... [ backup nbr: (415) 671-4335 ]
    • Skype: joinconference ... PIN: 141184#
  • In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130125
  • Add your Agenda Ideas and anything you want discussed at this meeting below:
    • ...

Agenda & Proceedings

{{{ [ Audio archives of the meeting ] . ( 1:04:53 ; mp3 ; 7.43 MB ) }}}

[ chat transcript ]

  • Opening, roll call, self-intros, adopt agenda
  • What are we trying to achieve?
    • quick review of the the Track-D intro slides from the Ontology Summit 2013 Launch Event
    • Noting: already on the Master Calendar -
      • Thu 2013.02.14 - session-05 - Track-D
      • Thu 2013.02.21 - session-06 - Synthesis-I; proposed Communique Outline; exploring a "hackathon"
      • Thu 2013.03.21 - session-10 - Track-D
      • Thu 2013.03.28 - session-11 - preparing for a "hackathon" and/or related activities
      • Thu 2013.04.25 - session-15 - pre-symposium prep
      • Thu & Fri 2013.05.02 & 03 - Symposium (F2F)
  • aligning what we mean by the "hackathon"
    • what: need to define the "challenge" between now and March
    • how: distributed network of power hack-teams (who would probably be co-located)
    • when: weekends between 2013.03.28 and 2013.04.25 ... maybe earlier (to avoid conflict with students' final exams)
  • Getting organized
    • (i) (A) Research, Survey, Enumerate "what's out there," and (B) showcase exemplary software environments and tools for evaluating ontologies
      • who's on board: Michael Denny (will lead 'Research, Survey, Enumerate "what's out there"' effort), Mike Bennett, ...
      • candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss
    • (ii) User communities that have real needs to evaluate ontologies, to provide us the use cases, upon which we can ground our work
      • who's on board: (Manufacturing / Process Industry) David Leal, (Finance) Mike Bennett, (Earth Science) PeterFox (added: JL/2013.01.28) ... RDA?? Biomedical Informatics??
      • candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss
    • (iii) Communities/teams of Ontology Software developers and tool-makers, who will join us in this track's activities, especially in terms of prototyping and implementations that could help advance the state-of-the-art in software and systems for ontology evaluation
  • Any other business
    • Yuriy Milov suggested, and there was consensus among those at the meeting, that, for the hackathon work, all hack-teams will put their work on the Eclipse development environment.
  • Action items
  • Next meeting, wrap-up
    • [consensus] (for now) we will not make further attempts to confer synchronously (it's too difficult) and will defer to asynchronous transactions
    • we will communicate all other outstanding issues via this wiki page, and via discussions on the mailing list(s) -
      • "[ontology-summit] {software-environment}" for teams (i) & (ii) work
      • "[ontolog-dev] {ontology-evaluation}" for team (iii) work ... PPY: I will subscribe everyone on this team to this list

session adjourned: 9:10 am PST

--

notes taken by: Peter P. Yim / 2013.01.25-9.14am PST

All participants, please review and edit to enhance accuracy and granularity of the documented proceedings.



Retrieved from "https://ontologforum.com/index.php?title=OntologySummit2013_Software_Environments_For_Evaluating_Ontologies_CommunityInput&oldid=790"