Ontolog Forum
OntologySummit2013: (Track-D) "Software Environments for Evaluating Ontologies" Community Input
Track Co-champions: Michael Denny, Ken Baclawski & PeterYim
Mission Statement:
Through this track, we aim to coordinate the following:
- provide a venue to bring together individuals and communities who can help define and advance the state-of-the-art in software and systems for evaluating ontologies
- the collection and enumeration of software environments and tools for evaluating ontologies (with emphasis on those that are open efforts and those that are publicly available)
- investigations and development work (software prototyping and implementation) focused on the ontology evaluation theme, leading to interim presentations at the symposium, and possibly continued after this Ontology Summit ... (this bullet, which was on our original mission statement is now handled by the Hackathon-Clinics Activities champions - see: OntologySummit2013_Hackathon_Clinics)
see also: OntologySummit2013_Software_Environments_For_Evaluating_Ontologies_Synthesis
- and the Track-D intro slides from the Ontology Summit 2013 Launch Event
Enter your input below ... (please identify yourself and date your entry)
- ...
Ontology Summit 2013 Hackathon-Clinic Contributor confcall (n.05) - Fri 2013.03.19
- Date / Start time: Tuesday 2013.03.19 - 9:00am PDT / 12:00pm EDT / 1:00pm ART / 5:00pm CET / 16:00 GMT/UTC (worldclock)
- Duration: ~1.5 Hour
- Dial-in:
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- ... [ backup nbr: (415) 671-4335 ]
- Skype: joinconference ... PIN: 141184#
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130319
- Expecting: all leads of submitted hackathon-clinics projects; all independent contributors who have signed up
- (optional) all Ontology Summit 2013 organizing committee members, invitees, and all who are interested or considering to participate ... this meeting is open to all (as observers).
- Attended: Mike Dean (co-chair), Ken Baclawski (co-chair), Peter P. Yim (scribe), Ali Hashemi, Amanda Vizedom, Anatoly Levenchuk, Astrid Duque Ramos, Joel Bender, Ken Baclawski, Marcela Vegetti, Mari Carmen Suarez Figueroa, Maria Poveda, Michael Grüninger, Mike Dean, Oliver Kutz, Till Mossakowski, Yuriy Milov
- Observers: Brand Niemann,
- Regrets: Samir Tartir, Matthew West,
Agenda Idea:
- collaboratively align and tweak the projects and the teams, so we pare the number down to a few very interesting projects to work on, during the (community picked) Hackathon-Clinics weekends.
- picking the dates of the Hackathon-Clinics weekend(s) and scheduling projects to those dates
- prepare for the Thu 2013.03.28 - session-11 - Getting the "hackathon," "clinics" and related activities going virtual session
- discussing next steps on rolling out the Ontology Summit 2013 Hackathon-Clinics;
Ref.
Agenda & Proceedings:
1. Roll call, review and adopt agenda.
2. Collaboratively align and tweak the projects and the teams, so we pare the number down to a few very interesting projects to work on, during the (community picked) Hackathon-Clinics weekends.
- Consolidation consensus - ref. Hackathon_Clinics page at: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Hackathon_Clinics#nid3OAS
- H1+H2+A1 -> A1
- H3 and O1 will not be featured this time, and will be pursued outside of the H-C activities
- H5 -> A3
- O3+O4 -> O3
- A2 -> H8
- H2 & H7 will be featured if there is enough programing support for them (other than the proposers)
- therefore the selected project (and point-of-contact) are as follows:
- H4. Ontohub-OOR-OOPS!-OQuaRE (TillMossakowski)
- H6. OSummit-content-hack (KenBaclawski)
- H8. Ontology-of-Ontology-Evaluation (AmandaVizedom)
- O2. 15926-ref-data-validation (VictorAgroskin)
- O3. FIBO-Clinic (MikeBennett)
- A1. GOEF-I-Choose (JoanneLuciano)
- A3. BACnet Clinic (JoelBender)
- The project point person(s) - TillMossakowski(H4), KenBaclawski(H6), AmandaVizedom(H8), VictorAgroskin(O2), MikeBennett(O3), JoanneLuciano(A1) and JoelBender(A3) are kindly requested to update their project documents and send them in within this week (by Friday 3/22 if you please) ... please send to [ontology-summit] list, or direct to wiki (then advise the list) and also mail the co-champions a pdf version of the project document for archival purposes.
3. Picking the dates of the Hackathon-Clinics weekend(s) and scheduling projects to those dates
- Candidate-1: Sat(-Sun) 2013.03.30~31
- Candidate-2: Sat(-Sun) 2013.04.06~07
- Candidate-3: Sat(-Sun) 2013.04.13~14
- we will assume that each project will take up one day (the Saturday will be the main event day, the Sunday will be an optional extension day, if the team wants to spend more time finishing up.)
4. Prepare for the Thu 2013.03.28 - session-11 - Getting the "hackathon," "clinics" and related activities going virtual session
- Session plan for the Mar-28 session-11 - developing session page on: http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2013_03_28
- for the 3/28 session - after overview by Mike-Ken-Peter, the 7 project point persons will each do a short presentation (~8 min, 3~5 slides) on their projects
- [action] project point-persons, please be prepared to present on 3/28, slides due 3/26
5. Discussing next steps on rolling out the Ontology Summit 2013 Hackathon-Clinics;
- Peter P. Yim will harmonize the schedule input received and post a proposed hackathon-clinics calendar for everyone on the [ontology-summit] list to review and adopt
6. Any other business
7. Follow-up, next meeting, adjournment.
- let's discuss over the [ontology-summit] (for general and proposal-related issues) and [ontolog-dev] (for low level hackathon details) mailing lists
-- session ended: 10:32 am PDT --
Ontology Summit 2013 Hackathon-Clinic Proposal confcall (n.04) - Fri 2013.03.05
- Date / Start time: Tuesday 2013.03.05 - 7:00am PST / 10:00 am EST / 12:00pm ART / 4:00pm CET / 15:00 GMT/UTC (worldclock)
- Duration: ~1.25 Hour
- Dial-in:
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- ... [ backup nbr: (415) 671-4335 ]
- Skype: joinconference ... PIN: 141184#
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130305
- Expecting: Mike Dean (co-chair), Peter P. Yim (co-chair), Ken Baclawski, and all who plan to participate in the Ontology Summit 2013 "Hackathon" and "Clinics" activities ... (anyone else from the summit organizing team interested and can commit time and effort into this are welcome.)
- Attended:
- Regrets:
Ref. Call for Proposals to the the "hackathon" and "clinics" activities - http://ontolog.cim3.net/forum/ontology-summit/2013-02/msg00056.html
Agenda Idea:
- Make explicit that proposals may include slots for which they want/need additional help (what expertise). Also, there should be a call for, and way for, willing contributors who are not affiliated with one of these projects to register themselves and their skills, for proposers to see (and to generate additional energy/excitement). Having these separate, explicitly, may help with proposal speed / number (suggested by AmandaVizedom)
- encouraging collaboration and partnering in putting together a proposal
- any remaining issues, Q&A ref. the making of a "hackathon" or "clinic" proposal
- re-assess planned timeline and milestones
Ref. 2013.02.21 presentation on the "Hackathon-Clinics" Approach, and the 2013.03.01 clarification
Agenda & Proceedings:
1. Roll call, review and adopt agenda.
2. Taking inventory on candidate projects, and Q&A ...
- Any question on what are projects under: "Hackathon," "Ontology Clinic-A," "Ontology-Clinic-B" & "Application Clinic" ... questions on the proposal writing?
- ref. slides#11
- ref. slides#5, 7 & 9 - what is still ON, what is OFF, and what other projects are on deck?
- ref. OntologySummit2013_Hackathon_Clinics
- * see status in chat-transcript
3. Possible coordination to make as many of these projects into reality as we can
- what gaps are there in people's proposals
- who (indepedent participants) is offering to join - http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Hackathon_Clinics#nid3O1R
- what other resources are available
4. Reviewing the Calendar again - slides#13:
- Announcement of the call for proposals: Thu 2013.02.21
- Deadline for proposal submission: Thu 2013.03.08 (2 weeks to prepare proposal)
- Alignment of projects and teams: 2013.03.09~03.19 (10 days to tweak proposals/projects)
- Announcement of selected projects: Thu 2013.03.21
- Hackathon-Clinics project plan debut: session-11 - Thu 2013.03.28
- Staging of projects: Fri 2013.03.22 to hackathon-clinics weekend (see below; 1 week+)
- Hackathon-Clinics Weekends:
- Candidate-1: Fri-Sat 2013.03.30~31
- Candidate-2: Fri-Sat 2013.04.06~07
- Candidate-3: Fri-Sat 2013.04.13~14
- preparation of writeup/presentation/demo - 2013.04.15~29 (2 weeks+)
- writeup/presentation/demo material due - 2013.04.30 (2 days before event)
- Presentation / Demo: Thu 2013.05.02 (Symposium Day-1)
- (?)Award Ceremony: Fri 2013.05.03 (Symposium Day-2)
- do we want/need to extend the 2013.03.08 (this Thursday) proposal submission deadline?
- Peter P. Yim: looks like we don't need to ... however, Again, proposal deadline is 2013.03.08 (this Thursday) ... anyone who needs an extra day or two for this, should write <peter.yim@cim3.com> offline about it.
5. Any other business
- Yuriy Milov: why limit the hackathon to 1 or 2 days ... why not 4 weeks?
- Answer: [ppy] the constraint is in our ability to sustain an open distributed collaboration workspace for intensive work for a long time ... we should recognize the project partner can (and would) be working independent of those 1 or 2 days; just treat those 1 or 2 days as the "community collaboration" days.
6. Action items
- see details in chat-transcript
7. Follow-up, next meeting, adjournment
- let's discuss over the [ontology-summit] (for general and proposal-related issues) and [ontolog-dev] (for low level hackathon details) mailing lists
-- session ended: 8:30 am PST --
Ontology Summit 2013 Survey and Website sub-team confcall (n.03) - Fri 2013.02.22
- Date / Start time: Friday 2013.02.22 - 6:00am PST / 9:00 am EST / 11:00am ART / 3:00pm CET / 14:00 GMT/UTC
- Duration: ~1.0 Hours (for survey); maybe another 30 minutes on website planning
- Dial-in:
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- ... [ backup nbr: (415) 671-4335 ]
- Skype: joinconference ... PIN: 141184#
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130222
- Expecting: Mike Denny (chair), Ken Baclawski, Simon Spero, Amanda Vizedom, Marcela Vegetti, Ali Hashemi, Peter P. Yim, ... (anyone else from the summit organizing team interested and can commit time and effort into this are welcome.)
- Attended: Mike Denny (chair), Ken Baclawski, Simon Spero, Amanda Vizedom, Marcela Vegetti, Ali Hashemi, Peter P. Yim (scribe)
- Regrets:
Ref. 2013.02.15 organizing committee discussion: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013/GettingOrganized#nid3M2R
Agenda & Proceedings:
1. Roll call, review and adopt agenda.
- attendees - see above
- we ran into problems with the chat-room (soaphub server seems to be down), please go to the google-doc here
2. 2013-Survey design, implementation and deployment discussion - we want to come away with a plan for: (ref.)
- 1) finalizing the list of software capabilities;
- Mike Denny: feedback collected, looks like only minor changes needed. Mike Denny will get a revised list out by cob Thu 2013.02.28 [action: MikeDenny]
-
- Mike Denny: I will be traveling for 10 days starting Fri 2013.03.01 (will miss the organizing committee meeting on Mar-1 too)
-
- Mike Denny: feedback collected, looks like only minor changes needed. Mike Denny will get a revised list out by cob Thu 2013.02.28 [action: MikeDenny]
- 2) reviewing prototypes from candidate software providers;
- 3) publishing the survey in a convenient form ... reviewing:
- prototype on LimeSurvey from Simon Spero - Simon: (for now) see: alt-A (scrn-shot) & alt-B (scrn-shot)
- prototype on Ontolog PSMW from Ken Baclawski ... Ken: give it a try ...
- http://ontolog-02.cim3.net/wiki/OntologySummit2013_Survey_Prototype_Untabbed
- http://ontolog-02.cim3.net/wiki/OntologySummit2013_Survey_Prototype_Tabbed
- we are missing the the header tabs extension at the ontolog-02 wiki (for now), so all of the questions show up as separate sections on a single page rather than tabs ... this is what it should look like.
- note that one will have to log in, to contribute to the survey (the login anyone is using at the Ontolog Wiki now should also work on the OntologPSMW)
- [decision] Mike Denny & ALL: we will do the survey on the Ontolog PSMW
- Mike Denny with work with Ken Baclawski to develop the survey form - will use the [ontolog-dev] mailing list for the communications (so we can document the process and details for future reference.)
- 4) collecting and publishing the survey results.
- [action - KenBaclawski] will have the initial survey ready by Mon 2013.02.25 ... Mike will provide comments to Ken (in fact, Mike Denny can even edit the survey himself, if he wants to; afterall it is on a wiki).
- [action - Mike Denny, KenBaclawski] will aim at having the survey instrument done (all questions and content finalized) by - Thu 2013.02.28
- [action - Mike Denny, et al.] will also discuss how to circulate and promote the survey over [ontology-summit-org] list
- Peter will add Ken to the [ontology-summit-org] list
- [action - MikeDenny] we will aim to release on Wed 2013.03.13
3. Website design, implementation and deployment discussion
- Marcela: see my SMW prototype (scrn-shot)
- ... and the ontology I am using for this prototype
- Peter: we will develop the Ontology Summit 2013 PSMW site on the wiki instance at - http://ontolog-02.cim3.net/wiki/
- our target is to create a "prettier" website (as a start: like what we had last year) - ref. http://ontolog.cim3.net/OntologySummit/2012/
- we need to work on the look-and-feel too - need some UI, css and skin development skills
- [action] let's continue the discussion on the [ontolog-dev] list
4. Any other business
- exposing/publishing 2012-survey work ... [discussion deferred]
5. Action items
- see above
6. Follow-up, next meeting, adjournment
-
- no real-time meeting planned. We'll do it asynchronously on the mailing lists (as discussed above.)
-- session ended: 7:57am PST --
OOR Ontology Summit 2013 Hackathon-Clinic Team Meeting (n.02) - Tue 2013.02.05
- Date / Start time: Tuesday 2013.02.05 - 7:30am PST / 10:30am EST / 4:30pm CET / 15:30 GMT/UTC
- Duration: 1.5 Hours
- Attendees: Peter P. Yim (chair), Ken Baclawski, Maria Poveda, Mike Dean, Mike Denny, Oliver Kutz, Till Mossakowski, Yuriy Milov
Full details at: OOR/ConferenceCall_2013_02_05
Software for Ontology Evaluation: Exploratory Meeting - Fri 2013.01.25
Conference call details:
- Date / Start time: Friday 2013.01.25 - starting 8:00am PST / 11:00am EST / 5:00pm CET / 4:00pm GMT/UTC
- ref. world clock
- Expected Duration: ~1.5 Hrs.
- Dial-in:
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- ... [ backup nbr: (415) 671-4335 ]
- Skype: joinconference ... PIN: 141184#
- Phone (US): +1 (206) 402-0100 ... PIN: 141184# , or
- In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130125
- Invited: Ken Baclawski, David Leal, Victor Agroskin, Till Mossakowski, Michael Grüninger, Mike Dean, Michael Denny, Peter P. Yim, ... also, Leo Obrst, Steve Ray, Kingsley Idehen, Simon Spero, Joanne Luciano, Yuriy Milov, Harold Solbrig, Tania Tudorache, Trish Whetzel, Jie Bao,
- this is an open meeting, besides the those invited (above), everyone else who are interested in supporting the track-D or the potential "hackathon" work are welcome; those on the [ontology-summit-org] list; and other invitees of the organizing committee.
- Attended: Peter P. Yim (chair), David Leal, Ken Baclawski, Mike Denny, Mike Bennett, Till Mossakowski, Yuriy Milov
- Regrets: Tania Tudorache, Paul Alexander, Mike Dean, Todd Schneider, Victor Agroskin, Steve Ray (traveling), Leo Obrst (will try to join), Joanne Luciano (will try to join),
- Add your Agenda Ideas and anything you want discussed at this meeting below:
- ...
Agenda & Proceedings:
{{
[ chat transcript ]
- Opening, roll call, self-intros, adopt agenda
- What are we trying to achieve?
- quick review of the the Track-D intro slides from the Ontology Summit 2013 Launch Event
- Noting: already on the Master Calendar -
- Thu 2013.02.14 - session-05 - Track-D
- Thu 2013.02.21 - session-06 - Synthesis-I; proposed Communique Outline; exploring a "hackathon"
- Thu 2013.03.21 - session-10 - Track-D
- Thu 2013.03.28 - session-11 - preparing for a "hackathon" and/or related activities
- Thu 2013.04.25 - session-15 - pre-symposium prep
- Thu & Fri 2013.05.02 & 03 - Symposium (F2F)
- aligning what we mean by the "hackathon"
- what: need to define the "challenge" between now and March
- how: distributed network of power hack-teams (who would probably be co-located)
- when: weekends between 2013.03.28 and 2013.04.25 ... maybe earlier (to avoid conflict with students' final exams)
- Getting organized
- (i) (A) Research, Survey, Enumerate "what's out there," and (B) showcase exemplary software environments and tools for evaluating ontologies
- who's on board: Michael Denny (will lead 'Research, Survey, Enumerate "what's out there"' effort), Mike Bennett, ...
- candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss
- (ii) User communities that have real needs to evaluate ontologies, to provide us the use cases, upon which we can ground our work
- who's on board: (Manufacturing / Process Industry) David Leal, (Finance) Mike Bennett, (Earth Science) PeterFox (added: JL/2013.01.28) ... RDA?? Biomedical Informatics??
- candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss
- (iii) Communities/teams of Ontology Software developers and tool-makers, who will join us in this track's activities, especially in terms of prototyping and implementations that could help advance the state-of-the-art in software and systems for ontology evaluation
- who's on board: Till Mossakowski, Ken Baclawski, Yuriy Milov, ... Victor Agroskin, Mike Dean
- candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss
- (i) (A) Research, Survey, Enumerate "what's out there," and (B) showcase exemplary software environments and tools for evaluating ontologies
- Any other business
- Yuriy Milov suggested, and there was consensus among those at the meeting, that, for the hackathon work, all hack-teams will put their work on the Eclipse development environment.
- Action items
- Next meeting, wrap-up
- [consensus] (for now) we will not make further attempts to confer synchronously (it's too difficult) and will defer to asynchronous transactions
- we will communicate all other outstanding issues via this wiki page, and via discussions on the mailing list(s) -
- "[ontology-summit] " for teams (i) & (ii) work
- "[ontolog-dev] " for team (iii) work ... PPY: I will subscribe everyone on this team to this list
session adjourned: 9:10 am PST -- notes taken by: Peter P. Yim / 2013.01.25-9.14am PST All participants, please review and edit to enhance accuracy and granularity of the documented proceedings.