Actions

Ontolog Forum

Ontology Summit 2013 Launch Event - Thu 2013-01-17

  • Topic: OntologySummit2013: "Ontology Evaluation Across the Ontology Lifecycle"
  • Champions:
    • Track A: Intrinsic Aspects of Ontology Evaluation - Dr. Leo Obrst & Dr. SteveRay
    • Track B: Extrinsic Aspects of Ontology Evaluation - Mr. Terry Longstreth & Dr. ToddSchneider
    • Track C: Building Ontologies to Meet Evaluation Criteria - Dr. Matthew West & Mr. MikeBennett
    • Track D: Software Environments for Evaluating Ontologies - Dr. Joanne Luciano & Mr. PeterYim
    • Ontology Summit Community Library - Dr. AmandaVizedom
    • Infrastructure, Process, Logistics - Mr. PeterYim

Abstract: Goals & Objectives

OntologySummit2013 Theme: "Ontology Evaluation Across the Ontology Lifecycle"

This is our 8th Ontology Summit, a joint initiative by NIST, Ontolog, NCOR, NCBO, IAOA & NCO_NITRD with the support of our co-sponsors. The theme adopted for this Ontology Summit is: "Ontology Evaluation Across the Ontology Lifecycle." In an earlier planning session last month, the community and subsequently, the summit organizing team brainstormed on how best to frame the issues. These inputs were carefully reviewed and synthesized by the Ontology Summit Organizing Committee and its leadership. It is this plan and program that we will be discussing with everyone during today's launch event.

Currently, there is no agreed methodology for development of ontologies, and there are no universally agreed metrics for ontology evaluation. At the same time, everybody agrees that there are a lot of badly engineered ontologies out there, thus people use -- at least implicitly -- some criteria for the evaluation of ontologies.

During the next 3 to 4 months (16 weeks, to be exact) when the Summit is in session, we seek to identify best practices for ontology development and evaluation. We will consider the entire lifecycle of an ontology -- from requirements gathering and analysis, through to design and implementation. In this endeavor, the Summit will seek collaboration with the software engineering and knowledge acquisition communities. Research in these fields has led to several mature models for the software lifecycle and the design of knowledge-based systems, and we expect that fruitful interaction among all participants will lead to a consensus for a methodology within ontological engineering. Following earlier Ontology Summit practice, the synthesized results of this season's discourse will be published as a Communiqué.

The 2013 Ontology Summit officially begins with today's launch event. We are initiating a series of topical online discussions, virtual panel sessions, studies, prototyping, synthesis exercises, etc. which will take place, virtually, over the next 3 months. All of these will come together with a face-to-face meeting on May 2 & 3 in Gaithersburg, Maryland, USA at the National Institute of Standards and Technology (NIST).

See developing details at: OntologySummit2013 (homepage for this summit)

Agenda

Ontology Summit 2013 Launch

  • Session Format: this is a virtual session conducted over an augmented conference call - [ slides ]

Proceedings

Please refer to the above

IM Chat Transcript captured during the session

see raw transcript here.

(for better clarity, the version below is a re-organized and lightly edited chat-transcript.)

Participants are welcome to make light edits to their own contributions as they see fit.

-- begin in-session chat-transcript --

[09:00] Peter P. Yim: Welcome to the

Ontology Summit 2013 Launch Event - Thu 2013-01-17

  • Summit Theme: Ontology Evaluation Across the Ontology Lifecycle

Logistics:

  • (if you haven't already done so) please click on "settings" (top center) and morph from "anonymous" to your RealName (in WikiWord format)
  • Mute control: *7 to un-mute ... *6 to mute
  • Can't find Skype Dial pad?
    • for Windows Skype users: it's under the "Call" dropdown menu as "Show Dial pad"
    • for Linux Skype users: please note that the dial-pad is only available on v4.1 (or later or the earlier Skype versions 2.x,)

if the dialpad button is not shown in the call window you need to press the "d" hotkey to enable it.

Proceedings:

[09:18] anonymous1 Matthew West

[09:21] anonymous1 morphed into Jie Zheng

[09:29] anonymous2 morphed into AndreyBayda

[09:29] anonymous3 morphed into Maria Copeland

[09:29] anonymous morphed into MariCarmenSuarezFigueroa

[09:29] anonymous4 morphed into ElieAbiLahoud

[09:29] anonymous morphed into George Strawn

[09:30] anonymous1 morphed into Max Petrenko

[09:31] anonymous morphed into Bob Schloss

[09:31] anonymous1 morphed into Karen Stocks

[09:32] anonymous morphed into Mark Fox

[09:33] anonymous1 morphed into Bruce Bray

[09:33] Mark Fox: Michael Grüninger is at IBM TJ Watson today. It may take a while for him to get on.

[09:34] anonymous morphed into Mike Riben

[09:34] anonymous morphed into Ram D. Sriram

[09:35] anonymous morphed into Trish Whetzel

[09:36] Todd Schneider: Peter, is VNC working?

[09:36] anonymous morphed into Ramona Walls

[09:37] anonymous1 morphed into Gerald Radack

[09:37] Terry Longstreth: VNC's working for me

[09:38] Amanda Vizedom: Note about VNC: there is sometimes a bit of a lag between when you first

connect to the vnc hopper and when it pops up the password prompt for the share. Give it a minute if

it seems not to be working.

[09:39] Todd Schneider: Peter, do have a limiter available?

[09:40] Peter P. Yim: -- session started 9:39am PST --

[09:41] Peter P. Yim: == Michael Grüninger starts the session off on behalf of the Ontology Summit

General Co-chairs ...

[09:52] anonymous morphed into Bob Schloss

[09:53] Peter P. Yim: == Co-organizers of the Ontology Summit presenting their perspectives and

expectation ...

[09:53] Peter P. Yim: Representing the Co-organizers: (3KN4)

ONTOLOG - Dr. Leo Obrst (3KN5)

NIST - Dr. Ram D. Sriram (3KN6)

NCOR - Dr. Fabian Neuhaus (on behalf of Professor BarrySmith) (3KN7)

NCBO - Dr. Trish Whetzel (on behalf of Professor MarkMusen) (3KN8)

IAOA - Professor Michael Grüninger (3KN9)

NCO_NITRD - Dr. George Strawn (3KNA)

[09:56] anonymous1 morphed into Max Petrenko

[09:58] anonymous morphed into Atilla Elci

[09:56] Steve Ray: (ref. the NIST report on the "Workshop on Ontology Evaluation" at NIST held in

Oct-2007, later published in Oct-2011, which Ram D. Sriram was citing in his opening talk) @Ram: Could

you post the link to the NIST report to the chat room here?

[10:04] Ram D. Sriram: @Steve: Since the report was WERBED it should be in the publication database.

[10:05] Bruce Bray: @Ram Is this the evaluation mini-series you referenced?

http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologyMeasurementEvaluation

[10:07] Ram D. Sriram: @steve: Here is the link:

http://www.nist.gov/manuscript-publication-search.cfm?pub_id=907201

[10:13] Peter P. Yim: == Track Champion intros ...

Peter P. Yim: Track A: Intrinsic Aspects of Ontology Evaluation - Dr. Leo Obrst & Dr. Steve Ray (3KT1)

Track B: Extrinsic Aspects of Ontology Evaluation - Mr. Terry Longstreth & Dr. Todd Schneider (3KT2)

Track C: Building Ontologies to Meet Evaluation Criteria - Dr. Matthew West & Mr. Mike Bennett (3KT3)

Track D: Software Environments for Evaluating Ontologies - Dr. Joanne Luciano & Mr. Peter P. Yim (3KT4)

[10:15] Anatoly Levenchuk: Draft of an OMG Standard (expecting be a standard in February of 2013) for

software engineering methodologies -- http://semat.org/wp-content/uploads/2012/02/2012-11-01.pdf

(this is newest of situational method engineering standards, with lessons learned from OPF, SPEM 2,

ISO 24744). Language/ontology for capturing best practices.

[10:16] Terry Longstreth: My concern about separation of classes and instances: is it not the case

that every instance is a representative of an idempotent class?

[10:19] Steve Ray: @Terry: This bullet derives from some of the classic examples of misuse, such as

calling "Pinot Noir" an instance of "Grape" rather than a subclass of "Grape".

[10:21] Terry Longstreth: Thanks Steve. I'm more concerned with the situation where an artifact is

the best description of the class; as in Biology for example.

[10:25] Amanda Vizedom: @Terry: it sounds like you're thinking in terms of prototype-based

characterization of classes, yes? That is an interesting modeling practice, used in some

areas/projects, but not especially widespread or typical in ontological modeling. It would be

interesting and worth while to consider when such modeling is, or isn't, a good fit for some

modeling problem.

[10:25] Steve Ray: @Terry: Even in your case, there are archetypical properties of an artifact, and

instance properties (such as its temporal existence, physical location, etc.

[10:30] Amanda Vizedom: @Terry, @Steve: Relatedly, the kinds of assertions that properly specify a

class can be importantly dependent on the logic of the language and the inference capabilities

supporting it. For example, in a monotonic system, things that are typical of, but not necessary to,

instances of a class should not be axioms on that class. In nonmonotonic systems, rules regarding

typical characteristics, over-ridable by more specific information, can be much more useful.

[10:33] Terry Longstreth: Sorry, I forgot how to unmute, so couldn't chime in. One point we didn't

delve into in our charts was that the instance data may be used by automated reasoning systems to

extend the conceptual scope of an ontology.

[10:37] Matthew West: @Terry: Yes we do a lot of that in ISO 15926.

[10:43] Peter P. Yim: == Intro to the Ontology Summit 2013 community library, communique, symposium, administrivia

Ontology Summit Community Library - Dr. Amanda Vizedom (3KT5)

OntologySummit2013_Communique - Co-Lead Editors: Amanda Vizedom & Fabian Neuhaus (3KT7)

Symposium overview and vision from the Symposium Co-chairs - Ram D. Sriram & Mike Dean (3KT8)

Infrastructure, Process, Logistics - Mr. Peter P. Yim (3KT6)

[10:47] anonymous morphed into Rex Brooks

[10:52] RosarioUcedaSosa: @Amanda, can you add me to the repository?

[10:59] Amanda Vizedom: @Rosario, please go to zotero.org and create a sign-in account, then go to

http://www.zotero.org/groups/ontologysummit2013 and join. I'll then approve you ASAP

[11:00] Max Petrenko: Amanda, I have also submitted a request to join

[11:00] Todd Schneider: Have to go. Cheers.

[11:01] Amanda Vizedom: @max, you're in. :-)

[11:01] Max Petrenko: Thanks!

[11:02] Terry Longstreth: In earlier meetings, we seemed to have a consensus that the order should be

Track B,A,C,D.

[11:08] Peter P. Yim: == Q&A and Open Discussion ... .

[11:17] Peter P. Yim: Re: co-sponsors -

http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013#nid3J0J - we will be assuming that all

co-sponsors from last year will continue with us this year (please write me otherwise) ... ALL:

please help get your institution/employer to sign-up as a co-sponsor!

[11:21] Matthew West: == Conclusion / Follow-up / Announcements / Next session (Thu 2013.01.24) ...

[11:22] Peter P. Yim: -- session ended: 11:21am PST --

-- end of in-session chat-transcript --

  • Further Question & Remarks - please post them to the [ ontology-summit ] listserv
    • all subscribers to the previous summit discussion, and all who responded to today's call will automatically be subscribed to the [ ontology-summit ] listserv
    • if you are already subscribed, post to <ontology-summit [at] ontolog.cim3.net>
    • (if you are not yet subscribed) you may subscribe yourself to the [ ontology-summit ] listserv, by sending a blank email to <ontology-summit-join [at] ontolog.cim3.net> from your subscribing email address, and then follow the instructions you receive back from the mailing list system.
    • (in case you aren't already a member) you may also want to join the ONTOLOG community and be subscribed to the [ ontolog-forum ] listserv, when general ontology-related topics (not specific to this year's Summit theme) are discussed. Please refer to Ontolog membership details at: http://ontolog.cim3.net/cgi-bin/wiki.pl?WikiHomePage#nid1J
      • kindly email <peter.yim@cim3.com> if you have any question.

Additional Resources


For the record ...

How To Join (while the session is in progress)

Conference Call Details

  • Date: Thursday, 17-Jan-2013
  • Start Time: 9:30am PST / 12:30pm EST / 6:30pm CET / 17:30 GMT/UTC
  • Expected Call Duration: ~2.0 hours
  • Dial-in:
    • Phone (US): +1 (206) 402-0100 ... (long distance cost may apply)
      • ... [ backup nbr: (415) 671-4335 ]
      • when prompted enter Conference ID: 141184#
    • Skype: joinconference (i.e. make a skype call to the contact with skypeID="joinconference") ... (generally free-of-charge, when connecting from your computer)
      • when prompted enter Conference ID: 141184#
      • Unfamiliar with how to do this on Skype? ...
        • Add the contact "joinconference" to your skype contact list first. To participate in the teleconference, make a skype call to "joinconference", then open the dial pad (see platform-specific instructions below) and enter the Conference ID: 141184# when prompted.
      • Can't find Skype Dial pad? ...
        • for Windows Skype users: Can't find Skype Dial pad? ... it's under the "Call" dropdown menu as "Show Dial pad"
        • for Linux Skype users: please note that the dial-pad is only available on v4.1 (or later; or on the earlier Skype versions 2.x,) if the dialpad button is not shown in the call window you need to press the "d" hotkey to enable it. ... (ref.)
  • Shared-screen support (VNC session), if applicable, will be started 5 minutes before the call at: http://vnc2.cim3.net:5800/
    • view-only password: "ontolog"
    • if you plan to be logging into this shared-screen option (which the speaker may be navigating), and you are not familiar with the process, please try to call in 5 minutes before the start of the session so that we can work out the connection logistics. Help on this will generally not be available once the presentation starts.
    • people behind corporate firewalls may have difficulty accessing this. If that is the case, please download the slides above (where applicable) and running them locally. The speaker(s) will prompt you to advance the slides during the talk.
  • In-session chat-room url: http://webconf.soaphub.org/conf/room/summit_20130117
    • instructions: once you got access to the page, click on the "settings" button, and identify yourself (by modifying the Name field from "anonymous" to your real name, like "JaneDoe").
    • You can indicate that you want to ask a question verbally by clicking on the "hand" button, and wait for the moderator to call on you; or, type and send your question into the chat window at the bottom of the screen.
    • thanks to the soaphub.org folks, one can now use a jabber/xmpp client (e.g. gtalk) to join this chatroom. Just add the room as a buddy - (in our case here) summit_20130117@soaphub.org ... Handy for mobile devices!
  • Discussions and Q & A:
    • Nominally, when a presentation is in progress, the moderator will mute everyone, except for the speaker.
    • To un-mute, press "*7" ... To mute, press "*6" (please mute your phone, especially if you are in a noisy surrounding, or if you are introducing noise, echoes, etc. into the conference line.)
    • we will usually save all questions and discussions till after all presentations are through. You are encouraged to jot down questions onto the chat-area in the mean time (that way, they get documented; and you might even get some answers in the interim, through the chat.)
    • During the Q&A / discussion segment (when everyone is muted), If you want to speak or have questions or remarks to make, please raise your hand (virtually) by clicking on the "hand button" (lower right) on the chat session page. You may speak when acknowledged by the session moderator (again, press "*7" on your phone to un-mute). Test your voice and introduce yourself first before proceeding with your remarks, please. (Please remember to click on the "hand button" again (to lower your hand) and press "*6" on your phone to mute yourself after you are done speaking.)
  • RSVP to peter.yim@cim3.com appreciated, ... or simply just by adding yourself to the "Expected Attendee" list below (if you are a member of the team.)
  • Please note that this session may be recorded, and if so, the audio archive is expected to be made available as open content, along with the proceedings of the call to our community membership and the public at-large under our prevailing open IPR policy.

Attendees