Actions

Ontolog Forum

Ontology Summit 2013: May 2~3, 2013 Symposium (Face-to-Face Workshop)

The culmination of Ontology Summit 2013 - a 2-day workshop and symposium event at the Gaithersburg campus of NIST that supported both face-to-face and virtual (remote) participation!

P1100302c.jpg . P1100322c.jpg . P1100388c.jpg . P1100363c.jpg ... [more pics]

Theme: Ontology Summit 2013: Ontology Evaluation Across the Ontology Lifecycle

8th in the series of a 3-month annual event by and for the Ontology Community. This Summit is co-organized by Ontolog, NIST, NCOR, NCBO, IAOA & NCO_NITRD

  • Ontology Summit 2013: Symposium Co-chairs: Dr. Ram D. Sriram & Mr. MikeDean

Goals

Currently, there is no agreed methodology for development of ontologies, and there are no universally agreed metrics for ontology evaluation. At the same time, everybody agrees that there are a lot of badly engineered ontologies out there, thus people use -- at least implicitly -- some criteria for the evaluation of ontologies.
The goal for Ontology Summit 2013 is to identify best practices for ontology development and evaluation. We will consider the entire lifecycle of an ontology -- from requirements gathering and analysis, through to design and implementation. In this endeavor, the Summit will seek collaboration with the software engineering and knowledge acquisition communities. Research in these fields has led to several mature models for the software lifecycle and the design of knowledge-based systems, and we expect that fruitful interaction among all participants will lead to a consensus for a methodology within ontological engineering. Following earlier Ontology Summit practice, the synthesized results of this season's discourse will be published as a Communique.
In the course of the Symposium, we shall distill the results from this summit's 3.5 months of research, discourse, analysis, synthesis and to present this knowledge in the form of presentations and a broadly distributed communique collective produced by the participants of this OntologySummit.

Resources

Program / Agenda

Thursday, May 2, 2013 (Green Auditorium)

Day 1: ... [ Archives ]

8:30 am: Breakfast and Setup

9:00 am: Welcome by Dr. Charles Romine, Director of the Information Technology Laboratory, NIST

9:15 am: General Ontology Summit Symposium Introductions and Information - Ram D. Sriram and Mike Dean, Symposium Co-chairs

9:25 am: Ontology Summit Opening Remarks - Matthew West and Michael Grüninger, Ontology Summit 2013 General Co-chairs ... [ slides ]

9:30 am: Keynote 1: Dr. James Warren, NIST, Materials Genome Initiative ... [ slides ]

10:20 am: Ontologies in the Materials Genome Initiative - Alden Dima ... [ slides ]

10:30 am: Break

11:00 am: Panel: Ontologies in the Materials Genome Initiative - Fabian Neuhaus (moderator), James Warren, Alden Dima, Mike Bennett, Leo Obrst, Steve Ray

11:30 am: Discussion: Track-A Intrinsic Aspects of Ontology Evaluation - Co-Champions: Leo Obrst & Steve Ray ... [ slides ]

12:00 pm: Discussion: Track-B Extrinsic Aspects of Ontology Evaluation - Co-Champions: Terry Longstreth & Todd Schneider ... [ slides ]

12:30 pm: Lunch and Discussion Break

2:00 pm: Keynote 2: David Newman, Wells Fargo, Financial Industry Business Ontology (FIBO) ... [ slides ]

3:00 pm: Break

3:30 pm: Discussion: Track-C Building Ontologies to Meet Evaluation Criteria - Co-Champions: Matthew West & Mike Bennett ... [ slides ]

4:00 pm: Discussion: Track-D Software Environments for Evaluating Ontologies - Co-Champions: Michael Denny, Ken Baclawski & Peter P. Yim ... [ slides ] . [ survey ] . [ responses ]

4:30 pm: Ontology Summit 2013 Web Site - Co-Champions: Marcela Vegetti & Ali Hashemi ... [ slides ]

4:45 pm: Ontology Summit 2013 Community Library (bibliography) - Amanda Vizedom ... [ slides ]

5:00 pm: End of Day 1 Business

6:30 pm: Summit Dinner at Growlers Brew Pub, 227 E. Diamond Ave., Gaithersburg

Friday, May 3, 2013 (Portrait Room)

Day 2: ... [ Archives ]

8:30 am: Breakfast and Setup

9:00 am: Keynote 3: Dr. Olivier Bodenreider, National Institutes of Health, Quality Assurance of Biomedical Ontologies and Derived Artifacts in the Era of the Meaningful Use of Electronic Health Record Data ... [ slides ]

10:00 am: Presentation of the Communique: Amanda Vizedom & Fabian Neuhaus ... [ slides ] . [ [[OntologySummit2013_Communique|OntologySummit2013_Communique]] ]

10:45 am: Affirmation of Communique by Community: Matthew West & Michael Grüninger

11:00 am: Break

11:30 am: Hackathon-Clinics Overview - Co-Champions: Mike Dean, Ken Baclawski, Peter P. Yim ... [ slides ]

11:40 am: HC-01 BACnet Ontology Hackathon - Joel Bender ... [ slides ]

12:00 pm: HC-02 The General Ontology Evaluation Framework (GOEF) & the I-Choose Use Case - Joanne Luciano, James Michaelis, DjokoSigitSayogo, NicolauDePaula ... [ slides ]

12:20 pm: HC-03 Evaluation of OOPS! OQuaRE and OntoQA for FIBO Ontologies - Mike Bennett, MariaPovedaVillalon, AstridDuqueRamos, Samir Tartir, et al. ... [ slides ]

12:40 pm: Lunch

1:40 pm: HC-04 Ontology Summit 2013 Content Hack: Leveraging Semantics on OntologPSMW - Ken Baclawski, et al. ... [ slides ]

2:00 pm: HC-05 Hackathon: Ontology of Ontology Evaluation - Amanda Vizedom ... [ slides ]

2:20 pm: HC-06 ISO 15926 Reference Data Validation - Victor Agroskin, Anatoly Levenchuk, et al. ... [ slides ]

2:40 pm: HC-07 Ontohub-OOR-OOPS! Integration - Till Mossakowski, DanielCouteVale, Ken Baclawski, MariaPovedaVillalon, et al. ... [ slides ]

3:00 pm: Announcement and Award of the First IAOA Best Ontology Summit Hackathon-Clinic Prize - Panel of Judges: Leo Obrst, Matthew West & Michael Grüninger

3:10 pm: Next Steps and Conclusion: Michael Grüninger, Matthew West, Ram D. Sriram, Mike Dean ... [ slides ]

3:30 pm: End of Day 2 Business

3:30 pm: Available for BOFs, small groups, etc.

  • Ontology of Ontology Evaluation: Touch base about continuing work - Amanda Vizedom

5:00 pm: Adjourn

Transcript of the online chat during the session

Thu 2013.05.02

see raw transcript here.

(for better clarity, the version below is a re-organized and lightly edited chat-transcript.)

Participants are welcome to make light edits to their own contributions as they see fit.

-- begin of chat session --

[06:03] Peter P. Yim: Welcome to the

Ontology Summit 2013 Symposium (Day-1) 2-May-2013

Session details: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Symposium

Dial-in details: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013/WorkshopRegistration#nid3P38

Agenda: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Symposium#nid3P64

Attendees: AdrianBaranyuk, Ali Hashemi, Amanda Vizedom, AstridDuqueRamos, Barry Smith, Ben Bovee,

Bob Schloss, Bobbin Teegarden, Bruce Bray, Carmen Chui, Christian Hempelmann, Chuck Ward, Doug Foxvog,

Elizabeth Florescu, Fabian Neuhaus, Fouad Ramia, Frank Olken, GaryBergCross, Gary Gannon, Jim Jacobs,

LaVernPritchard, Michael Barnett, Marc Halpern, Matthew Kaufman, Matthew West, Mike Bennett, Mike Dean,

Oliver Kutz, Pavithra Kenjige, Peter P. Yim, Simon Spero, Steve Ray, Sylvia Spengler, Symposium (SteveRay),

Terry Longstreth, Till Mossakowski, Torsten Hahmann, anonymous, anonymous1, mpavel, vnc2

proceedings:

[05:54] anonymous morphed into Sylvia Spengler

[05:56] Symposium (SteveRay): Welcome everyone.

[06:09] Sylvia Spengler: can people hear on the phone?

[06:09] Till Mossakowski: not very well

[06:10] Symposium (SteveRay): I will go check with the A/V folks.

[06:11] Till Mossakowski: I have to put my local volume at maximum, and then I still the outcome is

so low-volume that it is hard to understand everything.

[06:11] Sylvia Spengler: I thought it was my phone but nothing works.

[06:12] anonymous morphed into Doug Foxvog

[06:13] Peter P. Yim: more slides uploaded ... please refresh your agenda page to see their active links

[06:15] Symposium (SteveRay): OK, sound should be good now. Is it OK?

[06:16] Symposium (SteveRay): Also, could the call-in folks please mute your phones when you aren't

speaking? We had some microphone rustling sounds earlier.

[06:16] Till Mossakowski: yes, better now

[06:17] Sylvia Spengler: much better now

[06:19] Till Mossakowski: currently, I cannot understand a word...

[06:20] Till Mossakowski: better again

[06:20] Symposium (SteveRay): OK, let us know if there are problems during the day.

[06:25] anonymous morphed into Frank Olken

[06:25] Frank Olken: Sylvia, Can you hear now??

[06:26] Sylvia Spengler: yes, but some speak much more quietly....

[06:27] anonymous morphed into Chuck Ward

[06:27] Till Mossakowski: is there a vnc screen, or do we have to download each slide set

individually?

[06:30] Symposium (SteveRay): Regarding VNC, yes, it is the same VNC as our normal Thursday calls.

[06:27] Frank Olken: Peter P. Yim & George Strawn announced that next year's Ontology Summit Symposium

will be held at NSF/NITRD near Ballston Metro station in Arlington, VA.

[06:30] Peter P. Yim: next year's Ontology Summit Symposium will be hosted by NCO/NITRD ...

[06:31] anonymous morphed into Elizabeth Florescu

[06:40] anonymous morphed into Jim Jacobs

[06:43] Peter P. Yim: == James Warren giving the Keynote-1 talk on the Material Genome Initiative (MGI)

[06:44] Sylvia Spengler: can the speaker please speak up?

[06:50] Symposium (SteveRay): Is that better? They turned up the gain on his mic.

[06:51] Symposium (SteveRay): Question on the relationship with DARPA's manufacturing program

[06:52] Doug Foxvog: Remote users should turn off their microphones. We're getting some clicks and

noises over the loudspeakers at NIST.

[07:07] Terry Longstreth: Q: J. Warren - did the conference/MGI itself deal with Intellectual

property, patents and copyright ?

[07:08] Sylvia Spengler: Can presenters please repeat the questions!!

[07:09] Doug Foxvog: The question was what Terry put on the chat.

[07:09] Symposium (SteveRay): This last question was Terry's question above

[07:09] Symposium (SteveRay): Terry is raising the issue that, for example, seismic data is hard to

get from oil companies?

[07:10] Bob Schloss: There is a multi-national initiative starting, called the Research Data

Alliance, http://rd-alliance.org that is in the organizing stage. Some of the technical conventions

about metadata etc they are addressing would also be relevant to MGI. Also, the World Wide Web

consortium is planning to increase their work on representations of web-accessible data collections

(I was at their "Open Data" meeting in London last week), and could help on some of this work.

[07:27] Peter P. Yim: == Alden Dima giving a brief on CALPHAD, a project in the Material Genome area

where ontologies are coming into play

[07:27] Peter P. Yim: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Symposium#nid3RSZ ...

slides will be uploaded later

[07:36] anonymous morphed into Marc Halpern

[07:40] Symposium (SteveRay): Break until 11am Eastern time (10:40 EDT now).

[07:44] Peter P. Yim: Slides from Alden Dima is now online ... please refresh the agenda page (url above)

to see it. His questions on the last slide will be part of the panel discussion that follows after

the break

[08:09] Peter P. Yim: == session resuming - Panel Discussion -

http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Symposium#nid3Q0N

[08:28] anonymous morphed into Torsten Hahmann

[08:31] anonymous morphed into Matthew Kaufman

[08:41] Symposium (SteveRay): == Track A session - Intrinsic Aspects of Ontology Evaluation -

Leo Obrst presenting

[08:45] Doug Foxvog: The panel discussion brought up the question as to what the requirements are for

an ontology being developed. Often it turns out that ontology development is part of requirements

analysis or modeling. So one requirement for developing the ontology is to develop a subset of the

requirements for the system and to develop a model of an area.

[08:51] Symposium (SteveRay): Remote participants please mute your microphones. Lots of rustling

sounds. Thanks

[08:52] Doug Foxvog: Leo discusses OntoClean methodology. OntoClean says a role, e.g., Employee,

should not be a subclass of Person because the role is dynamic, but Person is static. This is valid

in a 4D theory, but in a 3D+1 system, is not a necessary restriction. This suggests that at least

some of the rules should depend upon the broader model, e.g., 4D vs. 3D+1 the ontology is based on.

[08:53] Mike Bennett: @Doug interesting point. In FIBO we use the "Relative Thing" partition which

has a similar effect - so it's not only a 4D thing - but it reinforces your opinion that some of

these considerations are to do with the theories in the upper ontology partitions

[09:00] Doug Foxvog: @Mike: This brings up the point that "upper-level" decisions are not always

necessary to be made in an ontology. One could identify from an ontology whether the ontology

intrinsically includes such a decision -- in which case it should be identified, perhaps by

  1. including an "upper-level" ontology with that model. It might be useful to create an agnostic

relation that would map to different relations in (in this case) 4D and 3D+1 ontologies.

[09:02] Mike Bennett: @Doug yes, it occurs to me that there is a connection between upper ontology

use, and semantic conformance criteria. Some folks have suggested that we should not use the

Independent / Relative / Mediating partitions because it's easy for modelers to get it wrong.

Conversely, something which is easy for a modeler to get wrong, is one where you have a means to

test when the meaning has been consistently understood and applied.

[08:54] anonymous morphed into mpavel

[08:54] anonymous morphed into Fouad Ramia

[08:54] anonymous1 morphed into AdrianBaranyuk

[08:55] Jim Jacobs: What evaluation methods speak to the strength of the property or relation side of

an ontology (as opposed to class taxonomy issues)? The relative "flatness or bushy-ness" of the

property set greatly affects reasoning power.

[08:56] Mike Bennett: @JimJacobs the OQuaRE toolset has measures for that and similar things.

[08:58] AstridDuqueRamos: @JimJacobs In OQuaRE, the subcharacteristic "Formal relations support".

and the metric RROnto is related with that.

[09:00] Terry Longstreth: IMO flatness or bushyness affects the utility of the ontology, in much the

same way as abstraction does. If the ontology detail is elided, then it's utility is equivalently

reduced. If the requirement exists for the greater utility, then the ontology fails.

[09:00] Steve Ray: Regarding question #2, one piece of evidence leading toward a larger ROI is if you

answer "yes" to question 1. In that case, the "I" (investment) part of ROI is small, thus the

chances of the ROI will be large increases.

[09:02] Doug Foxvog: FWIW, the question numbers that are referred to above are to Leo's questions on

his Slide 5. // 1) Structural evaluation tests are the easiest set of tests to apply. Agree or

disagree?

2) Structural evaluation provides the greatest ROI during ontology development. Agree or disagree?

3) Is ontology quality always relative to some external criteria? Can an ontology intrinsically be

of high quality without respect to some criteria? Is ontology quality inherently second-order?

4) Does ontological analysis in terms of relatively agreed upon and sound theories (e.g.,

mereotopology, a theory of parts; distinguishing semantic vs. metaphysical analyses or commitments,

a theory of referring expressions and their referents; 3D vs. 4D analyses; parsimony of

representation; explicit intentional and causal focus; etc.) enable a better ontology?

5) If we were to rank criteria that a good ("quality") ontology would have, what would be the first

five criteria in order of importance? //

[09:03] Sylvia Spengler: thanks...hard to tell on some things....

[09:04] Jim Jacobs: With respect to Q3, there seems to be a distinction between intrinsic quality and

utility for any particular purpose. In both cases it seems critical to have meta information

regarding the intended context for use. I believe specificity of context to the "next big thing" in

this area.

[09:05] Sylvia Spengler: Very nice point.

[09:07] Doug Foxvog: @JimJacobs: I suggest that the intended context of an ontology should be

reified. I.e., statements in the ontology language should be made providing information about the

intended context. Thus a knowledge base about the ontology!

[09:09] Doug Foxvog: We could create standards for what sort and breadth of statements should be

included for best practice ontologizing.

[09:11] Mike Bennett: Indeed. Then extending that, whether the ontology merits the use of upper

ontology partitions (e.g. reference ontology Yes, application ontology No), and then quality

measures follow from the due application of these.

[09:12] Symposium (SteveRay): == Beginning Track B - Extrinsic Aspects of Ontology Evaluation -

Todd Schneider presenting

[09:12] Bob Schloss: I would like to see any ideas about evaluation of ontologies that takes place

over time -- watches the dynamics of requests for modifications, and whether those modifications are

the kind the require more-expensive changes to producing or consuming software or information

repositories (databases).

[09:17] Matthew Kaufman: It sounds to me like Operational Aspects are Merging Much with Development

Aspects in many domains; such as Ontology Versus Real-Life Use as in: Dev-Ops is Merging with

Software Pragmatics/Development -- http://itrevolution.com/the-convergence-of-devops/

[09:18] Matthew Kaufman: Software Engineering + Dev-Ops = Future (Now; i.e., the Cloud)? It is

merging.

[09:28] Matthew Kaufman: Requirements for Ontology: 1) Business Requirements (Opportunity Discovery,

Due Diligence, or Regulatory/Compliance Checks) -- 2) Regulatory / Legal: Sarbanes-Oxley is a

wonderful example of how operational can fit in to the abstracted design of the ontology -- 3) The

last phase IMO: Is the User Scenario / Use Cases of the software itself that the ontology is created

for

[09:30] Jim Jacobs: @ToddSchneider wrt "intended interpretation" almost suggests a requirement for a

"SKOS-type"" descriptive document to go along with the actual detailed ontology (""OWL-level""). Having

a recommended set of metadata descriptions to go with ontologies intended for re-use ... this would

be a valuable thing.

[09:30] Amanda Vizedom: RE Regression Testing for ontologies - this does exist in some places, but

needs to be adopted much more broadly. RE: current practices: see Mar-7 presentation by

Maria Copeland [1], Feb-14 by Gavin Matthews [2]. ... ref. [1]

http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2013_03_07 ; [2]

http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2013_02_14

[09:31] Steve Ray: I don't see why much of what comprises requirements engineering cannot also apply

to ontology development ( see http://en.wikipedia.org/wiki/Requirements_engineering )

[09:32] Matthew Kaufman: @JimJacobs: ""Having a recommended set of metadata descriptions to go with

ontologies intended for re-use"" ---- I was just going to say this: ***I BELIEVE BEFORE THE

REQUIREMENTS; IT IS REQUIRED AND ESSENTIAL TO FIRST GATHER AND DEFINE AND *KNOW* WHAT THE

""DEFINITIONS"" ARE OF YOUR DOMAIN***

[09:32] Matthew Kaufman: http://www.sec.gov/about/laws/soa2002.pdf

[09:32] Matthew Kaufman: Sec. 2. Definitions. Sec. 3. Commission rules and enforcement

[09:33] Matthew Kaufman: I.e., the Ontology is built on: ""Commission rules and enforcement""; but

first Definitions are required to know the domains and scopes?.

[09:34] Matthew Kaufman: (c) DEFINITIONS.In this section (1) the term securities analyst means any

associated person of a registered broker or dealer that is principally responsible for, and any

associated person who reports directly or indirectly to a securities analyst in connection with, the

preparation of the substance of a research report, whether or not any such person has the job title

of securities analyst; and (2) the term research report means a written or electronic communication

that includes an analysis of equity securities of individual (..)

[09:35] Steve Ray: @MatthewKaufman: Would you agree that one of the main uses of ontology is to

provide the definitions?

[09:37] Steve Ray: @MatthewKaufman: It is looking like you are getting circular: You want definitions

before composing the requirements for an ontology, whose purpose is to provide the definitions.

[09:38] Amanda Vizedom: @MatthewKaufman - many of us view that as an essential part of the

requirements development process, not something which is separate and before it.

[09:38] Matthew Kaufman: @AmandaVizedom: Okay, point taken. Correct. I'd agree and encourage that.

[09:40] Matthew Kaufman: @SteveRay: I see what you are saying; but I think the definitions are in the

""context"" itself; i.e., I see an ontology in being a ""LINKER"" between 2 ""Definitions"" or ""sources""

or "frames". I see an ontology as providing the *links* and or relational connections between 1 or

sources and or concepts/entities/things.

[09:41] Jim Jacobs: This reminds me of why some folks have suggested that in system architecture

frameworks like DODAF or MODAF an "AV-2" document should be quite ontological in its list of

defining terms for system designers and developers to use during system development.

[09:42] Matthew Kaufman: I am not familiar with DODAF or MODAF. AV-2 sounds familiar; but still

unknown. I think GNUStep is the closest thing I have seen to an ontological type concept in systems.

[11:07] Terry Longstreth: @MatthewKaufman: For an overview of MODAF work products see

https://www.gov.uk/mod-architecture-framework#viewpoints-and-views

[11:21] GaryBergCross: DODAFia a DoD Architectural Framework...and Enterprise Architecture.

[11:39] Matthew Kaufman: Thanks Terry

{{{ [11:40] Terry Longstreth: ;}) }}}

[10:19] Ali Hashemi: are people breaking atm?

[10:35] AstridDuqueRamos: has the conference re-started?.

[10:40] Sylvia Spengler: (1:40pm EDT now) 2:00pm EDT is what I have on my agenda copy

[10:45] AstridDuqueRamos: Thanks.

[10:52] anonymous morphed into Carmen Chui

[10:55] Amanda Vizedom: People are re-gathering. We should be starting shortly.

[11:01] anonymous morphed into Barry Smith

[11:05] Mike Bennett: We are standing in little clumps chatting, but nearly everyone is here.

[11:06] anonymous1 morphed into Symposium (SteveRay)

[11:07] anonymous morphed into LaVernPritchard

[11:08] Symposium (SteveRay): == David Newman giving the keynote-2

[11:15] Symposium (SteveRay): We can hear keyboard activity. Please try to mute when not speaking.

[11:22] anonymous morphed into Christian Hempelmann

[11:28] anonymous morphed into Ben Bovee

[11:31] List of cuurent members in the chat-workspace: Ali Hashemi, Amanda Vizedom, AstridDuqueRamos,

Barry Smith, Ben Bovee, Bobbin Teegarden, Bob Schloss, Carmen Chui, Christian Hempelmann, Doug Foxvog,

Fouad Ramia, GaryBergCross, Jim Jacobs, LaVernPritchard, Matthew Kaufman, Matthew West, Mike Bennett,

Mike Dean, mpavel, Peter P. Yim, Simon Spero, Steve Ray, Sylvia Spengler, Symposium (SteveRay),

Terry Longstreth, Torsten Hahmann, vnc2

[11:32] LaVernPritchard: slides are not being advanced

[11:32] Peter P. Yim: ran into a technical issue; vnc service is back now

[11:33] LaVernPritchard: thank you

[11:47] GaryBergCross: How would you describe the method by which you arrive at community agreed

upon standard definitions of business terms? And what were the challenges along the way?

[11:47] anonymous morphed into Pavithra Kenjige

[11:48] Doug Foxvog: Mention of use of other standards. Are there mappings to EDI terms? ... either

X12, EDIFACT, SWIFT, ...?

[11:56] anonymous morphed into Gary Gannon

[12:02] Mike Bennett: @GaryBergCross for the most part, we took definitions in the corresponding data

standards e.g. ISO20022, adapted so they describe the thing rather than the data about the thing,

and then present this for review and validation. The main challenge is that people prefer to tell

you about new terms than to formally validate the existing ones.

[12:04] Mike Bennett: @DougFoxvog in the FIBO "Foundations" specification we have defined

abstractions which are necessarily outside of the financial industry, and tried to find standard

ontologies which cover the same ground (only a few so far). For the industry content, most terms

originate as a reverse engineering of logical (ISO 20022) or physical (e.g.FpML) model standard,

refactored to describe the actual thing. We hope to map to more standard ontologies in the future as

these emerge.

[12:04] anonymous morphed into Fabian Neuhaus

[12:06] Mike Bennett: For example when we model loans, we want to align with the MISMO standard for

loans, but that only deals with physical and logical data model components, so with their blessing

we aim to create the corresponding ontology - but where MISMO deals with terms about real estate, we

would expect to use formal ontologies developed in and by the real estate community of practice.

[12:08] Mike Bennett: For definitions, if there isn't a pre-existing industry data model standard, we

tend to use a wikipedia or Investopedia definition, as long as the subject matter experts agree on

the use of a given definition and source.

[12:10] GaryBergCross: @MikeBennett did you run into situations where there was a conflict of

ontology quality, say a real taxonomy, vs. domain definitions that seemed to want it another way?

Did you ever have to resolve conflicts between 2 or more conflicting taxonomies from the various

domains?

[12:12] Doug Foxvog: @MikeBennett: SWIFT has been sending financial messages with formally defined

terms for over 40 years. X12 & EDIFACT have had such messages since the 1980s. These messages have

transferred 10s (100s? more?) of trillions of US dollars over the years. They are certainly used in

the financial industry

[12:14] Mike Bennett: Not as such, but we have had to work out what treatments to take on external

ontologies e.g. when to use a snapshot or when to refer to the ontology direct. Quality, and

knowledge of maintenance of other ontologies, is quite variable. In reality, we have only so far

make such reference to a small number of ontologies, and this sort of material is outside the scope

of the OMG submission, which is restricted to what is our own, stable set of terms and definitions.

So this is an aspect of the ontology that we can expect to develop further as time goes on.

[12:14] Gary Gannon: (responding to the moderator's verbal question) yes I am speaking

[12:14] Sylvia Spengler: you seem muted, Gary

[12:14] Ali Hashemi: Gary you're likely still muted.

[12:14] Ali Hashemi: Try *7

[12:15] Mike Bennett: @DougFoxvog indeed. We made reference to the ISO 20022 FIBIM model component

(the remaining aspects of SWIFT are more in the transaction space, which we haven't modeled yet. At

the end of May, SWIFT (in their capacity as RA of ISO 20022) are releasing a new interface and more

semantic terms for their material - worth a look.

[12:15] Ali Hashemi: @MikeBennett, any work towards using Controlled English for the natural language

definitions?

[12:17] Mike Bennett: Not at this point, but we are considering in a future iteration, having a layer

of SBVR terminology, which is a sort of CNL. I'd like to look at more formal use of something like

ACE as well. This wouild be a different set of definitions to the industry ones, which are

deliberately intended to be the ones which business folks themselves are comfortable with.

[12:19] Ali Hashemi: Do you think there'll always be a divide b/w these languages? (in this context

at least)

[12:19] Ali Hashemi: )// always --> for a long time*

[12:16] Simon Spero: @AliHashemi: there was a quick look at ACE in the hackathon

[12:20] Symposium (SteveRay): All remote attendees: The audio bridge only lasts for 4 hours, so

please hang up your audio connection and dial back in at 3:30pm Eastern. Thanks!

[12:20] Simon Spero: Engineers, physicists, architects, and mathematicians demonstrate that all odd

numbers greater than 1 are prime:

[12:20] Simon Spero: Mathematician: 3 is prime, 5 is prime, and 7 is prime. By induction, all the odd

integers are prime.

[12:20] Simon Spero: Physicist: 3 is prime, 5 is prime, 7 is prime, 9 is experimental error, 11 is

prime, 13 is prime, 15 is experimental error, 17 is prime, 19 is prime. The empirical evidence is

overwhelming

[12:21] Simon Spero: Engineer: 3 is prime, 5 is prime, 7 is prime, 9 is a good approximation, 11 is

prime

[12:21] Simon Spero: Architect: 3 is prime, 5 is prime, 7 is prime, the engineers will figure out how

to make 9 prime, 11 is prime, ...

[12:29] Bobbin Teegarden: Thank you, Simon. ;0)

[12:31] Ali Hashemi: if people are speaking, the audio is not working properly

[12:33] Ali Hashemi: wait,

[12:33] Symposium (SteveRay): people ... please re-dial into the conf call again, the bridge is up

now

[12:33] Ali Hashemi: I could only hear Steve. If others are speaking, still only faint audio.

[12:34] Ali Hashemi: (ah nm)

[12:36] Ali Hashemi: no it's fine!

[12:37] Bruce Bray: that's better

[12:38] Symposium (SteveRay): == Track-C - Building Ontologies to Meet Evaluation Criteria - report

starting, Mike Bennett presenting

[12:46] GaryBergCross: @MikeBennett Concepts can, and should, also be grounded in data. So if we are

talking about a contract, what data do we have on a contract.

[12:51] Simon Spero: GaryBergCross: see

http://www.iva.dk/bh/lifeboat_ko/CONCEPTS/literary_warrant.htm

[12:54] GaryBergCross: @SimonSpero This provides great intensive defs, but less of the type of

instance data that I was thinking of...

[12:55] Simon Spero: Scientific Warrant is close

[12:51] GaryBergCross: @MikeBennett @DavidNewman another part of development would be the in the

integrating of ontology modules / ODPs from the Base as mentioned earlier.

[12:55] Peter P. Yim: == Track C - Building Ontologies to Meet Evaluation Criteria - session continues -

Matthew West posing questions to the participants

[12:55] Peter P. Yim: === Matthew: Q1. why have an ontology development methodology? [Symposium

(SteveRay) and Peter P. Yim capturing some of the verbal responses below ... ]

[12:56] Doug Foxvog: Why have an ontology development methodology? To ensure that the ontology is

consistent with itself, included ontologies, and to ensure the lack of large gaps.

[12:56] Symposium (SteveRay): Easier to teach people to develop ontologies

[12:56] Peter P. Yim: to develop a repeatable pattern

[12:56] Christian Hempelmann: If you don't know on what basis you're making choices, you can't

correct them in an informed manner.

[12:56] Bobbin Teegarden: Reuseability

[12:57] Jim Jacobs: Answer to Q1: "You need an ontology development methodology to "raise the quality

floor" of ontology work yielding a well-framed artifact."

[12:57] Terry Longstreth: re: Matthew West question 1 - requires first answering the question 'Why

have an ontology', the answer to that will guide the selection of (a) methodology

[12:57] Bob Schloss: Why have an ontology development methodology? - To not miss anything critical

and have visibility of where you are toward "Completion - Ready for Use" (so the methodology implies

a repeatable process in my mind)

[12:57] Peter P. Yim: making out current implicit methodology explicit, and therefore repeatable and

reusable

[12:57] Symposium (SteveRay): Makes collaboration between people much easier to develop the ontology

[12:58] Simon Spero: If you don't know have a methodology, you have no idea what you're going to do,

or if you've done it

[12:58] Steve Ray: For consistency in quality and design

[12:58] Jim Jacobs: 2nd answer to Q1: to embody and clarify development assumptions.

[12:58] Ali Hashemi: Q1 Answer: A development methodology is instrumental in providing insight into

whether the resulting ontology is appropriate, and how to best manage the ontology as a resource /

asset. Helps make ontologies more measurable, comparable and understandable.

[12:58] Symposium (SteveRay): Provides a framework for completeness and learning

[12:58] Amanda Vizedom: Sometimes to make ontology development effective quality-wise. Sometimes to

make team development possible.

[12:59] GaryBergCross: To help diverse people produce ontologies with similar, good

qualities...Ontologies become more reproducible.

[12:59] Symposium (SteveRay): === Matthew West: Q2. What should an ontology development methodology

cover?

[12:59] Jim Jacobs: Q2: The frame of analysis, the epistemology used, the intended purpose.

[13:00] Torsten Hahmann: second question: it should include milestones and activities

[13:00] Simon Spero: What should methodology cover: do you need an ontology,

[13:00] GaryBergCross: A development methodology would cover the class of tools and standards that

should help.

[13:01] GaryBergCross: Development methodology should include how phases of work are related.

[13:02] GaryBergCross: Development methodology should include guidance on how quality is gauged

during each phase.

[13:00] Ali Hashemi: Q2 Answer - Should offer a set of optional (but normative) best practices,

aggregating the collective wisdom of practitioners and lessons learned. Suggestions for different

methodologies depending on the intended usage.

[13:01] Ali Hashemi: Q2A addendum - ability to gauge and measure the ontology as it is being

developed.

[13:00] Sylvia Spengler: How about giving the online folks a chance to sound off? This feels like

sheep and goats..

[13:01] Torsten Hahmann: should offer criteria to track the progress of the development

[13:01] Peter P. Yim: ... from Hans Polzer: methodology should include techniques for how upper

ontologies can be used to analyze a domain to support development of a consistent domain ontology

[13:01] Doug Foxvog: An ontology development methodology should cover a technique for covering a

topic, what kinds of assertions are required for each class, individual, and relation defined in the

ontology, including documentation. It should include (how to select) which higher ontologies to

include.

[13:01] Amanda Vizedom: Methodology should cover & guide development-time decisions, including how to

choose between logically equivalent solutions to a modeling problem (for consistency &

collaboration)

[13:01] Amanda Vizedom: How to scope (what to include and when to stop)

[13:02] Amanda Vizedom: A methodology should include specification of its own applicability

conditions.

[13:03] Doug Foxvog: @Amanda: +1

[13:04] Amanda Vizedom: Where, when, & how to test your work

[13:04] Symposium (SteveRay): Should use a process language to specify the kinds of tasks needed in

a development methodology

[13:05] Peter P. Yim: an improvement methodology to fix things when things don't work

[13:05] Simon Spero: Stand Up for SCRUM

[13:05] Amanda Vizedom: should be specified clearly enough to track - whether automatically or

manually

[13:05] Doug Foxvog: An ontology development methodology should include a technique for analyzing

that no logically inconsistent assertions are made. Including inconsistency between assertions made

by different members of the development team.

[13:06] Doug Foxvog: I mean *automatic* analysis of assertions as made.

[13:05] Symposium (SteveRay): Need to distinguish between the tool-set and the methodology. Might

have a good methodology and bad tools.

[13:06] GaryBergCross: How to engineering an ontology from an existing vocabulary and/or data model.

[13:06] Symposium (SteveRay): Separately evaluate the tools against the methodology that is

separately defined.

[13:06] Peter P. Yim: === Matthew West: Q3. How do you know if an ontology development methodology is delivering?

[13:07] Ali Hashemi: Q3A: The intended uses and functionality of the ontology are satisfied with

"minimal" amount of (re)work.

[13:07] Peter P. Yim: if people are using your ontology

[13:07] Symposium (SteveRay): If it reduces the number of errors in an ontology

[13:07] Amanda Vizedom: should include acknowledgement of possible need to handle situations the

methodology doesn't cover, and enough rationale and principles to help figure out how to do so.

(still q2)

[13:07] Jim Jacobs: Q3: if it encourages ontology reuse, and endurance

[13:07] Symposium (SteveRay): Continuity - allows others to step in and pick up if one person leaves

a team.

[13:07] GaryBergCross: If you are asked to present at the Ontology summit

[13:07] Peter P. Yim: manageability, scalability, efficiency, repeatability,

[13:07] Symposium (SteveRay): Consistently good and useful ontologies on multiple projects.

[13:08] Amanda Vizedom: Q3: do the developers find that it guides their decision? do the results of

those decisions meet ontology requirements?

[13:08] Simon Spero: If the mission is achieved on time and within budget

[13:08] Symposium (SteveRay): Consistency the first time through

[13:09] GaryBergCross: If it subsumes, integrates and rationalizes other methods. If IT or Domain

people can work with it with modest help.

[13:09] GaryBergCross: If people start to build tools to support the method.

[13:09] Ram D. Sriram: go through the design literature ... can probably pick up a lot there

[13:09] Simon Spero: Ram D. Sriram: Fred Brooks (2010). The Design Of Design.

[13:09] Doug Foxvog: == Track D - Software Environments for Evaluating Ontologies - Ken Baclawski presenting

[13:17] GaryBergCross: There is some possible overlap in the tools responded...CALORE for example

and OOR of which it is a part.

[ ... the OOR response is in reference to the OOR-sandbox instance. =ppy]

[13:18] anonymous morphed into Michael Barnett

[13:22] Peter P. Yim: see the software survey result summary at:

http://ontolog-02.cim3.net/wiki/OntologySummit2013_SurveySummary

[13:19] Peter P. Yim: === soliciting answers from participants: Q1.

//

(1) What are the greatest barriers today to having

(i) system architects/designers, and

(ii) software engineers, 

employ ontology in their work

//

[13:21] Peter P. Yim: again Symposium (SteveRay) and Peter P. Yim capturing some of the verbal the answers

from the participants

[13:20] GaryBergCross: Barrier for tools...lack of easy and effective training on the tool which

takes people thru the ontology lifecycle.

[13:22] GaryBergCross: Embed ontology tools and integrate them with traditional SW dev

tools/environments.

[13:20] Steve Ray: To answer the first question (slide 7) on Track D: We need tools where the UI is

designed for non-ontologists to use.

[13:21] Matthew Kaufman: @SteveRay can you describe some of the UI examples that you mean by

'non-ontologists'? What are some good application models or UI methodologies or IA (information

architectures) to model after?

[13:22] Matthew Kaufman: there is a lot of cross work between the W3C and the DOM in the structure

that looks to be pointing towards entity and ontological relations more so. I have not had time to

look completely but I like to model my frontends in XPath similarly to the ontological (I believe

imo) structure itself .

[13:24] Steve Ray: @MatthewKaufman: The UI would allow a user to pull down a pick-list for

constraining, say, the range of an association, which might be labelled "Values for this association

MUST be of type:" (rather than a user declaring a restriction class in the "subClassOf" attribute of

a class definition

[13:22] GaryBergCross: Lots of hands up out there!!!

[13:23] Peter P. Yim: ... have processes on incorporation of ontology built into their IDE or tools

[13:24] Peter P. Yim: ... better and more friendly user interfaces to the tools

[13:26] Peter P. Yim: ... Leo Obrst: training, formal training ...

[13:28] GaryBergCross: @LeoObrst Put more training online...

[13:29] Peter P. Yim: ... Dennis Wisnosky: tools like BPMN, DoD's DM2 ... tools are out there

[13:29] Jim Jacobs: Q2: strong need for clear examples of real-world threads of people using sound

ontology methodology.

[13:30] Peter P. Yim: ==== Q2: (2) what features need to be improved/added to software tools and IDE's to take down the above barriers

[13:30] Symposium (SteveRay): Interesting that CS graduates are expected to know the formal

mathematics behind their programs, but are not trained on the formal semantics of data

[13:30] Peter P. Yim: ... Matthew: documenting change

[13:31] Jim Jacobs: Q2: would be good to have tool support for the distinction between ontology as

the "worldview philosophy" of the system under development and the actual implementation level

knowledge representation ontology.

[13:31] Peter P. Yim: ... Michael Grüninger: traceability and provenance of ontology requirements

[13:31] GaryBergCross: MOOCs are Massive Open Online Courses. There are MOOCs for Computing for Data

Analysis (Coursera) Data Analysis (Coursera) Network Analysis in Systems Biology (Coursera)

Information Visualization (IU)

[13:35] GaryBergCross: Dr. Harald Sack ran a MOOC on Semantic Web Technologies is now in archive

mode. 5,692 learners were registered Duration: 6 weeks Course language: English

https://openhpi.de/course/semanticweb

[13:32] Peter P. Yim: ... Mike Bennett: drag and drop UI, two views - UML-model and Conceptual-model

[13:38] Amanda Vizedom: The open world assumption just says that unknown/unprovable assertions should

not be assumed to be false. That's quite compatible with saying that modeling what you know, you

should aim for consistency and pay attention to what *is* entailed (according to your chosen

language & associated reasoning) by what you assert.

[13:44] Steve Ray: @AmandaVizedom: Of course I agree, otherwise what would be the use of tools to

check for "errors". I suppose what I should have said is that the tool should not PREVENT you from

doing bad things, but should let you know that you are doing bad things. Or perhaps there could be a

novice setting that does in fact constrain what could be valid but not-encouraged OWL

statements/patterns.

[13:50] Amanda Vizedom: @Steve, I guess what I meant is that distinguishing between unknown things

and things known to be false (which is what OWA does) does not mean that there aren't any inferrably

false things, or that inconsistencies won't lead to contradictions. It just rules out one particular

line of inference.

[13:39] GaryBergCross: The tools should allow leveraging existing ontologies an their parts in a

manageable way.

[13:42] GaryBergCross: For people's information there will be a "Semantics For Big Data" session at

AAAI Fall Symposium, Arlington, VA, November 15-17, 2013 Details:

http://stko.geog.ucsb.edu/s4bd2013/

[13:48] Simon Spero: Tools should not let you produce syntactically invalid OWL. like a certain

Library on Capitol Hill does

[13:46] Peter P. Yim: == Website team presentation is on - Ali Hashemi presenting (remotely)

[13:50] PavithraKenjige1 morphed into Pavithra Kenjige

[13:52] Steve Ray: @Ali: Very nice presentation. Where do I go to find out more about applying a

SPARQL query against the wiki?

[13:54] Ali Hashemi: Hi Steve, there are a number of different extensions. The SMW contains a lot of

pages and information about the different extensions, their development status and so on. A good

place ot start would be: http://www.mediawiki.org/wiki/Extension:SparqlExtension

[13:53] Symposium (SteveRay): == Amanda Vizedom now presenting on the Community Library

[13:55] Ali Hashemi: Am I the only remote person who lost audio?

[13:56] Peter P. Yim: probably ... I am monitoring here, and I seem to be doing ok

[13:56] Peter P. Yim: anyone else having audio problems?

[13:57] Bruce Bray: audio is fine now

[13:57] Ali Hashemi: i had to dial back in. ok now.

[14:01] Jim Jacobs: Many thanks to all the support folk that enabled the remote participation. Cheers!

[13:58] Steve Ray: Hello to all the Bobbins.

[14:02] BobbinTeegarden13 morphed into Bobbin Teegarden

[14:03] Symposium (SteveRay): == the day-1 program is adjorned ... see you all tomorrow at 9:00am

[14:03] List of current members in the chat-room: Ali Hashemi, Barry Smith, Ben Bovee, Bobbin Teegarden,

Bruce Bray, Carmen Chui, Christian Hempelmann, Doug Foxvog, Gary Gannon, Jim Jacobs, Marc Halpern,

Matthew Kaufman, Mike Dean, mpavel, Oliver Kutz, Pavithra Kenjige, Peter P. Yim, Simon Spero, Steve Ray,

Sylvia Spengler, Symposium, vnc2

-- end of chat session --

Fri 2013.05.03

see raw transcript here.

(for better clarity, the version below is a re-organized and lightly edited chat-transcript.)

Participants are welcome to make light edits to their own contributions as they see fit.

-- begin of chat session --

[05:45] Symposium (SteveRay): = Welcome to Day 2 of the Ontology Summit Symposium 2013 =

[05:26] anonymous morphed into Bruce Bray

[06:01] Sylvia Spengler: Must better sound today...thank you

[06:02] Steve Ray: Please move over to the May 3rd chat room. Just change the URL to end in 0503

instead of 0502. The rest of us are over there.

[06:04] Sylvia Spengler: sorry wasn't paying attention...thanks Steve

[06:04] Steve Ray: See you on the other side!

[06:00] == Olivier Bodenreider presenting Keynote-3

[06:05] Sylvia Spengler: could you remind the speaker about saying changed slide or its title..

[06:06] Symposium (SteveRay): Currently on slide 5

[06:22] GaryBergCross: It is interesting to see that under organizing principles there is no

hierarchical structure among the major concepts.

[06:25] anonymous morphed into Frank Olken

[06:26] Hans Polzer: Interesting that the assessment approach doesn't include anything about the

purpose of the assessment or the context/perspective from which the assessment is being made

[06:28] Terry Longstreth: Hans - sometimes it does, abstractly, as in chart 26

[06:40] GaryBergCross: Anatomy point seemed like a problem identifying parts vs. object in region of

pelvis.

[06:41] Steve Ray: [ref. slide #49] +1 to that.

[06:41] GaryBergCross: [ref. slide #50] @MikeDean Another use to test our Path ODP!!

[06:43] Steve Ray: [ref. slide #51] Intrinsic evaluation!

[06:45] Symposium (SteveRay): slide#55

[06:46] GaryBergCross: In a way these quality measures set Requirements" for the ontology

[06:47] Steve Ray: I think the heading should be Diabetic patients rather than Pediatric patients

[06:48] Sylvia Spengler: not according to the ages

[06:48] Bruce Bray: in this case it is diabetic pediatric patients

[06:49] Steve Ray: Ah

[06:49] Sylvia Spengler: agree

[06:49] Steve Ray: Ah

[06:49] GaryBergCross: @ Steve Does age 5-17 set this as pediatric?

[06:49] Bruce Bray: yes

[06:51] Bruce Bray: in this application the age specifies the denominator or cohort specification for

the measure (ie. eliminate very young children and adults)

[06:55] GaryBergCross: For me OlivierBodenreider's talk brings some of the quality discussion into

focus via real examples of what had been discussed generally.

[06:55] Terry Longstreth: Thought experiment - does updating their ontology periodically create new

ontologies every time? Are the ramifications of all changes communicated to all dependent

applications/users/uses?

[06:55] GaryBergCross: @Terry maybe it is just versioning.

[06:56] Steve Ray: @Gary: This underscores my belief that most benefit can be derived from the

simpler problems (i.e. "intrinsic" error checking), much of which can be automated.

[06:57] Mike Bennett: Change management in ontologies sounds like another very important aspect of

the ontology development lifecycle. We've considered the lifecycle for the initial development of

the thing, but with any engineering artifact, changes into subsequent versions is also part of the

process (and arguably the rationale for having a good process to begin with).

[06:57] Bruce Bray: @gary, I agree - it would be very interesting to apply some of the tools/methods

discussed in this summit to the biomed domain

[06:57] Steve Ray: The change management problem looks identical to the problem handled in code

development.

[06:57] Terry Longstreth: @Gary - whatever it's called, dependencies against the prior version are in

an unknown state after the changes are applied

[06:57] GaryBergCross: @MikeBennett Since ontology development is never complete the versioning

problem is intrinsic to the effort.

[06:58] Amanda Vizedom: Very important thing to note, IMHO: The need to support changing codes that

Olivier just mentioned (and language use, in other cases) is among the reasons to observe discipline

in representing concept/entity structure centrally, and map to different code systems (i would

include NL terminologies among code systems, here). Updating mappings is very different that

updating concept/entity structure or names, and updating mappings is a much more manageable process.

[06:59] GaryBergCross: @Terry The relations need not be unknown, but in practice this quality may

not be realized because of lack of resources and standard methods and tools.

[07:01] Doug Foxvog: Change management should include policies for handling changed codes. Those

removed have recommendations for replacement codes (sometimes one replacement, sometimes more). KBs

need to be scanned for the changed codes and the recommendations for changes for specific assertions

need to be generated.

[07:01] anonymous morphed into Misha

[07:02] Amanda Vizedom: Another suggestion to support ease of updates *and* preserve interpretability

of older data: If code mapping include explicit naming of the code system *and version*, mapping to

new code systems can be added in new versions of the ontology in a way that facilitates detection

when out of date, tracking, etc.

[07:06] GaryBergCross: I wonder if anything analogous to regression testing makes sense and/or is

done?

[07:07] Amanda Vizedom: @OlivierBodenreider - thank you for presenting this. It's an excellent

example of good, integrated evaluation practices that have concretely improved specific ontologies.

The detailed look is wonderful to have.

[07:08] == The OntologySummit2013_Communique - Fabian Neuhaus presenting

[07:08] Ali Hashemi / Amanda Vizedom: see the Communique at:

https://docs.google.com/document/d/1gaQ8DIdg20AGJnlaCpQ7ebwJH_L4c4tK5RH1wyMHQig/edit?usp=sharing

[07:09] Doug Foxvog: The date of assertions can provide a maximum version of the code set(s) used. A

KB that tracks the changes to codes could date the last time each code's meaning/properties is

changed.

[07:10] Amanda Vizedom: Remote participants: you may need to refresh the session page to see the link

to the slides.

[07:12] anonymous morphed into Clare Paul

[07:14] Amanda Vizedom: We are now on slide #7

[07:16] GaryBergCross: Should craftsmanship include good analysis as well as design?

[07:19] Matthew West: I think good analysis is what fidelity is about.

[07:22] GaryBergCross: @Matthew Yes, I can see that. But you might also have to design analysis

products to engage is discussion with domain experts such as conceptual viz.

[07:25] Matthew West: @Gary: I agree, but Craftsmanship is not a lifecycle phase, but something that

applies to artifacts of different lifecycle phases, and so is fidelity. So I would still consider

that good analysis is detected by a test of fidelity, where ever fidelity is important in the

various artifacts produced.

[07:26] Mike Bennett: @Gary the question there is what method is used for presenting content to

domain experts - do you design a one-off throwaway viz to show them, do you design an interface

which shows all or some of the actual model formalisms directly (do you limit what is expressed in

the ontology to what can be presented to this audience). Or do you use ACE etc. So once the answer

to this requirement is known, there will be design considerations for how that is handled.

[07:24] Amanda Vizedom: Please keep in mind, also, that this presentation is necessarily just an

outline or summary of the points in the Communique.

[07:25] GaryBergCross: @Amanda Will the slides be identified and available as background into to

help interpret the communique?

[07:26] Doug Foxvog: @Gary: Everything in the slides is already in the communique.

[07:27] GaryBergCross: @Doug yes, but this is like an outline that gives an overview and some focus

and some browsers might look here first and afterwards too.

[07:26] Bob Schloss: Two "artifacts" that Fabian doesn't call out in his slides are: Example Queries

(first expressed in natural language, later expressed in some semi-formal or precise query

language), (perhaps this is one case of a capability question), and Illustrative Sample Instances.

My experience is that we realize that our ontology has gaps or makes it too difficult to code and

execute the most critical queries is discovered when we use these against our intermediate designs.

[07:28] Bob Schloss: I think Matthew and I are both thinking about how tests of ontology adequacy are

performed. Mike points out that in many cases, a valid test involves domain experts who will have no

willingness or capacity to look at the representation of the ontology design which professional

ontologies or data modelers use.

[07:28] Matthew West: @Bob: Yes that is covered in the communique, at least at a high level. That's

one of the ways that requirements are determined.

[07:27] Amanda Vizedom: In the Communique, we had many, many hard choices to make regarding how much

detail to go into where. And even after we cut much that could have been said, the document is still

long... We tried to select with an eye toward making a strong and clear statement, and advocating

effectively in the direction in which consensus and understanding emerged...

[07:29] Doug Foxvog: @Amanda: I wouldn't say that the document is too long. It covers a lot of

material. If it were arbitrarily limited to 10 pages, it would be incomplete.

[07:30] Bob Schloss: @Amanda - I do not think the communique fails just because I would have written

somethings more specifically -- I'm just sharing my own experience with the people who are at this

meeting. (Yes, I know I'm bad for not writing things for you and Fabian weeks ago -- work is

incredibly busy!!)

[07:31] Amanda Vizedom: We hope that the Communique will encourage people to look further into the

supporting resources ...

[07:31] Mike Bennett: If the communique is anything like what Fabian is summarizing here, it sounds

to me like they have got to the heart of the important issues that have come out of these

discussions - not an easy task.

[07:31] Amanda Vizedom: *and* those resources should and will continue to evolve after today.

[07:32] Mike Bennett: Perhaps the communique can be followed up by a more referenced / academic white

paper covering this material - I think the specific things that have come out of this would merit

that (but it sounds like a lot of work for someone).

[07:34] Amanda Vizedom: To ToddSchneider's point (that there are tools available to augment the

development of requirements): We are not talking about generic software requirements tracking tools.

We are talking about tools that specifically are integrated into ontology development, management,

and evaluation tools.

[07:35] Bob Schloss: It would be an interesting exercise (but not something I am signing up to do) to

try to document this approach in some tool such as Rational Method Composer -

http://en.wikipedia.org/wiki/IBM_Rational_Method_Composer https://jazz.net/library/article/1092/

Then tooling to support an ontology development and release process, at least that based on Eclipse,

could actually have a sidebar with "What to do next?" for novice ontology developers. I think about

this because I am not sure that all commercial organizations have the budget to hire experienced

ontology designers so that their own staff can apprentice with these experienced and skilled people.

[07:37] Amanda Vizedom: To date: outside of a few, proprietary examples (e.g. Cyc), there are no true

Integrated Development Environments for ontology, as there are for software development.

[07:34] Steve Ray: All footnotes after #9 seem to have disappeared in the Google Doc.

[07:38] Amanda Vizedom: @Steve: I still have them showing...

[07:39] Amanda Vizedom: All: If you do not see all footnotes, you should be aware that we have

noticed a bit of bugginess in gdocs around this...

[07:41] Amanda Vizedom: Occasionally the footnotes seem to hide from people, possibly when using

browsers other than chrome.

[07:47] Steve Ray: @Amanda: Indeed footnotes don't seem to work in Safari but do work on my machine

in Chrome.

[07:42] Amanda Vizedom: We can produce a pdf download snapshot of it if needed.

[07:46] Peter P. Yim: @Amanda & Fabian - I have downloaded a version (from your google-doc) and is

versioning that as v1.0.0 dated 2013.05.03-10:30 which people are endorsing ... will post that pdf

on the wiki later too

[07:51] Amanda Vizedom: Thank you, Peter.

[07:58] GaryBergCross: I would just add to this discussion of "ontologies are part of systems" the

idea of ontologies as reference models (mentioned by Leo) and the type of use of ontology in Biomed

noted by Olivier. These seem one step removed from Apps by can be used there.

[08:05] anonymous morphed into Dan Carey

[08:06] Frank Olken: If Cyc has had an integrated ontology development environment for 15 years, then

it would be difficult for NSF/CISE/III to fund such a project as research - unless a case could be

made that the proposed ontology development environment was a substantial improvement over prior

art. It may be possible to fund an ODE via either Computer Research Infrastructure program, or via

the ACI (Advanced Computer Infrastructure) division's software tool development programs.

[08:31] Amanda Vizedom: @Frank: note that the Cyc environment is not in public domain, and is

customized for use with the CycL language, Cyc inference engine, and supporting infrastructure test

harness, test- and quality-related ontology, automated bookkeeping, inference tracing... To the best

of my knowledge (which I admit could be out of date), it is not usable outside of those conditions.

For example, it could not be used on ontologies in OWL or CLIF. And key pieces are not part of

OpenCyc (I believe because including it would allow too much, and too easy, reverse engineering of

the related proprietary Cyc technology)

[08:38] Amanda Vizedom: (continuing prior comment: so, it is a huge advantage for projects using

licensed, full Cyc. But unless the broader community using standard languages all start buying Cyc

licenses and working natively in CycL, it does not help the general ontology community, or

interoperability-oriented community using ontologies.

[08:38] Amanda Vizedom: )

[08:41] Ali Hashemi: yes!

[08:43] Doug Foxvog: A significant subset of the Cyc environment *is* available through earlier

versions of OpenCyc (through 2.0). OpenCyc 4.0 makes it difficult to access the Cyc environment.

[08:34] Peter P. Yim: == session resuming (after the break) ...

[08:36] Peter P. Yim: == the Hackathon-Clinics overview on behalf of the co-champions of this group of

H-C Activities

[08:40] Peter P. Yim: === Ken Baclawski: comments and suggestions for the Hackathon-Clinics activities?

...

[08:41] Peter P. Yim: [consensus] we should do the Hackathons & Clinics again

[08:42] Ali Hashemi: the scope is sometimes too much for one session

[08:44] anonymous morphed into Evan Wallace

[08:45] Amanda Vizedom: My suggestion: (1) start earlier, (2) allow for the possibility of multiple

iterations. For example, 1 day intensive work, then a few weeks later, after time to think about it,

another 1 day intensive.

[08:46] Amanda Vizedom: Another thought: allow for the possibility of some *entirely* asynchronous

(any time of day) projects, within a limited time span (say a weekend). I imagine that this could

work well for highly parallelizable projects with a good idea of what they want to get done.

[08:46] anonymous morphed into Djoko Sayogo

[08:47] Terry Longstreth: I suggest we separate hackathons from the summit, and have them

independently scheduled and planned

[08:52] Amanda Vizedom: There is, though, a lot of benefit from the flow of ideas between the summit

activities and the hackathons. Benefit for both, I think, from the relatedness of focus.

[08:57] Terry Longstreth: Related but different topic - followup on this summit - add a hotlink in

footnotes to Communique for posthoc comments, observations, activities - in essence a 2013Summit

blog - which could also be a place for FOLLOWUP hackathons.

[08:50] Peter P. Yim: Doug Foxvog noted that we should not have scheduled the activities over the Easter

Weekend ... and the point was well taken

[08:49] Frank Olken: Catholic Easter or Orthodox Easter?

[08:57] Doug Foxvog: @Frank: commercial Easter. The one with Easter bunnies, eggs, and family

get-togethers (in the US). FWIW, Orthodox Easter has not been interfered with (which may be

important for the Russians) -- it occurs this coming weekend.

[08:51] anonymous morphed into NicolauDePaula

[08:54] Frank Olken: I am opposed to pushing the Ontology Summit into June. It would run into Semantic

Technology Conference in SF or possibly SIGMOD/PODS conference.

[08:54] == Joel Bender was unable to join us to present on the HC-01 project - Steve Ray made a few

remarks as a participant in that activity

[08:56] anonymous morphed into James Michaelis

[08:59] Frank Olken: Steve, I agree that ontologies would help tighten up many standards. I would

point to work of HL7 on HL7 version 3 which is based on a reference information model from which HL7

messages are derived as views on the underlying Reference Information Model.

[09:01] Mike Dean: I tried to comment on BACnet, but apparently only introduced echo

[09:02] Steve Ray: Sorry Mike

[09:02] Mike Dean: My main point is that ASN.1 describes messages, so there was a need to represent

messages as well as the domain model

[09:00] == HC-02 The General Ontology Evaluation Framework (GOEF) & the I-Choose Use Case -

James Michaelis presenting (remotely)

[09:03] BobbinTeegarden11 morphed into Bobbin Teegarden

[09:04] anonymous morphed into Jerry Smith

[09:05] Amanda Vizedom: @James, could you speak a tiny bit slower? It's a bit hard to understand at

times.

[09:12] anonymous morphed into Dan Carey

[09:15] anonymous morphed into Ken Baclawski

[09:22] GaryBergCross: It is interesting to note in passing that they cite 3 different criteria

(from our 5) to evaluate the ontology - Correctness, Completeness, & Utility.

[09:27] Amanda Vizedom: @Gary - just to note, Joanne did present on GOEF during one of the summit

sessions. So the characteristics/requirements/etc mentioned as part of the GOEF framework were among

the many that we looked at, along with those from OntoQA, OQuaRE, OOPS!, other presentations, and

prior literature, that fed into the ongoing summit discussions -- which discussions ultimately led

to the clustering of in-scope potential requirements into the focal 5 we ended up with.

[09:20] == HC-03 Evaluation of OOPS! OQuaRE and OntoQA for FIBO Ontologies - Mike Bennett presenting

[09:32] anonymous morphed into Hans Polzer

[09:34] Bob Schloss: Listening to Mike talk about grounding FIBO concepts in legal, financial,

regulatory concepts, I am reminded that in the Intelligent Semantic Model Palette (for Smarter

Cities) that I have worked on with RosarioUcedaSosa and others, we adopted conventions to use

annotations so that for any concept in ISMP (which internally we call SCRIBE), its complete or

partial heritage or partial mapping to concepts in pre-existing representations, vocabularies or

data communication standards (such as Common Alerting Protocol, National Information Exchange Model,

DATEX II for transportation) is always specified. We think this may allow software developers

familiar with these standards to find the matching concepts in the ISMP ontology.

[09:40] GaryBergCross: @Amanda Is utility reflected in your 5 categories? deployability seems

closer, but is not quite it. I searched and the word 'utility' is not in the document.

[09:41] Amanda Vizedom: Gary, it is reflected, especially in fitness, but may require some unpacking

of implications to see...

[09:43] Amanda Vizedom: This comes under the heading of things we talked quite a lot about, that

provided important content to the Communique, but that may have a non-obvious terminological

alignment...

[09:44] Terry Longstreth: @Gary - I'm curious as to how one would measure utility empirically.

[09:45] GaryBergCross: @Amanda I can see that a bit, but the def doesn't easily lead me to think of

utility which is derived from it- Does the ontology accurately represent its domain? (Fidelity)

[09:45] Matthew West: @Gary: Utility is really a function of meeting requirements. If it isn't then

it means you did not get your requirements right.

[09:45] Amanda Vizedom: (I have particular hopes for the future work along the Ontology of Ontology

Evaluation lines to capture such alignments and relationships, including the work that Mike Bennett

just talked about.)

[09:45] Amanda Vizedom: (more on that after lunch)

[09:47] Symposium (SteveRay): == session adjourned for lunch ... reconvening in about 50 minutes

[09:48] Symposium (SteveRay): == all remote participants will need to dial-in to the conference

bridge again, after this lunch break. (Please dial-in a couple of minutes early if you can.)

[10:44] anonymous morphed into Dan Carey

[10:46] Peter P. Yim: please dial back into the conference bridge

[10:51] Symposium (SteveRay): == HC-04 Ontology Summit 2013 Content Hack: Leveraging Semantics on

OntologPSMW - Ken Baclawski presenting

[11:05] == HC-05 Hackathon: Ontology of Ontology Evaluation - Amanda Vizedom presenting

[11:09] Amanda Vizedom: Observation: that indirection in the ontology is actually a typical sign that

what you have is really not a standard ontology but a subject hierarchy / classification system. You

can either understand the subsumption relationship to be broader/narrower in the subject-headings

sense, or treat all of the class names as containing an elision of "information about..." (or "pages

about...," in this case.

[11:11] Mike Bennett: @Amanda that came up in some of the classification research we did with the

folks at UBC - for instance with books, French Grammar is not a kind of French, but a French Grammar

Book is a kind of Book about French. The "Thing" is the book / article etc. not the subject. Sounds

like like is applicable to wiki as well.

[11:16] GaryBergCross: I'd like to a see a Hackathon on converting some existing subject

classifications into a useful ontology!

[11:30] GaryBergCross: @Amanda This work is a good opportunity to integrate with some IT methods and

show Process diagram as well as an Object model both of which then get represented in an Ontology.

[11:33] Amanda Vizedom: @Gary, I like that idea.

[11:16] anonymous morphed into Dan Carey

[11:25] Hamizah Hamka: Amanda, did you consider the meta ontology proposed by AldoGangemi?

[11:27] Hamizah Hamka: Oqual

[11:28] Hamizah Hamka: http://km.aifb.kit.edu/ws/eon2006/eon2006gangemietal.pdf

[11:29] Anatoly Levenchuk: http://ontolog.cim3.net/forum/ontology-summit/2013-04/msg00038.html

[11:32] Amanda Vizedom: @Hamizah, we did not look at that one during the hackathon day, though we do

have it in the collection of relevant references. Thanks for the reminder.

[11:33] Mike Bennett: @Gary in FIBO we used Occurrent Things partition to create process primitives

and so draw process flows that were also ontologies - a bit primitive, since then Dennis Wisnosky has

worked on something in OMG which maps BPMN to OWL.

[11:37] GaryBergCross: @MikeBennett Yes , I was thinking of a simple Endurant / Occurent distinction

with these on a top level of the diagram so below things are sub-types of these 2.

[11:43] Bobbin Teegarden: @MikeBennett BPMN? But wouldn't a UML activity diagram be a richer

expression of the graph structure needed?

[11:44] Amanda Vizedom: @Gary, @Mike there are a number of fairly well-established ways to ontologize

the processes and process relationships, including scripts, subprocess hierarchies, specification of

participants and the role they play, etc.. Any of those could be applied in formally and shown in a

diagram which is itself quite understandable. I may have misunderstood Gary's first point; I took it

too me about the usefulness of having visual conventions (e.g., color, shape) for showing the

process and event things differently from, say, the actors and information objects.

[11:45] Bobbin Teegarden: @Amanda Shape, not color, my vote.

[11:48] Amanda Vizedom: @Bobbin - certainly color runs up against limits and perception variations

more quickly!

[11:49] Mike Bennett: @Amanda I'd like to look into that some more. I see potential for conceptual

modeling tooling which goes beyond ontology to business process, business rules etc., with

everything tied in to 1st order logic, math etc. - I like the idea of different appearances.

[11:49] GaryBergCross: @Amanda You understood what I was saying, which was to use a color or shape

code at this level, but that could be later formalized a bit by linking to DUL concepts.

[11:50] Mike Bennett: On appearances, there was a chap who presented at the last OMG meetings, on

taking a more scientific approach to appearances of things - tore into UML and the rest :)

[11:50] Mike Bennett: (for instance, use color as a way to help the eye differentiate things but not

as primary distinction which would be e.g. shape).

[11:53] Amanda Vizedom: @Bobbin - but good visualization and use of visual metaphors are areas in

which I tend to rely on the strengths and expertise of others -- I recognize them as important, and

also make a practice of attending to whether an intended audience (say, experts reviewing something)

can easily and correctly understand some presentation, or whether it needs to be modified for them.

In that (common) case, though, I often look for tools and/or metaphors that audience likes already,

or find someone who has more UI / visualization expertise to help solve it.

[11:53] GaryBergCross: @MikeBennett Yes the older convention seemed to be sq for continuent-objects

and ovals for process-occurents.

[11:54] Amanda Vizedom: @Gary, Mike - increasingly crowded convention-space. Shape uses in different

diagramming practices can conflict.

[11:55] Mike Bennett: @Gary is that published somewhere? We have the opportunity now to rethink and

improve the business facing visuals in our work.

[11:56] Steve Ray: I would recommend turning to UI research such as the work of Ben Schneiderman for

some good principles.

[11:56] Bobbin Teegarden: @Amanda Agree that human sensory reaction important. Thought: color doesn't

print well, turns out it's important for model usage, I think.

[11:57] Amanda Vizedom: @Mike, during the USAF project, we had that specific issue: bridging BPMN and

OWL. Well, not only that; representing BPMN in OWL was useful but didn't solve our whole problem. We

  • really* wanted to bridge the work of Enterprise Architects and that of Ontologists, so that we

could have more continuity &integration of work and reuse of information gathering.

[11:58] GaryBergCross: @MikeBennett Data Flow Diagrams The formal, structured analysis approach

employs the data-flow diagram (DFD) to assist in the functional decomposition process. I learned

structured analysis techniques from DeMarco [7], and those techniques are representative of present

conventions. To summarize, DFD's are comprised of four components: External interactors are

represented by a rectangle. Data stores are represented by an open rectangle (2 or 3 sides).

Processes are represented by any rounded object (a circle, oval, or square with rounded corners). A

DFD process may represent system function at one of various levels, atomic through aggregate. Data

flows are represented by arrows, with labels indicating their content.

http://www.umsl.edu/~sauterv/analysis/dfd/DiagrammingMethods.html

[11:58] Mike Bennett: Turns out that UI chap is right here in Maryland http://www.cs.umd.edu/~ben/

[11:58] Mike Bennett: @Gary, ah yes, I remember those.

[11:59] Amanda Vizedom: E.g. EA often bottoms out at the exchange of information objects (e.g.,

reports, data artifacts). It doesn't go into the information content of those objects or that

exchange. That's where the ontologists on that project were picking up...

[12:00] Mike Bennett: @Amanda what I'd want to see is something where you draw the process flow in

front of the users, so it looks exactly like a Visio swimlanes diagram, but behind the scenes each

Process, Process Activity, Process Event etc. is given its 'is a' relationship to the kind of

occurrent thing it is a kind of. Then in drawing the process you draw the process ontology.

[12:00] Bob Schloss: If changes are being made to OntoHub, would the team consider adding social

media facilities -- such as where visitors can participate in a discussion forum, with questions,

answers, vetted answers-to-questions (FAQ), around each ontology registered with the Hub, as well as

perhaps discussion of the performance of different reasoners in different configurations with

different databases with the ontology, etc.

[12:00] GaryBergCross: @Amanda I guess, theoretically the Data Ref Models of EA were proposed to

cover the "content".

[12:00] Steve Ray: @Mike: Indeed, he's local. As I recall, for example, he invented the notion of

TreeMaps and space-filling maps, which are now very popular.

[12:01] Amanda Vizedom: And, of course, the processes provided context that was implicit in the data,

and which we wanted to make explicit in the ontology. Plus, some of the content was about processes!

[12:02] Bobbin Teegarden: @Gary @MikeBennett yes, we have used Data Flow Diagrams for initial

(unified domain) modeling, then broken it into UML process/structure(class) because of the need to

get to code. The DFD model is a good place to start with 'active ontologies', IMHO.

[12:02] Steve Ray: Golden Rules of Interface Design:

http://faculty.washington.edu/jtenenbg/courses/360/f04/sessions/schneidermanGoldenRules.html

[12:02] GaryBergCross: On yes Ben Shneiderman. A guru in the field.

[12:03] anonymous morphed into Pete Nielsen

[12:04] Mike Bennett: @Bobbin the weird thing is that "pure" UML would not let you mix activity and

class diagrams, yet you need to talk about inputs / resources and products of process activities

(the Sparx EA tool lets you do hybrid diagrams for that). Vital for e.g. securities issuance process

and related reference data elements.

[12:04] Amanda Vizedom: @Mike - Robert Kahlert (Cycorp) and I envisioned and prototyped just such a

tool under the RKF project (circa 2003?). This in response to working with domain experts & trying

to enable them to directly create terrain analysis ontology. There's a paper draft from that kicking

around somewhere.

[11:25] == HC-06 ISO 15926 Reference Data Validation - Anatoly Levenchuk presenting (remotely)

[11:45] == HC-07 Ontohub-OOR-OOPS! Integration - Till Mossakowski presenting (remotely)

[12:06] Bob Schloss: On Slide 13, in the table, row 3, column 2, there is a typo (it says langauge.id

instead of language.id)

[12:07] Mike Bennett: This Federation API work would also be of interest in the OMG SIMF initiative

(semantics of information models for federation), I think. (current slides)

[12:07] Amanda Vizedom: Motivator was that the experts could easily call up and articulate their

expert knowledge while performing, simulating, or describing their terrain analysis processes, but

not outside of that. Without the process context, the pieces either made no sense to them or seemed

to be show-stoppingly subject to misunderstanding.

[12:10] Bobbin Teegarden: @MikeBennett MagicDraw let's you mix class with process in activity

diagrams, just fyi, as I use it for those 'DFD' diagrams.

[12:15] == Michael Grüninger announced that the winner of First IAOA Best Ontology Summit

Hackathon-Clinic Prize is the HC-03 team that worked on "Evaluation of OOPS! OQuaRE and OntoQA for

FIBO Ontologies"

[12:16] Amanda Vizedom: Congratulations to the HC-03 team!

[12:20] Mike Bennett: Thank you! Here's a big shout out to AstridSuqueRamos, MariaPovedaVillalon,

Samir Tartir and also the rest of the team - Simon, Amanda, Peter, the FIBO folks (Jacobus Geluk,

Derek LaSalle, Max Gillmore, Kevin Tyson and others), all of whom put in valuable ideas and

perspectives to the event.

[12:25] == Michael Grüninger and Matthew West: Discussing Next Steps and Conclusion

[12:25] GaryBergCross: (ref. the comment on less people coming to the symposium) Contributing Reason

Sequestation

[12:36] GaryBergCross: Suggestion Have a half day workshop preceding the Symposium for newbies who

might be shy about attending w/o more knowledge.

[12:30] Jerry Smith: Peter - How do people 'sign' the Communique electronically?

[12:36] Peter P. Yim: @Jerry & ALL - for those who are online (i.e. now, virtually), you can just type

in "I endorse the communique") for those who are not around, we will be posting a solicitation for

endorsement to the [ontology-summit] mailing list shortly!) - ref.

http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Communique

[12:41] Mike Bennett: We would expect to build on the HC-03 hackathon work by building on the

Ontology of Ontology Evaluation as a formal basis for structuring this work.

[12:41] Evan Wallace: @MikeBennett Some of the folks involved with Ontohub were initially involved in

SIMF submission development. But I haven't noticed much involvement from those people in SIMF in

recent months. I can think of many different reasons for that. SIMF was a great idea, but I doubt it

will live up to its potential (if it results in anything at all).

[12:44] Mike Bennett: @Evan I'd forgotten there was some overlap. I'd like to have been more involved

but we're an OMG Domain Mamber and so no eligible to participate. Been thinking of some deep

meta-metamodel ideas, which reflects a small part of what I saw in those slides today.

[12:42] anonymous morphed into Dan Carey

[12:45] Frank Olken: Lots of distortion on the Skype audio channel now.

[12:46] == Michael Grüninger: join us on 23-May-2013 Thu (normal virtual session time; was 16-May

when Michael announced this, date subsequently changed) for the Ontology Summit 2013 Post Mortem

session

[12:46] == Michael Grüninger: participants welcome to stay for the "Birds of a Feather (BOF) meeting

about follow-up work on the "Ontology of Ontology Evaluation" (HC-05) work

[12:47] Frank Olken: Maybe....

[12:47] Ali Hashemi: briefly though.

[12:47] Bobbin Teegarden: Yes, staying.

[12:50] Jerry Smith: CONGRATULATIONS! Each Summit gets better and better. The outstanding success of

this one tops all of the others. Great job all!!!

[12:51] vnc: == the Ontology Summit 2013 Symposium is now adjourned

[12:53] List of attendees: Ali Hashemi, Amanda Vizedom, Anatoly Levenchuk, AstridDuqueRamos,

Bob Schloss, Bobbin Teegarden, Bruce Bray, Christian Hempelmann, Clare Paul, Dan Carey, Djoko Sayogo,

Doug Foxvog, Evan Wallace, Frank Olken, GaryBergCross, Hamizah Hamka, Hans Polzer, James Michaelis,

Jerry Smith, Ken Baclawski, LaVernPritchard, Matthew West, Megan Katsumi, Mike Bennett, Mike Dean, Misha ,

NicolauDePaula, Oliver Kutz, Pavithra Kenjige, Pete Nielsen, Peter P. Yim, Steve Ray, Sylvia Spengler,

Symposium (SteveRay), Terry Longstreth, Till Mossakowski, anonymous, anonymous1, vnc, vnc2

[12:52] vnc: === we are resuming in 8 minutes for the informal BOF on "Ontology of Ontology

Evaluation" session

[12:52] Amanda Vizedom: 10 minute break, then Birds of a Feather session re: continuing work on

ontology of ontology evaluation

[13:03] Peter P. Yim: == Birds of a Feather (BOF) meeting re: continuing work on ontology of ontology

evaluation ... is now in session

[13:06] Ali Hashemi: Ali committing to provide an English description of the informal model.

[13:06] Ali Hashemi: Make the Hackathon page or a new Ontology of Ontology Evaluation page as

centralized starting point.

[13:06] Ali Hashemi: ?

[13:07] Mike Dean: I don't think you can hear me. I'm interest in continuing to work on and update

the OWL formalization.

[13:07] Mike Dean: s/interest/interested/

[13:13] Amanda Vizedom: subcollections of

https://www.zotero.org/groups/ontologysummit2013/items/collectionKey/PVGF24A6

[13:13] Peter P. Yim: the HC-05: "Ontology of Ontology Evaluation" Project Homepage is at:

http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Hackathon_Clinics_OntologyOfOntologyEvalu

ation

[13:14] Peter P. Yim: shared-files (artifacts) are under:

http://ontolog.cim3.net/file/work/OntologySummit2013/Hackathon-Clinics/HC-05_Ontology-of-OntologyEva

luation/

[13:15] Amanda Vizedom: I am interested in continuing to grapple the graphical informal model. The

final informal model will be submitted for team review, but in between I would love help, tool

suggestions, etc.

[13:17] vnc: the shadowed HC-05 project homepage at the OntologPSMW -

http://ontolog-02.cim3.net/wiki/OntologySummit2013_Hackathon_Clinics_OntologyOfOntologyEvaluation

[13:19] Amanda Vizedom: Vote yes if you want to be involved and included in communication about

continuing activity on this project. Then email me and tell me what email to use for that.

(firstname.lastname@gmail.com) (1) Yes (2) No This is a single choice vote.

[13:20] Ali Hashemi: (1)

[13:20] Ali Hashemi: Ali Hashemi voted for: Yes

[13:20] Mike Bennett: Mike Bennett voted for: Yes

[13:21] DougFoxvog1: Yes

[13:21] DougFoxvog1 morphed into Doug Foxvog

[13:21] Peter P. Yim: Peter P. Yim voted for: Yes

[13:21] Mike Dean: Mike Dean voted for: Yes - mdean [at] bbn.com

[13:22] GaryBergCross: GaryBergCross voted for: Yes - gbergcross [at] gmail.com

[13:22] Mike Bennett: Use mikehypercube [at] gmail.com

[13:23] Ali Hashemi: http://arxiv.org/abs/1304.7224

[13:23] Frank Olken: There is a lot of work going on in the provenance community. Some of it in W3C

working group.

[13:24] KenBaclawski1: KenBaclawski1 voted for: Yes - I can help with ICOM at least

[13:24] GaryBergCross: Qood grid: A metaontology-based framework for ontology evaluation and

selection Aldo Gangemi

[13:24] Peter P. Yim: I suggest we volunteer Michael Grüninger on work related to OMV (as he leads the

metadata effort for OOR too)

[13:25] Ali Hashemi: http://www.ccs.neu.edu/home/kenb/ontologies/ucdo.owl

[13:25] Ali Hashemi: Use Case Description Ontology -

http://ontolog.cim3.net/cgi-bin/wiki.pl?OpenOntologyRepository_UseCases

[13:28] KenBaclawski1: We should also include the Use Case Description Ontology (UCDO)

[13:29] Terry Longstreth: Time to go find a beer...

[13:29] Terry Longstreth: Bye all; Thanks for a great Summit!!

[13:30] Ali Hashemi: Great summit, congrats to all. Bye!

[13:31] Peter P. Yim: the has been marvelous! ... bye everyone ... talk to you all again on May-16, if

not sooner!

[13:31] Amanda Vizedom: Thank you all!

-- end of chat session --

  • ... More Questions
    • For those who have further questions or remarks on the topic, please post them to the "ontology-summit" list so that everyone in the community can benefit from the discourse.

Audio Recording of the Workshop Sessions

  • edited and post-processed audio segment will be posted against the corresponding agenda items above later ...(coming!)
  • the unedited, original recordings can be found here
  • suggestions:
    • its best that you listen to the session while having the respective [ presentations (slides) ] opened in front of you. You'll be prompted to advance slides by the speaker.
    • Take a look, also, at the rich body of knowledge that this community has built together, over the years, by going through the archives of noteworthy past Ontolog events. (References on how to subscribe to our podcast can also be found there.)

For the records ...

How To Join Remotely (while the session is in progress)

Session Details

  • Date: Thursday, 2-May-2013 & Friday 3-May-2013
  • Start Time: (both days) 9:00am EDT / 6:00am PDT / 3:00pm CEST / 2:00pm BST / 13:00 UTC
    • World Clock ref: [ Thursday 2-MAY ] and [ Friday 3-MAY ]
    • On-site participants should arrive at the venue 30 minutes before the session start time, and remote participants should dial into the conference bridge at 10 minutes before the scheduled start time.
  • Expected Call Duration: please refer to [ agenda details below]
  • Remote Participant Dial-in: see - Conference Call Details
  • In-session chat-room url:
    • (for day-1) http://webconf.soaphub.org/conf/room/summit_20130502 &
    • (for day-2) http://webconf.soaphub.org/conf/room/summit_20130503
    • instructions: once you got access to the page, click on the "settings" button, and identify yourself (by modifying the Name field from "anonymous" to your real name, like "JaneDoe").
    • You can indicate that you want to ask a question verbally by clicking on the "hand" button, and wait for the moderator to call on you; or, type and send your question into the chat window at the bottom of the screen.
    • thanks to the soaphub.org folks, one can now use a jabber/xmpp client (e.g. gtalk) to join this chatroom. Just add the room as a buddy - (in our case here) summit_20130502@soaphub.org (for day-1) & summit_20130503@soaphub.org (for day-2) ... Handy for mobile devices!
  • Discussions and Q & A:
    • Nominally, when a presentation is in progress, the moderator will mute everyone, except for the speaker.
    • To un-mute, press "*7" ... To mute, press "*6" (please mute your phone, especially if you are in a noisy surrounding, or if you are introducing noise, echoes, etc. into the conference line.)
    • we will usually save all questions and discussions till after all presentations are through. You are encouraged to jot down questions onto the chat-area in the mean time (that way, they get documented; and you might even get some answers in the interim, through the chat.)
    • During the Q&A / discussion segment (when everyone is muted), If you want to speak or have questions or remarks to make, please raise your hand (virtually) by clicking on the "hand button" (lower right) on the chat session page. You may speak when acknowledged by the session moderator (again, press "*7" on your phone to un-mute). Test your voice and introduce yourself first before proceeding with your remarks, please. (Please remember to click on the "hand button" again (to lower your hand) and press "*6" on your phone to mute yourself after you are done speaking.)
  • For those who cannot join us, or who have further questions or remarks on the summit topic and content, please post them to the [ ontology-summit ] listserv so that everyone in the community can benefit from the discourse.
  • Registration, Venue & Remote dial-in information
    • registration for on-site attendance is mandatory (due to the venue being a government facility), and the deadline is 22-Apr-2013.
    • For On-site Attendees: see registration details here (click on the "CONFERENCE REGISTRATION" link to register.) Registration is mandatory, and the deadline is 22-Apr-2013 ... (details)
    • Remote participation is supported; see registration details here
  • Please note that this session may be recorded, and if so, the audio/video archive is expected to be made available as open content, along with the proceedings of the call to our community membership and the public at-large under our prevailing open IPR policy.
  • Logistics:
    • NIST
      • NIST opens at 7 am
      • NIST locks the gates at 7 pm
      • Leave NIST by 6:30 pm to avoid issues
      • Cafeteria hours: 7:30 am - 3 pm
  • Emergency:

Ram's NIST Admin Asst: Janet Madison, 301-975-8616



Retrieved from "https://ontologforum.com/index.php?title=OntologySummit2013_Symposium&oldid=259"