Actions

ConferenceCall 2023 10 11 and ConferenceCall 2023 10 18: Difference between pages

Ontolog Forum

(Difference between pages)
 
mNo edit summary
 
Line 2: Line 2:
|-
|-
! scope="row" | Session
! scope="row" | Session
| [[session::Setting the stage]]
| [[session::A look across the industry, Part 1]]
|-
|-
! scope="row" | Duration
! scope="row" | Duration
Line 8: Line 8:
|-
|-
! scope="row" rowspan="3" | Date/Time
! scope="row" rowspan="3" | Date/Time
| [[has date::11 Oct 2023 16:00 GMT]]
| [[has date::18 Oct 2023 16:00 GMT]]
|-
|-
| 9:00am PDT/12:00pm EDT
| 9:00am PDT/12:00pm EDT
Line 15: Line 15:
|-
|-
! scope="row" | Convener
! scope="row" | Convener
| [[convener::AndreaWesterinen|Andrea Westerinen]] [[convener::MikeBennett|Mike Bennett]]
| [[convener::AndreaWesterinen|Andrea Westerinen]] and [[convener::MikeBennett|Mike Bennett]]
|}
|}


Line 21: Line 21:


== Agenda ==
== Agenda ==
'''[[DeborahMcGuinness|Deborah L. McGuinness]]'''<br />
* '''Kurt Cagle''', Author of [https://thecaglereport.com/ The Cagle Report]
Rennselaer Tetherless World Senior Constellation Chair<br />
** '''Title:''' Complementary Thinking: Language Models, Ontologies and Knowledge Graphs
Professor of Computer Science, Cognitive Science, and Industrial and Systems Engineering<br />
** '''Abstract:''' LLM, ontology and knowledge graph technologies are evolving rapidly. It is important to view these technologies from multiple perspectives and understand how those perspectives are shifting.
 
* '''Tony Seale''', Knowledge graph architect and thought leader ([https://www.linkedin.com/in/tonyseale/ LinkedIn])
'''Title''': ''The Evolving Landscape: Generative AI, Ontologies, and Knowledge Graphs''
** '''Title:''' How Ontologies Can Unlock the Potential of Large Language Models for Business
 
** '''Abstract:''' LLMs have remarkable capabilities; they can craft letters, analyze data, orchestrate workflows, generate code, and much more. Companies such as Google, Apple, Amazon, Meta, and Microsoft are all investing heavily in this technology. Everything indicates that LLMs have enormous disruptive potential. However, there is a problem: they can hallucinate, and for any serious business, that is a deal-breaker. This is where ontologies can come in. In combination with Knowledge Graphs, they can place guardrails around the LLMs, thus allowing organizations to harness the capabilities of LLMs within the framework of a safely controlled ontological structure.
'''Abstract''': AI is in the news with astonishing regularity and the variety of announcements is often dizzying. In this talk, we will explore some opportunities (as well as threats) from the world of generative AI with respect to semantic technologies. We will explore some questions worth pondering as we plan our ontology and knowledge graph directions and hopefully leave with some mutually beneficial synergies between large language models and classical Ontology Summit topics.
 
[https://bit.ly/3LYsfgh Slides]
 
[https://bit.ly/48PYojR Video Recording]


== Conference Call Information ==
== Conference Call Information ==
* Date: '''Wednesday, 11 October 2023'''  
* Date: '''Wednesday, 18 October 2023'''  
* Start Time: 9:00am PDT / 12:00pm EDT / 6:00pm CEST / 5:00pm BST / 1600 UTC
* Start Time: 9:00am PDT / 12:00pm EDT / 6:00pm CEST / 5:00pm BST / 1600 UTC
** ref: [http://www.timeanddate.com/worldclock/fixedtime.html?month=10&day=11&year=2023&hour=12&min=00&sec=0&p1=179 World Clock]
** ref: [http://www.timeanddate.com/worldclock/fixedtime.html?month=10&day=18&year=2023&hour=12&min=00&sec=0&p1=179 World Clock]
* Expected Call Duration: 1 hour
* Expected Call Duration: 1 hour
{{:OntologySummit2024/ConferenceCallInformation}}
{{:OntologySummit2024/ConferenceCallInformation}}


== Participants ==
== Participants ==
* [[AndreaWesterinen|Andrea Westerinen]]
* Ayya Niyyanika Bhikkhuni
* [[BartGajderowicz|Bart Gajderowicz]]
* [[DeborahMcGuinness|Deborah McGuinness]]
* [[DouglasMiles|Douglas Miles]]
* [[GaryBergCross|Gary Berg-Cross]]
* John O'Gorman
* [[JohnSowa|John Sowa]]
* [[KenBaclawski|Ken Baclawski]]
* [[LeiaDickerson|Leia Dickerson]]
* [[MarkUnderwood|Mark Underwood (IS Innovation)]]
* [[MikeBennett|Mike Bennett]]
* Phil Jackson
* [[RaviSharma|Ravi Sharma]]
* [[SusanneVejdemo|Sus Vejdemo]]
* [[ToddSchneider|Todd Schneider]]


== Discussion ==
== Discussion ==
* [[RaviSharma|Ravi Sharma]] : Deborah what if the training set is not representative, how do we know the errors are due to lack of a good raining set or bad algorithms such as Bayes implementation?
* [[RaviSharma|Ravi Sharma]] : Would like to know how much richness beyond ontologies can be added to KGs?
** [[ToddSchneider|Todd Schneider]] : What about the converse: How can ontologies be leveraged to improve LLMs?
** [[ToddSchneider|Todd Schneider]] : Ontologies and knowledge graphs provide explicitness, in contrast to LLMs.
* [[BartGajderowicz|Bart Gajderowicz]] : Following this year’s FOIS in Canada, I submitted a proposal for a FOIS Working Group specifically for an ontology benchmark suite, in case anyone is interested in joining me in the effort.
** [[ToddSchneider|Todd Schneider]] : Bart, ‘ontology benchmark suite’??
** [[BartGajderowicz|Bart Gajderowicz]] : Yes, it’s exactly what is it sounds like. At FOIS there were a few presentations that used datasets and a few that found issues with published ontologies. It came from these works
* [[RaviSharma|Ravi Sharma]] : Are LLM aware of Graphic way of understanding or even ability to create imagelike information from patterns?
* [[MikeBennett|Mike Bennett]] : I would expect a wine ontology to have 'Relative' concepts like terroir (land in wine context); vintage (time in wine context); varietal (grape in wine context) etc. i.e. contextually relevant concepts. The reason I mention it: how does any LLM recognize or relate to contextually relative concepts?
* [[RaviSharma|Ravi Sharma]] : Seems like Agile development type template
* [[RaviSharma|Ravi Sharma]] : In wine ontology, what would be impact of adding one or two more variables?
* [[SusanneVejdemo|Sus Vejdemo]] : I'm creating an ontology for the linguistics of temperature terms (how different language communities divide up the sensation of hot vs cold in different ways). I used chatGPT to help me with OWL syntax - but if I hadn't already had a very firm grasp of what I wanted to know, it would have led me pretty wrong.
* [[DouglasMiles|Douglas Miles]] : LLMs turn out to be the best version of a search engine at finding obscure data
** [[DouglasMiles|Douglas Miles]] : (not calling *this* obscure, but it is ideal for finding exactly the works we are looking for sometimes)
* [[SusanneVejdemo|Sus Vejdemo]] : Beware - chatGPT can sometimes delete classes without informing you if you run bigger ontologies through it.
** [[RaviSharma|Ravi Sharma]] : Sue that is why context and prior knowledge are good filters?
* [[DouglasMiles|Douglas Miles]] : often i will ask "What information was jst left out"
** [[DouglasMiles|Douglas Miles]] : and the LLM usually (with enough harassment) will supply me with what i wanted
* [[MikeBennett|Mike Bennett]] : I like ChatBS as a term. LLM is technically bullshit.
** [[RaviSharma|Ravi Sharma]] : What is ChatBS? why is it more suitable?
* [[RaviSharma|Ravi Sharma]] : Deborah I also started with changing the Country (e.g. India) and ended with changing myself.
* Phil Jackson : Can LLM's perform 'self-talk' yet, e.g. to emulate artificial consciousness?
** [[BartGajderowicz|Bart Gajderowicz]] : There’s a recent paper that evaluates whether the LLM knows it’s hallucinating, that may be close to its internet “thinking” as it explores different text it wants to generate: Azaria, A., & Mitchell, T. (2023). The Internal State of an LLM Knows When its Lying. http://arxiv.org/abs/2304.13734
** Phil Jackson : thanks for this reference
** [[SusanneVejdemo|Sus Vejdemo]] : We'd want it to have an "evidentiality" signal, like some natural languages do!
* [[DouglasMiles|Douglas Miles]] : Chat GPT3.5 or 4 there?
** [[DouglasMiles|Douglas Miles]] : hah forecasting
* [[MikeBennett|Mike Bennett]] : Mansplaining as a service
* [[JohnSowa|John Sowa]] : Summary of all these messages:  LLMs are flaky. If you're lucky, they're great. If not, you have no idea what went wrong.  That is not acceptable for any mission-critical applications.
* [[RaviSharma|Ravi Sharma]] : What would have the outcome been if you had experts keyinputs to create a new exposures health ontology?
* [[GaryBergCross|Gary Berg-Cross]] : It will be good to look at these leverage and pain points again in a year
* John O'Gorman : @Semantium is using a faceted, foundational ontology
* [[DouglasMiles|Douglas Miles]] : GPT for Python code, it's kinda hit-or-miss.. mostly garbage. But with Prolog and Lisp, it's useful!..  Maybe it's because there's less bad code out there (only one place the CMU AI archive).. Tehre will be a big market for LLM curators
* [[ToddSchneider|Todd Schneider]] : We don’t even know what ‘context’ is.
** [[MikeBennett|Mike Bennett]] : Context is the nexus of time, place, role, event etc. i.e. a bunch of concepts in the ontology (or instances of these)
** John O'Gorman : @Todd Schneider - Context is the way language reduces ambiguity.
*** [[ToddSchneider|Todd Schneider]] : Yes, but that’s an application of [a] ‘context’.
** [[AndreaWesterinen|Andrea Westerinen]] : I have tried to provide ‘context’ in my prompts. For example, summarize this news article assuming it was written by a right-wing publication.
* [[DouglasMiles|Douglas Miles]] : You have to harass them over and over John .. such as "Gbvie me three completely different translations to CLIF:
* [[AndreaWesterinen|Andrea Westerinen]] : My “sandbox” is translating NL to an ontology.  Will be talking about it on Nov 1.
** [[MarkUnderwood|Mark Underwood (IS Innovation)]] : will try to make your talk.  May have possible uses for specialized, DSL-type ontologies that are constructed from emerging, fresh domains; e.g., AWS Lambda
* [[GaryBergCross|Gary Berg-Cross]] : Just as chatGPTs can do some programming they can express concepts in formal languages and thus help with Ontology population.
* [[DouglasMiles|Douglas Miles]] : "Would that translation you just gave translate back to the same English?"
* [[BartGajderowicz|Bart Gajderowicz]] : John Sowa: Speaking with those in classic literature, translation models do a poor job exactly because of the nuances in classics where meaning is lost due to the poetic styles
* [[DouglasMiles|Douglas Miles]] : i am in general agreement.. and admit there is no clear way to resolve LLM issues
* Ayya Niyyanika Bhikkhuni : The metrics are a concern even more when the “research” being done is about what something from an ancient language means and how to apply what it “means” in today’s world.  So the pain point of competency  metrics is not just the actual textual validity of the translation but also of “context.”
* [[SusanneVejdemo|Sus Vejdemo]] : What's a good way to get on the mailing list? I found this seminar from a Taxonomy LinkedIn group post. (I'm a linguist, semanticist)
** [[LeiaDickerson|Leia Dickerson]] : https://ontologforum.com/index.php/WikiHomePage
** [[LeiaDickerson|Leia Dickerson]] : Sign up and more info is here.  Also, if you are not on it, I suggest adding yourself to the KGC Slack channel. https://www.knowledgegraph.tech/community/
** [[AndreaWesterinen|Andrea Westerinen]] : Send email to membership@ontologforum.org
* [[GaryBergCross|Gary Berg-Cross]] : I've used chats for competency Qs but not use cases which seems like an interesting possibility as part of KE sessions.


== Resources ==
== Resources ==
* [https://bit.ly/48PYojR Video Recording]


== Previous Meetings ==
== Previous Meetings ==
{{#ask: [[Category:OntologySummit2024]] [[Category:Icom_conf_Conference]] [[<<ConferenceCall_2023_10_11]]
{{#ask: [[Category:OntologySummit2024]] [[Category:Icom_conf_Conference]] [[<<ConferenceCall_2023_10_18]]
         |?|?Session|mainlabel=-|order=desc|limit=3}}
         |?|?Session|mainlabel=-|order=desc|limit=3}}
== Next Meetings ==
== Next Meetings ==
{{#ask: [[Category:OntologySummit2024]] [[Category:Icom_conf_Conference]] [[>>ConferenceCall_2023_10_11]]
{{#ask: [[Category:OntologySummit2024]] [[Category:Icom_conf_Conference]] [[>>ConferenceCall_2023_10_18]]
         |?|?Session|mainlabel=-|order=asc|limit=3}}
         |?|?Session|mainlabel=-|order=asc|limit=3}}



Revision as of 19:08, 15 October 2023

Session A look across the industry, Part 1
Duration 1 hour
Date/Time 18 Oct 2023 16:00 GMT
9:00am PDT/12:00pm EDT
4:00pm GMT/5:00pm CST
Convener Andrea Westerinen and Mike Bennett

Ontology Summit 2024 A look across the industry, Part 1

Agenda

  • Kurt Cagle, Author of The Cagle Report
    • Title: Complementary Thinking: Language Models, Ontologies and Knowledge Graphs
    • Abstract: LLM, ontology and knowledge graph technologies are evolving rapidly. It is important to view these technologies from multiple perspectives and understand how those perspectives are shifting.
  • Tony Seale, Knowledge graph architect and thought leader (LinkedIn)
    • Title: How Ontologies Can Unlock the Potential of Large Language Models for Business
    • Abstract: LLMs have remarkable capabilities; they can craft letters, analyze data, orchestrate workflows, generate code, and much more. Companies such as Google, Apple, Amazon, Meta, and Microsoft are all investing heavily in this technology. Everything indicates that LLMs have enormous disruptive potential. However, there is a problem: they can hallucinate, and for any serious business, that is a deal-breaker. This is where ontologies can come in. In combination with Knowledge Graphs, they can place guardrails around the LLMs, thus allowing organizations to harness the capabilities of LLMs within the framework of a safely controlled ontological structure.

Conference Call Information

  • Date: Wednesday, 18 October 2023
  • Start Time: 9:00am PDT / 12:00pm EDT / 6:00pm CEST / 5:00pm BST / 1600 UTC
  • Expected Call Duration: 1 hour
  • Video Conference URL: https://bit.ly/48lM0Ik
    • Conference ID: 876 3045 3240
    • Passcode: 464312

The unabbreviated URL is: https://us02web.zoom.us/j/87630453240?pwd=YVYvZHRpelVqSkM5QlJ4aGJrbmZzQT09

Participants

Discussion

Resources

Previous Meetings

 Session
ConferenceCall 2023 10 11Setting the stage
ConferenceCall 2023 10 04Overview

Next Meetings

 Session
ConferenceCall 2023 10 25A look across the industry, Part 2
ConferenceCall 2023 11 01Demos of information extraction via hybrid systems
ConferenceCall 2023 11 08Broader thoughts
... further results