Tweet
Tweet

Slide 1

Slide 1 text

Scaling Ontologies with Language Models and Math [email protected] Marc Green

Slide 2

Slide 2 text

Problems ● Humanity’s corpus of scientific knowledge is not yet robustly linked ● Ontology engineering is hard, time-consuming, and expensive [email protected] Marc Green ● Ologs provide mathematical robustness to ontologies ● Language Models increase efficiency and accessibility of knowledge workflows Solutions

Slide 3

Slide 3 text

Intro to Ologs (ontology logs) [email protected] - “Rigorous mathematical framework for knowledge representation, construction of scientific models, and data storage” (Spivak, 2011) - More scalable than traditional semantic web standards like RDF Marc Green (Spivak, 2011) (Spivak, 2011)

Slide 4

Slide 4 text

Intro to Language Models (LMs) - Enable a new paradigm of Human-Computer Interaction - B2C for closed domains (chatbots), B2B for open domains (ai assistants) [email protected] Marc Green https://huggingface.co/blog/large-language-models

Slide 5

Slide 5 text

Ontochain application idea: Ontology AI Assistant - Public service to increase access to and utility of shared understandings - Key Ideas: - Language Models increase accessibility and improve efficiency of working with text - Ologs provide rigorous and scalable mechanism for building shared understandings - Potential features: - Natural Language UI for interacting with ontologies (querying, editing, aligning, etc) - SotA NLP for systematic generation and manipulation of ontologies (eg from existing literature) - Integrates with decentralized network, knowledge graph and knowledge/asset market - Modular architecture allows app to scale as LM tech improves [email protected] Marc Green

Slide 6

Slide 6 text

[email protected] Marc Green

Slide 7

Slide 7 text

Other References and Related Work ● Spivak, 2011: Ologs: a categorical framework for knowledge representation (arXiv:1102.1889) ● “23% searching …”: https://topos.institute/networked-mathematics ● Training and Application of Neural-Network Language Model for Ontology Population (https://www.researchgate.net/publication/347861342_Training_and_Applicati on_of_Neural-Network_Language_Model_for_Ontology_Population) ● Ontology-Based Model Abstraction (https://www.researchgate.net/publication/332290797_Ontology-Based_Mode l_Abstraction) ● Semantic Scholar by Allen Institute of AI ● MathFoldR by Topos Institute [email protected] Marc Green