Information Architecture From Data Products to Knowledge Graph

For far too long, information technology has been overly concerned with the technology itself, rather than the information it manages. The truth is that technology is only the means of delivering information — information is the underlying asset that can be used to gain strategic advantage.
This is why it's more crucial than ever to focus more on how to architect information than on how to architect technologies. In this talk at the Data-Centric AI Forum 2024, I provide a concise overview of this critical topic.

📽️ The recording of the talk is available here: https://www.youtube.com/watch?v=Oe0mjHM2Ghw

Transcript

1. Information Architecture From Data Products to Knowledge Graph
2. Speaker: Andrea Gioia
3. Andrea Gioia Hi there 👋 I'm Andrea Gioia, CTO at Quantyca, and Co-founder of blindata.io With 20+ years in the game, I have navigated the data universe up and down, one project at a time. LinkedIn: /andreagioia Github: /andrea-gioia 05
4. INFORMATION ARCHITECTURE
5. Information architecture Data is an asset that only unlocks its value when put to use. Data management cannot be limited to just managing data DATA RELATIONSHIPS + Meaning KNOWLEDGE INTELLIGENCE ALGORITHMS + Actions METADATA Context INFORMATION +
6. Information architecture No matter what your data background is, we share a common mission: create value from data. A holistic approach is crucial to succeed. DATA INFORMATION KNOWLEDGE INTELLIGENCE Data Scientists Data Engineers Information Architects & Data Stuarts Ontologists & Business Experts Cross Functional Team
7. DATA
8. Data Management Solutions Monolithic solutions Modular solutions
9. Data Product A data product is a modular unit within the data architecture, tailored to the cognitive capacity of the responsible team and developed following product management principles to make a data asset accurate, relevant, combinable, and readily usable for future value creation.
10. Data Product Data Product Data Asset Accuracy Relevance Reusability Composability VALUE Identify and maintain Share and multiply
11. INFORMATION
12. Data Product Interoperability Interoperability Federated Governance Standardizes Self-Serve Platform Supports
13. Data Contracts Data Product Data Contract Schema Constraints API Federated Governance Self-serve platform Define Enforce Populate Shared Lifecycle Metadata Data
14. KNOWLEDGE
15. Knowledge Gap Operations Domain Marketing Domain Sales Domain Logistics Domain #@% xyz $€£ a->b ???
16. Federated conceptual modelling Federated Governance Federated Modelling Team Self-serve platform Schema Constraints API Enterprise Ontology Data Contracts Data Data Product Defines Populate Links to Semantic interoperability Syntactic & tech. interoperability Uses Enforces Promotes
17. Knowledge Graph Upper ontology Number of concepts Applicability High Low Context Dependent Context Independent Enterprise Ontology Data products 1. enable access to physical data asset 2. aggregate technical metadata related to exposed data 3. create the semantic link between physical data asset and business concepts modeled in the enterprise ontology Data products are a pivotal element in the incremental and distributed construction of a knowledge graph Domain ontology Physical Data Subdomain ontologies
18. INTELLIGENCE
19. Data Product Catalog SPARQL Vector Search SQL Data Product Catalog INFORMATION KNOWLEDGE INTELLIGENCE DATA Ontology Knowledge Graph
20. KG + LLM SPARQL Vector Search SQL Data Product Catalog Chat with Relevant information Smart search Insights Intelligent automation Extend Knowledge Base Outcomes
21. Information Architecture Flywheel INTELLIGENCE Generate insight and drive actions KNOWLEDGE Extend the enterprise ontology INFORMATION Define data contracts DATA Implement data products Use Case gets context from assists with modeling answers questions start here… …and iterate
22. Questions? Follow me on linkedin #TheDataJoy