Data Catalogs - Rebuild the Broken Promise

Is Data Catalog still relevant? Why does most data catalog fail? What can we do to prevent the failures?

Transcript

1. Data Catalogs - Rebuild the Broken Promise Ananth Packkildurai
2. Slack Data Engineer Zendesk Principal Data Engineer Creator Schemata - Data Contract Platform Author Data Engineering Weekly
3. Data Catalog is an expensive data ingestion platform you never intend to build.
4. How Happy are you with Data Catalog?
5. What is the purpose of a Data Catalog? Data Lineage Data Governance Data Discovery Metadata Management Collaboration
6. Data Engineering in a Nutshell
7. Data Catalog - A Disjointed Space
8. MAD Landscape - 2012
9. Data Engineering Function 2012
10. MAD Landscape 2023
11. Don’t Strive for comprehensive & Complete Coverage
12. Don’t Desire for Single Source of Metadata
13. What should we start thinking about it?
14. Streamline Data Creation Process
15. Shift Left
16. Data Contract as a Code
17. Headless Data Catalog
18. https://schemata.app https://www.linkedin.com/in/ananthdurai ananth@dataengineeringweekly.com