The Catalog is the Platform™ IT Press Tour: Alation Satyen Sangani, Co-founder and CEO Aaron Kalb, Co-founder and CDAO Andreas Haehre, Head of Information Governance, Vattenfall (customer) Dave Kellogg, CMO (acting) and Director 10/8/2020
The Catalog is the Platform™ Welcome • Welcome and Alation speaker self-introductions – Dave Kellogg • The Catalog is the Platform – Satyen Sangani • Alation Product: Vision and Reality - Past, Present, Future – Aaron Kalb • Alation @ Vattenfall, Status and Vision – Andreas Haehre
The Catalog is the Platform™ The Catalog is the Platform (On the evolution of data catalogs into data intelligence platforms) Satyen Sangani October 8, 2020
The Catalog is the Platform™ • Data culture and the Alation vision • Alation company and product overview • The evolution of the data catalog into a data intelligence platform • Q&A Agenda
The Catalog is the Platform™ ...And Organizations Are Changing Too. Used to have too little data, now too much Capture tribal knowledge, enable collaboration Comply with changing laws and regulations Data Explosion • 63 ZB in 2021 (volume) • 300+ DBMSs (variety) • IoT and Edge (velocity) Evolving Laws • Privacy: GDPR, CCPA, HIPAA • Risk: BCBS 239 • Industry-specific: FedRAMP Changing Workforce • Turnover, restructuring • New SMEs, lost stewards • Remote work (WFH)
The Catalog is the Platform™ The Alation Vision To empower a curious and rational world Data Culture Data Literacy Enable proper interpretation & analysis Data Governance Take responsibility & authority Data Search & Discovery Find & understand Core Data Intelligence Capabilities
The Catalog is the Platform™ The Data Culture Imperative The Benefits are Compelling • Insights-driven businesses on track to earn $1.8T by 2021 • 7x more likely to increase revenue as result of big data • 2.8x more likely to have double-digit growth The Stakes are High • Fines of 20M Euros or 4% of annual revenue (GDPR) • $5M fines for misleading financial reports (SOX) • Incorrect decisions made on bad data or bad models The Priority is Clear Forrester: Insights-Driven Businesses Set the Pace for Global Growth. October 2018 2018 Gartner Fourth Annual Chief Data Officer Study
The Catalog is the Platform™ Progress Towards Data Culture Facts from the recently-announced Alation State of Data Culture Report • 78% of orgs have strategic data initiative • 86% have C-level officer responsible for data • Only 12% of companies score an “A” on data culture Everyone wants a data culture, but there’s a lot of work yet to do
The Catalog is the Platform™ • Data culture and the Alation vision • Alation company and product overview • The evolution of the data catalog into a data intelligence platform • Q&A Agenda
The Catalog is the Platform™ Living Catalogs Enable You to Quickly Self-Serve is trusted catalog that helps you quickly learn about products sold on the web. New OLED TV You used to go to a store.
The Catalog is the Platform™ What is a Data Catalog? • A repository of metadata on information sources across an organization - Search & discovery - Data governance & curation - Collaboration & analysis • Catalogs a broad range of information assets - Data sets, tables, articles, reports, queries, visualizations, conversations • Includes common functionality such as: Answers these core questions: How to find information? Can it be used? Should it be used? How should it be used? Business Glossary Lineage Catalog Pages Search
The Catalog is the Platform™ Alation Commercialized the Data Catalog “Alation started the ML Data Catalog trend.” -Forrester Wave, Machine Learning Data Catalogs, 2018 • Founded 8 years ago in 2012 • Born out of my experience at Oracle • Envisioned a collaborative catalog • Born in the era of “big” data
The Catalog is the Platform™ That Leveraged Machine Learning for Relevance Plot the dots Connect Make Connections Compute Draw Conclusions Conclude Sue Bob Query #2 Query #3 Query #1 Top Users: Bob and Sue Popularity: II
The Catalog is the Platform™ Innovating Through the Years 2015 2016 2017 2018 2019 2020 First to intelligently and automatically power data search & discovery eBay becomes Alation’s first customer Alation launches RevAlation, first user community conference for data catalogs Alation is named Leader in Forrester Wave for MLDC Alation named leader in Gartner MQ for Metadata Management Solutions Top ranking in Dresner Wisdom of Crowds Data Catalog Market Study Hundreds of customers (35% of whom are using Alation for data governance) First to enable active collaboration on COVID-19 data First to apply governance at the point of data use (TrustCheck)
The Catalog is the Platform™ Alation Facts & Figures Third party validated net promoter scores of 60+ and CSAT scores of 8+ out of 10 110% three-year CAGR 260+ employees Recognized by analysts as category leader Gartner MQ for Metadata Management Solutions (2017, 2018, 2019), Forrester Wave: Machine Learning Data Catalogs (2018), Dresner Wisdom of Crowds Data Catalog Market Study (2017, 2018, 2019, and 2020) Hundreds of customers across more than three dozen industry verticals, including financial services, insurance, healthcare, technology, and more.
The Catalog is the Platform™ Hundreds of Customers with Dozens of Use-Cases Risk & Compliance Data Privacy/GDPR Digital Transformation Analytics Governance Cloud Analytics Governance Cloud Risk & Compliance Data Privacy / GDPR Digital Transformation Use Alation as their platform to support a wide range of data intelligence solutions
The Catalog is the Platform™ • Data culture and the Alation vision • Alation company and product overview • The evolution of the data catalog into a data intelligence platform • Q&A Agenda
The Catalog is the Platform™ Data Intelligence Use Cases Example Data Intelligence Use Cases Core Data Intelligence Capabilities Data Literacy Enable proper interpretation & analysis Data Governance Take responsibility & authority Data Search & Discovery Find & understand
The Catalog is the Platform™ “Just by having a data lake in the Cloud, doesn’t mean that it is going to start raining insights. We now must teach people to fish in the data lake.” NISHANT UPADHYAY VP of Information & Data Management, American Family Insurance Finding the Data Didn’t Mean You Could Understand It Data Literacy: Properly analyzing, interpreting, and drawing conclusions from data 1. What am I looking at? 2. How do I use it properly? 3. How do I tell a story?
The Catalog is the Platform™ Metadata Extraction Data Sampling Auto-Titling (ML & NLP) Query Log Ingestion “Behavioral” Layer (cf. Traffic View) Top Users based on observed historical usage Popularity is a “frecency” metric based on recency and frequency of past use
The Catalog is the Platform™ Metadata Extraction Data Sampling Auto-Titling (ML & NLP) Query Log Ingestion Crowd- Sourcing Expert- Sourcing Flags help analysts trust data
The Catalog is the Platform™ People • Day-to-day data users are not engaged in the governance framework • Policy information is not shared with the business users Processes • Policy implementation and monitoring requires too much manual work • Governance tends to remain static • Lack of collaboration with business users Tools • Data analysts have no or little access to governance tools • The Metadata repository is very technical Traditional Data Governance Programs Often Fail
The Catalog is the Platform™ Bringing New Product Requirements Historical requirements largely focused on ease of finding information, collaboration, and connectivity New requirements in the platform era • Broad range of functionality (to support all use cases) • Leveraging intelligence everywhere (Allie for everything) • Modern architecture • Flexible cloud deployment (from on-premise to multi-cloud and lots in between) • Open and programmable to enable an ecosystem of customer and partner applications
The Catalog is the Platform™ In May, we did a full project review and it was determined that the enterprise data catalog initiative was of vital strategic importance to our business.” – LEADING AUTOMOBILE MANUFACTURER And a Bright Future 5,000+ organizations globally with data and analytics teams Platform for Data Powered Applications Alation 200+ customers Alation Six Figure land size $1M+ enterprise data catalog need 30x Data and Analytical Platform Market: $146 billion* MLDC: $5 billion *451 Research Total Data: Data Platforms & Analytics Market, April 2018.
the temperature in Berlin today in degrees Fahrenheit? accurate answer, in moments Hey Analyst, what was our Q2 profit margin in DACH in USD? dubious report, after months
the Data Value Chain Data Definitions Interpretations Which of the 97 different tables called cust_data should we use? Does the EU include the UK? How much should we invest in the European market?
Data all tables in lineage have been endorsed and/or appear trustworthy and up-to-date based on behavioral cues (i.e. have been consistently updated and recently queried by knowledgeable users) Joins all join conditions have been endorsed and/or validated by usage patterns Fields the underlying calculation for every field has been endorsed as being the correct way to compute a measure, dimension, or filter with that label
Revenue – Total Costs Definition View Code... Used by John X. Purt, Sue Sykes and 208 others Cost of Materials + Cost of Labor + Taxes Definition View Code... Used by John X. Purt, Sue Sykes, Mike Moofles, and 207 others Total Costs
We are one of Europe’s largest producers and retailers of electricity and heat. • Vattenfall’s main markets are Sweden, Germany, the Netherlands, Denmark, and the UK. • The Group has approximately 20,000 employees. • The Parent Company, Vattenfall AB, is 100%- owned by the Swedish state.
Public 4 Data-Driven Company Data Science Skills (inhouse) Data Innovation Management Information Governance Technology Data Platform Business Models Culture Legal Organization Core Dimensions Supporting Dimensions
sharing for everybody along our complete value chain Alation user friendliness and low training efforts Democratizing our Data Alation community vision
end up among the stars. 8/10/2020 C1 - Public 6 Where we come from... Information asymmetries interfere with today's rising complexities ...in a perfect world We can analyze, manage and deliver any combination of knowledge across domains, any contextual transfer, any evaluation to put rational thought before emotions
driven company 8/10/2020 C1 - Public 7 High Low Low High Complexity Competitive advantage Stage 1 Analytically impaired Stage 2 Localized analytics Stage 3 Analytical aspirations Stage 4 Analytical companies Stage 5 Insight driven organisation Aware of data analytics, but little to no infrastructure and poorly defined data strategy Adopting data analytics, building capabilities and articulating a data strategy in silos Expanding ad-hoc data capabilities beyond silos into mainstream business functions Industrialising data analytics to aggregate and combine data from broad sources into meaningful content and new ideas Transforming data analytics to streamline decision making across all business functions Most companies are here... ...want to be here
itpresstour
genda
srenext
yuksew
kitano_yuichi
torumakabe
repunit
koheiyoshikawa
nari_ex
kaminashi
moongift
satohy0323
tkyowa
tammyeverts
akashhashmi
uxyall
jeffersonlam
jlugia
ryanjones
sarafernandez
axbom
rkaga
tmiket
szymonslowik
techseoconnect
![Vattenfall contact Dr. Andreas Hähre [email protected] 8/10/2020 C1 - Public](https://files.speakerdeck.com/presentations/5df146b8e25842a0a45e5a2b98f58b1e/slide_70.jpg){kind=link}