Alation - IT Press Tour Oct 2020

Transcript

1. 1 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ IT Press Tour: Alation Satyen Sangani, Co-founder and CEO Aaron Kalb, Co-founder and CDAO Andreas Haehre, Head of Information Governance, Vattenfall (customer) Dave Kellogg, CMO (acting) and Director 10/8/2020
2. 2 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Welcome • Welcome and Alation speaker self-introductions – Dave Kellogg • The Catalog is the Platform – Satyen Sangani • Alation Product: Vision and Reality - Past, Present, Future – Aaron Kalb • Alation @ Vattenfall, Status and Vision – Andreas Haehre
3. 3 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ The Catalog is the Platform (On the evolution of data catalogs into data intelligence platforms) Satyen Sangani October 8, 2020
4. 4 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ • Data culture and the Alation vision • Alation company and product overview • The evolution of the data catalog into a data intelligence platform • Q&A Agenda
5. 5 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ The World is Changing Fast...
6. 6 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ ...And Organizations Are Changing Too. Used to have too little data, now too much Capture tribal knowledge, enable collaboration Comply with changing laws and regulations Data Explosion • 63 ZB in 2021 (volume) • 300+ DBMSs (variety) • IoT and Edge (velocity) Evolving Laws • Privacy: GDPR, CCPA, HIPAA • Risk: BCBS 239 • Industry-specific: FedRAMP Changing Workforce • Turnover, restructuring • New SMEs, lost stewards • Remote work (WFH)
7. 7 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ How Do You Want People to Make Decisions? Simon Says? Their Gut? Based on data and evidence?
8. 8 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ The Alation Vision To empower a curious and rational world Data Culture Data Literacy Enable proper interpretation & analysis Data Governance Take responsibility & authority Data Search & Discovery Find & understand Core Data Intelligence Capabilities
9. 9 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ The Data Culture Imperative The Benefits are Compelling • Insights-driven businesses on track to earn $1.8T by 2021 • 7x more likely to increase revenue as result of big data • 2.8x more likely to have double-digit growth The Stakes are High • Fines of 20M Euros or 4% of annual revenue (GDPR) • $5M fines for misleading financial reports (SOX) • Incorrect decisions made on bad data or bad models The Priority is Clear Forrester: Insights-Driven Businesses Set the Pace for Global Growth. October 2018 2018 Gartner Fourth Annual Chief Data Officer Study
10. 10 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Progress Towards Data Culture Facts from the recently-announced Alation State of Data Culture Report • 78% of orgs have strategic data initiative • 86% have C-level officer responsible for data • Only 12% of companies score an “A” on data culture Everyone wants a data culture, but there’s a lot of work yet to do
11. 11 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ • Data culture and the Alation vision • Alation company and product overview • The evolution of the data catalog into a data intelligence platform • Q&A Agenda
12. 12 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Living Catalogs Enable You to Quickly Self-Serve is trusted catalog that helps you quickly learn about products sold on the web. New OLED TV You used to go to a store.
13. 13 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ What is a Data Catalog? • A repository of metadata on information sources across an organization - Search & discovery - Data governance & curation - Collaboration & analysis • Catalogs a broad range of information assets - Data sets, tables, articles, reports, queries, visualizations, conversations • Includes common functionality such as: Answers these core questions: How to find information? Can it be used? Should it be used? How should it be used? Business Glossary Lineage Catalog Pages Search
14. 14 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Alation Commercialized the Data Catalog “Alation started the ML Data Catalog trend.” -Forrester Wave, Machine Learning Data Catalogs, 2018 • Founded 8 years ago in 2012 • Born out of my experience at Oracle • Envisioned a collaborative catalog • Born in the era of “big” data
15. 15 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ That Leveraged Machine Learning for Relevance Plot the dots Connect Make Connections Compute Draw Conclusions Conclude Sue Bob Query #2 Query #3 Query #1 Top Users: Bob and Sue Popularity: II
16. 16 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Innovating Through the Years 2015 2016 2017 2018 2019 2020 First to intelligently and automatically power data search & discovery eBay becomes Alation’s first customer Alation launches RevAlation, first user community conference for data catalogs Alation is named Leader in Forrester Wave for MLDC Alation named leader in Gartner MQ for Metadata Management Solutions Top ranking in Dresner Wisdom of Crowds Data Catalog Market Study Hundreds of customers (35% of whom are using Alation for data governance) First to enable active collaboration on COVID-19 data First to apply governance at the point of data use (TrustCheck)
17. 17 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Alation Facts & Figures Third party validated net promoter scores of 60+ and CSAT scores of 8+ out of 10 110% three-year CAGR 260+ employees Recognized by analysts as category leader Gartner MQ for Metadata Management Solutions (2017, 2018, 2019), Forrester Wave: Machine Learning Data Catalogs (2018), Dresner Wisdom of Crowds Data Catalog Market Study (2017, 2018, 2019, and 2020) Hundreds of customers across more than three dozen industry verticals, including financial services, insurance, healthcare, technology, and more.
18. 18 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Hundreds of Customers with Dozens of Use-Cases Risk & Compliance Data Privacy/GDPR Digital Transformation Analytics Governance Cloud Analytics Governance Cloud Risk & Compliance Data Privacy / GDPR Digital Transformation Use Alation as their platform to support a wide range of data intelligence solutions
19. 19 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Partner Ecosystem Global SI’s Selected Regional SI’s Tier 1 Technology Partners ISV Partners Global SI’s Tier 1 Technology Partners Selected Regional SI’s ISV Partners
20. 20 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Providing a Single Source of Reference vs. Truth FIND | UNDERSTAND | TRUST
21. 21 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ • Data culture and the Alation vision • Alation company and product overview • The evolution of the data catalog into a data intelligence platform • Q&A Agenda
22. 22 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Data Intelligence Use Cases Example Data Intelligence Use Cases Core Data Intelligence Capabilities Data Literacy Enable proper interpretation & analysis Data Governance Take responsibility & authority Data Search & Discovery Find & understand
23. 23 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Find Customer Data
24. 24 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Search & Discovery Was the First Use Case Data Scientist Business Analyst
25. 25 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ “Just by having a data lake in the Cloud, doesn’t mean that it is going to start raining insights. We now must teach people to fish in the data lake.” NISHANT UPADHYAY VP of Information & Data Management, American Family Insurance Finding the Data Didn’t Mean You Could Understand It Data Literacy: Properly analyzing, interpreting, and drawing conclusions from data 1. What am I looking at? 2. How do I use it properly? 3. How do I tell a story?
26. 26 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Metadata Extraction Physical Layer (cf. Satellite View)
27. 27 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Metadata Extraction Data Sampling Physical Layer (cf. Topology)
28. 28 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Metadata Extraction Data Sampling Auto-Titling (ML & NLP) “Political” Layer (cf. Street Names)
29. 29 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Metadata Extraction Data Sampling Auto-Titling (ML & NLP) Query Log Ingestion “Behavioral” Layer (cf. Traffic View) Top Users based on observed historical usage Popularity is a “frecency” metric based on recency and frequency of past use
30. 30 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Metadata Extraction Data Sampling Auto-Titling (ML & NLP) Query Log Ingestion Crowd- Sourcing Expert- Sourcing Flags help analysts trust data
31. 31 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™
32. 32 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ People • Day-to-day data users are not engaged in the governance framework • Policy information is not shared with the business users Processes • Policy implementation and monitoring requires too much manual work • Governance tends to remain static • Lack of collaboration with business users Tools • Data analysts have no or little access to governance tools • The Metadata repository is very technical Traditional Data Governance Programs Often Fail
33. 33 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ 33 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ “One of Cisco’s primary goals was to enable the democratization of data while simultaneously ensuring our data was properly governed. To succeed, we needed a user-friendly platform that provided business units with the ability to utilize data and drive their business forward.” ABRA LE Senior Manager of Data Governance Cisco Virtuous Cycle of Adoption (More) people use data catalog Data catalog becomes more valuable
34. 34 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ The Catalog is the Platform
35. 35 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Progress on the Evolution Analytics Governance Privacy, Risk & Compliance Cloud Transformation Digital Transformation
36. 36 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ Bringing New Product Requirements Historical requirements largely focused on ease of finding information, collaboration, and connectivity New requirements in the platform era • Broad range of functionality (to support all use cases) • Leveraging intelligence everywhere (Allie for everything) • Modern architecture • Flexible cloud deployment (from on-premise to multi-cloud and lots in between) • Open and programmable to enable an ecosystem of customer and partner applications
37. 37 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™ In May, we did a full project review and it was determined that the enterprise data catalog initiative was of vital strategic importance to our business.” – LEADING AUTOMOBILE MANUFACTURER And a Bright Future 5,000+ organizations globally with data and analytics teams Platform for Data Powered Applications Alation 200+ customers Alation Six Figure land size $1M+ enterprise data catalog need 30x Data and Analytical Platform Market: $146 billion* MLDC: $5 billion *451 Research Total Data: Data Platforms & Analytics Market, April 2018.
38. 38 | © 2020 Alation, Inc. – All Rights Reserved. The Catalog is the Platform™
39. Alation Product: Vision & Reality — past, present, and future Aaron Kalb, co-founder & Chief Data & Analytics Officer Thursday, October 8, 2020
40. Day 1 Vision “Siri for the Enterprise” Hey Siri, what’s the temperature in Berlin today in degrees Fahrenheit? accurate answer, in moments Hey Analyst, what was our Q2 profit margin in DACH in USD? dubious report, after months
41. Day 1 Vision “Siri for the Enterprise” Hey Allie, what was our Q2 profit margin in DACH in USD? accurate answer, in moments
42. data engineers data analysts data scientists marketers salespeople support reps product managers accountants engineers executives actuaries HR pro’s
43. Analysis is only as trustworthy as its weakest link in the Data Value Chain Data Definitions Interpretations Which of the 97 different tables called cust_data should we use? Does the EU include the UK? How much should we invest in the European market?
44. data engineers data analysts data scientists marketers salespeople support reps product managers accountants engineers executives actuaries HR pro’s Analysis is only as trustworthy as its weakest link
45. …so we started at the source
46. Smart Suggest GPS Navigation for Data: turn-by-turn directions based on… …where you are… Solutions, Specifically 'MT' 'MW' 'ML' 'FK' 'MY' 'MV' …and where you want to go
47. Trust Check Like Spell Check but for SQL
50. introducing Alation 2020
51. Proprietary & Confidential Alation 2020 Home Page
52. Proprietary & Confidential Alation 2020 Home Page
53. Proprietary & Confidential Alation 2020 Search
54. Proprietary & Confidential Alation 2020 Search
55. Agenda ✓ The Past ✓ The Present — Alation 2020.3 • The Future
56. • Logical Domains for data discovery • Query Forms 2.0 → NL Question Answering • Deeper integrations with end-user tools
57. Proprietary & Confidential Logical Data Domains
58. Proprietary & Confidential Ask Allie
59. Proprietary & Confidential Trust Check everywhere Viewers trust TDSs in Tableau Server Stewards endorse TDSs in Alation Catalog Today
60. Proprietary & Confidential Trust Check everywhere Soon   Source Data all tables in lineage have been endorsed and/or appear trustworthy and up-to-date based on behavioral cues (i.e. have been consistently updated and recently queried by knowledgeable users)  Joins all join conditions have been endorsed and/or validated by usage patterns  Fields the underlying calculation for every field has been endorsed as being the correct way to compute a measure, dimension, or filter with that label
61. Proprietary & Confidential Trust Check everywhere Ultimately  Total Profit Revenue – Total Costs Definition  View Code... Used by John X. Purt, Sue Sykes and 208 others Cost of Materials + Cost of Labor + Taxes Definition  View Code... Used by John X. Purt, Sue Sykes, Mike Moofles, and 207 others Total Costs
62. Proprietary & Confidential Trust Check everywhere
63. Proprietary & Confidential Alation Everywhere
64. Alation @ Vattenfall Status and vision 8.10.2020 – Dr. Andreas Hähre 8/10/2020 C1 - Public 1
65. 8/10/2020 C1 - Public 2 Vattenfall group in brief • We are one of Europe’s largest producers and retailers of electricity and heat. • Vattenfall’s main markets are Sweden, Germany, the Netherlands, Denmark, and the UK. • The Group has approximately 20,000 employees. • The Parent Company, Vattenfall AB, is 100%- owned by the Swedish state.
66. Fossil free living within one generation 8/10/2020 C1 - Public 3
67. What is needed for a data-driven company? 8/10/2020 C1 - Public 4 Data-Driven Company Data Science Skills (inhouse) Data Innovation Management Information Governance Technology Data Platform Business Models Culture Legal Organization Core Dimensions Supporting Dimensions
68. Why Alation 8/10/2020 C1 - Public 5 Data cataloging and sharing for everybody along our complete value chain Alation user friendliness and low training efforts Democratizing our Data Alation community vision
69. Aim for the moon. Even if you miss it, you'll end up among the stars. 8/10/2020 C1 - Public 6 Where we come from... Information asymmetries interfere with today's rising complexities ...in a perfect world We can analyze, manage and deliver any combination of knowledge across domains, any contextual transfer, any evaluation to put rational thought before emotions
70. Vattenfall is on its way to a data and insight driven company 8/10/2020 C1 - Public 7 High Low Low High Complexity Competitive advantage Stage 1 Analytically impaired Stage 2 Localized analytics Stage 3 Analytical aspirations Stage 4 Analytical companies Stage 5 Insight driven organisation Aware of data analytics, but little to no infrastructure and poorly defined data strategy Adopting data analytics, building capabilities and articulating a data strategy in silos Expanding ad-hoc data capabilities beyond silos into mainstream business functions Industrialising data analytics to aggregate and combine data from broad sources into meaningful content and new ideas Transforming data analytics to streamline decision making across all business functions Most companies are here... ...want to be here
71. Vattenfall contact Dr. Andreas Hähre andreas.haehre@vattenfall.com 8/10/2020 C1 - Public