Datameer - IT Press Tour Jan 2021

Transcript

1. © 2020 Datameer, Inc. All rights reserved. Self-service analytics and data democratization is still a long road ahead for many organizations Data Project Fails 80% of data lake projects will fail by 2022 - Gartner 80% Low Analytics Maturity 87% of organizations have low BI and analytics maturity - Gartner Sensitive Data 46% of organizations don’t know where all the sensitive data reside. - Splunk Searching & Prepping 30% of time wasted on searching and prepping data - IDC Unused & Dark Data More than 60% of data in an enterprise goes unused for analysis. - Forrester Effort Duplication 20% of time wasted in reinventing the wheel - IDC 87% 46% 30% 60%+ 20%
2. © 2020 Datameer, Inc. All rights reserved. The utopian vision of centralizing all data in one place Results in the total opposite of what this architecture was meant to achieve: • Data copied all over the place • Shadow data-marts and files on desktop • Data Silos • Expensive data movement • Complex and expensive to maintain (astronomical data engineering costs) • Impossible to keep up with new data sources or updates on existing ones. • Pay for storage and compute as many times as there are copies • Hard to keep track of the data lineage • Can’t find the data you need • Disconnect between data engineers and BI/Business Users Data Sources Ingest/ Load Data Lake Data warehouses Data marts/ Extracts ETL/ELT BI & DS Tools DATA ENGINEERS/ARCHITECTS BI USERS/ DATA SCIENTISTS ETL/ELT Data Sources • Ungoverned • Untrusted • Expensive • Very slow time to insights • Business Users still can’t find & access easily
3. © 2020 Datameer, Inc. All rights reserved. Data Sources Ingest/ Load Data Lake Data warehouses Data marts/ Extracts ETL/ELT BI & DS Tools DATA ENGINEERS/ARCHITECTS BI USERS/ DATA SCIENTISTS Virtually Search, Model, Govern, Collaborate ETL/ELT Only materialize views when needed Simplifying the data architecture Data Sources