Big Data
Getting Down to Business
Joe Hellerstein, Co-Founder and Chief Strategy Officer
Wrangling
Slide 2
Slide 2 text
Berkeley
Slide 3
Slide 3 text
Data to the People!
Celebrate Diversity
Tech for the People
1
2
3
Outline
Slide 4
Slide 4 text
Marketing
Finance
Product
IT & Cyber
Web &
Social
Customer
Data
Sales
Support
4
See you at the Lake!
Slide 5
Slide 5 text
A Common Platform to Store & Analyze Diverse Data
Data
Lake
Finance
Supply
Chain
IT & Cyber
Web &
Social
Customer
Satisfaction
Marketing
Support
Sales
Slide 6
Slide 6 text
Your business users feel…
Data
Lake
Finance
Supply
Chain
IT & Cyber
Web &
Social
Customer
Satisfaction
Marketing
Support
Sales
Slide 7
Slide 7 text
Data
Scientists
Data
Engineers
SQL Analysts
Excel Data
Analysts
Business
Users
Data-Driven Population
Slide 8
Slide 8 text
Data Accessibility
Data
Scientists
Data
Engineers
SQL Analysts
Excel Data
Analysts
Business
Users
Hundreds of
Gigabytes
Petabytes &
Terabytes
Megabytes &
Gigabytes
Slide 9
Slide 9 text
9
Your business users feel…
Slide 10
Slide 10 text
Data
Scientists
Data
Engineers
SQL Analysts
Business
Users
Put the data in the hands of the
people who know it best.
Unlock potential by empowering people.
Slide 11
Slide 11 text
Celebrate Diversity
1
2
3
Slide 12
Slide 12 text
“There is no point in bringing data … into the data warehouse environment
without integrating it.”
— Bill Inmon, Building the Data Warehouse
The Single Source of Truth
Slide 13
Slide 13 text
“There is no point in bringing data … into the data warehouse environment
without integrating it.”
— Bill Inmon, Building the Data Warehouse
Building
Slide 14
Slide 14 text
“There is no point in bringing data … into the data warehouse environment
without integrating it.”
— Bill Inmon, Building the Data Warehouse
Building
Slide 15
Slide 15 text
“There is no point in bringing data … into the data warehouse environment
without integrating it.”
— Bill Inmon, Building the Data Warehouse
Slide 16
Slide 16 text
Data
Lake
Data
Lake
Finance
Supply
Chain
IT & Cyber
Web &
Social
Marketing
Support
The Value of Diversity
Customer
Satisfaction
Sales
Slide 17
Slide 17 text
The Value of Diversity
Data
Lake
Supply
Chain
Marketing
Customer
Satisfaction
Inventory Management
per supermarket chain!
Customer Behavior
Inventory correlations with social
media campaigns.
Brand Management
Buying patterns by
demographics, politics.
Slide 18
Slide 18 text
Data
Lake
Finance
Supply
Chain
IT & Cyber
Web &
Social
Marketing
Support
Data
Lake
Customer
Satisfaction
Sales
Move beyond
the single source of truth.
Foster agility to generate diverse value.
Slide 19
Slide 19 text
1
2
3
Tech for the People
Slide 20
Slide 20 text
Driving Value
To drive more
value here
You have to make this more efficient
20
Optimizing &
Publishing
Enriching &
Blending
Cleaning
80% of the time spent 20%
Structuring
Discovery
Ingestion
Slide 21
Slide 21 text
Why are Business Users Disconnected from Big Data?
Slide 22
Slide 22 text
It’s an Interaction Problem
Slide 23
Slide 23 text
Turn of the Century UX for Data Transformation
- Schemas and annotations
- Box-and-arrow programming
- Batch execution
Slide 24
Slide 24 text
Research Roots: Potter’s Wheel 2001
+ Real data, sampled on the fly
+ Menu-driven transforms
+ Immediate execution and
feedback
[Raman & Hellerstein, VLDB01]
Slide 25
Slide 25 text
Research Roots: Open Source Data Wrangler, 2011
+ Predictive Transformation
+ Immediate feedback on
multiple choices
– Browser-sized data sets
[Kandel, Heer & Hellerstein, CHI 11]
Slide 26
Slide 26 text
26
Tech Challenge:
Make Working with Raw Data at Scale…
Provide immediate
feedback for how
transformations impact
the data on-the-fly
Interactive
Suggestions and cues
guide based on data,
activity and history. You
decide based on visual
feedback
Intelligent
See what’s in your data—
use visualization to drive
transformation
Visual
Directly manipulate data
in collaboration with
algorithms.
Delightful
Slide 27
Slide 27 text
All of This Led to
Slide 28
Slide 28 text
Interactive Exploration
28
Slide 29
Slide 29 text
29
Predictive Transformation
Slide 30
Slide 30 text
Data to the People!
Celebrate Diversity
Tech for the People
1
2
3
Slide 31
Slide 31 text
Context Matters
4
Slide 32
Slide 32 text
?
?
THE KNIGHT
IT
THE WARRIOR
DATA SCIENCE
PROBABILITY
PREDICTION
THE QUEEN
MANAGEMENT
!
LOCH
DATA
Data Relativism and Context Services
http://bit.ly/datarelativism16
Slide 33
Slide 33 text
Open Source Context Services
http://www.ground-context.org
ground
A broader context for big data
THE WARRIOR
DATA SCIENCE
THE WARRIOR
DATA SCIENCE
Wrangle Aggressively
Govern Collectively
THE WARRIOR
DATA SCIENCE
THE WARRIOR
DATA SCIENCE
THE KNIGHT
IT
THE QUEEN
MANAGEMENT
Slide 34
Slide 34 text
Stop by Trifacta’s booth #306
Download Trifacta Wrangler for Free
trifacta.com/start-wrangling