Big Data in the Cloud - Welcome to cost oriented design

Cost consideration and design decisions when dealing with Big Data

Transcript

1. Big data in the cloud 
 welcome to cost oriented design Arnon Rotem-Gal-Oz Chief Data Officer
2. Cost oriented design Cheap (but hopefully cheaper) Caveat Emptor
4. security performance availability correctness scalability solution cost
5. “Traditional” design for cost • POC • (choose technologies, understand constraints) • Size needed hardware • purchase HW + SW • Optimize
6. Amdocs TeraScale Source: https://www.youtube.com/watch?v=0N2KhuMKAxM
7. Optimize & 
 maximize utilization
8. Big data in the cloud
10. Big Data Big Data
12. 
 Analytic Database 
 
 
 Vertica 

13. security performance availability correctness scalability solution initial cost
14. security performance availability correctness scalability Initial cost Variable running costs
15. 
 Dedicated Servers vs. S3 with EC2 

16. Spot instances
17. security performance availability correctness scalability Initial cost Continuous cost optimization variable cost
18. Analytics database 
 (take 2) 
 
 Redshift, TokuMX 
 vs. 

19. Google BigQuery
20. What do users actually need? “You can’t always get what you want, But if you try, sometimes, you might find you get what you need”The rolling stones
21. Initial cost variable cost continuous cost optimization
22. “COST ORIENTATION” YOU KEEP USING THESE WORDS I DON’T THINK THEY MEAN WHAT YOU THINK THEY MEAN