Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Big Data in the Cloud - Welcome to cost oriente...

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Arnon Rotem-Gal-Oz Arnon Rotem-Gal-Oz PRO
March 13, 2016
Technology
32
0

Big Data in the Cloud - Welcome to cost oriented design

Cost consideration and design decisions when dealing with Big Data

Avatar for Arnon Rotem-Gal-Oz

Arnon Rotem-Gal-Oz PRO

March 13, 2016

More Decks by Arnon Rotem-Gal-Oz

See All by Arnon Rotem-Gal-Oz
Coding with AI
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
19
Brownfield Architecture transformations
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
160
Software architecture 101
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
1.8k
Apache Spark - Overview
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
53
Taking ML to production - a journey
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
130
Topics in Distributed Systems
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
42
Docker & Kubernetes
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
34
Data Security @ the personal level
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
34
Microservices it's deja vu all over again
Avatar for Arnon Rotem-Gal-Oz arnonrgo
PRO
0
30

Other Decks in Technology

See All in Technology
Google Cloud Next '26 の裏でこっそりリリースされたCloud Number Registry & Cloud Hub コスト分析 を試してみた
Avatar for hikaru hikaru1001
0
170
AI対話分析の夢と、汚いデータの現実 Looker / Dataplex / Dataform で実現する品質ファーストな基盤設計
Avatar for Yuta Ozaki waiwai2111
0
170
ファインディの事業拡大を支える 拡張可能なデータ基盤へのリアーキテクチャ
Avatar for Noriaki Hiraki hiracky16
0
930
Percolatorを廃止し、マルチ検索サービスへ刷新した話 / Search Engineering Tech Talk 2026 Spring
Avatar for Visional Engineering ＆ Design visional_engineering_and_design
0
330
OWASP APTSを眺めてみた
Avatar for su3158 su3158
0
130
2026年春のAgentCoreアプデ 細かいやつ全部まとめ
Avatar for みのるん minorun365
3
200
Oracle Cloud Infrastructure presents managed, serverless MCP Servers for Oracle AI Database
Avatar for thatjeffsmith thatjeffsmith
0
120
AIと乗り切った1,500ページ超のヘルプサイト基盤刷新とさらにその先の話
Avatar for mugi / Hajime Mugishima mugi_uno
2
310
変化の激しい時代をゴキゲンに生き抜くために 〜ストレスマネジメントのススメ〜
Avatar for KAKEHASHI kakehashi
PRO
4
1.2k
MySQL 9.7がやってきた ～これまでのあらすじと基本情報～ @ 日本MySQLユーザ会会2026年04月 / mysql97-yattekita
Avatar for sakaik sakaik
0
170
Oracle Base Database Service 技術詳細
Avatar for oracle4engineer oracle4engineer
PRO
15
100k
需要創出(Chatwork)×供給(BPaaS) フライホイールとMoat 実行能力の最適配置とAI戦略
Avatar for kubell kubell_hr
0
2.1k

Featured

See All Featured
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
1
360
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.7k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
1
2k
Fireside Chat
Avatar for paigeccino paigeccino
42
3.9k
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
140
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
220
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k

Transcript

  1. Big data in the cloud 
 welcome to cost oriented

    design Arnon Rotem-Gal-Oz Chief Data Officer

  2. Cost oriented design Cheap (but hopefully cheaper) Caveat Emptor

  3. None

  4. security performance availability correctness scalability solution cost

  5. “Traditional” design for cost • POC • (choose technologies, understand

    constraints) • Size needed hardware • purchase HW + SW • Optimize

  6. Amdocs TeraScale Source: https://www.youtube.com/watch?v=0N2KhuMKAxM

  7. Optimize & 
 maximize utilization

  8. Big data in the cloud

  9. None

  10. Big Data Big Data

  11. None

  12. 
 Analytic Database 
 
 
 Vertica 


  13. security performance availability correctness scalability solution initial cost

  14. security performance availability correctness scalability Initial cost Variable running costs

  15. 
 Dedicated Servers vs. S3 with EC2 


  16. Spot instances

  17. security performance availability correctness scalability Initial cost Continuous cost optimization

    variable cost

  18. Analytics database 
 (take 2) 
 
 Redshift, TokuMX 


    vs. 


  19. Google BigQuery

  20. What do users actually need? “You can’t always get what

    you want, But if you try, sometimes, you might find you get what you need”The rolling stones

  21. Initial cost variable cost continuous cost optimization

  22. “COST ORIENTATION” YOU KEEP USING THESE WORDS I DON’T THINK

    THEY MEAN WHAT YOU THINK THEY MEAN
  23. None