Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
0
86

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
410
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
250
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.7k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
290
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
350
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.5k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
630
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
生成AIによるソフトウェア開発の収束地点 - Hack Fes 2025
Avatar for vaaaaanquish vaaaaanquish
29
13k
AI時代の大規模データ活用とセキュリティ戦略
Avatar for Kengo Suzuki ken5scal
0
130
Intro to Software Startups: Spring 2025
Avatar for Arnab Nandi arnabdotorg
0
260
薬屋のひとりごとにみるトラブルシューティング
Avatar for tomokusaba tomokusaba
0
340
Amazon Bedrock AgentCoreのフロントエンドを探す旅 (Next.js編)
Avatar for たけのこ kmiya84377
1
140
九州の人に知ってもらいたいGISスポット / gis spot in kyushu 2025
Avatar for sakaik sakaik
0
160
Bet "Bet AI" - Accelerating Our AI Journey #BetAIDay
Avatar for LayerX layerx
PRO
4
1.7k
夏休みWebアプリパフォーマンス相談室/web-app-performance-on-radio
Avatar for Eiji Hachiya hachi_eiji
0
180
Findy Freelance 利用シーン別AI活用例
Avatar for nesskazu ness
0
500
【新卒研修資料】数理最適化 / Mathematical Optimization
Avatar for BrainPad brainpadpr
27
13k
「Roblox」の開発環境とその効率化 ～DAU9700万人超の巨大プラットフォームの開発 事始め～
Avatar for Keita Tanji keitatanji
0
120
Amazon GuardDuty での脅威検出：脅威検出の実例から学ぶ
Avatar for KintoTech_Dev kintotechdev
0
110

Featured

See All Featured
Visualization
Avatar for Eitan Lees eitanlees
146
16k
Code Review Best Practice
Avatar for Trisha Gee trishagee
69
19k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
63
7.8k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
8
450
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
235
140k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
140
7.1k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
139
34k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
15
1.6k
Typedesign – Prime Four
Avatar for Hannes Fritz hannesfritz
42
2.7k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees