Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
120
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
460
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
300
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
350
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
390
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
670
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
アクセスキー流出時の対応で再認識した攻撃側と防御側の非対称性について
Avatar for kazzpapa3 kazzpapa3
0
430
暗号化？某ファイルストレージはどうなるの！？ 3rd Partyとうまく付き合う秘密度ラベル設計
Avatar for Kaz Asada | しがない情シス kasada
0
210
ブラウザで変わるID連携（OAuth/OIDC Numa (Immersion) Workshop 2026）
Avatar for OpenID Foundation Japan oidfj
PRO
0
350
Point Cloud as a Foreign Language for Multi-modal Large Language Model
Avatar for Takuya MINAGAWA takmin
0
290
atproto spaces概要
Avatar for yamarten yamarten
0
110
ハッカソンで入賞した話 @ Findy LT
Avatar for asari asari194617
0
1.5k
型落ちシンクライアント端末のPoEモジュールを自作したかった話
Avatar for Takuto Nagami logica0419
0
510
Contract One Engineering Unit 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
0
20k
IHV like なユースケースへのOpenID Connect 関連仕様の適用事例
Avatar for OPTiM optim
0
350
Introduction to Bill One Development Engineer
Avatar for Sansan, Inc. sansan33
PRO
0
480
Digitization部 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
2
7.8k
8bit CPU 2026
Avatar for KOBA789 koba789
7
3k

Featured

See All Featured
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
163
24k
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
290
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.2k
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.4k
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
950
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.4k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
88
5.1k
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
1
34k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
53k
Mind Mapping
Avatar for Hélio Medeiros helmedeiros
PRO
1
340
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.7k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees