Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
120
0

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
450
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
300
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.8k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
340
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
380
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.6k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
660
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
シンガポールで登壇してきます
Avatar for Yuuki Yamashita yama3133
0
240
生成AI×AWS CDK×AWS FISで"振り返れる"ミニGameDayをつくろう
Avatar for yoshimi0227 yoshimi0227
1
360
Oracle Exadata Database Service on Cloud@Customer X11M (ExaDB-C@C) サービス概要
Avatar for oracle4engineer oracle4engineer
PRO
2
8.4k
発表と総括 / Presentations and Summary
Avatar for Kenji Saito ks91
PRO
0
140
AI Driven AI Governance
Avatar for Yutaka Hiroyama pict3
0
480
[2026-07-15] AI Ready なはずだったアーキテクチャと、見えてきた課題・次に目指す状態
Avatar for 和田 悠佑 wxyzzz
9
4k
しぶいSRE: サーバから見えない障害にどう向き合うか。ラストワンマイルのデバッグ実践 / Shibui SRE
Avatar for Hokuto Hoshi kanny
13
6.4k
AIコード生成×サプライチェーン攻撃 — PHPが直面する“二重の信頼問題
Avatar for Shinya Saita shinyasaita
0
190
Data + AI Summit 2026 イベントレポート： 「AIがビジネスで意思決定するデータ基盤」へ
Avatar for KJ(Kenji Matsuda) nek0128
0
260
ガバナンスの「ちょうどいい落とし所」を探れ！開発スピードを妨げない運用判断の勘所 / SRE NEXT 2026
Avatar for GENDA genda
1
240
Control Planeで育てるBtoB SaaSの認証基盤 - SRE NEXT 2026
Avatar for pokohide pokohide
1
2.6k
企業でAWS Organizationsを動かすための組織設計の考え方
Avatar for NRI Netcom nrinetcom
PRO
1
110

Featured

See All Featured
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
34
2.8k
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
1
9.7k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
41
2.6k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.9k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1.3k
It's Worth the Effort
Avatar for 3n 3n
188
29k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
408
67k
Applied NLP in the Age of Generative AI
Avatar for Ines Montani inesmontani
PRO
4
2.4k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
270
14k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
31
6k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees