Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Timothy Chen
March 23, 2016
Technology
0
80

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
tnachen
2
390
Spark on Mesos - MesosCon 2016
tnachen
0
240
Containers in Mesos: Present and Future
tnachen
0
1.7k
Past, Present and Future of Containers
tnachen
0
2.4k
Deep dive Spark on Mesos
tnachen
0
270
Scale your Docker containers with Mesos
tnachen
0
340
Docker Swarm + Mesos
tnachen
8
7.5k
Scale your Docker containers with Mesos
tnachen
3
620
Introduction To Apache Drill - Big Data Bellevue 20131023
tnachen
2
3.4k

Other Decks in Technology

See All in Technology
「経験の点」の位置を意識したキャリア形成 / Career development with an awareness of the “point of experience” position
pauli
4
100
OpenLane-V2ベンチマークと代表的な手法
kzykmyzw
0
110
JPOUG Tech Talk #12 UNDO Tablespace Reintroduction
nori_shinoda
2
150
C++26アップデート 2025-03
faithandbrave
0
760
Cursor AgentによるパーソナルAIアシスタント育成入門―業務のプロンプト化・MCPの活用
os1ma
14
4.9k
MCPを活用した検索システムの作り方/How to implement search systems with MCP #catalks
quiver
12
6.8k
The Tale of Leo: Brave Lion and Curious Little Bug
canalun
1
130
コスト最適重視でAurora PostgreSQLのログ分析基盤を作ってみた #jawsug_tokyo
non97
1
490
LLM as プロダクト開発のパワードスーツ
layerx
PRO
1
240
Amazon CloudWatch を使って NW 監視を行うには
o11yfes2023
0
170
白金鉱業Meetup_Vol.18_生成AIはデータサイエンティストを代替するのか？
brainpadpr
3
110
AWS Control Towerを 数年運用してきての気づきとこれから/aws-controltower-ops-tips
tadayukinakamura
0
160

Featured

See All Featured
Why Our Code Smells
bkeepers
PRO
336
57k
Navigating Team Friction
lara
184
15k
StorybookのUI Testing Handbookを読んだ
zakiyama
29
5.6k
Product Roadmaps are Hard
iamctodd
PRO
52
11k
A designer walks into a library…
pauljervisheath
205
24k
Being A Developer After 40
akosma
91
590k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
119
51k
Stop Working from a Prison Cell
hatefulcrawdad
268
20k
A better future with KSS
kneath
239
17k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Facilitating Awesome Meetings
lara
54
6.3k
Building an army of robots
kneath
304
45k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees