Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Avatar for Timothy Chen Timothy Chen
March 23, 2016
Technology
0
100

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Avatar for Timothy Chen

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
Avatar for Timothy Chen tnachen
2
420
Spark on Mesos - MesosCon 2016
Avatar for Timothy Chen tnachen
0
260
Containers in Mesos: Present and Future
Avatar for Timothy Chen tnachen
0
1.7k
Past, Present and Future of Containers
Avatar for Timothy Chen tnachen
0
2.5k
Deep dive Spark on Mesos
Avatar for Timothy Chen tnachen
0
300
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
0
360
Docker Swarm + Mesos
Avatar for Timothy Chen tnachen
8
7.5k
Scale your Docker containers with Mesos
Avatar for Timothy Chen tnachen
3
640
Introduction To Apache Drill - Big Data Bellevue 20131023
Avatar for Timothy Chen tnachen
2
3.4k

Other Decks in Technology

See All in Technology
Progressive Deliveryで支える！スケールする衛星コンステレーションの地上システム運用 / Ground Station Operation for Scalable Satellite Constellation by Progressive Delivery
Avatar for iselegant iselegant
1
220
転職したら勘定系システムのクラウド化担当だった件 〜銀行勘定系システムをEKSで稼働させるまで〜
Avatar for Toru Kono torukouno
0
100
IaC を使いたくないけどポリシー管理をどうにかしたい
Avatar for kazzpapa3 kazzpapa3
1
160
pmconf 2025 大阪「生成AI時代に未来を切り開くためのプロダクト戦略：圧倒的生産性を実現するためのプロダクトサイクロン」 / The Product Cyclone for Outstanding Productivity
Avatar for yama@muteki yamamuteki
3
2.6k
重厚長大企業で、顧客価値をスケールさせるためのプロダクトづくりとプロダクト開発チームづくりの裏側 / Developers X Summit 2025
Avatar for モンゴル (mongolyy) mongolyy
0
200
2025 DORA Reportから読み解く！AIが映し出す、成果を出し続ける組織の共通点 #開発生産性_findy
Avatar for Hiroyuki TAKAHASHI takabow
0
130
米軍Platform One / Black Pearlに学ぶ 極限環境DevSecOps
Avatar for jyoshise jyoshise
2
530
IPv6-mostly field report from RubyKaigi 2026
Avatar for Sorah Fukumori sorah
0
200
AI時代の戦略的アーキテクチャ 〜Adaptable AI をアーキテクチャで実現する〜 / Enabling Adaptable AI Through Strategic Architecture
Avatar for 株式会社ビットキー / Bitkey Inc. bitkey
PRO
15
10k
Datadog LLM Observabilityで実現するLLMOps実践事例 / practical-llm-observability-with-datadog
Avatar for 逆井（さかさい） k6s4i53rx
0
160
LINEヤフー バックエンド組織・体制の紹介
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
850
ローカルLLM基礎知識 / local LLM basics 2025
Avatar for Naoki Kishida kishida
23
8.6k

Featured

See All Featured
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.2k
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1032
470k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
26
3.2k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
46
7.8k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
1.8k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
329
39k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.3k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.3k
KATA
Avatar for Megan Lloyd mclloyd
PRO
32
15k
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
127
17k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
186
22k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees