Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Container + Big Data Shinect discussions
Search
Timothy Chen
March 23, 2016
Technology
0
85
Container + Big Data Shinect discussions
Container + Big Data Shinect discussions
Timothy Chen
March 23, 2016
Tweet
Share
More Decks by Timothy Chen
See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
tnachen
2
410
Spark on Mesos - MesosCon 2016
tnachen
0
250
Containers in Mesos: Present and Future
tnachen
0
1.7k
Past, Present and Future of Containers
tnachen
0
2.5k
Deep dive Spark on Mesos
tnachen
0
280
Scale your Docker containers with Mesos
tnachen
0
350
Docker Swarm + Mesos
tnachen
8
7.5k
Scale your Docker containers with Mesos
tnachen
3
630
Introduction To Apache Drill - Big Data Bellevue 20131023
tnachen
2
3.4k
Other Decks in Technology
See All in Technology
経験がないことを言い訳にしない、 AI時代の他領域への染み出し方
parayama0625
0
170
なぜAI時代に 「イベント」を中心に考えるのか? / Why focus on "events" in the age of AI?
ytake
2
630
P2P通信の標準化 WebRTCを知ろう
faithandbrave
6
2.3k
地図と生成AI
nakasho
0
720
激動の時代、新卒エンジニアはAIツールにどう向き合うか。 [LayerX Bet AI Day Countdown LT Day1 ツールの選択]
tak848
0
550
Turn Your Community into a Fundraising Catalyst for Black Philanthropy Month
auctria
PRO
0
140
新規事業におけるAIリサーチの活用例
ranxxx
0
150
低レイヤソフトウェア技術者が YouTuberとして食っていこうとした話
sat
PRO
7
5.8k
ObsidianをLLM時代のナレッジベースに! クリッピング→Markdown→CLI連携の実践
srvhat09
7
9.2k
P2P ではじめる WebRTC のつまづきどころ
tnoho
1
220
MCP とマネージド PaaS で実現する大規模 AI アプリケーションの高速開発
nahokoxxx
1
1.5k
Ktor + Google Cloud Tasks/PubSub におけるOTel Messaging計装の実践
sansantech
PRO
1
300
Featured
See All Featured
Raft: Consensus for Rubyists
vanstee
140
7k
Building Adaptive Systems
keathley
43
2.7k
Typedesign – Prime Four
hannesfritz
42
2.7k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Being A Developer After 40
akosma
90
590k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
45
7.5k
Thoughts on Productivity
jonyablonski
69
4.7k
Code Review Best Practice
trishagee
69
19k
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
357
30k
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
Transcript
Containers + Big Data: Present and Future By Timothy Chen
Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
None
Containers • Light weight • Deploy cycle reduced • Enterprise-ready
(soon) open source solutions • Right timing!
YARN Mesos
Cluster Manager
Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •
Performance Isolation • Security • More..
Container == process
Multi-tenant Between users and systems!
Future...
Everything in Container
None
Stop reimplementing the wheel, use your OS!
Big data systems as an App / Pod
Utilization and Guarantees