Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Container + Big Data Shinect discussions
Search
Timothy Chen
March 23, 2016
Technology
0
76
Container + Big Data Shinect discussions
Container + Big Data Shinect discussions
Timothy Chen
March 23, 2016
Tweet
Share
More Decks by Timothy Chen
See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
tnachen
2
390
Spark on Mesos - MesosCon 2016
tnachen
0
230
Containers in Mesos: Present and Future
tnachen
0
1.7k
Past, Present and Future of Containers
tnachen
0
2.4k
Deep dive Spark on Mesos
tnachen
0
260
Scale your Docker containers with Mesos
tnachen
0
330
Docker Swarm + Mesos
tnachen
8
7.5k
Scale your Docker containers with Mesos
tnachen
3
610
Introduction To Apache Drill - Big Data Bellevue 20131023
tnachen
2
3.4k
Other Decks in Technology
See All in Technology
クラウド関連のインシデントケースを収集して見えてきたもの
lhazy
5
370
偏光画像処理ライブラリを作った話
elerac
1
170
2/18 Making Security Scale: メルカリが考えるセキュリティ戦略 - Coincheck x LayerX x Mercari
jsonf
0
190
ウォンテッドリーのデータパイプラインを支える ETL のための analytics, rds-exporter / analytics, rds-exporter for ETL to support Wantedly's data pipeline
unblee
0
120
組織におけるCCoEの役割とAWS活用事例
nrinetcom
PRO
4
130
内製化を加速させるlaC活用術
nrinetcom
PRO
2
140
データエンジニアリング領域におけるDuckDBのユースケース
chanyou0311
9
2.2k
php-conference-nagoya-2025
fuwasegu
0
150
IAMのマニアックな話2025
nrinetcom
PRO
2
250
AWSアカウントのセキュリティ自動化、どこまで進める? 最適な設計と実践ポイント
yuobayashi
7
540
4th place solution Eedi - Mining Misconceptions in Mathematics
rist
0
140
Snowflakeの開発・運用コストをApache Icebergで効率化しよう!~機能と活用例のご紹介~
sagara
1
430
Featured
See All Featured
Side Projects
sachag
452
42k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Code Review Best Practice
trishagee
67
18k
Visualization
eitanlees
146
15k
Automating Front-end Workflow
addyosmani
1368
200k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
44
7k
Testing 201, or: Great Expectations
jmmastey
42
7.2k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
30
2.2k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Git: the NoSQL Database
bkeepers
PRO
427
65k
Why You Should Never Use an ORM
jnunemaker
PRO
55
9.2k
Transcript
Containers + Big Data: Present and Future By Timothy Chen
Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
None
Containers • Light weight • Deploy cycle reduced • Enterprise-ready
(soon) open source solutions • Right timing!
YARN Mesos
Cluster Manager
Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •
Performance Isolation • Security • More..
Container == process
Multi-tenant Between users and systems!
Future...
Everything in Container
None
Stop reimplementing the wheel, use your OS!
Big data systems as an App / Pod
Utilization and Guarantees