Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Container + Big Data Shinect discussions

Timothy Chen
March 23, 2016
Technology
0
76

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Timothy Chen

March 23, 2016
Tweet

More Decks by Timothy Chen

See All by Timothy Chen
Spark Summit 2017 SF - Spark on Kubernetes
tnachen
2
390
Spark on Mesos - MesosCon 2016
tnachen
0
230
Containers in Mesos: Present and Future
tnachen
0
1.7k
Past, Present and Future of Containers
tnachen
0
2.4k
Deep dive Spark on Mesos
tnachen
0
260
Scale your Docker containers with Mesos
tnachen
0
330
Docker Swarm + Mesos
tnachen
8
7.5k
Scale your Docker containers with Mesos
tnachen
3
610
Introduction To Apache Drill - Big Data Bellevue 20131023
tnachen
2
3.4k

Other Decks in Technology

See All in Technology
クラウド関連のインシデントケースを収集して見えてきたもの
lhazy
5
370
偏光画像処理ライブラリを作った話
elerac
1
170
2/18 Making Security Scale: メルカリが考えるセキュリティ戦略 - Coincheck x LayerX x Mercari
jsonf
0
190
ウォンテッドリーのデータパイプラインを支える ETL のための analytics, rds-exporter / analytics, rds-exporter for ETL to support Wantedly's data pipeline
unblee
0
120
組織におけるCCoEの役割とAWS活用事例
nrinetcom
PRO
4
130
内製化を加速させるlaC活用術
nrinetcom
PRO
2
140
データエンジニアリング領域におけるDuckDBのユースケース
chanyou0311
9
2.2k
php-conference-nagoya-2025
fuwasegu
0
150
IAMのマニアックな話2025
nrinetcom
PRO
2
250
AWSアカウントのセキュリティ自動化、どこまで進める？　最適な設計と実践ポイント
yuobayashi
7
540
4th place solution Eedi - Mining Misconceptions in Mathematics
rist
0
140
Snowflakeの開発・運用コストをApache Icebergで効率化しよう！～機能と活用例のご紹介～
sagara
1
430

Featured

See All Featured
Side Projects
sachag
452
42k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Code Review Best Practice
trishagee
67
18k
Visualization
eitanlees
146
15k
Automating Front-end Workflow
addyosmani
1368
200k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
44
7k
Testing 201, or: Great Expectations
jmmastey
42
7.2k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
30
2.2k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Git: the NoSQL Database
bkeepers
PRO
427
65k
Why You Should Never Use an ORM
jnunemaker
PRO
55
9.2k

Transcript

  1. Containers + Big Data: Present and Future By Timothy Chen

    Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
  2. None

  3. Containers • Light weight • Deploy cycle reduced • Enterprise-ready

    (soon) open source solutions • Right timing!

  4. YARN Mesos

  5. Cluster Manager

  6. Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •

    Performance Isolation • Security • More..

  7. Container == process

  8. Multi-tenant Between users and systems!

  9. Future...

  10. Everything in Container

  11. None

  12. Stop reimplementing the wheel, use your OS!

  13. Big data systems as an App / Pod

  14. Utilization and Guarantees