Container + Big Data Shinect discussions

March 23, 2016

76

Container + Big Data Shinect discussions

Container + Big Data Shinect discussions

Timothy Chen

March 23, 2016

Tweet

More Decks by Timothy Chen

See All by Timothy Chen

Spark Summit 2017 SF - Spark on Kubernetes

2

390

Spark on Mesos - MesosCon 2016

0

240

Containers in Mesos: Present and Future

0

1.7k

Past, Present and Future of Containers

0

2.4k

Deep dive Spark on Mesos

0

260

Scale your Docker containers with Mesos

0

330

Docker Swarm + Mesos

8

7.5k

Scale your Docker containers with Mesos

3

610

Introduction To Apache Drill - Big Data Bellevue 20131023

2

3.4k

Other Decks in Technology

See All in Technology

株式会社Awarefy(アウェアファイ)会社説明資料 / Awarefy-Company-Deck

3

11k

Ruby on Railsで持続可能な開発を行うために取り組んでいること

3

160

開発組織を進化させる！AWSで実践するチームトポロジー

2

460

AIエージェント入門

32

19k

Introduction to OpenSearch Project - Search Engineering Tech Talk 2025 Winter

2

140

"TEAM"を導入したら最高のエンジニア"Team"を実現できた / Deploying "TEAM" and Building the Best Engineering "Team"

1

220

Amazon Q Developerの無料利用枠を使い倒してHello worldを表示させよう！

2

120

生成AI “再”入門 2025年春@WIRED TUESDAY EDITOR'S LOUNGE

0

150

ディスプレイ広告（Yahoo!広告・LINE広告）におけるバックエンド開発

0

480

開発者のための FinOps/FinOps for Engineers

oracle4engineer

2

180

Exadata Database Service on Cloud@Customer セキュリティ、ネットワーク、および管理について

oracle4engineer

2

1.5k

スキルだけでは満たせない、 “組織全体に”なじむオンボーディング/Onboarding that fits “throughout the organization” and cannot be satisfied by skills alone

0

190

Featured

See All Featured

GitHub's CSS Performance

1030

460k

Embracing the Ebb and Flow

84

4.6k

Distributed Sagas: A Protocol for Coordinating Microservices

330

21k

Building an army of robots

303

45k

The World Runs on Bad Software

67

11k

The MySQL Ecosystem @ GitHub 2015

250

12k

Building Flexible Design Systems

yeseniaperezcruz

328

38k

Practical Orchestrator

186

10k

Product Roadmaps are Hard

50

11k

Build The Right Thing And Hit Your Dates

34

2.5k

sergeychernyshev

27

810

Put a Button on it: Removing Barriers to Going Fast.

60

3.7k

Transcript

Containers + Big Data: Present and Future By Timothy Chen
Apache Mesos & Drill PMC, Lead Engineer @ Mesosphere
None
Containers • Light weight • Deploy cycle reduced • Enterprise-ready
(soon) open source solutions • Right timing!
YARN Mesos
Cluster Manager
Multi-tenancy • Resource Isolation • Fair sharing / Scheduling •
Performance Isolation • Security • More..
Container == process
Multi-tenant Between users and systems!
Future...
Everything in Container
None
Stop reimplementing the wheel, use your OS!
Big data systems as an App / Pod
Utilization and Guarantees