Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Journey to #GIFEE: Intro to the Open Source
Search
Brandon Philips
April 10, 2016
Technology
1
110
The Journey to #GIFEE: Intro to the Open Source
At Linux Foundation Collab Summit 2016
Brandon Philips
April 10, 2016
Tweet
Share
More Decks by Brandon Philips
See All by Brandon Philips
Node.js Workflow with Minikube and Skaffold
philips
0
250
Manage the App on Kubernetes
philips
0
330
Production Backbone Monitoring Containerized Apps
philips
0
160
KubeCon EU 2017: Dancing on the Edge of a Volcano
philips
1
690
rkt - KubeCon EU keynote - 2017
philips
1
250
FOSDEM_Keynote_2017-_.pdf
philips
0
120
Tectonic Summit Day 2 Keynote
philips
0
330
Kubernetes: Simple to Manage Anywhere (self-hosted, Tectonic upgrade demo)
philips
0
370
KubeCon Keynote 2016- Distributed Systems Simplified on Kubernetes
philips
2
540
Other Decks in Technology
See All in Technology
つくって納得、つかって実感! 大規模言語モデルことはじめ
recruitengineers
PRO
19
5.3k
Yahoo!ニュースにおけるソフトウェア開発
lycorptech_jp
PRO
0
340
RAID6 を楔形文字で組んで現代人を怖がらせましょう(実装編)
mimifuwa
0
300
広島発!スタートアップ開発の裏側
tsankyo
0
240
人と組織に偏重したEMへのアンチテーゼ──なぜ、EMに設計力が必要なのか/An antithesis to the overemphasis of people and organizations in EM
dskst
5
600
認知戦の理解と、市民としての対抗策
hogehuga
0
320
KiroでGameDay開催してみよう(準備編)
yuuuuuuu168
1
130
Goss: Faiss向けの新しい本番環境対応 Goバインディング #coefl_go_jp
bengo4com
0
1.4k
Claude Code x Androidアプリ 開発
kgmyshin
1
570
OpenAPIから画面生成に挑戦した話
koinunopochi
0
150
7月のガバクラ利用料が高かったので調べてみた
techniczna
3
320
実践アプリケーション設計 ②トランザクションスクリプトへの対応
recruitengineers
PRO
2
150
Featured
See All Featured
Thoughts on Productivity
jonyablonski
69
4.8k
Large-scale JavaScript Application Architecture
addyosmani
512
110k
Java REST API Framework Comparison - PWX 2021
mraible
33
8.8k
How to train your dragon (web standard)
notwaldorf
96
6.2k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
30
9.6k
Typedesign – Prime Four
hannesfritz
42
2.8k
Building an army of robots
kneath
306
46k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
36
2.5k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
161
15k
Speed Design
sergeychernyshev
32
1.1k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Transcript
Brandon Philips @brandonphilips |
[email protected]
The Journey to #GIFEE Intro
to the Open Source
Secure the Internet MISSION
None
None
None
None
None
None
3 Application packaging Clustering Linux at scale
#GIFEE Borg/Omega Linux Chubby
#GIFEE Borg/Omega Linux Chubby
#GIFEE Borg/Omega Linux Chubby
Avoid single points of failure Design for constant updates Consistent
environment Why build #GIFEE?
Why build #GIFEE? Design for constant updates
Application Packaging 1
Abstract away app from the OS OS App
None
None
Base software managed by CoreOS kernel systemd OpenSSH
Protect apps from each other Isolated network namespace Isolated file
system namespace Mixed versions of dependencies eg. python 3.4 & python 2.7
$ sudo rkt run coreos.com/etcd:v2.0.0 $ sudo rkt run coreos.com/etcd:v2.0.0
\ --cpu=750m --memory=128M $ sudo rkt run --net=host coreos.com/etcd:v2.0.0 rkt run
Search container metadata Identify vulnerabilities Explain update actions Clair container
security auditing
After scanning millions of containers we found that over 80%
still had Heartbleed 80% Clair container security auditing
None
In-Progress Universal Container Format Packaged Downloaded Verified
Linux at Scale 2
Patches to the OS and kernel are hard Retest after
updates No automation SECURITY Dependency breakage Uptime risk APPLICATION
None
Auto-updating browsers fixed security We got HTML5 at the same
time
Atomic operating system updates
Atomic operating system updates
Clustering 3
Patches to the OS and kernel are hard Retest after
updates No automation SECURITY Dependency breakage Uptime risk APPLICATION
Patches to the OS and kernel are hard No automation
SECURITY Uptime risk APPLICATION
Operations Paradise Easy scale out Painless app upgrades Tolerant of
machine failure
App Req/sec: 6,000 App Healthy: True
App Req/sec: 6,000 App Healthy: True
App Req/sec: 7,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
App Req/sec: 7,000 App Healthy: True
App Req/sec: 6,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
App Req/sec: 7,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
When do you need cluster coordination? Leader election Cluster-wide Semaphores
Service discovery Dynamic configuration
Hard Computer Science Problem ?
Hard Computer Science Problem Chubby
A highly-available key value store for shared configuration and service
discovery
None
None
None
None
None
None
None
No existing “cloud native” solutions Simple HTTP + JSON APIs
Dynamic reconfiguration Why build etcd?
Simple key/value “Distributed etc” Keys are versioned Changes can be
watch
Cluster-wide reboot lock - locksmith Service discovery - vulcand, skydns
Cluster orchestration - k8s, cloud foundry
Industry Adoption 500+ projects on Github
App Req/sec: 8,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
App Req/sec: 8,000 App Healthy: True
Kubernetes is our choice for orchestration platform
Guides & Tools coreos.com/kubernetes kube-aws Cloud-configs
Upstream rktnetes Auth/OIDC Node self-signed TLS
Scaling 15x scheduler performance 30k pods on 1k nodes SIG-scale
3 Application packaging Clustering Linux at scale
Sounds good, but... Is anyone successful with all this in
prod?
Publically traded options exchange
Containers on CoreOS are powering ISE's high- throughput, low-latency financial
exchange Running in production Bare metal & AWS Billions of transactions a day 150 million req/sec
None
Secure the Internet MISSION
coreos.com/fest - @coreosfest May 9 & 10, 2016 - Berlin,
Germany
None
Thank you! Brandon Philips @brandonphilips |
[email protected]
| coreos.com We’re
hiring in all departments! Email:
[email protected]
Positions: coreos.com/ careers