The Journey to #GIFEE: Intro to the Open Source

At Linux Foundation Collab Summit 2016

Transcript

1. Brandon Philips @brandonphilips | brandon.philips@coreos.com The Journey to #GIFEE Intro to the Open Source
2. Secure the Internet MISSION
9. 3 Application packaging Clustering Linux at scale
10. #GIFEE Borg/Omega Linux Chubby
11. #GIFEE Borg/Omega Linux Chubby
12. #GIFEE Borg/Omega Linux Chubby
13. Avoid single points of failure Design for constant updates Consistent environment Why build #GIFEE?
14. Why build #GIFEE? Design for constant updates
15. Application Packaging 1
16. Abstract away app from the OS OS App
19. Base software managed by CoreOS kernel systemd OpenSSH
20. Protect apps from each other Isolated network namespace Isolated file system namespace Mixed versions of dependencies eg. python 3.4 & python 2.7
21. $ sudo rkt run coreos.com/etcd:v2.0.0 $ sudo rkt run coreos.com/etcd:v2.0.0 \ --cpu=750m --memory=128M $ sudo rkt run --net=host coreos.com/etcd:v2.0.0 rkt run
22. Search container metadata Identify vulnerabilities Explain update actions Clair container security auditing
23. After scanning millions of containers we found that over 80% still had Heartbleed 80% Clair container security auditing
25. In-Progress Universal Container Format Packaged Downloaded Verified
26. Linux at Scale 2
27. Patches to the OS and kernel are hard Retest after updates No automation SECURITY Dependency breakage Uptime risk APPLICATION
29. Auto-updating browsers fixed security We got HTML5 at the same time
30. Atomic operating system updates
31. Atomic operating system updates
32. Clustering 3
33. Patches to the OS and kernel are hard Retest after updates No automation SECURITY Dependency breakage Uptime risk APPLICATION
34. Patches to the OS and kernel are hard No automation SECURITY Uptime risk APPLICATION
35. Operations Paradise Easy scale out Painless app upgrades Tolerant of machine failure
36. App Req/sec: 6,000 App Healthy: True
37. App Req/sec: 6,000 App Healthy: True
38. App Req/sec: 7,000 App Healthy: True
39. App Req/sec: 8,000 App Healthy: True
40. App Req/sec: 7,000 App Healthy: True
41. App Req/sec: 6,000 App Healthy: True
42. App Req/sec: 8,000 App Healthy: True
43. App Req/sec: 7,000 App Healthy: True
44. App Req/sec: 8,000 App Healthy: True
45. App Req/sec: 8,000 App Healthy: True
46. App Req/sec: 8,000 App Healthy: True
47. When do you need cluster coordination? Leader election Cluster-wide Semaphores Service discovery Dynamic configuration
48. Hard Computer Science Problem ?
49. Hard Computer Science Problem Chubby
50. A highly-available key value store for shared configuration and service discovery
58. No existing “cloud native” solutions Simple HTTP + JSON APIs Dynamic reconfiguration Why build etcd?
59. Simple key/value “Distributed etc” Keys are versioned Changes can be watch
60. Cluster-wide reboot lock - locksmith Service discovery - vulcand, skydns Cluster orchestration - k8s, cloud foundry
61. Industry Adoption 500+ projects on Github
62. App Req/sec: 8,000 App Healthy: True
63. App Req/sec: 8,000 App Healthy: True
64. App Req/sec: 8,000 App Healthy: True
65. App Req/sec: 8,000 App Healthy: True
66. Kubernetes is our choice for orchestration platform
67. Guides & Tools coreos.com/kubernetes kube-aws Cloud-configs
68. Upstream rktnetes Auth/OIDC Node self-signed TLS
69. Scaling 15x scheduler performance 30k pods on 1k nodes SIG-scale
70. 3 Application packaging Clustering Linux at scale
71. Sounds good, but... Is anyone successful with all this in prod?
72. Publically traded options exchange
73. Containers on CoreOS are powering ISE's high- throughput, low-latency financial exchange Running in production Bare metal & AWS Billions of transactions a day 150 million req/sec
75. Secure the Internet MISSION
76. coreos.com/fest - @coreosfest May 9 & 10, 2016 - Berlin, Germany
78. Thank you! Brandon Philips @brandonphilips | brandon@coreos.com | coreos.com We’re hiring in all departments! Email: careers@coreos.com Positions: coreos.com/ careers