CoreOS + Kubernetes @ Velocity NY 2015

Transcript

1. Modern Container Orchestration Kubernetes, CoreOS, and more @coreoslinux @brandonphilips
2. Brandon Philips CTO, CoreOS github.com/philips
3. Easy CoreOS+Kubernetes Setup vagrant, aws, bare metal, etc coreos.com/kubernetes/docs/latest/
4. What is CoreOS?
5. What is CoreOS?
8. What is CoreOS?
10. The smartest way to run your container infrastructure. tectonic.com @tectonic
11. QUAY Secure hosting for private Docker repositories quay.io @quayio
12. Why build CoreOS?
13. you
14. you as a sw engineer
15. your
16. your container image
17. your
18. your
19. your com.example.app d474e8c57737625c
20. your d474e8c57737625c Signed By: Alice
21. you as an ops engineer
22. your
23. your
24. your
25. your ???
26. How do we do it?
27. reduce API contracts minimal
28. kernel systemd rkt ssh docker python java nginx mysql openssl app tro distro distro distro distro distro
29. python java nginx mysql openssl app tro distro distro distro distro distro kernel systemd rkt ssh docker
30. python openssl-A app1 tro distro distro distro distro distro java openssl-B app2 java openssl-B app3 kernel systemd rkt ssh docker
31. CoreOS container tro distro distro distro distro distro container container
32. OS operations
33. updates OS operations
34. manual updates
35. automatic updates
36. automatic updates
39. atomic update with rollback CoreOS Updates
40. machine configuration OS operations
41. get into the cluster machine config
46. distributed configuration cluster operations
47. etcd
48. /etc distributed
49. Available Leader Follower
50. Available Leader Follower
51. Available Leader Follower
52. Unavailable Leader Follower
53. Available Leader Follower
54. Available Leader Follower
55. Temporarily Unavailable Leader Follower
56. Available Leader Follower
57. Unavailable Leader Follower
58. what should run cluster operations
59. k8s/mesos/etc scheduler scheduling
60. getting work to servers scheduling
61. $ scp app host:/opt $ ssh host systemd-run /opt/app
62. $ scp app host:/opt $ ssh host systemd-run /opt/app
63. $ fab deploy:app
64. $ fab deploy:app
65. $ fab deploy:app
66. $ fab deploy:collector-app
67. $ fab deploy:collector-app
68. $ fab deploy:collector-app
69. $ fab deploy deploy:collector-app
70. $ fab lowest-loadaverage
71. $ fab lowest-loadaverage host1
72. $ fab lowest-loadaverage host1 $ fab -H host1 deploy:job
73. You Scheduler API Scheduler Machine(s)
74. while true { todo = diff(desState, curState) schedule(todo) }
75. while true { todo = diff(desState, curState) schedule(todo) }
76. while true { todo = diff(desState, curState) schedule(todo) }
77. while true { todo = diff(desState, curState) schedule(todo) }
80. pod env=prod app=web pod env=prod app=web pod env=prod app=web rc web-prod select(env=prod,app=web) count=1
81. pod env=prod app=web pod env=prod app=web pod env=prod app=web rc web-prod select(env=prod,app=web) count=1
82. pod env=prod app=web rc web-prod select(env=prod,app=web) count=1
83. pod env=prod app=web rc web-prod select(env=prod,app=web) count=5
84. pod env=prod app=web pod env=prod app=web pod env=prod app=web pod env=prod app=web pod env=prod app=web rc web-prod select(env=prod,app=web) count=5
85. where is it running cluster operations
86. dns, LBs, k8s labels services
87. flexible service discovery k8s labels
88. pod env=dev app=web pod env=test app=web pod env=prod app=web
89. pod env=dev app=web pod env=test app=web pod env=prod app=web service test.example.com select(env=dev,app=web) service beta.example.com select(env=test,app=web) OR select(env=prod,app=web) service example.com select(env=prod,app=web)
90. pod env=test app=web pod env=prod app=web pod env=prod app=web pod env=dev app=web pod env=test app=web pod env=prod app=web service test.example.com select(env=dev,app=web) service beta.example.com select(env=test,app=web) OR select(env=prod,app=web) service example.com select(env=prod,app=web)
91. pod app=foo,version=1 service foo.cluster.local select(app=foo)
92. pod app=foo,version=1 pod app=foo,version=2 service foo.cluster.local select(app=foo)
93. pod app=foo,version=1 pod app=foo,version=2 service foo.cluster.local select(app=foo)
95. architecture in practice cluster operations
96. worker kubelet worker kubelet worker kubelet scheduler & API worker kubelet w ku t worker kubelet
97. worker kubelet worker kubelet scheduler & API
98. worker & API works on 1 node too
99. Easy CoreOS+Kubernetes Setup vagrant, aws, bare metal, etc coreos.com/kubernetes/docs/latest/
100. coreos.com/careers work with us
101. @coreoslinux @tectonicstack @brandonphilips thank you
102. continuous delivery of the OS - Linux Kernel API promise - Containers are required - Consistency of configuration
103. $ date -d "-674 days" Mon Jul 1 2013
104. Alpha α
105. Alpha Beta α β
106. Alpha Beta Stable α β S
107. $ cd coreos/manifest
108. $ cd coreos/manifest $ git tag | wc -l
109. $ cd coreos/manifest $ git tag | wc -l 329
110. $ uname -r 3.8.0
111. $ uname -r 3.8.0 $ uname -r 4.0.0
112. $ init --version systemd 207
113. $ init --version systemd 207 $ init --version systemd 219
114. github.com/coreos/etcd
120. ...
123. ok? ok?
124. no yes
126. done
127. ok?
129. github.com/coreos/etcd
130. container networking
131. github.com/appc/cni - Defining external plugins e.g. ipvlan, bridge, etc - Used in rkt today for setting up network namespaces - Collaborating with folks from Red Hat, Cisco, and others
132. 192.168.1.10 192.168.1.40
133. 192.168.1.10 192.168.1.40
134. 10.0.0.3 10.0.0.8 10.0.1.10 10.0.1.20 192.168.1.10 192.168.1.40
136. 192.168.1.10 192.168.1.40 10.0.0.0/24 10.0.1.0/24
137. routes to 192.168.1.40 192.168.1.10 192.168.1.40 10.0.0.0/24 10.0.1.0/24
138. 192.168.1.40 10.0.1.0/24 192.168.1.10 routes to 192.168.1.10