CoreOS + Kubernetes @ Hyderabad Scalability Meetup

Overview of Kubernetes and Application First Infrastructure at: http://www.meetup.com/hyderabad-scalability/events/227567581/

Transcript

1. Application First Infrastructure Kubernetes, CoreOS, and more @coreoslinux @brandonphilips
2. Brandon Philips CTO, CoreOS github.com/philips
3. What is CoreOS?
4. What is CoreOS?
7. What is CoreOS?
9. The smartest way to run your container infrastructure. tectonic.com @tectonic
10. QUAY Secure hosting for private Docker repositories quay.io @quayio
11. Why build CoreOS?
12. you
13. you as a sw engineer
14. your with Ada.Text_IO; procedure Hello_World is use Ada.Text_IO; begin Put_Line("Hello, world!"); end; #include <stdio.h> int main() { printf("Hello, world!\n"); } package main import "fmt" func main() { fmt.Println("Hello, world!") }
15. your container image
16. your /bin/java /opt/app.jar /lib/libc
17. your /bin/python /opt/app.py /lib/libc
18. your com.example.app d474e8c57737625c
19. your d474e8c57737625c Signed By: Alice
20. you as an ops engineer
21. your
22. your com.example.webapp x3
23. your com.example.webapp x3
24. your ??? com.example.webapp x3
25. How do we do it?
26. reduce API contracts minimal
27. kernel systemd rkt ssh docker python java nginx mysql openssl app tro distro distro distro distro distro
28. python java nginx mysql openssl app tro distro distro distro distro distro kernel systemd rkt ssh docker
29. python openssl-A app1 tro distro distro distro distro distro java openssl-B app2 java openssl-B app3 kernel systemd rkt ssh docker
30. CoreOS container tro distro distro distro distro distro container container
31. OS operations
32. updates OS operations
33. automatic updates
36. automatic updates
39. atomic update with rollback CoreOS Updates
40. machine configuration OS operations
41. get into the cluster machine config
42. [Service] ExecStart=/usr/bin/kubelet -- api_servers=https://172.17.4.101 -- register-node=true --hostname- override=172.17.4.201 --cluster_dns=10. 3.0.10 --cluster_domain=cluster.local --tls-cert-file=worker.pem --tls- private-key-file=worker-key.pem
43. [Service] ExecStart=/usr/bin/kubelet -- api_servers=https://172.17.4.101 -- register-node=true --hostname- override=172.17.4.201 --cluster_dns=10. 3.0.10 --cluster_domain=cluster.local --tls-cert-file=worker.pem --tls- private-key-file=worker-key.pem
44. [Service] ExecStart=/usr/bin/kubelet -- api_servers=https://172.17.4.101 -- register-node=true --hostname- override=172.17.4.201 --cluster_dns=10. 3.0.10 --cluster_domain=cluster.local --tls-cert-file=worker.pem --tls- private-key-file=worker-key.pem
45. [Service] ExecStart=/usr/bin/kubelet -- api_servers=https://172.17.4.101 -- register-node=true --hostname- override=172.17.4.201 --cluster_dns=10. 3.0.10 --cluster_domain=cluster.local --tls-cert-file=worker.pem --tls- private-key-file=worker-key.pem
46. distributed configuration cluster operations
47. etcd
48. /etc distributed
49. Available Leader Follower
50. Available Leader Follower
51. Available Leader Follower
52. Unavailable Leader Follower
53. Available Leader Follower
54. Available Leader Follower
55. Temporarily Unavailable Leader Follower
56. Available Leader Follower
57. Unavailable Leader Follower
58. what should run cluster operations
59. k8s/mesos/etc scheduler scheduling
60. getting work to servers scheduling
61. $ scp app host:/opt $ ssh host systemd-run /opt/app
62. $ scp app host:/opt $ ssh host systemd-run /opt/app
63. $ fab deploy:app
64. $ fab deploy:app
65. $ fab deploy:app
66. $ fab deploy:collector-app
67. $ fab deploy:collector-app
68. $ fab deploy:collector-app
69. $ fab deploy deploy:collector-app
70. $ fab lowest-loadaverage
71. $ fab lowest-loadaverage host1
72. $ fab lowest-loadaverage host1 $ fab -H host1 deploy:job
73. You Scheduler API Scheduler Machine(s)
74. while true { todo = diff(desState, curState) schedule(todo) }
75. while true { todo = diff(desState, curState) schedule(todo) }
76. while true { todo = diff(desState, curState) schedule(todo) }
77. while true { todo = diff(desState, curState) schedule(todo) }
78. $ kubectl run host-info --image=quay.io/philips/host-info --replicas=1 $ kubectl get pods POD IP host-info-97wt8 10.2.29.4
79. $ kubectl scale rc host-info --replicas=2 $ kubectl get pods POD IP host-info-97wt8 10.2.29.4 host-info-f839d 10.2.29.8
80. pod env=prod app=web pod env=prod app=web pod env=prod app=web rc web-prod select(env=prod,app=web) count=1
81. pod env=prod app=web pod env=prod app=web pod env=prod app=web rc web-prod select(env=prod,app=web) count=1
82. pod env=prod app=web rc web-prod select(env=prod,app=web) count=1
83. pod env=prod app=web rc web-prod select(env=prod,app=web) count=5
84. pod env=prod app=web pod env=prod app=web pod env=prod app=web pod env=prod app=web pod env=prod app=web rc web-prod select(env=prod,app=web) count=5
85. where is it running cluster operations
86. dns, LBs, k8s labels services
87. flexible service discovery k8s labels
88. pod env=dev app=web pod env=test app=web pod env=prod app=web
89. pod env=dev app=web pod env=test app=web pod env=prod app=web service test.example.com select(env=dev,app=web) service beta.example.com select(env=test,app=web) OR select(env=prod,app=web) service example.com select(env=prod,app=web)
90. pod env=test app=web pod env=prod app=web pod env=prod app=web pod env=dev app=web pod env=test app=web pod env=prod app=web service test.example.com select(env=dev,app=web) service beta.example.com select(env=test,app=web) OR select(env=prod,app=web) service example.com select(env=prod,app=web)
91. pod app=foo,version=1 service foo.cluster.local select(app=foo)
92. pod app=foo,version=1 pod app=foo,version=2 service foo.cluster.local select(app=foo)
93. pod app=foo,version=1 pod app=foo,version=2 service foo.cluster.local select(app=foo)
94. $ kubectl expose rc host-info --port=80 --target-port=5483 --type=NodePort $ curl http://172.17.4.202:32430/
95. architecture in practice cluster operations
96. worker kubelet worker kubelet worker kubelet scheduler & API worker kubelet w ku t worker kubelet
97. worker kubelet worker kubelet scheduler & API
98. worker & API works on 1 node too
99. coreos.com/careers work with us
100. @coreoslinux @tectonicstack @brandonphilips thank you