2016 DevOps Summit Taipei - CICD with Kubernetes

Transcript

1. @saturnism @googlecloud #kubernetes Cloud-native CI/CD pipeline for Kubernetes
2. @saturnism @googlecloud #kubernetes Ray Tsang Developer Advocate Google Cloud Platform @saturnism | +RayTsang 請參加 http://gcpug.tw/
3. @saturnism @googlecloud #kubernetes Ray Tsang Developer Architect Traveler Photographer flickr.com/saturnism
4. @saturnism @googlecloud #kubernetes
5. @saturnism @googlecloud #kubernetes F is for Features! Developer
6. @saturnism @googlecloud #kubernetes U is for Uptime! Operations
7. @saturnism @googlecloud #kubernetes New Features Uptime / Reliability
8. @saturnism @googlecloud #kubernetes New Features Uptime / Reliability Operations
9. @saturnism @googlecloud #kubernetes New Features Uptime / Reliability Operations Developers
10. @saturnism @googlecloud #kubernetes
11. @saturnism @googlecloud #kubernetes Site Reliability Engineering
12. @saturnism @googlecloud #kubernetes “ ” SRE is what happens when you ask a software engineer to design and run operations. Ben Treynor Sloss 24x7 VP, Google
13. @saturnism @googlecloud #kubernetes
14. @saturnism @googlecloud #kubernetes 50% on Engineering Work Automation! Create tools for developers
15. @saturnism @googlecloud #kubernetes Package & Deployment application.ear app.war helloworld-service.jar guestbook-service.jar apache-xyz.jar application.war /... helloworld-service.jar guestbook-service.jar apache-xyz.jar
16. @saturnism @googlecloud #kubernetes Machine app.war / app.ear Application Server Kernel Shell / CLI / Tools
17. @saturnism @googlecloud #kubernetes Machine app.war / app.ear Application Server Kernel Shell / CLI / Tools Machine app.war / app.ear Application Server Kernel Shell / CLI / Tools Machine app.war / app.ear Application Server Kernel Shell / CLI / Tools
18. @saturnism @googlecloud #kubernetes Everything at Google runs in containers
19. @saturnism @googlecloud #kubernetes Everything at Google runs in containers Launch over 2 billion containers per week.
20. @saturnism @googlecloud #kubernetes Everything at Google runs in containers 每週啟動二十億個 Container
21. @saturnism @googlecloud #kubernetes job hello_world = { runtime = { cell = 'ic' } // Cell (cluster) to run in binary = '.../hello_world_webserver' // Program to run args = { port = '%port%' } // Command line parameters requirements = { // Resource requirements ram = 100M disk = 100M cpu = 0.1 } replicas = 5 // Number of tasks } 10000 Developer View
22. @saturnism @googlecloud #kubernetes web browsers BorgMaster link shard UI shard BorgMaster link shard UI shard BorgMaster link shard UI shard BorgMaster link shard UI shard Scheduler borgcfg web browsers scheduler Borglet Borglet Borglet Borglet Config file BorgMaster link shard UI shard persistent store (Paxos) Binary Developer View What just happened?
23. @saturnism @googlecloud #kubernetes Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Image by Connie Zhou Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world! Hello world!
24. @saturnism @googlecloud #kubernetes Developer View
25. @saturnism @googlecloud #kubernetes Kubernetes Greek for “Helmsman”; also the root of the words “governor” and “cybernetic” • Infrastructure for containers • Schedules, runs, and manages containers on virtual and physical machines • Platform for automating deployment, scaling, and operations • Inspired and informed by Google’s experiences and internal systems • 100% Open source, written in Go
26. @saturnism @googlecloud #kubernetes web browsers Scheduler kubectl web browsers scheduler Kubelet Kubelet Kubelet Kubelet Config file Kubernetes Master Container Image Developer View What just happened?
27. @saturnism @googlecloud #kubernetes
28. @saturnism @googlecloud #kubernetes Hello World Service - Greet Guestbook Service - Create Guestbook Service - Retrieve
29. @saturnism @googlecloud #kubernetes Guestbook UI Hello World Service Redis session replication greeting MySQL Guestbook Service CRUD
30. @saturnism @googlecloud #kubernetes Let's see it
31. @saturnism @googlecloud #kubernetes GitHub plugin Kuberntes plugin Pipeline plugin ...
32. @saturnism @googlecloud #kubernetes JBoss Fabric8
33. Confidential & Proprietary Google Cloud Platform 33 jfrog.com/artifactory/free-trial-google-cloud-platform/ Learn more on GCP: cloud.google.com/free-trial
34. @saturnism @googlecloud #kubernetes Challenges Which host machine(s) should each service run on? Avoid port conflicts? How does the application code find the Guest Book service? How do we keep all of these service running? What happens if a host machine has trouble? Are the services healthy? How do we scale when load changes? Run this in another environment? QA, dev, another cloud, your servers?
35. @saturnism @googlecloud #kubernetes Developer View spec: containers: - name: myservice image: myservice resources: limits: memory: "128Mi" cpu: "0.1" ports: - containerPort: 3306 protocol: TCP replicas: 1 10000
36. @saturnism @googlecloud #kubernetes Cluster of Machines as One
37. @saturnism @googlecloud #kubernetes Group of containers Live and die together Shared network interface Shared volumes Unique Routable IP Pod App Log Collector Pods ...
38. @saturnism @googlecloud #kubernetes Pod IPs are routable • Docker default is private IP Pods can reach each other without NAT • even across nodes No brokering of port numbers This is a fundamental requirement • several SDN solutions Inter-Pods Networking
39. @saturnism @googlecloud #kubernetes Label anything Name-value pair Make your own Pod App Log Collector Labels ... type = Frontend version = 1.0
40. @saturnism @googlecloud #kubernetes Replication Controller Replicas → 2 Pod frontend Pod App Log Collector ... type = Frontend version = 1.0 Pod App Log Collector ... type = Frontend version = 1.0 Replication Controllers
41. @saturnism @googlecloud #kubernetes Replication Controller Replicas → 1 Pod App Log Collector ... type = Frontend version = 1.0 Replication Controllers
42. @saturnism @googlecloud #kubernetes Replication Controllers node 1 f0118 node 3 node 4 node 2 d9376 b0111 a1209 Replication Controller - Desired = 4 - Current = 4
43. @saturnism @googlecloud #kubernetes Replication Controllers node 1 f0118 node 3 node 4 node 2 Replication Controller - Desired = 4 - Current = 4 d9376 b0111 a1209
44. @saturnism @googlecloud #kubernetes Replication Controllers node 1 f0118 node 3 node 4 Replication Controller - Desired = 4 - Current = 3 b0111 a1209
45. @saturnism @googlecloud #kubernetes Replication Controllers node 1 f0118 node 3 node 4 Replication Controller - Desired = 4 - Current = 4 b0111 a1209 c9bad
46. @saturnism @googlecloud #kubernetes Replication Controller Replicas → 2 Pod frontend Pod type = Frontend version = 1.0 Pod type = Frontend version = 1.0 Services Service Label selectors: version = 1.0 type = Frontend
47. @saturnism @googlecloud #kubernetes Pod frontend Pod type = Frontend version = 1.0 Pod type = Frontend version = 1.0 Services Service Label selectors: version = 1.0 type = Frontend Pod type = Frontend version = 2.0
48. @saturnism @googlecloud #kubernetes Pod frontend Pod type = Frontend version = 1.0 Pod type = Frontend version = 1.0 Services Service Label selectors: type = Frontend Pod type = Frontend version = 2.0
49. @saturnism @googlecloud #kubernetes Service discovery Read service IP addresses via environmental variables
50. @saturnism @googlecloud #kubernetes Service discovery Kubernetes API or… DNS Lookups! ping redis
51. @saturnism @googlecloud #kubernetes Live Demo
52. @saturnism @googlecloud #kubernetes Try out Google Container Engine https://cloud.google.com/container-engine/
53. @saturnism @googlecloud #kubernetes Try Kubernetes Today!
54. @saturnism @googlecloud #kubernetes Thanks! Images by Connie Zhou http://kubernetes.io http://bit.ly/1QLg5E1