Kubernetes: Applying Lessons from a Decade of Containers @ GCPUG Osaka

Transcript

1. Kubernetes Applying Lessons from a Decade of Containers Ian Lewis, Developer Advocate
2. Ian Lewis Developer Advocate Google Cloud Platform google.com/+IanLewis-hoge @IanMLewis
3. ＋
5. Cloud Technology Innovations 2012 2013 MapReduce Spanner/F1 2003 2006 2007 2010 2011 GFS Omega Colossus Cloud Storage Dremel BigQuery Big Table Cloud Datastore Paxos impl. 2004 Cloud Bigtable
6. BORG +
7. http://research.google.com/pubs/pub43438.html
8. build and deploy vm images • Curated runtimes • Rich services • Auto-everything • … just add code • Managed collections • Declarative + Dynamic Compute as a Continuum Platform Cluster • Basic atom • Run anything VM More agility More Flexibility build and deploy containers build and deploy apps
9. distributed process scheduler
10. Current Practice Docker Containers Kubernetes Clusters Wrap-up 1 2 3 4 Agenda
11. Current Practice … what we’re really doing.
12. Database Batch processing Cache Webservers Webservers Webservers Webservers
13. dedicated machines
14. management Chef, Puppet, Salt, Ansible…
15. machines physical, cloud
16. challenging to get this far
17. remaining challenges app dependencies, utilization, scaling, deployment, version upgrades Dev→ Test→ Staging/Canary→ Prod
18. Docker Containers
19. containers? processes, microservices, jails, zones
20. process isolation
21. static binaries
22. containers everywhere!
23. we need a distributed process scheduler
24. Kubernetes Clusters
25. (Key Concepts) What is Kubernetes?
26. • 0.4.2 released • 116 contributors • over 4200 github stars • CoreOS • HP • IBM • Mesosphere • Microsoft • Pivotal • Red Hat • SaltStack • VMWare • Binary releases • Logging and monitoring • Richer scheduling ◦ Labels based constraints ◦ Smart bin-packing ◦ Run-to-completion • Updated service model ◦ IP per service • DNS integration Project Partners New Introducing Google Container Engine Community
27. • Group of containers • Settings in a template ➔ Reuse across environments ➔ Repeatable, manageable Behavior Benefits Pod Web Server Content Management Server Pods more at pod.md
28. Dashboard show: FE Labels • Metadata with semantic meaning • Membership identifier ➔ Allow for intent of many users (e.g. dashboards) ➔ Build higher level systems … Behavior Benefits Pod Pod frontend Pod frontend Pod Pod FE BI, FE v2 Dashboard show: v2 more at labels.md
29. Replication Controllers Behavior Benefits Replication Controller #Pods → 2 label selector: v1 Pod Pod frontend Pod frontend Pod Pod v1 v1 Replication Controller #Pods → 1 label selector: v2 v2 more at rc.md • Keeps Pods running • Gives direct control of Pod #s ➔ Restarts Pods, desired state ➔ Fine-grained control for scaling
30. let’s see it
31. Database Batch processing Cache Webservers Webservers Webservers Webservers demo
34. Pod Services Behavior Benefits Pod FE FE Pod FE Service label selector: Front End more at services.md ➔ Clients shielded from implementation details ➔ Independently control each, build for resiliency • Stable address • Decoupled from Controllers
35. distributed process scheduler
36. Wrap up … or how does this fit with the rest of everything else.
37. Do I have to manage it myself?
38. Google Container Engine - Inspired by a decade within Google - Reimagines Cluster computing - Designed for a multi-cloud world Photo by Connie Zhou
39. Run and manage an optimized cluster Kubernetes Open Source Workload API & Tools Google Container Engine (GKE) Google Container Engine Kubernetes • Growing Community • Linux containers support • Open source orchestration create and manage Container Engine • Provisioned cluster in seconds • Optimized cluster environment • Runs and manages Kubernetes GKE Master GKE Nodes Virtual Machines
40. Google Container Engine (GKE) New service for cluster-based compute • Provisioned cluster in seconds. Fully configured. • Fine-grained control over cluster. Desired state • Designed for multi-cloud. Runs Kubernetes. Releases • Today: Alpha open to the public • Coming soon: SLA, Pricing Resources • Google Container Engine: http://cloud.google.com/container-engine • Kubernetes: http://kubernetes.io
41. #gcpug plus.google.com/+IanLewis-hoge twitter.com/IanMLewis Thank you!