Kubernetes- Applying Lessons from a Decade of Containers (Aug 2015)

Transcript

1. Kubernetes Applying Lessons from a Decade of Containers Ian Lewis, Developer Advocate
2. Ian Lewis Developer Advocate Google Cloud Platform google.com/+IanLewis-hoge @IanMLewis
3. Cloud Technology Innovations 2012 2013 MapReduce Spanner/F1 2003 2006 2007 2010 2011 GFS Omega Colossus Cloud Storage Dremel BigQuery Big Table Cloud Datastore Paxos impl. 2004 Cloud Bigtable
4. http://research.google.com/pubs/pub43438.html
5. build and deploy vm images • Curated runtimes • Rich services • Auto-everything • … just add code • Managed collections • Declarative + Dynamic Compute as a Continuum Platform Cluster • Basic atom • Run anything VM More agility More Flexibility build and deploy containers build and deploy apps
6. Current Practice Docker Containers Kubernetes Clusters Wrap-up 1 2 3 4 Agenda
7. Current Practice … what we’re really doing.
8. Database Batch processing Cache Webservers Webservers Webservers Webservers
9. Shared Machines No isolation No namespacing Common libs Highly coupled apps and OS kernel libs app app app app
10. Old Way: Virtual Machines Some isolation Inefficient Still highly coupled to the guest OS Hard to manage app libs kernel libs app app kernel app libs libs kernel kernel
11. management Chef, Puppet, Salt, Ansible…
12. machines physical, cloud
13. challenging to get this far
14. remaining challenges app dependencies, utilization, scaling, deployment, version upgrades Dev→ Test→ Staging/Canary→ Prod
15. Docker Containers
16. New Way: Containers libs app kernel libs app libs app libs app
17. containers? processes, microservices, jails, zones
18. process isolation
19. static binaries
20. containers everywhere!
21. we need a distributed process scheduler
22. Kubernetes Clusters
23. Enter Kubernetes Greek for “Helmsman”; also the root of the word “Governor” • Container orchestrator • Runs containers • Supports multiple cloud and bare- metal environments • Inspired and informed by Google’s experiences and internal systems • Open source, written in Go Manage applications, not machines
24. • 1.0 released • 460 contributors • over 9500 github stars • CoreOS • HP • IBM • Mesosphere • Microsoft • Pivotal • Red Hat • SaltStack • VMWare • Binary releases • Logging and monitoring • Richer scheduling ◦ Labels based constraints ◦ Smart bin-packing ◦ Run-to-completion • Updated service model ◦ IP per service • DNS integration Project Partners New Introducing Google Container Engine Community
25. • Group of containers • Settings in a template ➔ Reuse across environments ➔ Repeatable, manageable Behavior Benefits Pod Web Server Content Management Server Pods Read the docs
26. Dashboard show: FE Labels • Metadata with semantic meaning • Membership identifier ➔ Allow for intent of many users (e.g. dashboards) ➔ Build higher level systems … Behavior Benefits Pod Pod frontend Pod frontend Pod Pod FE BI, FE v2 Dashboard show: v2 Read the docs
27. Replication Controllers Behavior Benefits Replication Controller #Pods → 2 label selector: v1 Pod Pod frontend Pod frontend Pod Pod v1 v1 Replication Controller #Pods → 1 label selector: v2 v2 Read the docs • Keeps Pods running • Gives direct control of Pod #s ➔ Restarts Pods, desired state ➔ Fine-grained control for scaling
28. let’s see it
29. Database Batch processing Cache Webservers Webservers Webservers Webservers demo
32. Pod Services Behavior Benefits Pod FE FE Pod FE Service label selector: Front End ➔ Clients shielded from implementation details ➔ Independently control each, build for resiliency • Stable address • Decoupled from Controllers Read the docs
33. distributed process scheduler
34. Wrap up … or how does this fit with the rest of everything else.
35. Do I have to manage it myself?
36. Google Container Engine - Inspired by a decade within Google - Reimagines Cluster computing - Designed for a multi-cloud world Photo by Connie Zhou
37. Run and manage an optimized cluster Kubernetes Open Source Workload API & Tools Google Container Engine (GKE) Google Container Engine Kubernetes • Growing Community • Linux containers support • Open source orchestration create and manage Container Engine • Provisioned cluster in seconds • Optimized cluster environment • Runs and manages Kubernetes GKE Master GKE Nodes Virtual Machines
38. Google Container Engine (GKE) New service for cluster-based compute • Provisioned cluster in seconds. Fully configured. • Fine-grained control over cluster. Desired state • Designed for multi-cloud. Runs Kubernetes. Releases • Today: Alpha open to the public • Coming soon: SLA, Pricing Resources • Google Container Engine: http://cloud.google.com/container-engine • Kubernetes: http://kubernetes.io
39. #gcpug plus.google.com/+IanLewis-hoge twitter.com/IanMLewis Thank you!