Kubernetes scalability: VPA, Federation & Cluster API

Kubernetes scalability: VPA, Federation & Cluster API for Cloud Native Prague meetup

Transcript

2. Katie Gamanji Cloud Platform Engineer Condé Nast International @k_gamanji katie-gamanji
3. Kubernetes scalability: VPA, Federation & Cluster API @k_gamanji katie-gamanji
4. Condé Nast International has set the benchmark for print and digital publishing with a heritage of more than 110 years.
6. Markets 11 Websites 62 Unique users 200m Digital readership 1.1bn July 2019
9. Vertical Pod Autoscaler Federation v2 Cluster API
10. Vertical Pod Autoscaler Federation v2 Cluster API
11. Vertical Pod Autoscaler Federation v2 Cluster API
12. Vertical Pod Autoscaler Federation v2 Cluster API
13. Vertical Pod Autoscaler
14. apiVersion: apps/v1beta1 kind: Deployment metadata: name: nginx labels: app: nginx spec: template: [...] spec: containers: - resources: requests: memory: "16Mi" cpu: "25m" limits: memory: "16Mi" cpu: "50m"
15. apiVersion: apps/v1beta1 kind: Deployment metadata: name: nginx labels: app: nginx spec: template: [...] spec: containers: - resources: requests: memory: "16Mi" cpu: "25m" limits: memory: "16Mi" cpu: "50m"
16. VPA Reduce the maintenance cost, by automating configuration of resource requirements. Improving utilization of cluster resources, while minimizing the risk of containers running out of memory or getting CPU starved.
17. VPA • Vertical Pod Autoscaler ◦ CRD v0.5.0 (v1beta2) ◦ requires v1.11 • 3 components: ◦ admission controller ◦ recommender ◦ updater
19. apiVersion: autoscaling.k8s.io/v1beta2 kind: VerticalPodAutoscaler metadata: name: nginx-vpa spec: targetRef: apiVersion: "apps/v1" kind: Deployment name: nginx updatePolicy: updateMode: "Auto"
20. VPA VPA update policy: • Auto - assign/update resource requests by updating existing pods (restart-free) • Recreate - assign/update resource requests by evicting pods (restart required) • Initial - assign resource requests on creation only • Off - no automatic change, however resources are calculated
21. VPA Demo https://asciinema.org/a/wyRWC7Gy6nZW7D4J xd4AROfQS
22. Pod disruption budget HPA & VPA Limit/request ratio Takeaways
23. Federation v2
24. Federation v2 Mechanism for managing applications and services in multiple Kubernetes clusters tracked by the Kubernetes cluster registry.
25. Federation v2 SIG multicluster: • Federation ◦ v1 - deprecated ◦ v2 (alpha) - requires v1.13 • Cluster registry ◦ maintain list of clusters and associated metadata
26. 1 / 4
27. Host cluster Member clusters 2 / 4
28. Host cluster Member clusters Cluster registry Federation APIs 3 / 4
29. Host cluster Member clusters Control plane 4 / 4 Applications & services
30. Federation v2 Cluster placement • targeted clusters by the federation Configuration overrides • patches to federated resources
31. Federation v2 Cluster Placement • clusters spec: placement: clusters: - name: cluster2 - name: cluster1 • clusterSelector spec: clusterSelector: matchLabels: region: eu-central-1
32. Federation v2 Configuration overrides • Replace (default), add or remove spec: overrides: - clusterName: cluster1 clusterOverrides: - path: "/spec/replicas" value: 5
33. apiVersion: types.kubefed.io/v1beta1 kind: FederatedDeployment metadata: name: nginx-deployment spec: template: spec: replicas: 3 [...] placement: clusters: - cluster2 - cluster1 overrides: - clusterName: cluster2 clusterOverrides: - path: "/spec/replicas" value: 7
34. Federation v2 DEMO https://asciinema.org/a/caUpnqVCUz2PP1Fui wPiDQfkj
35. Resource management Namespace scoped control plane Conditional scalability Takeaways Higher level behaviour
36. Cluster API
37. Unique users Unique users Total digital readership 9m 62m 360m Russia China
38. Cluster API Provision of declarative APIs for cluster creation, configuration, and management.
39. Cluster API SIG-cluster-lifecycle: • Initial release: April 2019 • API: v1alpha2
40. 1 / 3
41. Bootstrap cluster Clusters 2 / 3 • CRDs • controllers • actuators
42. Bootstrap cluster Clusters 3 / 3 • CRDs • controllers • actuators
43. Bootstrap cluster Clusters 3 / 3 pivot • CRDs • controllers • actuators
44. Cluster API • Cluster - CIDRs for pods and services + DNS suffix • Machine - kubelet and control plane verisons • MachineSet • MachineDeployment • MachineClass - consolidate provider specific details
45. Cluster API Controllers vs actuators: Controllers: - e.g. MachineSet - watch resources for changes - invoke actuators Actuators: - e.g. Cluster, Machine - provider-specific logic to match the declared state
46. Cluster API DEMO
47. Building blocks Cloud agnostic Experimental Takeaways
48. Vertical Pod Autoscaler Federation v2 Cluster API
49. References VPA • https://github.com/kubernetes/autoscaler/ tree/master/vertical-pod-autoscaler Federation v2 • https://github.com/kubernetes-sigs/federati on-v2 ClusterAPI • https://github.com/kubernetes-sigs/cluster- api-provider-aws
50. https://www.condenastinternational.com/careers @k_gamanji katie-gamanji