Kubernetes in Adform

Talk about Kubernetes in Adform on bare metal.

Transcript

1. Kubernetes in Adform Edgaras Apšega Technical Product Manager @apsega 1
2. Agenda • About Adform • Kubernetes clusters and architecture • Monitoring • Deployment workflow • Self-service for developers • Live Demo (hopefully someone made some donations to the demo gods) 2
4. Why Containers and Kubernetes? 4 Build locally – run anywhere • Dependencies packaged inside a container image • Consistent software version and assets • Declarative Configuration Immutable Infrastructure • No user modifications • Quick rollbacks • Self-healing systems Workflow • Efficiency • Scalability • No VM maintenance (OS, security updates, etc.)
5. Kubernetes Clusters 5 Sandbox • Fully virtualized, running on OpenStack • Test object for new features • 3 VMs for etcd • 3 VMs for control plane • 3 VMs as nodes Development • 2 clusters • 10 physical machines • 3 VMs for etcd • 3 VMs for control plane • 1000+ containers • 25 CPU cores used Staging • 6 physical machines • 3 VMs for etcd • 3 VMs for control plane • 400+ containers Production • Multi AZ • 17 physical machines • 550+ cores • 5 VMs for etcd • 3 VMs for control plane • + 3 planned remote clusters • 700+ containers
6. Having big clusters 6
7. Exposing service on Bare Metal 7
8. Exposing service on Bare Metal (2) 8
9. Kubernetes architecture 9
10. Kubernetes architecture 10
11. Kubernetes architecture 11
12. Technologies around Kubernetes 12
13. Monitoring 13
14. Self-Service Portal 17
15. Deployment workflow 18
17. @apsega 2