Higher-Order Deployments: Reducing Boilerplate With Kubernetes Custom Resource Definitions

Custom Resource Definitions (CRDs) with associated Controllers can provide a more powerful alternative to templating YAML manifests in Kubernetes. This talk will cover how we use CRDs and Controllers at Manifold to define higher-order composite Kubernetes resources for our deployments at Manifold. These CRDs combine the definition of Deployments, Services, and Ingresses into a single resource that is continually reconciled by Kubernetes, preventing accidental deletion or modification of one of the components. With the associated Controllers, we are able to define new styles of deployment rollouts, and trigger automatic deployments when secrets or container images change, based on definable policies.

Transcript

1. Higher-Order Deployments Reducing Boilerplate With Kubernetes Custom Resource Definitions @jrbowes May 3, 2018
2. https://www.manifold.co YES, WE ARE HIRING SIGN UP TODAY
3. Photo by Caleb Jones on Unsplash
4. Photo by Tyler Milligan on Unsplash
5. Photo by Connor Betts on Unsplash @jrbowes
6. Photo by Connor Betts on Unsplash @jrbowes
7. Photo by chuttersnap on Unsplash @jrbowes
8. Photo by Etienne Pauthenet on Unsplash
9. By Frank Vincentz (Own work) GFDL via Wikimedia Commons
10. Photo by Lauren Lester on Unsplash apiVersion: extensions/v1beta1 kind: Deployment metadata: name: worker spec: replicas: 2 strategy: Photo by Lauren Lester on Unsplash
11. Y Photo by Mariam Soliman on Unsplash @jrbowes
12. Photo by Alexandru Tugui on Unsplash @jrbowes
13. Photo by Alexandru Tugui on Unsplash @jrbowes
14. @jrbowes
15. @jrbowes
16. @jrbowes
17. Kubernetes is Composition @jrbowes
18. Kubernetes is a Database @jrbowes
19. Photo by Wine Dharma on Unsplash • 1 Custom Resource Definition • 1 Controller • Admission Controllers to taste @jrbowes
20. apiVersion: apiextensions.k8s.io/v1beta1 kind: CustomResourceDefinition metadata: name: applications.manifold.co spec: group: stable.manifold.co version: v1 scope: Namespaced names: plural: applications singular: application kind: Application @jrbowes
21. validation: openAPIV3Schema: properties: spec: properties: replicas: type: integer minimum: 2 image: type: string @jrbowes
22. @jrbowes
23. Start with Metacontroller @jrbowes
24. @jrbowes
25. Why?
26. @jrbowes
27. @jrbowes
28. @jrbowes
29. - name: Create my app's deployment k8s_raw: state: present definition: apiVersion: extensions/v1beta1 kind: Deployment metadata: name: my-app spec: replicas: 2 @jrbowes
30. - name: Create all of my app k8s_raw: state: present definition: apiVersion: manifold.co/v1 kind: Application metadata: name: my-app spec: external: true @jrbowes
31. Build your own Operators
32. Photo by Matthew Hamilton on Unsplash CRDs are new & incomplete No multi-version support yet @jrbowes
33. Photo by Matthew Hamilton on Unsplash Many moving parts Definition, controller, webhooks @jrbowes
34. Photo by Matthew Hamilton on Unsplash Attempts to simplify are still early • Metacontroller • Kubekit • operator-sdk • Your cool project? @jrbowes
36. Thank you! @jrbowes April 18, 2018