Building a Platform Framework: Lessons Learned from Developing a Multi-Cluster Kubernetes Operator

Running multi-cluster Kubernetes environments introduces significant operational complexities that challenge even skilled engineering teams. In developing Kratix, an open source platform framework to manage these complexities, we encountered technical, organisational, and strategic challenges that reshaped our approach to building reliable, customer-centric software.

As founding engineer and product manager of Kratix, we have found that while technical expertise is crucial, it often falls short in solving complex, cross-cluster issues. We learnt the importance of diverse perspectives, customer involvement, and embracing existing CNCF projects.

By sharing our successes and setbacks, we aim to equip you with a holistic approach to managing multi-cluster Kubernetes environments, fostering resilience and adaptability in an evolving technological landscape.

Transcript

1. Building a Platform Framework Cat Morris & Jake Klein Lessons Learned from Developing a Multi-Cluster Kubernetes Operator
2. Cat Morris Product Manager Jake Klein Software Engineer
3. Short and stout. Fully sentient.
4. 😄
5. 🙂
6. Availability Zone 1 Availability Zone 2 😅
7. Region 1 Availability Zone 1 Availability Zone 2 Region 2 Availability Zone 3 Availability Zone 4 🤔
8. Azure AWS Region 1 Availability Zone 1 Availability Zone 2 Region 2 Availability Zone 3 Availability Zone 3 😥
9. Azure AWS Region 1 Availability Zone 1 Availability Zone 2 Region 2 Availability Zone 3 Availability Zone 3 On prem 😫
10. Azure AWS On prem Region 2 Region 1 😱
11. Hands up, who has felt this pain?
12. Some do’s and don’ts when building a Platform Framework
13. Don’t… Reinvent the wheel (use the ecosystem!)
15. A digital platform is a foundation of self-service APIs, tools, services, knowledge and support which are arranged as a compelling internal product. Evan Bottcher
16. GUI Platform Orchestrator App Orchestrator CI/CD system Infrastructure provisioning Infra as Code Container orchestration
17. But Do… Innovate on top of the wheel
19. Platform Orchestrator GUI App Orchestrator CI/CD system Infrastructure provisioning Infra as Code Container orchestration
20. Don’t… Underestimate the complexity of going multi cluster
45. Don’t… Underestimate the complexity of going multi cluster
46. But do… Reduce the complexity of things in your control
51. Don’t… Just build things you think will be great
53. Never listen to your users
54. Never listen to your users
55. Never listen to your users Do the fastest thing to unblock users
56. Never listen to your users Do the fastest thing to unblock users
58. Never listen to your users Prioritise user needs with your goals Do the fastest thing to unblock users
59. But Do… Remember why you started in the first place
61. Azure AWS On prem Region 2 Region 1 Unified Interface
62. Azure AWS On prem Region 2 Region 1 Unified Interface KRATIX
63. Azure AWS On prem Region 2 Region 1 Unified Interface KRATIX Other platform orchestrators are available!
64. Drum roll for the real biggest lesson learnt…
65. Never assume people actually know Kubernetes!
66. • Don’t reinvent the wheel • But Do innovate on top of the wheel
67. • Don’t reinvent the wheel • But Do innovate on top of the wheel • Don’t underestimate the complexity of going multi-cluster • But Do reduce the complexity of things in your control
68. • Don’t reinvent the wheel • But Do innovate on top of the wheel • Don’t underestimate the complexity of going multi-cluster • But Do reduce the complexity of things in your control • Don’t just build things you think will be great • But Do remember why you started building in the first place
69. • Don’t reinvent the wheel • But Do innovate on top of the wheel • Don’t underestimate the complexity of going multi-cluster • But Do something something something • Don’t just build things you think will be great • But Do remember why you started building in the first place AND NEVER assume people actually know kubernetes
70. Thank you! S641 Card games Demos