Kubernetes

 Kubernetes

Hootsuite's journey to a production grade cluster.

We will go through an example setup for a Kubernetes cluster that scales for ~100s of nodes and then extend that to a cluster for ~1000s of nodes.

We will explore the challenges that Hootsuite has had with running and maintaining Kubernetes in AWS.

26896287bc831a13e768cea7efe29632?s=128

Anubhav Mishra

July 06, 2017
Tweet

Transcript

  1. 1.

    Anubhav Mishra Senior Developer - Production Operations and Delivery @anubhavm

    Hootsuite’s Journey to a Production Grade Cluster Kubernetes
  2. 2.
  3. 9.
  4. 10.

    API

  5. 18.
  6. 21.
  7. 22.
  8. 23.
  9. 24.
  10. 25.
  11. 26.
  12. 27.
  13. 28.
  14. 30.
  15. 31.
  16. 32.
  17. 33.

    Advantages • Using layer 3 (AWS Routing Table) • Simpler

    implementation Limitations • Routing table (50 entries max) = 50 nodes • Complex orchestration*
  18. 34.

    Our Production Criteria • ~1000s of nodes / cluster •

    Operationally friendly • Highly available • Easily reproducible ◦ Multi region ◦ Multiple clusters / environment • Secure
  19. 35.

    Our Production Criteria • ~1000s of nodes / cluster •

    Operationally friendly • Highly available • Easily reproducible ◦ Multi region ◦ Multiple clusters / environment • Secure
  20. 40.

    Our Production Criteria • ~1000s of nodes / cluster •

    Operationally friendly • Highly available • Easily reproducible ◦ Multi region ◦ Multiple clusters / environment • Secure
  21. 41.

    Our Production Criteria • ~1000s of nodes / cluster •

    Operationally friendly • Highly available • Easily reproducible ◦ Multi region ◦ Multiple clusters / environment • Secure
  22. 43.
  23. 44.
  24. 45.
  25. 46.
  26. 47.
  27. 49.
  28. 50.
  29. 52.

    kops (Kubernetes Operations) • Easy to get a production grade

    cluster • Create/Upgrade/Delete a cluster • Reconfigure the cluster components • Manage multiple clusters • Export terraform
  30. 54.

    Yay! We made it through. Yes! We are hiring :D

    Senior Developer - Production Operations and Delivery @anubhavm Anubhav Mishra