Improve Reliability of any Application using Kubernetes and Patterns

The sidecar pattern in Kubernetes allows you to add other functionality alongside an application for things like monitoring, TLS termination, circuit breaking etc. This talk will demonstrate how to easily improve the security and reliability of a service that you don’t have access to the code base.

Transcript

1. @OpsDavy Improve Reliability of any Application using Kubernetes Davy Jones
2. @OpsDavy Complexity
3. @OpsDavy Complexity Operations Domain Architecture
4. @OpsDavy
5. @OpsDavy
6. @OpsDavy
7. @OpsDavy
8. @OpsDavy
9. @OpsDavy Kubernetes Pod A Pod (as in a pod of whales or pea pod) is a group of one or more containers, with shared storage/network, and a specification for how to run the containers Container 1 Container 2 Pod A Container 1 Container 2 Pod B Container 1 Container 2 Pod C Service app=demo app=demo app=demo app=demo
10. @OpsDavy Kubernetes • Resource Requests and Limits • Liveness and Readiness Checks • Config Maps and Secrets • Services • Ingress
11. @OpsDavy
12. @OpsDavy Human Needs
13. @OpsDavy Reliability
14. @OpsDavy http://bit.ly/DavyGopherconUK
15. @OpsDavy A reliable service can: • be in a degraded state without affecting customer experience • be deployed regularly, without downtime, in isolation and in an automated way • scale elastically as demands change • be debugged easily Reliability
16. @OpsDavy Image source: https://www.deviantart.com/kirael-art/art/Go-lang-Mascot-458285682 S E R V I C E Ingress Controller Frontend SERVICE API
17. @OpsDavy • Sidecar • Adapter • Ambassador Patterns
18. @OpsDavy Proxy Sidecar API localhost S E R V I C E Frontend localhost Service Monitor Prometheus Operator Prometheus Server Grafana S E R V I C E Service Monitor
19. @OpsDavy Log Adapter API Log Log Adapter fluentd
20. @OpsDavy API Frontend Circuit Breaker Ambassador Breaker Ambassador S E R V I C E S E R V I C E
21. @OpsDavy Circuit Breaker
22. @OpsDavy App Proxy Sidecar Database Connection Ambassador Configuration Sidecar Database Configuration Service Another Application External Service Ambassador App Z Queue Worker Message Queue A Message Queue B Log Adapter fluentd
23. @OpsDavy Service Meshes
24. @OpsDavy Summary
25. @OpsDavy Thank you! Any questions? Slides http://bit.ly/DavyGopherconUK
26. @OpsDavy Links • Example Code • PagerDuty Incident Response Docs • Burns, Oppenheimer - Design patterns for container-based distributed systems • The SRE Book • Mikey Dickerson Velocity NY 2014 Keynote: "One Year After healthcare.gov..." • The RED Method - Weaveworks • Resilience Engineering Youtube Playlist • Release It! - Nygard • Database Reliability Engineering - Campbell, Majors
27. @OpsDavy Links • Thai Wood - Resilience Roundup • Mike Julian - Monitoring Weekly • Lex Neva - SRE Weekly • How Complex Systems Fail - Cook • The Infinite Hows - Allspaw • Istio • Linkerd • Prometheus