Building an Autoscaling HTTP Proxy for Kubernetes - Aaron Schlesinger

Transcript

1. HTTP Proxies on Kubernetes HTTP Proxies on Kubernetes Aaron Schlesinger, Microsoft Aaron Schlesinger, Microsoft @arschles
2. Origin Origin The application. Proxy Proxy The ingress. Scaler Scaler The background controller.
3. The Origin The Origin Not in a “stable” location. Not in a “stable” location. Often stateless. Often stateless. Controlled by other software. Controlled by other software.
4. The Scaler The Scaler Adds/removes origin replicas automatically. Adds/removes origin replicas automatically. Communicates with proxy. Communicates with proxy.
5. The Proxy The Proxy Stateless Stateless Acts on (1) incoming requests and (2) scaler changes Acts on (1) incoming requests and (2) scaler changes Handles origin faults Handles origin faults
6. Proxy Patterns Proxy Patterns wait = hold inbound request until scaler says >0 replicas. = hold inbound request until scaler says >0 replicas. forward = attempt connection and forward HTTP request. = attempt connection and forward HTTP request. Use inbound http.Request.Context() for everything in the proxy
7. Code Code bit.ly/gcru21
8. Building Your Own Building Your Own Applicable even outside Kubernetes. Applicable even outside Kubernetes. Keep proxy as stateless as possible. Keep proxy as stateless as possible. Minimize and simplify RPC calls. Minimize and simplify RPC calls.
9. Thank You & Q/A Thank You & Q/A bit.ly/gcru21 twitter.com/arschles twitch.tv/arschles github.com/arschles