scaler says >0 replicas. = hold inbound request until scaler says >0 replicas. forward = attempt connection and forward HTTP request. = attempt connection and forward HTTP request. Use inbound http.Request.Context() for everything in the proxy
Applicable even outside Kubernetes. Keep proxy as stateless as possible. Keep proxy as stateless as possible. Minimize and simplify RPC calls. Minimize and simplify RPC calls.