Navigating the service mesh ecosystem (webinar)

Slides from the Buoyant & RedHat joint webinar

Transcript

1. Navigating the service mesh ecosystem Joint webinar focused on Linkerd, Envoy, Istio, and Conduit March 7, 2018
2. Introductions Christian Posta Senior Principal Architect, Red Hat @christianposta George Miranda Director of Community, Buoyant @gmiranda23
3. What is a service mesh?
4. Service mesh architecture
5. Data plane Control plane Policy Metrics UI
6. Service mesh architecture • Application infrastructure • Lives outside of the application • Application requests/messages flow through proxies • Applications may or may not be explicitly aware of these proxies • The proxies make up the “data plane” of a service mesh • Ability to understand what’s happening between our apps... HUGE!! • The “control plane” used to observe/configure/manage the behavior of data plane
7. A service mesh differs from • CORBA/RMI/DCOM/etc • Messaging Oriented Middleware • Enterprise Service Bus (ESB) • Enterprise Application Integration (EAI) • API Gateway • Resilience libraries
8. What questions should you be asking?
9. Am I ready for a service mesh?
10. Centralized or decentralized functionality?
11. What functionality do you already have?
12. What level of observability do your services have today?
13. What platforms do you need to support?
14. What problems are you having today?
15. What does the division of responsibility look like for your teams today?
16. What support expectations do you have or need?
17. A landscape of open-source service mesh options
19. Linkerd • Built on Twitter’s Finagle library (Scala) • First released Feb 2016 (2 years) • ~50 companies running in production • Multi-platform (Docker, K8s, DC/OS, Amazon ECS, and more) • Built-in service discovery, latency-aware load balancing, retries, circuit breaking, protocol upgrades (TLS by default), top-line metrics, distributed tracing, per request routing (useful for CI/CD, testing, and more) • Support for H2, gRPC, HTTP/1.x, and all tcp traffic • Handles tens of thousands of requests per second, per instance • http://linkerd.io
21. Envoy • https://www.envoyproxy.io • A service proxy for modern services architectures • Open sourced by (@mattklein123) and Lyft.com October 2016 • C++, highly performant, non-blocking architecture • Low tail latencies at scale/load (P99) • L3/4 filter at its core with many L7 filters out of the box • HTTP 2, gRPC support (upstream/downstream) • API-driven, dynamic configuration • Amenable to shared-proxy/sidecar-proxy deployment models • Foundation for more advanced application proxies
23. Istio • http://istio.io • Launched May 2017 bootstrapped with Lyft, IBM, Google • Provides a control plane for service proxies (default Envoy) • Brings clustering control and observability • Fine grained routing • mTLS/RBAC/security • Resiliency • Policy control • Observability
25. Conduit • Released December 2017 (current 0.3.0) • Data plane written in Rust, Control plane written in Go • Sub 1ms p99 latency, ~1MB footprint, designed for sidecar deployments • “Minimum viable service mesh” or a Zero Config philosophy • Supports gRPC, H2, HTTP1.x, and all tcp traffic out of the box • Performance based load-balancing • Export Prometheus metrics & Automatic TLS (0.4.0) • Controllable timeouts/deadlines, OpenTracing, & key rotation (0.5.0) • Rich ingress routing, auth policy, auto alerts & composable resiliency (0.6.0) • Late April 2018 ETA for 0.6 • https://conduit.io/roadmap/
26. Summary
27. Questions to ask yourself • Am I ready for a service mesh? • What problems am I having today? • What platforms do you need to support? • What level of observability do your services have today? • What functionalities of a service mesh do you already have? How will that play out in your when you introduce a service mesh? • What does the division of responsibility look like in your teams? • Centralized or decentralized functionality? • Support expectations and team needs?
28. Thank you! Q&A