Service Mesh for your Service Mess

Building microservices is easy, operating a microservice architecture is hard. Many companies are successfully using tools like Kubernetes for deploys, but they still face runtime challenges when they have to perform routing, monitoring or security. Having a mess of tens, hundreds or even thousands of services comunicating in production is a job only for the very tough ones... Service Mesh is an architecural pattern that comes to solve these problems with a simple, clean approach.

By deploying sidecar proxies and other control elements interconecting your services, a Service Mesh creates a network abstraction that greatly simplifies the managing of containerized applications and makes it easier to dynamically route, monitor and secure microservice-based applications. In this talk we are going to explain this pattern and how to deploy it by walking through some of the top capabilities a Service Mesh allows, like:

Dynamic Intelligent Requests Routing

Transparent Distributed Tracing

Traffic monitoring (observability)

Security (authentication+encryption)

Policy Enforcements (Rate Limits)

Load Balancing and Circuit Breaking

Transcript

1. Service Mesh for your Service Mess
2. HELLO! I am Fernando Llaca @Nandollaca Site Reliability Engineer at
4. Some people... @NandoLlaca
5. Some people... @NandoLlaca
6. Some people... @NandoLlaca
7. Some people... @NandoLlaca
9. MicroService Mess @NandoLlaca
11. Routing
12. Offers MicroService Mess Sales Orders Users Products @NandoLlaca
13. Offers Sales Orders Users Products V1 MicroService Mess @NandoLlaca Products V2
14. MicroService Mess @NandoLlaca Offers Sales Orders Users Products V1 Products V2 90 % 10 %
15. MicroService Mess @NandoLlaca Offers Sales Orders Users Products V1 Products V2 90 % 10 %
16. MicroService Mess @NandoLlaca Offers Sales Orders Users Products V1 Products V2 90 % 10 %
17. MicroService Mess @NandoLlaca Offers Sales Orders Users Products V1 Products V2 User: * user: (.+)@mycorp.com
18. • Load Balancing • Circuit Breaking MicroService Mess @NandoLlaca Offers Sales Orders Users Products
20. Observability
21. • 5XX errors? • Timeouts? • Tracing? MicroService Mess - Monitoring @NandoLlaca Sales Orders Users Products
22. MicroService Mess - Monitoring @NandoLlaca
23. MicroService Mess - Monitoring @NandoLlaca $ telnet products 80
24. MicroService Mess - Monitoring @NandoLlaca $ dig whatthef $ telnet products 80
25. MicroService Mess - Monitoring @NandoLlaca $ curl -H “Host: madafaka” http:/offers/ $ dig whatthef $ telnet products 80
26. MicroService Mess - Monitoring @NandoLlaca
28. Security
29. TLS TLS TLS TLS • Authentication • Authorization MicroService Mess - Security @NandoLlaca Offers Sales Orders Users Products TLS
30. : grumpy human MicroService Mess @NandoLlaca Offers Sales Orders Users Products
31. : grumpy human MicroService Mess @NandoLlaca Offers Sales Orders Users Products
32. : grumpy human MicroService Mess @NandoLlaca Offers Sales Orders Users Products
33. : grumpy human MicroService Mess @NandoLlaca Offers Sales Orders Users Products
34. : grumpy human MicroService Mess @NandoLlaca Offers Sales Orders Users Products
35. : fucked up human MicroService Mess @NandoLlaca Offers Sales Orders Users Products
36. Service Mesh
37. Service Mesh Make your microservices great again!
38. Sales Orders Offers Products Users Service Mess Mesh @NandoLlaca
39. P Sales P Orders P Offers P Products P Users @NandoLlaca Service Mesh
40. P Sales P Orders P Offers P Products P Users @NandoLlaca Service Mesh
41. P Sales P Orders P Offers P Products P Users Control Plane @NandoLlaca Service Mesh
42. P Sales P Orders P Offers P Products P Users Control Plane @NandoLlaca Not so grumpy human Service Mesh
43. P P P P P Control Plane @NandoLlaca Service Mesh
44. P P P P P Control Plane @NandoLlaca Data Plane Service Mesh
45. P P P P P Control Plane Service Mesh @NandoLlaca Control Plane
46. P Offers Control Plane P Products V1 P Products V2 @NandoLlaca Data Plane - LB
47. Offers Control Plane P Products V1 P Products V2 Data Plane - LB @NandoLlaca GET http://products/
48. Offers Control Plane P Products V1 P Products V2 Data Plane - LB @NandoLlaca GET http://products/
49. Offers Control Plane P Products V1 P Products V2 Data Plane - LB @NandoLlaca Header(user): any GET http://products/
50. Offers Control Plane P Products V1 P Products V2 GET http://products/ Data Plane - LB @NandoLlaca Header(user): any Header(user): (.+)@mycorp.com
51. Offers Control Plane P Products V1 P Products V2 JAEGER Metrics Traces Data Plane - Monitoring @NandoLlaca
52. Sales Orders Offers Products Users Metrics Traces @NandoLlaca
53. Host A Sidecar Proxy Offers Host B Sidecar Proxy Products Encrypted Unencrypted Unencrypted Data Plane - Security @NandoLlaca TLS
54. • Routing • Load Balancing • Service Discovery • Authentication & Authorization • Observability (metrics + tracing) • The human • Configuration UI • Call to sidecar Proxy Configuration APIs Data Plane vs Control Plane Data Plane: Control Plane: @NandoLlaca
55. Bonus: deploy - proxy per service @NandoLlaca P Sales P Orders P Offers P Products P Users Control Plane
56. P Sales P Orders Offers P Users Control Plane Products Bonus: deploy - proxy per host @NandoLlaca
57. Conduit Bonus: some products over there Linkerd + Namerd EnvoyProxy Istio @NandoLlaca
58. THANKS! Any questions? You can find me at @NandoLlaca / fllaca@tuenti.com