Intro to Tracing and Jaeger

Transcript

1. Annanay Agarwal, Software developer
2. https://llvm.org https://jaegertracing.io. https://opentelemetry.io, Bohemian Rhapsody
3. Simon Sinek: How great leaders inspire action | TED Talk
5. https://rancher.com/blog/2019/microservices-vs-monolithic-architectures
6. Img src: Link
7. Img src: Link • Shorter development cycles • Components could be written in different languages • Scale independently • Easy to operate & observe • ...
8. Img src: Link • Shorter development cycles • Components could be written in different languages • Scale independently • Easy to operate & observe • ...
9. Would You Like Some Tracing With Your Monitoring? - Yuri Shkuro, Uber Technologies - KCCNA 2017
10. Images: Prometheus, Fluentd, Elastic, InfluxData Monitoring tools Logs Metrics
11. https://grafana.com/blog/2018/08/02/the-red-method-how-to-instrument-your-services/ RED Method Requests Error Duration USE Method Utilization Saturation Errors …. Metrics - Aggregatable
12. https://grafana.com/docs/grafana/latest/alerting/notifications/ https://www.pagerduty.com/blog/mobile-updates-2018/ SLAs / SLOs Metrics - Alerting
13. http_request_duration_sec{“app=ice-cream-shop”} 10s Metrics - Cardinality
14. http_request_duration_sec{“app=ice-cream-shop” datacenter=”us-central”, env=”production”, service=”cart-manager”, path=”/api/order”, func_name=”my-func”, cust_name=”annanay”} 10s Metrics - Cardinality
15. Img src: https://www.dictionary.com/e/emoji/heavy-dollar-sign-emoji/ http_request_duration_sec{“app=ice-cream-shop” datacenter=”us-central”, env=”production”, service=”cart-manager”, path=”/api/order”, func_name=”my-func”, cust_name=”annanay”} 10s Metrics - Cardinality
16. Logs
17. Useful to check health of a particular service. “Events” in a service. "rpc error: code = Code(400) desc = user = xyz: series={__name__=\"process_virtual_memory_bytes\", cluster=\"us-central\", instance=\"consul-5sqwxccxvq\", timestamp=2020-01-04T14:12:59.102Z: out of order sample}" . . level=error ts=2020-05-08T09:46:43.11193994Z caller=a_file_from_my_codebase:16 msg="error processing requests" err="rpc error: Code(400) desc = expected string but got null" Logs
18. TLDR; Telemetry Primary use case What we want in addition Metrics Aggregations Fine grained information Logs Events “Stack-trace” debugging
19. Need fine grained information like function level latency, and stack trace debuggability.
21. https://www.jaegertracing.io/docs/1.17/architecture/ Context propagation
22. Inspired from - Would You Like Some Tracing With Your Monitoring? - Yuri Shkuro, Uber Technologies - KCCNA 2017
23. Src: HBO.
24. https://peter.bourgon.org/blog/2017/02/21/metrics-tracing-and-logging.html
25. https://www.jaegertracing.io/docs/1.17/architecture/ Jaeger - Architecture
26. https://www.pngkey.com/maxpic/u2q8i1y3e6y3r5e6/
27. https://www.iconfinder.com/icons/564851/alert_danger_error_exclamation_mark_mark_problem_warning_icon Data volume
28. Data volume
29. https://grafana.com/blog/2020/06/18/how-grafana-labs-enables-horizontally-scalable-tail-sampling-in-the-opentelemetry-collector/ Tail sampling
30. https://grafana.com/blog/2019/09/11/the-future-of-grafanas-ui/ Exemplars
31. Deep Linking Metrics and Traces with OpenTelemetry, OpenMetrics and M3 - Rob Skillington Exemplars
32. https://github.com/grafana/grafana/issues?q=label%3Aarea%2Ftracing Grafana Trace Viewer
34. Jaeger - CNCF Graduated project
35. Reach out! - https://gitter.im/jaegertracing/Lobby - https://github.com/jaegertracing/jaeger/labels/good%20first%20 issue
36. @annanay25 Questions? @mrannanay