Tracing Node.js - The Open Source Edition

Node alone doesn’t guarantee flawless code execution with stellar performance and finding problems in distributed systems is hard.

Tracing gives you both visibility into distributed code execution and the data you need to optimize performance and remove flaws in your code.

This deck covers

- the key performance metrics and how to collect them from Node.js
- challenges of asynchronous tracing and content propagation
- the different Open Source approaches and their use cases
- an end-to-end live sample that shows you how to get started with tracing your apps today

Transcript

1. Daniel Khan / @dkhan Let’s talk about Node.js
2. Daniel Khan / @dkhan … and Monitoring
3. Daniel Khan / @dkhan Daniel Khan
 @dkhan
4. Daniel Khan / @dkhan COP$ 36,180,270.72
5. Daniel Khan / @dkhan
6. Daniel Khan / @dkhan
7. Daniel Khan / @dkhan http://roundtripticket.me/austria-on-world-map.html
8. Daniel Khan / @dkhan https://laprensasa.com/culture/art-music/mozart-festival-texas-returns-uiw/
9. Daniel Khan / @dkhan
10. Daniel Khan / @dkhan
11. Daniel Khan / @dkhan TMN
12. Daniel Khan / @dkhan
13. Daniel Khan / @dkhan vote.demo.khan.io
14. Daniel Khan / @dkhan
15. Daniel Khan / @dkhan
16. Daniel Khan / @dkhan
17. Daniel Khan / @dkhan
18. Daniel Khan / @dkhan
19. Daniel Khan / @dkhan
20. Daniel Khan / @dkhan
21. Daniel Khan / @dkhan Try out Dynatrace for free
 dynatrace.com/trial
22. Daniel Khan / @dkhan
23. Daniel Khan / @dkhan
24. Daniel Khan / @dkhan Collecting Metrics
25. Daniel Khan / @dkhan
26. Daniel Khan / @dkhan
27. Daniel Khan / @dkhan
28. Daniel Khan / @dkhan Metrics Collection Pipeline Metrics Agent StatsD
 
 appmetrics-statsd
 express-statsd Timeseries DB Aggregated Metrics InfluxDB Dashboarding Query Grafana Metrics Collector Metrics Telegraf (UDP)
29. Daniel Khan / @dkhan vote.demo.khan.io/metrics User: test
 Password: test
30. Daniel Khan / @dkhan Key Metrics of Node.js
31. Daniel Khan / @dkhan HTTP Request HTTP Response (e.g. res.send()) Δ Response Time
32. Daniel Khan / @dkhan Event Loop Latency How long does a callback wait to be executed. setTimeout(foo, 1000) 0 1000 Latency Execution
33. Daniel Khan / @dkhan Heap Usage How much memory does my application consume over time Code Segment Heap Reserved Heap Used Resident Set
34. Daniel Khan / @dkhan GC Duration How often and how long does the Garbage Collector run
35. Daniel Khan / @dkhan CPU Usage How much time does my application consume System Process
36. Daniel Khan / @dkhan Memory Usage GC Duration Event Loop Latency Response Time Number of Requests CPU Usage 1 2 3 4 5
37. Daniel Khan / @dkhan Memory Usage GC Duration Event Loop Latency Response Time Number of Requests CPU Usage
38. Daniel Khan / @dkhan
39. Daniel Khan / @dkhan
40. Daniel Khan / @dkhan
41. Daniel Khan / @dkhan Incoming Request ☠
42. Daniel Khan / @dkhan Collecting Traces
43. Daniel Khan / @dkhan Tracing Transactions Span A Span B Span G Trace Span C Span D Span E Span F Trace Context: Trace ID, Parent ID, Span ID Metadata: HTTP Status Code, Response Time, … Trace Context Trace Context Trace Context Trace Context Trace Context ☠
44. Daniel Khan / @dkhan
45. Daniel Khan / @dkhan Node.js Context Propagation HTTP Request http.get Context? HTTP Request HTTP Request mongoose.find callback(err, res) http.get callback Global context Global context Global context
46. Daniel Khan / @dkhan
47. Daniel Khan / @dkhan
48. Daniel Khan / @dkhan CNCF project driven by LightStep Defines an API / Interface No UI / Backend
49. Daniel Khan / @dkhan
50. Daniel Khan / @dkhan Open Source driven by Google Provides Full Instrumentation Exporters to various UI / Backends
51. Daniel Khan / @dkhan
52. Daniel Khan / @dkhan Open Source based out of Twitter Provides Full Instrumentation Provides UI
53. Daniel Khan / @dkhan Open Source by Uber Provides a full backend and UI Can ingest von various sources Provides generic client libraries based on OpenTracing
54. Confidential confidential 54 Exporter Ingest Binding Display OpenTracing OpenCensus Zipkin Tracer Header B3 B3 (TraceContext) (TraceContext) SpanContext B3
55. Daniel Khan / @dkhan
56. Daniel Khan / @dkhan
57. Daniel Khan / @dkhan
58. Daniel Khan / @dkhan Traces and Spans Ingest Process Store Agent
59. Daniel Khan / @dkhan vote.demo.khan.io/traces
60. Daniel Khan / @dkhan
61. Daniel Khan / @dkhan
62. Daniel Khan / @dkhan
63. Daniel Khan / @dkhan
64. Daniel Khan / @dkhan
65. Daniel Khan / @dkhan Tabs or Spaces?
66. Daniel Khan / @dkhan
67. Daniel Khan / @dkhan
68. Daniel Khan / @dkhan gist.github.com/danielkhan
69. Daniel Khan / @dkhan vote.demo.khan.io/metrics vote.demo.khan.io/traces User: test
 Password: test
70. Daniel Khan / @dkhan @dkhan ¡Hasta la vista ,❤! Try out Dynatrace for free
 dynatrace.com/trial