Node.js Interactive Europe 2016: Tracing and instrumentation in Node.js

This talk is a head first dive into the next-gen core tracing API’s being developed under the Node.js Tracing Working Group. We’ll learn about the upcoming AsyncWrap API and how this can be used to build your own high level instrumentation logic in production.

Transcript

1. Thomas Watson @wa7son github.com/watson
2. @wa7son
3. @wa7son
4. Tracing in Node.js Instrumentation and @wa7son
5. HTTP Request lifetime Incoming Request Response @wa7son
6. HTTP Request lifetime Transaction Incoming Request Response @wa7son
7. HTTP Request lifetime Transaction Incoming Request Response @wa7son
8. HTTP Request lifetime Transaction Incoming Request Response @wa7son
9. HTTP Request lifetime Transaction Incoming Request Response @wa7son
10. HTTP Request lifetime Traces Transaction Incoming Request Response @wa7son
11. HTTP Request lifetime BOOM! Traces Transaction Incoming Request Response @wa7son
12. nodejsreactions.tumblr.com The Event Loop @wa7son
13. The Event Loop Node.js process Processing an HTTP request @wa7son
14. The Event Loop Node.js process Synchronous code @wa7son
15. The Event Loop Node.js process @wa7son Another HTTP request
16. @wa7son
17. Request Lifecycle global.currentRequest == Req #1 @wa7son
18. @wa7son global.currentRequest == Req #1 Request Lifecycle global.currentRequest == Req #2
19. @wa7son global.currentRequest == Req #1 Request Lifecycle global.currentRequest == Req #2
20. @wa7son global.currentRequest == Req #1 Request Lifecycle global.currentRequest == Req #2
21. @wa7son global.currentRequest == Req #1 Request Lifecycle global.currentRequest == Req #2
22. @wa7son
23. @wa7son
24. @wa7son
25. @wa7son
26. @wa7son
27. @wa7son
28. @wa7son
29. @wa7son
30. @wa7son
31. @wa7son
32. @wa7son
33. @wa7son
34. Patch the world • Patch every async operation in core • timers • process.nextTick • Promise (native) • libuv • Patch certain 3rd party modules @wa7son
35. AsyncWrap https://github.com/nodejs/diagnostics @wa7son
36. AsyncWrap https://github.com/nodejs/diagnostics @wa7son
37. AsyncWrap https://github.com/nodejs/diagnostics @wa7son
38. AsyncWrap https://github.com/nodejs/diagnostics @wa7son
39. AsyncWrap https://github.com/nodejs/diagnostics @wa7son Hooks
40. @wa7son
41. @wa7son
42. @wa7son
43. @wa7son
44. @wa7son
45. user: before async_hooks: init user: after async_hooks: pre user: done async_hooks: post async_hooks: destroy @wa7son
46. @wa7son
47. FATAL ERROR: node::AsyncWrap::AsyncWrap init hook threw @wa7son
48. @wa7son
49. @wa7son
50. user: before async_hooks: init user: after async_hooks: pre user: done async_hooks: post async_hooks: destroy @wa7son
51. @wa7son
52. > var asyncWrap = process.binding('async_wrap') undefined > asyncWrap.Providers { NONE: 0, CRYPTO: 1, FSEVENTWRAP: 2, FSREQWRAP: 3, GETADDRINFOREQWRAP: 4, GETNAMEINFOREQWRAP: 5, HTTPPARSER: 6, JSSTREAM: 7, PIPEWRAP: 8, PIPECONNECTWRAP: 9, PROCESSWRAP: 10, QUERYWRAP: 11, SHUTDOWNWRAP: 12, SIGNALWRAP: 13, STATWATCHER: 14, TCPWRAP: 15, TCPCONNECTWRAP: 16, TIMERWRAP: 17, TLSWRAP: 18, TTYWRAP: 19, UDPWRAP: 20, UDPSENDWRAP: 21, WRITEWRAP: 22, ZLIB: 23 } @wa7son
53. @wa7son
54. Handle Objects Node Core Userland libuv V8 JavaScript C / C++ @wa7son
55. Handle Objects net.connect @wa7son
56. Handle Objects net.connect Handle objects @wa7son
57. Handle Objects net.connect req === this socket === this @wa7son
58. Timers @wa7son
59. Timers user: before #1 async_hooks: init user: after #1 user: before #2 user: after #2 @wa7son
60. Timers user: before #1 async_hooks: init user: after #1 user: before #2 user: after #2 async_hooks: pre user: done #1 user: done #2 async_hooks: post async_hooks: destroy @wa7son
61. @wa7son Real World Example
62. @wa7son
63. @wa7son
64. @wa7son
65. @wa7son
66. @wa7son
67. @wa7son
68. @wa7son
69. @wa7son
70. @wa7son
71. AsyncHooks Gotchas • Handle creation time • console.log • (process.nextTick) • Timers • Promises • Multiple AsyncHooks @wa7son
72. Callback queues in user-land @wa7son
73. ES Modules @wa7son
74. https://github.com/nodejs/node-eps/pull/18 @wa7son
75. https://github.com/nodejs/diagnostics @wa7son
76. https://github.com/nodejs/diagnostics/tree/master/tracing/AsyncWrap @wa7son
77. https://github.com/nodejs/diagnostics/issues/29 @wa7son
78. Dank je @wa7son github.com/watson