Everyday tools and tricks for scaling Node.js

In order to understand how to scale Node.js you need to know how the internals work together and what type of problems are best suited for it. With the right combination of tools you can easily have a scalable and reliable Node.js cluster.

Transcript

1. Everyday tools and tricks for scaling Node.js @stoitsev
5. v8
6. v8 libuv
7. v8 Event queue libuv
8. v8 Event queue libuv
9. v8 Event queue libuv
10. v8 Event queue libuv
11. v8 Event queue libuv
12. 1. Know v8
13. Crankshaft
14. TurboFan
15. 2. Scale for the right problem
16. CPU intensive
18. Apache Kafka https://kafka.apache.org/
19. I/O intensive
20. Scaling
23. Vertical scaling
24. Cluster mode
25. Core 1 Core 2 Core 3 Core 4 CPU
26. Master process Node.js Instance Node.js Instance Node.js Instance Cluster mode
29. Horizontal scaling
30. Node.js app
31. Components Cities Users Payments Products Trips Receipts
32. Example
35. Services Cities Users Payments Products Trips Receipts
36. Node.js
37. Node.js HTTPS HTTPS HTTPS HTTPS
38. Node.js HAProxy HAProxy
39. https://expressjs.com/en/guide/behind-proxies.html
40. Configuration X-Forwarded-Host X-Forwarded-Proto
41. Scaling websockets?
42. Scaling AMQP?
43. Protocol is just an abstraction
44. Reverse proxy does it for you
45. https://www.nginx.com/blog/nginx-nodejs-websockets-socketio/
46. Deployment?
48. https://nodejs.org/en/docs/guides/nodejs-docker-webapp/
50. $ docker build
51. $ docker build $ docker push Repository
52. Zero downtime deployment
53. Node.js HAProxy HAProxy
54. Old HAProxy New
55. Old HAProxy New
56. Old HAProxy New
57. Stateless services
58. Universal rendering
59. MVC
60. MVCS
61. Service layer
62. Controller Mapper Service Entities External Services Database
63. https://martinfowler.com/eaaCatalog/serviceLayer.html
64. NoSQL databases
65. 2 phase commit
66. https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
67. Distributed system
68. Service discovery
69. Hyperbahn https://github.com/uber/hyperbahn
70. Node.js App Node.js App Node.js App Node.js App
71. Etcd https://github.com/coreos/etcd
72. Consistent between node failures
73. Partition tolerance
74. node-etcd https://www.npmjs.com/package/node-etcd
81. etcd etcd
82. Distributed locking
83. Leader election
84. Idempotency
85. Thanks