Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Node.js Scalability Myth

23968f0ca75b13463d2db5343e5c2096?s=47 Felix Geisendörfer
June 16, 2012
Programming
6
1.2k

The Node.js Scalability Myth

Talk given at the Munich Node.js Meetup on 14.06.2012.

23968f0ca75b13463d2db5343e5c2096?s=128

Felix Geisendörfer

June 16, 2012
Tweet

More Decks by Felix Geisendörfer

See All by Felix Geisendörfer
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
2
600
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
2
750
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
370
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
1
470
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
1
1k
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
340
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
1
400
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
340
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
270

Other Decks in Programming

See All in Programming
E10ba38646a905c8cd2c893c84d5c520?s=48 suzushin54
0
280
4a0e3afe85259f2973dbc9386b6a4bb3?s=48 ikumatadokoro
3
160
Af64bc38c0ffcfcabdf430759ee491ce?s=48 lovee
4
220
6aaaf03c4f5c681d89c3078bd6070a6f?s=48 rumi_yamaguchi
0
310
8ec2b967e38f000eb63ae345cd7c58e6?s=48 minodriven
5
5.2k
E35f18d9e5584b48a7cf5550f905522f?s=48 zntfdr
1
290
80a3a3857a55f154d23acb705eff72cc?s=48 star_zero
3
760
20ddbe9b7cfdde5e2dfeb8d8714d5de8?s=48 tarugoconf
0
1.7k
1bfc6e2ed04a895bb36f36b86828b689?s=48 110y
0
120
4a0e3afe85259f2973dbc9386b6a4bb3?s=48 ikumatadokoro
2
260
3799f16d41d627cf75b984212844c7ed?s=48 ryamakuchi
1
270
B546a9b97d993392e4b22b74b99b91fe?s=48 javiergs
PRO
0
110

Featured

See All Featured
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
71
3.2k
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
267
11k
828ace851b606e1206900f26459f55ad?s=48 speakerdeck
PRO
2
570
C7393b7ba7ec9c8890dd77d209fbb3c9?s=48 maltzj
505
37k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
PRO
324
54k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
277
17k
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
225
15k
Af6a12710770ad9a7cfd08c97efd40d3?s=48 pedronauck
656
120k
Ecdea9b9714877b86cee08458f085481?s=48 trallard
27
1.3k
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
25
990
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
56
5.8k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
PRO
55
5k

Transcript

  1. The Node.js Scalability Myth Felix Geisendörfer 14.06.2012 at Munich node.js

    user group
  2. None

  3. Felix Geisendörfer

  4. transloadit.com

  5. core contributor

  6. npm modules

  7. node-formidable

  8. node-mysql

  9. ~50 modules total

  10. (@)felixge(.de)

  11. Background

  12. I need to build an über-scalable web service. It will

    be the next big thing!

  13. Easy! I will use node.js and MongoDB!

  14. Easy! I will use node.js and MongoDB!

  15. Because node.js is “scalable”, right?

  16. None

  17. This Talk

  18. #1 Consider Reality

  19. Using node for performance reasons?

  20. Measuring performance in production?

  21. 1000 req / s

  22. 100 req / s

  23. 10 req / s 10 req / s

  24. ~1 million requests per day

  25. ~1 million units of value

  26. None

  27. #2 Node Scales Vertically

  28. Adding more resources to a single node

  29. None

  30. CPU

  31. Google V8

  32. JS -> Assembly

  33. Crankshaft JIT

  34. Fast

  35. Single Threaded* * For most parts

  36. Computers of the future will have hundreds of cores!

  37. Node’s Multi-Core Story

  38. Pre-fork

  39. IPC

  40. Like Ruby, Python, PHP, etc.

  41. But ... shared memory?

  42. Your problem requires shared memory?

  43. JavaScript is not your language

  44. Good Luck

  45. Memory

  46. No hard limit on 64bit (since node-0.6 / v8-3.7)

  47. However

  48. Avoid huge heaps

  49. Disk

  50. Done in thread pool

  51. Along with DNS

  52. No sendfile()

  53. None

  54. Network

  55. None

  56. Non-blocking I/O

  57. tl;dr

  58. pre-fork & non-blocking i/o

  59. #3 Horizontal Scaling is hard

  60. CAP

  61. Network Partitions

  62. Consistency

  63. Availability

  64. Some Tips

  65. Shared Nothing

  66. Messaging

  67. Monitoring

  68. The Node.js Scalability Myth

  69. Threads do not scale Node.js scales

  70. Threads do not scale Node.js scales

  71. Node is a tool

  72. None
  73. None
  74. None

  75. If you can’t duc it F#@k it

  76. Questions? Slides will be available at felixge.de

  77. Thanks

  78. Tool Demo