Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Node.js Scalability Myth

23968f0ca75b13463d2db5343e5c2096?s=47 Felix Geisendörfer
June 16, 2012
Programming
6
1.1k

The Node.js Scalability Myth

Talk given at the Munich Node.js Meetup on 14.06.2012.

23968f0ca75b13463d2db5343e5c2096?s=128

Felix Geisendörfer

June 16, 2012
Tweet

More Decks by Felix Geisendörfer

See All by Felix Geisendörfer
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
2
520
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
2
660
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
290
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
1
390
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
1
920
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
250
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
1
320
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
260
23968f0ca75b13463d2db5343e5c2096?s=48 felixge
0
200

Other Decks in Programming

See All in Programming
7eca3e06edc3c69004aaf57de51900c2?s=48 ajstarks
2
550
347a1b64f3a6e38981bc99b53919e2b1?s=48 azdaroth
0
100
E0e036f89c14b3e59640318eedf9670b?s=48 bkuhlmann
4
630
827dbd19908541482bac51ace8b86426?s=48 anchorcable
1
130
7975b9fd58c8945ae1c6b38747de7f28?s=48 line_developers_tw2
0
1.4k
6338c8fa4e2e6325094fe30b1e9f9443?s=48 malvinstn
1
670
De266761b955b2636e454a1bc7a99ed4?s=48 masayaaoyama
4
560
2102a6b8760bd6f57f672805723dd83a?s=48 line_developers_tw
0
1.6k
347a1b64f3a6e38981bc99b53919e2b1?s=48 azdaroth
0
150
6dd0483f1353a4a359e92633cfd65c64?s=48 wasabeef
1
580
5c588fdfe782f92fa6b081903edd82bb?s=48 hr01
0
1.7k
3c4e24fd827c789cb67a9f759f057b06?s=48 kgmyshin
1
280

Featured

See All Featured
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
146
19k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
321
53k
Ded01cdab114abe4ec13511e4c25b9bb?s=48 andyhume
62
3.5k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
119
16k
245cee81a9c424266e5e401d844ea881?s=48 lara
16
2.6k
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
258
24k
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
283
47k
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
11
1.3k
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
220
120k
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
257
17k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
656
54k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
27
1.9k

Transcript

  1. The Node.js Scalability Myth Felix Geisendörfer 14.06.2012 at Munich node.js

    user group
  2. None

  3. Felix Geisendörfer

  4. transloadit.com

  5. core contributor

  6. npm modules

  7. node-formidable

  8. node-mysql

  9. ~50 modules total

  10. (@)felixge(.de)

  11. Background

  12. I need to build an über-scalable web service. It will

    be the next big thing!

  13. Easy! I will use node.js and MongoDB!

  14. Easy! I will use node.js and MongoDB!

  15. Because node.js is “scalable”, right?

  16. None

  17. This Talk

  18. #1 Consider Reality

  19. Using node for performance reasons?

  20. Measuring performance in production?

  21. 1000 req / s

  22. 100 req / s

  23. 10 req / s 10 req / s

  24. ~1 million requests per day

  25. ~1 million units of value

  26. None

  27. #2 Node Scales Vertically

  28. Adding more resources to a single node

  29. None

  30. CPU

  31. Google V8

  32. JS -> Assembly

  33. Crankshaft JIT

  34. Fast

  35. Single Threaded* * For most parts

  36. Computers of the future will have hundreds of cores!

  37. Node’s Multi-Core Story

  38. Pre-fork

  39. IPC

  40. Like Ruby, Python, PHP, etc.

  41. But ... shared memory?

  42. Your problem requires shared memory?

  43. JavaScript is not your language

  44. Good Luck

  45. Memory

  46. No hard limit on 64bit (since node-0.6 / v8-3.7)

  47. However

  48. Avoid huge heaps

  49. Disk

  50. Done in thread pool

  51. Along with DNS

  52. No sendfile()

  53. None

  54. Network

  55. None

  56. Non-blocking I/O

  57. tl;dr

  58. pre-fork & non-blocking i/o

  59. #3 Horizontal Scaling is hard

  60. CAP

  61. Network Partitions

  62. Consistency

  63. Availability

  64. Some Tips

  65. Shared Nothing

  66. Messaging

  67. Monitoring

  68. The Node.js Scalability Myth

  69. Threads do not scale Node.js scales

  70. Threads do not scale Node.js scales

  71. Node is a tool

  72. None
  73. None
  74. None

  75. If you can’t duc it F#@k it

  76. Questions? Slides will be available at felixge.de

  77. Thanks

  78. Tool Demo