Link
Embed
Share
Beginning
This slide
Copy link URL
Copy link URL
Copy iframe embed code
Copy iframe embed code
Copy javascript embed code
Copy javascript embed code
Share
Tweet
Share
Tweet
Slide 1
Slide 1 text
The Node.js Scalability Myth Felix Geisendörfer 14.06.2012 at Munich node.js user group
Slide 2
Slide 2 text
No content
Slide 3
Slide 3 text
Felix Geisendörfer
Slide 4
Slide 4 text
transloadit.com
Slide 5
Slide 5 text
core contributor
Slide 6
Slide 6 text
npm modules
Slide 7
Slide 7 text
node-formidable
Slide 8
Slide 8 text
node-mysql
Slide 9
Slide 9 text
~50 modules total
Slide 10
Slide 10 text
(@)felixge(.de)
Slide 11
Slide 11 text
Background
Slide 12
Slide 12 text
I need to build an über-scalable web service. It will be the next big thing!
Slide 13
Slide 13 text
Easy! I will use node.js and MongoDB!
Slide 14
Slide 14 text
Easy! I will use node.js and MongoDB!
Slide 15
Slide 15 text
Because node.js is “scalable”, right?
Slide 16
Slide 16 text
No content
Slide 17
Slide 17 text
This Talk
Slide 18
Slide 18 text
#1 Consider Reality
Slide 19
Slide 19 text
Using node for performance reasons?
Slide 20
Slide 20 text
Measuring performance in production?
Slide 21
Slide 21 text
1000 req / s
Slide 22
Slide 22 text
100 req / s
Slide 23
Slide 23 text
10 req / s 10 req / s
Slide 24
Slide 24 text
~1 million requests per day
Slide 25
Slide 25 text
~1 million units of value
Slide 26
Slide 26 text
No content
Slide 27
Slide 27 text
#2 Node Scales Vertically
Slide 28
Slide 28 text
Adding more resources to a single node
Slide 29
Slide 29 text
No content
Slide 30
Slide 30 text
CPU
Slide 31
Slide 31 text
Google V8
Slide 32
Slide 32 text
JS -> Assembly
Slide 33
Slide 33 text
Crankshaft JIT
Slide 34
Slide 34 text
Fast
Slide 35
Slide 35 text
Single Threaded* * For most parts
Slide 36
Slide 36 text
Computers of the future will have hundreds of cores!
Slide 37
Slide 37 text
Node’s Multi-Core Story
Slide 38
Slide 38 text
Pre-fork
Slide 39
Slide 39 text
IPC
Slide 40
Slide 40 text
Like Ruby, Python, PHP, etc.
Slide 41
Slide 41 text
But ... shared memory?
Slide 42
Slide 42 text
Your problem requires shared memory?
Slide 43
Slide 43 text
JavaScript is not your language
Slide 44
Slide 44 text
Good Luck
Slide 45
Slide 45 text
Memory
Slide 46
Slide 46 text
No hard limit on 64bit (since node-0.6 / v8-3.7)
Slide 47
Slide 47 text
However
Slide 48
Slide 48 text
Avoid huge heaps
Slide 49
Slide 49 text
Disk
Slide 50
Slide 50 text
Done in thread pool
Slide 51
Slide 51 text
Along with DNS
Slide 52
Slide 52 text
No sendfile()
Slide 53
Slide 53 text
No content
Slide 54
Slide 54 text
Network
Slide 55
Slide 55 text
No content
Slide 56
Slide 56 text
Non-blocking I/O
Slide 57
Slide 57 text
tl;dr
Slide 58
Slide 58 text
pre-fork & non-blocking i/o
Slide 59
Slide 59 text
#3 Horizontal Scaling is hard
Slide 60
Slide 60 text
CAP
Slide 61
Slide 61 text
Network Partitions
Slide 62
Slide 62 text
Consistency
Slide 63
Slide 63 text
Availability
Slide 64
Slide 64 text
Some Tips
Slide 65
Slide 65 text
Shared Nothing
Slide 66
Slide 66 text
Messaging
Slide 67
Slide 67 text
Monitoring
Slide 68
Slide 68 text
The Node.js Scalability Myth
Slide 69
Slide 69 text
Threads do not scale Node.js scales
Slide 70
Slide 70 text
Threads do not scale Node.js scales
Slide 71
Slide 71 text
Node is a tool
Slide 72
Slide 72 text
No content
Slide 73
Slide 73 text
No content
Slide 74
Slide 74 text
No content
Slide 75
Slide 75 text
If you can’t duc it F#@k it
Slide 76
Slide 76 text
Questions? Slides will be available at felixge.de
Slide 77
Slide 77 text
Thanks
Slide 78
Slide 78 text
Tool Demo