Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Shape of Node Architectures at Scale

Bd38b9183f8b841522dbd118ac99c024?s=47 Dan Shaw
February 27, 2013
Technology
1
210

The Shape of Node Architectures at Scale

Talk given to London Node Users Group. #LNUG

Bd38b9183f8b841522dbd118ac99c024?s=128

Dan Shaw

February 27, 2013
Tweet

More Decks by Dan Shaw

See All by Dan Shaw
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
0
12
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
1
97
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
7
8.5k
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
1
710
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
0
110
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
13
7.3k
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
0
79
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
0
230
Bd38b9183f8b841522dbd118ac99c024?s=48 dshaw
1
410

Other Decks in Technology

See All in Technology
1896b034326abb4bc429d6718dc6a42e?s=48 shomaekawa
3
1.1k
Ea29e2b19d11b48f867ae71d6a6de5df?s=48 opelab
2
290
53850955f15249a1a9dc49df6113e400?s=48 line_developers
PRO
0
140
E783e2d26dc6388730b73ced1348c638?s=48 vkbaba
0
110
2ee165e506f59e3fe6f463bf7f150ccb?s=48 minamizaki
0
550
96de66872f54da75c05c881c7a3713ce?s=48 kenya888
1
120
3487ed46845ad0c09d36c3c1c0533ea6?s=48 masakick
0
110
0f4a27389318ca7087ae12b1593171c1?s=48 saoritakita
0
340
A4d5b3aae2e67f31b513c88c726514c2?s=48 smzksts
0
210
63d1e567c2c7b1dbf340f7bea9a92876?s=48 caori_t
0
150
C47bda32c8455a59471cd7e19c32c074?s=48 hamadakoji
0
1.1k
E7f82c6db76f340b8ccc175d4330405b?s=48 sakon310
4
4.2k

Featured

See All Featured
5b9fe87ec1faa67a4599782930f45ec9?s=48 sstephenson
144
12k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
267
17k
F29327647a9cff5c69618bae420792ea?s=48 tenderlove
52
3.4k
A9a491b0fcbe0fbce3d64063a37add99?s=48 rmw
11
740
48c098b6579220a67a6ba949be6e4b5a?s=48 revolveconf
200
9.6k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
192
8.8k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
241
21k
282d599b414022eba5096510f675b6e2?s=48 chrislema
231
16k
761be20b5ebd271008bcee1244fc5b52?s=48 matthewcrist
73
7.5k
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
204
35k
7653c7c449918ff6542880a8c284f5e7?s=48 jponch
103
4.9k
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
229
18k

Transcript

  1. The Shape of Node Architectures at Scale

  2. Daniel D. Shaw @dshaw

  3. I like to build things with Node

  4. Build Node Things • Storify • Spreecast • Node Knockout

    • Voxer • The Node Firm

  5. Do Less Well

  6. FP for Distributed Architectures

  7. What do I do? - your processes

  8. Evolutionary Shapes • ALL THE THINGS! • Generalization • Specialization

    • One Thing

  9. ALL THE THINGS Mixture

  10. ALL THE THINGS Easy to run, multi-process, single execution point.

  11. Generalization Not all apps need to aspire to be the

    next Facebook.

  12. Scale Will you really need it?

  13. Building and Planning Node.js application

  14. Generalization • Express + Socket.io + API • Website +

    API • Restify

  15. Am I doing too much?

  16. Trade-offs

  17. Trade-offs • Expensive loads limit conjoined services. • Impact of

    exceptions and crashes. • Deployment complexity. • Deployment isolation. • Evolve services independently.

  18. Dumb Clusters Simple Pooling

  19. Dumb Cluster • Static file server • Simple web sites

    • Minimal client/server • API server hosts

  20. Pooling Tools • Round Robin DNS • Varnish • Nginx

    • HAProxy • ...more node

  21. Pooling Tools • Substack - seaport, etc • Nodejitsu -

    node-http-proxy • Poolee - battle tested at Voxer

  22. Distribute Load Data store(s) have the definitive answers

  23. Smarter Clusters Session Affinity

  24. Sticky Sessions

  25. Smart Clusters (Consistent Hash Rings)

  26. Why? Complex interactions or data persistence

  27. Properties of Consistent Hash Rings • Deterministic • Change has

    minimal impact on determinism • Crunchy middle?

  28. House of Pain Complexity

  29. Right for the Task As simple as possible

  30. Thank You! <3 dshaw