Cheating Your Way to Webscale

Ce86d68173d477a17396b5e611468f52?s=47 Matt Robenolt
May 02, 2014
Programming
13
940

Cheating Your Way to Webscale

Python Nordeste, May 2nd 2014

Ce86d68173d477a17396b5e611468f52?s=128

Matt Robenolt

May 02, 2014
Tweet

More Decks by Matt Robenolt

See All by Matt Robenolt
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
0
44
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
0
110
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
1
120
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
2
450
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
1
140
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
7
1k
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
85
180k
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
51
2.1M
Ce86d68173d477a17396b5e611468f52?s=48 mattrobenolt
26
1k

Other Decks in Programming

See All in Programming
D9e4d5a4b36f83fbde1076815df1362f?s=48 bmack
0
170
F28abade40c3fa0565f578f7dbae6560?s=48 orumin
2
1.1k
1d1580fb0945b0ffadff18e28bead3c5?s=48 adarapata
0
270
4d78b749c315e21a956053dcbf0508a9?s=48 po3rin
1
130
F9e11bea0c22333596791dd0696f5d4f?s=48 daiksy
0
1.2k
6e85e396c2fca10e469e67cbede8104e?s=48 yukikimoto
0
130
Bdd3fb3269e67bbc512f2530c409a926?s=48 tnishinaga
3
3.4k
4d78b749c315e21a956053dcbf0508a9?s=48 po3rin
2
460
8f1fde48dea93c5c3dd6c68c8b8cee92?s=48 kazutaka333
0
260
1405a601755e5fcbfdc93a2560368bb1?s=48 freddi
1
200
80a3a3857a55f154d23acb705eff72cc?s=48 star_zero
3
130
D83b3739651001461f48763639b90b50?s=48 mazipan
4
930

Featured

See All Featured
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
50
3.9k
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
65
2.9k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
218
14k
15f2b8221f247985a27a627d2ece72f0?s=48 pauljervisheath
193
15k
Dafc4723e9a1c067796c0fec6f509774?s=48 lemiorhan
620
40k
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
256
24k
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
8
930
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
12
430
9952dfcd5d338f8a8e7175c8a8f65fb5?s=48 wjessup
333
15k
61857dafbd287b3027c4dcea9008ad3c?s=48 carmenhchung
13
770
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
91
2.8k
Af6a12710770ad9a7cfd08c97efd40d3?s=48 pedronauck
648
110k

Transcript

  1. Python Nordeste May 2nd 2014 Matt Robenolt Cheating Your Way

    to #webscale

  2. Hello < me irl

  3. Lead Operations Engineer

  4. Core Contributor

  5. So what is #webscale?

  6. 10 million requests per second 4ms mean response time asynchronous

    io mongodb

  7. 10 million requests per second 4ms mean response time asynchronous

    io mongodb NOPE

  8. Disqus only does 150 req/s per web server. * we

    also write some bad code

  9. 150 12,960,000 388,800,000 per second per day per month real

    world #webscale

  10. Scale is about hiding the fact that your application is

    actually really slow.

  11. If your application feels fast, then it’s probably good enough.

  12. Users hate waiting for shit.

  13. So how do we do it?

  14. Cheating 101

  15. When a user asks for new data, let’s give them

    old data instead.

  16. When a user asks for new data, let’s give them

    old data instead. Caching

  17. When telling us to do something, let’s say we did

    and maybe do it later.

  18. When telling us to do something, let’s say we did

    and maybe do it later. Queueing

  19. Rule #1 Don’t get caught.

  20. Rule #2 Don’t get caught.

  21. Rule #3 Don’t get caught.

  22. HTTP Caching

  23. Introducing

  24. tl;dr Varnish sits between your application and your users Internet

  25. Let’s talk about HTTP. Hypertext Transport Protocol

  26. $ curl -v disqus.com

  27. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300

  28. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Request

  29. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Method

  30. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Path

  31. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Version

  32. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Headers

  33. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Response

  34. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Status

  35. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Headers

  36. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300

  37. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 For 300 seconds, all users will get the same response without talking to our application.

  38. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 With power comes great responsibility.

  39. GET / INTERNET Varnish Web servers

  40. GET / INTERNET Varnish Web servers CACHED! “Cache-Control: max-age=300”

  41. GET / INTERNET Varnish Web servers

  42. GET / INTERNET Varnish Web servers CACHED!

  43. BUT WAIT… THERE’S MORE

  44. COLLAPSING REQUEST

  45. GET / INTERNET Varnish Web servers

  46. INTERNET Varnish Web servers GET /

  47. INTERNET Varnish Web servers GET / If multiple users request

    the same object, Varnish makes one fetch and returns to all users.

  48. Queueing

  49. Do as little work as possible, and return a promise

    that this work will be done.

  50. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo

  51. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo

  52. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo Workers can rate limit, debounce, increment counters, generate a fast materialized view, etc.

  53. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo Make sure your tasks finish before a user tries to read the data back.

  54. Final Thoughts

  55. Understand your application. Where can you cheat without disrupting user

    experience? Is seeing a few seconds old data going to damage a product?

  56. Cheating should only enhance user experience.

  57. Cheat any way you can, just don’t get caught.

  58. Django & Varnish & RabbitMQ & Celery & PostgreSQL &

    Redis &
 Cassandra & Riak Thanks

  59. Questions? I have answers. ^ github.com/mattrobenolt @mattrobenolt some