$30 off During Our Annual Pro Sale. View Details »

Cheating Your Way to Webscale

Matt Robenolt
May 02, 2014
Programming
13
1.1k

Cheating Your Way to Webscale

Python Nordeste, May 2nd 2014

Matt Robenolt

May 02, 2014
Tweet

More Decks by Matt Robenolt

See All by Matt Robenolt
Everything is broken and I don't know why.
mattrobenolt
0
44
I am bad at my job.
mattrobenolt
0
160
Everything is broken, and I don't know why. Python edition.
mattrobenolt
1
140
Everything is broken, and I don't know why. Python edition.
mattrobenolt
2
490
Varnish: How We Do It
mattrobenolt
1
170
Everything is broken, and I don't know why.
mattrobenolt
7
1.2k
HTTP for Great Good
mattrobenolt
86
200k
Caching is Hard: Varnish @ Disqus
mattrobenolt
52
2.1M
Developing & Deploying "Large" Scale Web Applications
mattrobenolt
26
1.1k

Other Decks in Programming

See All in Programming
How to dynamically validate data with Symfony
marionleherisson
0
100
コロナ禍でRails Girlsを開催したお話
emorima
0
140
Ltag
inoue2002
0
130
FrankenPHP: a modern app server for PHP and Symfony apps
dunglas
0
170
Hands-on Native ESM @ JSConf JP 2022
qnighy
0
3.5k
それぞれの特徴から考えるフレームワーク選び
ippey
1
270
Git 未経験者 が GitHub Actions で CICD できるようになるまで / 20221127-JJUGCCC-2022-Fall-Git-beginner-built-CICD-pipeline-with-GitHubActions
mackey0225
2
150
なんでもPull Requestにする / Kichijoji.pm 31
utgwkk
1
1.4k
Findy - エンジニア向け会社紹介 / Findy Letter for Engineers
findyinc
2
40k
『良いコード／悪いコードで学ぶ設計入門』を一歩深める読み方 / deepen good code bad code
minodriven
12
4k
37年前の Sun 3/60 のために最新のNetBSDと最新のX.orgをメンテする話 / KOF2022
tsutsui
1
130
Composing an API with Kotlin vol 2 (Advanced Kotlin Dev Day 2022)
zsmb
1
210

Featured

See All Featured
Building a Modern Day 
E-commerce SEO Strategy
aleyda
4
3.8k
VelocityConf: Rendering Performance Case Studies
addyosmani
317
22k
Robots, Beer and Maslow
schacon
154
7.3k
The Straight Up "How To Draw Better" Workshop
denniskardys
225
130k
Support Driven Design
roundedbygravity
87
8.8k
Rebuilding a faster, lazier Slack
samanthasiow
65
7.5k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
23
4.4k
The Power of CSS Pseudo Elements
geoffreycrofte
51
4.2k
No one is an island. Learnings from fostering a developers community.
thoeni
11
1.5k
How GitHub (no longer) Works
holman
298
140k
Building Applications with DynamoDB
mza
84
4.9k
Ruby is Unlike a Banana
tanoku
92
9.5k

Transcript

  1. Python Nordeste May 2nd 2014 Matt Robenolt Cheating Your Way

    to #webscale

  2. Hello < me irl

  3. Lead Operations Engineer

  4. Core Contributor

  5. So what is #webscale?

  6. 10 million requests per second 4ms mean response time asynchronous

    io mongodb

  7. 10 million requests per second 4ms mean response time asynchronous

    io mongodb NOPE

  8. Disqus only does 150 req/s per web server. * we

    also write some bad code

  9. 150 12,960,000 388,800,000 per second per day per month real

    world #webscale

  10. Scale is about hiding the fact that your application is

    actually really slow.

  11. If your application feels fast, then it’s probably good enough.

  12. Users hate waiting for shit.

  13. So how do we do it?

  14. Cheating 101

  15. When a user asks for new data, let’s give them

    old data instead.

  16. When a user asks for new data, let’s give them

    old data instead. Caching

  17. When telling us to do something, let’s say we did

    and maybe do it later.

  18. When telling us to do something, let’s say we did

    and maybe do it later. Queueing

  19. Rule #1 Don’t get caught.

  20. Rule #2 Don’t get caught.

  21. Rule #3 Don’t get caught.

  22. HTTP Caching

  23. Introducing

  24. tl;dr Varnish sits between your application and your users Internet

  25. Let’s talk about HTTP. Hypertext Transport Protocol

  26. $ curl -v disqus.com

  27. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300

  28. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Request

  29. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Method

  30. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Path

  31. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Version

  32. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Headers

  33. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Response

  34. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Status

  35. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 Headers

  36. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300

  37. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 For 300 seconds, all users will get the same response without talking to our application.

  38. > GET / HTTP/1.1 > User-Agent: curl/7.24.0 > Host: disqus.com

    > Accept: */* > < HTTP/1.1 200 OK < Server: nginx < Date: Fri, 02 May 2014 06:38:37 GMT < Content-Type: text/html; charset=utf-8 < Content-Length: 10453 < Last-Modified: Fri, 30 Aug 2013 00:32:14 GMT < Vary: Accept-Encoding < Expires: Fri, 02 May 2014 06:43:36 GMT < Cache-Control: public, max-age=300 With power comes great responsibility.

  39. GET / INTERNET Varnish Web servers

  40. GET / INTERNET Varnish Web servers CACHED! “Cache-Control: max-age=300”

  41. GET / INTERNET Varnish Web servers

  42. GET / INTERNET Varnish Web servers CACHED!

  43. BUT WAIT… THERE’S MORE

  44. COLLAPSING REQUEST

  45. GET / INTERNET Varnish Web servers

  46. INTERNET Varnish Web servers GET /

  47. INTERNET Varnish Web servers GET / If multiple users request

    the same object, Varnish makes one fetch and returns to all users.

  48. Queueing

  49. Do as little work as possible, and return a promise

    that this work will be done.

  50. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo

  51. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo

  52. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo Workers can rate limit, debounce, increment counters, generate a fast materialized view, etc.

  53. INTERNET Web servers Task workers Slow/Fast Data store Queue POST

    /foo Make sure your tasks finish before a user tries to read the data back.

  54. Final Thoughts

  55. Understand your application. Where can you cheat without disrupting user

    experience? Is seeing a few seconds old data going to damage a product?

  56. Cheating should only enhance user experience.

  57. Cheat any way you can, just don’t get caught.

  58. Django & Varnish & RabbitMQ & Celery & PostgreSQL &

    Redis &
 Cassandra & Riak Thanks

  59. Questions? I have answers. ^ github.com/mattrobenolt @mattrobenolt some