Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

077e9a0cb34fa3eba2699240c9509717?s=47 Andrew Godwin
August 05, 2017
Programming
0
120

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

077e9a0cb34fa3eba2699240c9509717?s=128

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
7
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
230
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
170
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
200
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
320
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
290
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
76
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
2
810
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
150

Other Decks in Programming

See All in Programming
A4d1023b1de7890c67a083d14573882d?s=48 ktgrstsh
0
190
7252086bae9203045dd7f5664fd96a07?s=48 manuelmeyer
0
130
9516a84fcc28d6456d4fc87a5c8b130f?s=48 kidel
0
1.2k
Dc8d7b0277a1646d6842105241e8bef5?s=48 peacock0803sz
0
230
82aa6e293e94bf37796f4ae50f583f6c?s=48 veronikapj
2
130
3c7020b33ae8880dd9514b6469a28ae0?s=48 yt8492
1
130
635e53b96114c922fa5486b418895960?s=48 fadis
0
1.4k
1d42b38276c3d2c7cc931fa444c13488?s=48 nasum
19
7.3k
8ec2b967e38f000eb63ae345cd7c58e6?s=48 minodriven
13
2.8k
744f1c2c6cbea2ff5104b0ac512936bd?s=48 hpgrahsl
0
120
D833ebe946fb6c3ca990758737855f79?s=48 typewriter
0
150
E0e036f89c14b3e59640318eedf9670b?s=48 bkuhlmann
6
820

Featured

See All Featured
4262b9cfacfb6b2c77f23e1d0310cd3e?s=48 myddelton
110
11k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
170
7.5k
651dcfe41723207fbb0aa044a4f7c07f?s=48 dotmariusz
98
5.6k
Ef32e0b1ac5082450dc8c1fca3a26b5c?s=48 cherdarchuk
77
270k
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
777
200k
812e1705ff0f8bc1bcf18587bde687d5?s=48 62gerente
591
210k
C51b39fa3c79ccb99dcb8a076bc98287?s=48 brianwarren
85
5k
245cee81a9c424266e5e401d844ea881?s=48 lara
26
3.2k
79acae287842acf29084005533a7fb3b?s=48 hursman
111
9.4k
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
207
38k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
247
21k
E76911cbe088e5b850d966de3fc7435b?s=48 robhawkes
55
3k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay