Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

077e9a0cb34fa3eba2699240c9509717?s=47 Andrew Godwin
August 05, 2017
Programming
0
100

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

077e9a0cb34fa3eba2699240c9509717?s=128

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
170
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
110
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
110
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
290
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
260
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
54
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
2
720
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
130
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
40

Other Decks in Programming

See All in Programming
Df4978f14401325586e9e286b140ac4c?s=48 n1215
1
490
588a291ce25b07e836ae5df8911eaf18?s=48 tdak
0
120
A760a90c9afd981004343b9861f1e8b4?s=48 daipresents
0
360
Acd2f6f7498ea41881e161e191aa7c02?s=48 yattom
33
11k
44df43ecb9d8ae00cafee6b804db3fcd?s=48 kentatada
0
130
02ca2dc42e6d88c692a21b18200796a1?s=48 shun_oshidari
6
3k
Ec2fcdc4ea7905b289967a2c4c43e154?s=48 sgeengineer
1
210
B31f9495679ee5513a2f9904767336af?s=48 kidokidofire
1
120
Dc5157c1e1b11923f4cdd210ee27d4af?s=48 patorash
0
150
52cc8a838bf44a589d2572833b2dd1b9?s=48 palkan
2
540
E83cdc415df47ab3eae30957ae7e2d33?s=48 ykpythemind
0
160
942bb606679caf4c57b38927f83178e1?s=48 qsona
19
5k

Featured

See All Featured
D8fc2580cfaca035f666d9e4ee79a7f7?s=48 mongodb
23
3.9k
E195ae45320d9202eaa01c9f1d31a416?s=48 marktimemedia
7
460
15f2b8221f247985a27a627d2ece72f0?s=48 pauljervisheath
195
15k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
220
15k
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
188
14k
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
118
4.9k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
242
21k
Ecdea9b9714877b86cee08458f085481?s=48 trallard
15
840
Ef32e0b1ac5082450dc8c1fca3a26b5c?s=48 cherdarchuk
73
270k
88bc30284c6a424b63a92aad27d0ba36?s=48 jnunemaker
PRO
40
4.7k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
146
20k
1f74b13f1e5c6c69cb5d7fbaabb1e2cb?s=48 sferik
613
55k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay