Scaling Down (Running Large Sites Locally)

077e9a0cb34fa3eba2699240c9509717?s=47 Andrew Godwin
August 05, 2017
Programming
0
99

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

077e9a0cb34fa3eba2699240c9509717?s=128

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
35
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
38
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
250
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
210
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
38
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
2
560
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
110
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
31
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
96

Other Decks in Programming

See All in Programming
9bf923e39671cde83584e3e926296c13?s=48 kishikawakatsumi
8
1.8k
7437b9552e193bb1f8ea757bf1a51175?s=48 aruneko
1
840
15934fa2aa7b2ce21f091e9b7cffa856?s=48 manfredsteyer
1
140
85caff7f89434c74e9c6b4287d3c8e05?s=48 yoseiyamagishi
2
190
0187ef0e45a8d745eafc223cf2ebb90c?s=48 tosh7
1
810
E586b46d5b09f8109beb66bb146e4f20?s=48 tamappe
1
300
433ce798352c6d5ad363b3b585cb015d?s=48 rizumi
5
680
De266761b955b2636e454a1bc7a99ed4?s=48 masayaaoyama
5
630
9d1961575e45a8286cdde5f86dbba312?s=48 akatsuki174
5
1.2k
Dee9a95c0e5483692c54cc5e60e8b09e?s=48 yusuke57
0
120
Fd3442482c4a9b2d2353448a6e379823?s=48 matsu_chara
2
410
87137598c23e3e90755e5d7476d21405?s=48 bastnic
1
500

Featured

See All Featured
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1348
190k
4262b9cfacfb6b2c77f23e1d0310cd3e?s=48 myddelton
104
10k
E837d2996f52008ace055a08fbfff992?s=48 frogandcode
121
20k
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
61
7.4k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
190
8.2k
245cee81a9c424266e5e401d844ea881?s=48 lara
169
9.2k
Dafc4723e9a1c067796c0fec6f509774?s=48 lemiorhan
621
40k
7fa6101cd43067653cf4ac6c7ca54305?s=48 akmur
252
19k
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
250
11k
C0390e8b11079f8761c0cd3274ed61cb?s=48 productmarketing
5
510
E43f8dfd01057f8304f5f8fb9a294d7d?s=48 jeffersonlam
325
14k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
267
16k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay