Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

077e9a0cb34fa3eba2699240c9509717?s=47 Andrew Godwin
August 05, 2017
Programming
0
180

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

077e9a0cb34fa3eba2699240c9509717?s=128

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
A Newcomer's Guide To Airflow's Architecture
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
98
Async, Python, and the Future
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
370
How To Break Django: With Async
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
310
Taking Django's ORM Async
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
340
The Long Road To Asynchrony
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
380
The Scientist & The Engineer
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
380
Pioneering Real-Time
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
0
150
Just Add Await: Retrofitting Async Into Django
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
2
1.1k
Terrain, Art, Python and LiDAR
077e9a0cb34fa3eba2699240c9509717?s=48 andrewgodwin
1
240

Other Decks in Programming

See All in Programming
UI Testing of Jetpack Compose Apps, AppDevCon
2b0404a5db1a74f01bf3bf94d142e28c?s=48 alexzhukovich
0
140
Swift Regex
0b26590a0a8b0f1da140ed5de9b68379?s=48 usamik26
0
150
Running Laravel/PHP on AWS (AWS Builders Day Taiwan 2022)
2f42f32689c8244280dd01d864f92079?s=48 dwchiang
0
140
1時間半で克服するJavaScriptの非同期処理/async_javascript_kokufuku
338259af0e093b5d91e9dc7afbcdd0d5?s=48 marchin1989
2
610
GoogleI/O2022 LT報告会資料
2bd3b8c3550384ab61d671b673c119bb?s=48 shinsukefujita1126
0
310
シェーダー氷山発掘記
6a661bb5871208cad64912223bb0c637?s=48 logilabo
0
140
JetPackComposeは宣言型プログラミングパラダイムって実はよくわかってないんですが、別に使ってもいいんですよね、
6affc38c52fa1cd2e395b3044cfb95fe?s=48 conigashima
0
180
JSのウェブフレームワークで高速なルーターを実装する方法
6e34bfefc3edbe746ac7a71ca6635309?s=48 usualoma
1
1.7k
即、New Relic / New Relic NOW!
271fad8d53cd1f12f2b4b6d38e3d7bd3?s=48 uzulla
0
310
ISUCON12 事前講習
2e7087b86608d4497c209eb9ba14d8f5?s=48 rosylilly
3
4.3k
Terraform Plan/Apply結果の自動通知
92a1e043fcefaed6e1b89182b1cd34a5?s=48 ymmy02
0
280
git on intellij
1a51f443c6d75a0576428792b0da05f2?s=48 hiroto_kitamura
0
170

Featured

See All Featured
Build your cross-platform service in a week with App Engine
5f83ef806155b403c3393160ce51f955?s=48 jlugia
219
17k
Intergalactic Javascript Robots from Outer Space
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
261
25k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
237
19k
Large-scale JavaScript Application Architecture
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
499
110k
The Pragmatic Product Professional
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
19
3k
Creatively Recalculating Your Daily Design Routine
48c098b6579220a67a6ba949be6e4b5a?s=48 revolveconf
207
10k
Six Lessons from altMBA
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
14
1.4k
Statistics for Hackers
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
781
210k
In The Pink: A Labor of Love
E837d2996f52008ace055a08fbfff992?s=48 frogandcode
131
21k
VelocityConf: Rendering Performance Case Studies
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
316
22k
The Language of Interfaces
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
148
20k
Teambox: Starting and Learning
Aebc2d07a50011e2a30d38435fde564a?s=48 jrom
123
7.7k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay