Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

Andrew Godwin
August 05, 2017
Programming
0
190

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
Writing Maintainable Software At Scale
andrewgodwin
0
190
A Newcomer's Guide To Airflow's Architecture
andrewgodwin
0
150
Async, Python, and the Future
andrewgodwin
2
440
How To Break Django: With Async
andrewgodwin
1
420
Taking Django's ORM Async
andrewgodwin
0
400
The Long Road To Asynchrony
andrewgodwin
0
420
The Scientist & The Engineer
andrewgodwin
1
440
Pioneering Real-Time
andrewgodwin
0
190
Just Add Await: Retrofitting Async Into Django
andrewgodwin
2
1.2k

Other Decks in Programming

See All in Programming
domain層のモジュール化 / MoT TechTalk #15
mot_techtalk
0
110
Qiita Night PHP 2023
fuwasegu
0
10k
Amazon QuickSightのアップデート -re:Invent 2022の復習&2022年ハイライト-
shogo452
0
210
Prácticas de Seguridad en Kubernetes
pablokbs
0
120
WordPress（再）入門 - 基礎知識・環境編
oleindesign
1
120
はてなリモートインターンシップ2022 Web API 講義資料
hatena
0
150
OSC大阪 パスワード認証は人類には早すぎる ~ IDaaSを使ったソーシャルログインのすすめ ~
authyasan
6
1.2k
An Advanced Introduction to R
nicetak
0
1.7k
SHOWROOMの分析目的を意識した伝え方・コミュニケーション
hatapu
0
230
ipa-medit: Memory search and patch tool for IPA without Jailbreaking/ipa-medit-bh2022-europe
tkmru
0
130
2023年にクル（かもしれない）通信ミドルウェア技術（仮）
s_hosoai
0
140
新卒でサービス立ち上げから Hasuraを使って３年経った振り返り
yutorin
0
210

Featured

See All Featured
How STYLIGHT went responsive
nonsquared
89
4.2k
Imperfection Machines: The Place of Print at Facebook
scottboms
254
12k
KATA
mclloyd
12
9.7k
Art Directing for the Web. Five minutes with CSS Template Areas
malarkey
196
9.8k
JazzCon 2018 Closing Keynote - Leadership for the Reluctant Leader
reverentgeek
175
9.1k
Designing with Data
zakiwarfel
91
4.2k
Build your cross-platform service in a week with App Engine
jlugia
221
17k
The Power of CSS Pseudo Elements
geoffreycrofte
52
4.3k
The Web Native Designer (August 2011)
paulrobertlloyd
76
2.2k
It's Worth the Effort
3n
177
26k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
224
50k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
24
4.5k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay