Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

Avatar for Andrew Godwin Andrew Godwin
August 05, 2017
Programming
250
0

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

Avatar for Andrew Godwin

Andrew Godwin

August 05, 2017

More Decks by Andrew Godwin

See All by Andrew Godwin
Reconciling Everything
Avatar for Andrew Godwin andrewgodwin
1
390
Django Through The Years
Avatar for Andrew Godwin andrewgodwin
0
310
Writing Maintainable Software At Scale
Avatar for Andrew Godwin andrewgodwin
0
520
A Newcomer's Guide To Airflow's Architecture
Avatar for Andrew Godwin andrewgodwin
0
420
Async, Python, and the Future
Avatar for Andrew Godwin andrewgodwin
2
730
How To Break Django: With Async
Avatar for Andrew Godwin andrewgodwin
1
800
Taking Django's ORM Async
Avatar for Andrew Godwin andrewgodwin
0
810
The Long Road To Asynchrony
Avatar for Andrew Godwin andrewgodwin
0
760
The Scientist & The Engineer
Avatar for Andrew Godwin andrewgodwin
1
840

Other Decks in Programming

See All in Programming
RailsTokyo 2026#4: AI様があれば、
Hotwireの弱点は消えるか？
Avatar for Naofumi Kagami naofumi
5
990
OCRを使ってゲームのアイテムをデータ化する
Avatar for Kishikawa Katsumi kishikawakatsumi
0
120
Are We Really Coding 10× Faster with AI?
Avatar for Koichi Yoshida kohzas
0
240
Modding RubyKaigi for Myself
Avatar for yui-knk yui_knk
0
470
Agentic UI beyond Chats Architecture Patterns & Open Standards @ngMunich 05/2026
Avatar for Manfred Steyer manfredsteyer
PRO
0
150
次世代リンターで探る、tsgo 時代における型認識カスタムルールの現実解
Avatar for Yuta Takahashi ytakahashii
3
1.1k
SPMマルチモジュールで テストカバレッジを取得する技法
Avatar for yosshi yosshi4486
0
120
Technical Debt: Understanding it Rightly, Engaging it Rightly #LaravelLiveJP
Avatar for shogogg shogogg
0
150
UaaL×Androidアプリのメモリ計測 — Memory Profilerの先へ
Avatar for Ryosuke Shimizu (RIO) rio432
0
180
Transactional Change Stream Processing With Debezium and Apache Flink
Avatar for Gunnar Morling gunnarmorling
1
130
技術記事、AIに書かせるか、自分で書くか？ 〜それでも私が自分の手で書く理由〜 / #QiitaConference
Avatar for Junichi Ito jnchito
2
1.1k
AI時代だからこそ「Bloc」を採用する価値があるのかもしれない
Avatar for takuro abe takuroabe
0
240

Featured

See All Featured
Building Applications with DynamoDB
Avatar for Matt Wood mza
96
7k
Sam Torres - BigQuery for SEOs
Avatar for Tech SEO Connect techseoconnect
PRO
0
270
Jess Joyce - The Pitfalls of Following Frameworks
Avatar for Tech SEO Connect techseoconnect
PRO
1
150
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
210
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.3k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
ラッコキーワード サービス紹介資料
Avatar for ラッコ株式会社 rakko
1
3.4M
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
9
2k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
200
The AI Search Optimization Roadmap by Aleyda Solis
Avatar for Aleyda Solis aleyda
1
5.8k
Design in an AI World
Avatar for tapps tapps
1
220

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay