Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

Avatar for Andrew Godwin Andrew Godwin
August 05, 2017
Programming
0
220

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.
Avatar for Andrew Godwin

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
Reconciling Everything
Avatar for Andrew Godwin andrewgodwin
1
310
Django Through The Years
Avatar for Andrew Godwin andrewgodwin
0
200
Writing Maintainable Software At Scale
Avatar for Andrew Godwin andrewgodwin
0
440
A Newcomer's Guide To Airflow's Architecture
Avatar for Andrew Godwin andrewgodwin
0
350
Async, Python, and the Future
Avatar for Andrew Godwin andrewgodwin
2
660
How To Break Django: With Async
Avatar for Andrew Godwin andrewgodwin
1
720
Taking Django's ORM Async
Avatar for Andrew Godwin andrewgodwin
0
720
The Long Road To Asynchrony
Avatar for Andrew Godwin andrewgodwin
0
650
The Scientist & The Engineer
Avatar for Andrew Godwin andrewgodwin
1
760

Other Decks in Programming

See All in Programming
PicoRuby on Rails
Avatar for makicamel makicamel
2
110
GraphRAGの仕組みまるわかり
Avatar for とすり tosuri13
8
500
なぜ適用するか、移行して理解するClean Architecture 〜構造を超えて設計を継承する〜 / Why Apply, Migrate and Understand Clean Architecture - Inherit Design Beyond Structure
Avatar for shiro seike seike460
PRO
1
700
プロダクト志向ってなんなんだろうね
Avatar for RightTouch righttouch
PRO
0
170
『自分のデータだけ見せたい！』を叶える──Laravel × Casbin で複雑権限をスッキリ解きほぐす 25 分
Avatar for AkitoTsukahara akitotsukahara
1
580
PostgreSQLのRow Level SecurityをPHPのORMで扱う Eloquent vs Doctrine #phpcon #track2
Avatar for Hiromi Hishida 77web
2
400
データの民主化を支える、透明性のあるデータ利活用への挑戦 2025-06-25 Database Engineering Meetup#7
Avatar for Kentaro Yoshida y_ken
0
320
AWS CDKの推しポイント 〜CloudFormationと比較してみた〜
Avatar for アキキー akihisaikeda
3
320
たった 1 枚の PHP ファイルで実装する MCP サーバ / MCP Server with Vanilla PHP
Avatar for Shohei Okada okashoi
1
210
LT 2025-06-30: プロダクトエンジニアの役割
Avatar for Keisuke Yamamoto yamamotok
0
560
エンジニア向け採用ピッチ資料
Avatar for 犬飼嵩 inusan
0
170
Team topologies and the microservice architecture: a synergistic relationship
Avatar for Chris Richardson cer
PRO
0
1.1k

Featured

See All Featured
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
277
23k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
10
660
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
46
9.6k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
35
2.4k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
140
7k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
54
13k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
614
210k
KATA
Avatar for Megan Lloyd mclloyd
30
14k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.7k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
5
230
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
30
5.8k
[RailsConf 2023] Rails as a piece of cake
Avatar for Vladimir Dementyev palkan
55
5.6k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay