Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Scaling Down (Running Large Sites Locally)

Avatar for Andrew Godwin Andrew Godwin
August 05, 2017
Programming
260
0

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

Avatar for Andrew Godwin

Andrew Godwin

August 05, 2017

More Decks by Andrew Godwin

See All by Andrew Godwin
Reconciling Everything
Avatar for Andrew Godwin andrewgodwin
1
410
Django Through The Years
Avatar for Andrew Godwin andrewgodwin
0
330
Writing Maintainable Software At Scale
Avatar for Andrew Godwin andrewgodwin
0
550
A Newcomer's Guide To Airflow's Architecture
Avatar for Andrew Godwin andrewgodwin
0
430
Async, Python, and the Future
Avatar for Andrew Godwin andrewgodwin
2
760
How To Break Django: With Async
Avatar for Andrew Godwin andrewgodwin
1
840
Taking Django's ORM Async
Avatar for Andrew Godwin andrewgodwin
0
870
The Long Road To Asynchrony
Avatar for Andrew Godwin andrewgodwin
0
780
The Scientist & The Engineer
Avatar for Andrew Godwin andrewgodwin
1
870

Other Decks in Programming

See All in Programming
From 6 People Classroom Meetup to 100 People Regional Conference / FOSS4G Hiroshima 2026
Avatar for YFurukawa furukawayasuto
0
130
ハーネス設計入門 〜プロンプト、コンテキストの次〜
Avatar for kinopee kinopeee
56
38k
App Intentsのビルドプロセスを支える技術
Avatar for kntk kntkymt
0
270
Heart of Swift Concurrency
Avatar for Yuta Koshizawa koher
0
250
What We Talk About When We Talk About XP
Avatar for seki at druby.org m_seki
2
500
iOSDC Japan 2026 - Swiftで作って学ぼう！データベース自作入門
Avatar for kaseken (Kent Kaseda) kaseken
2
130
モバイル交通系ICへのチャージ実例から考える、クロスプラットフォーム開発におけるiOS実機テスト設計とCI運用
Avatar for Yu Sugawara yusuga
1
360
Family mrubyの進捗
Avatar for Katsuhiko Kageyama kishima
1
110
AWS DevOps Agentで インシデント対応をAIに任せたい
Avatar for HonMarkHunt honmarkhunt
7
2.7k
アクセシビリティから考える情報設計
Avatar for high-g high_g_engineer
0
360
thread_parallel_with_free-threaded_Python_and_NumPy.pdf
Avatar for Riku Sakamoto riku_sakamoto
0
300
GKE で Pod の見方を変えたら、スケールアウト時の挙動を真に捉えられた話
Avatar for Sota Takaki stkk
0
110

Featured

See All Featured
First, design no harm
Avatar for Per Axbom axbom
PRO
2
1.3k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
520
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3.6k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
141
7.7k
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
300
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.9k
Visualization
Avatar for Eitan Lees eitanlees
152
17k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
56k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.8k
Ecommerce SEO: The Keys for Success Now & Beyond - #SERPConf2024
Avatar for Aleyda Solis aleyda
1
2.1k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
300
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
3
1.2k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay