Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Andrew Godwin Andrew Godwin
August 05, 2017
Programming
0
240

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

Avatar for Andrew Godwin

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
Reconciling Everything
Avatar for Andrew Godwin andrewgodwin
1
360
Django Through The Years
Avatar for Andrew Godwin andrewgodwin
0
280
Writing Maintainable Software At Scale
Avatar for Andrew Godwin andrewgodwin
0
490
A Newcomer's Guide To Airflow's Architecture
Avatar for Andrew Godwin andrewgodwin
0
390
Async, Python, and the Future
Avatar for Andrew Godwin andrewgodwin
2
710
How To Break Django: With Async
Avatar for Andrew Godwin andrewgodwin
1
770
Taking Django's ORM Async
Avatar for Andrew Godwin andrewgodwin
0
770
The Long Road To Asynchrony
Avatar for Andrew Godwin andrewgodwin
0
740
The Scientist & The Engineer
Avatar for Andrew Godwin andrewgodwin
1
810

Other Decks in Programming

See All in Programming
Patterns of Patterns
Avatar for Denys Poltorak denyspoltorak
0
1.4k
開発者から情シスまで - 多様なユーザー層に届けるAPI提供戦略 / Postman API Night Okinawa 2026 Winter
Avatar for tasshi tasshi
0
210
CSC307 Lecture 04
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
660
QAフローを最適化し、品質水準を満たしながらリリースまでの期間を最短化する #RSGT2026
Avatar for shibayu36 shibayu36
2
4.4k
15年続くIoTサービスの SREエンジニアが挑む 分散トレーシング導入
Avatar for Melonps melonps
2
220
CSC307 Lecture 02
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
1
780
AIによる高速開発をどう制御するか？ ガードレール設置で開発速度と品質を両立させたチームの事例
Avatar for tonkotsuboy_com tonkotsuboy_com
7
2.4k
今こそ知るべき耐量子計算機暗号(PQC)入門 / PQC: What You Need to Know Now
Avatar for mackey0225 mackey0225
3
380
並行開発のためのコードレビュー
Avatar for Miyuki miyukiw
0
510
Honoを使ったリモートMCPサーバでAIツールとの連携を加速させる！
Avatar for とすり tosuri13
1
180
OSSとなったswift-buildで Xcodeのビルドを差し替えられるため 自分でXcodeを直せる時代になっている ダイアモンド問題編
Avatar for yimajo yimajo
3
620
Package Management Learnings from Homebrew
Avatar for Mike McQuaid mikemcquaid
0
230

Featured

See All Featured
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
66
37k
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
Avatar for Tech SEO Connect techseoconnect
PRO
0
86
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
304
21k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
Navigating Weather and Climate Data
Avatar for Ryan Abernathey rabernat
0
110
Sharpening the Axe: The Primacy of Toolmaking
Avatar for Bryan Cantrill bcantrill
46
2.7k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
9.5k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
110
Money Talks: Using Revenue to Get Sh*t Done
Avatar for Nikki Halliwell nikkihalliwell
0
150
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
120

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay