$30 off During Our Annual Pro Sale. View Details »

Scaling Down (Running Large Sites Locally)

Avatar for Andrew Godwin Andrew Godwin
August 05, 2017
Programming
0
230

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

Avatar for Andrew Godwin

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
Reconciling Everything
Avatar for Andrew Godwin andrewgodwin
1
350
Django Through The Years
Avatar for Andrew Godwin andrewgodwin
0
260
Writing Maintainable Software At Scale
Avatar for Andrew Godwin andrewgodwin
0
470
A Newcomer's Guide To Airflow's Architecture
Avatar for Andrew Godwin andrewgodwin
0
380
Async, Python, and the Future
Avatar for Andrew Godwin andrewgodwin
2
700
How To Break Django: With Async
Avatar for Andrew Godwin andrewgodwin
1
760
Taking Django's ORM Async
Avatar for Andrew Godwin andrewgodwin
0
760
The Long Road To Asynchrony
Avatar for Andrew Godwin andrewgodwin
0
720
The Scientist & The Engineer
Avatar for Andrew Godwin andrewgodwin
1
800

Other Decks in Programming

See All in Programming
開発に寄りそう自動テストの実現
Avatar for Hiroki Iseri goyoki
2
1.2k
Go コードベースの構成と AI コンテキスト定義
Avatar for ANDPAD inc andpad
0
130
俺流レスポンシブコーディング 2025
Avatar for TAK tak_dcxi
14
9.1k
組み合わせ爆発にのまれない - 責務分割 x テスト
Avatar for HAL halhorn
1
150
Giselleで作るAI QAアシスタント 〜 Pull Requestレビューに継続的QAを
Avatar for Tadashi Shigeoka codenote
0
250
Pythonではじめるオープンデータ分析〜書籍の紹介と書籍で紹介しきれなかった事例の紹介〜
Avatar for Ryo YOSHI welliving
2
300
バックエンドエンジニアによる Amebaブログ K8s 基盤への CronJobの導入・運用経験
Avatar for suna-big sunabig
0
170
新卒エンジニアのプルリクエスト with AI駆動
Avatar for Yuta Fukunaga fukunaga2025
0
230
Cap'n Webについて
Avatar for Yusuke Wada yusukebe
0
140
モデル駆動設計をやってみよう ワークショップ開催報告(Modeling Forum2025) / model driven design workshop report
Avatar for haru860 haru860
0
270
AI時代を生き抜く 新卒エンジニアの生きる道
Avatar for coconala_engineer coconala_engineer
1
360
ハイパーメディア駆動アプリケーションとIslandアーキテクチャ: htmxによるWebアプリケーション開発と動的UIの局所的適用
Avatar for Ryota Nakamura nowaki28
0
430

Featured

See All Featured
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
1
1.5k
Done Done
Avatar for chrislema chrislema
186
16k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
Marketing to machines
Avatar for Jono Alderson jonoalderson
1
4.3k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.1k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4.1k
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
1
200
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.6k
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
52
5.8k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
54k
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
180
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.4k

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay