$30 off During Our Annual Pro Sale. View Details »

Scaling Down (Running Large Sites Locally)

Andrew Godwin
August 05, 2017
Programming
0
200

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

Andrew Godwin

August 05, 2017
Tweet

More Decks by Andrew Godwin

See All by Andrew Godwin
Reconciling Everything
andrewgodwin
1
160
Django Through The Years
andrewgodwin
0
44
Writing Maintainable Software At Scale
andrewgodwin
0
280
A Newcomer's Guide To Airflow's Architecture
andrewgodwin
0
210
Async, Python, and the Future
andrewgodwin
2
510
How To Break Django: With Async
andrewgodwin
1
520
Taking Django's ORM Async
andrewgodwin
0
540
The Long Road To Asynchrony
andrewgodwin
0
470
The Scientist & The Engineer
andrewgodwin
1
510

Other Decks in Programming

See All in Programming
Developing a Vim plugin with Ruby
okuramasafumi
0
230
C++20からC++23までの変化
faithandbrave
5
5k
Microservices: what does good look like? (Nov 2023)
cer
PRO
0
780
「defineCustomElement」を活用した サービス共通のUIコンポーネントライブラリ
piyoppi
0
230
ユーザー登録とログインフォームにautocomplete属性を使いましょう
ivanova1991
2
1.7k
Expo Router は Expo 導入の決め手となるか フロントエンドカンファレンス沖縄2023 @Kaito-Dogi
doggy
3
1.7k
ニジエチューニング2023-12
nijieinfra
0
190
BigQuery のデータ品質やデータ活用を高める Dataplex 等の活用
mot_techtalk
5
980
進化したWeb技術でPWAをネイティブアプリに近づける / frontend-conf-2023
yuhei_fujita
6
2.6k
エンジニアだけでスポンサーブースを出したら大変なことになった
zakky21
1
480
Introducing Kotlin Multiplatform in an existing mobile app - Workshop Edition | DevFest Berlin 23
prof18
0
230
機械学習ソフトウェアにおけるテスト手法
hitsuji1991
PRO
2
1.1k

Featured

See All Featured
Typedesign – Prime Four
hannesfritz
35
1.8k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
318
20k
A Tale of Four Properties
chriscoyier
150
22k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
152
14k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
225
51k
Bootstrapping a Software Product
garrettdimon
PRO
299
110k
A better future with KSS
kneath
230
16k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
53
33k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
44
12k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
656
120k
What the flash - Photography Introduction
edds
64
11k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
24
2k

Transcript

  1. Andrew Godwin

    View Slide

  2. Hi, I’m
    Andrew Godwin

    View Slide

  3. 2013

    View Slide

  4. View Slide

  5. View Slide

  6. 2017

    View Slide

  7. View Slide

  8. ~150 Docker containers

    View Slide

  9. ~24GB of RAM

    View Slide

  10. View Slide

  11. docker-compose

    View Slide

  12. docker-compose

    View Slide

  13. bay

    View Slide

  14. View Slide

  15. View Slide

  16. View Slide

  17. Containers & Links

    View Slide

  18. Django
    Core MySQL Payments
    Audit MySQL
    Redis

    View Slide

  19. Django
    Core MySQL Payments
    Audit MySQL
    Redis

    View Slide

  20. Django
    Core MySQL Payments
    Audit MySQL
    Redis

    View Slide

  21. Django
    Core MySQL
    Redis
    “tiny”

    View Slide

  22. Did it boot yet?

    View Slide

  23. Docker containers run only one thing

    View Slide

  24. View Slide

  25. View Slide

  26. View Slide

  27. What if you don’t have a custom init?

    View Slide

  28. View Slide

  29. Rebuilding is Bad

    View Slide

  30. Rebuilding core is about 10 mins

    View Slide

  31. Mounts (“devmodes”)
    Core mount
    ➜
    Library mount
    ➜

    View Slide

  32. View Slide

  33. Our dependencies change every few hours

    View Slide

  34. Docker images are portable

    View Slide

  35. Pull rather than build

    View Slide

  36. View Slide

  37. What’s Next?

    View Slide

  38. Automated image building

    View Slide

  39. Running images remotely

    View Slide

  40. Running whole stacks remotely

    View Slide

  41. Trying not to reinvent the wheel

    View Slide

  42. github.com/eventbrite/bay

    View Slide

  43. Thanks.
    github.com/eventbrite/bay

    View Slide