Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Down (Running Large Sites Locally)

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Andrew Godwin Andrew Godwin
August 05, 2017
Programming
250
0

Scaling Down (Running Large Sites Locally)

A talk I gave at PyCon AU 2017.

Avatar for Andrew Godwin

Andrew Godwin

August 05, 2017

More Decks by Andrew Godwin

See All by Andrew Godwin
Reconciling Everything
Avatar for Andrew Godwin andrewgodwin
1
380
Django Through The Years
Avatar for Andrew Godwin andrewgodwin
0
300
Writing Maintainable Software At Scale
Avatar for Andrew Godwin andrewgodwin
0
510
A Newcomer's Guide To Airflow's Architecture
Avatar for Andrew Godwin andrewgodwin
0
410
Async, Python, and the Future
Avatar for Andrew Godwin andrewgodwin
2
730
How To Break Django: With Async
Avatar for Andrew Godwin andrewgodwin
1
800
Taking Django's ORM Async
Avatar for Andrew Godwin andrewgodwin
0
800
The Long Road To Asynchrony
Avatar for Andrew Godwin andrewgodwin
0
750
The Scientist & The Engineer
Avatar for Andrew Godwin andrewgodwin
1
830

Other Decks in Programming

See All in Programming
GoogleCloudとterraform完全に理解した
Avatar for Terisuke terisuke
1
180
Spec-driven Development: How AI Changes Everything (And Nothing)
Avatar for Simon Martinelli simas
PRO
0
520
Terraform言語の静的解析 / static analysis of Terraform language
Avatar for Kazuma Watanabe wata727
1
120
t *testing.T は どこからやってくるの？
Avatar for Kotaro Otaka otakakot
1
860
Spec-Driven Development with AI Agents (Workshop, May 2026)
Avatar for Anton Arhipov antonarhipov
2
210
PHPer、Cloudflare に引っ越す
Avatar for Suguru Oki / スー suguruooki
1
120
The Past, Present, and Future of Enterprise Java
Avatar for ivargrimstad ivargrimstad
0
340
(Re)make Regexp in Ruby: Democratizing internals for the JIT
Avatar for TSUYUSATO Kitsune makenowjust
3
940
個人的に嬉しかったpnpmの新機能・3選
Avatar for Atsushi Matsuo matsuo_atsushi
0
120
The Less-Told Story of Socket Timeouts
Avatar for Misaki Shioi(塩井美咲/しおい) coe401_
3
860
GNU Makeの使い方 / How to use GNU Make
Avatar for kaityo256 kaityo256
PRO
16
5.6k
UIの境界線をデザインする | React Tokyo #15 メイントーク
Avatar for SASAPIYO sasagar
2
410

Featured

See All Featured
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
270
14k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.7k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
10k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
356
21k
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
340
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
2.9k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
1.6k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
23k
<Decoding/> the Language of Devs - We Love SEO 2024
Avatar for Nikki Halliwell nikkihalliwell
1
200
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
47
8.1k
How To Speak Unicorn (iThemes Webinar)
Avatar for Michelle Schulp Hunt marktimemedia
1
450
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
0
220

Transcript

  1. Andrew Godwin

  2. Hi, I’m Andrew Godwin

  3. 2013

  4. None
  5. None

  6. 2017

  7. None

  8. ~150 Docker containers

  9. ~24GB of RAM

  10. None

  11. docker-compose

  12. docker-compose

  13. bay

  14. None
  15. None
  16. None

  17. Containers & Links

  18. Django Core MySQL Payments Audit MySQL Redis

  19. Django Core MySQL Payments Audit MySQL Redis

  20. Django Core MySQL Payments Audit MySQL Redis

  21. Django Core MySQL Redis “tiny”

  22. Did it boot yet?

  23. Docker containers run only one thing

  24. None
  25. None
  26. None

  27. What if you don’t have a custom init?

  28. None

  29. Rebuilding is Bad

  30. Rebuilding core is about 10 mins

  31. Mounts (“devmodes”) Core mount ➜ Library mount ➜

  32. None

  33. Our dependencies change every few hours

  34. Docker images are portable

  35. Pull rather than build

  36. None

  37. What’s Next?

  38. Automated image building

  39. Running images remotely

  40. Running whole stacks remotely

  41. Trying not to reinvent the wheel

  42. github.com/eventbrite/bay

  43. Thanks. github.com/eventbrite/bay