Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Tracking Service Infrastructure at Scale

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for John Arthorne John Arthorne
March 13, 2017
Technology
1
490

Tracking Service Infrastructure at Scale

Talk from SRECon North America 2017 on tracking and automating service infrastructure at Shopify

Avatar for John Arthorne

John Arthorne

March 13, 2017
Tweet

More Decks by John Arthorne

See All by John Arthorne
Expect the Unexpected: Preparing SRE Teams for Responding to Novel Failures
Avatar for John Arthorne jarthorn
0
390
Black Friday: Lessons in Resiliency and Incident Response at Shopify
Avatar for John Arthorne jarthorn
0
440
Operating Systems in Cloud City
Avatar for John Arthorne jarthorn
0
380
Tracking and automating software infrastructure with GitHub
Avatar for John Arthorne jarthorn
0
530
Slack Superpowers
Avatar for John Arthorne jarthorn
0
420
Continuous Delivery at Shopify
Avatar for John Arthorne jarthorn
0
920
Planetary Scale Web Architecture: A Gentle Introduction
Avatar for John Arthorne jarthorn
1
350
DevOps Toronto 2016: Scaling out Continuous Delivery
Avatar for John Arthorne jarthorn
1
910
DevOps Vancouver 2016: Scaling out Continuous Delivery
Avatar for John Arthorne jarthorn
0
670

Other Decks in Technology

See All in Technology
AWS Bedrock Guardrails / 機密情報の入力・出力をブロックする — Blocking Sensitive Information Input/Output
Avatar for Kazuhito Nakayama kazuhitonakayama
2
190
dbt meetup #19 『dbtを『なんとなく動かす』を卒業します』
Avatar for t-hiroto tiltmax3
0
150
LY Tableauでの Tableau x AIの実践 (at Tableau Now! - 2026-02-26)
Avatar for Yoshitaka Arakawa yoshitakaarakawa
0
1.2k
2026-02-25 Tokyo dbt meetup プロダクトと融合したCI/CD で実現する、堅牢なデータパイプラインの作り方
Avatar for Kentaro Yoshida y_ken
0
160
LINE Messengerの次世代ストレージ選定
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
17
7k
型を書かないRuby開発への挑戦
Avatar for Shia riseshia
0
130
All About Sansan – for New Global Engineers
Avatar for Sansan, Inc. sansan33
PRO
1
1.4k
Exadata Fleet Update
Avatar for oracle4engineer oracle4engineer
PRO
0
1.3k
AI が Approve する開発フロー / How AI Reviewers Accelerate Our Development
Avatar for Hiroka Zaitsu zaimy
1
260
メタデータ同期に潜んでいた問題 〜 Cache Stampede 時の Cycle Wait を⾒つけた話
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
140
どこで打鍵するのが良い？ IaCの実行基盤選定について
Avatar for NRI Netcom nrinetcom
PRO
2
110
社内でAWS BuilderCards体験会を立ち上げ、得られた気づき / 20260225 Masaki Okuda
Avatar for SHIFT EVOLVE shift_evolve
PRO
1
150

Featured

See All Featured
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
190
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
59
50k
Ten Tips & Tricks for a 🌱 transition
Avatar for Manu Carrasco Molina stuffmc
0
83
New Earth Scene 8
Avatar for Sydney Stone popppiees
1
1.7k
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
3
110
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
2.8k
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
63
53k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
300
Docker and Python
Avatar for Tania Allard trallard
47
3.8k
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.6k
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
210
Evolving SEO for Evolving Search Engines
Avatar for Ryan Jones ryanjones
0
140

Transcript

  1. None
  2. None

  3. A startup building hosted software for commerce Facing rapid growth

    in customers, RPM, devs, deploys

  4. Still growing fast, things on fire all the time Production

    Engineering to the rescue!

  5. Still in “double all the things” mode SRE mindset helped

    us get ahead of the growth Concern is more about growth rate than actual #’s
  6. None
  7. None
  8. None
  9. None
  10. None
  11. None
  12. None

  13. • • • ➢

  14. None
  15. None

  16. Collective Ownership in common Ability to deliver with high speed

    Works well in small teams No specialized roles Authoritarian No change without permission Bureaucratic, slow, safe The norm in massive orgs Highly specialized roles Shopify 2015 Shopify 2017

  17. • • •

  18. None
  19. None

  20. • • •

  21. Tier Impact Needs 1 Critical Playbooks, defined SLO, resiliency patterns,

    DC failover, scheduled load tests, security reviews 2 Important On call, monitoring with alerts, metrics instrumentation, dedicated DB, load tested, rolling deploy (preboot) 3 Useful >1 owner, deploy automation, CI, standard dev setup, uptime monitor, bugsnag, log retention, backups, SSL 4 Experiments Owner, Security bugs, resolve outages
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Office Hours Keep In Touch - -