Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Tracking Service Infrastructure at Scale

Avatar for John Arthorne John Arthorne
March 13, 2017
Technology
1
480

Tracking Service Infrastructure at Scale

Talk from SRECon North America 2017 on tracking and automating service infrastructure at Shopify

Avatar for John Arthorne

John Arthorne

March 13, 2017
Tweet

More Decks by John Arthorne

See All by John Arthorne
Expect the Unexpected: Preparing SRE Teams for Responding to Novel Failures
Avatar for John Arthorne jarthorn
0
370
Black Friday: Lessons in Resiliency and Incident Response at Shopify
Avatar for John Arthorne jarthorn
0
430
Operating Systems in Cloud City
Avatar for John Arthorne jarthorn
0
370
Tracking and automating software infrastructure with GitHub
Avatar for John Arthorne jarthorn
0
520
Slack Superpowers
Avatar for John Arthorne jarthorn
0
410
Continuous Delivery at Shopify
Avatar for John Arthorne jarthorn
0
900
Planetary Scale Web Architecture: A Gentle Introduction
Avatar for John Arthorne jarthorn
1
330
DevOps Toronto 2016: Scaling out Continuous Delivery
Avatar for John Arthorne jarthorn
1
880
DevOps Vancouver 2016: Scaling out Continuous Delivery
Avatar for John Arthorne jarthorn
0
660

Other Decks in Technology

See All in Technology
英語は話せません！それでも海外チームと信頼関係を作るため、対話を重ねた2ヶ月間のまなび
Avatar for ニイオカ niioka_97
0
130
Wasmのエコシステムを使った ツール作成方法
Avatar for asuka askua
0
110
生成AIで「お客様の声」を ストーリーに変える 新潮流「Generative ETL」
Avatar for Satoru Ishikawa ishikawa_satoru
1
370
能登半島災害現場エンジニアクロストーク 【JAWS FESTA 2025 in 金沢】
Avatar for Masakatsu Sugii ditccsugii
0
230
後進育成のしくじり〜任せるスキルとリーダーシップの両立〜
Avatar for mtskhs matsu0228
7
3.2k
AIツールでどこまでデザインを忠実に実装できるのか
Avatar for Oikon oikon48
6
3.1k
M5製品で作るポン置きセルラー対応カメラ
Avatar for Hisaya OKADA sayacom
0
170
Reflections of AI: A Trilogy in Four Parts (GOTO; Copenhagen 2025)
Avatar for Rasmus Lystrøm ondfisk
0
110
ユーザーの声とAI検証で進める、プロダクトディスカバリー
Avatar for SansanTech sansantech
PRO
1
110
「れきちず」のこれまでとこれから - 誰にでもわかりやすい歴史地図を目指して / FOSS4G 2025 Japan
Avatar for Hajime Kato hjmkth
1
200
ACA でMAGI システムを社内で展開しようとした話
Avatar for Yuji Masaoka | まっぴぃ mappie_kochi
1
310
【Kaigi on Rails 事後勉強会LT】MeはどうしてGirlsに？ 私とRubyを繋いだRail(s)
Avatar for joy joyfrommasara
0
220

Featured

See All Featured
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
33
8.9k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
54
3k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
53
9k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
45
7.7k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
1.6k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k
Designing for Performance
Avatar for Lara Hogan lara
610
69k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
657
61k
Code Review Best Practice
Avatar for Trisha Gee trishagee
72
19k
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
79
6k

Transcript

  1. None
  2. None

  3. A startup building hosted software for commerce Facing rapid growth

    in customers, RPM, devs, deploys

  4. Still growing fast, things on fire all the time Production

    Engineering to the rescue!

  5. Still in “double all the things” mode SRE mindset helped

    us get ahead of the growth Concern is more about growth rate than actual #’s
  6. None
  7. None
  8. None
  9. None
  10. None
  11. None
  12. None

  13. • • • ➢

  14. None
  15. None

  16. Collective Ownership in common Ability to deliver with high speed

    Works well in small teams No specialized roles Authoritarian No change without permission Bureaucratic, slow, safe The norm in massive orgs Highly specialized roles Shopify 2015 Shopify 2017

  17. • • •

  18. None
  19. None

  20. • • •

  21. Tier Impact Needs 1 Critical Playbooks, defined SLO, resiliency patterns,

    DC failover, scheduled load tests, security reviews 2 Important On call, monitoring with alerts, metrics instrumentation, dedicated DB, load tested, rolling deploy (preboot) 3 Useful >1 owner, deploy automation, CI, standard dev setup, uptime monitor, bugsnag, log retention, backups, SSL 4 Experiments Owner, Security bugs, resolve outages
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Office Hours Keep In Touch - -