Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Tracking Service Infrastructure at Scale

Avatar for John Arthorne John Arthorne
March 13, 2017
Technology
1
480

Tracking Service Infrastructure at Scale

Talk from SRECon North America 2017 on tracking and automating service infrastructure at Shopify

Avatar for John Arthorne

John Arthorne

March 13, 2017
Tweet

More Decks by John Arthorne

See All by John Arthorne
Expect the Unexpected: Preparing SRE Teams for Responding to Novel Failures
Avatar for John Arthorne jarthorn
0
380
Black Friday: Lessons in Resiliency and Incident Response at Shopify
Avatar for John Arthorne jarthorn
0
440
Operating Systems in Cloud City
Avatar for John Arthorne jarthorn
0
370
Tracking and automating software infrastructure with GitHub
Avatar for John Arthorne jarthorn
0
520
Slack Superpowers
Avatar for John Arthorne jarthorn
0
420
Continuous Delivery at Shopify
Avatar for John Arthorne jarthorn
0
910
Planetary Scale Web Architecture: A Gentle Introduction
Avatar for John Arthorne jarthorn
1
330
DevOps Toronto 2016: Scaling out Continuous Delivery
Avatar for John Arthorne jarthorn
1
890
DevOps Vancouver 2016: Scaling out Continuous Delivery
Avatar for John Arthorne jarthorn
0
660

Other Decks in Technology

See All in Technology
Greenは本当にGreenか？ - B/GデプロイとAPI自動テストで安心デプロイ
Avatar for Kaz Watanabe kaz29
1
130
AWS re:Invent 2025 で頻出の 生成 AI サービスをおさらい
Avatar for komakichi komakichi
3
240
Digitization部 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
1
6k
組織の“見えない壁”を越えよ！エンタープライズシフトに必須な3つのPMの「在り方」変革 #pmconf2025
Avatar for Masakazu Inaba masakazu178
1
1k
AS59105におけるFreeBSD EtherIPの運用と課題
Avatar for t-umeda x86taka
0
280
スタートアップの事業成長を支えるアーキテクチャとエンジニアリング
Avatar for どら doragt
1
8.6k
持続可能なアクセシビリティ開発
Avatar for azukiazusa azukiazusa1
6
350
履歴テーブル、今回はこう作りました 〜 Delegated Types編 〜 / How We Built Our History Table This Time — With Delegated Types
Avatar for moznion moznion
0
1.3k
mablでリグレッションテストをデイリー実行するまで #mablExperience
Avatar for 弁護士ドットコム bengo4com
0
410
AIで加速する次世代のBill Oneアーキテクチャ〜成長の先にある軌道修正〜
Avatar for SansanTech sansantech
PRO
1
130
変わるもの、変わらないもの ：OSSアーキテクチャで実現する持続可能なシステム
Avatar for gree_tech gree_tech
PRO
0
1k
セキュリティ対策としての PostgreSQL マイナーバージョンアップ
Avatar for Yuichiro Narita jri_narita
0
110

Featured

See All Featured
Designing Experiences People Love
Avatar for Jonathan Moore moore
142
24k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
194
65k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
34
9k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.3k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
37
2.6k
Code Review Best Practice
Avatar for Trisha Gee trishagee
72
19k
Sharpening the Axe: The Primacy of Toolmaking
Avatar for Bryan Cantrill bcantrill
46
2.6k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4.1k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.6k
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
3
350

Transcript

  1. None
  2. None

  3. A startup building hosted software for commerce Facing rapid growth

    in customers, RPM, devs, deploys

  4. Still growing fast, things on fire all the time Production

    Engineering to the rescue!

  5. Still in “double all the things” mode SRE mindset helped

    us get ahead of the growth Concern is more about growth rate than actual #’s
  6. None
  7. None
  8. None
  9. None
  10. None
  11. None
  12. None

  13. • • • ➢

  14. None
  15. None

  16. Collective Ownership in common Ability to deliver with high speed

    Works well in small teams No specialized roles Authoritarian No change without permission Bureaucratic, slow, safe The norm in massive orgs Highly specialized roles Shopify 2015 Shopify 2017

  17. • • •

  18. None
  19. None

  20. • • •

  21. Tier Impact Needs 1 Critical Playbooks, defined SLO, resiliency patterns,

    DC failover, scheduled load tests, security reviews 2 Important On call, monitoring with alerts, metrics instrumentation, dedicated DB, load tested, rolling deploy (preboot) 3 Useful >1 owner, deploy automation, CI, standard dev setup, uptime monitor, bugsnag, log retention, backups, SSL 4 Experiments Owner, Security bugs, resolve outages
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Office Hours Keep In Touch - -