Tracking Service Infrastructure at Scale

Talk from SRECon North America 2017 on tracking and automating service infrastructure at Shopify

Transcript

3. A startup building hosted software for commerce Facing rapid growth in customers, RPM, devs, deploys
4. Still growing fast, things on fire all the time Production Engineering to the rescue!
5. Still in “double all the things” mode SRE mindset helped us get ahead of the growth Concern is more about growth rate than actual #’s
13. • • • ➢
16. Collective Ownership in common Ability to deliver with high speed Works well in small teams No specialized roles Authoritarian No change without permission Bureaucratic, slow, safe The norm in massive orgs Highly specialized roles Shopify 2015 Shopify 2017
17. • • •
20. • • •
21. Tier Impact Needs 1 Critical Playbooks, defined SLO, resiliency patterns, DC failover, scheduled load tests, security reviews 2 Important On call, monitoring with alerts, metrics instrumentation, dedicated DB, load tested, rolling deploy (preboot) 3 Useful >1 owner, deploy automation, CI, standard dev setup, uptime monitor, bugsnag, log retention, backups, SSL 4 Experiments Owner, Security bugs, resolve outages
29. Office Hours Keep In Touch - -