Tweet
Tweet

Slide 1

Slide 1 text

Expect the Unexpected

Slide 2

Slide 2 text

Help > About John Arthorne ● Developer/Manager/SRE at Shopify Shopify ● Software for Commerce ● 30 → 120 SREs ● Average $1700 GMV / second

Slide 3

Slide 3 text

● ● ● What We’ll Cover

Slide 4

Slide 4 text

high failure novelty rate

Slide 5

Slide 5 text

● ● ●

Slide 6

Slide 6 text

Transparent Response ● ● ●

Slide 7

Slide 7 text

Incident Simulation ● ● ●

Slide 8

Slide 8 text

Game Days ● ● ●

Slide 9

Slide 9 text

Turn Rusty Knobs ● ● ●

Slide 10

Slide 10 text

Automated Failure Tests ● ● ●

Slide 11

Slide 11 text

Software Change Rate People Change Rate High High Low Low

Slide 12

Slide 12 text

Software Change Rate People Change Rate High High Low Low Incident Transparency Automated Tests Game Days Incident Simulations Rusty Knobs

Slide 13

Slide 13 text

novel failures?

Slide 14

Slide 14 text

Magic Recipe for Novel Failures

Slide 15

Slide 15 text

Training Exercise Formula ● ● ● ● ●

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

No content

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

Summing Up

Slide 21

Slide 21 text

Thank You! github.com/jarthorn/lego-incident-response