But I don't feel elite: A look beyond DORA

Slide 1

Slide 1 text

But I don’t feel elite:  A look beyond DORA Michael Stahnke VP Engineering at flox (floxdev.com) @stahnma

Slide 2

Slide 2 text

Edu Career 9 Years 8 Years 4 Years A few months

Slide 3

Slide 3 text

@stahnma

Slide 4

Slide 4 text

4 1. … @stahnma

Slide 5

Slide 5 text

5 @stahnma

Slide 6

Slide 6 text

@stahnma

Slide 7

Slide 7 text

@stahnma

Slide 8

Slide 8 text

@stahnma

Slide 9

Slide 9 text

We are here. @stahnma

Slide 10

Slide 10 text

Do I believe this? @stahnma

Slide 11

Slide 11 text

@stahnma

Slide 12

Slide 12 text

@stahnma

Slide 13

Slide 13 text

Where have I found my orgs historically? @stahnma

Slide 14

Slide 14 text

We are here. @stahnma

Slide 15

Slide 15 text

I don’t feel elite. @stahnma

Slide 16

Slide 16 text

Why don’t I feel elite? @stahnma

Slide 17

Slide 17 text

What truly is elite? @stahnma

Slide 18

Slide 18 text

Moving fast with confidence. @stahnma

Slide 19

Slide 19 text

Move from IC reported to aggregate @stahnma

Slide 20

Slide 20 text

Move from reported to derived @stahnma

Slide 21

Slide 21 text

https://www.flickr.com/photos/pillarofautumn/13770741955

Slide 22

Slide 22 text

What are the categories of things I care about? @stahnma

Slide 23

Slide 23 text

Is engineering throughput good? @stahnma

Slide 24

Slide 24 text

Is that throughput meaningful? @stahnma

Slide 25

Slide 25 text

If I add more engineers, will we go faster?     Can I prove that? @stahnma

Slide 26

Slide 26 text

Metric Thoughts Layer Cake Quality People Throughput @stahnma

Slide 27

Slide 27 text

Throughput Measurements @stahnma

Slide 28

Slide 28 text

deployments / week @stahnma

Slide 29

Slide 29 text

Does adding more developers make things go faster? @stahnma

Slide 30

Slide 30 text

deploys / dev / week @stahnma

Slide 31

Slide 31 text

deploys / dev / week @stahnma

Slide 32

Slide 32 text

1. … @stahnma

Slide 33

Slide 33 text

ratio of distraction action @stahnma

Slide 34

Slide 34 text

narrow vs wide work @stahnma

Slide 35

Slide 35 text

1. … @stahnma

Slide 36

Slide 36 text

People @stahnma

Slide 37

Slide 37 text

Are our systems easy to work on? @stahnma

Slide 38

Slide 38 text

@stahnma

Slide 39

Slide 39 text

fungible engineering? @stahnma

Slide 40

Slide 40 text

@stahnma

Slide 41

Slide 41 text

normalization @stahnma

Slide 42

Slide 42 text

% of code provided   by the platform. @stahnma

Slide 43

Slide 43 text

43 @stahnma

Slide 44

Slide 44 text

How quickly are they productive? @stahnma

Slide 45

Slide 45 text

5th contribution (PR) @stahnma

Slide 46

Slide 46 text

deploys / dev / week @stahnma

Slide 47

Slide 47 text

Quality @stahnma

Slide 48

Slide 48 text

successful deployments / week @stahnma

Slide 49

Slide 49 text

rollbacks   (or roll forwards) @stahnma

Slide 50

Slide 50 text

understanding changes happening all around you @stahnma

Slide 51

Slide 51 text

51 @stahnma

Slide 52

Slide 52 text

Metric Thoughts Layer Cake Quality People Throughput @stahnma

Slide 53

Slide 53 text

53 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions @stahnma People Metric Metric Metric Themes

Slide 54

Slide 54 text

54 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions @stahnma People Metric Metric Metric Themes

Slide 55

Slide 55 text

55 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions @stahnma People Metric Metric Metric Themes

Slide 56

Slide 56 text

Summary ● What do you want your metrics to tell you? ● Can you correlate the movement with intentional action and improved outcomes? ● Do you have baseline metrics already? ● How have you joined these up with product management? ● Deploys / Dev / Week is the _one_ I would start with @stahnma

Slide 57

Slide 57 text

Thank You Michael Stahnke flox @stahnma