Beyond the four most common DevOps metrics

Slide 1

Slide 1 text

1 Beyond the four most common DevOps metrics Michael Stahnke VP Engineering - CircleCI @stahnma

Slide 2

Slide 2 text

@stahnma 8 Years 9 Years 3+ Years

Slide 3

Slide 3 text

3 @stahnma

Slide 4

Slide 4 text

4 @stahnma

Slide 5

Slide 5 text

5 @stahnma

Slide 6

Slide 6 text

6 @stahnma

Slide 7

Slide 7 text

7 We are here. @stahnma

Slide 8

Slide 8 text

8 Do I believe this? @stahnma

Slide 9

Slide 9 text

9 @stahnma

Slide 10

Slide 10 text

10 @stahnma

Slide 11

Slide 11 text

11 Where Is my org? @stahnma

Slide 12

Slide 12 text

12 We are here. @stahnma

Slide 13

Slide 13 text

13 I don’t feel elite. @stahnma

Slide 14

Slide 14 text

14 Why don’t I feel elite? @stahnma

Slide 15

Slide 15 text

15 What truly is elite? @stahnma

Slide 16

Slide 16 text

16 Moving fast with confidence. @stahnma

Slide 17

Slide 17 text

17 Move from IC reported to aggregate. @stahnma

Slide 18

Slide 18 text

https://www.flickr.com/photos/pillarofautumn/13770741955

Slide 19

Slide 19 text

19 What are the categories of things I care about? @stahnma

Slide 20

Slide 20 text

20 Is engineering throughput good? @stahnma

Slide 21

Slide 21 text

21 Is that throughput meaningful? @stahnma

Slide 22

Slide 22 text

22 If I add more engineers, will we go faster?     Can I prove that? @stahnma

Slide 23

Slide 23 text

23 Metric Thoughts Layer Cake Quality People Throughput @stahnma

Slide 24

Slide 24 text

24 Throughput measurements @stahnma

Slide 25

Slide 25 text

25 Deployments / week @stahnma

Slide 26

Slide 26 text

26 Does adding more developers make things go faster? @stahnma

Slide 27

Slide 27 text

27 Deploys / Dev / Week @stahnma

Slide 28

Slide 28 text

28 Deploys / Dev / Week @stahnma

Slide 29

Slide 29 text

29 1. … @stahnma

Slide 30

Slide 30 text

30 Ratio of distraction action. @stahnma

Slide 31

Slide 31 text

31 Narrow vs wide work. @stahnma

Slide 32

Slide 32 text

32 1. … @stahnma

Slide 33

Slide 33 text

33 People @stahnma

Slide 34

Slide 34 text

34 Are our systems easy to work on? @stahnma

Slide 35

Slide 35 text

35 @stahnma

Slide 36

Slide 36 text

36 Fungible engineering? @stahnma

Slide 37

Slide 37 text

37 @stahnma

Slide 38

Slide 38 text

38 Normalization @stahnma

Slide 39

Slide 39 text

39 % of code provided by Platform. @stahnma

Slide 40

Slide 40 text

40 @stahnma

Slide 41

Slide 41 text

41 How fast are they productive? @stahnma

Slide 42

Slide 42 text

42 5th contribution (PR) @stahnma

Slide 43

Slide 43 text

43 Deploys / Dev / Week @stahnma

Slide 44

Slide 44 text

44 Quality @stahnma

Slide 45

Slide 45 text

45 Successful Deployments / Week @stahnma

Slide 46

Slide 46 text

46 Rollbacks   (or roll forwards) @stahnma

Slide 47

Slide 47 text

47 Understanding changes happening all around you @stahnma

Slide 48

Slide 48 text

48 @stahnma

Slide 49

Slide 49 text

49 Metric Thoughts Layer Cake Throughput People Quality @stahnma

Slide 50

Slide 50 text

50 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions Metric Metric Metric Themes @stahnma People

Slide 51

Slide 51 text

51 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions Metric Metric Metric Themes @stahnma People

Slide 52

Slide 52 text

52 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions Metric Metric Metric Themes @stahnma People

Slide 53

Slide 53 text

53 Some References GitLab Engineering Metrics The Space of Developer Productivity We put customer experience over organization and architecture. Let 10,000 Flowers Bloom then rip 999 of them out by their roots. @stahnma

Slide 54

Slide 54 text

54 Thank you Michael Stahnke CircleCI @stahnma Come find me in the break. @stahnma