Beyond the four most common DevOps metrics

Let's look beyond the four most cited metrics in DevOps and figure out what else could matter or what to do if those are in control.

Originally given at CTO Connection Summit in Chicago - Spring of 2022.

Transcript

1. 1 Beyond the four most common DevOps metrics Michael Stahnke VP Engineering - CircleCI @stahnma
2. @stahnma 8 Years 9 Years 3+ Years
3. 3 @stahnma
4. 4 @stahnma
5. 5 @stahnma
6. 6 @stahnma
7. 7 We are here. @stahnma
8. 8 Do I believe this? @stahnma
9. 9 @stahnma
10. 10 @stahnma
11. 11 Where Is my org? @stahnma
12. 12 We are here. @stahnma
13. 13 I don’t feel elite. @stahnma
14. 14 Why don’t I feel elite? @stahnma
15. 15 What truly is elite? @stahnma
16. 16 Moving fast with confidence. @stahnma
17. 17 Move from IC reported to aggregate. @stahnma
18. https://www.flickr.com/photos/pillarofautumn/13770741955
19. 19 What are the categories of things I care about? @stahnma
20. 20 Is engineering throughput good? @stahnma
21. 21 Is that throughput meaningful? @stahnma
22. 22 If I add more engineers, will we go faster? 
 
 Can I prove that? @stahnma
23. 23 Metric Thoughts Layer Cake Quality People Throughput @stahnma
24. 24 Throughput measurements @stahnma
25. 25 Deployments / week @stahnma
26. 26 Does adding more developers make things go faster? @stahnma
27. 27 Deploys / Dev / Week @stahnma
28. 28 Deploys / Dev / Week @stahnma
29. 29 1. … @stahnma
30. 30 Ratio of distraction action. @stahnma
31. 31 Narrow vs wide work. @stahnma
32. 32 1. … @stahnma
33. 33 People @stahnma
34. 34 Are our systems easy to work on? @stahnma
35. 35 @stahnma
36. 36 Fungible engineering? @stahnma
37. 37 @stahnma
38. 38 Normalization @stahnma
39. 39 % of code provided by Platform. @stahnma
40. 40 @stahnma
41. 41 How fast are they productive? @stahnma
42. 42 5th contribution (PR) @stahnma
43. 43 Deploys / Dev / Week @stahnma
44. 44 Quality @stahnma
45. 45 Successful Deployments / Week @stahnma
46. 46 Rollbacks 
 (or roll forwards) @stahnma
47. 47 Understanding changes happening all around you @stahnma
48. 48 @stahnma
49. 49 Metric Thoughts Layer Cake Throughput People Quality @stahnma
50. 50 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions Metric Metric Metric Themes @stahnma People
51. 51 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions Metric Metric Metric Themes @stahnma People
52. 52 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions Metric Metric Metric Themes @stahnma People
53. 53 Some References GitLab Engineering Metrics The Space of Developer Productivity We put customer experience over organization and architecture. Let 10,000 Flowers Bloom then rip 999 of them out by their roots. @stahnma
54. 54 Thank you Michael Stahnke CircleCI @stahnma Come find me in the break. @stahnma