Tweet
Tweet

Slide 1

Slide 1 text

How do you know your DevEx Efforts are working? Michael Stahnke VP Engineering at Flox (flox.dev) @stahnma

Slide 2

Slide 2 text

Edu Career 2 9 Years 8 Years 4 Years About a Year

Slide 3

Slide 3 text

3 @stahnma

Slide 4

Slide 4 text

4 1. … @stahnma

Slide 5

Slide 5 text

@stahnma

Slide 6

Slide 6 text

@stahnma

Slide 7

Slide 7 text

@stahnma

Slide 8

Slide 8 text

We are here. @stahnma

Slide 9

Slide 9 text

Availability Cost for Downtime COGS Cost for Services in support of Gross Margin Security Attach Rate and dollar value for compliance docs and security questionnaires Developer Productivity Hiring Tradeoffs, time to value, throughput Developer Sentiment Developer Adoption @stahnma

Slide 10

Slide 10 text

Developer Productivity Hiring Tradeoffs, time to value, throughput @stahnma

Slide 11

Slide 11 text

We are here. @stahnma

Slide 12

Slide 12 text

Do I believe this? 12 @stahnma

Slide 13

Slide 13 text

@stahnma

Slide 14

Slide 14 text

@stahnma

Slide 15

Slide 15 text

We are here. @stahnma

Slide 16

Slide 16 text

I don’t feel elite. 16 @stahnma

Slide 17

Slide 17 text

Why don’t I feel elite? 17 @stahnma

Slide 18

Slide 18 text

18 What truly is elite? @stahnma

Slide 19

Slide 19 text

Moving fast with confidence. 19 @stahnma

Slide 20

Slide 20 text

20

Slide 21

Slide 21 text

What are the categories of things I care about? 21 @stahnma

Slide 22

Slide 22 text

Is engineering throughput good? 22 @stahnma

Slide 23

Slide 23 text

Is that throughput meaningful? 23 @stahnma

Slide 24

Slide 24 text

Is that throughput meaningful? 24 @stahnma Exec Team Cares about this

Slide 25

Slide 25 text

If I add more engineers, will we go faster? Can I prove that? 25 @stahnma

Slide 26

Slide 26 text

If I add more engineers, will we go faster? Can I prove that? 26 @stahnma CFO needs this

Slide 27

Slide 27 text

27 Metric Thoughts Layer Cake Quality People Throughput @stahnma

Slide 28

Slide 28 text

28 Throughput Measurements @stahnma

Slide 29

Slide 29 text

deployments / week 29 @stahnma

Slide 30

Slide 30 text

Does adding more developers make things go faster? 30 @stahnma

Slide 31

Slide 31 text

deploys / dev / week 31 @stahnma

Slide 32

Slide 32 text

deploys / dev / week 32 @stahnma

Slide 33

Slide 33 text

33 1. … @stahnma

Slide 34

Slide 34 text

narrow vs wide work 34 @stahnma

Slide 35

Slide 35 text

35 1. … @stahnma

Slide 36

Slide 36 text

36 People @stahnma

Slide 37

Slide 37 text

Are our systems easy to work on? 37 @stahnma

Slide 38

Slide 38 text

38 @stahnma

Slide 39

Slide 39 text

fungible engineering? 39 @stahnma

Slide 40

Slide 40 text

more ^ fungible engineering? 40 @stahnma

Slide 41

Slide 41 text

41 @stahnma

Slide 42

Slide 42 text

normalization 42 @stahnma

Slide 43

Slide 43 text

normalization 43 @stahnma

Slide 44

Slide 44 text

% of code provided by the platform. 44 @stahnma

Slide 45

Slide 45 text

45 @stahnma

Slide 46

Slide 46 text

How quickly are they productive? 46 @stahnma

Slide 47

Slide 47 text

5th contribution (PR) 47 @stahnma

Slide 48

Slide 48 text

deploys / dev / week 48 @stahnma

Slide 49

Slide 49 text

49 Quality @stahnma

Slide 50

Slide 50 text

successful deployments / week 50 @stahnma

Slide 51

Slide 51 text

rollbacks (or roll forwards) 51 @stahnma

Slide 52

Slide 52 text

understanding changes happening all around you 52 @stahnma

Slide 53

Slide 53 text

53 @stahnma

Slide 54

Slide 54 text

54 Metric Thoughts Layer Cake Quality People Throughput @stahnma

Slide 55

Slide 55 text

55 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions @stahnma People Metric Metric Metric Themes

Slide 56

Slide 56 text

56 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions @stahnma People Metric Metric Metric Themes

Slide 57

Slide 57 text

57 Mental Model for Metrics Baseline DevOps Metrics I don’t feel elite. Move Quickly with Confidence Throughput Quality Normalization Fungibility Rollbacks (or forwards) Deployments per Week Deploys / Dev / Week Successful deploys Narrow vs Wide Time to 5th PR Changes Understood Start Status Questions @stahnma People Metric Metric Metric Themes

Slide 58

Slide 58 text

Availability Cost for Downtime COGS Cost for Services in support of Gross Margin Security Attach Rate and dollar value for compliance docs and security questionnaires Developer Productivity Hiring Tradeoffs, time to value, throughput Developer Sentiment Developer Adoption @stahnma

Slide 59

Slide 59 text

Summary 59 @stahnma What do you want your metrics to tell you? Can you correlate the movement with intentional action and improved outcomes? Do you have baseline metrics already? How have you joined these up with product management? Deploys / Dev / Week is the first metric I would start with after traditional DORA/DevOps metric sets

Slide 60

Slide 60 text

60 Twitter’s Engineering Effectiveness Let 1,000 Flowers Bloom - http:// www.gigamonkeys.com/flowers/ The SPACE of developer Productivity. Research paper from Nicole Forsgren, GitHub Margaret-Anne Storey, University of Victoria Chandra Maddila, Thomas Zimmermann, Brian Houck, and Jenna Butler, Microsoft Research https://queue.acm.org/detail.cfm?id=3454124 GitLab MR Rate https://about.gitlab.com/handbook/engineering/ merge-request-rate/ @stahnma

Slide 61

Slide 61 text

flox.dev