Is It Worth It? Four Metrics to Determine Platform Efficiency

A successful platform is normally measured by adoption and usage — important metrics to track to ensure you’re serving your internal customers. From a business perspective, though, you also need to show that your platform delivers a worthy return on the investment your organization makes to build, run, maintain and evolve it. Join CircleCI's VP, Platform, Mike Stahnke in this talk as he walks attendees through four key metrics to determine platform ROI and ways to put them into practice.

(As presented at CTOCraftCon)

Transcript

1. 1 Is it worth it? 4 Metrics to Determine Platform Efficiency Michael Stahnke VP Platform Engineering @stahnma
2. 2 It’s not a silo, it’s a barn. Concentrating your efficiencies into a platform organization. Michael Stahnke VP Platform Engineering @stahnma
3. 3 @stahnma
4. Silo gif 4 @stahnma
5. Stream Aligned Teams 5 @stahnma
6. Collaboration is expensive 6 @stahnma
7. Silo gif 7 @stahnma
8. 8 @stahnma
9. Stream Aligned Teams 9 @stahnma
10. Team that support stream aligned teams. 10 @stahnma
11. Extract the common functions 11 @stahnma
12. What is the ROI of a platform organization? 12 @stahnma
13. Team Payroll divided something? 13 @stahnma
14. Don’t want a cost center mentality. 14 @stahnma
15. Don’t want subsidies. 15 @stahnma
16. The I is easy 16 @stahnma
17. The O is on. Skip it. 17 @stahnma
18. Measuring Returns. 18 @stahnma
19. What is business actively willing to invest in? 19 @stahnma
20. Consult on Security 20 @stahnma
21. Provide cost management 21 @stahnma
22. Drive availability 22 @stahnma
23. Running infrastructure 23 @stahnma
24. Build common libraries to do common things 24 @stahnma
25. 4 Pillars slide 25 @stahnma
26. Annual Revenue / Time. 26 @stahnma
27. 100 million / 525600 = $190.25/min 27 @stahnma
28. Of course that’s not evenly distributed. 28 @stahnma
29. Tackling Costs. 29 @stahnma
30. CoGS. 30 @stahnma
31. This is the easy one. 31 @stahnma
32. 32 @stahnma
33. Security. 33 @stahnma
34. Are you good at security? 34 @stahnma
35. Compliance. 35 @stahnma
36. Don’t want a cost center mentality. 36 @stahnma
37. Map compliance requests to revenue/prospects. 37 @stahnma
38. Cost center again 38 @stahnma
39. Developer Throughput. 39 @stahnma
40. How do we measure developer productivity? 40 @stahnma
41. Some ideas. 41 @stahnma
42. What makes stream aligned teams developers more effective? 42 @stahnma
43. Leverage on tooling. 43 @stahnma
44. Leverage on libraries. 44 @stahnma
45. Leverage on process. 45 @stahnma
46. Diagram of hiring here vs there. 46 @stahnma
47. Diagram of hiring here vs there. 47 @stahnma
48. Diagram of hiring here vs there. 48 @stahnma
49. 49 When is hiring platform developers (enablement/efficiency engineers) more effective than hiring stream aligned developers? @stahnma
50. Sentiment 50 @stahnma
51. Adoption 51 @stahnma
52. Paved road vs water slide. 52 @stahnma
53. Slide that says Summary 53 @stahnma
54. 54 Pillars of Platform Availability Cost for Downtime COGS Cost for Services in support of Gross Margin Security Attach Rate and dollar value for compliance docs and security questionnaires Developer Productivity Hiring Tradeoffs, time to value Developer Sentiment Developer Adoption @stahnma
55. 55 Pillars of Platform Availability Cost for Downtime COGS Cost for Services in support of Gross Margin Security Attach Rate and dollar value for compliance docs and security questionnaires Developer Productivity Hiring Tradeoffs, time to value Developer Sentiment Developer Adoption @stahnma
56. 56 Twitter’s Engineering Effectiveness Let 1,000 Flowers Bloom - http://www.gigamonkeys.com/ flowers/ The SPACE of developer Productivity. Research paper from Nicole Forsgren, GitHub Margaret-Anne Storey, University of Victoria Chandra Maddila, Thomas Zimmermann, Brian Houck, and Jenna Butler, Microsoft Research https://queue.acm.org/detail.cfm?id=3454124 GitLab MR Rate https://about.gitlab.com/handbook/engineering/merge- request-rate/ Further Reading Materials on Developer Productivity @stahnma
57. 57 Thank you Michael Stahnke @stahnma