[2019.04. Meetup] [Talk #1] Chris Young - Business Metrics - The Good The Bad and The Ugly

Transcript

1. Metrics
2. Meh; tricks!
4. Imagined Realities “We cooperate effectively with strangers because we believe in things like gods, nations, money and human rights. Yet none of these things exists outside the stories that people invent and tell one another.” Yuval Noah Harari https://www.ynharari.com/topic/power-and-imagination/
5. Stories
6. Reality Abstracts from Impacts Stories
7. Reality Abstracts from Impacts Stories Quality Value
8. What do we mean by quality?
9. “Quality is Conformance to Requirements” Philip B. Crosby
10. So what are the requirements?
11. What’s the context?
12. Dev Ops Generic Model
13. Dev Ops Generic Model Toyota Lean Metrics IBM RAS Model
14. Lean Metrics • Throughput • Cycle Time • Value / Failure Demand
15. Throughput
16. Cycle Time
17. Value vs Failure Demand
18. Operational Metrics • Reliability • Availability • Serviceability
19. Reliability
20. Defect discovery rate indicates reliability
21. Number of test cases
22. Availability
23. Queue Lengths indicate availability
24. Queue Lengths indicate availability
25. Servicability
26. Liquidity affects serviceability
27. Let me tell you a story
28. More setup Context
29. Stories in the product backlog Inbalanced investment Change diagram to exclude USABILITY
30. Usability • Count of Support tickets raised • Word count of Slack conversations
31. Reliability As the size of the underlying database in the codebase increases we are seeing a correlating increase in the latency for search queries to return. In October it was 2-3 seconds, now in December it is 10-15 seconds.
32. Availability Six of the seven Showstopper defects raised against the platform in the last three months have been caused by the ___ codebase. The most visible of these was the ___ outage. This suggests underlying code quality issues which would need to be addressed before additional functionality was added. Adding new functionality or refactoring existing code is impaired by the lack of up to date unit tests and automated integration tests on the ___ codebase.
33. Serviceability Knowledge of the ___ codebase and the skills required to develop it, C# is limited to ___ engineers. In the CET timezone where we provide Showstopper support there is only one engineer identified being able to work independently on the _____ codebase. In contrast for ___ and ___ there are four.
34. Throughput
35. Throughput - Actual
36. What happened to Throughput?
37. Where does all this data come from?
38. Dev Ops Generic Model Toyota Lean Metrics IBM RAS Model
39. Quality of Measurement Practice Metrics Practice Dev Ops
40. Cleanliness
41. “If you don't think you have a data quality problem then you haven't looked at your data.” Bruce Durling @otfrom https://skillsmatter.com/skillscasts/4106-cascalog-for-the-80-of-data-science
42. Example of dirty data - closed tickets that are not
44. Selection
47. Who is the audience Good data telling the wrong story - make this about selection Shifting left quality Add another example of bias
48. Lisa Crispin Quote What do you do with the information about number of QA defects vs Production defects.
50. Reality Abstracts from Impacts Stories Quality Value
51. Quality of Measurement Practice Metrics Practice Dev Ops
52. Business Value Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
53. “Quality is Conformance to Requirements” Philip B. Crosby
54. Value + “Quality is Conformance to Requirements” Philip B. Crosby
55. Business Need Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
56. Business Need AARRR! - Pirate Metrics Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
58. Reality Abstracts from Impacts Stories Quality Value
60. Business Need AARRR! - Pirate Metrics Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
61. Goals of project - uplift of gym membership
62. Business Need AARRR! - Pirate Metrics Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
63. Cycle Time Forecast with modality
64. Throughput
65. Business Need AARRR! - Pirate Metrics Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
66. Test cases
67. Ops Value Metrics
68. Acquisition by looking at referer Google Analytics?
69. Revenue Repeat Business Apache Logs - Story Map - referral Uplift in gym membership
70. Business Need AARRR! - Pirate Metrics Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
71. Boring standups
72. Business Need AARRR! - Pirate Metrics Metrics Practice Cleanliness, Bias, Selection Dev Throughput, CycleTime, Failure Demand Ops Reliability, Availability, Serviceability
73. Imagined Realities “We cooperate effectively with strangers because we believe in things like gods, nations, money and human rights. Yet none of these things exists outside the stories that people invent and tell one another.” Yuval Noah Harari https://www.ynharari.com/topic/power-and-imagination/
74. “There's the story, then there's the real story, then there's the story of how the story came to be told. Then there's what you leave out of the story. Which is part of the story too.” ― Margaret Atwood, MaddAddam https://www.goodreads.com/photo/author/3472.Margaret_Atwood
75. Read the book: 15% Discount code! tiny.cc/lisbonmetrics