Defining a Metrics Strategy and Measuring Collaboration

Presentation at the InnerSource Commons in Stuttgart by Daniel Izquierdo Cortázar.

No metric is important but that one that is directly linked to the strategic goals of your company. Success is basically measured when the goals are achieved. Measuring things is 'easy' if you know where to mine the data, but having a strategy requires context expertise, a detailed method to formalize the measuring process and a strategy regarding to awareness, process improvement, transparency and motivational actions among other key areas. Metrics are not the panacea, but help to understand the current structure and methodology followed by a software development team. And how far this is from other similar organizations. Topics include:
* Goals using metrics
* Areas of analysis
* A formal approach such as the Goal-Question-Metric one
* Strategy when using metrics
* Some examples

Breaking silos and foster collaboration across the several business units is one of the main goals of any InnerSource inititive. However, how can we know if this is actually taking place? This talk will also focus on the usual data sources available when building the infrastructure needed in this types of initiatives and the traces left by the members of the new community. Those traces are the ones parsed, stored and curated in order to produce valuable metrics for the organization. I will go through the usual data sources such as GitHub, Jira or Slack as some examples of how to understand and measure collaboration across the organization.

Transcript

1. Defining a Metrics Strategy InnerSource Commons, Renningen. May 2018 Daniel Izquierdo dizquierdo@bitergia.com @dizquierdo speakerdeck.com/bitergia
2. What’s the most important metric for you?
3. What’s the most important metric for you? Hint: Don’t think (just) of commits, files or lines of code!
4. What’s the most important metric for you? And for your manager?
5. What’s the most important metric for you? And for your manager? And for QA?
6. Do we have the complete picture?
11. Datasets are everywhere Overwhelming task What’s the right metric to use?
12. GrimoireLab data sources grimoirelab.github.io
14. Why?
15. Why? Why do we need metrics?
16. Why do we need metrics? Awareness
17. Why do we need metrics? Awareness Lead a change
18. Why do we need metrics? Awareness Lead a change Motivational
19. In InnerSource we may face any of those three stages at any point in our trip
20. What?
21. What? What can we measure?
22. What can we measure? Activity
23. What can we measure? Activity Community
24. What can we measure? Activity Community Process
25. What can we measure? Activity Community Process Code
26. How?
27. How? How can we measure this?
28. How can we measure? Method Goal Question Metric Approach Objective and Key Results
29. How can we measure? Method Documentation Documentation Documentation Documentation Documentation
30. How can we measure? Method Strategy
31. How can we measure? Method Strategy C-level Middle management Contributors
32. How can we measure? Method Strategy For how long is a metric useful? => link to goals
33. How can we measure? Method Strategy For how long is a metric useful? => link to goals For how long is a goal useful?
34. How can we measure? Method Strategy Infra
35. When?
36. When? When do we start?
37. When do we start? Mature Org Transparency Aligned Interests
38. When do we start? “The principles must be understood” Erin Bank, CA Technologies
39. Summary Why, what, how, and when
40. Summary Why, what, how, and when Next step: use case
41. Use Case: Collaboration Please in the following: Chatham House Rule
42. Bonus
43. Tooling: GrimoireLab, 100% Open Source grimoirelab.github.io
44. commit e065f08d71609de44151ecdd9d9cb152dbf8713b ... Author: Daniel Izquierdo <dizquierdo@bitergia.com> AuthorDate: Thu May 26 19:34:07 2016 +0200 Commit: Daniel Izquierdo <dizquierdo@bitergia.com> CommitDate: Thu May 26 19:34:07 2016 +0200 Add module to deal with format and unification of data Methods receive as entry a pandas.DataFrame. Those return a new dataframe with some basic formatting activity such as adding, removing, filling and dates formatting. :000000 100644 0000000... 18e533f... A format.py :000000 100644 0000000... e69de29... A tests/__init__.py :000000 100644 0000000... d8685c1... A tests/run_tests.py :000000 100644 0000000... ab74263... A tests/test_format.py 113 0 format.py 0 0 tests/__init__.py 30 0 tests/run_tests.py 55 0 tests/test_format.py
45. grimoirelab.github.io Python Interpreter
46. https://opnfv.biterg.io
47. cauldron.io Or produce an internal SaaS service as in Cauldron.io
48. Community Health Analytics for Open Source Software Is the audience interested in discussing about metrics? chaoss.community
49. Mordred Perceval Arthur SortingHat Sigils Manuscripts Kibiter GELK Kidash
50. Bonus: Gitbook for InnerSource Metrics GitBook/GitHub (CC-BY-SA) Looking for public use cases http://bit.ly/isbook-html
51. Summary
52. Summary Why What How When Use Case Collaboration CHAOSS InnerSource WG?
53. Defining a Metrics Strategy InnerSource Commons, Renningen. May 2018 Daniel Izquierdo dizquierdo@bitergia.com @dizquierdo speakerdeck.com/bitergia