What, who, when and how of software development

Slides used for GDG Asturias DevFest 2018 talk about Bitergia, GrimoireLab and Software Development Analytics

Transcript

1. Software Development Analytics What, who, when and how of software development J. Manrique López de la Fuente @jsmanrique / @bitergia jsmanrique@bitergia.com DevFest Asturias - Gijón - Dec., 2018
2. A long time ago, in this same building ...
3. Overhead projector, used during lessons in a classroom. Typ: favorit master 625, made by Liesegang, Düsseldorf. By mailer_diablo
4. Digital Transformation Digital Transformation
5. You’ll become a technology company, if you are not yet Your software infrastructure is one of your company’s key assets Digital Transformation
6. Software Infrastructure Management Software Infrastructure Dev. Management
7. Software Infrastructure Management Software infra.
8. Software Infrastructure Management Open Source Software Software infra.
9. Software Infrastructure Management Inner Source Software Software infra.
10. Software Infrastructure Management Open Source Software Inner Source Software Software infra.
11. Software Infrastructure Management Open Source Program Office todogroup.org Inner Source Program Office innersourcecommons.org www.meetup.com/es-ES/innersource-spain/
12. Open environments Openess everywhere
13. Who is contributing to the projects? How much/what/where are they contributing*? Who is driving successful projects? Who is behind a project? How welcoming is a project? Questions for open source projects
14. Which projects are more community attractive? Are projects retaining contributors? Are projects community-driven or enterprise-driven? How diverse is your community? Who are projects top contributors? Where does my community come from? Where else my community contributes? Questions for communities
15. How fast are we dealing with feedback (issues, requests, comments)? How long does it take to add new features? Are people engaged with the project/company? Is the project/company allowing innovation? Questions for collaborative project
16. Questions
17. “Without data, you are just another person with an opinion” W. Edwards Deming
18. In other words...
19. Software Development Analytics Software Development Analytics
20. “collecting data is only the first step toward wisdom ...” Henry Louis Gates Jr.
21. Software Development Analytics Data sources supported by Bitergia Analytics
22. GrimoireLab / Bitergia Analytics Software Development Analytics
23. GrimoireLab / Bitergia Analytics (Python packages) $ pip install grimoirelab Let’s have some fun: bit.ly/perceval-colab Software Development Analytics
24. GrimoireLab / Bitergia Analytics (Single Docker image) $ docker run -p 127.0.0.1:5601:5601 \ -v $(pwd)/credentials.cfg:/mordred-override.cfg \ -t grimoirelab/full Credentials file: [github] api-token = XXX Software Development Analytics
25. GrimoireLab / Bitergia Analytics (set of Docker images) $ git clone https://gitlab.com/Bitergia/lab/analytics-demo $ cd analytics-demo Review and modify configurations files: projects.json setup.cfg $ docker-compose up -d Software Development Analytics
26. CHAOSS
27. Join us! #GrimoireLab in irc.freenode.net bit.ly/grimoirelab-mailman chaoss.github.com/grimoirelab @GrimoireLab #GrimoireLab
28. “collecting data is only the first step toward wisdom, but sharing data is the first step toward community” Henry Louis Gates Jr.
29. Software Development Analytics
30. Software Development Analytics
31. “Strategy without tactics is the slowest route to victory. Tactics without strategy is the noise before defeat” Sun Tzu
32. Goals - Questions - Metrics & Deming Circle
33. Goals Transparency Self Awareness Governance Motivational ...
34. Activity Questions How much… (code, tests, communication, review…) When... (patterns, time zones, trends…) Where… (by module, by company, by activity...) Deviations… (differential analysis, gaps…) Organization… (sequences of activity…) …
35. Activity Community Questions How many… (by role, by company, by experience…) How important… (bus factor, core/regular/casual…) Where are they working… (by activity, by code area…) How skilled… (experience, mentoring, efficiency….) How long… (attraction, retention, patterns…) ...
36. Activity Community Processes Questions How is people doing… (fix bugs, code review...) How long is taking… (fix bugs, attend contributions…) What is missing… (backlog of open code reviews...) How is performance... (test coverage, bug density, issue throughput...) Where are problems… (bottlenecks, process technical debt…) ...
37. Activity Metrics
38. Activity Metrics
39. Activity Metrics
40. Activity Community Metrics Onion Analysis New contributors
41. Activity Community Metrics
42. Activity Community Metrics
43. Activity Community Metrics
44. Activity Community Processes Metrics GitHub Pull Requests Median Open Days Uber: 4h Non Uber: 1d
45. Activity Community Processes Metrics
46. Activity Community Processes Metrics
47. “Human beings adjust behavior based on the metrics they’re held against. Anything you measure will impel a person to optimize his score on that metric. What you measure is what you’ll get. Period” You Are What You Measure by Dan Ariely
48. Plan - Do - Check - Act Christoph Roser at AllAboutLean.com
49. What’s next? What’s next?
50. CHAOSS Community Health Analytics for Open Source Software chaoss.community GrimoireLab is one of CHAOSS software projects chaoss.github.io/grimoirelab CHAOSSCon Europe - Brussels - Feb, 1st, 2019
51. Software Development Analytics For Your Peace of Mind About us Bitergia
52. “To measure is to know” “If you can not measure it, you cannot improve it” Lord Kelvin
53. bitergia.com
54. J. Manrique López de la Fuente CEO at Bitergia jsmanrique@bitergia.com Let’s go for questions!