Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What, who, when and how of software development

What, who, when and how of software development

Slides used for GDG Asturias DevFest 2018 talk about Bitergia, GrimoireLab and Software Development Analytics



December 01, 2018


  1. Software Development Analytics What, who, when and how of software

    development J. Manrique López de la Fuente @jsmanrique / @bitergia jsmanrique@bitergia.com DevFest Asturias - Gijón - Dec., 2018
  2. A long time ago, in this same building ...

  3. Overhead projector, used during lessons in a classroom. Typ: favorit

    master 625, made by Liesegang, Düsseldorf. By mailer_diablo
  4. Digital Transformation Digital Transformation

  5. You’ll become a technology company, if you are not yet

    Your software infrastructure is one of your company’s key assets Digital Transformation
  6. Software Infrastructure Management Software Infrastructure Dev. Management

  7. Software Infrastructure Management Software infra.

  8. Software Infrastructure Management Open Source Software Software infra.

  9. Software Infrastructure Management Inner Source Software Software infra.

  10. Software Infrastructure Management Open Source Software Inner Source Software Software

  11. Software Infrastructure Management Open Source Program Office todogroup.org Inner Source

    Program Office innersourcecommons.org www.meetup.com/es-ES/innersource-spain/
  12. Open environments Openess everywhere

  13. Who is contributing to the projects? How much/what/where are they

    contributing*? Who is driving successful projects? Who is behind a project? How welcoming is a project? Questions for open source projects
  14. Which projects are more community attractive? Are projects retaining contributors?

    Are projects community-driven or enterprise-driven? How diverse is your community? Who are projects top contributors? Where does my community come from? Where else my community contributes? Questions for communities
  15. How fast are we dealing with feedback (issues, requests, comments)?

    How long does it take to add new features? Are people engaged with the project/company? Is the project/company allowing innovation? Questions for collaborative project
  16. Questions

  17. “Without data, you are just another person with an opinion”

    W. Edwards Deming
  18. In other words...

  19. Software Development Analytics Software Development Analytics

  20. “collecting data is only the first step toward wisdom ...”

    Henry Louis Gates Jr.
  21. Software Development Analytics Data sources supported by Bitergia Analytics

  22. GrimoireLab / Bitergia Analytics Software Development Analytics

  23. GrimoireLab / Bitergia Analytics (Python packages) $ pip install grimoirelab

    Let’s have some fun: bit.ly/perceval-colab Software Development Analytics
  24. GrimoireLab / Bitergia Analytics (Single Docker image) $ docker run

    -p \ -v $(pwd)/credentials.cfg:/mordred-override.cfg \ -t grimoirelab/full Credentials file: [github] api-token = XXX Software Development Analytics
  25. GrimoireLab / Bitergia Analytics (set of Docker images) $ git

    clone https://gitlab.com/Bitergia/lab/analytics-demo $ cd analytics-demo Review and modify configurations files: projects.json setup.cfg $ docker-compose up -d Software Development Analytics
  26. CHAOSS

  27. Join us! #GrimoireLab in irc.freenode.net bit.ly/grimoirelab-mailman chaoss.github.com/grimoirelab @GrimoireLab #GrimoireLab

  28. “collecting data is only the first step toward wisdom, but

    sharing data is the first step toward community” Henry Louis Gates Jr.
  29. Software Development Analytics

  30. Software Development Analytics

  31. “Strategy without tactics is the slowest route to victory. Tactics

    without strategy is the noise before defeat” Sun Tzu
  32. Goals - Questions - Metrics & Deming Circle

  33. Goals Transparency Self Awareness Governance Motivational ...

  34. Activity Questions How much… (code, tests, communication, review…) When... (patterns,

    time zones, trends…) Where… (by module, by company, by activity...) Deviations… (differential analysis, gaps…) Organization… (sequences of activity…) …
  35. Activity Community Questions How many… (by role, by company, by

    experience…) How important… (bus factor, core/regular/casual…) Where are they working… (by activity, by code area…) How skilled… (experience, mentoring, efficiency….) How long… (attraction, retention, patterns…) ...
  36. Activity Community Processes Questions How is people doing… (fix bugs,

    code review...) How long is taking… (fix bugs, attend contributions…) What is missing… (backlog of open code reviews...) How is performance... (test coverage, bug density, issue throughput...) Where are problems… (bottlenecks, process technical debt…) ...
  37. Activity Metrics

  38. Activity Metrics

  39. Activity Metrics

  40. Activity Community Metrics Onion Analysis New contributors

  41. Activity Community Metrics

  42. Activity Community Metrics

  43. Activity Community Metrics

  44. Activity Community Processes Metrics GitHub Pull Requests Median Open Days

    Uber: 4h Non Uber: 1d
  45. Activity Community Processes Metrics

  46. Activity Community Processes Metrics

  47. “Human beings adjust behavior based on the metrics they’re held

    against. Anything you measure will impel a person to optimize his score on that metric. What you measure is what you’ll get. Period” You Are What You Measure by Dan Ariely
  48. Plan - Do - Check - Act Christoph Roser at

  49. What’s next? What’s next?

  50. CHAOSS Community Health Analytics for Open Source Software chaoss.community GrimoireLab

    is one of CHAOSS software projects chaoss.github.io/grimoirelab CHAOSSCon Europe - Brussels - Feb, 1st, 2019
  51. Software Development Analytics For Your Peace of Mind About us

  52. “To measure is to know” “If you can not measure

    it, you cannot improve it” Lord Kelvin
  53. bitergia.com

  54. J. Manrique López de la Fuente CEO at Bitergia jsmanrique@bitergia.com

    Let’s go for questions!