What, who, when and how of software development

Slides used for GDG Asturias DevFest 2018 talk about Bitergia, GrimoireLab and Software Development Analytics

Transcript

1. Software Development Analytics
   What, who, when and how of software development
   J. Manrique López de la Fuente
   @jsmanrique / @bitergia
   jsmanrique@bitergia.com
   DevFest Asturias - Gijón - Dec., 2018
   

   View Slide

2. A long time ago, in this same
   building ...
   

   View Slide

3. Overhead projector, used during lessons in a classroom. Typ: favorit master 625,
   made by Liesegang, Düsseldorf. By mailer_diablo
   

   View Slide

4. Digital Transformation
   Digital Transformation
   

   View Slide

5. You’ll become a technology company, if
   you are not yet
   Your software infrastructure is one of
   your company’s key assets
   Digital
   Transformation
   

   View Slide

6. Software Infrastructure Management
   Software Infrastructure Dev. Management
   

   View Slide

7. Software
   Infrastructure
   Management
   Software
   infra.
   

   View Slide

8. Software
   Infrastructure
   Management
   Open Source
   Software
   Software
   infra.
   

   View Slide

9. Software
   Infrastructure
   Management
   Inner Source
   Software
   Software
   infra.
   

   View Slide

10. Software
    Infrastructure
    Management
    Open Source
    Software
    Inner Source
    Software
    Software
    infra.
    

    View Slide

11. Software
    Infrastructure
    Management
    Open Source Program Office
    todogroup.org
    Inner Source Program Office
    innersourcecommons.org
    www.meetup.com/es-ES/innersource-spain/
    

    View Slide

12. Open
    environments
    Openess everywhere
    

    View Slide

13. Who is contributing to the projects?
    How much/what/where are they contributing*?
    Who is driving successful projects?
    Who is behind a project?
    How welcoming is a project?
    Questions for
    open source
    projects
    

    View Slide

14. Which projects are more community attractive?
    Are projects retaining contributors?
    Are projects community-driven or enterprise-driven?
    How diverse is your community?
    Who are projects top contributors?
    Where does my community come from?
    Where else my community contributes?
    Questions for
    communities
    

    View Slide

15. How fast are we dealing with feedback (issues, requests, comments)?
    How long does it take to add new features?
    Are people engaged with the project/company?
    Is the project/company allowing innovation?
    Questions for
    collaborative
    project
    

    View Slide

16. Questions
    

    View Slide

17. “Without data, you are
    just another person with
    an opinion”
    W. Edwards Deming
    

    View Slide

18. In other words...
    

    View Slide

19. Software Development Analytics
    Software Development Analytics
    

    View Slide

20. “collecting data is only the first step
    toward wisdom ...”
    Henry Louis Gates Jr.
    

    View Slide

21. Software
    Development
    Analytics
    Data sources supported by Bitergia Analytics
    

    View Slide

22. GrimoireLab / Bitergia Analytics
    Software
    Development
    Analytics
    

    View Slide

23. GrimoireLab / Bitergia Analytics (Python packages)
    $ pip install grimoirelab
    Let’s have some fun: bit.ly/perceval-colab
    Software
    Development
    Analytics
    

    View Slide

24. GrimoireLab / Bitergia Analytics (Single Docker image)
    $ docker run -p 127.0.0.1:5601:5601 \
    -v $(pwd)/credentials.cfg:/mordred-override.cfg \
    -t grimoirelab/full
    Credentials file:
    [github]
    api-token = XXX
    Software
    Development
    Analytics
    

    View Slide

25. GrimoireLab / Bitergia Analytics (set of Docker images)
    $ git clone https://gitlab.com/Bitergia/lab/analytics-demo
    $ cd analytics-demo
    Review and modify configurations files:
    projects.json
    setup.cfg
    $ docker-compose up -d
    Software
    Development
    Analytics
    

    View Slide

26. CHAOSS
    

    View Slide

27. Join us!
    #GrimoireLab in
    irc.freenode.net
    bit.ly/grimoirelab-mailman
    chaoss.github.com/grimoirelab @GrimoireLab
    #GrimoireLab
    

    View Slide

28. “collecting data is only the first step
    toward wisdom, but sharing data is
    the first step toward community”
    Henry Louis Gates Jr.
    

    View Slide

29. Software
    Development
    Analytics
    

    View Slide

30. Software
    Development
    Analytics
    

    View Slide

31. “Strategy without tactics is the
    slowest route to victory. Tactics
    without strategy is the noise before
    defeat”
    Sun Tzu
    

    View Slide

32. Goals - Questions - Metrics
    &
    Deming Circle
    

    View Slide

33. Goals
    Transparency
    Self Awareness
    Governance
    Motivational
    ...
    

    View Slide

34. Activity
    Questions
    How much…
    (code, tests, communication, review…)
    When...
    (patterns, time zones, trends…)
    Where…
    (by module, by company, by activity...)
    Deviations…
    (differential analysis, gaps…)
    Organization…
    (sequences of activity…)
    …
    

    View Slide

35. Activity
    Community
    Questions
    How many…
    (by role, by company, by experience…)
    How important…
    (bus factor, core/regular/casual…)
    Where are they working…
    (by activity, by code area…)
    How skilled…
    (experience, mentoring, efficiency….)
    How long…
    (attraction, retention, patterns…)
    ...
    

    View Slide

36. Activity
    Community
    Processes
    Questions
    How is people doing…
    (fix bugs, code review...)
    How long is taking…
    (fix bugs, attend contributions…)
    What is missing…
    (backlog of open code reviews...)
    How is performance...
    (test coverage, bug density, issue
    throughput...)
    Where are problems…
    (bottlenecks, process technical debt…)
    ...
    

    View Slide

37. Activity
    Metrics
    

    View Slide

38. Activity
    Metrics
    

    View Slide

39. Activity
    Metrics
    

    View Slide

40. Activity
    Community
    Metrics
    Onion Analysis
    New contributors
    

    View Slide

41. Activity
    Community
    Metrics
    

    View Slide

42. Activity
    Community
    Metrics
    

    View Slide

43. Activity
    Community
    Metrics
    

    View Slide

44. Activity
    Community
    Processes
    Metrics
    GitHub Pull Requests Median Open Days
    Uber: 4h Non Uber: 1d
    

    View Slide

45. Activity
    Community
    Processes
    Metrics
    

    View Slide

46. Activity
    Community
    Processes
    Metrics
    

    View Slide

47. “Human beings adjust behavior based on
    the metrics they’re held against. Anything
    you measure will impel a person to
    optimize his score on that metric. What you
    measure is what you’ll get. Period”
    You Are What You Measure by Dan Ariely
    

    View Slide

48. Plan - Do -
    Check - Act
    Christoph Roser at AllAboutLean.com
    

    View Slide

49. What’s next?
    What’s next?
    

    View Slide

50. CHAOSS
    Community Health Analytics for Open Source Software
    chaoss.community
    GrimoireLab is one of CHAOSS software projects
    chaoss.github.io/grimoirelab
    CHAOSSCon Europe - Brussels - Feb, 1st, 2019
    

    View Slide

51. Software Development Analytics
    For Your Peace of Mind
    About us
    Bitergia
    

    View Slide

52. “To measure is to know”
    “If you can not measure it,
    you cannot improve it”
    Lord Kelvin
    

    View Slide

53. bitergia.com
    

    View Slide

54. J. Manrique López de la Fuente
    CEO at Bitergia
    jsmanrique@bitergia.com
    Let’s go for questions!
    

    View Slide