Software development analytics

7dddc875546948b5b5094167c90dc10d?s=47 Bitergia
December 19, 2013

Software development analytics

Talk at the Open Source Committee Meeting
Intellectual Property Owners Association, December 19th 2013

7dddc875546948b5b5094167c90dc10d?s=128

Bitergia

December 19, 2013
Tweet

Transcript

  1. 1.

    Bitergia: free / open source software development analytics Jesus M.

    Gonzalez-Barahona jgb@bitergia.com @jgbarah Bitergia / LibreSoft (URJC) Talk at the Open Source Committee Meeting Intellectual Property Owners Association, December 19th 2013 Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 1 / 42
  2. 2.

    c 2012, 2013 Bitergia Some rights reserved. This presentation is

    distributed under the “Attribution-ShareAlike 3.0” license, by Creative Commons, available at http://creativecommons.org/licenses/by-sa/3.0/ Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 2 / 42
  3. 3.

    Structure of the presentation 1 Measuring free / open source

    software development 2 Why software development analytics? 3 Bitergia, the software development analytics company 4 Some examples of project analytics Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 3 / 42
  4. 4.

    Measuring free / open source software development Jesus Gonzalez-Barahona (Bitergia)

    Bitergia: Software development analytics IPO Open Source Meeting 4 / 42
  5. 5.

    A successful development model Free (open source) software has shown

    to be a great success ...but there are many details to be understood ...and (a lot of) interest in understanding ...but there is room for improvement ...and (a lot of) interest in improving Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 5 / 42
  6. 6.

    The importance of the community [Crowd at FOSDEM 2008, by

    Jes´ us Corrius, CC Attribution 2.0] http://www.flickr.com/photos/jcorrius/2302302707/ Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 6 / 42
  7. 7.
  8. 8.

    Understanding / improving free software development Who is interested? Large

    & small free software communities ...and thousands of large & small companies, public administrations, foundations participating in them, depending on their software [Who can afford not to be interested? It is a key strategic need for many actors] Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 8 / 42
  9. 9.

    Understanding / improving free software development Why? Free software is

    more and more important for IT users, producers, integrators It is different & complex, yet transparent, many details are public, and it can be improved Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 9 / 42
  10. 11.

    Measuring, measuring, measuring Information about code, community, development for free

    / open source software projects can usually be retrieved, organized, analyzed Let’s do it! Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 11 / 42
  11. 12.

    Some areas of interest Company participation (beyond copyright notices) Transparency

    (available information) Due diligence (understanding activity) Auditing (certify participation, experience, etc.) Profiling (key people, companies) Neutrality (fair treatment) Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 12 / 42
  12. 13.

    Areas of interest: company participation [Main companies in OpenStack Havana

    (partial view)] http://activity.openstack.org/dash/releases/ Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 13 / 42
  13. 14.

    Areas of interest: company participation [IBM participation in OpenStack Havana

    (partial view)] http://activity.openstack.org/dash/releases/company.html?company=IBM Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 14 / 42
  14. 15.

    Areas of interest: transparency Development communities: companies and developers working

    together Policies, procedures, tools, source code... and development data Do they really provide enough data to enable assesment? Analysis of all repositories (data sources)... ...and associated information (eg: affiliation) Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 15 / 42
  15. 16.

    Areas of interest: due diligence When: Participation in free software

    communities as an asset (maybe a key asset: single-product companies) Dependence on free software projects (for integration, use, ...) What: General issues: activity, reliability of the community, sustainability Specific performance parameters: size, reaction times, growth rate, structure, etc. Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 16 / 42
  16. 17.

    Areas of interest: due diligence [GlusterFS community: Demography analysis] Jesus

    Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 17 / 42
  17. 18.

    Areas of interest: due diligence [Linux kernel: age of developers

    per cohort] http://blog.bitergia.com/2013/02/01/ demographics-of-linux-kernel-developers-how-old-are-they/ Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 18 / 42
  18. 19.

    Areas of interest: due diligence Liferay: time-to-close tickets (quantiles) http://blog.bitergia.com/

    2012/10/25/preview-of-the-analysis-of-liferay/ Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 19 / 42
  19. 20.

    Areas of interest: due diligence [MediaWiki community: tickets-related parameters] Jesus

    Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 20 / 42
  20. 21.

    Areas of interest: auditing [OpenStack top contributors] Jesus Gonzalez-Barahona (Bitergia)

    Bitergia: Software development analytics IPO Open Source Meeting 21 / 42
  21. 22.

    Areas of interest: profiling [oVirt developer profile] Jesus Gonzalez-Barahona (Bitergia)

    Bitergia: Software development analytics IPO Open Source Meeting 22 / 42
  22. 23.

    Areas of interest: neutrality q q q q q q

    q q 0 1 2 3 250 500 1000 2000 4000 Number of accepted reviews Iterations per accepted review (median) [WebKit code review data per company (2012)] Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 23 / 42
  23. 24.

    Bitergia, the software development analytics company Jesus Gonzalez-Barahona (Bitergia) Bitergia:

    Software development analytics IPO Open Source Meeting 24 / 42
  24. 25.

    Bitergia: the company Started operations in July 2012 Builds on

    the experience of LibreSoft R&D group Offering professional products and services Focused on: Metrics about software development (including community metrics) Dashboards and reports for showing, explaining those metrics Consultancy to help to understand, improve software development http://bitergia.com Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 25 / 42
  25. 27.

    Bitergia’s proposals quantitative understanding analytics-guided software development Get advantage of

    the availability of detailed data Facts, not opinions Software & specialized services needed Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 27 / 42
  26. 28.

    Bitergia’s proposals Measuring is a starting point for understanding You

    cannot improve what you cannot measure Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 28 / 42
  27. 29.

    Data has to be extracted, mined Data lives in repositories

    usually not designed to release it easily: tools are needed to retrieve and extract Data includes many complexities and details tools are needed to assist in mining, analysis Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 29 / 42
  28. 31.

    Bitergia services: Grimoire Dashboard Deployment, configuration and maintenance of data

    retrieval tools Deployment and maintenance of dashboard Many panels, different views of the project Charts, summaries, statistic analysis Subscription: unattended daily update of data Example: Dashboard for the Ceph project http://bitergia.com/projects/inktank-ceph-dashboard/browser/ Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 31 / 42
  29. 33.

    Why Bitergia? Value proposal: We tell you about your project

    Good tools for extracting relevant information Good integration with existing systems Good analytics tools, knowledge & expertise Good visualization and reporting system Extensive experience in free software development Tools and methodologies State of the art in research Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 33 / 42
  30. 34.
  31. 35.

    Some analyzed comunities (customers) Openstack (OpenStack Foundation) MediaWiki (Wikimedia Foundation)

    Puppet (Puppet Labs) Ceph (Inktank) oVirt (Red Hat) Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 35 / 42
  32. 38.

    Activity in source code repositories in Puppet http://bitergia.com/projects/puppetlabs-dashboard/browser/ Jesus Gonzalez-Barahona

    (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 38 / 42
  33. 39.
  34. 41.

    In summary If you’re interested in free / open source

    software it’s likely that we can help you! Bitergia: Software development analytics for your peace of mind Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 41 / 42
  35. 42.

    This is the end Have you learned something useful? [Questions,

    comments...] http://bitergia.com Jesus Gonzalez-Barahona (Bitergia) Bitergia: Software development analytics IPO Open Source Meeting 42 / 42