The quantitative state of OPNFV

The quantitative state of OPNFV

Presentation at the OPNFV Design Summit in Berlin, on June 20th 2016.

Transcript

  1. The Quantitative State of OPNFV Jesus M. Gonzalez-Barahona jgb@bitergia.com @jgbarah

    Bitergia / URJC This slidedeck: http://speakerdeck.com/jgbarah OPNFV Design Summit Berlin (Germany), June 20th 2016 Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 1 / 53
  2. Open Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June

    2016 2 / 53
  3. Software development http://xkcd.com/844/ Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of

    OPNFV June 2016 3 / 53
  4. Analytics https://en.wikipedia.org/wiki/Charles_Joseph_Minard Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV

    June 2016 4 / 53
  5. OPNFV Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June

    2016 5 / 53
  6. Open Development Analytics for OPNFV Slidedeck: http://speakerdeck.com/jgbarah Jesus Gonzalez-Barahona (Bitergia)

    The Quantitative State of OPNFV June 2016 6 / 53
  7. Structure of the presentation 1 A bit of context 2

    Data, data, data, and some analysis 3 Activity: what are you doing? 4 Performance is key! 5 Diversity (persons, organizations) 6 Comparisons are odious 7 Bonus track 8 Summary Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 7 / 53
  8. A bit of context Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 8 / 53
  9. Me and my two hats Uni Rey Juan Carlos: LibreSoft

    research team Understanding free, open source software Data analytics approach Bitergia: From research to the real world Understanding software development Data analytics approach http://gsyc.es/~jgb Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 9 / 53
  10. The company The software development analytics company dashboards reports consultancy

    ... http://bitergia.com Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 10 / 53
  11. Data, data, data, and some analysis Jesus Gonzalez-Barahona (Bitergia) The

    Quantitative State of OPNFV June 2016 11 / 53
  12. Open development analytics for OPNFV All the data presented in

    this talk is available online!!! And much more... Note: data does for late June and Q2 is still missing Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 12 / 53
  13. The OPNFV dashboard http://projects.bitergia.com/opnfv Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 13 / 53
  14. The OPNFV reports https://wiki.opnfv.org/display/DEV/Quarterly+Reports Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 14 / 53
  15. The Bitergia Analytics dashboard (WIP) https://dashboard.bitergia.com/opnfv Jesus Gonzalez-Barahona (Bitergia) The

    Quantitative State of OPNFV June 2016 15 / 53
  16. Transparency analysis Data sources available: Source code management (git) Code

    review (Gerrit) Issue tracking (Jira) Mailing lists Instant messaging (IRC) Questions & answers (Askbot) Automated testing (Jenkins) Visualizations, data, and analytics available from the project Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 16 / 53
  17. Activity: what are you doing? Jesus Gonzalez-Barahona (Bitergia) The Quantitative

    State of OPNFV June 2016 17 / 53
  18. Git: commits over time Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 18 / 53
  19. Git: active authors over time Jesus Gonzalez-Barahona (Bitergia) The Quantitative

    State of OPNFV June 2016 19 / 53
  20. Git: active authors over time (by participation) Jesus Gonzalez-Barahona (Bitergia)

    The Quantitative State of OPNFV June 2016 20 / 53
  21. Code review (top: changesets, bottom: submitters) Jesus Gonzalez-Barahona (Bitergia) The

    Quantitative State of OPNFV June 2016 21 / 53
  22. Tickets (closed / opened) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 22 / 53
  23. Mailing lists (top: messages, bottom: senders) Jesus Gonzalez-Barahona (Bitergia) The

    Quantitative State of OPNFV June 2016 23 / 53
  24. IRC (top: messages, bottom: identities) Jesus Gonzalez-Barahona (Bitergia) The Quantitative

    State of OPNFV June 2016 24 / 53
  25. Performance is key! Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of

    OPNFV June 2016 25 / 53
  26. Review: Changesets per status Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 26 / 53
  27. Review: pending changesets / actors Jesus Gonzalez-Barahona (Bitergia) The Quantitative

    State of OPNFV June 2016 27 / 53
  28. Review: Patchsets per changeset Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 28 / 53
  29. Review: Time to merge, days Jesus Gonzalez-Barahona (Bitergia) The Quantitative

    State of OPNFV June 2016 29 / 53
  30. Review: Time open, days (top: 50%, bottom: 85%) Time open

    for May 2016: 0.21 (50%), 5.04 (85%) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 30 / 53
  31. Review: Time waiting for reviewer, days Jesus Gonzalez-Barahona (Bitergia) The

    Quantitative State of OPNFV June 2016 31 / 53
  32. Review: Time waiting for submitter, days Jesus Gonzalez-Barahona (Bitergia) The

    Quantitative State of OPNFV June 2016 32 / 53
  33. Review: current active backlog by month, week Jesus Gonzalez-Barahona (Bitergia)

    The Quantitative State of OPNFV June 2016 33 / 53
  34. Review: changesets (efficiency) Efficiency: fraction of changesets abandoned or merged

    with respect to those opened Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 34 / 53
  35. Tickets (efficiency) Efficiency: fraction of tickets closed with respect to

    those opened Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 35 / 53
  36. Diversity (persons, organizations) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of

    OPNFV June 2016 36 / 53
  37. Developers (pony factor) 15 developers, 50% commits Jesus Gonzalez-Barahona (Bitergia)

    The Quantitative State of OPNFV June 2016 37 / 53
  38. Organizations (elephant factor) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of

    OPNFV June 2016 38 / 53
  39. Organizations (elephant factor) 3 organizations, 50% commits Jesus Gonzalez-Barahona (Bitergia)

    The Quantitative State of OPNFV June 2016 39 / 53
  40. Comparisons are odious Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of

    OPNFV June 2016 40 / 53
  41. OpenStack vs OPNFV (first years) OpenStack Launched by Rackspace, NASA

    on July 19th, 2010 21 months: 2010-07 – 2012-03 http://www.openstack.org/blog/ 2010/07/introducing-openstack/ OPNFV Launched by Linux Foundation on September 30th, 2014 21 months: 2014-10 – 2016-06 https://www.opnfv.org/news-faq/ press-release/2014/09/ telecom-industry-and-vendors-unite-bu Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 41 / 53
  42. Some parameters, 21th month OPNFV OpenStack Commits 8,814 23,293 Commits/mo(a)

    700 1,500 Commits/mo (12mo)(b) 250 → 700 (x2.8) 1,200 → 1,500 (x1.25) Authors 203 452 Authors/mo(a) 80 150 Pony factor(c) 15 26 Elephant factor(d) 3 1 (a) Approximate (b) Approximate three-month average year over year (c) Pony factor: min. number authors with 50% commits (d) Elephant factor: min. number organizations with 50% commits Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 42 / 53
  43. Commits, 21th month (top: OPNFV, bottom: OpenStack) Jesus Gonzalez-Barahona (Bitergia)

    The Quantitative State of OPNFV June 2016 43 / 53
  44. Authors, 21th month (top: OPNFV, bottom: OpenStack) Jesus Gonzalez-Barahona (Bitergia)

    The Quantitative State of OPNFV June 2016 44 / 53
  45. Organizations, 21th month (left: OPNFV, : right: OpenStack) Jesus Gonzalez-Barahona

    (Bitergia) The Quantitative State of OPNFV June 2016 45 / 53
  46. Some parameters, processes OPNFV OpenStack (2016-Q2) (2015-Q4) Time-to-merge (median, days)

    0.30 2.38 Time-to-merge (mean, days) 3.40 11.83 Patchsets per changeset (median, days) 1.0 2.0 Patchsets per changeset (mean, days) 1.79 3.86 Efficiency (changesets) 0.94 0.78 Efficiency (tickets) 0.57 0.44 Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 46 / 53
  47. Bonus track Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV

    June 2016 47 / 53
  48. Testing: Jenkins data (preview) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State

    of OPNFV June 2016 48 / 53
  49. Summary Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June

    2016 49 / 53
  50. Summarizing... OPNFV provides open development analytics: You don’t need others

    to provide conclusions You can do that yourself! Slidedeck: http://speakerdeck.com/jgbarah Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 50 / 53
  51. License c 2016 Bitergia Some rights reserved. This presentation is

    distributed under the “Attribution-ShareAlike 3.0” license, by Creative Commons, available at http://creativecommons.org/licenses/by-sa/3.0/ Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 51 / 53
  52. Credits (1) “Man With Two Hats” Statue by Henk Visch,

    located in Otawa, Canada Picture by Lezumbalaberenjena in Wikimedia Commons License: Public domain https://commons.wikimedia.org/wiki/File: Man_With_Two_Hats_Ottawa_Statue_by_lezumbalaberenjena.jpg “Napoleon’s Russian campaign of 1812” Original by Charles Minard License: Public domain https://en.wikipedia.org/wiki/Charles_Joseph_Minard#/media/File: Minard.png Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 52 / 53
  53. Credits (2) “Aged Come In We’re Open” Picture by Czarina

    Alegre in Flickr License: Creative Commons Attribution 2.0 https://flic.kr/p/fjGamh “Good code” Comic by Randall Munroe, XKCD 844 License: Creative Commons Attribution-NonCommercial 2.5 http://xkcd.com/844/ Charts and tables are derived from Bitergia dashboards and reports for OPNFV Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 53 / 53