The quantitative state of OPNFV

Slide 1

Slide 1 text

The Quantitative State of OPNFV Jesus M. Gonzalez-Barahona [email protected] @jgbarah Bitergia / URJC This slidedeck: http://speakerdeck.com/jgbarah OPNFV Design Summit Berlin (Germany), June 20th 2016 Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 1 / 53

Slide 2

Slide 2 text

Open Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 2 / 53

Slide 3

Slide 3 text

Software development http://xkcd.com/844/ Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 3 / 53

Slide 4

Slide 4 text

Analytics https://en.wikipedia.org/wiki/Charles_Joseph_Minard Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 4 / 53

Slide 5

Slide 5 text

OPNFV Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 5 / 53

Slide 6

Slide 6 text

Open Development Analytics for OPNFV Slidedeck: http://speakerdeck.com/jgbarah Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 6 / 53

Slide 7

Slide 7 text

Structure of the presentation 1 A bit of context 2 Data, data, data, and some analysis 3 Activity: what are you doing? 4 Performance is key! 5 Diversity (persons, organizations) 6 Comparisons are odious 7 Bonus track 8 Summary Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 7 / 53

Slide 8

Slide 8 text

A bit of context Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 8 / 53

Slide 9

Slide 9 text

Me and my two hats Uni Rey Juan Carlos: LibreSoft research team Understanding free, open source software Data analytics approach Bitergia: From research to the real world Understanding software development Data analytics approach http://gsyc.es/~jgb Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 9 / 53

Slide 10

Slide 10 text

The company The software development analytics company dashboards reports consultancy ... http://bitergia.com Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 10 / 53

Slide 11

Slide 11 text

Data, data, data, and some analysis Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 11 / 53

Slide 12

Slide 12 text

Open development analytics for OPNFV All the data presented in this talk is available online!!! And much more... Note: data does for late June and Q2 is still missing Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 12 / 53

Slide 13

Slide 13 text

The OPNFV dashboard http://projects.bitergia.com/opnfv Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 13 / 53

Slide 14

Slide 14 text

The OPNFV reports https://wiki.opnfv.org/display/DEV/Quarterly+Reports Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 14 / 53

Slide 15

Slide 15 text

The Bitergia Analytics dashboard (WIP) https://dashboard.bitergia.com/opnfv Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 15 / 53

Slide 16

Slide 16 text

Transparency analysis Data sources available: Source code management (git) Code review (Gerrit) Issue tracking (Jira) Mailing lists Instant messaging (IRC) Questions & answers (Askbot) Automated testing (Jenkins) Visualizations, data, and analytics available from the project Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 16 / 53

Slide 17

Slide 17 text

Activity: what are you doing? Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 17 / 53

Slide 18

Slide 18 text

Git: commits over time Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 18 / 53

Slide 19

Slide 19 text

Git: active authors over time Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 19 / 53

Slide 20

Slide 20 text

Git: active authors over time (by participation) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 20 / 53

Slide 21

Slide 21 text

Code review (top: changesets, bottom: submitters) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 21 / 53

Slide 22

Slide 22 text

Tickets (closed / opened) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 22 / 53

Slide 23

Slide 23 text

Mailing lists (top: messages, bottom: senders) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 23 / 53

Slide 24

Slide 24 text

IRC (top: messages, bottom: identities) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 24 / 53

Slide 25

Slide 25 text

Performance is key! Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 25 / 53

Slide 26

Slide 26 text

Review: Changesets per status Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 26 / 53

Slide 27

Slide 27 text

Review: pending changesets / actors Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 27 / 53

Slide 28

Slide 28 text

Review: Patchsets per changeset Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 28 / 53

Slide 29

Slide 29 text

Review: Time to merge, days Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 29 / 53

Slide 30

Slide 30 text

Review: Time open, days (top: 50%, bottom: 85%) Time open for May 2016: 0.21 (50%), 5.04 (85%) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 30 / 53

Slide 31

Slide 31 text

Review: Time waiting for reviewer, days Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 31 / 53

Slide 32

Slide 32 text

Review: Time waiting for submitter, days Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 32 / 53

Slide 33

Slide 33 text

Review: current active backlog by month, week Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 33 / 53

Slide 34

Slide 34 text

Review: changesets (eﬃciency) Eﬃciency: fraction of changesets abandoned or merged with respect to those opened Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 34 / 53

Slide 35

Slide 35 text

Tickets (eﬃciency) Eﬃciency: fraction of tickets closed with respect to those opened Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 35 / 53

Slide 36

Slide 36 text

Diversity (persons, organizations) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 36 / 53

Slide 37

Slide 37 text

Developers (pony factor) 15 developers, 50% commits Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 37 / 53

Slide 38

Slide 38 text

Organizations (elephant factor) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 38 / 53

Slide 39

Slide 39 text

Organizations (elephant factor) 3 organizations, 50% commits Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 39 / 53

Slide 40

Slide 40 text

Comparisons are odious Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 40 / 53

Slide 41

Slide 41 text

OpenStack vs OPNFV (ﬁrst years) OpenStack Launched by Rackspace, NASA on July 19th, 2010 21 months: 2010-07 – 2012-03 http://www.openstack.org/blog/ 2010/07/introducing-openstack/ OPNFV Launched by Linux Foundation on September 30th, 2014 21 months: 2014-10 – 2016-06 https://www.opnfv.org/news-faq/ press-release/2014/09/ telecom-industry-and-vendors-unite-bu Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 41 / 53

Slide 42

Slide 42 text

Some parameters, 21th month OPNFV OpenStack Commits 8,814 23,293 Commits/mo(a) 700 1,500 Commits/mo (12mo)(b) 250 → 700 (x2.8) 1,200 → 1,500 (x1.25) Authors 203 452 Authors/mo(a) 80 150 Pony factor(c) 15 26 Elephant factor(d) 3 1 (a) Approximate (b) Approximate three-month average year over year (c) Pony factor: min. number authors with 50% commits (d) Elephant factor: min. number organizations with 50% commits Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 42 / 53

Slide 43

Slide 43 text

Commits, 21th month (top: OPNFV, bottom: OpenStack) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 43 / 53

Slide 44

Slide 44 text

Authors, 21th month (top: OPNFV, bottom: OpenStack) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 44 / 53

Slide 45

Slide 45 text

Organizations, 21th month (left: OPNFV, : right: OpenStack) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 45 / 53

Slide 46

Slide 46 text

Some parameters, processes OPNFV OpenStack (2016-Q2) (2015-Q4) Time-to-merge (median, days) 0.30 2.38 Time-to-merge (mean, days) 3.40 11.83 Patchsets per changeset (median, days) 1.0 2.0 Patchsets per changeset (mean, days) 1.79 3.86 Eﬃciency (changesets) 0.94 0.78 Eﬃciency (tickets) 0.57 0.44 Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 46 / 53

Slide 47

Slide 47 text

Bonus track Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 47 / 53

Slide 48

Slide 48 text

Testing: Jenkins data (preview) Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 48 / 53

Slide 49

Slide 49 text

Summary Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 49 / 53

Slide 50

Slide 50 text

Summarizing... OPNFV provides open development analytics: You don’t need others to provide conclusions You can do that yourself! Slidedeck: http://speakerdeck.com/jgbarah Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 50 / 53

Slide 51

Slide 51 text

License c 2016 Bitergia Some rights reserved. This presentation is distributed under the “Attribution-ShareAlike 3.0” license, by Creative Commons, available at http://creativecommons.org/licenses/by-sa/3.0/ Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 51 / 53

Slide 52

Slide 52 text

Credits (1) “Man With Two Hats” Statue by Henk Visch, located in Otawa, Canada Picture by Lezumbalaberenjena in Wikimedia Commons License: Public domain https://commons.wikimedia.org/wiki/File: Man_With_Two_Hats_Ottawa_Statue_by_lezumbalaberenjena.jpg “Napoleon’s Russian campaign of 1812” Original by Charles Minard License: Public domain https://en.wikipedia.org/wiki/Charles_Joseph_Minard#/media/File: Minard.png Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 52 / 53

Slide 53

Slide 53 text

Credits (2) “Aged Come In We’re Open” Picture by Czarina Alegre in Flickr License: Creative Commons Attribution 2.0 https://flic.kr/p/fjGamh “Good code” Comic by Randall Munroe, XKCD 844 License: Creative Commons Attribution-NonCommercial 2.5 http://xkcd.com/844/ Charts and tables are derived from Bitergia dashboards and reports for OPNFV Jesus Gonzalez-Barahona (Bitergia) The Quantitative State of OPNFV June 2016 53 / 53