A Development Analytics Dashboard For Apache CloudStack

Talk at ApacheCon Europe 2014, Budapest (Hungary), Nov. 17th 2014.

The Apache CloudStack Development Analytics Dashboard helps to better understand how the project is evolving and performing. Using information from git, Jira and mailing lists, several charts and numbers provide some insight on relevant parameters of the project. The talk will explain the meaning of the different panels in the dashboard, and will use them and some complementary quantitative data to analyze specific aspects of the inner life of the project. Those will be used to describe the CloudStack community, its activity, and some of their most important development processes.

CloudStack Dashboard: http://projects.bitergia.com/apache-cloudstack/browser/

Transcript

1. A Development Analytics Dashboard For Apache CloudStack Jesus M. Gonzalez-Barahona jgb@bitergia.com Twitter: @jgbarah Bitergia http://bit.ly/cloudstack-dashboard ApacheCon Europe 2014 Budapest (Hungary), November 17th 2014 Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 1 / 34
2. Structure of the presentation 1 Why a software development dashboard? 2 The CloudStack Development Dashboard 3 Browsing the data 4 Browsing the data: git 5 Browsing the data: Jira 6 Browsing the data: other 7 Bonus track 8 Final remarks Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 2 / 34
3. Why a software development dashboard? Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 3 / 34
4. From open development to open development analytics Information about code, community, development for open development projects can be retrieved, organized, analyzed Let’s publish analytics results & data Open Development Analytics: A new standard for transparency Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 4 / 34
5. Who makes a project successful? Persons (and organizations) with different interests common goals Need for coordination, common decision making Availability of data as a tool: Transparency to the community (fairness) Transparency to third parties (trust) Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 5 / 34
6. Assessing transparency Development communities: companies and developers working together Policies, procedures, tools, source code... and development data Do they really provide enough data to enable assessment? Analysis of all repositories (data sources)... ...and associated information (eg: affiliation) Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 6 / 34
7. Examples of areas of interest Performance (understanding activity) Company participation (beyond copyright notices) Transparency (available information) Auditing (certify participation, experience, etc.) Profiling (key people, companies) Neutrality (fair treatment) Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 7 / 34
8. The CloudStack Development Dashboard Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 8 / 34
9. A Grimoire Dashboard for CloudStack http://projects.bitergia.com/apache-cloudstack/ Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 9 / 34
10. Tools: Grimoire system MetricsGrimoire: Free software for retrieving data from repositories vizGrimoire (GrimoireLib, vizGrimoireJS): Free software for analyzing, visualizing data Grimoire Dashboard: Many panels, different views of the project (charts, summaries, statistic analysis) Commercially supported by Bitergia http://metricsgrimoire.github.com http://vizgrimoire.github.com Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 10 / 34
11. Tools: Grimoire system Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 11 / 34
12. Browsing the data Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 12 / 34
13. Dashboard: main menu Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 13 / 34
14. Dashboard: summary information Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 14 / 34
15. Dashboard: trend charts Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 15 / 34
16. Browsing the data: git Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 16 / 34
17. Dashboard: commits http://projects.bitergia.com/apache-cloudstack/browser/scm.html Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 17 / 34
18. Dashboard: who is contributing [CloudStack top authors in git (November 2014)] Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 18 / 34
19. Dashboard: commits by git repository Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 19 / 34
20. Browsing the data: Jira Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 20 / 34
21. Dashboard: tickets Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 21 / 34
22. Dashboard: ticket backlogs over time Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 22 / 34
23. Dashboard: age of current tickets by state Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 23 / 34
24. Browsing the data: other Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 24 / 34
25. Dashboard: mailing lists Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 25 / 34
26. Dashboard: Attraction / retention (git authors) http://projects.bitergia.com/apache-cloudstack/browser/ demographics.html Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 26 / 34
27. Dashboard: Attraction / retention http://radar.oreilly.com/2014/10/ measure-your-open-source-communitys-age-to-keep-it-healthy.html Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 27 / 34
28. Dashboard: Profiling of contributors Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 28 / 34
29. Bonus track Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 29 / 34
30. Time zone analysis (1) 15 10 5 0 5 10 15 tz 0 50 100 150 200 authors 15 10 5 0 5 10 15 tz 0 50 100 150 200 250 300 350 400 450 authors [Posters in mailing lists per time zone (2012, 2014)] Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 30 / 34
31. Time zone analysis (2) 15 10 5 0 5 10 15 tz 0 5 10 15 20 25 30 authors 15 10 5 0 5 10 15 tz 0 10 20 30 40 50 60 authors [Authors in git repos per time zone (2010, 2014)] Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 31 / 34
32. Final remarks Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 32 / 34
33. Do you want to play a bit? Do you want your own instance of the dashboard? git clone https://github.com/Bitergia/apache-cloudstack-dashbo Do you want the database dumps? http://projects.bitergia.com/apache-cloudstack/browser/ data/db/ Schemas available from MetricsGrimoire tools wikis at GitHub Do you want the JSON files? http://projects.bitergia.com/apache-cloudstack/browser/ data/json/ Simple API, easy to get specific parameters Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 33 / 34
34. Polishing the final version Still (and continuously) fixing bugs, adding new functionality improving performance Your feedback is welcome!!! https://github.com/Bitergia/apache-cloudstack-dashboard/issues Gonzalez-Barahona (Bitergia) CloudStack Development Dashboard ApacheCon EU 2014 34 / 34