The Eclipse Development Dashboard

Talk at EclipseCon EU 2014.

The new Eclipse Development Dashboard has been deployed during the last months using Grimoire technology, It helps to better understand how the different projects in the Eclipse ecosystem are evolving and performing. Using information from git, Bugzilla and mailing lists, several charts and numbers provide some insight on relevant parameters of the project. The talk will:

explain the meaning of the different panels in the dashboard
use information in those panels, and some complementary quantitative data, to explore specific aspects of the inner life of some Eclipse projects
show how the overall Eclipse community, activity, and some of their most important development processes can be examined
describe the setup and operation of the dashboard itself, which uses only free, open source software technology
introduce how developers and project leaders can benefit from the information it provides

Transcript

1. The Eclipse Development Dashboard Jesus M. Gonzalez-Barahona, Daniel Izquierdo {jgb,dizquierdo}@bitergia.com Twitter: @jgbarah @dizquierdo Bitergia http://bit.ly/eclipse-dashboard-2 EclipseCon Europe 2014 Ludwigsburg (Germany), October 29th 2014 Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 1 / 32
2. Structure of the presentation 1 The Eclipse Development Dashboard 2 Browsing the data 3 Using the information 4 Final remarks Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 2 / 32
3. The Eclipse Development Dashboard Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 3 / 32
4. A Grimoire Dashboard for Eclipse http://dashboard.eclipse.org/ Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 4 / 32
5. Tools: Grimoire system MetricsGrimoire: Free software for retrieving data from repositories vizGrimoire (GrimoireLib, vizGrimoireJS): Free software for analyzing, visualizing data Grimoire Dashboard: Many panels, different views of the project (charts, summaries, statistic analysis) Commercially supported by Bitergia http://metricsgrimoire.github.com http://vizgrimoire.github.com Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 5 / 32
6. Tools: Grimoire system Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 6 / 32
7. Browsing the data Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 7 / 32
8. Dashboard: summary information Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 8 / 32
9. Dashboard: trend charts Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 9 / 32
10. Dashboard: main menu Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 10 / 32
11. Dashboard: navigation by project tree Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 11 / 32
12. Dashboard: project view Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 12 / 32
13. Dashboard: commits http://dashboard.eclipse.org/scm.html Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 13 / 32
14. Dashboard: commits by project http://dashboard.eclipse.org/scm-projects.html Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 14 / 32
15. Dashboard: tickets Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 15 / 32
16. Dashboard: activity by company Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 16 / 32
17. Dashboard: companies table http://dashboard.eclipse.org/companies.html Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 17 / 32
18. Using the information Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 18 / 32
19. From open development to open development analytics Information about code, community, development for open development projects can be retrieved, organized, analyzed Let’s publish analytics results & data Open Development Analytics: A new standard for transparency Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 19 / 32
20. Example: Performance 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3 0 5 10 15 20 25 30 4.520 6.040 7.550 9.790 12.000 16.570 17.820 22.070 1.190 1.830 2.460 4.080 4.290 6.220 6.080 6.780 Time to review (days): OpenStack Software mean median 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3 0 1 2 3 4 5 6 7 2.760 3.340 3.690 4.250 4.860 5.120 5.490 5.290 2.000 2.000 2.000 2.000 2.000 3.000 3.000 3.000 Patchsets per Changeset: OpenStack Software mean median 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3 0 2 4 6 8 3.180 3.510 4.090 6.660 6.210 7.180 7.560 6.270 0.180 0.310 0.450 0.520 0.780 0.960 0.910 0.760 Time waiting for the reviewer: OpenStack Software avg median 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3 0 2 4 6 8 10 12 14 8.440 6.910 7.750 10.110 8.390 8.410 9.430 10.210 0.230 0.270 0.550 0.470 0.690 0.730 0.790 0.830 Time waiting for the submitter: OpenStack Software avg median [OpenStack core: main code review parameters per quarter] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 20 / 32
21. Example: Performance [MediaWiki community: tickets-related parameters] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 21 / 32
22. Example: Attraction / retention http://dashboard.eclipse.org/demographics.html http://radar.oreilly.com/2014/10/ measure-your-open-source-communitys-age-to-keep-it-healthy. html Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 22 / 32
23. Example: Auditing who is contributing [Eclipse top contributors (October 2014)] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 23 / 32
24. Example: Auditing company participation [Main companies in Eclipse (Oct 2009 - Oct 2014)] http://dashboard.eclipse.org/scm-companies-summary.html Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 24 / 32
25. Example: Auditing geographic diversity 15 10 5 0 5 10 15 tz 0 50 100 150 200 250 300 authors 15 10 5 0 5 10 15 tz 0 50 100 150 200 250 300 350 400 authors [Eclipse mailing lists authors per time zone (2003, 2013)] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 25 / 32
26. Example: Auditing geographic diversity (2) 15 10 5 0 5 10 15 tz 0 50 100 150 200 250 300 350 400 authors 15 10 5 0 5 10 15 tz 0 50 100 150 200 250 300 350 400 authors [Eclipse mailing lists and SCM authors per time zone (2013)] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 26 / 32
27. Example: Profiling individuals Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 27 / 32
28. Example: Profiling companies [Oracle participation in Eclipse] http://dashboard.eclipse.org/company.html?company=Oracle Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 28 / 32
29. Example: Transparency Development communities: companies and developers working together Policies, procedures, tools, source code... and development data Do they really provide enough data to enable assessment? Analysis of all repositories (data sources)... ...and associated information (eg: affiliation) Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 29 / 32
30. Example: Transparency & neutrality q q q q q q q q 0 1 2 3 250 500 1000 2000 4000 Number of accepted reviews Iterations per accepted review (median) [WebKit code review data per company (2012)] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 30 / 32
31. Final remarks Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 31 / 32
32. Do you want to play a bit? Do you want your own instance of the dashboard? git clone https://github.com/Bitergia/eclipse-dashboard.git Do you want the database dumps? http://dashboard.eclipse.org/data/db/ Schemas available from MetricsGrimoire tools wikis at GitHub Do you want the JSON files? http://dashboard.eclipse.org/data/json/ Simple API, easy to get specific parameters Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 32 / 32
33. Polishing the final version Still fixing bugs, adding new functionality improving performance Your feedback is welcome!!! https://bugs.eclipse.org/bugs/buglist.cgi?component= Dashboard&product=Community Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 33 / 32