Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Eclipse Development Dashboard

The Eclipse Development Dashboard

Talk at EclipseCon EU 2014.

The new Eclipse Development Dashboard has been deployed during the last months using Grimoire technology, It helps to better understand how the different projects in the Eclipse ecosystem are evolving and performing. Using information from git, Bugzilla and mailing lists, several charts and numbers provide some insight on relevant parameters of the project. The talk will:

explain the meaning of the different panels in the dashboard
use information in those panels, and some complementary quantitative data, to explore specific aspects of the inner life of some Eclipse projects
show how the overall Eclipse community, activity, and some of their most important development processes can be examined
describe the setup and operation of the dashboard itself, which uses only free, open source software technology
introduce how developers and project leaders can benefit from the information it provides

Jesus M. Gonzalez-Barahona

October 28, 2014
Tweet

More Decks by Jesus M. Gonzalez-Barahona

Other Decks in Technology

Transcript

  1. The Eclipse Development Dashboard Jesus M. Gonzalez-Barahona, Daniel Izquierdo {jgb,dizquierdo}@bitergia.com

    Twitter: @jgbarah @dizquierdo Bitergia http://bit.ly/eclipse-dashboard-2 EclipseCon Europe 2014 Ludwigsburg (Germany), October 29th 2014 Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 1 / 32
  2. Structure of the presentation 1 The Eclipse Development Dashboard 2

    Browsing the data 3 Using the information 4 Final remarks Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 2 / 32
  3. Tools: Grimoire system MetricsGrimoire: Free software for retrieving data from

    repositories vizGrimoire (GrimoireLib, vizGrimoireJS): Free software for analyzing, visualizing data Grimoire Dashboard: Many panels, different views of the project (charts, summaries, statistic analysis) Commercially supported by Bitergia http://metricsgrimoire.github.com http://vizgrimoire.github.com Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 5 / 32
  4. From open development to open development analytics Information about code,

    community, development for open development projects can be retrieved, organized, analyzed Let’s publish analytics results & data Open Development Analytics: A new standard for transparency Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 19 / 32
  5. Example: Performance 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3

    0 5 10 15 20 25 30 4.520 6.040 7.550 9.790 12.000 16.570 17.820 22.070 1.190 1.830 2.460 4.080 4.290 6.220 6.080 6.780 Time to review (days): OpenStack Software mean median 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3 0 1 2 3 4 5 6 7 2.760 3.340 3.690 4.250 4.860 5.120 5.490 5.290 2.000 2.000 2.000 2.000 2.000 3.000 3.000 3.000 Patchsets per Changeset: OpenStack Software mean median 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3 0 2 4 6 8 3.180 3.510 4.090 6.660 6.210 7.180 7.560 6.270 0.180 0.310 0.450 0.520 0.780 0.960 0.910 0.760 Time waiting for the reviewer: OpenStack Software avg median 12-Q4 13-Q1 13-Q2 13-Q3 13-Q4 14-Q1 14-Q2 14-Q3 0 2 4 6 8 10 12 14 8.440 6.910 7.750 10.110 8.390 8.410 9.430 10.210 0.230 0.270 0.550 0.470 0.690 0.730 0.790 0.830 Time waiting for the submitter: OpenStack Software avg median [OpenStack core: main code review parameters per quarter] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 20 / 32
  6. Example: Auditing who is contributing [Eclipse top contributors (October 2014)]

    Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 23 / 32
  7. Example: Auditing company participation [Main companies in Eclipse (Oct 2009

    - Oct 2014)] http://dashboard.eclipse.org/scm-companies-summary.html Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 24 / 32
  8. Example: Auditing geographic diversity 15 10 5 0 5 10

    15 tz 0 50 100 150 200 250 300 authors 15 10 5 0 5 10 15 tz 0 50 100 150 200 250 300 350 400 authors [Eclipse mailing lists authors per time zone (2003, 2013)] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 25 / 32
  9. Example: Auditing geographic diversity (2) 15 10 5 0 5

    10 15 tz 0 50 100 150 200 250 300 350 400 authors 15 10 5 0 5 10 15 tz 0 50 100 150 200 250 300 350 400 authors [Eclipse mailing lists and SCM authors per time zone (2013)] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 26 / 32
  10. Example: Transparency Development communities: companies and developers working together Policies,

    procedures, tools, source code... and development data Do they really provide enough data to enable assessment? Analysis of all repositories (data sources)... ...and associated information (eg: affiliation) Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 29 / 32
  11. Example: Transparency & neutrality q q q q q q

    q q 0 1 2 3 250 500 1000 2000 4000 Number of accepted reviews Iterations per accepted review (median) [WebKit code review data per company (2012)] Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 30 / 32
  12. Do you want to play a bit? Do you want

    your own instance of the dashboard? git clone https://github.com/Bitergia/eclipse-dashboard.git Do you want the database dumps? http://dashboard.eclipse.org/data/db/ Schemas available from MetricsGrimoire tools wikis at GitHub Do you want the JSON files? http://dashboard.eclipse.org/data/json/ Simple API, easy to get specific parameters Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 32 / 32
  13. Polishing the final version Still fixing bugs, adding new functionality

    improving performance Your feedback is welcome!!! https://bugs.eclipse.org/bugs/buglist.cgi?component= Dashboard&product=Community Gonzalez-Barahona, Izquierdo (Bitergia) Eclipse Development Dashboard EclipseCon EU 2014 33 / 32