The MetricsGrimoire toolkit

Presentation at FLOSS Community Metrics Meeting EU 2015. Brussels, Belgium, January 30th 2015.

Transcript

1. The MetricsGrimoire toolkit Jesus M. Gonzalez-Barahona jgb@bitergia.com http://twitter.com/jgbarah Bitergia GSyC/LibreSoft (Universidad Rey Juan Carlos) FLOSS Community Metrics Meeting, Brussles, Belgium, January 30th 2015 http://bit.ly/fcm2eu-grimoire Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 1 / 26
2. c 2012-2015 Bitergia Some rights reserved. This presentation is distributed under the “Attribution-ShareAlike 3.0” license, by Creative Commons, available at http://creativecommons.org/licenses/by-sa/3.0/ Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 2 / 26
3. Structure of the presentation 1 Me, myself, my circumstances 2 Open source and beyond 3 Grimoire 4 MetricsGrimoire 5 Why open development analytics? 6 Drawing conclusions Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 3 / 26
4. Me, myself, my circumstances Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 4 / 26
5. My two hats: University, company Uni Rey Juan Carlos: LibreSoft research team Understanding free, open source software development ...since 2000 Data analytics approach Bitergia: From research to practice The software development analytics company Dashboards, reports, consultancy... http://gsyc.es/~jgb http://bitergia.com Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 5 / 26
6. Bitergia: analytics for your peace of mind Started operations in July 2012 Builds on the experience of LibreSoft R&D group Professional products and services, focused on: Grimoire Dashboard: software development analytics (including community metrics) Specific studies and reports (based on metrics and facts collection) http://bitergia.com/projects.html http://blog.bitergia.com Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 6 / 26
7. Open source and beyond Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 7 / 26
8. A new dimension of openness When we develop in the open we produce a great deal of data about how we develop “Show me the development data” as a step beyond “show me the code” Let’s do it! Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 8 / 26
9. Grimoire Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 9 / 26
10. Data lives in many different repositories Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 10 / 26
11. Data has to be extracted, mined... Repositories don’t release all their data easily: tools are needed to retrieve and extract it Data includes many complexities and details tools are needed to filter, organize it MetricsGrimoire Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 11 / 26
12. Data has to be analyzed, visualized... Casual observation is not enough: tools are needed for statistical and other kinds of analysis Analysis is not enough: tools are needed for interactive visualization vizGrimoire Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 12 / 26
13. The Grimoire landscape Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 13 / 26
14. Grimoire: tools for retrieval, analysis, visualization MetricsGrimoire vizGrimoire Grimoire Dashboard Data retrieval Analysis, User from visualization interaction, repositories panels, views Free software Commercial support available Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 14 / 26
15. The Grimoire Development Dashboard http://dashboard.eclipse.com http://demo.bitergia.com Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 15 / 26
16. MetricsGrimoire Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 16 / 26
17. MetricsGrimoire tools (1) Retrieving information repositories: CVSAnalY: source code management CVS, Subversion, git... (Mercurial, others through git) Bicho: issue tracking systems Bugzilla, Jira, GitHub, Allura, Launchpad, Storyboard... & code review systems (Gerrit) MLStats: mailing lists mbox files, Mailman & GMane archives... Sybyl: Q&A websites Askbot, Stackoverflow, Discourse http://metricsgrimoire.github.io Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 17 / 26
18. MetricsGrimoire tools (1) pullpo: Pull request analysis GitHub pull requests MediaWikiAnalysis: wikis IRCAnalysis: IRC logs Several log formats Octopus: crawl forges Puppet forge... sortinghat: manage identities Most MetricsGrimoire databases Automator: automating Grimoire toolchains https://github.com/MetricsGrimoire Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 18 / 26
19. Why open development analytics? Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 19 / 26
20. From open development to open development analytics Information about code, community, development for open development projects can be retrieved, organized, analyzed Let’s publish analytics results & data Open Development Analytics: A new standard for transparency Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 20 / 26
21. Open development analytics Who is interested? Developers Project managers Community managers Evaluators ... Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 21 / 26
22. Open development analytics Why? Free software produced with open development models is more and more important for IT users, producers, integrators It is different & complex, yet transparent, many details are public, and it can be improved Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 22 / 26
23. Some areas of interest Performance (understanding activity) Company participation (beyond copyright notices) Transparency (available information) Auditing (certify participation, experience, etc.) Profiling (key people, companies) Neutrality (fair treatment) Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 23 / 26
24. Drawing conclusions Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 24 / 26
25. In summary... Let’s analyze free software with free software, and let’s publish the results! MetricsGrimoire extracts data from repositories vizGrimoire analyzes it and produces dashboards They’re simple to use, and becoming simpler We can incrementally develop a powerful platform Make your pet project open-development-data ready! Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 25 / 26
26. Thanks go to... The *Grimoire community LibreSoft developers who developed a sizable part of MetricsGrimoire The community maintaining MetricsGrimoire Bitergia developers producing vizGrimoire The (future) community maintaining vizGrimoire The many free software developers that produced all the software on which these tools rely The many free software developers that produced all the software that gives us projects to analyze http://metricsgrimoire.github.io http://bitergia.com Slides: http://bit.ly/fcm2eu-grimoire Jesus Gonzalez-Barahona (Bitergia) The MetricsGrimoire toolkit FCM2 EU 2015 26 / 26