GrimoireLab Intro - OpenExpo 2017

Brief introduction to Grimoire Lab metrics toolkit to analyze open source software development

Transcript

1. GrimoireLab intro Manrique López @jsmanrique {email} at bitergia dot com https://speakerdeck.com/bitergia OpenExpo, Madrid, June 2017
2. /outline Introduction Community Metrics Grimoire Lab Extras
3. Introduction A bit about me Bitergia
4. /me Hello, my name is Manrique and I am a community junkie Involved in: HPCC, AsturLiNUX, HispaLiNUX, GPE, Maemo, Meego, Gnome, GDG, Mozilla, ... Business, alliances, marketing & community developer in Bitergia, the software development analytics company
5. /bitergia Software Development Analytics for your peace of mind
6. /bitergia
7. Community metrics Goals Community Transparency Methodology What
8. /goals “...accelerate open technology development and commercial adoption…” “...global development, distribution and adoption of the OpenStack cloud…” “...open, collaborative software development projects…”
9. /community “A community is commonly considered a social unit (a group of people) who share something in common, such as norms, values, identity, and often a sense of place that is situated in a given geographical area (e.g. a village, town, or neighborhood) [...] The word "community" derives from the Old French comuneté which comes from the Latin communitas (from Latin communis, things held in common)” By https://en.wikipedia.org/wiki/Community
10. /transparency Transparency to the community Fairness Transparency to third parties Trust
11. /what? Activity Community Process Code License compliance …
12. /what? Activity Community Process Code License compliance …
13. /methodology 1. Goals 2. Questions 3. Metrics
14. /wacth out! “Human beings adjust behavior based on the metrics they’re held against. Anything you measure will impel a person to optimize his score on that metric. What you measure is what you’ll get. Period”. You Are What You Measure by Dan Ariely
15. Grimoire Lab Community Goals Transparency Methodology What grimoirelab.github.io
16. /grimoirelab
17. /grimoirelab + + =
18. /grimoirelab
19. /grimoirelab Grimoire Lab Training jgbarah.gitbooks.io/grimoirelab-training/
20. /grimoirelab
21. /grimoirelab Perceval https://github.com/GrimoireLab/perceval PyPI package: $ pip3 install perceval From sources: $ git clone https://github.com/grimoirelab/perceval.git $ pip3 install -r requirements.txt $ python3 setup.py install Docker: https://hub.docker.com/r/grimoirelab/perceval/
22. /grimoirelab Perceval https://github.com/GrimoireLab/perceval From command line: $ perceval [-c <file>] [-g] <backend> [<args>] |--help | --version In your Python code: … from perceval.backends.core.<backend> import <Backend> … backend_repo = <Backend>(<params>) for item in backend_repo.fetch(): …
23. /grimoirelab Perceval https://github.com/GrimoireLab/perceval Backends: askbot Fetch questions and answers from Askbot site bugzilla Fetch bugs from a Bugzilla server bugzillarest Fetch bugs from a Bugzilla server (>=5.0) using its REST API confluence Fetch contents from a Confluence server discourse Fetch posts from Discourse site dockerhub Fetch repository data from Docker Hub site gerrit Fetch reviews from a Gerrit server git Fetch commits from Git github Fetch issues from GitHub gmane Fetch messages from Gmane hyperkitty Fetch messages from a HyperKitty archiver jenkins Fetch builds from a Jenkins server jira Fetch issues from JIRA issue tracker mbox Fetch messages from MBox files mediawiki Fetch pages and revisions from a MediaWiki site meetup Fetch events from a Meetup group nntp Fetch articles from a NNTP news group phabricator Fetch tasks from a Phabricator site pipermail Fetch messages from a Pipermail archiver redmine Fetch issues from a Redmine server rss Fetch entries from a RSS feed server slack Fetch messages from a Slack channel stackexchange Fetch questions from StackExchange sites supybot Fetch messages from Supybot log files telegram Fetch messages from the Telegram server
24. /grimoirelab Perceval https://github.com/GrimoireLab/perceval Write your own backends! https://github.com/grimoirelab/perceval/tree/master/perceval/backends/cor e … class <Backend>(Backend): … @metadata def fetch(self): … … @metadata def fetch_from_cache(self): … … class <Backend>Client: … class <Backend>Command(BackendCommand): …
25. /grimoirelab
26. /grimoirelab GrimoireELK https://github.com/GrimoireLab/grimoireelk Sorting Hat https://github.com/GrimoireLab/sortinghat Kibiter https://github.com/GrimoireLab/kibiter Panels https://github.com/GrimoireLab/panels
27. /grimoirelab “Collecting data is only the first step toward wisdom, but sharing data is the first step toward community” Henry Louis Gates Jr., IBM/Linux Commercials
28. /bitergia
29. Extras Network analysis Dependency Geographical analysis Demography Gender diversity Contributors review Some analysis and metrics provided with Grimoire Lab
30. /network Open Source Kibana network visualization plug-in: https://github.com/dlumbrer/kbn_network
31. /dependency Onion model ASF Pony factor Bitergia Elephant factor Bitergia Zapata factor Linux Kernel Zapata factor ~ 200 Bitergia United Fruit Company factor Linux Kernel UFCo factor ~ 10 Linux kernel ownership analysis: linux.biterg.io 7 core ~ 40 regular ~ 85 casual Pony factor: 1 Elephant factor: 2
32. /geoanalysis Node GitHub Pull Requests Mozilla Reps Activities Mozilla Commits by timezone
33. /demography Open Containers Initiative Demography panel
34. /gender Gender-diversity Analysis of the Linux Kernel Technical Contributions Women in OpenStack report for WOO Meeting Gender-diversity analysis of technical contributions in the Hadoop Ecosystem
35. /reviews Open NFV code review stats Development cycle analysis Idea, request → Iterations → Testing → Deployment
36. /reviews Some reviewers are more equal than others Neutrality? Source: Some developers are more equal than others (Bitergia’s blog, 2015) Source: Understanding How Companies Interact with Free Software Communities (IEEE, 2013)
37. /bitergia
38. GrimoireLab intro Manrique López @jsmanrique {email} at bitergia dot com https://speakerdeck.com/bitergia OpenExpo, Madrid, June 2017