Open Development Analytics - Codemotion ES 2016

Presentation for Codemotion Madrid 2016 about Open Development Analytics concept and some examples

Transcript

1. Open Development Analytics by @jsmanrique from @bitergia MADRID · NOV 18-19 · 2016
2. MADRID · NOV 18-19 · 2016 /me “Hello, my name is Manrique and I am a community junkie” Previously addicted to: HPCC, AsturLiNUX, HispaLiNUX, GPE, Maemo, Meego, GNOME, GDG, Mozilla, ... Currently, business & marketing developer in Bitergia, the software development analytics company
3. MADRID · NOV 18-19 · 2016 /why
4. MADRID · NOV 18-19 · 2016 /disclaimer I am not a computer scientist, how many of you are? I am not a data scientist, how many of you are? Presentation focus in open source & inner source related communities
5. MADRID · NOV 18-19 · 2016 /open-development /community /open-source /inner-source /management
6. MADRID · NOV 18-19 · 2016 /open-development/community “A community is commonly considered a social unit (a group of people) who share something in common, such as norms, values, identity, and often a sense of place that is situated in a given geographical area (e.g. a village, town, or neighborhood). Durable relations that extend beyond immediate genealogical ties also define a sense of community. People tend to define those social ties as important to their identity, practice, and roles in social institutions like family, home, work, government, society, or humanity, at large. Although communities are usually small relative to personal social ties (micro-level), "community" may also refer to large group affiliations (or macro-level), such as national communities, international communities, and virtual communities. The word "community" derives from the Old French comuneté which comes from the Latin communitas (from Latin communis, things held in common)” By https://en.wikipedia.org/wiki/Community
7. MADRID · NOV 18-19 · 2016 /open-development/community It’s about people
8. MADRID · NOV 18-19 · 2016 /open-development/community It’s about people who share
9. MADRID · NOV 18-19 · 2016 /open-development/community It’s about people who share something in common (target)
10. MADRID · NOV 18-19 · 2016 /open-development/community/ Self-awareness - Governance - Transparency
11. MADRID · NOV 18-19 · 2016 /open-development/community/self-awareness Potential members Observers Attendees Participants Champions Anatomy of a community Alex Hillman
12. MADRID · NOV 18-19 · 2016 /open-development/community/governance “Establishment of policies, and continuous monitoring of their proper implementation, by the members of the governing body of an organization. It includes the mechanisms required to balance the powers of the members (with the associated accountability), and their primary duty of enhancing the prosperity and viability of the organization”. businessdictionary.com
13. MADRID · NOV 18-19 · 2016 /open-development/community/governance “Establishment of policies, and continuous monitoring of their proper implementation, by the members of the governing body of an organization. It includes the mechanisms required to balance the powers of the members (with the associated accountability), and their primary duty of enhancing the prosperity and viability of the organization”. businessdictionary.com
14. MADRID · NOV 18-19 · 2016 /open-development/community/transparency Transparency to the community Fairness Transparency to third parties Trust
15. MADRID · NOV 18-19 · 2016 /open-development/open-source
16. MADRID · NOV 18-19 · 2016 /open-development/inner-source
17. MADRID · NOV 18-19 · 2016 /open-development/management Do communities need to be managed? Do communities need leadership? Why is becoming so important?
18. MADRID · NOV 18-19 · 2016 /open-development/management Health - Productivity - Visibility
19. MADRID · NOV 18-19 · 2016 /open-development/management “To measure is to know” “If you can not measure it, you can not improve it” Lord Kelvin “Without data, you are just another person with an opinion” W. Edwards Deming
20. MADRID · NOV 18-19 · 2016 /open-development-analytics /data-sources /tools /metrics
21. MADRID · NOV 18-19 · 2016 /open-development-analytics/data-sources I need information
22. MADRID · NOV 18-19 · 2016 /open-development-analytics/data-sources Where is everything happenning?
23. MADRID · NOV 18-19 · 2016 /open-development-analytics/data-sources
24. MADRID · NOV 18-19 · 2016 /open-development-analytics/tools OpenHub StackOverflow metrics Stackalytics GitTorrent, GitHub Archive GitHub Archive + Google BigQuery github3.py ...
25. MADRID · NOV 18-19 · 2016 /open-development-analytics/tools Free, Libre, Open Source Tools for Software Development Analytics GrimoireLab grimoirelab.github.io
26. MADRID · NOV 18-19 · 2016 /open-development-analytics/metrics “Human beings adjust behavior based on the metrics they’re held against. Anything you measure will impel a person to optimize his score on that metric. What you measure is what you’ll get. Period”. You Are What You Measure by Dan Ariely
27. MADRID · NOV 18-19 · 2016 /showtime
28. MADRID · NOV 18-19 · 2016 /showtime Metrics that matter People Diversity Demography Activity Performance Impact Awareness facebook/yarnpkg pythton/cpython apple/swift microsoft/typescript w3c/html vs whatwg/html
29. MADRID · NOV 18-19 · 2016 /open-development-analytics $ git clone http://.../perceval.git $ sudo python3 setup.py install … $ git clone http://.../grimoireelk.git $ elasticsearch/bin/elastic & $ kibana/bin/kibana & GrimoireELK/utils$ python3 ./p2o.py --enrich --index git_yarn -e http://localhost:9200 --no_inc --debug git https://github.com/yarnpkg/yarn.git … 2016-10-14 14:09:32,392 Total items enriched 897 2016-10-14 14:09:32,392 Done git 2016-10-14 14:09:32,392 Enrich backend completed 2016-10-14 14:09:32,393 Finished in 0.75 min GrimoireELK/utils$ python3 ./p2o.py --enrich --index github_yarn -e http://localhost:9200 --no_inc --debug github -t *** --owner yarnpkg --repository yarn … 2016-10-14 14:20:19,736 Total items enriched 900 2016-10-14 14:20:19,736 Done github 2016-10-14 14:20:19,737 Enrich backend completed 2016-10-14 14:20:19,738 Finished in 7.20 min $
30. MADRID · NOV 18-19 · 2016 /extras /contributions-review /dependency /dealing-with-issues /gender-diversity /contributors-funnel /live-examples /GrimoireCon
31. MADRID · NOV 18-19 · 2016 /extras/contributions-review Some reviewers are more equal than others Neutrality? Source: Some developers are more equal than others (Bitergia’s blog, 2015) Source: Understanding How Companies Interact with Free Software Communities (IEEE, 2013)
32. MADRID · NOV 18-19 · 2016 /extras/dependency Onion model ASF Pony factor Bitergia Elephant factor Bitergia Zapata factor 7 core ~ 40 regular ~ 85 casual Pony factor: 1 Elephant factor: 2 Linux kernel ownership analysis: linux.biterg.io Linux Kernel Zapata factor ~ 200 Linux Kernel UFCo factor ~ 10 Bitergia United Fruit Company factor
33. MADRID · NOV 18-19 · 2016 /extras/dealing-with-issues
34. MADRID · NOV 18-19 · 2016 /extras/gender-diversity Gender-diversity Analysis of the Linux Kernel Technical Contributions Women in OpenStack report for WOO Meeting Gender-diversity analysis of technical contributions in the Hadoop Ecosystem
35. MADRID · NOV 18-19 · 2016 /extras/contributors-funnel Observers / attendees Participants Champions DEMO at FOSDEM 2017
36. MADRID · NOV 18-19 · 2016 /extras/live-examples eclipse.biterg.io puppet.biterg.io coreos.biterg.io cncf.biterg.io opnfv.biterg.io oci.biterg.io … and more at bitergia.com/customers & blog.bitergia.com
37. MADRID · NOV 18-19 · 2016 /extras/live-examples Cauldron.io (use OWL2016 as invitation code) Use the source (it’s FREE!!!): grimoirelab.github.io Free “under development” collaborative book www.gitbook.com/book/jgbarah/grimoirelab-training/ Ask us: info@bitergia.com
38. MADRID · NOV 18-19 · 2016 /extras Do you need a better excuse to come to FOSDEM … despite waffles, chocolate and beers?
39. MADRID · NOV 18-19 · 2016 /extras Are you a community manager consultant? Are you working as developer advocate for other companies? Are you software development consultant? We are looking for partners!! Ask us about our partnership program: info@bitergia.com
40. Open Development Analytics by @jsmanrique from @bitergia MADRID · NOV 18-19 · 2016 Thank you! Slides at speakerdeck.com/bitergia