Pro Yearly is on sale from $80 to $50! »

GitHub Insights: Understanding Open Source

43df3993acc9af4e9f619e59cd849aee?s=47 Georgios Gousios
May 19, 2016
Technology
0
200

GitHub Insights: Understanding Open Source

Talk given at OSCON 2016

43df3993acc9af4e9f619e59cd849aee?s=128

Georgios Gousios

May 19, 2016
Tweet

More Decks by Georgios Gousios

See All by Georgios Gousios
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
69
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
140
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
300
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
120
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
420
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
9
25k
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
650
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
120
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
2
10k

Other Decks in Technology

See All in Technology
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
140
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
180
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
210
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
170
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
220
14fc669973dea92bf6fd5ede6f4e016b?s=48 seizecare
0
130
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
140
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
200
79dcb04101764d7bf66f898dd446838e?s=48 tsukubachallenge
0
180
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
200
7cd783377515bdf8207062840b7b2f4e?s=48 soracom
0
190
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
130

Featured

See All Featured
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
125
21k
170b760e0147792d0140e59ec78e9893?s=48 eitanlees
109
9.7k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
683
180k
E43f8dfd01057f8304f5f8fb9a294d7d?s=48 jeffersonlam
326
15k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
218
15k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1349
190k
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
358
62k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
268
16k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
408
57k
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
146
19k
2bb923c57a1fdc3a2eb484bb8d565fd2?s=48 ufuk
56
5.3k
0c6fd6a08d0f898159cda7cafcacf07f?s=48 afnizarnur
176
14k

Transcript

  1. GitHub Insights Understanding Open Source @jeffmcaffer–Microsoft Georgios Gousios –Delft University

    of Technology (TU Delft) Kevin Lewis – Microsoft

  2. Snapshot overview

  3. Inspire confidence

  4. How open is a project? http://ghtorrent.org/pullreq-perf/

  5. Commits (core vs community)

  6. Commits (origin)

  7. Comments (core vs community)

  8. PR lifelines

  9. Are we using git in a distributed way?

  10. How may devs are there per country?

  11. Insights

  12. Business insights

  13. Research insights

  14. Cross-domain insights

  15. Operational insights

  16. Approach Data for the masses

  17. GitHub by the numbers (Mid 2016)

  18. Approach http://ghtorrent.org

  19. How does it work? http://api.github.com/events

  20. Example event (condensed) https://api.github.com/users/Cephei https://api.github.com/repos/PowerDMS/Owin.Scim https://api.github.com/repos/PowerDMS/Owin.Scim/commits/c751014f634d73e0b72f78a53c8cf137888b3 https://api.github.com/orgs/PowerDMS

  21. Entities

  22. GHTorrent architecture Github API Event Retrieval Commits Queue Project Events

    Queue Events Data Retrieval Projects Commits evt.commit evt.watch evt.fork Data Retrieval Data Retrieval Data Retrieval Mirroring Cluster

  23. GHTorrent by the numbers

  24. Using the data You can do it too!

  25. Using the data: Hosted http://ghtorrent.org

  26. Using the data: Download

  27. Using the data: Self-service https://github.com/ghtorrent/ghtorrent-webhook

  28. Using the data: Azure Data Lake

  29. Resources http://ghtorrent.org https://github.com/Microsoft/ghinsights @gousiosg @jeffmcaffer @kelewis