GitHub Insights: Understanding Open Source

43df3993acc9af4e9f619e59cd849aee?s=47 Georgios Gousios
May 19, 2016
Technology
0
190

GitHub Insights: Understanding Open Source

Talk given at OSCON 2016

43df3993acc9af4e9f619e59cd849aee?s=128

Georgios Gousios

May 19, 2016
Tweet

More Decks by Georgios Gousios

See All by Georgios Gousios
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
56
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
120
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
270
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
120
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
410
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
9
20k
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
640
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
120
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
2
9.9k

Other Decks in Technology

See All in Technology
5dbaf4015e7f249ab21b195ced8e9e46?s=48 masatoshitada
9
1.8k
231dbe4867c139c325b61e808b757750?s=48 kotatsu360
3
1k
C786d7772602b488a7972c38c143f61c?s=48 con_mame
3
1.8k
D1b28ca276bee52e56ba11785f70d2d6?s=48 makocchi
2
320
Bf466502958a3e05d643e910ff5ec6a2?s=48 skmatz
0
180
53850955f15249a1a9dc49df6113e400?s=48 line_developers
0
460
D9130a0952480278c7f44527c6989da7?s=48 syoshie
6
500
404b6b310d5fc7680a62ef09a463a794?s=48 yutakakinjyo
0
230
9f96c3fd49e6a294e521175f2ad80b71?s=48 usamomokawa
0
180
E0561c4d5a2a8842fe1de5bc73a65310?s=48 kameikki
7
2k
9e7a653ed313b3da4b263a772bfc5026?s=48 clustervr
0
280
5de063e47d0da381a3848e761a059a7a?s=48 tjun
5
780

Featured

See All Featured
A415db3ac9e9668acbc1fb36eead84ac?s=48 mthomps
37
2.2k
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
4
480
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
13
470
F29327647a9cff5c69618bae420792ea?s=48 tenderlove
49
3.2k
79acae287842acf29084005533a7fb3b?s=48 hursman
103
9.1k
3d6ace9554821d552146413bcdf874f6?s=48 trishagee
13
690
245cee81a9c424266e5e401d844ea881?s=48 lara
13
2.3k
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
124
21k
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
196
19k
F716e5f737fcfb03f2cf8d1a184f1dbe?s=48 nonsquared
78
3.1k
32de0bd2ba869609d26fd052a4622778?s=48 cromwellryan
100
5.7k
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
436
28k

Transcript

  1. GitHub Insights Understanding Open Source @jeffmcaffer–Microsoft Georgios Gousios –Delft University

    of Technology (TU Delft) Kevin Lewis – Microsoft

  2. Snapshot overview

  3. Inspire confidence

  4. How open is a project? http://ghtorrent.org/pullreq-perf/

  5. Commits (core vs community)

  6. Commits (origin)

  7. Comments (core vs community)

  8. PR lifelines

  9. Are we using git in a distributed way?

  10. How may devs are there per country?

  11. Insights

  12. Business insights

  13. Research insights

  14. Cross-domain insights

  15. Operational insights

  16. Approach Data for the masses

  17. GitHub by the numbers (Mid 2016)

  18. Approach http://ghtorrent.org

  19. How does it work? http://api.github.com/events

  20. Example event (condensed) https://api.github.com/users/Cephei https://api.github.com/repos/PowerDMS/Owin.Scim https://api.github.com/repos/PowerDMS/Owin.Scim/commits/c751014f634d73e0b72f78a53c8cf137888b3 https://api.github.com/orgs/PowerDMS

  21. Entities

  22. GHTorrent architecture Github API Event Retrieval Commits Queue Project Events

    Queue Events Data Retrieval Projects Commits evt.commit evt.watch evt.fork Data Retrieval Data Retrieval Data Retrieval Mirroring Cluster

  23. GHTorrent by the numbers

  24. Using the data You can do it too!

  25. Using the data: Hosted http://ghtorrent.org

  26. Using the data: Download

  27. Using the data: Self-service https://github.com/ghtorrent/ghtorrent-webhook

  28. Using the data: Azure Data Lake

  29. Resources http://ghtorrent.org https://github.com/Microsoft/ghinsights @gousiosg @jeffmcaffer @kelewis