Save 37% off PRO during our Black Friday Sale! »

GitHub Insights: Understanding Open Source

43df3993acc9af4e9f619e59cd849aee?s=47 Georgios Gousios
May 19, 2016
Technology
0
220

GitHub Insights: Understanding Open Source

Talk given at OSCON 2016

43df3993acc9af4e9f619e59cd849aee?s=128

Georgios Gousios

May 19, 2016
Tweet

More Decks by Georgios Gousios

See All by Georgios Gousios
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
120
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
190
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
370
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
140
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
460
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
9
45k
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
720
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
0
140
43df3993acc9af4e9f619e59cd849aee?s=48 gousiosg
2
13k

Other Decks in Technology

See All in Technology
D2d151b1f646128e4875038282acd953?s=48 humanresociarpa
1
11k
64e95d2d8051ee58501f21987f46b9e7?s=48 chck
0
110
F15db152a0cf9f1f0572cbb456b100c2?s=48 fuzzy31u
0
180
A857277d74d4719f7f7751dca5ed553e?s=48 cmusudakeisuke
0
610
D0f5daa7cc3a26140c06ea29e5e235cc?s=48 noriyukitakei
0
890
966e29b84ae7dbde170f66b0bc75b7a6?s=48 ishiayaya
0
1k
53850955f15249a1a9dc49df6113e400?s=48 line_developers
PRO
0
270
50bc42471d197d0dbef7171f2ef85bb6?s=48 comucal
PRO
0
460
B1dca90d4b3ffd2ccd918774e1ba170d?s=48 hmatsu47
PRO
0
2k
3716cf98e52588e91ba25e54b3f61255?s=48 tamagawaconan
2
190
Ff0453fcbf27a84de92b9cc1f2aed9af?s=48 koike91
0
430
7a29c02251394fc05ebd88c631c562dc?s=48 takufujii
0
170

Featured

See All Featured
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
14
1.1k
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
224
48k
828ace851b606e1206900f26459f55ad?s=48 speakerdeck
PRO
2
480
9128d500301ae51524e887bb680f471d?s=48 caitiem20
314
18k
A0517b08532aec8ab2aae3f65d40ad86?s=48 hannesfritz
32
1.2k
282d599b414022eba5096510f675b6e2?s=48 chrislema
174
14k
D09fad3e36ae6841f54820be0e907f7a?s=48 rocio
156
12k
64827b31aef81498662e8af4bd6d5157?s=48 jonrohan
1021
410k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
498
130k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
449
36k
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
167
19k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
497
110k

Transcript

  1. GitHub Insights Understanding Open Source @jeffmcaffer–Microsoft Georgios Gousios –Delft University

    of Technology (TU Delft) Kevin Lewis – Microsoft

  2. Snapshot overview

  3. Inspire confidence

  4. How open is a project? http://ghtorrent.org/pullreq-perf/

  5. Commits (core vs community)

  6. Commits (origin)

  7. Comments (core vs community)

  8. PR lifelines

  9. Are we using git in a distributed way?

  10. How may devs are there per country?

  11. Insights

  12. Business insights

  13. Research insights

  14. Cross-domain insights

  15. Operational insights

  16. Approach Data for the masses

  17. GitHub by the numbers (Mid 2016)

  18. Approach http://ghtorrent.org

  19. How does it work? http://api.github.com/events

  20. Example event (condensed) https://api.github.com/users/Cephei https://api.github.com/repos/PowerDMS/Owin.Scim https://api.github.com/repos/PowerDMS/Owin.Scim/commits/c751014f634d73e0b72f78a53c8cf137888b3 https://api.github.com/orgs/PowerDMS

  21. Entities

  22. GHTorrent architecture Github API Event Retrieval Commits Queue Project Events

    Queue Events Data Retrieval Projects Commits evt.commit evt.watch evt.fork Data Retrieval Data Retrieval Data Retrieval Mirroring Cluster

  23. GHTorrent by the numbers

  24. Using the data You can do it too!

  25. Using the data: Hosted http://ghtorrent.org

  26. Using the data: Download

  27. Using the data: Self-service https://github.com/ghtorrent/ghtorrent-webhook

  28. Using the data: Azure Data Lake

  29. Resources http://ghtorrent.org https://github.com/Microsoft/ghinsights @gousiosg @jeffmcaffer @kelewis