Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
GitHub Insights: Understanding Open Source
Search
Sponsored
·
Ship Features Fearlessly
Turn features on and off without deploys. Used by thousands of Ruby developers.
→
Georgios Gousios
May 19, 2016
Technology
480
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
GitHub Insights: Understanding Open Source
Talk given at OSCON 2016
Georgios Gousios
May 19, 2016
Transcript
29 slides
GitHub Insights Understanding Open Source @jeffmcaffer–Microsoft Georgios Gousios –Delft University
of Technology (TU Delft) Kevin Lewis – Microsoft
Snapshot overview
Inspire confidence
How open is a project? http://ghtorrent.org/pullreq-perf/
Commits (core vs community)
Commits (origin)
Comments (core vs community)
PR lifelines
Are we using git in a distributed way?
How may devs are there per country?
Insights
Business insights
Research insights
Cross-domain insights
Operational insights
Approach Data for the masses
GitHub by the numbers (Mid 2016)
Approach http://ghtorrent.org
How does it work? http://api.github.com/events
Example event (condensed) https://api.github.com/users/Cephei https://api.github.com/repos/PowerDMS/Owin.Scim https://api.github.com/repos/PowerDMS/Owin.Scim/commits/c751014f634d73e0b72f78a53c8cf137888b3 https://api.github.com/orgs/PowerDMS
Entities
GHTorrent architecture Github API Event Retrieval Commits Queue Project Events
Queue Events Data Retrieval Projects Commits evt.commit evt.watch evt.fork Data Retrieval Data Retrieval Data Retrieval Mirroring Cluster
GHTorrent by the numbers
Using the data You can do it too!
Using the data: Hosted http://ghtorrent.org
Using the data: Download
Using the data: Self-service https://github.com/ghtorrent/ghtorrent-webhook
Using the data: Azure Data Lake
Resources http://ghtorrent.org https://github.com/Microsoft/ghinsights @gousiosg @jeffmcaffer @kelewis
More Decks by Georgios Gousios
See All by Georgios Gousios
NLP + SE = ❤️
gousiosg
0
420
The troubles of modern dependency management and what to do about them
gousiosg
0
780
Mining Repositories with Apache Spark
gousiosg
0
790
My adventures with open everything
gousiosg
0
390
Structure and Evolution of Package Dependency Networks
gousiosg
0
980
Mining Github for fun and profit
gousiosg
9
63k
Work Practices and Challenges in Pull-Based Development: The Contributor’s Perspective
gousiosg
0
1k
Big Data in Software Engineering panel and Privacy: Should we care?
gousiosg
0
370
The #issue32 incident
gousiosg
2
16k
Other Decks in Technology
See All in Technology
ぼくのClaude Codeの使い方
falken
PRO
5
7.6k
そのイメージ、どのCIが作った? Artifact Attestationsで来歴を固定する / Which CI system created that image? Pinning provenance with Artifact Attestations
chmikata
0
140
AI対話型分析を作成し、リリースするまでの話 / The Road to Release: Buiding AI Conversational Analytics
yappli_developers
0
180
コーディングできない僕にBobが舞い降りた
shumpei3
0
100
AIで実装が加速したのに、 なぜ私は仕事の大半で人と話し続けていたのか?
say_no_w
0
200
Well, that’s weird…
csswizardry
1
110
PHPで家庭用ゲーム機の専用コントローラーをMIDIデバイスとして扱ってみる
wind111
0
170
Gov-JAWS#9 統合監視機能のマネージドサービス化+AIによる障害時自動調査
fj_yoshimura_kosuke
0
220
人の努力に頼らないセキュリティをエンジニアリングする在り方 / An approach to engineering security that does not rely on human effort
carta_engineering
0
230
Kansai WordPress Meetup@大阪『ブロックテーマを作る上で知っておくべきこと
torounit
0
260
現地速報! Microsoft Ignite アップデートレポート
kasada
0
350
20261113_AWS Organizations運用を下支えするCFn StackSetsの柔軟性
dkduppf
0
110
Featured
See All Featured
Design in an AI World
tapps
1
390
VelocityConf: Rendering Performance Case Studies
addyosmani
331
25k
Web Performance Is a Journey [PerfNow 2026]
tammyeverts
1
69
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
soudai
PRO
68
60k
How to Talk to Developers About Accessibility
jct
2
620
Chasing Engaging Ingredients in Design
codingconduct
0
400
Six Lessons from altMBA
skipperchong
29
4.6k
The Art of Programming - Codeland 2020
erikaheidi
57
15k
From Legacy to Launchpad: Building Startup-Ready Communities
dugsong
0
380
Unlocking the hidden potential of vector embeddings in international SEO
frankvandijk
0
1k
The agentic SEO stack - context over prompts
schlessera
0
1k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
49
3.6k