Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Git, GitHub, Etc
Search
Andy Delcambre
April 19, 2014
Programming
3
240
Git, GitHub, Etc
How git and GitHub work, behind the scenes. Aka what I do in my day job.
Andy Delcambre
April 19, 2014
Tweet
Share
More Decks by Andy Delcambre
See All by Andy Delcambre
Git and GitHub at YAPC:Asia
adelcambre
1
3.4k
Systems Programming - SoCoded 2013
adelcambre
2
180
Ruby Systems Programming
adelcambre
4
1.1k
Debugging Production Service Oriented Systems
adelcambre
3
440
Ruby, Rails and Engine Yard - Úll
adelcambre
1
320
SFRuby Nov 2011 - Release Early and Release Often
adelcambre
2
84
Release early and Release often
adelcambre
2
510
Other Decks in Programming
See All in Programming
GitHub Actions × AWS OIDC連携の仕組みと経緯を理解する
ota1022
0
200
Build your own WebP codec in Swift
kishikawakatsumi
2
800
非同期jobをtransaction内で 呼ぶなよ!絶対に呼ぶなよ!
alstrocrack
0
280
CSC305 Lecture 01
javiergs
PRO
1
380
階層構造を表現するデータ構造とリファクタリング 〜1年で10倍成長したプロダクトの変化と課題〜
yuhisatoxxx
3
680
Swiftビルド弾丸ツアー - Swift Buildが作る新しいエコシステム
giginet
PRO
0
1.5k
API Platform 4.2: Redefining API Development
soyuka
0
780
Server Less Code More - コードを書かない時代に生きるサーバーレスデザイン / server-less-code-more
gawa
5
1.9k
まだ世にないサービスをAIと創る話 〜 失敗から学ぶフルスタック開発への挑戦 〜
katayamatg
0
160
Repenser les filtres API Platform: une nouvelle syntaxe
vinceamstoutz
2
150
Current States of Java Web Frameworks at JCConf 2025
kishida
0
430
Web Components で実現する Hotwire とフロントエンドフレームワークの橋渡し / Bridging with Web Components
da1chi
2
1.1k
Featured
See All Featured
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
45
2.5k
Git: the NoSQL Database
bkeepers
PRO
431
66k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
18
1.2k
GraphQLの誤解/rethinking-graphql
sonatard
72
11k
Fireside Chat
paigeccino
40
3.7k
Building an army of robots
kneath
306
46k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Agile that works and the tools we love
rasmusluckow
330
21k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
358
30k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.2k
The Straight Up "How To Draw Better" Workshop
denniskardys
237
140k
Bash Introduction
62gerente
615
210k
Transcript
Git, GitHub, Etc Andy Delcambre
None
None
PLANET ARGON
None
None
None
None
DIRECTED ACYCLIC GRAPH
yt $ git init Initialized empty Git repository in /private/tmp/demo/.git/
yt $ echo "My sweet repo" > README yt ✗ $ git add README yt ✗ $ git status # On branch master # # Initial commit # # Changes to be committed: # (use "git rm --cached <file>..." to unstage) # # new file: README # yt ✗ $ git commit -m "Add a README" [master (root-commit) 8a720fa] Add a README 1 file changed, 1 insertion(+) create mode 100644 README yt $ git log commit 8a720fa06710948f2ab79dd3e213ef745b6000c5 Author: Andy Delcambre <
[email protected]
> Date: Mon Apr 14 15:41:34 2014 -0700 ! Add a README
8a720fa HEAD, master Refs Commit
yt $ echo "It's so awesome" >> README yt ✗
$ git add README yt ✗ $ git commit -m "Update README" [master ede0fc8] Update README 1 file changed, 1 insertion(+) yt $ git log --graph --decorate --pretty=oneline * ede0fc8 (HEAD, master) Update README * 8a720fa Add a README%
Commit 8a720fa ede0fc8 HEAD, master Refs Commit
yt $ git cat-file -p ede0fc8 tree 493fc85c806ebd9e49395561d2f9c98a5d9ebdce parent 8a720fa06710948f2ab79dd3e213ef745b6000c5
author Andy Delcambre <
[email protected]
> 1397516385 -0700 committer Andy Delcambre <
[email protected]
> 1397516385 -0700 ! Update README
Commit ede0fc8 8a720fa 493fc85 Parent Tree
yt $ git cat-file -p 493fc85 100644 blob 17ca828132ebdc5347f4c5c20484b9a33fffb294 README
!
Tree 493fc85 17ca828 Blob (README)
yt $ git cat-file -p 17ca828 My sweet repo It's
so awesome
GitHub
Secret:
Hosting a Git repo is Secret:
Hosting a Git repo is Secret: EASY
enzo $ git init --bare demo.git Initialized empty Git repo
in /home/adelcambre/git/demo.git/ ! yt $ git remote add origin adelcambre@enzo:git/demo.git yt $ git push origin master Counting objects: 6, done. Delta compression using up to 8 threads. Compressing objects: 100% (2/2), done. Writing objects: 100% (6/6), 473 bytes, done. Total 6 (delta 0), reused 6 (delta 0) To adelcambre@enzo:git/demo.git * [new branch] master -> master ! yt $ git clone adelcambre@enzo:git/demo.git Cloning into 'demo'... remote: Counting objects: 6, done. remote: Compressing objects: 100% (2/2), done. remote: Total 6 (delta 0), reused 0 (delta 0) Receiving objects: 100% (6/6), done.
None
yt $ git remote add -f origin
[email protected]
:adelcambre/demo.git Updating origin
From github.com:adelcambre/demo * [new branch] master -> origin/master ! yt $ git push origin master Counting objects: 6, done. Delta compression using up to 8 threads. Compressing objects: 100% (2/2), done. Writing objects: 100% (6/6), 473 bytes, done. Total 6 (delta 0), reused 6 (delta 0) To https://github.com/adelcambre/demo.git * [new branch] master -> master
None
None
GitHub Flow
Make a branch
Add Commits
Open a Pull Request
Discuss & Code Review
Merge and deploy
None
Not so Secret:
Hosting a *lot* of Git repos is Not so Secret:
Hosting a *lot* of Git repos is Not so Secret:
HARD
> 7 million repositories
1.5 million pushes
100 million pulls & clones
27 fileservers
100 TB of online storage
None
Grit
1st Commit GitHub
1st Commit GitHub 1st Commit Grit
Ruby wrapper around Git
repo = Grit::Repo.new(“grit.git”) ! repo.commits # => [#<Grit::Commit "e80bbd2ce67651aa18e57fb0b43618ad4baf7750">, #<Grit::Commit
"91169e1f5fa4de2eaea3f176461f5dc784796769">, #<Grit::Commit "038af8c329ef7c1bae4568b98bd5c58510465493">, #<Grit::Commit "40d3057d09a7a4d61059bca9dca5ae698de58cbe">, #<Grit::Commit "4ea50f4754937bf19461af58ce3b3d24c77311d9">]
This works for everything! ! (locally)
27 fileservers
Smoke “Grit in the cloud”
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 … BERTRPC
module Smoke def self.install! ::Grit.send(:remove_const, :Git) ! ::Grit.const_set(:Git, Smoke::Git) end
end
repo.ls_tree("HEAD").each do | entry| if entry.blob? repo.load_blob(entry.oid) end end
Death by Round Trip
A condensed (and probably wrong) history of git
Bitkeeper
Git
Shared library?
libgit2
JGit
libgit2 http://github.com/libgit2/libgit2
Rugged http://github.com/libgit2/rugged
Ruby wrapper around libgit2
repo = Rugged::Repository.new("rugged.git") ! repo.last_commit # => #<Rugged::Commit:2227356240 oid: 0277b7df0fea08d5f3fc7177e47527fc24d96a0e>
None
GitRPC The New Hotness aka
Like Smoke, But Better
Caching
Pluggable Wire Protocols
Encoding Aware
This is My Job
education.github.com
Questions! Git for Computer Scientists http://eagain.net/articles/git-for-computer-scientists/ My mom told me
git doesn’t scale https://vimeo.com/64716825 GitHub Flow https://guides.github.com/introduction/flow/index.html How GitHub uses GitHub to build Github http://zachholman.com/talk/how-github-uses-github-to-build-github/