Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Git, GitHub, Etc
Search
Andy Delcambre
April 19, 2014
Programming
3
200
Git, GitHub, Etc
How git and GitHub work, behind the scenes. Aka what I do in my day job.
Andy Delcambre
April 19, 2014
Tweet
Share
More Decks by Andy Delcambre
See All by Andy Delcambre
Git and GitHub at YAPC:Asia
adelcambre
1
3.3k
Systems Programming - SoCoded 2013
adelcambre
2
160
Ruby Systems Programming
adelcambre
4
1.1k
Debugging Production Service Oriented Systems
adelcambre
3
420
Ruby, Rails and Engine Yard - Úll
adelcambre
1
260
SFRuby Nov 2011 - Release Early and Release Often
adelcambre
2
78
Release early and Release often
adelcambre
2
430
Other Decks in Programming
See All in Programming
Rust.Nagoya #1
codemountains
0
170
The rollercoaster of releasing an Android, iOS, and macOS app with Kotlin Multiplatform | droidcon Berlin
prof18
0
110
小さな開発会社を作った理由
polidog
0
1.9k
Cloudflare Workers x AWS Lambdaの組み合わせユースケース / Cloudflare Workers x AWS Lambda Combination Use Case
seike460
PRO
2
310
CSC307 Lecture 08
javiergs
PRO
0
330
CSC307 Lecture 10
javiergs
PRO
0
310
Clean Architecture by TypeScript & NestJS
ryounasso
0
150
Folding Cheat Sheet #7
philipschwarz
PRO
0
150
はしめてのプログラミングとロボット制御
watawatavoltage
0
290
日付と正規化
megmogmog1965
0
140
さきがけから振り返るアーキテクチャ刷新 / Reflecting on the Architectural Renewal from the Vanguard
nrslib
2
770
SRE チーム立ち上げ前に考えたこと・取り組んだこと / Considerations and Preparations Before Establishing an SRE Team
mackey0225
3
320
Featured
See All Featured
Why You Should Never Use an ORM
jnunemaker
PRO
51
8.9k
BBQ
matthewcrist
82
9k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
360
22k
Rebuilding a faster, lazier Slack
samanthasiow
78
8.5k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
248
20k
How to train your dragon (web standard)
notwaldorf
79
5.5k
Typedesign – Prime Four
hannesfritz
37
2.2k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
353
29k
Web development in the modern age
philhawksworth
203
10k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
18
1.2k
Making Projects Easy
brettharned
111
5.7k
Building Better People: How to give real-time feedback that sticks.
wjessup
357
18k
Transcript
Git, GitHub, Etc Andy Delcambre
None
None
PLANET ARGON
None
None
None
None
DIRECTED ACYCLIC GRAPH
yt $ git init Initialized empty Git repository in /private/tmp/demo/.git/
yt $ echo "My sweet repo" > README yt ✗ $ git add README yt ✗ $ git status # On branch master # # Initial commit # # Changes to be committed: # (use "git rm --cached <file>..." to unstage) # # new file: README # yt ✗ $ git commit -m "Add a README" [master (root-commit) 8a720fa] Add a README 1 file changed, 1 insertion(+) create mode 100644 README yt $ git log commit 8a720fa06710948f2ab79dd3e213ef745b6000c5 Author: Andy Delcambre <
[email protected]
> Date: Mon Apr 14 15:41:34 2014 -0700 ! Add a README
8a720fa HEAD, master Refs Commit
yt $ echo "It's so awesome" >> README yt ✗
$ git add README yt ✗ $ git commit -m "Update README" [master ede0fc8] Update README 1 file changed, 1 insertion(+) yt $ git log --graph --decorate --pretty=oneline * ede0fc8 (HEAD, master) Update README * 8a720fa Add a README%
Commit 8a720fa ede0fc8 HEAD, master Refs Commit
yt $ git cat-file -p ede0fc8 tree 493fc85c806ebd9e49395561d2f9c98a5d9ebdce parent 8a720fa06710948f2ab79dd3e213ef745b6000c5
author Andy Delcambre <
[email protected]
> 1397516385 -0700 committer Andy Delcambre <
[email protected]
> 1397516385 -0700 ! Update README
Commit ede0fc8 8a720fa 493fc85 Parent Tree
yt $ git cat-file -p 493fc85 100644 blob 17ca828132ebdc5347f4c5c20484b9a33fffb294 README
!
Tree 493fc85 17ca828 Blob (README)
yt $ git cat-file -p 17ca828 My sweet repo It's
so awesome
GitHub
Secret:
Hosting a Git repo is Secret:
Hosting a Git repo is Secret: EASY
enzo $ git init --bare demo.git Initialized empty Git repo
in /home/adelcambre/git/demo.git/ ! yt $ git remote add origin adelcambre@enzo:git/demo.git yt $ git push origin master Counting objects: 6, done. Delta compression using up to 8 threads. Compressing objects: 100% (2/2), done. Writing objects: 100% (6/6), 473 bytes, done. Total 6 (delta 0), reused 6 (delta 0) To adelcambre@enzo:git/demo.git * [new branch] master -> master ! yt $ git clone adelcambre@enzo:git/demo.git Cloning into 'demo'... remote: Counting objects: 6, done. remote: Compressing objects: 100% (2/2), done. remote: Total 6 (delta 0), reused 0 (delta 0) Receiving objects: 100% (6/6), done.
None
yt $ git remote add -f origin
[email protected]
:adelcambre/demo.git Updating origin
From github.com:adelcambre/demo * [new branch] master -> origin/master ! yt $ git push origin master Counting objects: 6, done. Delta compression using up to 8 threads. Compressing objects: 100% (2/2), done. Writing objects: 100% (6/6), 473 bytes, done. Total 6 (delta 0), reused 6 (delta 0) To https://github.com/adelcambre/demo.git * [new branch] master -> master
None
None
GitHub Flow
Make a branch
Add Commits
Open a Pull Request
Discuss & Code Review
Merge and deploy
None
Not so Secret:
Hosting a *lot* of Git repos is Not so Secret:
Hosting a *lot* of Git repos is Not so Secret:
HARD
> 7 million repositories
1.5 million pushes
100 million pulls & clones
27 fileservers
100 TB of online storage
None
Grit
1st Commit GitHub
1st Commit GitHub 1st Commit Grit
Ruby wrapper around Git
repo = Grit::Repo.new(“grit.git”) ! repo.commits # => [#<Grit::Commit "e80bbd2ce67651aa18e57fb0b43618ad4baf7750">, #<Grit::Commit
"91169e1f5fa4de2eaea3f176461f5dc784796769">, #<Grit::Commit "038af8c329ef7c1bae4568b98bd5c58510465493">, #<Grit::Commit "40d3057d09a7a4d61059bca9dca5ae698de58cbe">, #<Grit::Commit "4ea50f4754937bf19461af58ce3b3d24c77311d9">]
This works for everything! ! (locally)
27 fileservers
Smoke “Grit in the cloud”
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 …
The Internet Chimney fs102 fs103 fs104 fs105 … fe102 fe103
fe104 fe105 … BERTRPC
module Smoke def self.install! ::Grit.send(:remove_const, :Git) ! ::Grit.const_set(:Git, Smoke::Git) end
end
repo.ls_tree("HEAD").each do | entry| if entry.blob? repo.load_blob(entry.oid) end end
Death by Round Trip
A condensed (and probably wrong) history of git
Bitkeeper
Git
Shared library?
libgit2
JGit
libgit2 http://github.com/libgit2/libgit2
Rugged http://github.com/libgit2/rugged
Ruby wrapper around libgit2
repo = Rugged::Repository.new("rugged.git") ! repo.last_commit # => #<Rugged::Commit:2227356240 oid: 0277b7df0fea08d5f3fc7177e47527fc24d96a0e>
None
GitRPC The New Hotness aka
Like Smoke, But Better
Caching
Pluggable Wire Protocols
Encoding Aware
This is My Job
education.github.com
Questions! Git for Computer Scientists http://eagain.net/articles/git-for-computer-scientists/ My mom told me
git doesn’t scale https://vimeo.com/64716825 GitHub Flow https://guides.github.com/introduction/flow/index.html How GitHub uses GitHub to build Github http://zachholman.com/talk/how-github-uses-github-to-build-github/