How Gitlab Works

7777fbc132a52a9e5f71812645dc534d?s=47 Saito
November 18, 2012
Technology
34
3.4k

How Gitlab Works

RubyConfChina presentation.

7777fbc132a52a9e5f71812645dc534d?s=128

Saito

November 18, 2012
Tweet

More Decks by Saito

See All by Saito
7777fbc132a52a9e5f71812645dc534d?s=48 saito
3
5.8k

Other Decks in Technology

See All in Technology
Ea29e2b19d11b48f867ae71d6a6de5df?s=48 opelab
18
6.7k
F274f2fd3531a606f0a5766c9052b5d8?s=48 miyamotok
0
250
Cd931bc05e7cee46b9a950a63e47ba4c?s=48 you
0
130
6d87223b5fcfb9a5a73007f77f134e28?s=48 taketora
0
150
F301c0275838d562c72ea9177e7ddc68?s=48 fkino
7
1.1k
Ee6254efe6c4bc4c08967c11d4939245?s=48 kotetuco
2
150
25325b405f9ca72c4c8024727c41cb98?s=48 hisayuki
1
280
E525f881c3ee0fc2b2ce53d80a82b9d8?s=48 13imi
0
320
467edb2e221a47426f19405f53aa51ca?s=48 nakaly
5
2.6k
7e6a435700dda6cdb22105d601f20892?s=48 picardparis
4
2k
53850955f15249a1a9dc49df6113e400?s=48 line_developers
1
830
53850955f15249a1a9dc49df6113e400?s=48 line_developers
0
320

Featured

See All Featured
5ce91fa49a613cbc3e20d5f96856473f?s=48 edds
55
9.2k
61857dafbd287b3027c4dcea9008ad3c?s=48 carmenhchung
18
910
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
115
4.7k
D36d2c1821af9249b69ff7f5ed60529b?s=48 tammielis
236
23k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
448
35k
1b8ad785acdd1ce1c99914b1c2a4e10e?s=48 sugarenia
230
770k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
165
6.8k
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
164
18k
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
10
590
24fc194843a71f10949be18d5a692682?s=48 gr2m
82
11k
F57e2136eb9895eb95ff5dc8a1c02677?s=48 zakiwarfel
87
3.2k
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
356
62k

Transcript

  1. How GitLab Works

  2. Saito github.com/saitowu @saitowu

  3. AIXForce

  4. GitLab?

  5. GitLab? Self Hosted Git Management Application

  6. None

  7. issues code snippet ssh & http wall ... code view

    wiki network graph merge request

  8. happy to use it.

  9. happy to use it. want to know how it works?

  10. None

  11. backend

  12. backend repo access

  13. backend repo access presentation layer

  14. Backend

  15. Can be backend:

  16. Can be backend: protocol

  17. Can be backend: file => (RW) git => (R) ssh

    => (RW) http => (RW) protocol

  18. Can be backend: file => (RW) git => (R) ssh

    => (RW) http => (RW) protocol x x

  19. Can be backend: file => (RW) git => (R) ssh

    => (RW) http => (RW) protocol x x #=> remote #=> authentication

  20. SSH:

  21. SSH: normal: authorized_keys

  22. SSH: normal: authorized_keys

  23. SSH:

  24. SSH: gitosis/gitolite: authorized_keys

  25. SSH: gitosis/gitolite: authorized_keys SSH magic command

  26. SSH: gitosis/gitolite: authorized_keys SSH magic command

  27. SSH:

  28. SSH: sshd: not authorized_keys

  29. SSH: sshd: not authorized_keys but patched sshd

  30. SSH: sshd: not authorized_keys but patched sshd

  31. SSH: sshd: not authorized_keys but patched sshd

  32. SSH: sshd: not authorized_keys but patched sshd <= instead of

    sshd

  33. SSH:

  34. SSH: GitLab v1.0: gitosis #=> python

  35. SSH: GitLab v1.0: gitosis #=> python GitLab v2.0: gitolite #=>

    perl

  36. HTTP:

  37. HTTP: before Git v1.6.6: dumb

  38. HTTP: before Git v1.6.6: dumb after Git v1.6.6: smart!!!

  39. HTTP: https://github.com/schacon/grack/blob/master/lib/git_http.rb#L10-23

  40. git-upload-pack #=> send git-receive-pack #=> receive HTTP:

  41. git-upload-pack #=> send git-receive-pack #=> receive HTTP: smart

  42. HTTP: GitLab v2.7: smart HTTP protocol

  43. Repo Access

  44. Grit: command-line wrapper

  45. Rugged: ruby bindings to libgit2

  46. Grit vs Rugged

  47. Grit vs Rugged win

  48. Grit vs Rugged win lose

  49. Grit vs Rugged win lose github will migrate from grit

    to rugged too

  50. Repo Browser

  51. Must Know:

  52. Must Know: Git object model

  53. Must Know: Git encoding strategy Git object model

  54. Must Know: Git encoding strategy Ruby encoding Git object model

  55. Git Object Model:

  56. Git Object Model: 4 basic objects: blob tree commit tag

  57. Git Object Model: 4 basic objects: blob tree commit tag

    stored in: .git/objects

  58. Git Object Model:

  59. Git Object Model: git show <sha>

  60. Git Object Model: git cat-file -p <sha> git show <sha>

  61. Git Object Model: http://saito.im/note/Git-Internals/

  62. Git Encoding Strategy: At the core level, git is character

    encoding agnostic. http://www.kernel.org/pub/software/scm/git/docs/v1.5.0.2/git-log.html#_discussion

  63. Git Encoding Strategy:

  64. Git Encoding Strategy: filename

  65. Git Encoding Strategy: filename blob contents

  66. Git Encoding Strategy: filename blob contents commit message

  67. Git Encoding Strategy: filename #=> tree blob blob contents commit

    message

  68. Git Encoding Strategy: filename #=> tree blob blob contents #=>

    blob commit message

  69. Git Encoding Strategy: filename #=> tree blob blob contents #=>

    blob commit message #=> commit tag

  70. Git Encoding Strategy:

  71. Git Encoding Strategy: no need #=> blob contents

  72. Git Encoding Strategy: no need #=> blob contents need #=>

    commit message, filename

  73. Git Encoding Strategy: no need #=> blob contents need #=>

    commit message, filename IMHO: #=> hg hybird strategy & svn

  74. Ruby Encoding: detect encoding:

  75. Ruby Encoding: detect encoding:the longer the better

  76. Ruby Encoding: detect encoding:the longer the better filename

  77. Ruby Encoding: detect encoding:the longer the better filename blob contents

  78. Ruby Encoding: detect encoding:the longer the better filename blob contents

    commit message

  79. Ruby Encoding: detect encoding:the longer the better #=> too short

    filename blob contents commit message

  80. Ruby Encoding: detect encoding:the longer the better #=> too short

    #=> good to detect filename blob contents commit message

  81. Ruby Encoding: detect encoding:the longer the better #=> too short

    #=> good to detect #=> not long enough filename blob contents commit message

  82. Ruby Encoding: Character encoding detection:

  83. Ruby Encoding: Character encoding detection: charlock_holmes

  84. Ruby Encoding: Character encoding detection: charlock_holmes rchardet19

  85. Ruby Encoding: Character encoding detection: charlock_holmes #=> libicu rchardet19

  86. Ruby Encoding: Character encoding detection: charlock_holmes #=> libicu rchardet19 #=>

    pure ruby

  87. Ruby Encoding:

  88. Ruby Encoding: blob contents:

  89. Ruby Encoding: blob contents: filename and commit message:

  90. Ruby Encoding: blob contents: filename and commit message: detect and

    encode

  91. Ruby Encoding: blob contents: filename and commit message: detect and

    encode hard to deal with

  92. Ruby Encoding:

  93. Ruby Encoding: CSI

  94. Ruby Encoding: CSI #=> Character Set Independent

  95. Ruby Encoding: CSI USC #=> Character Set Independent

  96. Ruby Encoding: CSI USC #=> Character Set Independent #=> Universal

    Character Set

  97. Ruby Encoding: CSI USC #=> Ruby #=> Character Set Independent

    #=> Universal Character Set

  98. Ruby Encoding: CSI USC #=> Ruby #=> Java Python Perl

    #=> Character Set Independent #=> Universal Character Set

  99. Ruby Encoding:

  100. Ruby Encoding: MRI 1.8:

  101. Ruby Encoding: MRI 1.8: defective encoding

  102. Ruby Encoding: MRI 1.8: MRI 1.9: defective encoding

  103. Ruby Encoding: MRI 1.8: MRI 1.9: defective encoding Encoding Class

  104. Ruby Encoding: MRI 1.8: MRI 1.9: defective encoding pros: regexp

    length Encoding Class

  105. Ruby Encoding: MRI 1.8: MRI 1.9: defective encoding pros: regexp

    length cons: incompatible character encodings Encoding Class

  106. Hooks

  107. Post-receive:

  108. Post-receive: push event to redis

  109. Post-receive: push event to redis resque it

  110. scalability : Web Hooks Post-receive:

  111. interoperability : API Post-receive:

  112. interoperability : API based on grape Post-receive:

  113. More

  114. Git: pull-request

  115. Git: pull-request git format-patch <br>..<br>

  116. Git: git apply --check <patch> pull-request git format-patch <br>..<br>

  117. Git: git apply --check <patch> pull-request git format-patch <br>..<br> git

    am <patch>

  118. Git: git cherry-pick <sha> cherry-pick

  119. One More Thing

  120. Gitlab CI

  121. Thanks