$30 off During Our Annual Pro Sale. View Details »

Advanced GitLab Workshop - 談 pipeline 調教與進階 GitLab CI 語法

mouson(墨嗓)
November 24, 2021
Technology
0
890

Advanced GitLab Workshop - 談 pipeline 調教與進階 GitLab CI 語法

此為 DevOpsDays Taipei 2021 中的 Workshop Advanced GitLab CI 所使用的簡報，與簡報搭配的範例 GitLab Repo：
https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24

PS. 本次工作坊使用的範例及對應步驟，大部分都可以在對應的 GitLab 中找到對應的 Git 分支。可透過 GitLab pipeline editor 直接選擇分支進行查看及編輯。

mouson(墨嗓)

November 24, 2021
Tweet

More Decks by mouson(墨嗓)

See All by mouson(墨嗓)
從 Legacy 到 Lovely，用 CI/CD 改建二十年祖產全記錄
mouson
0
210
GitLab 13~14CICD功能亮點提示-GitLab 10週年線上聚會
mouson
0
530
深入GitLabCI-談描述檔重構與流水線加速
mouson
4
880
GitLab CI 從團隊導入到運用
mouson
2
560
PHP 升版絕活 - 給你一劑面對 Legacy 專案的還魂丹
mouson
0
410
20190323_ThreeGitTips-台日技術社群交流會
mouson
1
980
用PHP快速建立商品上架通知器 - Star Rocket Meetup EP3
mouson
1
140
20170701 Eloquent 核心解構 讓 Laravel 支援更多資料庫
mouson
3
1.3k
GIT從入門到應用-線上讀書會
mouson
1
970

Other Decks in Technology

See All in Technology
急成長スタートアップにおける技術的負債とトレードオフ・スライダー / Technical Debt and Trade-off Sliders in Fast-Growing Startups
codenote
2
2.3k
開発生産性大幅アップ！Postman VS Code拡張機能
nagix
0
120
Honoが良さそう🔥
is_ryo
0
170
LINEでのコミュニケーションにマスコットキーホルダーを使ってみる / LINEを使ったLT大会 #5
you
PRO
0
100
The future is already here – Mastering the challenges of the coming years
ufried
0
250
Making your Kubernetes-based log collection reliable & durable with Vector
palark
0
320
LLMエンジニアリングを加速させるソフトウェアアーキテクチャ
tkikuchi1002
0
380
走馬灯のIaCは考えておいて
nwiizo
6
3.2k
CTO of the year 2023ピッチ資料（オーディエンス賞）チューリングCTO青木
aoshun7
0
220
分散型SNS最新状況
kojira
0
190
The Future of encoding/json
iamshunta
2
180
非開発者のためのプロンプトエンジニアリング入門
seosoft
0
120

Featured

See All Featured
The World Runs on Bad Software
bkeepers
PRO
59
6.1k
Why Our Code Smells
bkeepers
PRO
329
56k
Building Effective Engineering Teams - LeadDev
addyosmani
22
1.2k
Music & Morning Musume
bryan
38
5.2k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
10
1.2k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
0
1k
Ruby is Unlike a Banana
tanoku
93
10k
Building a Modern Day 
E-commerce SEO Strategy
aleyda
13
5.9k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
52
32k
KATA
mclloyd
13
11k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
240
20k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
656
120k

Transcript

  1. Advanced GitLab CI


    談 pipeline 調教與進階 GitLab CI
    墨嗓 (陳佑⽵)


    2021/11/24 @ DevOpsDays Taipei 2021

    View Slide

  2. About Me
    • 陳佑⽵，朋友都叫我墨嗓(Mouson)。
    專注於資訊科技整合、應⽤、開發⽅
    法及研究的T型⼈。


    妞妞

    View Slide

  3. View Slide

  4. DevOpsDaysGitLab

    View Slide

  5. 本⽇練習範例
    https://bit.ly/DevOpsDaysGitLab
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24

    View Slide

  6. Fork
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24
    https://bit.ly/DevOpsDaysGitLab

    View Slide

  7. 到⾃⼰的空間
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24
    https://bit.ly/DevOpsDaysGitLab

    View Slide

  8. 皆已建立分⽀
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24
    https://bit.ly/DevOpsDaysGitLab

    View Slide

  9. 進入 Pipeline
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24
    https://bit.ly/DevOpsDaysGitLab

    View Slide

  10. Run Pipeline
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24
    https://bit.ly/DevOpsDaysGitLab

    View Slide

  11. Run Pipeline
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24
    https://bit.ly/DevOpsDaysGitLab

    View Slide

  12. 使⽤ Pipeline Editor
    https://gitlab.com/mouson-gitlab-playground/gitlab-ci-workshop-2021-11-24
    https://bit.ly/DevOpsDaysGitLab

    View Slide

  13. Part I：GitLab CI 進階語法


    Part II：加速 GitLab CI Pipeline

    View Slide

  14. Part I：GitLab CI 進階語法
    Part II：加速 GitLab CI Pipeline

    View Slide

  15. 從前從前....
    使⽤ GitLab CI ⾃動檢查格式

    View Slide

  16. 加入⾃動測試

    View Slide

  17. 加入⾃動部署

    View Slide

  18. 再增加


    ⼀種版本...
    分⽀：00-init

    View Slide

  19. 越來越難以維護的


    .gitlab-ci.yml
    該怎麼整理？

    View Slide

  20. 怎麼整理？
    針對 v73, v74 分別有：


    lint、test、deploy 三種類型的⼯作

    View Slide

  21. 01. 擷取⼀致的
    部分到 Default:
    擷取⼀致的 script 變為 default:
    分⽀：01-default

    View Slide

  22. 01. 擷取⼀致的
    部分到 Default:
    擷取⼀致的 script 變為 default:
    分⽀：01-default

    View Slide

  23. Default:
    1. Pipeline 中所有⼯作都會套⽤


    2. 如不符使⽤，可以覆寫


    3. ⽀援：image、services、
    before_script、after_script、tags、
    cache、artifacts、retry、timeout、
    interruptible
    分⽀：01-default

    View Slide

  24. Default:
    不想沿⽤ Default，可以使⽤
    inherit:default
    https://docs.gitlab.com/ee/ci/yaml/index.html#inheritdefault

    View Slide

  25. 02. 整理 script
    共同之程序
    整理出來的 Script，可以做程序的分
    組，⽅便後續使⽤
    分⽀：02-extract-to-before-script

    View Slide

  26. 2. 整理 script
    共同之程序
    整理出來的 Script，可以做程序的分
    組，⽅便後續使⽤
    分⽀：02-extract-to-before-script

    View Slide

  27. 02. 整理 script
    共同之程序
    整理出來的 Script，可以做程序的分
    組，⽅便後續使⽤
    分⽀：02-extract-to-before-script

    View Slide

  28. 03. 擷取重複段
    落以繼承再利⽤
    利⽤ hidden job


    整理 job 共同的部分


    並使⽤ extends 繼承
    分⽀：03-extract-before-script-t...

    View Slide

  29. 03. 擷取重複段
    落以繼承再利⽤
    利⽤ hidden job


    整理 job 共同的部分


    並使⽤ extends 繼承
    分⽀：03-extract-before-script-t...

    View Slide

  30. 03. 擷取重複段
    落以繼承再利⽤
    利⽤ hidden job


    整理 job 共同的部分


    並使⽤ extends 繼承
    分⽀：03-extract-before-script-t...

    View Slide

  31. hidden job
    1. 以 「.」開頭的⼯作名稱：


    整個⼯作都不執⾏
    分⽀：03-extract-before-script-t...

    View Slide

  32. extends:
    分⽀：03-extract-before-script-t...

    View Slide

  33. extends:
    1. 把繼承來源的內容抄⼀次
    分⽀：03-extract-before-script-t...

    View Slide

  34. extends:
    1. 把繼承來源的內容抄⼀次
    2. 可以允許既成多個來源
    分⽀：03-extract-before-script-t...

    View Slide

  35. extends:
    1. 把繼承來源的內容抄⼀次
    2. 可以允許既成多個來源
    3. 重複的內容：
    分⽀：03-extract-before-script-t...

    View Slide

  36. extends:
    1. 把繼承來源的內容抄⼀次
    2. 可以允許既成多個來源
    3. 重複的內容：
    script: 後蓋前
    分⽀：03-extract-before-script-t...

    View Slide

  37. extends:
    1. 把繼承來源的內容抄⼀次
    2. 可以允許既成多個來源
    3. 重複的內容：
    script: 後蓋前
    variables: 取合集後蓋前
    分⽀：03-extract-before-script-t...

    View Slide

  38. 04.利⽤Anchors


    整理可複⽤的
    script
    分⽀：04-extract-prepare-process

    View Slide

  39. 04.利⽤Anchors


    整理可複⽤的
    script
    分⽀：04-extract-prepare-process

    View Slide

  40. 04.利⽤Anchors


    整理可複⽤的
    script
    分⽀：04-extract-prepare-process

    View Slide

  41. Anchors
    1. 可允許多⾏


    2. 可在 script 中使⽤
    分⽀：04-extract-prepare-process

    View Slide

  42. Anchors
    1. 可允許多⾏


    2. 可在 script 中使⽤
    分⽀：04-extract-prepare-process

    View Slide

  43. Anchors
    1. 可允許多⾏


    2. 可在 script 中使⽤
    分⽀：04-extract-prepare-process

    View Slide

  44. 04-02. 利⽤


    !reference


    整理可複⽤的 script
    (GitLab 13.9)
    04-02-extract-prepare-process
    https://docs.gitlab.com/ee/ci/yaml/yaml_optimization.html

    View Slide

  45. !reference


    vs.


    anchor tags
    !reference 可以參考 include 的 yaml
    04-02-extract-prepare-process
    https://docs.gitlab.com/ee/ci/yaml/yaml_optimization.html

    View Slide

  46. 05-1. 擷取為
    變數控制
    05-1-extract-to-variables

    View Slide

  47. 05-1. 擷取為
    變數控制
    05-1-extract-to-variables

    View Slide

  48. 05-1. 擷取為
    變數控制
    05-1-extract-to-variables

    View Slide

  49. 05-2. 建立同類
    ⼯作模板 tmpl
    extends: 可以允許多層次繼承
    05-2-extract-job-to-template

    View Slide

  50. 05-2. 建立同類
    ⼯作模板 tmpl
    extends: 可以允許多層次繼承
    05-2-extract-job-to-template

    View Slide

  51. extends: 可以允許多層次繼承
    06. 使⽤
    Parallel Matrix
    06-extract-to-parallel-matrix

    View Slide

  52. 06. 使⽤
    Parallel Matrix
    06-extract-to-parallel-matrix

    View Slide

  53. 06. 使⽤
    Parallel Matrix
    06-extract-to-parallel-matrix

    View Slide

  54. 07. 擷取 Parallel
    Matrix 為模板供
    繼承
    07-extract-version-de
    fi
    ne-to-....

    View Slide

  55. 07. 擷取 Parallel
    Matrix 為模板供
    繼承
    07-extract-version-de
    fi
    ne-to-....

    View Slide

  56. 07. 擷取 Parallel
    Matrix 為模板供
    繼承
    entends: 允許既成多個來源
    07-extract-version-de
    fi
    ne-to-....

    View Slide

  57. 08. 拆分檔案利
    ⽤ include 載入
    08-extract-to-template-yaml

    View Slide

  58. 08. 拆分檔案利
    ⽤ include 載入
    08-extract-to-template-yaml

    View Slide

  59. 08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    08-extract-to-template-yaml

    View Slide

  60. 08-extract-to-template-yaml
    08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    View Slide

  61. 08-extract-to-template-yaml
    08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    View Slide

  62. 08-extract-to-template-yaml
    08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    View Slide

  63. 08-extract-to-template-yaml
    08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    View Slide

  64. 08-extract-to-template-yaml
    08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    View Slide

  65. 08-extract-to-template-yaml
    08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    View Slide

  66. 08. 拆分檔案利
    ⽤ include 載入
    ├── .gitlab-ci.yml


    └── templates


    ├── common.yml


    ├── de
    fi
    ne.yml


    ├── lint.yml


    ├── test.yml


    └── deploy.yml


    08-extract-to-template-yaml

    View Slide

  67. include:
    - local: 同專案下的檔案


    - remote: URL 連結


    - template: GitLab 官⽅提供的模板


    -
    fi
    le: 來⾃其他專案的檔案


    View Slide

  68. include:
    - local: 同專案下的檔案


    - remote: URL 連結


    - template: GitLab 官⽅提供的模板


    -
    fi
    le: 來⾃其他專案的檔案


    GitLab 13.11.

    View Slide

  69. 09. 建立共⽤流
    程供其他專案


    使⽤
    09-used-template-from-other-project

    View Slide

  70. include:
    fi
    le introduced in GitLab 11.7


    include multi
    fi
    le from a project in
    GitLab 13.6
    09. 建立共⽤流
    程供其他專案


    使⽤
    09-used-template-from-other-project

    View Slide

  71. 變更及覆寫參數
    09. 建立共⽤流
    程供其他專案


    使⽤
    09-used-template-from-other-project

    View Slide

  72. 變更及覆寫參數
    09-1. 變數變
    更及覆寫
    09-1-overwrite-job-and-variable

    View Slide

  73. 09-2. 從模板選
    擇需要的⼯作

    View Slide

  74. 09-2. 從模板選
    擇需要的⼯作

    View Slide

  75. Recap
    • 利⽤ default stage 整理所有 job 都共同的


    • 利⽤ .hidden 建立模板⼯作，並⽤ extends 繼承使⽤


    • 利⽤ Anchors、Reference 整理可重複使⽤的 Script


    • 萃取出變數


    • 利⽤ Parallel Matrix 功能


    • 建立多專案共⽤流程

    View Slide

  76. Part I：GitLab CI 進階語法


    Part II：加速 GitLab CI Pipeline

    View Slide

  77. 流⽔線加速三要素

    View Slide

  78. 流⽔線加速三要素
    • ⼯作 少做點

    View Slide

  79. 流⽔線加速三要素
    • ⼯作 少做點
    • 事情 作快點

    View Slide

  80. 流⽔線加速三要素
    • ⼯作 少做點
    • 事情 作快點
    • 作事的 多⼀點

    View Slide

  81. 流⽔線 Pipeline 啟動到結束


    哪些地⽅花了時間？

    View Slide

  82. .gitlab-ci.yml

    View Slide

  83. .gitlab-ci.yml

    View Slide

  84. .gitlab-ci.yml

    View Slide

  85. .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  86. .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner

    View Slide

  87. .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    View Slide

  88. .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  89. •什麼⼯作先作比較好？
    .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  90. 什麼⼯作先做比較好？

    View Slide

  91. 什麼⼯作先做比較好？
    • 跑的快的⼯作

    View Slide

  92. 什麼⼯作先做比較好？
    • 跑的快的⼯作
    • 早點做完早點確認結果

    View Slide

  93. 什麼⼯作先做比較好？
    • 跑的快的⼯作
    • 早點做完早點確認結果
    • 有決定性的⼯作

    View Slide

  94. 什麼⼯作先做比較好？
    • 跑的快的⼯作
    • 早點做完早點確認結果
    • 有決定性的⼯作
    • 沒通過直接 Reject

    View Slide

  95. •什麼⼯作先做比較好？
    .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  96. •什麼⼯作先做比較好？
    •每個⼯作都是該做的嗎？
    .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  97. 每個⼯作都是該做的嗎？

    View Slide

  98. 每個⼯作都是該做的嗎？
    • 同⼀專案中包含前端及後端的測試

    View Slide

  99. 每個⼯作都是該做的嗎？
    • 同⼀專案中包含前端及後端的測試
    • 可以考慮對應原始碼變更才執⾏對應的測試

    View Slide

  100. 每個⼯作都是該做的嗎？
    • 同⼀專案中包含前端及後端的測試
    • 可以考慮對應原始碼變更才執⾏對應的測試

    View Slide

  101. •什麼⼯作先做比較好？
    •每個⼯作都是該做的嗎？
    .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  102. •什麼⼯作先做比較好？
    •每個⼯作都是該做的嗎？
    •有沒有⼯作花太久時間等
    待進 Queue ?
    .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  103. ⼯作花太久時間等待進 Queue?
    分⽀：10-stage-without-dag-needs

    View Slide

  104. ⼯作花太久時間等待進 Queue?
    build test deploy
    build_a test_a deploy_a
    build_b test_b deploy_b
    build_c test_c deploy_c
    分⽀：10-stage-without-dag-needs

    View Slide

  105. ⼯作花太久時間等待進 Queue?
    build test deploy
    build_a test_a deploy_a
    build_b test_b deploy_b
    build_c test_c deploy_c
    build_b
    分⽀：10-stage-without-dag-needs

    View Slide

  106. ⼯作花太久時間等待進 Queue?
    build test deploy
    build_a test_a deploy_a
    build_b test_b deploy_b
    build_c test_c deploy_c
    build_b
    分⽀：10-stage-without-dag-needs

    View Slide

  107. ⼯作花太久時間等待進 Queue?
    • 套⽤ DAG 機制 (GitLab 12.2）
    build test deploy
    build_a test_a deploy_a
    build_b test_b deploy_b
    build_c test_c deploy_c
    build_b
    分⽀：10-1-stage-with-needs

    View Slide

  108. ⼯作花太久時間等待進 Queue?
    • 套⽤ DAG 機制 (GitLab 12.2）
    build test deploy
    build_a test_a deploy_a
    build_b test_b deploy_b
    build_c test_c deploy_c
    build_b
    分⽀：10-1-stage-with-needs

    View Slide

  109. ⼯作花太久時間等待進 Queue?
    • 套⽤ DAG 機制 (GitLab 12.2）
    build test deploy
    build_a test_a deploy_a
    build_b test_b deploy_b
    build_c test_c deploy_c
    build_b
    分⽀：10-1-stage-with-needs

    View Slide

  110. .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue

    View Slide

  111. .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner

    View Slide

  112. Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner

    View Slide

  113. Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    •Runner 數量夠嗎？

    View Slide

  114. Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    •Runner 數量夠嗎？
    •能執⾏的 Runner 夠嗎？

    View Slide

  115. Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner

    View Slide

  116. Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    View Slide

  117. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    View Slide

  118. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________

    View Slide

  119. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e

    View Slide

  120. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e
    * git
    g
    i
    t gi
    t
    r

    View Slide

  121. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e
    * git
    g
    i
    t gi
    t
    r
    * restore
    re s
    t o

    View Slide

  122. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e
    * git
    g
    i
    t gi
    t
    r
    * restore
    re s
    t o
    * download
    do wnlo ad

    View Slide

  123. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e
    * git
    g
    i
    t gi
    t
    r
    * restore
    re s
    t o
    * download
    do wnlo ad
    * script
    s c r i p
    t

    View Slide

  124. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e
    * git
    g
    i
    t gi
    t
    r
    * restore
    re s
    t o
    * download
    do wnlo ad
    * script
    s c r i p
    t
    * package
    p
    ack
    a
    ge

    View Slide

  125. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e
    * git
    g
    i
    t gi
    t
    r
    * restore
    re s
    t o
    * download
    do wnlo ad
    * script
    s c r i p
    t
    * package
    p
    ack
    a
    ge
    * saving
    s
    a
    vin

    View Slide

  126. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run
    Run
    ____________________________
    * prepare
    p r
    e
    pa
    r
    e
    p
    r e
    * git
    g
    i
    t gi
    t
    r
    * restore
    re s
    t o
    * download
    do wnlo ad
    * script
    s c r i p
    t
    * package
    p
    ack
    a
    ge
    * saving
    s
    a
    vin
    * uploading
    u
    p load
    i ng

    View Slide

  127. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job
    ____________________________
    * prepare execute env
    * git repo fetch
    * restore cache
    * download artifacts
    * script execute
    * package install
    * saving cache
    * uploading artifacts
    * cleaning up
    fi
    le base var

    View Slide

  128. •Network Performance ?
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job
    ____________________________
    * prepare execute env
    * git repo fetch
    * restore cache
    * download artifacts
    * script execute
    * package install
    * saving cache
    * uploading artifacts
    * cleaning up
    fi
    le base var

    View Slide

  129. •Network Performance ?


    •Docker image size ?
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    * prepare execute env


    * git repo fetch


    * restore cache


    * download artifacts


    * script execute
    * package install


    * saving cache


    * uploading artifacts


    * cleaning up
    fi
    le base var

    View Slide

  130. Docker Image Size ?
    分⽀：11-compare-difference-image

    View Slide

  131. •Network Performance ?


    •Docker image size ?


    •Git Repo Size ?
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    * prepare execute env


    * git repo fetch


    * restore cache


    * download artifacts


    * script execute
    * package install


    * saving cache


    * uploading artifacts


    * cleaning up
    fi
    le base var

    View Slide

  132. •Network Performance ?


    •Docker image size ?


    •Git Repo Size ?


    •Programming Language
    Dependence Package
    Size ?
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    * prepare execute env


    * git repo fetch


    * restore cache


    * download artifacts


    * script execute
    * package install


    * saving cache


    * uploading artifacts


    * cleaning up
    fi
    le base var

    View Slide

  133. •Network Performance ?


    •Docker image size ?


    •Git Repo Size ?


    •Programming Language
    Dependence Package
    Size ?


    •Artifacts Size ?
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    * prepare execute env


    * git repo fetch


    * restore cache


    * download artifacts


    * script execute
    * package install


    * saving cache


    * uploading artifacts


    * cleaning up
    fi
    le base var

    View Slide

  134. •Network Performance ?


    •Docker image size ?


    •Git Repo Size ?


    •Programming Language
    Dependence Package
    Size ?


    •Artifacts Size ?


    •Script Performance ?
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    * prepare execute env


    * git repo fetch


    * restore cache


    * download artifacts


    * script execute
    * package install


    * saving cache


    * uploading artifacts


    * cleaning up
    fi
    le base var

    View Slide

  135. Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    * prepare execute env


    * git repo fetch


    * restore cache


    * download artifacts


    * script execute
    * package install


    * saving cache


    * uploading artifacts


    * cleaning up
    fi
    le base var

    View Slide

  136. .gitlab-ci.yml Job
    Job
    Job
    Job
    Job
    Job
    Job Queue
    Runner


    Server
    Runner


    Server
    Runners
    Runner
    Runner
    Runner
    Runner
    Run Job


    ____________________________


    * prepare execute env


    * git repo fetch


    * restore cache


    * download artifacts


    * script execute
    * package install


    * saving cache


    * uploading artifacts


    * cleaning up
    fi
    le base var

    View Slide

  137. Q&A

    View Slide