Container CI & Jenkins Job Builder

by Aya (Igarashi) Ozawa

Slide 1

Slide 1 text

01 JENKINS STUDY #9 Hello Container CI & JJB Container CI & JJB

Slide 2

Slide 2 text

2 ABOUT ME Software Engineer AYA IGARASHI NTT Communications @Ladicle 2

Slide 3

Slide 3 text

3 AGENDA INTRODUCTION ContainerCIͷྲྀΕ 01 02 03 04 ARCHITECTURE PROS VS CONS JOB MANAGEMENT BEFORE -> AFTER ContainerCIͷ·ͱΊ JOBΛͲͷΑ͏ʹRV, ؅ཧ͢Δ͔? JOB؅ཧΛ࢝ΊΔલͱޙ ͕࣌ؒ͋·Ε͹  Demo

Slide 4

Slide 4 text

4 ARCHITECTURE CONTAINER CI

Slide 5

Slide 5 text

5 ContainerCIͷྲྀΕ ARCHITECTURE Push code to GitHub 01 02 03 04 Build UT & IT jobs Run tests on Containers Notify result to Slack Not plugin Kubernetes :) Parallel execution Web hook plugin

Slide 6

Slide 6 text

6 ContainerCIͷ؀ڥߏ੒ ARCHITECTURE VM VM Jenkins OpenStack Kubernetes Docker Registry 02 CREATE CONTAINERS Container TRIGGER Fixed Components VM VM VM 01 BUILD&PUSH IMAGE

Slide 7

Slide 7 text

7 ContainerCIͷ؀ڥߏ੒ ARCHITECTURE VM OpenStack Container 03 PULL IMAGE 04 EXECUTE TESTS VM Jenkins Kubernetes Docker Registry VM VM VM 02 CREATE CONTAINERS

Slide 8

Slide 8 text

8 ContainerCIͷ؀ڥߏ੒ ARCHITECTURE VM OpenStack Container 05 RETURN RESULTS NOTIFY VM Jenkins Kubernetes Docker Registry VM VM VM 04 EXECUTE TESTS

Slide 9

Slide 9 text

9 Jobߏ੒ (1 BLOCK == 1 JOB) ARCHITECTURE Repository Trigger UT Trigger IT Trigger Check syntax Delete containers Build image PullReq Hook Create Containers Delete containers Create Containers Run Scenario Test Run Unit Test Manual Trigger GitHub Event Hook

Slide 10

Slide 10 text

10 ContainerCIͷPros/Cons CONCLUSION PROS CONS ● ίϯςφ಺Ͱ׬݁͢ΔͷͰࢼݧ؀ڥ͕ԚΕͳ͍ ● ඞཁͳ࣌ʹඞཁͳ਺͚ͩࢼݧ؀ڥΛ࡞ΕΔ ● ಈ࡞֬ೝͨ͠ίϯςφΛͦͷ··ຊ൪؀ڥͰ࢖͑Δ ● Πϝʔδͷ࡞੒ͱొ࿥ͷ෼͚ͩɺ͕͔͔࣌ؒΔ ● ίϯςφ಺ͷόάղੳʹ͸׳Ε͕ඞཁ ● ·ͩރΕ͍ͯͳ͍ͷͰ೔ʑDocker౳ͷόάΛ౿Ή

Slide 11

Slide 11 text

11 MANAGEMENT BY JJB શͯΛCLIͰૢ࡞͍ͨ͠ Jenkinsfile΋͍͍͚Ͳ…

Slide 12

Slide 12 text

12 Jenkins Job Builderͱ͸? ARCHITECTURE OpenStack Infraͷ1ϓϩδΣΫτɻ YAML·ͨ͸JSONͰJobΛఆٛ/؅ཧͰ͖ΔΑ͏ʹͨ͠΋ͷɻ - job: name: 'hoge-trigger' triggers: - timed: '0 9 * * 1-5' scm: - git: url: [email protected]:Ladicle/hoge.git builders: - shell: | echo "Hello world! $VALUE_1” publishers: - email: recipients: '[email protected]' 01 TRIGGERS CronͷܖػʹϏϧυ͢Δઃఆ 02 SCM GitHubͷࢦఆrepoΛClone͢Δ 02 BUILDERS ຊJOBͰॲཧ͢Δ಺༰ 02 PUBLISHERS ௨஌౳ͷϏϧυޙͷॲཧ ΄΅ɺJENKINSͷJOBઃఆɹɹ ϑΝΠϧͷཁૉͱҰக͍ͯ͠Δ දهΛ֮͑΍͍͢

Slide 13

Slide 13 text

13 Jenkins Job Builderͱ͸? ARCHITECTURE - job-template: name: '{repo}-trigger' builders: - shell: | echo “Hello {variable1}!“ - project: name: sample default-variable1: 1 repo: - hoge: default-variable1: 3 - piyo - age jobs: - '{repo}-trigger': variable1: '{default-variable1}' ϨϙδτϦ໊͚ͩҟͳΓಉ͡ॲ ཧΛ͢ΔJOBͳͲ΋ɺɹɹɹɹ ม਺Λ࢖͑͹؆୯ʹ࡞ΕΔɻ ୯७ͳYAMLͰ͸ͳ͘ɺม਺ {} ΋࢖͑Δɻ ม਺Λ্ॻ͖ variable1ʹ୅ೖ variable1Λࢀর 01 ࡞੒͞ΕΔJOB໊ hoge-trigger 02 piyo-trigger 03 age-trigger ࣮ߦ͢Δͱ ΋ͪΖΜɺ Pipline΋αϙʔτ

Slide 14

Slide 14 text

14 JJBʹΑΔJobͷ؅ཧ ARCHITECTURE YAML XML Jenkins Review Pull & Push Convert JJB Apply Before After ● ؅ཧ਺ΛݮΒͨ͢Ίಉ͡ॲཧΛ·ͱΊͨ΋ͷͷɺ ৚݅෼ذ͕ෳࡶͰ೉ղ ● ೉ղͳͨΊɺଐਓԽ͕ਐΉ ● RV͞Εͳ͍··Job͕มߋ͞ΕࣄނΔ ● มʹ·ͱΊΔඞཁ͕ͳ͘ͳͬͨͨΊɺɹɹɹɹ Script͕γϯϓϧʹͳͬͨ ● γϯϓϧ͔ͭRVͰཧղ͢Δػձ͕૿͑ɺɹɹɹ JobΛߋ৽Ͱ͖Δਓ͕૿͑ͨ ● Git(Hub)͕࢖͑Δ

Slide 15

Slide 15 text

15 JJB DEMO Using Local Docker https://github.com/Ladicle/jjb-demo

Slide 16

Slide 16 text

16 ContainerCI ServiceͱJenkins ADDITIONAL JENKINS CONTAINER CI SERVICE ࢖༻ྔʹԠͯ͡՝ۚ͞ΕΔ Φʔϓϯιʔεʹର͢ΔࢼݧͰ ͋Ε͹ແྉͷ΋ͷ͕ଟ͍ αʔόͳͲͷϋʔυ΢ΣΞʹର ͢Δ౤ࢿ͕ෆཁ ΠϯλʔωοτΛܦ༝͢Δ ಛԽͨ͠ػೳΛ࣋ͭ΋ͷ͕ଟ ͘ɺσϑΥϧτͷςϯϓϨʔτ ͕๛෋Ͱॳظֶशίετ͸௿͍ ෳࡶͳ݁߹ࢼݧͳͲɺରԠͰ͖ ͳ͍ࢼݧ΋͋Δ ӡ༻͕ඞཁ ΦϯϓϨϛεͷͨΊɺࣾ಺ωο τϫʔΫʹด͡Δ͜ͱ͕Ͱ͖Δ ΦʔϓϯιʔεͷͨΊɺࠔͬͨ ΒίʔυΛ௥͑Δ JJBΛ࢖͑͹GitͰJob؅ཧͰ͖Δ ͋Δఔ౓ॳظֶशίετ͕͋Δ ཧղޙ͸ͲΜͳࢼݧʹ΋ॊೈʹ ରԠ͠΍͍͢ ༻్ʹԠͯ͡ ࢖͍෼͚

Slide 17

Slide 17 text

17 Upgrade container Jenkins from v1.642 to v2.7 ADDITIONAL STEP 02 STEP 03 STEP 04 STEP 01 BACKUP $JENKINS_HOME Λ·Δͬͱอଘ CHANGE IMAGE TAG TAGΛ2.7ʹมߋ PROS VS CONS ݱߦίϯςφఀࢭ PROS VS CONS ίϯςφΛ࠶ىಈ

Slide 18

Slide 18 text

Thanks for watching! See You Next Time 18 @ladicle