kubefork - development experience like owning your own cluster

by Takamichi Omori

Embed

Start on current slide

Slide 1

Slide 1 text

Slide 2

Slide 2 text

Slide 3

Slide 3 text

Slide 4

Slide 4 text

Slide 5

Slide 5 text

©2022 Wantedly, Inc. Kubefork ͱ͸ ࣗ෼ઐ༻ͷΫϥελΛ͍࣋ͬͯΔΑ͏ͳମݧ Ұͭͷ։ൃ༻Ϋϥελ͔ΒԾ૝తͳΫϥελΛ࡞Δ࢓૊Έ Copy on Write ΫϥελΛίϐʔ͢Δͷ͸ίετ͕͔͔Δ   มߋ͍ͨ͠Օॴ͚ͩมߋ͠ɺ ڞ༗Ͱ͖ΔϦιʔε͸ڞ༗͢Δ ΞΫηε͕෼཭͞Ε͍ͯΔͷͰ   ଞͷ։ൃऀʹ໎࿭͕͔͔Βͳ͍ ߴ଎ มߋՕॴ͕࠷খݶ ؀ڥʹΞΫηεͰ͖Δ·Ͱ͕ߴ଎ 5

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

©2022 Wantedly, Inc. ϚΠΫϩαʔϏε։ൃͰେ੾ͳͭͷ͜ͱ มߋΛૉૣ͘ࢼͤΔ ΋ͷͮ͘Γશൠʹ͓͍ͯେࣄ   มߋ͕ྑ͔ͬͨɾѱ͔ͬͨ͜ͱͷϑΟʔυόοΫϧʔϓ ଞਓͷมߋͷӨڹΛड͚ͳ͍ ૝ఆͱҟͳΔϨεϙϯεͷݪҼ͸୭ʁ ݪҼ͕ࣗ෼Ҏ֎ʹ͋ͬͨ৔߹ɺ֬ೝ͕೉͍͠ ґଘؔ܎Λҙࣝ͢Δඞཁ͕ͳ͍ ͜ͷαʔϏε͸Կʹґଘ͍ͯ͠Δʁ ։ൃ͢ΔͨΊʹ͸ԿʹΞΫηεͰ͖ΔΑ͏ʹ͢Δඞཁ͕͋Δʁ αʔϏεɾػೳ͝ͱʹґଘؔ܎Λ͓֮͑ͯ͘ͷ͸େม

Slide 9

Slide 9 text

Slide 10

Slide 10 text

Slide 11

Slide 11 text

Slide 12

Slide 12 text

©2022 Wantedly, Inc. طଘͷख๏ʢ̏ʣ 5FMFQSFTFODF ৄ͘͠͸IUUQTXXXUFMFQSFTFODFJP ˓มߋΛૉૣ͘ࢼͤΔ ɹEPDLFSCVJMEΛ଴ͭඞཁ͕ͳ͍ ˓ґଘؔ܎Λҙࣝ͢Δඞཁ͕ͳ͍ ɹಈ͍͍ͯΔγεςϜͷதͷϦΫΤετ͕खݩʹඈΜͰ͘Δ   ✕ଞਓͷมߋͷӨڹΛड͚ͳ͍ ɹڞ༻ͷΫϥελͰ࣮ߦ͢ΔͱଞਓͷϦΫΤετ΋खݩʹདྷͯ͠·͏ $/$'4BOECPY1SPKFDU બ୒ͨ͠TFSWJDF΁ͷϦΫΤετΛ   ϩʔΧϧʹྲྀ͢͜ͱ͕Ͱ͖Δπʔϧ 12

Slide 13

Slide 13 text

©2022 Wantedly, Inc. ఺Λຬͨ͢։ൃख๏ *TUJPUFMFQSFTFODF *TUJPͷϦΫΤετϧʔςΟϯάΛ׆༻ ಛఆͷϦΫΤετ͚ͩΛखݩʹϧʔςΟϯά ଞͷϦΫΤετ͸ڞ༻ͷ؀ڥΛ௨Δ     LVCFGPSLͷߟ͑ํ͸͔͜͜Βग़ൃ ˓มߋΛૉૣ͘ࢼͤΔ %PDLFSCVJMEΛ଴ͨͳͯ͘Α͍ ˓ଞਓͷมߋͷӨڹΛड͚ͳ͍ खݩͰ։ൃ͍ͯ͠ΔͷͰଞਓͷӨڹ͸ड͚ͳ͍ ˓ґଘؔ܎Λҙࣝ͢Δඞཁ͕ͳ͍ ಈ͍͍ͯΔγεςϜͷதͷϦΫΤετ͕खݩʹඈΜͰ͘Δ ߋʹৄ͘͠͸ͪ͜ΒɿIUUQTTQFBLFSEFDLDPNNPSVYJTUJPJOUFHSBUFEUFMFQSFTFODF 13

Slide 14

Slide 14 text

©2022 Wantedly, Inc. *TUJPUFMFQSFTFODF͔ΒͷਐԽ HBUFXBZϨΠϠͷ࣮૷ TPNFEFWXBOUFEMZDPN GPSLFEBTPNFEFWXBOUFEMZDPN (BUFXBZ ࣗ෼ͷมߋʹϧʔςΟϯά͢ΔͨΊʹ ಛผͳIFBEFS͕ඞཁͩͬͨ   (BUFXBZϨΠϠͷಋೖʹΑΓIFBEFSͳ͠Ͱ ࣗ෼ͷมߋʹ౸ୡͰ͖ΔΑ͏ʹ 14 ࣮Ϋϥελ͔Β࡞੒͞ΕΔԾ૝ΫϥελΛࢦ͢ 'PSLFE"͕7JSUVBM$MVTUFSʹ֘౰   ϔομΛ࢖ͬͯϧʔςΟϯάΛૢ࡞͢Δମݧ͔ΒɺΫϥελΛίϐʔ͢ΔΑ͏ͳମݧʹ 7JSUVBM$MVTUFS

Slide 15

Slide 15 text

©2022 Wantedly, Inc. LVCFGPSL LVCFGPSLͷ׬੒ ϦΫΤετϧʔςΟϯάͳͲɺ   7JSUVBM$MVTUFSΛ࣮ݱ͢ΔͨΊʹ͸   ଟ͘ͷϦιʔε͕ඞཁ   ͦ͜ͰϦιʔεΛҰׅͯ͠؅ཧ͢Δ   ΧελϜίϯτϩʔϥʔΛ࣮૷   GPSLϦιʔεΛBQQMZ͢Δ͜ͱͰ   ඞཁʹͳΔϦιʔεΛશͯ࡞੒Ͱ͖Δ   Α͏ʹ ͜͜·ͰͰݱࡏͷ࢓૊Έ͕׬੒   LVCFGPSLͱݺͿΑ͏ʹ 15

Slide 16

Slide 16 text

©2022 Wantedly, Inc. 5FSNJOPMPHZ 7JSUVBM$MVTUFS Ծ૝తͳLVCFSFOUFTΫϥελ 'PSL*EFOUJ fi FS 'PSL͢Δ 7JSUVBMDMVTUFSΛ۠ผ͢Δࣝผࢠ TIBSFE͔ΒWJSUVBMDMVTUFSΛ ಛఆͷGPSLJEFOUJ fi FSΛ΋ͱʹ ΞΫηεͰ͖Δ ࡞੒͢Δ͜ͱ 4ͭͷϚΠΫϩαʔϏε͔ΒͳΔγεςϜͱɺA,B ͷ fork ͞ΕͨΫϥελ 16

Slide 17

Slide 17 text

Slide 18

Slide 18 text

Slide 19

Slide 19 text

Slide 20

Slide 20 text

Slide 21

Slide 21 text

Slide 22

Slide 22 text

Slide 23

Slide 23 text

©2022 Wantedly, Inc. ૝ఆ͍ͯͨ͠Ϣʔεέʔεɿखಈςετࢧԉ 23 *TUJPͷϦΫΤετϧʔςΟϯάΛ׆༻     ಛఆͷϦΫΤετ͚͕ͩϧʔςΟϯά͞ΕΔ   4FSJWJDF %FQMPZNFOUΛ࡞੒   ͜͜Ͱ࡞੒͢Δ%FQMPZNFOU͸ࣗ෼͕มߋͨ͠   *NBHFΛઃఆ͓ͯ͘͠ WJSUVBMDMVTUFS͕࡞੒Ͱ͖Ε͹ ϒϥ΢β͔Βมߋ͕ࢼͤΔ खಈςετɾϨϏϡʔͳͲͷ༻్Ͱར༻     ࣾ಺Ͱ͸SFNPUFGPSLͱݺ͹Ε͍ͯΔ

Slide 24

Slide 24 text

Slide 25

Slide 25 text

©2022 Wantedly, Inc. ৽͍͠Ϣʔεέʔε: Pull Request Preview 3FWJFX؀ڥͷࣗಈੜ੒ 13࡞੒࣌ʹWJSUVBMDMVTUFSΛࣗಈੜ੒ ੜ੒͞Εͨ63-ʹΞΫηε͢ΔͱࢼͤΔ .JDSPTFSWJDFͰ΋1SFWJFX ֎͔Β௚઀౸ୡͰ͖ͳ͍.JDSPTFSWJDF   ʹ΋ϧʔςΟϯάՄೳ ੜ੒͞Εͨ63-ʹΞΫηε͢Δ͜ͱͰ   Ұ෦͚ͩมߋ͞ΕͨγεςϜΛࢼͤΔ ඇΤϯδχΞʹࢼͯ͠΋Β͏ͱ͖΋ศར   ؀ڥߏங͕͍Βͳ͍ TBOECPYͷσʔλΛ͔ͭͬͯࢼͤΔ 25

Slide 26

Slide 26 text

©2022 Wantedly, Inc. ৽͍͠Ϣʔεέʔε: Pull Request Preview 3FWJFX؀ڥͷࣗಈੜ੒ 13࡞੒࣌ʹWJSUVBMDMVTUFSΛࣗಈੜ੒ ੜ੒͞Εͨ63-ʹΞΫηε͢ΔͱࢼͤΔ .JDSPTFSWJDFͰ΋1SFWJFXͰ͖Δ ֎͔Β௚઀౸ୡͰ͖ͳ͍.JDSPTFSWJDF   ʹ΋ϧʔςΟϯάՄೳ ੜ੒͞Εͨ63-ʹΞΫηε͢Δ͜ͱͰ   Ұ෦͚ͩมߋ͞ΕͨγεςϜΛࢼͤΔ ඇΤϯδχΞʹࢼͯ͠΋Β͏ͱ͖΋ศར   ؀ڥߏங͕͍Βͳ͍ TBOECPYͷσʔλΛ͔ͭͬͯࢼͤΔ 26

Slide 27

Slide 27 text

Slide 28

Slide 28 text

©2022 Wantedly, Inc. ৽͍͠Ϣʔεέʔε: Feature Flag ͷͨΊͷ؀ڥੜ੒ 'FBUVSF'MBH ΞϓϦέʔγϣϯͷڍಈΛมߋ͢ΔͨΊͷج൫ ୅දతͳྫɿ"#UFTU 8BOUFEMZͷج൫͸)FBEFSͰ੍ޚՄೳ   9GFBUVSF fl BHT\TPNF"#UFTUz"z^ 'PSLJEFOUJ fi FSͱಉ͡Α͏ʹGFBUVSF fl BH΋఻೻͢Δ͜ͱͰ ޙଆͷNJDSPTFSWJDFͷڍಈͰ΋ม͑ΒΕΔ 28 )FBEFSΛ࢖੍ͬͨޚ

Slide 29

Slide 29 text

©2022 Wantedly, Inc. ৽͍͠Ϣʔεέʔε: Feature Flag ͷͨΊͷ؀ڥੜ੒ 'FBUVSF'MBH(BUFXBZ ಛఆͷGFBUVSF fl BH͕༗ޮʹͳͬͨԾ૝Ϋϥελ͕࡞੒Մೳ TPNFEFWXBOUFEMZDPN TPNFGFBUVSFFOBCMFETPNFEFWXBOUFEMZDPN ྫ "#UFTUͷಛఆͷWBSJBOUͰදࣔ ϦϦʔεલͷػೳΛ༗ޮʹ͢Δ 3BJMTͷΞϓϦέʔγϣϯͷBTTFUT   ͚ͩखݩͷϦιʔεΛ࢖͏ 29 'FBUVSF fl BHͳΒ৽نͷQPEແ͠Ͱར༻Մೳ

Slide 30

Slide 30 text

©2022 Wantedly, Inc. ͜͜·Ͱͷ·ͱΊ ,VCFGPSL wҰͭͷΫϥελ͔ΒԾ૝ΫϥελΛ࡞੒Ͱ͖Δ͘͠Έ wϢʔεέʔε wΞϓϦέʔγϣϯ։ൃࢧԉ wଞͷ։ൃऀʹ໎࿭Λ͔͚ͣʹUFMFQSFTFODFͰ͖Δ wखಈςετࢧԉ wखݩʹΞϓϦέʔγϣϯͷಈ࡞؀ڥ͕ͳͯ͘΋มߋΛ࣮ࡍͷϦΫΤετΛ࢖ͬͯࢼͤΔ w1VMM3FRVFTU1SFWJFX wͲΜͳαʔϏεͰ΋৮Γͳ͕ΒࢼͤΔ؀ڥͷࣗಈੜ੒ w'FBUVSF'MBHͷͨΊͷ؀ڥੜ੒ wσόοάʹศརͳ؀ڥ΍ɺ"#ςετͷൺֱͷͨΊͷ؀ڥͷੜ੒ 30

Slide 31

Slide 31 text

Slide 32

Slide 32 text

Slide 33

Slide 33 text

Slide 34

Slide 34 text

©2022 Wantedly, Inc. ߏ੒ཁૉ apiVersion: networking.istio.io/v1beta1 kind: VirtualService metadata: labels: fork.k8s.wantedly.com/service: backend name: backend namespace: backend spec: hosts: - backend http: - match: - headers: x-fork-identifier: exact: many-todo-red route: - destination: host: backend-kubefork-many-todo-red - route: - destination: host: backend Service Mesh *TUJPͷϦΫΤετϧʔςΟϯάΛ׆༻ ಛఆͷϔομ͕෇͍͍ͯΔϦΫΤετΛ ࢦఆͨ͠TFSWJDFʹϧʔςΟϯά͢Δ 34 Gateway "NCBTTBEPSͷIFBEFS෇༩ػೳΛ׆༻ ϗετ໊ͱϔομͷରԠ෇͚Λߦ͏

Slide 35

Slide 35 text

©2022 Wantedly, Inc. ߏ੒ཁૉ apiVersion: networking.istio.io/v1beta1 kind: VirtualService metadata: labels: fork.k8s.wantedly.com/service: backend name: backend namespace: backend spec: hosts: - backend http: - match: - headers: x-fork-identifier: exact: many-todo-red route: - destination: host: backend-kubefork-many-todo-red - route: - destination: host: backend Service Mesh *TUJPͷϦΫΤετϧʔςΟϯάΛ׆༻ ಛఆͷϔομ͕෇͍͍ͯΔϦΫΤετΛ ࢦఆͨ͠TFSWJDFʹϧʔςΟϯά͢Δ 35 Gateway "NCBTTBEPSͷIFBEFS෇༩ػೳΛ׆༻ ϗετ໊ͱϔομͷରԠ෇͚Λߦ͏

Slide 36

Slide 36 text

Slide 37

Slide 37 text

©2022 Wantedly, Inc. ߏ੒ཁૉ apiVersion: getambassador.io/v2 kind: Mapping metadata: labels: fork.k8s.wantedly.com/manager: kubefork-manager name: backend-todo-test-many-todo-red namespace: emissary ownerReferences: spec: allow_upgrade: - websocket ambassador_id: - default add_request_headers: x-fork-identifier: many-todo-red x-forwarded-host: '%REQ(:authority)%' host: many-todo-red.backend.todo.test host_rewrite: backend.backend prefix: / rewrite: "" service: backend.backend timeout_ms: 90000 Service Mesh *TUJPͷϦΫΤετϧʔςΟϯάΛ׆༻ ಛఆͷϔομ͕෇͍͍ͯΔϦΫΤετΛ ࢦఆͨ͠TFSWJDFʹϧʔςΟϯά͢Δ 37 Gateway "NCBTTBEPSͷIFBEFS෇༩ػೳΛ׆༻ ϗετ໊ͱϔομͷରԠ෇͚Λߦ͏

Slide 38

Slide 38 text

©2022 Wantedly, Inc. ߏ੒ཁૉ apiVersion: getambassador.io/v2 kind: Mapping metadata: labels: fork.k8s.wantedly.com/manager: kubefork-manager name: backend-todo-test-many-todo-red namespace: emissary ownerReferences: spec: allow_upgrade: - websocket ambassador_id: - default add_request_headers: x-fork-identifier: many-todo-red x-forwarded-host: '%REQ(:authority)%' host: many-todo-red.backend.todo.test host_rewrite: backend.backend prefix: / rewrite: "" service: backend.backend timeout_ms: 90000 Service Mesh *TUJPͷϦΫΤετϧʔςΟϯάΛ׆༻ ಛఆͷϔομ͕෇͍͍ͯΔϦΫΤετΛ ࢦఆͨ͠TFSWJDFʹϧʔςΟϯά͢Δ 38 Gateway "NCBTTBEPSͷIFBEFS෇༩ػೳΛ׆༻ ϗετ໊ͱϔομͷରԠ෇͚Λߦ͏

Slide 39

Slide 39 text

©2022 Wantedly, Inc. 7JSUVBMDMVTUFSͷ࡞੒ 7JSUVBM$MVTUFSʹඞཁͳϦιʔε w%FQMPZNFOU w4FSWJDF w7JSUVBM4FSWJDF w.BQQJOH 39 'PSLϦιʔε ্هͷϦιʔεΛҰׅͯ͠࡞੒͢Δ 'PSLϦιʔεΛBQQMZ͢Δͱ 7JSUVBMDMVTUFS͕࡞੒͞ΕΔମݧ 'PSLϦιʔε͸LVCFGPSLDPOUSPMMFS͕ఏڙɾ؅ཧ͢Δ

Slide 40

Slide 40 text

©2022 Wantedly, Inc. 7JSUVBMDMVTUFSͷ࡞੒ apiVersion: fork.k8s.wantedly.com/v1beta1 kind: Fork metadata: generation: 1 labels: fork.k8s.wantedly.com/identifier: red name: kubefork-red namespace: option spec: deployments: replicas: 1 selector: matchLabels: app: option template: metadata: labels: app: red role: fork spec: containers: - env: - name: FORK_IDENTIFIER value: red image: onsd/todo-option:other name: todo-option resources: {} identifier: red manager: emissary/kubefork-manager services: selector: matchLabels: app: option 7JSUVBM$MVTUFSʹඞཁͳϦιʔε w%FQMPZNFOU w4FSWJDF w7JSUVBM4FSWJDF w.BQQJOH 40 'PSLϦιʔε ্هͷϦιʔεΛҰׅͯ͠࡞੒͢Δ 'PSLϦιʔεΛBQQMZ͢Δͱ 7JSUVBMDMVTUFS͕࡞੒͞ΕΔମݧ 'PSLϦιʔε͸LVCFGPSLDPOUSPMMFS͕ఏڙɾ؅ཧ͢Δ

Slide 41

Slide 41 text

©2022 Wantedly, Inc. 7JSUVBMDMVTUFSͷ࡞੒ apiVersion: fork.k8s.wantedly.com/v1beta1 kind: Fork metadata: generation: 1 labels: fork.k8s.wantedly.com/identifier: red name: kubefork-red namespace: option spec: deployments: replicas: 1 selector: matchLabels: app: option template: metadata: labels: app: red role: fork spec: containers: - env: - name: FORK_IDENTIFIER value: red image: onsd/todo-option:other name: todo-option resources: {} identifier: red manager: emissary/kubefork-manager services: selector: matchLabels: app: option 7JSUVBM$MVTUFSʹඞཁͳϦιʔε w%FQMPZNFOU w4FSWJDF w7JSUVBM4FSWJDF w.BQQJOH 41 'PSLϦιʔε ্هͷϦιʔεΛҰׅͯ͠࡞੒͢Δ 'PSLϦιʔεΛBQQMZ͢Δͱ 7JSUVBMDMVTUFS͕࡞੒͞ΕΔମݧ 'PSLϦιʔε͸LVCFGPSLDPOUSPMMFS͕ఏڙɾ؅ཧ͢Δ

Slide 42

Slide 42 text

©2022 Wantedly, Inc. 7JSUVBMDMVTUFSͷ࡞੒ apiVersion: fork.k8s.wantedly.com/v1beta1 kind: Fork metadata: generation: 1 labels: fork.k8s.wantedly.com/identifier: red name: kubefork-red namespace: option spec: deployments: replicas: 1 selector: matchLabels: app: option template: metadata: labels: app: red role: fork spec: containers: - env: - name: FORK_IDENTIFIER value: red image: onsd/todo-option:other name: todo-option resources: {} identifier: red manager: emissary/kubefork-manager services: selector: matchLabels: app: option 7JSUVBM$MVTUFSʹඞཁͳϦιʔε w%FQMPZNFOU w4FSWJDF w7JSUVBM4FSWJDF w.BQQJOH 42 'PSLϦιʔε ্هͷϦιʔεΛҰׅͯ͠࡞੒͢Δ 'PSLϦιʔεΛBQQMZ͢Δͱ 7JSUVBMDMVTUFS͕࡞੒͞ΕΔମݧ 'PSLϦιʔε͸LVCFGPSLDPOUSPMMFS͕ఏڙɾ؅ཧ͢Δ

Slide 43

Slide 43 text

©2022 Wantedly, Inc. 7JSUVBMDMVTUFSͷ࡞੒ apiVersion: fork.k8s.wantedly.com/v1beta1 kind: Fork metadata: generation: 1 labels: fork.k8s.wantedly.com/identifier: red name: kubefork-red namespace: option spec: deployments: replicas: 1 selector: matchLabels: app: option template: metadata: labels: app: red role: fork spec: containers: - env: - name: FORK_IDENTIFIER value: red image: onsd/todo-option:other name: todo-option resources: {} identifier: red manager: emissary/kubefork-manager services: selector: matchLabels: app: option 7JSUVBM$MVTUFSʹඞཁͳϦιʔε w%FQMPZNFOU w4FSWJDF w7JSUVBM4FSWJDF w.BQQJOH 43 'PSLϦιʔε ্هͷϦιʔεΛҰׅͯ͠࡞੒͢Δ 'PSLϦιʔεΛBQQMZ͢Δͱ 7JSUVBMDMVTUFS͕࡞੒͞ΕΔମݧ 'PSLϦιʔε͸LVCFGPSLDPOUSPMMFS͕ఏڙɾ؅ཧ͢Δ

Slide 44

Slide 44 text

Slide 45

Slide 45 text

Slide 46

Slide 46 text

Slide 47

Slide 47 text

Slide 48

Slide 48 text

Slide 49

Slide 49 text

Slide 50

Slide 50 text

©2022 Wantedly, Inc. LVCFGPSLDPOUSPMMFSͷվળҊ (BUFXBZϨΠϠͷࠩ͠ସ͑ʹରԠ ݱঢ়"NCBTTBEPSͱີ݁߹   )PTU໊͝ͱʹϔομΛ෇͚Δػೳ͕͋Ε͹ଞͷHBUFXBZͰ΋͍͍͸ͣ ݱঢ়ϔομ఻ൖ͸ΞϓϦέʔγϣϯͰ࣮૷͢Δඞཁ͕͋Δ   ΞϓϦέʔγϣϯͷରԠແ͠Ͱϔομ఻ൖ͕࣮ݱͰ͖ͳ͍͔ʁ )FBEFS1SPQBHBUJPOػೳͷఏڙ 50