Share
Embed
EKS Cluster-based Canary Deploy implemented with Terraform Custom Provider
Tomoaki Nakagawa
February 10, 2021
Transcript
17 slides
-
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy Terraform
Meetup Online 2021.02.10 -
2 த ஐӯ (Tomoaki Nakagawa ) Site Reliability Engineering Team
@ free e Wor k ➔ EC2 ͔Β EKS ҠߦɺࣗಈԽɺվળ Twitte r ➔ https://twitter.com/tmnkgwa4 GitHu b ➔ https://github.com/naka-gawa -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ࠓ͢͜ͱ
GSFFFͰ,VCFSOFUFT Ҏ߱&,4 γϯάϧςφϯτઓུΛ औ͓ͬͯΓɺͦͷ݁ՌɺଟͷΫϥελΛ๊͑Δ͜ͱͱͳΓ· ͨ͠ɻͦͷӡ༻ͷதͰग़͖ͯͨ՝ײΛڞ༗͠ɺߴ͍ՔಇΛཁ ٻ͢ΔϓϩμΫτʹରͯ͠ɺͲͷ༷ʹ5FSSBGPSNΛ͍ͭͭӡ༻Λ ࣗಈԽͨ͠ͷ͔Λ͝հ͠·͢ɻ -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy freeeʹ͓͚ΔΠϯϑϥCI/CDਤ
ALB&TG EKS ./xxx-pj sg.tf alb.tf route53.tf ./share-pj iam.tf terraform-repo manifest-repo ./xxx-cluster cluster.yaml ./xxx-service helmfile.yaml ci ci ci -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ՝
-1- ΫϥελͷόʔδϣϯΞοϓ ҆શʹ OPBMFSU ͰόʔδϣϯΛ্͛ऴ͑Δ·Ͱɺ13ඞཁʹͳ Δ SFQPTJUPSZΛԟ෮ͨ͠Γɺ࡞ͬͨϦιʔεΛผ13Ͱ࡞ͬͨ Γ Δ͜ͱఆܕ࡞ۀͳͷʹ͔͔ΘΒͣɺ߆ଋ͕࣌ؒ͘ͳΔ पลϦιʔεͷཧSFQPTJUPSZͱ&,4ཧSFQPTJUPSZ͕அ͞Ε͍ͯΔ -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ՝
-2- ߴ͍ՔಇΛཁٻ͞ΕΔΫϥελαΠζͷେ͖͍QSPEVDUʹର͢ΔΓ࣌ؒ͠ͷظԽ ALB&TG EK S 1.14->1.18 JOQMBDFͰWFSTJPOVQͯ͠ɺ͕͋ͬͨ ͔ΒΓ͍ͨ͠߹औΓಘΔબࢶ৽ͨ ʹΫϥελ࡞͔͠ͳ͍ɻ Ϋϥελʹ"QQΛσϓϩΠ͢Δ·Ͱૣͯ͘ ऑɺ4DBMFͷࢴ͢Δͱ࣌ؒ͑ Δ͜ͱ ࣌ظ࣍ୈͰݩʹͤͳ͍ͱ͍͏ࣄଶʹ 😇 EK S 1.14 -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ՝
-3- େنΫϥελʹͳΕͳΔ΄ͲɺXPSLFSOPEFͷೖΕସ͑ͰҰۤ࿑ ࡉʑͱͨ͠ӡ༻ʹ͔͔Δ࣌ؒͷظԽ ۩ମྫΛ͋͛Δͱ 8PSLFSʹ͚ͭΔ*".1PMJDZ4FDVSJUZ(SPVQସ͕࡞ۀ /PEF%SBJO͢ΔʹҰඞཁ -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy Canary
deploy per cluster ``্هͷΑ͏ͳมߋ௨ৗJOQMBDFͰߦ͏ͱࢥ͍·͕͢ɺલऀʹ͍ͭͯ$POUSPM 1MBOFͷ,TϚΠφʔόʔδϣϯΛҰ্͛ͯ͠·͏ͱԼ͛Δ͜ͱͰ͖ͳ͍ɺޙऀʹ ͍ͭͯͷ͋ͬͨมߋΛ͚ͩ͢Ͱेඵఔ͕͔͔࣌ؒͬͯ͠·͏Մೳੑ͕͋ Γ·͢ɻ 4-"తʹͦΕ͕ڐ͞Εͳ͍߹ʹɺԿ͔Ͱ͖Δ͜ͱͳ͍ͷͰ͠ΐ͏͔ʁ Ұͭͷํ๏ɺ"-#/-#ͳͲͷޙΖʹෳͷ&,4ΫϥελΛஔ͠ɺҰํͷΫϥε λͷτϥϑΟοΫͷॏΈΛͳͲͷेʹখ͍͞ʹͯ͠ɺͦͷॏΈͷখ͍͞Ϋϥ ελΛઌʹߋ৽͢Δ͜ͱͰ͢ɻͦͷޙɺಛʹΞϥʔτ্͕͕Βͳ͍ͷͰ͋Εɺͦͷม ߋ҆શͱΈͳͯ͠͏ҰํͷΫϥελʹશ͘ಉ͡มߋΛߦ͍·͢`` Ҿ༻ݩɿhttps://github.com/mumoshu/decouple-apps-and-eks-clusters-with-tf-and-gitops -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ࠾༻ͨ͠ιϦϡʔγϣϯ
ALB&TG EK S old ./xxx-pj sg.tf alb.tf route53.tf ./share-pj iam.tf terraform-repo manifest-repo ./xxx-cluster cluster.yaml ./xxx-service helmfile.yaml ci ci ci custo m provider EK S new weight rule -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ࠾༻ͨ͠ιϦϡʔγϣϯ
5FSSBGPSN$VTUPN1SPWJEFS ఏڙ͞Ε͍ͯΔGSBNFXPSLΛར༻ͨ͠ಠࣗͷQSPWJEFS UFSSBGPSNQSPWJEFSFLTDUM UFSSBGPSNQSPWJEFSIFMNGJMF UFSSBGPSNQSPWJEFSLVCFDUM -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ࠾༻ͨ͠ιϦϡʔγϣϯ
UFSSBGPSNQSPWJEFSFLTDUM UFSSBGPSN͔ΒFLTDUMίϚϯ υΛ࣮ߦ͢Δத֩ͱͳΔ QSPWJEFS BMCSPVUFͷXFJHIUΛࣗಈ ͰΓସ͑ͯ͘ΕΔͷ provider "eksctl" { } resource "eksctl_cluster" "sample" { name = "sample " region = "ap-northeast-1 " spec = <<EO S nodeGroups : - name: ng 1 instanceType: m5.larg e desiredCapacity: 1 EO S } -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ࠾༻ͨ͠ιϦϡʔγϣϯ
UFSSBGPSNQSPWJEFSIFMNGJMF UFSSBGPSN͔ΒIFMNGJMFίϚ ϯυΛ࣮ߦ͢ΔQSPWJEFS ಉ࣮࣌ߦͯ͠΄͘͠ͳ͍ $SPO+PCͳͲ͜͜Ͱ੍ޚ͢ Δ provider "helmfile" { } resource "helmfile_release_set" "sample" { working_directory = "mamifest-repo " content = file("./ helmfile.yaml" ) binary = "helmfile " helm_binary = "helm " environment = "default " kubeconfig = eksctl_cluster.sample.kubeconfig_pat h } -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ࠾༻ͨ͠ιϦϡʔγϣϯ
UFSSBGPSNQSPWJEFSLVCFDUM σϑΥϧτϦιʔεΛIFMN ཧ͢ΔͨΊɺ BOOPUBUJPOMBCFMΛ༩͢Δ ͨΊͷQSPWJEFS DPSFEOTͷύϥϝʔλΛҰ෦ ม͍͑ͨ߹ʹ͍ͬͯΔ provider "kubectl" { } resource "kubectl_ensure" "sample" { kubeconfig = eksctl_cluster.sample.kubeconfig_pat h namespace = "kube-system " resource = "configmap " name = "coredns " labels = { "app.kubernetes.io/managed-by" = "Helm " } annotations = { "meta.helm.sh/release-name" = "coredns " "meta.helm.sh/release-namespace" = "kube- system " } } https://www.slideshare.net/ssuser4fddce/ekscoredns -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy Pros
& Cons 1SPT ΫϥελόʔδϣϯΞοϓ࡞ۀʹ͓͍ͯΫϥελ࡞͔Β"QQ %FQMPZɺτϥϑΟοΫΓସ͑·Ͱͷखॱ͕վળͨ͠ ࠓ·ͰݫີʹίʔυཧͰ͖͍ͯͳ͔ͬͨࡉ͔͍&,4Ϧιʔε͕ ίʔυཧͰ͖ΔΑ͏ʹͳͬͨ FHBXTBVUI *34"ͳͲͰ͏*".SPMFͳͲͷϦιʔεͷࢀর͕Մೳʹ ࠓ·Ͱసه͍ͯͨ͠ -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy Pros
& Cons $POT NBOJGFTUEFQMPZ DE ͦͷ··։ൃऀ͕͏ͨΊɺೋॏཧ ʹͳͬͯ͠·͏ 8PSLFS/PEF͚ͩมߋ͍ͨ͠ͷʹ"QQ%FQMPZ͕ͬͯ͠·͏ $*ͷ߹্ɺ%FQMPZ IFMNGJMFTZOD ͕͍ ΨνΨνʹݻΊΒΕͨ5FSSBGPSNNPEVMF͕བྷΉͱͭΒ͍ TUBHJOHQSPEVDUJPOͱஈ֊తʹ্͍͕͛ͨNPEVMFΛղ͘ ඞཁ͕͋Δ -
Terraform Custom Provider Ͱ࣮ͨ͠ EKS Cluster ϕʔεͷ Canary Deploy ࠓޙͷల
քͷௐ Ϋϥελ࡞͔Βɺ"QQ%FQMPZͰ͖Δঢ়ଶʹ͢Δ·ͰΛ 5FSSBGPSNͰߦ͍ɺ"QQ%FQMPZΛ"SHP$%ͳͲͷ%FQMPZʹಛԽ ͨ͠UPPMʹҠৡ ΑΓ1SPHSFTTJWF%FMJWFSZʹ͚ۙͮΔ "QQ%FQMPZޙͷΫϥελਖ਼ৗςετΛॆ࣮ͤ͞ɺࣗಈͰΓ ͬͨΓɺΫϥελআ·ͰͬͨΓͰ͖ΔΑ͏ʹ͢Δ 13Ͱ҆શ҆৺ʹΫϥελΛೖΕସ͑ΒΕΔੈք