Share
Embed
Introduction to Kubernetes Using GKE
lanocci
June 19, 2018
Transcript
68 slides
-
໌͔Β͑Δ Kubernetes ೖ ~جૅ͔ΒॳΊͯͷσϓϩΠ~ Supporterz CoLab ษڧձ Jun. 19, 2018
Ӝ ߛҰ / URANO, Koichi (@lanocci) SRE at Adtech Studio, CyberAgent, Inc. -
࣍ 1. ࣗݾհ 2. ຊͷ͓ॻ͖ 3. લఏࣝͷ͓͞Β͍ 4. Kubernetesͷதͷ֓೦ʢຊʣ 5.
ࣄྫհʢ෭ᶃʣ 6. ίϚϯυϥΠϯπʔϧͱ͔ͷհʢ෭ᶄʣ -
ࣗݾհ • ӜɹߛҰ (@lanocci) • גࣜձࣾαΠόʔΤʔδΣϯτ • ΠϯλʔωοτࠂͷΠϯϑϥͬͯ·͢ • Kubernetesྺ:
GKEͰ1 • ࡢ7݄·ͰSIerͰέʔϒϧςϨϏاۀͷγεςϜ։ൃɾӡ༻ • CKA (Certified Kubernetes Administrator) ϗϧμʔ(#366) Koichi Urano April 1, 2018 CKA-1800-0366-0100 1 / 1 -
Assumed Listeners (Readers) • ͜Ε͔ΒKubernetesΛ৮ͬͯΈΑ͏ͱࢥ͍ͬͯΔਓ • KubernetesٴͼGKEΛ৮ͬͯΈ͚ͨͲͳΜ͔Α͘Θ ͔ΒΜͱ͍͏ਓ • KubernetesٴͼGKEʹڵຯ͋Δਓ
• ͏݁ߏ͍͡ΕΔΑɺͱ͍͏ਓੋඇஆ͔͍Ͱݟ क͍͚ͬͯͨͩΔͱخ͍͠Ͱ͢ -
The Goal of This Talk • ʮKubernetesͬͯͳʹʁΑ͘Θ͔ΒΜʯͱ͍͏ਓ ͕ɺKubernetesͰΞϓϦΛಈ͔͢Πϝʔδ͕ͳΜͱ ͳ͘Ͱ͖ΔΑ͏ʹͳΔ͜ͱ •
ʮKubernetes৮ͬͯΈ͚ͨͲ࠳ંͨ͠ʯͱ͍͏ਓ ͕͏ҰϋνϚΩΛకΊ͖͔͚ͬ͢ͱͳΔ͜ͱ • ໌͔ΒGKEͰ༡ΜͰΈ͍ͯͩ͘͞Ͷʂʂ -
This Talk Includes … • શ͘ԿΒͳ͔͕ͬͨKubernetes্ʹΞϓϦ έʔγϣϯΛߏஙͰ͖ΔΑ͏ʹͳΔ·ͰʹֶΜͩ͜ͱ • Kubernetesͷجຊతͳ֓೦ͱ͔ߏͱ͔ •
KubernetesΛ͏ͨΊͷಓ۩ཱͯ • GKEͷجຊతͳ͍ํ -
This Talk Doesn’t Include … • ϕετϓϥΫςΟεతͳͰ͋Γ·ͤΜ • GCPͷجຊతͳ৮ΓํʢϩάΠϯͱ͔ϓϩδΣ Ϋτ࡞ͱ͔ʣ
• KubernetesΫϥελࣗମͷΞʔΩςΫνϟৄࡉ • Dockerͷࡉ͔͍ -
What’s Docker Engine? • ʮίϯςφʯͷ࣮ߦڥΛఏڙ • ϑϨʔϜϫʔΫͷόʔδϣϯͳͲɺ͍ΖΜͳґଘؔΛʮίϯςφʯ ͷதʹด͡ࠐΊΔ͜ͱͰɺҠ২ੑͷߴ͍ΞϓϦέʔγϣϯΛ࡞Δ͜ͱ ͕Ͱ͖Δɹɹ(Build Once,
Run Anywhere) ⁶ PaaS • ίϯςφͷ࡞ɺআߴͳͷͰෛՙঢ়گʹΑͬͯॊೈʹϦιʔε Λ͍͚ΒΕΔͱ͍͏ϝϦοτ͕͋Δ • Docker୯ମͰಉҰϗετͷίϯςφ͔͠ཧͰ͖ͳ͍ ɹɹɹ→ͪΌΜͱ͏ͳΒΦʔέετϨʔγϣϯγεςϜ͕ඞཁ -
What’s Kubernetes? • ίϯςφΛͬͨΞϓϦέʔγϣϯͷσϓϩΠɺεέʔϧɺཧΛࣗಈԽ͢ ΔΦʔϓϯιʔεγεςϜ • Kubernetes is an open-source
system for automating deployment, scaling, and management of containerized applications. (https:// kubernetes.io/) • DockerͰެࣜαϙʔτ͞ΕͨΓʢDocker for Mac ʹඪ४ࡌʣɺઌ AWSͰKubernetesͷαʔϏε͕GA͞ΕͨΓͰɺΦʔέετϨʔγϣϯ πʔϧͷ΄΅σϑΝΫτελϯμʔυͱݴ͑Δײ͡ • Docker EngineΛͬͯ࡞ͨ͠ΞϓϦέʔγϣϯΛෳͷαʔόʹσϓ ϩΠͯ͠ӡ༻͢ΔͨΊʹඞཁͳػೳΛఏڙͯ͘͠ΕΔ • ΞϓϦέʔγϣϯಉ࢜Λ࿈ܞͤͨ͞ΓɺϚγϯϦιʔεΛཧͨ͠Γɺ֎෦͔ΒͷΞΫηεํ๏Λఏڙͨ͠ΓɺΞϓϦέʔγϣϯͷΞοϓσʔτख ஈΛఏڙͨ͠Γ • Docker͚ͩ͡Όͳͯ͘rktͱ͔͑ΔΒ͍͠ -
What’s GKE? • Google Kubernetes Engineͷུ • ʢࡢࠒ·ͰGoogle Container Engineʣ
• Google Cloud Platform ͷͳ͔ͰKubernetes Λͬͨίϯςφج൫Λఏڙ͢ΔαʔϏε -
Why GKE? • PCϩʔΧϧɺGCEͳͲͷVMʹKubernetesΛߏங͢Δ͜ͱͰ͖Δ͕ɺ ͦΕΛ͢ΔʹKubernetes෦ͷΞʔΩςΫνϟʹର͢Δཧղ͕ඞཁ • ෦ωοτϫʔΫͷઃఆผ్ඞཁͩͬͨΓͯ݁͠ߏͦ͜Ͱ٧·ͬͨΓ͢ Δ • खͬऔΓૣ͘KubernetesΛཧղ͢ΔͨΊʹ·ͣɺϚωʔδυαʔϏεΛ
ͬͯΈΔͷ͕ۙಓͩͱࢥ͍·͢ • ͔͠ɺGKEແྉͰ݁ߏ৭ʑ͍͡ΕΔͷͰΦεεϝ • $300ͷແྉ͕1ؒ͑Δ • minikubeͰ͍͍͚Ͳtype: loadBalancerͱ͔Ͱ֎෦ެ։Ͱ͖Δͷศར -
جຊ֓೦ᶃ - Cluster • KubernetesͷڥΛߏங͢Δ্ͰҰ൪େ͖͍ ୯Ґ • ҰͭͷClusterͷதʹNode, Pod, Serviceͷ
ߏཁૉΛ࡞͍ͬͯ͘(ޙड़) • (MasterͱNode͔Βߏ͞ΕΔ) -
جຊ֓೦ᶄ - Master • Kuberentes ClusterͷཧશൠΛߦ͏ • ΞϓϦέʔγϣϯͷঢ়ଶཧͦΕʹԠͨ͡εέδϡʔϦϯά • kubectlίϚϯυ(ޙड़)Kubernetes
API͜ ͜Ͱड͚͚ͯॲཧ͞ΕΔ • GKEΛ͏߹ɺ͜͜ϚωʔδυαʔϏε ʹͳ͍ͬͯΔ -
جຊ֓೦ᶅ - Node • ίϯςφ͕ஔ͞ΕΔϚγϯ(ཧϚγϯ / VM) • ͜ͷNodeʹҰͭҰͭͷPod(ޙड़)ׂ͕ΓͯΒ ΕΔΠϝʔδ
• GKEͰClusterΛ࡞͢ΔͱࣗಈͰNodeʹ૬ ͢ΔGCEΠϯελϯε͕࡞͞ΕΔ -
DEMO • Ϋϥελͷ࡞ • • image-type: NodeͷOSλΠϓ • machine-type: Node
ͷαΠζ(CPU/Mem) • num-nodes: Nodeͷ • preemptible: ҆͘͢ΔͨΊͷ͓·͡ͳ͍ʢpreemptive nodeʣ $ gcloud container clusters create test-cluster \ --image-type=cos \ —-machine-type=n1-standard-1 \ -—preemptible \ -—num-nodes=2 -
جຊ֓೦ᶆ - Pod • ҰͭͷΞϓϦέʔγϣϯΛಈ͔ͨ͢ΊͷίϯςφͱϦιʔ εΛάϧʔϓԽͨ͠ͷ • Kubernetesͷߏཁૉͱͯ͠࠷খͷ୯Ґ • Pod͝ͱʹCPUɺϝϞϦɺσΟεΫɺωοτϫʔΫΞυ
ϨεͷϦιʔεΛ࣋ͭͷͰɺʮҰͷαʔόʯͱݟΔ ͜ͱͰ͖Δ • Ϋϥελଆ͔ΒݟΔͱҰͭͷʮϓϩηεʯ -
Deployment • Podͷ࡞ɺߋ৽Λߦ͏୯ҐΛఆٛ • DeploymentΛ࡞͢Δͱ͜Μͳ͜ͱ͕Ͱ͖Δ • Podࣗମͷ࡞ • Podͷઃఆɾมߋ •
Deploymentʹଐ͢ΔPodͷΞϓϦέʔγϣϯΛࢭΊͣʹΞοϓ σʔτʢϩʔϦϯάΞοϓσʔτʣ • Serviceʢޙड़ʣͷΞλον ※ ࡉ͔͍͜ͱΛݴ͏ͱDeploymentReplica SetΛཧ͍ͯ͠Δ͕ɺઆ໌ׂѪ -
Deployment Sample(nginx) apiVersion: extensions/v1beta1 kind: Deployment metadata: name: test-deployment spec:
replicas: 2 selector: matchLabels: app: nginx template: metadata: labels: app: nginx spec: containers: - name: nginx image: nginx:latest resources: limits: cpu: 400m memory: 200Mi requests: cpu: 200m memory: 200Mi ports: - containerPort: 80 σϓϩΠϝϯτ໊ ࡞͢Δ1PE ͜ͷϥϕϧ͕͍͍ͭͯΔ1PEΛσϓϩΠϝϯτ͕ཧ͢Δ 1PEʹ͚ͭΔϥϕϧ ίϯςφͷ൪ϙʔτΛ։͚Δ ʢࢦఆ͠ͳͯ͘։͘ʣ ༻͢ΔEPDLFSΠϝʔδ ׂΓͯϦιʔε 1PEͷ ఆٛ -
• Deploymentͷద༻ • yamlϑΝΠϧ͔ΒDeploymentΛద༻͢Δ • ͪΌΜͱͰ͖ͯΔ͔֬ೝ $ kubectl apply -f
path/to/the/deployment-manifest.yaml DEMO $ kubectl port-forward test-nginx 8080:80 -
Service.yml Sample(LoadBalancer) apiVersion: v1 kind: Service metadata: name: test-service spec:
ports: - port: 80 targetPort: 80 protocol: TCP loadBalancerIP: xx.xx.xx.xx type: LoadBalancer selector: app: nginx ֎෦͔ΒͷΞΫηεΛड͚͚Δ*1ΞυϨε (,&Ͱࢦఆ͠ͳ͚ΕࣗಈͰׂΓͯ ΞΫηεΛసૹ͢Δઌͷ 1PEଆͷϙʔτ൪߸ ΞΫηεΛड͚͚Δ 4FSWJDFଆͷϙʔτ൪߸ ΞΫηεΛసૹ͢Δઌͷ 1PEΛϥϕϧͰࢦఆ -
• Serviceͷద༻ • yamlϑΝΠϧ͔ΒServiceΛద༻͢Δ • ͜ΜͳΓํ͋Δ $ kubectl apply -f
path/to/the/service-manifest.yaml DEMO $ kubectl expose deployment test-deployment —-port=80 —-target-port=80 -
Service.yml Sample(NodePort) apiVersion: v1 kind: Service metadata: name: test-service spec:
ports: - port: 80 targetPort: 80 nodePort: 30080 protocol: TCP type: NodePort selector: app: nginx ΞΫηεΛసૹ͢Δઌͷ 1PEΛࢦఆ /PEFͷ͜ͷϙʔτͷΞΫηεΛ͜ͷαʔϏεʹసૹ ࢦఆ͠ͳ͚ΕࣗಈͰׂΓͯ -
ͬͯΈΔͱศརͳίϯϙʔωϯτ • Config Map • Secret • Ingress • Daemon
Set • Cronjob • ʢ͜ͷลຊ൪ڥ࡞ΔͳΒඞਢ͔͚ͩͲɺݸਓͰ༡Ϳʹͳͯ͘ͳΜͱ͔ͳΔʣ -
Config Map Sample apiVersion: v1 kind: ConfigMap metadata: name: dev-common-env
data: TEST_HOST: “www.testdomain.com" TEST_PORT: "8081" TEST_ID: “test-project" EBUBϑΟʔϧυͷԼʹ ΩʔόϦϡʔΛॻ͘ -
Deployment͔Βͷݺͼग़͠ … envFrom: - configMapRef: name: dev-common-env … … env:
- name: DB_ACCESS_POINT valueFrom: configMapKeyRef: name: dev-common—env key: TEST_ID … DPOpHNBQΛؙ͝ͱಡΈग़͠ ͯڥมʹద༻ DPOpHNBQ͔ΒΛҰͭ ಡΈग़ͯ͠ڥมʹద༻ -
Secret Sample --- apiVersion: v1 data: tls.crt: <tlsূ໌ॻ> tls.key: <tlsൿີ伴>
kind: Secret metadata: name: domain-certs type: Opaque EBUBϑΟʔϧυͷԼʹ ΩʔόϦϡʔΛॻ͘ -
Deployment͔Βͷݺͼग़͠ … env: - name: AWS_ACCESS_KEY_ID valueFrom: secretKeyRef: name: aws-credential
key: aws.access_key_id … TFDSFU͔ΒΛҰͭ ಡΈग़ͯ͠ڥมʹద༻ -
Ingress Sample --- apiVersion: extensions/v1beta1 kind: Ingress metadata: name: test-ingress
annotations: kubernetes.io/ingress.global-static-ip-name: dev-console-ingress kubernetes.io/ingress.class: "gce" spec: tls: - secretName: domain-certs backend: serviceName: test-service servicePort: 80 rules: - host: www.test.com http: paths: - path: /* backend: serviceName: test-service servicePort: 80 (,&ͩͱɺOHJOYΛ͏͔ɺ ($1ͷ)551-#Λ͏͔બΔ σϑΥϧτͷόοΫΤϯυͷαʔϏεΛࢦఆ ΞΫηεϧʔϧΛࢦఆͯ͠ όʔνϟϧϗετͷΑ͏ʹ͏͜ͱͰ͖Δ ʢ͜ͷCBDLFOEͷࢦఆ͕TQFDCBDLFOEΑΓɹ ɹ༏ઌ͞ΕΔʣ ※ Ingress͕ར༻͢ΔHealth CheckσϑΥϧτͰbackendͷ/ͷΞΫηε ※ มߋ͍ͨ͠߹PodͷఆٛͰ`readinessProbe`Λઃఆ͢Δඞཁ͕͋Δ 5-4ͷऴ*OHSFTTͰͰ͖Δ -
`gcloud container clusters` • ओʹΫϥελͷ࡞ϩάΠϯઌͷΫϥελͷ Γସ͑ʹ͏ • ଞʹɺΫϥελΛϦαΠζ͢ΔίϚϯυͱ͔͋Δ͚Ͳࠓলུ e.g. (Լઢ෦ࣗ͝ͷڥʹஔ͖͍͑ͯͬͯͩ͘͞)
# Ϋϥελͷ࡞ ## CPU 0.5core/ Memory 1.7GB ͰcoreosϕʔεͷϚγϯ3ΛnodeΫϥελͱͯ͠Ή $ gcloud container clusters create test-cluster \ —-project=your-project —-zone=asia-northeast1-a —image-type=cos \ —-machine-type=g1-small --num-nodes=3 # ΫϥελͷϩάΠϯ ## ্ͷίϚϯυͰ࡞ͨ͠ΫϥελϩάΠϯ͠ɺkubectlΛ͑ΔΑ͏ʹ͢Δ $ gcloud container clusters get-credentials test_cluster \ —-project=your-project ——zone=asia-northeast1-a # ࡞ͬͨΫϥελΛআ $ gcloud container clusters delete test-cluster —-zone=asia-northeast1-a -
kubectl • KubernetesΛ੍ޚ͢ΔͨΊͷίϚϯυϥΠϯπʔϧ • ҎԼͷૢ࡞Λ͓͚֮͑ͯͱΓ͋͑ͣ͑Δ • (DeploymentService)֤ίϯϙʔωϯτΛ࡞Δ • ֤ίϯϙʔωϯτΛมߋ͢Δ •
֤ίϯϙʔωϯτΛআ͢Δ • ֤ίϯϙʔωϯτͷใΛӾཡ͢Δ(CLI / GUI) • ࣗͷϩάΠϯใΛ֬ೝ͢Δ -
Α͘͏ίϚϯυ # ϑΝΠϧ͔ΒίϯϙʔωϯτΛ࡞͢Δ # ಉ໊ͷίϯϙʔωϯτΛߋ৽͢Δͱ͖ಉ͡ίϚϯυ $ kubectl apply -f deployment.yml
# ཁૉҰཡΛऔಘ (pods /ɹdeployments / services / ingress / configmap …) $ kubectl get pods # লུͰ͖ΔΑ pods -> po ͱ͔ services -> svcͱ͔ # ৄࡉΈ͍ͨ߹ͬͪ͜ $ kubectl describe deployment test-deployment # ίϯςφΠϝʔδΛߋ৽ $ kubectl set image deployment/test-deployment nginx=nginx:latest # ίϯςφͷதʹೖͬͯΈΔ $ kubectl exec -it test-deployment-xxxxxxx —- /bin/bash -
Others • kubectx <https://github.com/ahmetb/kubectx> ΫϥελͷΓସ͑ʢίϯςΩετͷΓସ͑ʣ • stern <https://github.com/wercker/stern> ࢦఆͨ͠จࣈྻΛؚΉPodͷϩάΛ tail
ͯ͘͠ΕΔ • ckube <https://github.com/devonmoss/ckube> kubectl ͰͷϫʔΫϑϩʔΛ؆୯ʹͯ͘͠ΕΔπʔϧ | ࢀߟ: <https://speakerdeck.com/showmurai/kubernetestecliwokuai-shi-woshi-itai> -
༻ྫ # ίϯςΩετҰཡ $ kubectx # ίϯςΩετΓସ͑ $ kubectx test-cluster
# ͋ΔσϓϩΠϝϯτͷlogΛ·ͱΊͯtail $ stern test-deployment # ΠϯλϥΫςΟϒʹ֤ίϯϙʔωϯτͷใʹΞΫηε $ ckube ls -
GKE ͬͯԿͰͰ͖ͯΔͷʁ • Master: ϚωʔδυαʔϏε • Node: GCEΠϯελϯε͕࡞͞ΕΔ • Service(type
LoadBalancer): Forwarding Rule • Ingress: GCP HTTP(S) Load Balancer -
Wrapping Up • GKEͬͯΔͱجຊతʹίϯιʔϧૢ࡞ / ίϚϯυ ͳΒҰൃͰ؆୯ʹΫϥελΊͯߏஙָνϯ • Kubernetes͏ͳΒ·ͣDeploymentͱServiceΛ ԡ͓͚͑ͯ͞ΞϓϦಈ͔ͤͯΔײ͡ΛຯΘ͑Δ͔Β
͔ͦ͜Β࢝ΊΔͱ͍͍ͱࢥ͏ • DaemonSetͱ͔ConfigMapͱ͔͏ͱΑΓ៉ྷͳ ߏΛऔΕΔΑ͏ʹͳ͍ͬͯ͘ -
Further Reading • ࠔͬͨΒͱΓ͋͑ͣެࣜʢӳޠͷΈʣ ͜Ε: <https://kubernetes.io/> • ίϯςφج൫ͷσβΠϯύλʔϯ͕Google͔Βެ։͞Ε͍ͯΔͷͰɺڵຯ͕͋ͬͨ ΒͦΕΛࢀߟʹͯ͠ຏ͖Λ͔͚͍ͯ͘ͱྑ͍͔ ͜Ε:
<https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/45406.pdf> • ͔ͬ͜Α͘σϓϩΠ͍ͨ͠ਓ͚ Helm(ύοέʔδཧ): <https://helm.sh/> : Kubernetes ϚχϑΣετΛύοέʔδͷΑ͏ʹར༻ Spinnaker(CDπʔϧ): <https://www.spinnaker.io/> : σϓϩΠύΠϓϥΠϯΛߏங Istio (Service Mesh): <https://istio.io/> : Canary Release Ͱ Canary ൛ͷτϥϑΟοΫίϯτϩʔϧͱ͔ -
We Are Hiring • ͝ڵຯͷ͋Δํ͓ؾܰʹ͓͔͚͍ͩ͘͞ • ΦϑΟεݟֶ͚ͩͰେܴ • ຊ൪ڥ Ͱ
Kubernetes ͏ϓϩμΫτ૿͖͑ͯ·ͨ͠ • ࣾʹεΩϧΞοϓθϛͱ͍͏੍͕͋ͬͯɺKubernetesͷθϛ͋Γ·͢ גࣜձࣾαΠόʔΤʔδΣϯτ ΞυςΫελδΦ / ΞυςΫຊ෦ <https://adtech.cyberagent.io>