managed_Kubernetes_on-premises.pdf

Transcript

1. ΦϯϓϨͩͬͯ͜͜·ͰͰ͖Δ
   KubernetesͰ࡞ΔࣗલPaaS
   Takaaki Yuhara
   Infrastructure Service Group
   Gurunavi, Inc.
   2018.12.04
   Japan Container Days v18.12
   

   View Slide

2. Takaaki Yuhara
   Infrastructure Engineer
   2014~ ͙Δͳͼ
   ɹ͙ΔͳͼશͯͷαΠτΠϯϑϥͷߏஙͱӡ༻
   ɹVirtualization/OS/Middleware/Container/k8s…ϨΠϠʔΛ୲౰
   ɹΠϯϑϥͷίʔυԽɾࣗಈԽɺ؂ࢹ΍ςετͷ࠷దԽ etc…
   

   View Slide

3. ΦϯϓϨKubernetes
   kubeadm, Rancher, RKEͳͲɺखܰʹΦϯϓ
   ϨϛεͰ΋ߏஙͰ͖ΔΑ͏ʹͳΓ·ͨ͠ɻ
   ςʔϚɿΦϯϓϨKubernetesΛͲͷΑ͏ʹ׆༻͢Δ͔
   

   View Slide

4. Kubernetesに詳しくなくても誰でも簡単に使えるプラットフォーム
   

   View Slide

5. γεςϜ֓ཁ
   Generator API
   Management
   Console
   Load Barancer
   Ingress
   Service
   Deployment
   Namespace
   

   View Slide

6. γεςϜ֓ཁ
   Generator API
   Management
   Console
   Load Barancer
   ར༻ऀ͸Management Console͔
   Βඞཁࣄ߲Λೖྗ͠ར༻։࢝Ϙλϯ
   ΛΫϦοΫ
   

   View Slide

7. γεςϜ֓ཁ
   Generator API
   Management
   Console
   Load Barancer
   Generator APIͷ֤छδϣϒʹϦΫ
   Τετ͕౉Δ
   

   View Slide

8. γεςϜ֓ཁ
   Generator API
   Management
   Console
   Load Barancer
   Ingress
   Service
   Deployment
   Namespace
   Kubernetes APIΛ௨ͯ͡
   Namespace΍ඞཁͱͳΔϦιʔ
   ε܈Λ࡞੒
   

   View Slide

9. γεςϜ֓ཁ
   Generator API
   Management
   Console
   Load Barancer
   Ingress
   Service
   Deployment
   Namespace
   GitLab APIΛ௨ͯ͡ϓϩδΣΫτ
   ͷ࡞੒ʢςϯϓϨʔτ͔ΒͷΠϯ
   ϙʔτʣͱCI/CD༻ͷVariablesͷ
   ઃఆ
   Container Registry΋ར༻Մ
   

   View Slide

10. γεςϜ֓ཁ
    Generator API
    Management
    Console
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    LoadBalancerʢk8sͷ֎ʣͷઃఆ
    Λมߋ͠ΫϥΠΞϯτ͔ΒͷΤϯυ
    ϙΠϯτΛఏڙ
    

    View Slide

11. •  Kubernetes ্ͷNamespace΍֤छϦιʔε܈
    •  ΞϓϦέʔγϣϯʹର͢ΔΤϯυϙΠϯτ
    •  GitLab ͷ Projectʢ֤छઃఆ͕ࢪ͞Εͨঢ়ଶʣ
    Management Console ͔Β࡞੒
    ޙ͸ΞϓϦΛ࡞੒ͯ͠Commit & Push͢Δ͚ͩ
    

    View Slide

12. Kubernetes Resouce Generator
    •  KubernetesͷϦιʔε܈Λ࡞ΔͨΊʹಠࣗʹ࡞੒ͨ͠API
    •  YAMLϚχϡϑΣετΛapply͍ͯ͠ΔΑ͏ͳΠϝʔδ
    •  Kubernetes client pythonΛ࢖༻
    •  Officialʹఏڙ͞Ε͍ͯΔgo΍pythonͷClient Library
    ɹɹhttps://github.com/kubernetes-client/python
    ɹɹhttps://github.com/kubernetes/client-go
    •  Python FlaskͰREST APIԽ
    

    View Slide

13. Kubernetes Client Python
    ྫʣNamespaceͷ࡞੒
    

    View Slide

14. DeployͷྲྀΕ
    

    View Slide

15. γεςϜ֓ཁ
    Developer
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    Container
    Registry
    ίʔυΛGitLabͷϓϩδΣΫ
    τʹରͯ͠Commit / Push
    

    View Slide

16. γεςϜ֓ཁ
    Developer
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    Container
    Registry
    GitLab CI͕։࢝͞Εk8s্ͷrunner
    ʹରͯ͠Pipelineͷ࣮ߦΛ໋ྩ
    

    View Slide

17. γεςϜ֓ཁ
    Developer
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    workspace
    Container
    Registry
    #01 Build Stage
    Kubernetes্ͰίϯςφϏϧυ
    ༻ͷίϯςφΛ࣮ߦ
    

    View Slide

18. γεςϜ֓ཁ
    Developer
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    workspace
    Container
    Registry
    #01 Build Stage
    GitLabͷProjectΛclone͠
    DockerfileΛݩʹΠϝʔδϏϧυ
    

    View Slide

19. γεςϜ֓ཁ
    Developer
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    workspace
    Container
    Registry
    #01 Build Stage
    ϏϧυΠϝʔδΛGitLab
    Container RegistryʹPush
    

    View Slide

20. γεςϜ֓ཁ
    Developer
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    workspace
    Container
    Registry
    #02 Deploy Stage
    Runner͔ΒDeploy༻ͷίϯςφ
    Λىಈɻ
    Kubernetes APIΛ௨ͯ͡
    Deploymentʹରͯ͠Rolling
    updateΛ໋ྩ
    

    View Slide

21. γεςϜ֓ཁ
    Developer
    Load Barancer
    Ingress
    Service
    Deployment
    Namespace
    Container
    Registry
    ϏϧυΠϝʔδ͔ΒRolling updateΛ࣮ߦ
    

    View Slide

22. GitLab & GitLab CI
    •  GitLabɺGitLab Container RegistryΛར༻
    •  CI/CDδϣϒ͸Kubernetes executorͰ࣮ߦ
    •  .gitlab-ci.ymlͰύΠϓϥΠϯΛఆٛ͠ɺ࣮ߦ͍ͨ͠ॲཧͱɺͦͷॲཧΛ
    ࣮ߦ͢ΔϕʔεΠϝʔδΛબ୒ʢServerlessͳײ֮ʣ
    •  εςʔδຖʹtagΛࢦఆ͢Δ͜ͱͰɺDevelop/Staging/Productionͱ
    ͍ͬͨܗͰ࣮ߦ؀ڥΛ෼͚ΒΕΔ
    Build to develop
    stage: build
    only:
    - /^develop.*/
    image: gcr.io/kaniko-project/executor:debug
    script:
    - /kaniko/executor --context $CI_PROJECT_DIR --dockerfile $CI_PROJECT_DIR/Dockerfile --destination …(লུ)
    tags:
    - develop
    .gitlab-ci.ymlͷҰ෦Λൈਮ
    

    View Slide

23. Kubernetes ExecutorΛ࢖ͬͨPipeline
    •  #01 Build Stage
    •  Builderͱͯ͠͸dind(docker in docker) ͔ kanikoͷબ୒͕Մ
    •  kaniko͸Google͕։ൃ͢ΔϏϧμʔɻKubernetes্ͰΠϝʔδ
    Ϗϧυ͢Δ͜ͱΛ૝ఆ͠privilegedແ͠ͰϏϧυՄ
    ɹɹhttps://github.com/GoogleContainerTools/kaniko
    •  #02 Deploy Stage
    •  Kubernetes client pythonͰ࡞੒ͨ͠ಠࣗπʔϧΛ࢖༻
    •  Rolling update ΍ ຊ൪ͰͷB/G DeploymentɺRollback౳ʹର
    Ԡ
    

    View Slide

24. FeatureϒϥϯνରԠ
    •  FeatureϒϥϯνΛ࡞੒͢Δ
    ͱͦΕʹରԠͨ͠Endpointͱ
    Service/DeploymentΛࣗಈ
    తʹߏ੒
    •  GitLab CIͱ࿈ಈ͠ϒϥϯν໊
    ʹԠͨ͡Development͕ߋ
    ৽͞ΕΔ
    Ingress
    Service
    Deployment
    Service
    Deployment
    Service
    Deployment
    a.com b.com c.com
    develop
    branch
    feature/a
    branch
    feature/b
    branch
    

    View Slide

25. ։ൃϑϩʔ
    develop staging release master
    feature/a
    ֤ϒϥϯνͰͷCommit΍Merge୯ҐͰCI/CDΛ࣮ߦ
    ӡ༻͸Gitૢ࡞Ͱ׬݁
    ϓϧϦΫΤετɺϨϏϡʔɺϚʔδ
    ͷϓϩηεΛճ͢ࣄʹूத
    tag v1.1.0
    

    View Slide

26. •  Push Code, Not Container
    •  ӡ༻͸ϓϧϦΫΤετͰ࣮ߦ͞ΕΔ
    Weaveworks : Alexis Richardsonࢯ
    •  kubectl౳ͷίϚϯυϥΠϯπʔϧ͸࢖Θͳ͍ʢGitૢ࡞ͷΈʣ
    •  GitͱγεςϜͷঢ়ଶ͕ඞͣ౳͍͠ɺGitΛਅͱ͢Δߟ͑
    •  γεςϜΛGit؅ཧ͢Δ
    GitOps
    

    View Slide

27. ·ͱΊ
    •  Kubernetes্ͷϦιʔε܈΍Load Balancer / GitLab Project
    ͷ࡞੒ΛAPIΛ௨ͯࣗ͡ಈԽ
    •  Management ConsoleΛఏڙ͠KubernetesΛந৅Խ
    •  GitLab CIͱ࿈ܞ͠CI/CDΛ࣮ݱ
    •  ӡ༻͸Gitૢ࡞Ͱ׬݁ͤ͞ಛผͳૢ࡞͸ෆཁ
    ୭Ͱ΋؆୯ʹ࢖͑ΔϓϥοτϑΥʔϜͱͯ͠KubernetesΛ׆༻
    

    View Slide

28. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ
    

    View Slide