k8s - Kubernetes 8 Factors

https://www.youtube.com/watch?v=OB2IbY9QJzA
アプリケーション開発においては Twelve-Factor App のようなスケーラブルな開発を助ける方法論が多数存在しています。しかしながら、Kubernetes などのインフラレイヤーにはよく知られた方法論や原則がないという印象を持っています。この知識の欠落のため、Wantedly では3年間の Kubernetes クラスタの運用の中で、次々に運用上の問題に直面してきました。そのなかで逐次的な問題解決に限界を感じ、そもそも問題の起きにくいクラスタの性質を検討しました。この結果としてクラスタが持つべき性質はポータビリティであり、これを保つためにクラスタアドミンが守るべき8つの原則があるという結論に至りました。

Transcript

1. ©2019 Wantedly, Inc. k8s - Kubernetes 8 factors Kubernetes ΫϥελͷϙʔλϏϦςΟΛอͭͨΊͷ8ݪଇ CloudNative Days Tokyo 2019 Jul 22, 2019 - Shimpei Otsubo @potsbo
2. ©2019 Wantedly, Inc. Shimpei Otsubo @potsbo Visit Recommendation Squad, Wantedly, Inc. 2018 New Grads Kubernetes Dev Tools CI / CD AuthN / Z Productivity Dvorak
3. ©2019 Wantedly, Inc. ݕ౼த/ࡁΈ Kubernetes ͷಋೖঢ়گ͸ʁ ݕূத/ࡁΈ ຊ൪ಋೖ࡞ۀத/ࡁΈ ຊ֨ಋೖ࡞ۀத/ࡁΈ Ξϯέʔτͦͷ̍ ݕ౼͍ͯ͠ͳ͍
4. ©2019 Wantedly, Inc. WHAT Ϋϥελͷ࠶࡞੒ͷඞཁੑʹ଱͑ΒΕΔ k8sΫϥελͷϙʔλϏϦςΟΛอͭํ๏ ϕϯμʔϩοΫΠϯΛ͋Δఔ౓ආ͚ΒΕΔ WHY Ϋϥελ؅ཧऀʹऔͬͯͷ
5. ©2019 Wantedly, Inc. લఏͱͳΔ Wantedly ͷ؀ڥ Mainly AWS 40 Engineers 6 Infrastructure Engineers 5 Kubernetes Clusters 300 namespaces in total Partially GCP No On-Premises
6. ©2019 Wantedly, Inc. ϙʔλϏϦςΟͱ͸ લఏͱͳΔ Wantedly ͷ؀ڥ αʔόʔαΠυΤϯδχΞͱૄ݁߹ 8ݪଇ ࣮ࡍͷҠߦ ݪଇΛ࡞Δʹࢸͬͨഎܠ Ϋϥελ࠶࡞੒ͷඞཁʹഭΒΕΔ ΫϥελΞυϛϯ͕ΫϥελΛஔ͘ΠϯϑϥΛ؆୯ʹม͑ΒΕΔঢ়ଶ
7. ©2019 Wantedly, Inc. … … … ʮϙʔλϏϦςΟΛ΋ͭʯͱ͸ ΫϥελΞυϛϯ͕ΫϥελΛஔ͘ΠϯϑϥΛ؆୯ʹม͑ΒΕΔঢ়ଶ Kubernetes ͷͲ͜ͷ؅ཧͷ࿩ʁ ఆٛ͢ΔϦιʔε΋ʁ Ϋϥελͷఆ͚ٛͩʁ
8. ©2019 Wantedly, Inc. … … … Ϋϥελͷ࢓༷ cluster-specs αʔϏε༻Ϧιʔε service-resources ʮϙʔλϏϦςΟΛ΋ͭʯͱ͸ ΫϥελΞυϛϯ͕ΫϥελΛஔ͘ΠϯϑϥΛ؆୯ʹม͑ΒΕΔঢ়ଶ
9. ©2019 Wantedly, Inc. … … … Ϋϥελͷ࢓༷ cluster-specs αʔϏε༻Ϧιʔε service-resources ίίʹڱ͕ؒ͋Δ ʮϙʔλϏϦςΟΛ΋ͭʯͱ͸ ΫϥελΞυϛϯ͕ΫϥελΛஔ͘ΠϯϑϥΛ؆୯ʹม͑ΒΕΔঢ়ଶ
10. ©2019 Wantedly, Inc. … … … Ϋϥελͷ࢓༷ Ξυϛϯ༻Ϧιʔε αʔϏε༻Ϧιʔε cluster-addons cluster-specs service-resources ʮϙʔλϏϦςΟΛ΋ͭʯͱ͸ ΫϥελΞυϛϯ͕ΫϥελΛஔ͘ΠϯϑϥΛ؆୯ʹม͑ΒΕΔঢ়ଶ
11. ©2019 Wantedly, Inc. … … … Ϋϥελͷ࢓༷ Ξυϛϯ༻Ϧιʔε αʔϏε༻Ϧιʔε cluster-addons cluster-specs service-resources ʮϙʔλϏϦςΟΛ΋ͭʯͱ͸ ΫϥελΞυϛϯ͕ΫϥελΛஔ͘ΠϯϑϥΛ؆୯ʹม͑ΒΕΔঢ়ଶ
12. ©2019 Wantedly, Inc. … … … Ϋϥελͷ࢓༷ Ξυϛϯ༻Ϧιʔε αʔϏε༻Ϧιʔε cluster-addons cluster-specs service-resources ʮϙʔλϏϦςΟΛ΋ͭʯͱ͸ ΫϥελΞυϛϯ͕ΫϥελΛஔ͘ΠϯϑϥΛ؆୯ʹม͑ΒΕΔঢ়ଶ ͜ͷ෦෼ʹϑΥʔΧε
13. ©2019 Wantedly, Inc. എܠ Wantedly ʹ͓͚Δ Kubernetes App Engineer ͱͷૄ݁߹Λ໨ࢦ͍ͯ͠Δ ΋ͪΖΜݱ࣌఺Ͱ͸ίϛϡχέʔγϣϯ͸ॏཁ Ͱ΋ࣾ಺ Heroku ʹͳΓ͍ͨͷͰ஌Βͳͯ͘΋ྑ͍ͱ͜Ζ͸໨ࢦ͍ͨ͠ ͲΜͳίϯςφΛಈ͔͍ͯ͠Δͷ͔ΠϯϑϥνʔϜ͕஌Βͳͯ͘ྑ͍ঢ়ଶ αʔϏε༻Ϧιʔε͸είʔϓ֎ ΋ͪΖΜΠϯϑϥνʔϜͰਪ঑/ېࢭͳͲͷضৼΓ͸͢Δ Ͱ΋Ϋϥελ؅ཧʹ͓͍ͯ͸ࣗ༝ͱͯ͠࢒͢෦෼ αʔϏε༻ʹϦιʔε؅ཧ͸ΞϓϦέʔγϣϯΤϯδχΞʹ೚ͤΔ
14. ©2019 Wantedly, Inc. implement configure ask / help This is NOT how we do App Engineers Products infrastructure Infra Engineers
15. ©2019 Wantedly, Inc. App Engineers Infra Engineers implement Access through tools and APIs Products infrastructure This is how we do Provide tools automate
16. ©2019 Wantedly, Inc. എܠ 2018೥ʹͳΓ etcd ͷ version Λ্͛Δඞཁੑ͕ग़͖ͯͨ 2015೥͔Β ͏ͪΠϯϑϥ͸6ਓ Wantedly Ͱىͬͨ͜͜ͱ k8s Λॳظ͔Βݕূ/ӡ༻͖ͯͨ͠ v1.1ͩͬͨ ݱࡏ͸ 40ਓͷΤϯδχΞͰ߹ܭ 300 ͷ namespace Λ؅ཧ͍ͯ͠Δ ͜ͷͨΊॳظͷ component ͕࢒ͬͯ͠·͍ͬͯΔ in-place ͷ upgrade ͸ϦεΫ͕େ͖͍ ࠶࡞੒ͩʂ ʮ৽͍͠ͷ࡞͔ͬͨΒͦΕͧΕҠߦ͠ͱ͍ͯʯ͸ඇݱ࣮త
17. ©2019 Wantedly, Inc. ͳͥ࠶࡞੒͕ඞཁʹͳͬͨͷ͔ʁ ͜ΕΛظʹʮk8sΫϥελ͕࣋ͭ΂͖ੑ࣭ʯΛߟ͑Δ͜ͱʹͨ͠ ॳظ͔Βར༻͍ͯͨͨ͠Ί etcd ͷ version ͕2ͩͬͨ ϙʔλϏϦςΟΛे෼ʹߟ͍͑ͯͳ͔ͬͨͨΊۤ࿑͕େ͖͔ͬͨ ΠϯϑϥνʔϜͰશͯࡌ͔ͤ͑Δඞཁੑ͕ग़ͨ
18. ©2019 Wantedly, Inc. THE TWELVE FACTORS CloudNative ࣌୅ͷվྑ൛ Application αΠυͰ͸ʮϙʔλϏϦςΟΛอͭݪଇ͕஌ΒΕ͍ͯΔʯ https://12factor.net/ja/ https://content.pivotal.io/ebooks/beyond-the-12-factor-app
19. ©2019 Wantedly, Inc. https://12factor.net/ja/ https://content.pivotal.io/ebooks/beyond-the-12-factor-app THE TWELVE FACTORS CloudNative ࣌୅ͷվྑ൛ Application αΠυͰ͸ʮϙʔλϏϦςΟΛอͭݪଇ͕஌ΒΕ͍ͯΔʯ ͔͠͠Πϯϑϥ͕࣋ͭ΂͖ੑ࣭͸Α͘·ͱΊΒΕͯ͸͍ͳ͍ ࡞ͬͯ͠·͓͏ʂ
20. ©2019 Wantedly, Inc. ໨ࢦ͢ੈք ϕϯμʔϩοΫΠϯ΋ܰݮͰ͖Δ ͍ͭͰ΋ຊ൪ k8s ΫϥελΛࣺͯΒΕΔΑ͏ʹ͢Δ ແཧΛ͠ͳ͍Ϋϥελͷߋ৽͕ՄೳʹͳΔ
21. ©2019 Wantedly, Inc. લఏ ٞ࿦͸ੜ͡Δͱࢥ͏ͷͰσΟεΧογϣϯͰ͖Δͱخ͍͠ ʮશͯͷ k8s Ϋϥελ͕࣋ͭ΂͖ݪଇʯͰ͸ͳ͍ ͋͘·ͰʮWantedly ʹ͓͍ͯʯͷ࿩
22. ©2019 Wantedly, Inc. ίʔυϕʔε ґଘએݴ ίʔυϕʔε಺֎ʹอ؅ͯ͠஫ೖ͢Δ ୯Ұํ޲Ϗϧυ ؀ڥҰக ඇ໊લ؅ཧ όοΫΞοϓ ઃఆ͸͢΂ͯίʔυԽ͢Δ ґଘ͢ΔίϯϙʔωϯτͷWFSTJPOએݴ͢Δ ઃఆ෼཭ ίʔυϕʔε͔ΒΫϥελ΁ͷҰํ޲ͷΈͷ൓ө ࠩҟ͸ઃఆʹཹΊΔ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ ϦιʔεఆٛΛ෮ݩՄೳͳঢ়ଶͰอ؅͢Δ 12-factor app ͱڞ௨ New!! ॏෳܽଛ؅ཧ ॏෳͱܽଛͷ͍ͣΕ͔ͷΈΛकΔ
23. ©2019 Wantedly, Inc. ίʔυϕʔε ࠓͷΫϥελͷઃఆ͸
    repository
    ΛݟΕ͹ྑ͍ঢ়ଶʹ͢Δ ઃఆ͸͢΂ͯίʔυԽ͢Δ ܗࣜ͸ԿͰ΋ྑ͍ terraform / kops 5IF
    5XFMWF'BDUPS
    "QQ
    Ͱ͸
    ʮ*
    ίʔυϕʔεʯʹ૬౰ ࠓΫϥελΛࣦͬͯ΋ಉ͡ΫϥελΛ͙͢ʹͭ͘ΕΔ͔ʁ कΓ͍ͨ͜ͱ ؅ཧ͢Δ΋ͷ ؅ཧ͠ͳ͍΋ͷ αʔϏε༻ͷ …
24. ©2019 Wantedly, Inc. શ͘ಉ͡ΫϥελΛ࡞ΔͨΊʹ͸ґଘΛ໌֬ʹએݴ͢Δ͜ͱ͕ॏཁ ར༻͢ΔΦʔέετϨʔγϣϯπʔϧͰՄೳͳݶΓ
    WFSTJPO
    Λݻఆ͢Δ - etcdMembers: - instanceGroup: master-ap-northeast-1c name: c - instanceGroup: master-ap-northeast-1b name: b - instanceGroup: master-ap-northeast-1c-2 name: c2 name: main version: 3.0.17 ґଘએݴ ґଘ͢ΔίϯϙʔωϯτͷWFSTJPOએݴ͢Δ 5IF
    5XFMWF'BDUPS
    "QQ
    Ͱ͸
    ʮ**
    ґଘؔ܎ʯʹ૬౰ ؅ཧ͢Δ΋ͷ ؅ཧ͠ͳ͍΋ͷ αʔϏε༻ͷ … ࠓΫϥελΛࣦͬͯ΋ಉ͡ΫϥελΛ͙͢ʹͭ͘ΕΔ͔ʁ कΓ͍ͨ͜ͱ
25. ©2019 Wantedly, Inc. Code Config Deploy + = THE TWELVE FACTOR APP Code Config Cluster + = Kubernetes 8 factors ઃఆ෼཭ ίʔυϕʔε಺֎ʹอ؅ͯ͠஫ೖ͢Δ 5IF
    5XFMWF'BDUPS
    "QQ
    Ͱ͸
    ʮ***
    ઃఆʯʹ૬౰ ؀ڥࠩҟΛ໌ࣔతʹએݴ͢Δ ྫ͑͹ઃఆϑΝΠϧͷ
    HFOFSBUPS
    Λ࡞Δ wantedly Ͱ͸࣮͸ఘΊ͍ͯΔ $POGJH
    ͕ߴʑ਺ඦߦ 3FWJFX
    ͰಉҰมߋͰ͋Δ͜ͱΛอূ ಉҰεϖοΫͷݕূ؀ڥΛ؆୯ʹݐͯΒΕΔ͔ʁ कΓ͍ͨ͜ͱ কདྷతʹਐΈ͍ͨಓ
26. ©2019 Wantedly, Inc. શͯͷมߋʹ
    SFWJFX
    Λཁٻ͢Δ Ϋϥελͱઃఆʹࠩ෼͕ͳ͍͔ʁ Ϋϥελͷঢ়ଶ͔ΒίʔυϕʔεʹࣗಈͰ13Λ࡞੒͢ΔΞϓϩʔν΋͋Δ ٞ࿦͕෼͔ΕΔͱ͜Ζ कΓ͍ͨ͜ͱ ࣗಈ
    EFQMPZ
    ͩͱߋʹྑ͍ Code Cluster ୯Ұํ޲Ϗϧυ 5IF
    5XFMWF'BDUPS
    "QQ
    Ͱ͸
    ʮ7
    ϏϧυɺϦϦʔεɺ࣮ߦʯʹ૬౰ ίʔυϕʔε͔ΒΫϥελ΁ͷҰํ޲ͷΈͷ൓ө $MVTUFS
    Λ
    JNNVUBCMF
    ʹ͢Δ ίʔυϕʔεͷมߋͳ͠ʹΫϥελΛม͑ͳ͍ XBOUFEMZ
    Ͱ͸·ͩख࡞ۀ github.com/fluxcd/flux
27. ©2019 Wantedly, Inc. 1SPEVDUJPO
    
    4UBHF
    
    %FW ຊ൪͚ͩ
    NVMUJ
    ";
    ͩͬͨͷͰࢮΜͩ
    ͳͲ ༧ظͤ͵ͱ͜Ζʹ᠘͕͋Δ ݕূΫϥελͱͷࠩ෼Λগͳ͘͢Δ ݕূΫϥελͰͷ݁ՌΛ৴͡ΒΕΔ͔ʁ कΓ͍ͨ͜ͱ ؀ڥҰக ࠩҟ͸ઃఆʹཹΊΔ 5IF
    5XFMWF'BDUPS
    "QQ
    Ͱ͸
    ʮ9
    ։ൃຊ൪Ұகʯʹ૬౰
28. ©2019 Wantedly, Inc. ͜͜·Ͱ͸ The Twelve-Factor App ͔Β͖࣋ͬͯͨ
29. ©2019 Wantedly, Inc. ͔͜͜Β͸ The Twelve-Factor App Λ௒͑Δ෦෼
30. ©2019 Wantedly, Inc. 8BOUFEMZ
    Ͱ͸ԼͷΑ͏ͳΫϥελ໊ʹ͍ͯͨͨ͠Ίେมͩͬͨ ඇ໊લ؅ཧ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ prod.example.com api.prod.example.com dev.example.com api.dev.example.com stage.example.com api.stage.example.com ࠓޙ΋มΘΒͳͦ͞͏ͳงғؾ͕͋Δ Τϥʔݩ͕
    QSPEFYBNQMFDPN
    ͷ৔߹͸
    QBHFSEVUZ ໊લʹґଘͨ͠ϩδοΫΛ࡞ͬͯ͠·ͬͨ Τϥʔݩ͕
    TUBHFFYBNQMFDPN
    ͷ৔߹͸໷ؒ͸ແࢹ ΦʔέετϨʔγϣϯπʔϧ͕%/4Ϩίʔυ·Ͱ࡞੒ͯ͠͠·͏ Ҡߦ࣌ʹਖ਼͍͠
    BQJ
    αʔόʔ͕ߦํෆ໌ʹͳΔ ڞ௨ͷূ໌ॻΛ༻͍ͳ͍ͱҠߦ࣌ʹπʔϧ͕յΕͯ͠·͏ Ϋϥελ໊ BQJαʔόʔͷ%/4Ϩίʔυ
31. ©2019 Wantedly, Inc. ґଘͰ͖ͳͦ͞͏ͳ໊લϨίʔυʹมߋ ඇ໊લ؅ཧ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ prod201907.example.com prod201907.api.example.com dev201907.example.com dev201907.api.example.com stage201907.example.com stage201907.api.example.com ௚઀ͷࢀরΛආ͚Δ ϩδοΫͷ۠ผ͸ϥϕϧΛ༻͍Δ ໊લʹҙຯΛ࣋ͨͤͳ͍ FOW
    QSPEVDUJPO
    
    TUBHF
    
    EFW *.api.example.com ͷূ໌ॻΛڞ௨ͯ͠ར༻Ͱ͖Δ ґଘͰ͖ͳͦ͞͏ͳΞυϨεΛ࠾༻ FOWBQJFYBNQMFDPN
    ͔Β
    $/".&
    ΛுΔ͜ͱͰґଘπʔϧͷมߋΛෆཁʹͰ͖Δ Ϋϥελ໊ BQJαʔόʔͷ%/4Ϩίʔυ
32. ©2019 Wantedly, Inc. "1*αʔόʔͷҠߦϑϩʔ ඇ໊લ؅ཧ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ prod201906.api.example.com prod.api.example.com Ҡߦલʹ΋$/".&ΛڬΉ CNAME ղܾ ։ൃऀ༻πʔϧ܈
33. ©2019 Wantedly, Inc. ඇ໊લ؅ཧ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ prod201906.api.example.com prod201907.api.example.com Ҡߦதʹ͸ҟͳΔ໊લͰڞଘ prod.api.example.com CNAME ղܾ "1*αʔόʔͷҠߦϑϩʔ ։ൃऀ༻πʔϧ܈
34. ©2019 Wantedly, Inc. ඇ໊લ؅ཧ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ prod201906.api.example.com prod201907.api.example.com ݕূ͕ऴΘͬͨΒ%/4ͷுସ͑ prod.api.example.com CNAME ղܾ ։ൃऀ༻πʔϧ܈ "1*αʔόʔͷҠߦϑϩʔ
35. ©2019 Wantedly, Inc. ґଘͰ͖ͳͦ͞͏ͳ໊લϨίʔυʹมߋ ඇ໊લ؅ཧ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ prod201907.example.com prod201907.api.example.com dev201907.example.com dev201907.api.example.com stage201907.example.com stage201907.api.example.com ௚઀ͷࢀরΛආ͚Δ ΫογϣϯͱͳΔϨΠϠʔΛඞͣڬΉ Ωʔ͸௚઀ࢀর͠ͳ͍͜ͱ (BUFXBZ
    ͱ͍͏ղܾࡦ΋͋Δ *.api.example.com ͷূ໌ॻΛڞ௨ͯ͠ར༻Ͱ͖Δ ґଘͰ͖ͳͦ͞͏ͳΞυϨεΛ࠾༻ {env}.api.example.com ͔Β CNAME ΛுΔ͜ͱͰґଘπʔϧͷมߋΛෆཁʹͰ͖Δ Ϋϥελ໊ BQJαʔόʔͷ%/4Ϩίʔυ ͜ͷߟ͑͸
    LT
    ௨ͯ͠ڞ௨Ͱ͋Δͱߟ͍͑ͯΔ
36. ©2019 Wantedly, Inc. ໊લΛ௚઀ࢀর͠ͳ͍ߟ͑ͷଞͷదԠྫ ඇ໊લ؅ཧͷ༨ஊ ΫϥελͷҠߦʹࡍͯ͠શϩʔυόϥϯαʔ͕࠶࡞੒͞ΕΔ ϩʔυόϥϯαʔͷ࡞੒ΛτϦΨʔʹ$%/Λ࡞Δ࢓૊Έ͕͋ͬͨ Ҏ߱ڬΉΑ͏ʹͨ͠ $/".&ͷϫϯΫογϣϯ͕ݩ͔Β͋Ε͹Ҡߦ͸ָͩͬͨ ࣮ࡍʹ͸ख࡞ۀͰ΍͍ͬͯΔϑϩʔ͕ͩͬͨࣗಈͰ΋ಉ͡ όοΫΤϯυͷͭͳ͗௚͕͠େมʹͳͬͨ CDN Deployment Load Balancer
37. ©2019 Wantedly, Inc. ໊લΛ௚઀ࢀর͠ͳ͍ߟ͑ͷଞͷదԠྫ ඇ໊લ؅ཧͷ༨ஊ ΫϥελͷҠߦʹࡍͯ͠શϩʔυόϥϯαʔ͕࠶࡞੒͞ΕΔ ϩʔυόϥϯαʔͷ࡞੒ΛτϦΨʔʹ$%/Λ࡞Δ࢓૊Έ͕͋ͬͨ Ҏ߱ڬΉΑ͏ʹͨ͠ $/".&ͷϫϯΫογϣϯ͕ݩ͔Β͋Ε͹Ҡߦ͸ָͩͬͨ ࣮ࡍʹ͸ख࡞ۀͰ΍͍ͬͯΔϑϩʔ͕ͩͬͨࣗಈͰ΋ಉ͡ όοΫΤϯυͷղܾ͕େมʹͳͬͨ CDN CNAME Load Balancer Deployment
38. ©2019 Wantedly, Inc. όοΫΞοϓ ϦιʔεఆٛΛ෮ݩՄೳͳঢ়ଶͰอ؅͢Δ ͦΕͧΕʹҠߦͯ͠΋Β͏ϑϩʔΛऔΕͳ͍͜ͱ͕͋Δ ํ๏͸໰Θͳ͍ Ұׅͯ͠Ϛωδϝϯτͯ͋͛͠Δ͜ͱΛ೦಄ʹஔ͘ ΞϓϦέʔγϣϯΤϯδχΞͷෛ୲ͳ͠ʹҠߦ … … … ίί 8BOUFEMZ
    Ͱ͸
    IFQUJPWFMFSP
    Λ࠾༻ EFQMPZ
    ͷͨͼʹ
    ZBNM
    Λߋ৽
    
    BQQMZ
    ͢Δϑϩʔ΋औΕΔ 8BOUFEMZ
    Ͱ͸ࢿ࢈తʹ
    ZBNM
    ͱຊ൪ঢ়ଶʹࠩ෼͕ग़Δ͜ͱΛڐ༰ THE TWELVE FACTOR APP Ͱ͸ѻΘͳ͍ϨΠϠ ҰൠͷΞϓϦέʔγϣϯͰ͸%#ͷόοΫΞοϓʹ૬౰͢Δ Ϋϥελ؅ཧͰ͸ආ͚ΒΕͳ͍෦෼
39. ©2019 Wantedly, Inc. Ϋϥελ಺ͷεςʔτϑϧͳ΋ͷ͕ଘࡏ͢ΔͱҠߦ͕ඇৗʹେม SFBE
    SFQMJDB
    Λ৽نΫϥελͰཱͯͯঢ֨ εςʔτϑϧͱ͸ʁ +PC
    ΍
    $SPO+PC
    ΋͋Δҙຯεςʔτϑϧ 4UBUFGVMTFU
    ͸΋ͪΖΜεςʔτϑϧ ࣮ߦ͔ͨ͠ʁͷTUBUF͕ඇৗʹॏཁͰ͋ΔͨΊ ॏෳܽଛ؅ཧ ॏෳͱܽଛͷ͍ͣΕ͔ͷΈΛकΔ 8BOUFEMZ
    Ͱ͸εςʔτϑϧηοτͷຊ൪ར༻Λجຊతʹېࢭ͍ͯ͠Δ ࠷ѱσʔλ͕ඈͿ͜ͱΛڐ༰Ͱ͖Δ৔߹͸
    PL ॏෳͱܽଛͷ͍ͣΕ͔ͷΈΛकΔ Ҡߦ࣌ʹ
    EFMFUF
    ͱ
    DSFBUF
    ΛͲͷॱͰߦ͏͔ʁ ͍ͣΕͷॱͰ΋
    QPE
    ͷॏෳܽଛͷ͍ͣΕ͔͸ൃੜ͠͏Δ
40. ©2019 Wantedly, Inc. ॏෳܽଛ؅ཧ ॏෳͱܽଛͷ͍ͣΕ͔ͷΈΛकΔ at-most-one at-least-one ࠷େ1͔ͭ͠ଘࡏͯ͠͸ߦ͚ͳ͍ resource ࠷௿1ͭҎ্͸ଘࡏ͠ͳ͍ͱ͍͚ͳ͍ resource Muti-Cluster Strategy Λఆٛ ͜ͷ strategy ͝ͱʹҠߦ࣌ͷѻ͍Λม͑ΔΑ͏ʹͨ͠ ෳ਺Ϋϥελ͕ଘࡏ͢Δͱ͖ʹ Value ྫ Deployment(worker), CronJob, StatefulSet Deployment (web), ConfigMap, Service at-most-one delete and create at-least-one create and delete ΑΓཧ૝ͷੈք શͯͷ resource ͰॏෳΛڐ༰͢Δ શͯͷ Job Ͱႈ౳ੑΛ୲อ͢Δ Wantedly Ͱ͸ະ࣮ݱ Kubernetes Ͱ State Λ࣋ͬͨ resource Λ্ख͘ѻ͏ख๏΋͋Δ ͨͩʮ୭͕ͲΜͳίϯςφΛཱͯͯ΋͍͍ʯΛอͭʹ͸͋Δఔ౓ͷׂ੾΋ඞཁ
41. ©2019 Wantedly, Inc. ॏෳഉআ ΫϥελͷҠߦ࣌ʹ ॏෳͱܽଛͷ͍ͣΕ͔ͷΈΛकΔ SFBE
    SFQMJDB
    Λ৽نΫϥελͰཱͯͯঢ֨ εςʔτϑϧͱ͸ʁ +PC
    ΍
    $SPO+PC
    ΋͋Δҙຯεςʔτϑϧ 4UBUFGVMTFU
    ͸΋ͪΖΜεςʔτϑϧ ෳ਺ΫϥελͰಉ࣌ʹଘࡏͯ͠Α͍͔ʁ͕Ұͭͷ൑அج४ ࣮ߦ͔ͨ͠ʁͷTUBUF͕ඇৗʹॏཁͰ͋ΔͨΊ BUNPTUPOF BUMFBTUPOF ෳ਺Ϋϥελ͕ଘࡏͯ͠΋͔ͭ͠ଘࡏͯ͠͸ߦ͚ͳ͍
    SFTPVSDF ෳ਺Ϋϥελ͕ଘࡏͯ͠΋ͭҎ্͸ଘࡏ͠ͳ͍ͱ͍͚ͳ͍
    SFTPVSDF .VUJ$MVTUFS
    4USBUFHZ
    Λఆٛ ͜ͷ
    TUSBUFHZ
    ͝ͱʹҠߦ࣌ͷѻ͍Λม͑ΔΑ͏ʹͨ͠
42. ©2019 Wantedly, Inc. ίʔυϕʔε ґଘએݴ ίʔυϕʔε಺֎ʹอ؅ͯ͠஫ೖ͢Δ ୯Ұํ޲Ϗϧυ ؀ڥҰக ඇ໊લ؅ཧ όοΫΞοϓ ઃఆ͸͢΂ͯίʔυԽ͢Δ ґଘ͢ΔίϯϙʔωϯτͷWFSTJPOએݴ͢Δ ઃఆ෼཭ ίʔυϕʔε͔ΒΫϥελ΁ͷҰํ޲ͷΈͷ൓ө ࠩҟ͸ઃఆʹཹΊΔ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ ϦιʔεఆٛΛ෮ݩՄೳͳঢ়ଶͰอ؅͢Δ 12-factor app ͱڞ௨ New!! ॏෳܽଛ؅ཧ ॏෳͱܽଛͷ͍ͣΕ͔ͷΈΛकΔ
43. ©2019 Wantedly, Inc. heptio/ark(౰࣌) Ͱ backup ࣄલ ಉҰઃఆͰΫϥελΛ্ཱͪ͛Δ at-least-one resource ͷΈΛ ৽Ϋϥελʹ restore at-most-one resource ΛݱΫϥελ͔Β delete at-most-one resource Λ৽Ϋϥελʹ restore DNS Λ੾Γସ͑ ౰೔ ؂ࢹΛશͯϥϕϧ؅ཧʹม͑Δ ֤ॴʹΤΠϦΞεΛࠩ͠ࠐΉ ༨ஊ ࣮ࡍͷҠߦϑϩʔ Ops πʔϧ༻ͷূ໌ॻࠩ͠ସ͑ 1ϲ݄ఔ౓ 1೔
44. ©2019 Wantedly, Inc. ڭ܇ ಉҰ໨తͷΫϥελΛෳ਺؅ཧ͢Δ͜ͱΛ૝ఆ͢Δ গͳ͘ͱ΋Ұ࣌తʹ͸ߴ֬཰ʹൃੜ͠͏Δ
45. ©2019 Wantedly, Inc. ίʔυϕʔε ґଘએݴ ίʔυϕʔε಺֎ʹอ؅ͯ͠஫ೖ͢Δ ୯Ұํ޲Ϗϧυ ؀ڥҰக ඇ໊લ؅ཧ όοΫΞοϓ ઃఆ͸͢΂ͯίʔυԽ͢Δ ґଘ͢ΔίϯϙʔωϯτͷWFSTJPOએݴ͢Δ ઃఆ෼཭ ίʔυϕʔε͔ΒΫϥελ΁ͷҰํ޲ͷΈͷ൓ө ࠩҟ͸ઃఆʹཹΊΔ ϥϕϧ
    
    ΤΠϦΞεΛ࢖͏ ϦιʔεఆٛΛ෮ݩՄೳͳঢ়ଶͰอ؅͢Δ 12-factor app ͱڞ௨ New!! ॏෳܽଛ؅ཧ ॏෳͱܽଛͷ͍ͣΕ͔ͷΈΛकΔ