KubeCon+CNConに見るetcdの未来

Transcript

1. KubeCon + CNCon ʹݟΔ etcd ͷະདྷ Cloud Native Meetup Tokyo #6 2019೥1݄9೔ ஑ఴ ໌޺
2. • Akihiro IKEZOE (@zoetro) • αΠϘ΢ζגࣜձࣾۈ຿ • Πϯϑϥ࡮৽ϓϩδΣΫτ • ࣗࣾσʔληϯλʔʹKubernetesΫϥελΛߏங • αʔόʔػࡐͷϥΠϑαΠΫϧ؅ཧͷࣗಈԽ΍ɺKubernetesΫϥελͷӡ༻ࣗ ಈԽπʔϧΛ։ൃ͍ͯ͠Δ 2 ࣗݾ঺հ
3. KubeCon + CloudNativeCon North America 2018 • αΠϘ΢ζ͔Β͸7໊ͰࢀՃ͠·ͨ͠ɻ • KubeCon + CloudNativeCon North America 2018 ݱ஍Ϩϙʔτ • IUUQTCMPHDZCP[VJPFOUSZ • IUUQTCMPHDZCP[VJPFOUSZ • IUUQTCMPHDZCP[VJPFOUSZ • IUUQTCMPHDZCP[VJPFOUSZ 3
4. etcdؔ࿈ηογϣϯ • Keynote: 5 Years of etcd: Past, Present, and Future • What's Next for etcd Cluster Management? • Intro: Cluster Lifecycle SIG • Debugging etcd • Deep Dive: etcd 4
5. etcd • CoreOSࣾ(ݱRed Hatࣾ)͕։ൃ͢Δ෼ࢄΩʔόϦϡʔετΞ • ಛ௃ • )JHI
   "WBJMBCMF • 4USPOH
   $POTJTUFODZ
   .PEFM • 3BGUʹΑΔ෼ࢄ߹ҙ • 5SBOTBDUJPO
   8BUDI
   -FBTF • ϦʔμʔΤϨΫγϣϯͳͲ෼ࢄγεςϜʹඞཁͳػೳΛఏڙ • Kubernetes, Vitess, CoreDNSͳͲ਺ଟ͘ͷ෼ࢄγεςϜͷόο ΫΤϯυͱͯ͠ར༻͞Ε͍ͯΔɻ 5
6. etcdͷະདྷ Keynote: 5 Years of etcd: Past, Present, and Future
7. CoreOSࣾͷOSS͸Ͳ͏ͳΔͷ͔ʁ • CoreOS͕Red Hatʹങऩ͞ΕɺRed Hat΋IBMʹങऩ͞ΕΔ༧ఆɻ • Container Linux • 'FEPSB
   $PSF04͕ޙܧͱͳΔɻ • ೥͍ͬͺ͍͸ϝϯςφϯε͞ΕΔ༧ఆɻ • rkt • 3FE )BUͱͯ͠։ൃ͸ܧଓ͠ͳ͍ɻ'FEPSB
   $PSF04ʹ΋౥ࡌ͞Εͳ͍ɻ • etcd • Ͳ͏ͳΔʁ 7
8. https://www.cncf.io/blog/2018/12/11/cncf-to-host-etcd/ 8
9. etcd͕CNCFϓϩδΣΫτʹ • Red Hat͔ࣾΒCNCFʹدଃ͞Εͨɻ • etcdͷϝϯςφ͸΋ͱ΋ͱCoreOSͷ֎ͷਓ͕ଟ͍ͷͰɺ ։ൃମ੍ʹେ͖ͳมԽ͸ͳͦ͞͏ɻ • ࠓޙ͸࢖͍΍͢͞΍҆ఆੑ΍ੑೳͷվળͳͲ͕த৺ɻ • υΩϡϝϯτͷ੔උ΋ظ଴͞ΕΔɻ 9
10. etcdͷ৽ػೳ What's Next for etcd Cluster Management?
11. ࠓޙetcdʹಋೖ͞ΕΔػೳ • 
    3BGU
    -FBSOFS
    FUDE
    W
    • 
    FUDE
    PQFSBUPS
    1FSTJTUFOU7PMVNF
    4VQQPSU FUDE
    PQFSBUPS
    W
    
    • 
    4FSWFS
    %PXOHSBEF
    FUDE
    W
    • 
    $MVTUFS
    JOJU
    ఏҊத 11
12. 
    3BGU
    -FBSOFS 12
13. • ωοτϫʔΫ෼அ΍ύέοτϩεͳͲͷো֐͕ൃੜ͠ ͯ΋ɺσʔλͷෆ੔߹Λൃੜͤ͞ͳ͍͜ͱΛอূ͢Δɻ • Ϋϥελ಺͔ΒϦʔμʔΛબग़͢Δɻ Ϧʔμʔ͔ΒଞͷϝϯόʔʹϋʔτϏʔτΛૹ৴͠ Ϧʔμʔ͕1͔͍ͭ͠ͳ͍͜ͱΛอূ͢Δɻ • ϦʔμʔΛؚΉա൒਺ͷϝϯόʔ͕߹ҙͨ͠ͱ͖ʹ σʔλΛίϛοτ͢Δ͜ͱ͕Ͱ͖Δɻ 13 Raft: etcdͷ෼ࢄ߹ҙΞϧΰϦζϜ
14. Network Partition (Split Brain) https://youtu.be/5kAVOQ4APok 14
15. • Ϋϥελʹ৽͍͠ϝϯόΛ௥Ճͨ͠ͱ͖ɺσʔλͷಉظ͕׬ྃ ͢Δ·Ͱʹ͕͔͔࣌ؒΔɻ • σʔλͷಉظ͕׬͍ྃͯ͠ͳ͍ϝϯόʔ΋ɺ෼ࢄ߹ҙͷϝϯ όʔͱͯ͠Χ΢ϯτ͞ΕΔɻ 15 ݱঢ়ͷ໰୊఺ʢલఏʣ
16. • σʔλಉظத͸I/Oෛՙ͕ߴ͍ɻϦʔμʔ͔ΒͷϋʔτϏʔτ ϦΫΤετͷλΠϜΞ΢τ͕ൃੜ͠΍͘͢ͳΔɻ • σʔλಉظதʹωοτϫʔΫ෼அ͕ൃੜ͢ΔͱɺຊདྷͳΒো֐ ʹ଱͑͏ΔέʔεͰ΋Ϋϥελ่յ͕ൃੜͯ͠͠·͏ɻ • ϝϯόʔΛ௥Ճ͢Δͱ͖ʹىಈύϥϝʔλΛϛε͍ͬͯΔͱɺ Quorum Size͚ͩ૿͑ͯނোͨ͠ϝϯόʔ͕Ϋϥελʹ௥Ճ͞ Εͯ͠·͏ɻ 16 ݱঢ়ͷ໰୊఺
17. 17 σʔλಉظલͷωοτϫʔΫ෼அ https://youtu.be/5kAVOQ4APok
18. Raft Learner 18 https://youtu.be/5kAVOQ4APok
19. 
    $MVTUFS
    JOJU 19
20. etcdͷىಈΦϓγϣϯ 20
21. • etcdΫϥελΛ্ཱͪ͛ΔͨΊʹ͸ɺϝϯόʔ͝ͱʹ໊લ΍ɺ Ϧοεϯ͢ΔΞυϨεɺଞͷϝϯόʔʹ޿ࠂ͢ΔURLΛࢦఆ͢ Δඞཁ͕͋Δɻ • ͜ΕΒͷύϥϝʔλΛࢦఆ͠ͳͯ͘΋ɺDNSΛར༻ͯ͠ɺࣗಈ తʹ໊લ΍ΞυϨεΛղܾ͢Δ࢓૊Έ͕ఏҊ͞Ε͍ͯΔɻ • etcdϝϯόʔͷ্ཱ͕ͪ͛ඇৗʹ؆୯ʹͳΔʂ 21 Cluster init
22. etcdadm Intro: Cluster Lifecycle SIG
23. etcdͷӡ༻͸େม • etcd͸ඇৗʹ؆୯ʹ࢖͍࢝ΊΔ͜ͱ͕Ͱ͖Δɻ • ͔͠͠ɺຊ൪؀ڥͰӡ༻͠Α͏ͱࢥ͏ͱɺHAߏ੒ʹͨ͠Γɺ ূ໌ॻΛ؅ཧͨ͠ΓɺΫϥελ่͕յ͠ͳ͍Α͏ʹϝϯόΛ௥ Ճɾ࡟আͨ͠Γɺ͍Ζ͍Ζ೉͍͠ɻ • ӡ༻ΛࣗಈԽ͢Δπʔϧ͕ඞཁͱͳΔ • Kubernetes্ͷetcdΫϥελͷӡ༻ ὎ FUDE
    PQFSBUPS • ࣮ػ΍VM্ͷetcdΫϥελͷӡ༻͸ʁ 23
24. etcdadm https://youtu.be/vtBc0f1ACbM 24
25. • ࣮ػ΍7.޲͚ͷFUDEΫϥελӡ༻ࣗಈԽπʔϧ • ,VCFSOFUFT LVCFBQJTFSWFS ޲͚ʹಛԽ • $MVTUFS
    -JGFDZDMF 4*(ʹͯఏҊத • QMBUGPSNFUDEBEN ͱ LPQFJPFUDENBOBHFS Λϕʔεʹ࣮ͯ͠૷͕ਐΊΒΕΔ༧ఆɻ • FUDEΫϥελͷߏங΍ӡ༻ΛࣗಈԽͯ͘͠ΕΔ • ϝϯόʔͷ௥Ճ΍࡟আ • όοΫΞοϓͱϦετΞ σΟβελʔϦΧόϦʔ • ΞοϓάϨʔυɺμ΢ϯάϨʔυ • ূ໌ॻͷ؅ཧ 25 etcdadm
26. τϥϒϧγϡʔςΟϯά Debugging etcd
27. σόοάͷΞϓϩʔν https://youtu.be/NVMZBBQ9hsM 27
28. σόοάʹศརͳπʔϧ • etcdctl • FUDEΛૢ࡞͢ΔͨΊͷඪ४πʔϧɻ • auger • ,VCFSOFUFT͸QSPUPCVGܗࣜͰFUDEʹσʔλΛ֨ೲ͍ͯ͠Δɻ • ͜ͷσʔλΛσίʔυͯ͠දࣔͯ͘͠ΕΔπʔϧɻ • etcd-dump-logs • 8"-ͷMPHΛμϯϓͯ͠ɺFUDEʹରͯ͠ͲͷΑ͏ͳૢ࡞͕͓͜ͳΘΕ ͔ͨΛ֬ೝ͢Δ͜ͱ͕Ͱ͖Δπʔϧɻ 28
29. Q&Aܗࣜͷηογϣϯ Deep Dive: etcd
30. Deep Dive: etcd https://youtu.be/GJqO1TYzVDE 30
31. ؾʹͳͬͨQ&A • ͳͥσʔλαΠζʹ੍ݶ͕͋Δͷ͔ʁ • σϑΥϧτͰ2GBʢ࠷େ8GBʣͷ੍ݶ͕͋Δɻ • σʔλϕʔεϑΝΠϧΛmmap͢ΔͨΊɺσʔλྔ෼ͷϝϞϦ͕ඞཁɻ • ͳͥίϯύΫγϣϯ͕ඞཁͳͷ͔ʁ • Ωʔ͝ͱͷཤྺΛอ͍࣋ͯ͠Δɻ • ݹ͍ཤྺΛ࡟আ͠ͳ͍ͱɺσʔλ༰ྔ͕૿͑ϦετΞ࣌ؒ΋૿େ͢Δɻ • ͳͥI/OϨΠςϯγʹහײͳͷ͔ʁ • ఆظతʹϦʔμʔ͔ΒϑΥϩϫʔʹϋʔτϏʔτΛૹ৴ͯ͠ɺ෼ࢄ߹ҙͷϝ λσʔλΛϑΝΠϧʹอଘ͍ͯ͠Δɻ • ϑΝΠϧॻ͖ࠐΈ͕஗͍ͱϋʔτϏʔτ͕λΠϜΞ΢τ͢Δɻ(v3.4Ͱվળʁ) • ग़དྷΔ͚ͩSSDΛ࢖͏΂͖ɻ 31
32. ·ͱΊ
33. ·ͱΊ • etcd͸KubernetesΛ࢝Ί͍Ζ͍Ζͳͱ͜ΖͰ࢖ΘΕ͍ͯͯɺ ͳͯ͘͸ͳΒͳ͍ଘࡏɻ • CNCFϓϩδΣΫτʹՃΘͬͨ͜ͱ΋͋Γɺࠓޙͷϝϯςφϯ ε͸҆৺ͯ͠ྑͦ͞͏ɻ • ։ൃऀ޲͚ͷେ͖ͳ৽ػೳ͸͋·Γͳͦ͞͏͚ͩͲɺӡ༻ऀ޲ ͚ʹ͸خ͍͠ػೳ͕͍Ζ͍Ζग़͖ͯͦ͏ɻ 33