SRE ͷߟ͑ΛϚωδϝϯτʹ׆͔͢ Takeshi Kondo / @chaspy 2024/08/04 SRE NEXT 2024

Who am I chaspy Director of Engineering StudySapuri K12 at Recruit Co., Ltd. ✊ 4ճ໨Ͱ͢͜Μʹͪ͸ 📷 ࠓ೥͸ίΞελοϑ΋΍ͬͯ·͢ Takeshi Kondo https://chaspy.me chaspy_

ʰελσΟαϓϦʱখதߴ(*)ͷ։ൃΛ͍ͯ͠·͢ *খֶɾதֶɾߴߍɾେֶडݧߨ࠲ͷུͰ͢

SRE NEXT օۈ৆ͳͷ͸ @yuuk1 ͞Μͱ @chaspy ͚ͩʂ

ڈ೥ SRE Ҿୀͨ͠ͱ͔ݴͬͯͨ

SRE ͸ੜ͖༷

Ҿୀͯ͠Կ΍͍ͬͯΔͷ͔ • ։ൃ෦ͷ෦௕ͬͯ΍ͭΛ΍ͬͯΔ • ೉͍͕͠ͳΜͱ͔΍ͬͯ·͢ • ΋͏͙͢1೥ • ࠓ΋ SRE ͷ৺ͰϚωδϝϯτͷ࢓ࣄ΍ͬͯ·͢ • SRE ͸ੜ͖༷ͳͷͰ…

͜Ε·ͰͷΩϟϦΞ • 2014~ Software Engineer, Cloud at FUJITSU • ࠃ࢈Ϋϥ΢υͷ։ൃ • OpenStack, Ծ૝Խ(VMWare, HyperV, Xen, KVM), Hardware(Server,Network,Storage) • 2018~ Software Engineer, SRE at Quipper • AWS, Kubernetes, SLI/SLO, Monitoring • 2021~ Engineering Manager, SRE at Recruit • 2022~ Engineering Manager, SRE & WebDev at Recruit • 2023~ Director of Engineering at Recruit IC(Individual Contributor) ͱͯ͠7೥ Manager ͱͯ͠3೥

ࠓ೔࿩͢͜ͱ: SRE ͱϚωδϝϯτͷڞ௨఺ͱҧ͍ • ૝ఆ͢Δϩʔϧˍ࣋ͪؼ͍͖͍ͬͯͨͩͨ͜ͱ • SREing Λ΍͍ͬͯͯϚωδϝϯτʹڵຯ͕͋Δਓ • Ϛωδϝϯτ͕ΩϟϦΞͷબ୒ࢶͷ1ͭʹͳΕ͹خ͍͠ • ݱ໾ͰϚωʔδϟͷਓ • ࢓ࣄΛ͢Δ্Ͱͷߟ͑ͷώϯτʹͳΕ͹ʂ • Ϛωʔδϟʹڵຯ͕ͳ͍ਓ • ਎ͷճΓͷϚωʔδϟ͕ߟ͍͑ͯΔ͜ͱΛ஌͍ͬͯͨͩ͘

Agenda • ࣗݾ঺հ • Ϛωδϝϯτ / SRE ͱ͸Կ͔ • Ϛωδϝϯτͱ SRE ͷൺֱ • ۩ମྫ • ·ͱΊ

Ϛωδϝϯτͱ͸Կ͔ • Ϛωδϝϯτͱ͸ • ඞཁͳ΋ͷΛௐୡ/ௐ੔͠ɺظ଴͞ΕΔ੒ՌΛ্͛Δ͜ͱ • ϚωʔδϟͷΞ΢τϓοτ • = ࣗ૊৫ͷΞ΢τϓοτ + ྡͷ૊৫ͷΞ΢τϓοτ • ର৅͸ਓʢ૊৫ʣ https://bookplus.nikkei.com/atcl/catalog/17/P55010/ ࣗ૊৫ͷ Ξ΢τϓοτ ྡͷ૊৫ͷ Ξ΢τϓοτ* ϚωʔδϟͷΞ΢τϓοτ * ྡͷ૊৫ = Α͘Ұॹʹ࢓ࣄΛ͢ΔνʔϜΛ 
 ૝૾ͯ͠΋Β͑Ε͹ྑ͍Ͱ͢ʂ https://www.oreilly.co.jp/books/9784873119946/

SRE ͱ͸Կ͔ • αʔϏεͷ৴པੑΛίϯτϩʔϧ͢Δ͜ͱ • ͋Δ͍͸ίϯτϩʔϧ͢ΔೳྗΛ૊৫ʹ࣮૷͢Δ͜ͱ • ίϯτϩʔϧͱ͸: • αʔϏεͷظ଴஋(SLO)Λઃఆ͠ɺ؍࡯͠ɺաෆ଍͋Ε͹ௐ੔͢Δ • ର৅͸αʔϏεʢγεςϜʣ γεςϜ SLI: http success rate SLO: 99.99% Actual: 99.98% 🔴 SRE Devs PdM Biz CS ૊৫ Enabling Embedding

ϚωδϝϯτͱSREͷൺֱ Ϛωδϝϯτ SRE ϛογϣϯ 🙆 ࣗ૊৫ͱྡ઀૊৫ͷΞ΢τϓοτͷ ظ଴஋Λίϯτϩʔϧ͢Δ ✅ αʔϏεͷ৴པੑΛ ظ଴஋(SLO)ʹίϯτϩʔϧ͢Δ खஈ ʢ🙆🔨💰ʣϦιʔεͷௐୡɾௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ 🖥 γεςϜɾΠϯϑϥͷߏஙɺௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ ର৅ 🙆 ૊৫ 🙆 ૊৫ͱ🖥γεςϜ

ϚωδϝϯτͱSREͷൺֱ Ϛωδϝϯτ SRE ϛογϣϯ 🙆 ࣗ૊৫ͱྡ઀૊৫ͷΞ΢τϓοτͷ ظ଴஋Λίϯτϩʔϧ͢Δ ✅ αʔϏεͷ৴པੑΛ ظ଴஋(SLO)ʹίϯτϩʔϧ͢Δ खஈ ʢ🙆🔨💰ʣϦιʔεͷௐୡɾௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ 🖥 γεςϜɾΠϯϑϥͷߏஙɺௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ ର৅ 🙆 ૊৫ 🙆 ૊৫ͱ🖥γεςϜ ର৅ͷظ଴஋Λௐ੔͠ɺ ίϯτϩʔϧ͢Δͱ͍͏ ҙຯͰ͸ಉ͡Ͱ͸ʁ ͢Ͱʹ૊৫Λ ݟ͍ͯΔ఺͸ ڞ௨Ͱ͸ʁ ௐୡɾௐ੔ͱ͍͏ खஈ΋ڞ௨Ͱ͸ʁ

ϚωδϝϯτͱSREͷൺֱ • Ϛωδϝϯτ͸૊৫ͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ • SRE ͸γεςϜͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ͱγεςϜ • ͔ͳΓࣅ͍ͯΔͱࢥ͍·ͤΜ͔ʁ • ࣮ࡍʹࣗ෼͸Ϛωδϝϯτͱ͍͏ۀ຿Λ SRE ͷϝϯλϧϞσϧͰݟ͍ͯ·͢ • ͜Ε͕Ͱ͖Δͱࣗ਎͕ϓϨΠϠʔΛܦݧͯ͠ͳ͍νʔϜͰͷϚωδϝϯτΛ΍Δ৔߹ͷ෢ثʹͳΔ

SRE ͷۀ຿ΛϚωʔδϟͷ࢓ࣄʹྫ͑Δ • ΞϥʔτରԠ • ϦεΫϚωδϝϯτ • ΞʔΩςΫνϟઃܭ

ΞϥʔτରԠ SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ SLO ͱΞϥʔτΛઃఆ͢Δ ΞϥʔτΛड͚Δ ରԠ͢Δ νʔϜʹ͓೚ͤ͢Δظ଴஋Λ఻͑Δ Ͳ͏ͳͬͨΒݺΜͰཉ͍͔͠఻͑Δ ΞϥʔτΛड͚Δ ରԠ͢Δ

ΞϥʔτରԠ SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ SLO ͱΞϥʔτΛઃఆ͢Δ ΞϥʔτΛड͚Δ ରԠ͢Δ νʔϜʹ͓೚ͤ͢Δظ଴஋Λ఻͑Δ Ͳ͏ͳͬͨΒݺΜͰཉ͍͔͠఻͑Δ ΞϥʔτΛड͚Δ ରԠ͢Δ ✋ Ϛωδϝϯτͷ৔߹ͷ SLI/SLO ͸ʁ 😃 ఆྔతͳϝτϦΫε΋͋Δ͕ɺఆੑ৘ใΛ Ξϥʔτʹ࢖͏͜ͱ͕ଟ͍ ఆੑ * νʔϜͷৼΓฦΓͰग़Δ Problem * 1on1 Ͱͷձ࿩಺༰ * ԣͷϚωʔδϟ͔ΒͷΤεΧϨʔγϣϯ ఆྔ * νʔϜͷΞ΢τϓοτʢνέοτ౳ʣ * eNPSʢΤϯήʔδϝϯταʔϕΠʣ

ϦεΫ”Ϛωδϝϯτ” SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ γεςϜ͕མͪͨΒ Ͳ͏͢Δʁ ৑௕Խ ͜ͷਓ͕ʢ௕ظͰʣ ٳΉ࣌Ͳ͏͢Δʁ ଞͷਓͰ΋ۀ຿Ͱ͖Δ Α͏Ҿ͖ܧ͗ ٸͳεύΠΫΞΫηε ͕དྷΔ͔΋ʁ ࣄલʹεέʔϧΞοϓ/ Ξ΢τ͢Δ ٸʹۀ຿ྔ૿͑Δ͔΋ ਓΛ࿈Εͯ͘Δ ૿͑ͳ͍Α͏ʹௐ੔ σʔλফ͑ͪΌͬͨΒ Ͳ͏͠Α͏ όοΫΞοϓ ಥવୀ৬ऀ͕ग़ͨΒ Ͳ͏͠Α͏ υΩϡϝϯςʔγϣϯ φϨοδγΣΞ

ΞʔΩςΫνϟઃܭ SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ αʔϏεͷ໾ׂɾ੹຿Λઃܭ͢Δ ݸਓɾνʔϜͷ໾ׂΛઃܭ͢Δ ظ଴஋͸ ݸਓ/νʔϜ໨ඪ ظ଴஋͸ SLO ΠϯλʔϑΣʔε ͸ API ΠϯλʔϑΣʔε ͸ “Team API”* *શνʔϜʹରͯ͠ɺϝϯγϣϯάϧʔϓ໊ɺ ໾ׂɺ੹຿ɺίϛϡχέʔγϣϯํ๏Λ Spreadsheet Ͱ؅ཧ͠ɺ൒೥ʹ1౓ߋ৽ * Team Topologies ΑΓ https://pub.jmam.co.jp/book/b593881.html

ΞʔΩςΫνϟઃܭ SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ αʔϏεͷ໾ׂɾ੹຿Λઃܭ͢Δ ݸਓɾνʔϜͷ໾ׂΛઃܭ͢Δ ظ଴஋͸ ݸਓ/νʔϜ໨ඪ ظ଴஋͸ SLO ΠϯλʔϑΣʔε ͸ API ΠϯλʔϑΣʔε ͸ “Team API”* *શνʔϜʹରͯ͠ɺϝϯγϣϯάϧʔϓ໊ɺ ໾ׂɺ੹຿ɺίϛϡχέʔγϣϯํ๏Λ Spreadsheet Ͱ؅ཧ͠ɺ൒೥ʹ1౓ߋ৽ * Team Topologies ΑΓ https://pub.jmam.co.jp/book/b593881.html ✋ ΞʔΩςΫνϟઃܭʹ͸τϨʔυΦϑ͕ଘ ࡏ͠·͕͢ɺϚωδϝϯτͷ৔߹΋τϨʔυ Φϑ͸ଘࡏ͠·͔͢ʁ 😃 Yes ৗʹϝϦοτͱσϝϦοτΛ૝ఆ͠·͢ɻ e.g. νʔϜΛখ͘͞෼ׂ͢Ε͹ɺ໨ඪ͸γϯϓϧʹͳΓɺ ೝ஌ෛՙ͸࡟ݮ͞ΕΔ͕ɺۀ຿ྔͷ೾ʹΑͬͯՋͳ࣌ظ͕ ൃੜ͢Δ͔΋ جຊͷ੹຿ఆٛͱɺྫ֎࣌ʹͲ͏͢Δ͔Λఆٛ͠ɺ ྫ֎ൃੜ཰͕௿͘ͳΔΑ͏ʹ͢Δͷ͕ॏཁ

ϚωδϝϯτͱSREͷൺֱ • Ϛωδϝϯτ͸૊৫ͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ • SRE ͸γεςϜͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ͱγεςϜ • ظ଴஋ௐ੔ͱɺͦͷظ଴஋΁ͷίϯτϩʔϧ͕ڞ௨͍ͯ͠Δ • ͔͠΋͢Ͱʹ૊৫ʹ΋൒෼޲͖߹͖͍ͬͯͯΔ! • ͳΜ͔ͩ΍ΕΔؾ͕͖ͯ͠·͔ͨ͠…?

SRE ͱϚωδϝϯτͷ࠷େͷҧ͍ • ର৅͕ਓͰ͋Δ͜ͱ • ಉ͡ਓؒ͸୭Ұਓ͍ͳ͍ • ظ଴஋ௐ੔΋ΞϥʔτରԠ΋ಉ͡ํ๏͸௨͡ͳ͍ • ʮର࿩ʯ͠ɺʮཧղʯ͢Δ͜ͱ͕ॏཁ • ͦͷͨΊͷεΩϧ͸ޙఱతʹशಘՄೳ • ܏ௌɺݴޠԽɺϑΟʔυόοΫɺϑΝγϦςʔγϣϯ etc • ͱ͸͍͑ɺ͍͖ͳΓ΍Δͷ͸೉͍͠ͷͰஈ֊తʹ܇࿅ΛੵΉͷΛ͓͢͢Ί

·ͱΊ • 💡SRE ͱϚωδϝϯτ͸ظ଴஋ௐ੔ͷ఺Ͱڞ௨͍ͯ͠Δ • ϚωδϝϯτΛҰ෦͢Ͱʹ΍͍ͬͯΔͱ΋ݴ͑Δ • ͢Ͱʹ૊৫ʹ޲͖߹͍ͬͯΔ෼༗རͰ͋Δͱ΋ݴ͑Δ • 🤔͔͠͠ɺʢϐʔϓϧʣϚωδϝϯτ͸γεςϜͷΑ͏ʹ୯Ұతͳํ๏Ͱ ରॲ͢Δ͜ͱ͸೉͍͠ • ਓؒͬͯ೉͍͠…! • ͔͠͠ɺͦͷͨΊͷ܏ௌɺݴޠԽͳͲͷεΩϧ͸ޙఱతʹशಘՄೳ • 🤝Ϛωδϝϯτʹڵຯ͕͋Δਓ͸௅ઓͯ͠ཉ͍͠ͱࢥ͍·͢ • શྗͰԠԉ͠·͢ʂ

💡 ໌೔͔ΒͰ͖Δώϯτ • ϚωʔδϟΛ΍ͬͯΈ͍ͨਓ • ࣗ෼ͷ্௕ʹʮڵຯ͕͋Δʯ͜ͱΛ఻͑ͯΈΑ͏ • ਓ΍νʔϜʹରͯ͠ʮظ଴஋Λௐ੔͢Δʯ࿅शΛ΍ͬͯΈΑ͏ • ࣗ෼ͷಇ͖ํͷظ଴஋ΛνʔϜϝϯόʔ΍Ϛωʔδϟʹฉ͍ͯΈΑ͏ • ࠓϚωʔδϟΛ΍͍ͬͯΔਓ޲͚ͷώϯτ • ϝϯόʔʹରͯ͠࢓ࣄͷظ଴஋Λձ࿩ͯ͠ΈΑ͏ • ϝϯόʔʹରͯ͠Ϛωʔδϟͷظ଴஋Λձ࿩ͯ͠ΈΑ͏ • ࣗ෼ͷνʔϜͷظ଴஋ΛྡͷνʔϜ΍্௕ʹ͋ΒͨΊͯฉ͍ͯΈΑ͏

͓·͚ɿϚωδϝϯτͷָ͠͞ɺ΍Γ͕͍ • 💪 ࡋྔ͕͋Δ͜ͱͰɺΑΓେ͖ͳ੒ՌΛ૊৫ʹىͤ͜Δ • 💬 ݟΔൣғ͕૿͑ɺΑΓଟ༷ͳਓͱ࿩͢ػձ͕ଟָ͍͘͠ • 💥 ༷ʑͳ໰୊͕ى͖ΔͷͰɺ੒௕ػձ͕ଟ͍ • ଓ͖͸ Ask the Speaker Ͱ! 😄

Thank you! chaspy Director of Engineering StudySapuri K12 at Recruit Co., Ltd. 😄 ୭͔1ਓͷΩϟϦΞͷબ୒ࢶΛ࡞ΕͨΒخ͍͠ 🗣 Ask the Speaker Ͱ࿩͠·͠ΐ͏ʂ Takeshi Kondo https://chaspy.me chaspy_