Share
Embed
SRE の考えをマネジメントに活かす / applying SRE ideas to management
SRE NEXT 2024
https://sre-next.dev/2024/
Takeshi Kondo
August 04, 2024
Transcript
27 slides
-
Who am I chaspy Director of Engineering StudySapuri K12 at
Recruit Co., Ltd. ✊ 4ճͰ͢͜Μʹͪ 📷 ࠓίΞελοϑͬͯ·͢ Takeshi Kondo https://chaspy.me chaspy_ -
Ҿୀͯ͠Կ͍ͬͯΔͷ͔ • ։ൃ෦ͷ෦ͬͯͭΛͬͯΔ • ͍͕͠ͳΜͱ͔ͬͯ·͢ • ͏͙͢1 • ࠓ SRE
ͷ৺ͰϚωδϝϯτͷࣄͬͯ·͢ • SRE ੜ͖༷ͳͷͰ… -
͜Ε·ͰͷΩϟϦΞ • 2014~ Software Engineer, Cloud at FUJITSU • ࠃ࢈Ϋϥυͷ։ൃ
• OpenStack, ԾԽ(VMWare, HyperV, Xen, KVM), Hardware(Server,Network,Storage) • 2018~ Software Engineer, SRE at Quipper • AWS, Kubernetes, SLI/SLO, Monitoring • 2021~ Engineering Manager, SRE at Recruit • 2022~ Engineering Manager, SRE & WebDev at Recruit • 2023~ Director of Engineering at Recruit IC(Individual Contributor) ͱͯ͠7 Manager ͱͯ͠3 -
ࠓ͢͜ͱ: SRE ͱϚωδϝϯτͷڞ௨ͱҧ͍ • ఆ͢Δϩʔϧˍ࣋ͪؼ͍͖͍ͬͯͨͩͨ͜ͱ • SREing Λ͍ͬͯͯϚωδϝϯτʹڵຯ͕͋Δਓ • Ϛωδϝϯτ͕ΩϟϦΞͷબࢶͷ1ͭʹͳΕخ͍͠
• ݱͰϚωʔδϟͷਓ • ࣄΛ͢Δ্Ͱͷߟ͑ͷώϯτʹͳΕʂ • Ϛωʔδϟʹڵຯ͕ͳ͍ਓ • ͷճΓͷϚωʔδϟ͕ߟ͍͑ͯΔ͜ͱΛ͍ͬͯͨͩ͘ -
Agenda • ࣗݾհ • Ϛωδϝϯτ / SRE ͱԿ͔ • Ϛωδϝϯτͱ
SRE ͷൺֱ • ۩ମྫ • ·ͱΊ -
ϚωδϝϯτͱԿ͔ • Ϛωδϝϯτͱ • ඞཁͳͷΛௐୡ/ௐ͠ɺظ͞ΕΔՌΛ্͛Δ͜ͱ • ϚωʔδϟͷΞτϓοτ • = ࣗ৫ͷΞτϓοτ
+ ྡͷ৫ͷΞτϓοτ • ରਓʢ৫ʣ https://bookplus.nikkei.com/atcl/catalog/17/P55010/ ࣗ৫ͷ Ξτϓοτ ྡͷ৫ͷ Ξτϓοτ* ϚωʔδϟͷΞτϓοτ * ྡͷ৫ = Α͘ҰॹʹࣄΛ͢ΔνʔϜΛ ૾ͯ͠Β͑Εྑ͍Ͱ͢ʂ https://www.oreilly.co.jp/books/9784873119946/ -
SRE ͱԿ͔ • αʔϏεͷ৴པੑΛίϯτϩʔϧ͢Δ͜ͱ • ͋Δ͍ίϯτϩʔϧ͢ΔೳྗΛ৫ʹ࣮͢Δ͜ͱ • ίϯτϩʔϧͱ: • αʔϏεͷظ(SLO)Λઃఆ͠ɺ؍͠ɺաෆ͋Εௐ͢Δ
• ରαʔϏεʢγεςϜʣ γεςϜ SLI: http success rate SLO: 99.99% Actual: 99.98% 🔴 SRE Devs PdM Biz CS ৫ Enabling Embedding -
ϚωδϝϯτͱSREͷൺֱ Ϛωδϝϯτ SRE ϛογϣϯ 🙆 ࣗ৫ͱྡ৫ͷΞτϓοτͷ ظΛίϯτϩʔϧ͢Δ ✅ αʔϏεͷ৴པੑΛ ظ(SLO)ʹίϯτϩʔϧ͢Δ
खஈ ʢ🙆🔨💰ʣϦιʔεͷௐୡɾௐ 🙆 ৫ͷίϛϡχέʔγϣϯ 🖥 γεςϜɾΠϯϑϥͷߏஙɺௐ 🙆 ৫ͷίϛϡχέʔγϣϯ ର 🙆 ৫ 🙆 ৫ͱ🖥γεςϜ -
ϚωδϝϯτͱSREͷൺֱ Ϛωδϝϯτ SRE ϛογϣϯ 🙆 ࣗ৫ͱྡ৫ͷΞτϓοτͷ ظΛίϯτϩʔϧ͢Δ ✅ αʔϏεͷ৴པੑΛ ظ(SLO)ʹίϯτϩʔϧ͢Δ
खஈ ʢ🙆🔨💰ʣϦιʔεͷௐୡɾௐ 🙆 ৫ͷίϛϡχέʔγϣϯ 🖥 γεςϜɾΠϯϑϥͷߏஙɺௐ 🙆 ৫ͷίϛϡχέʔγϣϯ ର 🙆 ৫ 🙆 ৫ͱ🖥γεςϜ ରͷظΛௐ͠ɺ ίϯτϩʔϧ͢Δͱ͍͏ ҙຯͰಉ͡Ͱʁ ͢Ͱʹ৫Λ ݟ͍ͯΔ ڞ௨Ͱʁ ௐୡɾௐͱ͍͏ खஈڞ௨Ͱʁ -
ϚωδϝϯτͱSREͷൺֱ • Ϛωδϝϯτ৫ͷظΛຬͨͨ͢Ίʹௐ͢Δ • ର৫ • SRE γεςϜͷظΛຬͨͨ͢Ίʹௐ͢Δ • ର৫ͱγεςϜ
• ͔ͳΓࣅ͍ͯΔͱࢥ͍·ͤΜ͔ʁ • ࣮ࡍʹࣗϚωδϝϯτͱ͍͏ۀΛ SRE ͷϝϯλϧϞσϧͰݟ͍ͯ·͢ • ͜Ε͕Ͱ͖Δͱ͕ࣗϓϨΠϠʔΛܦݧͯ͠ͳ͍νʔϜͰͷϚωδϝϯτΛΔ߹ͷثʹͳΔ -
ΞϥʔτରԠ SRE ͷ߹ Ϛωʔδϟͷ߹ SLO ͱΞϥʔτΛઃఆ͢Δ ΞϥʔτΛड͚Δ ରԠ͢Δ νʔϜʹ͓ͤ͢ΔظΛ͑Δ Ͳ͏ͳͬͨΒݺΜͰཉ͍͔͑͠Δ
ΞϥʔτΛड͚Δ ରԠ͢Δ ✋ Ϛωδϝϯτͷ߹ͷ SLI/SLO ʁ 😃 ఆྔతͳϝτϦΫε͋Δ͕ɺఆੑใΛ Ξϥʔτʹ͏͜ͱ͕ଟ͍ ఆੑ * νʔϜͷৼΓฦΓͰग़Δ Problem * 1on1 Ͱͷձ༰ * ԣͷϚωʔδϟ͔ΒͷΤεΧϨʔγϣϯ ఆྔ * νʔϜͷΞτϓοτʢνέοτʣ * eNPSʢΤϯήʔδϝϯταʔϕΠʣ -
ϦεΫ”Ϛωδϝϯτ” SRE ͷ߹ Ϛωʔδϟͷ߹ γεςϜ͕མͪͨΒ Ͳ͏͢Δʁ Խ ͜ͷਓ͕ʢظͰʣ ٳΉ࣌Ͳ͏͢Δʁ ଞͷਓͰۀͰ͖Δ
Α͏Ҿ͖ܧ͗ ٸͳεύΠΫΞΫηε ͕དྷΔ͔ʁ ࣄલʹεέʔϧΞοϓ/ Ξτ͢Δ ٸʹۀྔ૿͑Δ͔ ਓΛ࿈Εͯ͘Δ ૿͑ͳ͍Α͏ʹௐ σʔλফ͑ͪΌͬͨΒ Ͳ͏͠Α͏ όοΫΞοϓ ಥવୀ৬ऀ͕ग़ͨΒ Ͳ͏͠Α͏ υΩϡϝϯςʔγϣϯ φϨοδγΣΞ -
ΞʔΩςΫνϟઃܭ SRE ͷ߹ Ϛωʔδϟͷ߹ αʔϏεͷׂɾΛઃܭ͢Δ ݸਓɾνʔϜͷׂΛઃܭ͢Δ ظ ݸਓ/νʔϜඪ ظ SLO
ΠϯλʔϑΣʔε API ΠϯλʔϑΣʔε “Team API”* *શνʔϜʹରͯ͠ɺϝϯγϣϯάϧʔϓ໊ɺ ׂɺɺίϛϡχέʔγϣϯํ๏Λ Spreadsheet Ͱཧ͠ɺʹ1ߋ৽ * Team Topologies ΑΓ https://pub.jmam.co.jp/book/b593881.html -
ΞʔΩςΫνϟઃܭ SRE ͷ߹ Ϛωʔδϟͷ߹ αʔϏεͷׂɾΛઃܭ͢Δ ݸਓɾνʔϜͷׂΛઃܭ͢Δ ظ ݸਓ/νʔϜඪ ظ SLO
ΠϯλʔϑΣʔε API ΠϯλʔϑΣʔε “Team API”* *શνʔϜʹରͯ͠ɺϝϯγϣϯάϧʔϓ໊ɺ ׂɺɺίϛϡχέʔγϣϯํ๏Λ Spreadsheet Ͱཧ͠ɺʹ1ߋ৽ * Team Topologies ΑΓ https://pub.jmam.co.jp/book/b593881.html ✋ ΞʔΩςΫνϟઃܭʹτϨʔυΦϑ͕ଘ ࡏ͠·͕͢ɺϚωδϝϯτͷ߹τϨʔυ Φϑଘࡏ͠·͔͢ʁ 😃 Yes ৗʹϝϦοτͱσϝϦοτΛఆ͠·͢ɻ e.g. νʔϜΛখׂ͘͢͞ΕɺඪγϯϓϧʹͳΓɺ ೝෛՙݮ͞ΕΔ͕ɺۀྔͷʹΑͬͯՋͳ࣌ظ͕ ൃੜ͢Δ͔ جຊͷఆٛͱɺྫ֎࣌ʹͲ͏͢Δ͔Λఆٛ͠ɺ ྫ֎ൃੜ͕͘ͳΔΑ͏ʹ͢Δͷ͕ॏཁ -
ϚωδϝϯτͱSREͷൺֱ • Ϛωδϝϯτ৫ͷظΛຬͨͨ͢Ίʹௐ͢Δ • ର৫ • SRE γεςϜͷظΛຬͨͨ͢Ίʹௐ͢Δ • ର৫ͱγεςϜ
• ظௐͱɺͦͷظͷίϯτϩʔϧ͕ڞ௨͍ͯ͠Δ • ͔͢͠Ͱʹ৫ʹ͖߹͖͍ͬͯͯΔ! • ͳΜ͔ͩΕΔؾ͕͖ͯ͠·͔ͨ͠…? -
SRE ͱϚωδϝϯτͷ࠷େͷҧ͍ • ର͕ਓͰ͋Δ͜ͱ • ಉ͡ਓؒ୭Ұਓ͍ͳ͍ • ظௐΞϥʔτରԠಉ͡ํ๏௨͡ͳ͍ • ʮରʯ͠ɺʮཧղʯ͢Δ͜ͱ͕ॏཁ
• ͦͷͨΊͷεΩϧޙఱతʹशಘՄೳ • ௌɺݴޠԽɺϑΟʔυόοΫɺϑΝγϦςʔγϣϯ etc • ͱ͍͑ɺ͍͖ͳΓΔͷ͍͠ͷͰஈ֊తʹ܇࿅ΛੵΉͷΛ͓͢͢Ί -
·ͱΊ • 💡SRE ͱϚωδϝϯτظௐͷͰڞ௨͍ͯ͠Δ • ϚωδϝϯτΛҰ෦͢Ͱʹ͍ͬͯΔͱݴ͑Δ • ͢Ͱʹ৫ʹ͖߹͍ͬͯΔ༗རͰ͋Δͱݴ͑Δ • 🤔͔͠͠ɺʢϐʔϓϧʣϚωδϝϯτγεςϜͷΑ͏ʹ୯Ұతͳํ๏Ͱ
ରॲ͢Δ͜ͱ͍͠ • ਓ͍ؒͬͯ͠…! • ͔͠͠ɺͦͷͨΊͷௌɺݴޠԽͳͲͷεΩϧޙఱతʹशಘՄೳ • 🤝Ϛωδϝϯτʹڵຯ͕͋Δਓઓͯ͠ཉ͍͠ͱࢥ͍·͢ • શྗͰԠԉ͠·͢ʂ -
💡 ໌͔ΒͰ͖Δώϯτ • ϚωʔδϟΛͬͯΈ͍ͨਓ • ࣗͷ্ʹʮڵຯ͕͋Δʯ͜ͱΛ͑ͯΈΑ͏ • ਓνʔϜʹରͯ͠ʮظΛௐ͢Δʯ࿅शΛͬͯΈΑ͏ • ࣗͷಇ͖ํͷظΛνʔϜϝϯόʔϚωʔδϟʹฉ͍ͯΈΑ͏
• ࠓϚωʔδϟΛ͍ͬͯΔਓ͚ͷώϯτ • ϝϯόʔʹରͯ͠ࣄͷظΛձͯ͠ΈΑ͏ • ϝϯόʔʹରͯ͠ϚωʔδϟͷظΛձͯ͠ΈΑ͏ • ࣗͷνʔϜͷظΛྡͷνʔϜ্ʹ͋ΒͨΊͯฉ͍ͯΈΑ͏ -
͓·͚ɿϚωδϝϯτͷָ͠͞ɺΓ͕͍ • 💪 ࡋྔ͕͋Δ͜ͱͰɺΑΓେ͖ͳՌΛ৫ʹىͤ͜Δ • 💬 ݟΔൣғ͕૿͑ɺΑΓଟ༷ͳਓͱ͢ػձ͕ଟָ͍͘͠ • 💥 ༷ʑͳ͕ى͖ΔͷͰɺػձ͕ଟ͍
• ଓ͖ Ask the Speaker Ͱ! 😄 -
Thank you! chaspy Director of Engineering StudySapuri K12 at Recruit
Co., Ltd. 😄 ୭͔1ਓͷΩϟϦΞͷબࢶΛ࡞ΕͨΒخ͍͠ 🗣 Ask the Speaker Ͱ͠·͠ΐ͏ʂ Takeshi Kondo https://chaspy.me chaspy_