Share
Embed
All for One なポストモーテム運用と工夫
Kuu
February 09, 2023
Transcript
20 slides
-
2 •αʔϏε։࢝ɿ20137݄ •ରԠOSɿAndroidɺiOS ※Webϒϥβ͔Βར༻Մೳ •ར༻ྉɿແྉ ※ചΕͨͱ͖ͷखྉɿൢചՁ֨ͷ10% •ରԠҬɾݴޠɿຊɾຊޠجຊ༷ •ྦྷܭग़ɿ30ԯΛಥഁ (202211݄) ͦΕΛඞཁͱ͢ΔਓͷखʹΓɺ༻͞ΕΔ͜ͱʹتͼΛײ
͡ɺ·ͨߪೖऀɺଟ࠼͔ͭϢχʔΫͳͷத͔Βʮๅ୳ ͠ʯײ֮Ͱ۷Γग़͠Λݟ͚ͭΔങ͍ମݧΛָ͠ΜͰ͍· ͢ɻ͞ΒʹʮϝϧΧϦʯͰɺͷചങ͚ͩͰͳ͘ɺग़ ऀɾߪೖऀؒͷνϟοτʮ͍͍ͶʂʯػೳΛ௨ͯ͡ɺ͓٬͞ ·ؒͷίϛϡχέʔγϣϯ׆ൃʹߦΘΕ͍ͯ·͢ɻ ϑϦϚΞϓϦʮϝϧΧϦʯɺݸਓ͕؆୯ʹෆཁͷചങΛߦ͑ΔCtoC ϚʔέοτϓϨΠεͰ͢ɻग़ऀɾߪೖऀํ͕ɺ҆શɾ҆৺ͳऔҾΛ ָ͠ΜͰ͍͚ͨͩΔαʔϏεΛࢦ͠ɺʮϝϧΧϦʯ͕Ұ࣌తʹߪೖ ۚΛ༬͔ΔΤεΫϩʔܾࡁΛ׆༻ͨ͠औҾڥͷඋɺ؆୯͔ͭखࠒ ͳՁ֨ͷૹΦϓγϣϯɺࠩผԽ͞ΕͨϢχʔΫͳ͓٬͞·ମݧΛఏڙ ͍ͯ͠·͢ɻଟ͘ͷग़ऀɺࣗʹͱͬͯඞཁͰͳ͘ͳͬͨϞϊ͕ɺ 2 ϝϧΧϦͱ -
3 3 1. FY2022.6͔ΒCtoCͱBtoCΛ߹ࢉ͠Ḫٴ։ࣔ 2. 1͔݄ʹ1ճҎ্ΞϓϦຢWEBαΠτΛϒϥδϯάͨ͠ొϢʔβͷ࢛ظฏۉͷ ར༻࣮ਪҠʢMarketplaceʣ YoY +5% YoY
+10% ԯԁ ສਓ ʻGMV1 /MAU2 ͷਪҠʼ ୯Ґɿԯԁ ୯Ґɿສਓ 2 1 -
5 • Kuu @ גࣜձࣾϝϧΧϦ • Software Engineer ◦ ϝϧΧϦͷAndroid൛Λ։ൃ͍ͯ͠Δ
• झຯ ◦ Ϟϯελʔϋϯλʔϫʔϧυ ◦ εΩʔ⛷ & εΩϡʔόμΠϏϯά 🤿 ◦ ேࢄาͨ͠Γɺඒຯ͍͠ͷΛௐཧɾ৯ͨΓ ࣗݾհ - Kuu -
6 • 2017͝Ζ͔Βӡ༻͍ͯ͠Δ • SRE͚ͩͰͳ͘ɺ৬छΛΘͣӡ༻͍ͯ͠Δ ◦ All for One ͳϙετϞʔςϜӡ༻
• ӡ༻ͷྲྀΕ ◦ ΠϯγσϯτൃੜɾରԠ ◦ νʔϜͰϨτϩεϖΫςΟϒɾϙετϞʔςϜͷ࡞ ◦ Incident management committee͕ϨϏϡʔɾϙετϞʔςϜͷެ։ ϝϧΧϦͰͷϙετϞʔςϜӡ༻ͷશମ૾ -
7 • 2017͝Ζ͔Βӡ༻͍ͯ͠Δ ◦ 2018࣌ͷӡ༻ঢ়گͷϒϩάهࣄ ◦ େࣄͳͱ͜ΖมΘ͍ͬͯͳ͍ ▪ िʹ11࣌ؒ ▪
Slack্ͰΦϯϥΠϯ։࠵ ▪ ࢀՃऀҙʢձΛ͏͚ͩͷࢀՃՄ) ▪ ਐߦෳਓͰ࣋ͪճΔ • ৫نͷ֦େɺঢ়گʹ߹ΘͤͯਐԽ͠ଓ͚͍ͯΔ ◦ SlackίϚϯυɾBotͷಋೖ ◦ Blameless ͷӡ༻ • ΑΓྑ͍ӡ༻ͷͨΊʹɺʑվળத ◦ ϙετϞʔςϜςϯϓϨʔτͷվળ ◦ ΦϯϘʔσΟϯάͷվળ ϙετϞʔςϜӡ༻ͷྺ࢙ -
8 • ͓٬༷ʹӨڹΛ༩͑Δ༧ظͤ͵αʔϏεͷதஅ࣭ͷԼ ◦ ͜ΕΒΛΠϯγσϯτͱͯ͠ѻ͍ͬͯΔ • ։ൃνʔϜɾSREνʔϜʑɺ෯͘ϙετϞʔςϜΛӡ༻͍ͯ͠Δ • ΑΓଟ͘ͷਓ͕ϙετϞʔςϜ࡞Ͱ͖ΔͨΊʹ ◦
ٕࣾज़ݚम͚ʹֶशίϯςϯπ࡞ ◦ ϙετϞʔςϜ ϨϏϡʔͰͷϑΟʔυόοΫ • ϝϧΧϦͷEngineering Ladderʹؚ·Ε͍ͯΔ ◦ ΤϯδχΞʹظ͞ΕΔߦಈΛ໌จԽͨ͠ͷ SRE͚ͩͰͳ͘ɺ৬छΛΘͣӡ༻͍ͯ͠Δ -
10 • Πϯγσϯτ͕ൃੜ͢ΔཁҼ༷ʑ ◦ Ξϥʔτ্͕͕͖ͬͯͨ ◦ ͓٬༷͔Βͷ͓͍߹Θͤ ◦ ։ൃνʔϜ͕ιϑτΣΞͷόάΛൃݟ •
ٙΘ͖͠ࣄ͕ൃੜͨ͠ࡍΤεΧϨʔγϣϯ ◦ SlackίϚϯυΛར༻͔ͯ͠ʹ։࢝Ͱ͖Δ ϙετϞʔςϜӡ༻ͷྲྀΕ - ΤεΧϨʔγϣϯ -
12 • ςϯϓϨʔτΛ׆༻ͯ͠ɺৼΓฦΓΛߦ͏ ◦ ۩ମతͳ༰ޙड़͠·͢ • େࣄʹ͍ͯ͠Δ͜ͱ ◦ ૬खΛඇͤͣݐઃతͳٞΛߦ͏ ◦
Πϯγσϯτ͔ΒֶͿ ◦ ߃ٱରԠɺ࠶ൃࢭΛߦ͍ΠϯγσϯτΛ܁Γฦ͞ͳ͍ ϙετϞʔςϜӡ༻ͷྲྀΕ - ϨτϩεϖΫςΟϒ -
13 • ϨτϩεϖΫςΟϒͰग़͖ͯͨվળҊΛ࣮ߦ͢Δ ◦ νέοτԽ࣮ͯ֬͠ʹߦ͑ΔΑ͏ʹ͢Δ • Incident Management Committee ◦
ΠϯγσϯτϚωδϝϯτͷվળΛతͱͨࣾ͠ҕһձ ◦ దʹӡ༻Ͱ͖͍ͯΔͷ͔ɺϨϏϡʔͱϑΟʔυόοΫΛߦ͍ͬͯΔ ϙετϞʔςϜӡ༻ͷྲྀΕ - ߃ٱରԠɾ࠶ൃࢭࡦͷ࣮ࢪ -
14 ϙετϞʔςϜͷ߲հ Overview Analysis Πϯγσϯτͷ֓ཁ ͲͷΑ͏ͳ༰͔Λཁͯ͠ॻ͘ ΠϯγσϯτͷݪҼ ͷࠜຊݪҼΛ୳ΔͨΊɺෳճਂ۷Γͯ͠ॻ͘ Follow up
action νέοτԽͯ͠ɺ࣮֬ʹ࣮ߦͰ͖ΔΑ͏ʹ͢Δ ൃੜ࣌ࠁ ݕ࣌ࠁ MTTA: Mean Time To Acknowledgeͷࢉग़ʹ͏ ղܾ࣌ࠁ MTTR : Mean Time To Resolveͷࢉग़ʹ͏ -
16 • ࠓ݄ͷϙετϞʔςϜ ◦ All hands(ࣾһ͕ू·ΔΠϕϯτ)ʹͯϙετϞʔςϜͷ౷ܭɾࣄྫհΛߦ͍ͬͯΔ • ϫʔΫϑϩʔʹམͱ͠ࠐΉ ◦ BlamelessSlackΛ׆༻ͯ͠ɺ׳Εͯͳ͍ਓͰӡ༻͍͢͠Α͏ʹ
• ڭҭ ◦ DevDojo(ٕࣾज़ݚम)Ͱͷڭҭˍެ։ͯ͠ΔΑ ◦ https://engineering.mercari.com/blog/entry/20221223-showcasing-devdojo-a-series-of- mercari-developed-learning-content-for-engineering/ ◦ αϯυϘοΫεڥͷඋ ϙετϞʔςϜจԽͷಋೖ -
17 • ੩తղੳπʔϧΛಋೖ͠ɺCI্Ͱ࣮ߦ͢Δ • ϞχλϦϯάڥͷඋɾՃ • ΦʔτεέʔϧͷઃఆΛߦ͏ɾᮢΛ࠷దԽ͢Δ • UI/Unit test/QAͷέʔεՃ
Πϯγσϯτݕ࣌ؒɾղܾ࣌ؒΛվળ͢Δํ๏ྫ