2023/05/29開催「JAWS-UG SRE支部 #6」での発表資料です。
LHPUP าͷςοΫ$MPVE8BUDIෳ߹ΞϥʔϜͰ&-#ͷ99Λ͍͍ײ͡ʹݕ͠Α͏ͱͨ͠Β͏·͍͔͘ͳ͔ͬͨ+"846(43&ࢧ෦
View Slide
ࣗݾհ LHPUPw ςοΫϦʔυɾϥʔϝϯ͖w "84$PNNVOJUZ#VJMEFS %FW5PPMTw าͷςοΫ ٕज़ϒϩάw ࣗ࡞"84ؔ࿈πʔϧͷ044։ൃw 5XJUUFS!@TUFQ@UFDI‣ LHPUP าͷςοΫ
$MPVE8BUDIෳ߹ΞϥʔϜͰ
&-#ͷ99Λ
͍͍ײ͡ʹݕ͠Α͏ͱͨ͠Β
͏·͍͔͘ͳ͔ͬͨ
͍͍ײ͡ʁw &-# "-#ͷΤϥʔ௨ $MPVE8BUDI"MBSN‣ )551$PEF@&-#@ccc@$PVOU εςʔλε͝ͱʹ௨͍ͨ͠‣ )551$PEF@&-#@99@$PVOU cccͷ߹99௨͠ͳ͍㾎ॏෳ௨Λഉআ͍ͨ͠ ʮ99དྷͯ͠·͏ʯͷΛආ͚Δ cccҎ֎ͷΤϥʔ͚ͩ99Ͱ௨͢Δ㾎 ͳͲͷͱ͖͚ͩ௨͢Δw ͦΜͳͷΛʰ$MPVE8BUDIෳ߹ΞϥʔϜʱͰ࡞ͬͯΈͨ
$MPVE8BUDIෳ߹ΞϥʔϜͱʁ
$MPVE8BUDIෳ߹ΞϥʔϜw ଞͷෳͷΞϥʔϜͷঢ়ଶΛͱʹw ࣜͰಈతʹஅͰ͖ΔΞϥʔϜ(ALARM("CPUUtilizationTooHigh") ORALARM("DiskReadOpsTooHigh")) ANDOK("NetworkOutTooHigh")$166UJMJ[BUJPO5PP)JHI͕ΞϥʔϜঢ়ଶ·ͨ%JTL3FBE0QT5PP)JHI͕ΞϥʔϜঢ়ଶ"/% /FUXPSL0VU5PP)JHI͕ਖ਼ৗঢ়ଶΞϥʔϜঢ়ଶ
ͬͯΈͨ
ͬͯΈͨෳ߹ΞϥʔϜ 99ΘΓͳͲͰൃՐͤ͞Δ༻
ͬͯΈͨYY͕ΞϥʔϜঢ়ଶ "/%͕ΞϥʔϜঢ়ଶ·͕ͨΞϥʔϜঢ়ଶ/05˞ ͕ͳ͍ͷݕূ্ͷཧ༝Ͱͩ͢ͱΞϥʔϜͩͱਖ਼ৗ
ͬͯΈͨΞϥʔϜ ͳͲಉ༷ʹ࡞
ͬͯΈͨ99ΞϥʔϜ࣮ࡍͷൃՐෳ߹ΞϥʔϜͷํͰߦ͏ͷͰͪ͜ΒΞΫγϣϯແޮʹͨͩͷΞϥʔϜࡐྉͱͯ͠࡞
ΤϥʔΛग़ͯ͠Έͨ
௨͕དྷͨʂ
ෳ߹ΞϥʔϜͷํ͕དྷͨʂ
ͭ·Γʮ Ͱͳ͍99ʯͷํ
ͭ·Γɺͱ͔ʂ
ͰͰͰͰͳ͍εςʔλεͳΜͯͦΜͳ؆୯ʹى͜Δ͔ɾɾɾʁ
ͦͷ͞Βʹඵޙ͏݅௨͕ɾɾɾ
ঢ়گΛཧͯ͠Έͨw ෳ߹ΞϥʔϜ͕དྷͨ‣ Ͱͳ͍99ͷͱ͖ʹ௨ ͢Δͣ‣ ͷͱ͖ɺ͜ͷΞϥʔϜൃՐ͠ͳ͍ ͔֬ʹͦͷ࣌ൃՐͤͣ99ͷΈൃՐ͍ͯͨͣ͠‣ ͭ·Γͱ͔͕ൃੜͨ͠ʁw ͦͷඵޙʹɺΤϥʔ͕དྷͨ‣ Ͱ͖ͬ͞ෳ߹ΞϥʔϜ͕དྷͨͬͯ͜ͱɺͰͳ͍ͣɾɾɾ
ঢ়گΛཧͯ͠Έͨw $MPVE8BUDIϝτϦΫεΛݟͯΈͨ‣ )551$PEF@&-#@99@$PVOU ݅‣ )551$PEF@&-#@@$PVOU ݅ͳͲͷɺͦͷଞͷΤϥʔى͖͍ͯ·ͤΜͰͨ͠ɻ
ঢ়گΛཧͯ͠Έͨw Τϥʔ͕݅ൃੜʢҙਤతʹʣw 99ΘΓͷෳ߹ΞϥʔϜ͕݅௨‣ Ͱͳ͍99ͷͱ͖ʹ௨ ͢Δͣw ඵޙ)551$PEF@&-#@͕݅௨݅ͷΤϥʔʹରͯ͠ෳ߹ΞϥʔϜΞϥʔϜ྆ํ௨͕དྷͨॏෳ௨͞Εͯ͠·ͬͨ
͏·͍͔͘ͳ͔ͬͨ
Α͘ݟͯΈͨ
Α͘ݟͯΈͨw )551$PEF@&-#@99@$PVOU‣ ൃੜ ঢ়ଶͷߋ৽࣌ࠁɿw )551$PEF@&-#@@$PVOU‣ ൃੜ ঢ়ଶͷߋ৽࣌ࠁɿ99͕ઌʹൃՐ͠ɺͦͷޙ͕ൃՐͨ͠ෳ߹ΞϥʔϜͷλΠϛϯάͰ͔֬ʹ99͔͠ൃՐ͍ͯ͠ͳ͍ൃՐ͍ͯ͠ͳ͍ࣜ௨Γͷڍಈʹͳ͍ͬͯΔ
99͕ઌʹൃՐͯͦ͠ͷޙ۩εςʔλε͕ൃՐ͢Δͷ͔ɾɾɾʁ
೦ͷͨΊڥΛ࡞Γͯ͠࠶࣮ߦͯ͠Έͨ
ࠓ99ΑΓઌʹ͕ൃՐͨ͠
ൃՐλΠϛϯά ඵຖճಉͩͬͨ͡
ൃՐධՁλΠϛϯάΞϥʔϜΛ࡞ͨ͠λΠϛϯά ࣌ࠁʹΑΔʁ
ඵҧ͏ɾɾɾ
ԿʹͤΑධՁλΠϛϯάຖಉ͡ඵ
ΞϥʔϜͷධՁλΠϛϯάͷલޙͲͪΒͰΤϥʔ͕ൃੜ͢Δ͔࣍ୈͰॱ൪͕มΘΔT TT T99ධՁ ධՁ͜͜ͰΤϥʔ͕ى͖ͨΒ͕ઌʹൃՐ͜͜ͰΤϥʔ͕ى͖ͨΒ99͕ઌʹൃՐ
ΤϥʔͷൃੜλΠϛϯάͰΞϥʔϜൃՐॱ൪͕มΘΔͷࠔΔ
͜ΕͰऴΘΓ͔ʁ
͍
·ͩΕΔ
αϓϨοαʔΞϥʔϜ
αϓϨοαʔΞϥʔϜIUUQTEPDTBXTBNB[PODPNKB@KQ"NB[PO$MPVE8BUDIMBUFTUNPOJUPSJOH$SFBUF@$PNQPTJUF@"MBSNIUNM
αϓϨοαʔΞϥʔϜ࣮ߦ͢·͢
αϓϨοαʔΞϥʔϜw બͨ͠ΞϥʔϜ͕ΞϥʔϜঢ়ଶʹͳΔͱෳ߹ΞϥʔϜͷΞΫγϣϯ͕ແޮʹͳΔ‣ αϓϨοαʔΞϥʔϜͷൃՐΛࢦఆඵͪɺෳ߹ΞϥʔϜͷൃՐΛԆɾ੍w αϓϨοαʔΞϥʔϜ͔ͭ͠બͳ͍‣ Λશ෦બͳ͍ͱࠓճͷతୡͰ͖ͳ͍ ͜ΕΒ͕ൃՐ͢Δ͔Ͳ͏͔͔ͬͯΒෳ߹ΞϥʔϜΛධՁ͍ͤͨ͞ ࣌ؒࠩ͠ͰൃՐ͢ΔͳΒෳ߹ΞϥʔϜͷൃՐΛࢭΊ͍ͨ‣ ͷෳ߹ΞϥʔϜΛ࡞ͯ͠ɺͦΕΛબ͢Εྑ͍ UFTUHPUPFMCTVQQSFTTJPO ෳ߹ΞϥʔϜɹɹl"-"3. UFTUHPUPFMC03"-"3. lUFTUHPUPFMC03ʜz
ͬͯΈͨɿαϓϨοαʔΞϥʔϜUFTUHPUPFMC99UFTUHPUPFMCUFTUHPUPFMCTVQQSFTTJPO࠷ॳͷݕূ࣌ͱಉ͘͡ΤϥʔΛൃੜͤͨ͞Β99͕ઌʹൃՐͨ͠ͱෳ߹ͷॏෳൃՐࣦͨ͠ഊύλʔϯ௨Γ
͢Δͱɾɾɾ
ෳ߹ΞϥʔϜ ࣮࣭99ൃՐ ௨ͤͣ
͚ͩ௨͕དྷͨʂʂʂ
ॏෳഉআޭʂ
ͬͯΈͨɿαϓϨοαʔΞϥʔϜ99ൃՐʹΑΓҰ࣌తʹΞϥʔϜঢ়ଶʹͳ͍ͬͯΔ͕ؒ 8BJU1FSJPEΞΫγϣϯ੍͕͞ΕΔͦͷޙൃՐʹΑͬͯ0,ঢ়ଶʹͬͨʢ͕ൃՐ͠ͳ͚ΕΞΫγϣϯ͕ى͜Δͣʁʣ
ҙw ࣮ࡍʹͳͲͷΤϥʔ Ҏ֎Λൃੜͤ͞ΔݕূΛ͍ͯ͠ͳ͍ͷͰɺͩͱͪΌΜͱෳ߹ΞϥʔϜ͕ൃՐ͢Δ͔Ͳ͏͔ͷ֬ೝ͍ͯ͠·ͤΜ‣ μϝͩͬͨΒ͍͢·ͤΜɾɾɾ
ҙw ࠓճͷख๏Ͱɺ͏·͍ͬͨ͘ʢఆ௨Γͷڍಈʹͳͬͨʣͱͯ͠ɺ ͱͦΕҎ֎ͷ99Τϥʔ͕ಉ࣌ʢಉධՁظؒʣʹൃੜͨ͠߹ɺෳ߹ΞϥʔϜ ࣮࣭99ϝτϦΫεͷํͷ௨͕དྷ·ͤΜɻ‣ ྫ͑ͱ͕ಉ࣌ʹى͖ͨͱ͖ɺʢ۩ʣͷ௨͚ͩདྷΔw ͦΕ࣮ࡍʹΤϥʔ͕ى͖ͨ࣌݁ہ"84ίϯιʔϧͷάϥϑΛݟʹߦ͘ͱࢥ͏ͷͰͦΕͰผ͢Ε͍͍͔ͳͱ͍͏ํͰɺؤுΒͳ͍͜ͱʹ͠·ͨ͠ɻ
ࢀߟɿϒϩάهࣄ าͷςοΫw $MPVE8BUDIෳ߹ΞϥʔϜͰ&-#ͷ99Λ͍͍ײ͡ʹݕ͠Α͏ͱͨ͠Β͏·͍͔͘ͳ͔ͬͨ‣ IUUQTHPUPLIBUFOBCMPHDPNFOUSZ
એɿࣗ࡞"84ؔ࿈πʔϧ044w EFMTUBDL"84$MPVE'PSNBUJPOελοΫڧ੍আπʔϧ‣ IUUQTHPUPLIBUFOBCMPHDPNFOUSZEFMTUBDLw DMT4όέοτߴআɾۭʹ͢Δπʔϧ όʔδϣχϯάରԠ‣ IUUQTHPUPLIBUFOBCMPHDPNFOUSZDMTw MBNWFS-BNCEBϥϯλΠϜόʔδϣϯݕࡧπʔϧ Ϧʔδϣϯԣஅ‣ IUUQTHPUPLIBUFOBCMPHDPNFOUSZMBNWFS
એɿొஃw d"84%FW%BZ5PLZP ࿈ଓ‣ ʰ"84$%,ͰֶͿ(P'σβΠϯύλʔϯʙ*B$ʹίʔυઃܭʙʱ
5IBOL:PVLHPUP าͷςοΫ