Share
Embed
レガシーシステムの監視運用を楽にするためにやってきたこと @ JAWS-UG Sapporo
SimSta
December 15, 2023
Transcript
61 slides
-
ࣗݾհʢΦϯϥΠϯରԠύʔτʣ חͷిػάϧʔϓͰӉػͷ੍ޚܥઃܭͱௐୡʢʣ ˠࡳຈʹҠॅɺ4&4ͰΫϥυͪΐͬͱ৮Δʢʣ ˠ"1/اۀͰΫϥυͷߏஙͱӡ༻ʢͱϲ݄ʣ ˠৗறઌͷΫϥυج൫ߏஙɾӡ༻ɾҠߦʢݱ৬ɺͦΖͦΖʣ 4JN4UBʢΦϯϥΠϯͷ͕ͨ͢ʣ !TIJNBHBKJ 5XJUUFS "84ೝఆˠ ͖ͳ"84αʔϏεɿ4UFQ'VODUJPOT
ಘҙʹͳΓ͍ͨ"84αʔϏεɿ4BHF.BLFS #FESPDL "QQ3VOOFS $%, "NQMJGZ -
"HFOEB • ͡ΊʹɿϨΨγʔΛҠߦ͠·ͨ͠ • ̏ͭͷࣗಈԽ • ࣗಈ࠶ىಈ • ࣗಈϦετΞ •
ࣗಈίʔϧ • ·ͱΊɿ͍Ζ͍ΖࣗಈԽ͖͚ͬͯͨΕͲʜ -
ϨΨγʔΛҠߦ͠·ͨ͠ Web ʢEC2ʣ Application Migration Service (MGN) サポートがギリギリなOS なんとか⽣きているミドルウェア 1台に複数のWordPressが同居
もちろんオールインワンな単体系 別々の制作会社、別々の管理者 STGが同居してたりしてなかったり 所々に乱雑に置かれたoldやbk 秘伝のタレみたいなhttpd.conf リダイレクト迷路な.htaccess GoTo⽂より迷うシンボリックリンク ͱΓ͋͑ͣ ظݶ·ͰʹҠߦ͍ͨ͠ͷͰ શ෦ͦͷ·· ϦϑτΞϯυγϑτͰ ࣋ͬͯ͘ΕϤγʂ 8FC -
ϨΨγʔΛҠߦ͠·ͨ͠ OHJOYϓϩΩγ ϞϊϦεͳ8FCαʔόͨͪ Application Load Balancer NAT gateway Web
Web Web Web Bastion CloudFront WAF ओཁαʔϏεͷΈਤࣔɺ"-#ڞ༗ɺ࣮ࡍ8FC 04͝ͱϞϊϦεͳ7.Λͦͷ··.(/ͰҠߦ Application Migration Service (MGN) ϧʔςΟϯά *1੍ݶ #BTJDೝূ -
ӡ༻Λָʹ͍ͨ͠ʂ ͦ͏͍͑ʜ ɾࢹӡ༻αʔϏεΛఏڙ͢Δձࣾʹ͍ͨ ɾϝΠϯߏங͚ͩͬͨͲҰ෦ӡ༻ͨ͠ ɾࢥ͑༗ਓରԠ͔ͬͰඇޮͩͬͨ ɾ͏ͪΐָ͍ʹࢹӡ༻Ͱ͖Εͳ͊ લ৬ͷهԱ Πϯϑϥͷӡ༻୲͕ΦϯϓϨͷϕϯμ͔Β ෦ʢ͓٬༷ͱฐࣾͳͲ#1ʣʹҠΔͷͰɺ ͳΔ͘εϚʔτʹӡ༻Ͱ͖ΔΑ͏ʹ͍ͨ͠
ྫ͑"NB[PO$POOFDUͷ൪߸Λͬͯ ٳؒʹࣗಈͰίʔϧͱ͔Ͱ͖ͳ͍ʁ ʢ۩ମతʹͲ͏͢Δ͔ΒΜ͚Ͳʣ 5-͔ΒͷΦʔμʔ ࣗಈԽͰ͖Δ෦ͯ͠͠·͓͏ʂ Ϟνϕʔγϣϯ ҰԠࣗಈίʔϧ࣮ݱͰ͖ͦ͏͔ͩΒͬͯΈΔ ͍ͭͰʹඇޮͲΜͲΜݮָ͍ͯͨ͠͠ -
̏ͭͷࣗಈԽ ࣗಈ࠶ىಈ ϓϩηεͷҟৗΛݕˠϓϩηεͷ࠶ىಈίϚϯυΛૹ৴ ϓϩηε࠶ىಈͰվળ͠ͳ͍·ͨΠϯελϯεͷҟৗΛݕ ˠΠϯελϯεͷ࠶ىಈίϚϯυΛૹ৴ ࣗಈϦετΞ ࣍όοΫΞοϓͰऔಘͨ͠".*ͷ*%ΛύϥϝʔλετΞʹอ ࠶ىಈͰ෮چ͠ͳ͔ͬͨΠϯελϯεΛผ";Ͱ෮ݩ 350ɿఔɺ310ɿҎ ࣗಈίʔϧ
ࣗಈ࠶ىಈϦετΞμϝͰɺ͔ͭӦۀ࣌ؒ֎ͷͱ͖ʹൃಈ ୲ऀͷి൪߸ʹࣗಈͰίʔϧ Ԡ͕ແ͚Ε࣍ͷਓʹίʔϧΛ࠷ޙͷਓ·Ͱ܁Γฦ͢ -
ࣗಈ࠶ىಈɹߏਤ Application Load Balancer NAT gateway Lambda EventBridge CloudTrail
CloudWatch Systems Manager Run Command EC2 Instance ࢹ SNS ୲ऀ ϓϩηε࠶ىಈ Πϯελϯε࠶ىಈ ΞϥʔϜ ௨ ΞϥʔϜ Πϕϯτ ݕ ىಈ ݺͼग़͠ ࣮ߦ -
ࣗಈ࠶ىಈɹॲཧ֓ཁ ᶃ $MPVE8BUDI͕ϓϩηεͷҟৗʢ"HFOUܦ༝ʣ ΠϯελϯεͷҟৗΛݕ͠ɺΞϥʔϜൃใ ᶄ $MPVE5SBJM͕"-"3.ͷঢ়ଶมԽΛه ᶅ
&WFOU#SJEHF͕ঢ়ଶมԽΠϕϯτΛݕͯ͠ -BNCEBΛୟ͘ ᶆ -BNCEB͕4ZTUFNT.BOBHFSυΩϡϝϯτͷ 3VO$PNNBOEΛݺͼग़͢ ᶇ B 3VO$PNNBOEʹΑͬͯ&$Πϯελϯεʹ ɹϓϩηε࠶ىಈίϚϯυ͕ૹ৴͞ΕΔ C 3VO$PNNBOEʹΑͬͯ&$Πϯελϯεͷ ɹ࠶ىಈ͕࣮ߦ͞ΕΔ ᶃ ᶄ ᶅ ᶆ ᶇ -
ࣗಈ࠶ىಈɹͨۤ͠࿑ͨ͠ϙΠϯτ &WFOU#SJEHFͷݕͱύϥϝʔλ͠ͷํ๏ $MPVE8BUDIͷΞϥʔϜΠϕϯτ͔Β&WFOU#SJEHFʹ࿈ܞͰ͖ͦ͏ͳ߲ "MBSN/BNFͱ"MBSN%FTDSJQUJPOͷͭ Ұํɺ࠶ىಈΛߦ͏ͨΊʹඞཁͳύϥϝʔλ ʮΠϯελϯε*%ʯͱʮϓϩηε໊ʯͷͭ Πϯελϯεҟৗͷ߹ͭ ͕ͨͬͯ͠ɺ"MBSN/BNFͷඌࣙ 4VGGJY
ͱ&WFOU#SJEHFϧʔϧΛରԠͤ͞ɺ "MBSN%FTDSJQUJPOʹΠϯελϯε*%ΛೖΕΔܗͰΞϥʔϜΛ࡞ ΰϦԡ͠ &WFOU#SJEHFϧʔϧ -BNCEB 999IUUQESFTUBSU 999DXBHFOUSFTUBSU 999NZTRMESFTUBSU 999SFCPPU J "MBSN/BNF "MBSN%FTDSJQUJPO ϓϩηε໊ Πϯελϯε*% -
ࣗಈ࠶ىಈɹͨۤ͠࿑ͨ͠ϙΠϯτ &WFOU#SJEHFͷݕͱύϥϝʔλ͠ͷํ๏ $MPVE8BUDIͷΞϥʔϜΠϕϯτ͔Β&WFOU#SJEHFʹ࿈ܞͰ͖ͦ͏ͳ߲ "MBSN/BNFͱ"MBSN%FTDSJQUJPOͷͭ Ұํɺ࠶ىಈΛߦ͏ͨΊʹඞཁͳύϥϝʔλ ʮΠϯελϯε*%ʯͱʮϓϩηε໊ʯͷͭ Πϯελϯεҟৗͷ߹ͭ ͕ͨͬͯ͠ɺ"MBSN/BNFͷඌࣙ 4VGGJY
ͱ&WFOU#SJEHFϧʔϧΛରԠͤ͞ɺ "MBSN%FTDSJQUJPOʹΠϯελϯε*%ΛೖΕΔܗͰΞϥʔϜΛ࡞ ΰϦԡ͠ &WFOU#SJEHFϧʔϧ -BNCEB 999IUUQESFTUBSU 999DXBHFOUSFTUBSU 999NZTRMESFTUBSU 999SFCPPU J "MBSN/BNF "MBSN%FTDSJQUJPO ϓϩηε໊ Πϯελϯε*% ΞοϓσʔτͰϧʔϧʹϫΠϧυΧʔυʢ ʣ͕ ࢦఆͰ͖ΔΑ͏ʹͳͬͨͷͰ ΞϥʔϜ໊ͷͲ͔͜ʹಛఆϫʔυΛೖΕ͓͚ͯ Θ͟Θ͟1SFGJY͔4VGGJYΛἧ͑ͳͯ͘ &WFOU#SJEHF͕र͑ΔΑ͏ʹͳΓ·ͨ͠ʂ -
ࣗಈϦετΞɹߏਤ Application Load Balancer NAT gateway EventBridge CloudTrail CloudWatch
Copied Instance ࢹ ϦετΞ ΞϥʔϜ Πϕϯτ ݕ ىಈ ىಈ Step Functions DynamoDB Parameter Store AMI Step Functions Backup EventBridge CloudTrail Πϕϯτ ݕ EC2 Instance ࡞ Πϕϯτ ".**% อ ࢀর ࢀর SNS ୲ऀ ௨ ΞϥʔϜ ࢦఆ -
ࣗಈϦετΞॲཧ֓ཁ1IBTF ᶃ #BDLVQ͕εέδϡʔϧʹج͍ͮͯ όοΫΞοϓͱͯ͠".*Λ࡞ ᶄ $MPVE5SBJM͕$SFBUF*NBHFΠϕϯτΛه ᶅ
&WFOU#SJEHF͕ঢ়ଶมԽΠϕϯτΛݕͯ͠ 4UFQ'VODUJPOTΛୟ͘ ᶆ 4UFQ'VODUJPOT͕1BSBNFUFS4UPSFʹ Πϯελϯε*%ͱ".**%ͷϖΞΛอ ᶃ ᶄ ᶅ ᶆ -
ࣗಈϦετΞॲཧ֓ཁ1IBTF ᶇ $MPVE8BUDI͕ɺ࠶ىಈΠϕϯτͰ෮چ͠ͳ͔ͬͨ ΠϯελϯεͷҟৗΛݕ͠ɺΞϥʔϜൃใ ᶈ $MPVE5SBJM͕"-"3.ͷঢ়ଶมԽΛه ᶉ
&WFOU#SJEHF͕ঢ়ଶมԽΠϕϯτΛݕͯ͠ 4UFQ'VODUJPOTΛୟ͘ ᶊ 4UFQ'VODUJPOT͕1BSBNFUFS4UPSFͷ".**%ͱ %ZOBNP%#ͷΠϯελϯεύϥϝʔλΛࢀর ᶋ 4UFQ'VODUJPOT͕όοΫΞοϓͷ".*Λ༻ͯ͠ ΠϯελϯεΛىಈ͠ɺλʔήοτάϧʔϓʹొ ᶇ ᶈ ᶉ ᶊ ᶋ -
ϦετΞΛ࣮ࢪ͢ΔεςʔτϚγϯ Πϯελϯε*%Λड͚औͬͨεςʔτϚγϯ͕ҎԼΛ࣮ߦ ᶃ 1BSBNFUFS4UPSF͔ΒΠϯελϯε*%ʹରԠ͢Δ ࠷৽ͷ".**%Λऔಘ ᶄ %ZOBNP%#ʹอͯ͋͠ΔΠϯελϯε࡞༻ͷ
֤छύϥϝʔλΛऔಘ ᶅ 7PMVNF4J[F͕*OUܕͰͳ͚ΕͳΒͳ͍ͨΊ %ZOBNP%#͔Βͷ/VNCFSܕΛ-BNCEBͰ*OUܕʹม ᶆ औಘͨ͠".**%ͱ֤छύϥϝʔλ͔ΒΠϯελϯεΛ࡞ ᶇ গ͠ͷ࣌ؒػ͠ɺλʔήοτάϧʔϓʹొ ᶃ ᶄ ᶅ ᶆ ᶇ -
ࣗಈϦετΞɹͨۤ͠࿑ͨ͠ϙΠϯτ ύϥϝʔλอʹ͓͚Δ͍͚ w ରͰϢχʔΫʹରԠ͢Δύϥϝʔλͷ1BSBNFUFS4UPSFʹอ Πϯελϯε*%ͱ࠷৽ͷ".**%ͳͲ w ෳͷ,FZ7BMVFΛؚΉσʔλͷҰࣜ%ZOBNP%#ʹอ
֤Πϯελϯεͷ෮ݩʹඞཁͳύϥϝʔλͳͲ 4UFQ'VODUJPOTศར͕ͩɺΑ͘ϋϚΔ w %ZOBNP%#͔ΒऔΓग़ͨ͠/VNCFSܕͷΛͦͷ··*OUܕʹೖྗͰ͖ͳ͍ ˠ4UFQ'VODUJPOTͰॲཧͰ͖ͳ͍ͷͰɺ-BNCEBʹͤΔ w ͍͍ͨͯͷ͜ͱϩʔίʔυͰઃఆͰ͖Δ͕ɺ+40/ͷྻͳͲ ࡉ͔͍෦Ͱ༥௨͕ޮ͔ͣΤϥʔʹͳΔ͜ͱ͕͋Δ ˠ4UFQ'VODUJPOTͰ͏ݴޠʢ"4-ʣ͕ͪΐͬͱʢ͔ͳΓʣཧղʹۤ͠Ή w Ͱ༨ܭͳʢάϧʔίʔυͱͯ͠ͷ4%,ୟ͚ͩ͘ͳʣ-BNCEBͷ ࣮֬ʹݮΒͤΔͷͰ4UFQ'VODUJPOTਆ 74 74 -
ࣗಈίʔϧɹߏਤ Application Load Balancer NAT gateway Lambda CloudWatch EC2
Instance ࢹ SNS ୲ऀ ࢀর ϑϥάߋ৽ ΞϥʔϜ ىಈ ݺͼग़͠ $53৴ SQS Step Functions DynamoDB Amazon Connect Kinesis Data Streams Lambda ݺͼग़͠ ىಈ ࿈ܞ ݺͼग़͠ ࣌ࠁஅ ϝʔϧ௨ ίʔϧ -
ࣗಈίʔϧॲཧ֓ཁ1IBTF ᶃ $MPVE8BUDI͕ಛఆͷΞϥʔϜΛݕ͠ɺ 4/4τϐοΫΛૹ৴ ᶄ 4/4͕424৴͠ɺ424͕݅ͣͭ -BNCEBΛݺͼग़͢ʢಉ࣌ଟൃίʔϧΛ੍ʣ
ᶅ -BNCEB͕Ӧۀ࣌ؒ֎͓Αͼ࿈ଓΛఆ͠ɺ 4UFQ'VODUJPOTΛىಈ͢Δ ʢฏͷӦۀ࣌ؒଳɺOҎʹ࿈ଓͰ ɹݺͼग़͞ΕͨࡍॲཧΛऴྃ͢Δʣ ᶆ 4UFQ'VODUJPOT͕%ZOBNP%#͔Βϑϥάͱ ి൪߸Λऔಘ͠ɺ"NB[PO$POOFDUͷ 4UBSU0VUCPVOE7PJDF$POUBDU"1*Λ࣮ߦ͠ ୲ऀʹίʔϧ͢Δ ᶃ ᶄ ᶅ ᶆ -
ࣗಈίʔϧॲཧ֓ཁ1IBTF̎ ᶇ "NB[PO$POOFDUʹΑΔൃ৴݁Ռ͕ $POUBDU5SBDF3FDPSEʢ$53ʣͱͯ͠৴ ᶈ $53Λ,JOFTJT%BUB4USFBNT͕Ωϟϓνϟ͠ ΠϕϯττϦΨʔͱͯ͠-BNCEBΛىಈ
ᶉ -BNCEB͕$53͔Βൃ৴݁ՌΛൈਮͯ͠ 4UFQ'VODUJPOTʹ͢ ᶊ 4UFQ'VODUJPOT͕ൃ৴݁ՌΛͱʹ %ZOBNP%#ͷϑϥάΛߋ৽ͭͭ͠ ࠶ൃ৴PSྠ൪PSॲཧऴྃͷ͍ͣΕ͔Λ࣮ߦ Ϧετͷશһʹܨ͕Βͳ͔ͬͨ߹ 4/4τϐοΫܦ༝Ͱ&ϝʔϧΛૹ৴ ᶇ ᶈ ᶉ ᶊ -
"NB[PO$POOFDUͷ͍߹Θͤϑϩʔ ˞ݸਓͰ$POOFDUΠϯελϯεΛ͍ͬͯͳ͍ͷͰ؆୯ͳུ֓ਤͰ͢ 4UBSU w దٓɺ܁Γฦ͠ແԠɺΤϥʔʹର͢ΔॲཧΛೖΕΔ w ೖྗͨ͠ύϥϝʔλʹैͬͯԻΛൃͤ͞Δ͜ͱɺ-BNCEBΛτϦΨʔͯ͠ ଞαʔϏεͱͷ࿈ܞͳͲ͋ΒΏΔॲཧΛߦ͏͜ͱ͕Մೳ w
डऀ$POOFDUଆ͕ऴ͢ΔͷΛͭඞཁ͕͋Δ ˠडऀଆ͔Βͬͨ߹ɺΛԡͨ͠ޙͰ௨݁Ռ͕ෆࡏͱಉ͡ѻ͍ʹͳΔ ɹʢ$6450.&3@%*4$0//&$5ʣ ͔̋̋Β͓ΒͤͰ͢ɻ "MBSN/BNFͱ͍͏ ΞϥʔϜ͕ൃੜ͠·ͨ͠ɻ ֬ೝͨ͠ΒΛɺ͏Ұฉ͘ ߹Λԡ͍ͯͩ͘͠͞ɻ &OE $53৴ ֬ೝ͠·ͨ͠ɻ ௨Λऴྃ͠·͢ɻ ԻΛઃఆ -
ࣗಈίʔϧΛߦ͏εςʔτϚγϯ ड͚औͬͨ$53͔ΒॲཧΛܾఆ ᶃॳճൃੜʢ*/*5*"-ʣ 1BSBNFUFS4UPSFʹΞϥʔϜ໊Λอ͠ɺ ϑϥάΛϦηοτͯ͠൪ͷి൪߸Λ औಘͯ͠ίʔϧ ᶄਖ਼ৗऴྃʢ$0/5"$5@'-08@%*4$0//&$5ʣ
ϑϥάΛϦηοτͯ͠ॲཧΛऴྃ ᶅҟৗऴྃʢ5&-&$0.@130#-&.ʣ ಉ͡ϑϥάͰ͏Ұίʔϧ ᶆෆࡏɺ௨தஅͳͲʢ$6450.&3@%*4$0//&$5ʣ ϑϥάΛΠϯΫϦϝϯτ͠ɺ࣍ͷి൪߸ʹίʔϧ Τϥʔ࣌4/4Ͱ&ϝʔϧ௨ޙɺϑϥάΛϦηοτ ᶃ ᶄ ᶅ ᶆ -
ࣗಈίʔϧɹͨ͠ϙΠϯτ %ZOBNP%#ʹΑΔϑϥάͱి൪߸ͷཧ γϯάϧςʔϒϧͰઃܭʢنখ͍͚͞ͲҰԠϕετϓϥΫςΟεʣ ओΩʔͰ͋Δ'MBHʹݱࡏͷϑϥάΛ֨ೲ͠ɺ4UFQ'VODUJPOT͕ಡΈॻ͖͢Δ ୲ऀͷ໊લʢPQFSBUPS/BNFʣॲཧͰ༻͠ͳ͍ͷͰҙ ઃఆՄೳͳϑϥάʢ୲ऀʣ͓ͦΒ͘ແ੍ݶ ˠ࠷ޙͷ୲ऀ͕ෆࡏͷ߹ɺ࣍ͷεςʔτϚγϯʹͯΤϥʔͱͳΓɺ4/4ܦ༝Ͱϝʔϧ͕ඈͿ 'MBH DVSSFOU'MBH QIPOF/VNCFS
PQFSBUPS/BNF ʢݱࡏͷϑϥάʣ 99999999 BNB[PO 99999999 HPPHMF 99999999 NJDSPTPGU -
̏ͭͷࣗಈԽʢ࠶ܝʣ ࣗಈ࠶ىಈ ϓϩηεͷҟৗΛݕˠϓϩηεͷ࠶ىಈίϚϯυΛૹ৴ ϓϩηε࠶ىಈͰվળ͠ͳ͍·ͨΠϯελϯεͷҟৗΛݕ ˠΠϯελϯεͷ࠶ىಈίϚϯυΛૹ৴ ࣗಈϦετΞ ࣍όοΫΞοϓͰऔಘͨ͠".*ͷ*%ΛύϥϝʔλετΞʹอ ࠶ىಈͰ෮چ͠ͳ͔ͬͨΠϯελϯεΛผ";Ͱ෮ݩ 350ɿఔɺ310ɿҎ ࣗಈίʔϧ
ࣗಈ࠶ىಈϦετΞμϝͰɺ͔ͭӦۀ࣌ؒ֎ͷͱ͖ʹൃಈ ୲ऀͷి൪߸ʹίʔϧ Ԡ͕ແ͚Ε࣍ͷਓʹίʔϧ -
̏ͭͷࣗಈԽ·ͱΊ • Ͱ͖Δ͚ͩϨΨγʔγεςϜͷӡ༻Λָʹ͢ΔͨΊʹ ͳΜͪΌͬͯαʔόʔϨεͰࣗಈԽγεςϜΛߏங͠·ͨ͠ • 4UFQ'VODUJPOTΦʔέετϨʔγϣϯπʔϧͱͯ͠ͱͯ༏ल ͨͩສೳͰͳ͘ɺϋϚΔϙΠϯτͦͦ͜͜ଟ͍ͷͰ׳Ε͕ඞཁ •
ରͰରԠ͢Δσʔλঢ়ଶΛѻ͏ͳΒ1BSBNFUFS4UPSF ෳͷ,FZ7BMVFΛؚΉσʔλঢ়ଶΛѻ͏ͳΒ%ZOBNP%# • "NB[PO$POOFDU"1*ʹΑΔൃ৴͕Ͱ͖Δɺ݁ՌΛ৴Ͱ͖Δ • ϞϊϦεͰ͋ΔఔͷϨδϦΤϯε֬อͰ͖ͨؾ͕͢Δ͚Ͳɺ ·ͩ·ͩվળͰ͖Δ෦ͨ͘͞Μ͋Δͱࢥ͏ -
༨ஊʙϨΨγʔΛͪΐͬͱϞμφΠζ͠·ͨ͠ʙ Application Load Balancer NAT gateway CMS Web Bastion
CloudFront WAF ͳΜͱ͔Ұ෦8FCαΠτͰίϯςϯπͱ%#ΛμϯλΠϜͳ͠Ͱޭͯ͠εςʔτϨεʹʂʢൃද࣌ظະఆʣ Application Load Balancer NAT gateway CMS Web Bastion CloudFront WAF Web EFS RDS