AWS Auroraのスロークエリを Datadogで扱うまで / How to handle slow_queries_logs in AWS Aurora with Datadog

"84"VSPSBͷεϩʔΫΤϦΛ %BUBEPHͰѻ͏·Ͱ .BLVBLF-51BSUZ

!NOVNB@ 5FBN43& %JTOFZ ʹೖΓ·ͨ͠ "OLFS/FCVMB$PTNPT."9ങͬͯΑ͔ͬͨ

ੈͷதʹ͸ͭͷϩά͕͋Γ·͢

ඇߏ଄Խϩά 6OTUSVDUVSFE-PHT ߏ଄Խϩά 4USVDUVSFE-PHT

ඇߏ଄Խϩά 6OTUSVDUVSFE-PHT DPNCJOFEMPHGPSNBU <%FD >(&5)551.P[JMMB 9-JOVYY@ "QQMF8FC,JU ,)5.- MJLF(FDLP
$ISPNF4BGBSJ

Ұൠతʹ͸KTPO ࣄલఆٛ͞ΕͨϝοηʔδϑΥʔϚοτ ςΩετͰ͸ͳ͘σʔληοτ ϩάͷॲཧ͕؆୯ʹͳΓϩάͷ෼ੳ͕ḿΔ ѻ͍΍͍͢ ߏ଄Խϩά 4USVDUVSFE-PHT KTPO1BZMPBE\ lpSTU@OBNF+PIO
lMBTU@OBNFl4NJUIz BHF NFTTBHFl)J ^

ɾ&SSPSMPH ɾ(FOFSBMRVFSZMPH ɾ4MPXRVFSZMPH ɾ"VEJUMPH "NB[PO"VSPSBͷϩά͸ $MPVE8BUDIʹΤΫεϙʔτՄೳ

IUUQTEPDTEBUBEPHIRDPNKBTFSWFSMFTTGPSXBSEFS $MPVE8BUDI-PHT͔Β%BUBEPH΁ͷసૹ %BUBEPH੡ͷϑΥϫʔμʔ͕ఏڙ͞Εͯ·͢ɻ

εϩʔΫΤϦϩά 4MPXRVFSZMPH

ϩάग़ྗ೔࣌ Ϣʔβʔɺ઀ଓαʔό 2VFSZ@UJNFΫΤϦ࣮ߦ࣌ؒ -PDL@UJNFϩοΫ࣌ؒ 3PXT@TFOUग़ྗߦ਺ 3PXT@FYBNJOFEॲཧର৅ߦ਺
42-จ

εϩʔΫΤϦϩά ඇߏ଄Խϩά Λ%BUBEPHͰѻ͍͍ͨ

ɾඇߏ଄Խϩά ɾෳ਺ߦ ɾσϦϛλ͕ڰؾཚ෣൒֯εϖʔε!

l*HSPLJOGVMMOFTTz3PCFSU")FJOMFJO 4USBOHFSJOB4USBOHF-BOE (SPL

(SPL ਖ਼نදݱηοτ ओʹϩάσʔλ޲͚ͷநग़ϑΟϧλɻ ඇߏ଄σʔλΛਖ਼نදݱʹΑͬͯߏ଄σʔλʹม׵ग़དྷΔɻ

https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/grok-patterns

(SPL Datadog LogsͰ͸ϩάऩू࣌ʹGrokΛϑΟϧλ͢Δ͜ͱ͕ग़དྷ·͢ɻ

ߏจ SVMF@OBNF\NBUDIFSpFMEpMUFS লུՄ ^ʜ ྫ VTFSPSEFSTUBUVTDPNQMFUF (SPLύʔαʔ IPHF@QBSTFS\EBUF ZZZZ..EE))NNTT444 UJNFTUBNQ^VTFS\OVNCFSVTFSJE^PSEFS
\EBUBPSEFSLFZWBMVF^

ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL*%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT
2VFSZ)BTIYYY 4&-&$5 '30.VTFST ύλʔϯ 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 4&-&$5 '30.VTFST ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE VTFUBCMF 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL*%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT 2VFSZ)BTIYYY 4&-&$5 '30.VTFST ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL*%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT 2VFSZ)BTIYYY 4&-&$5 '30.VTFST ѥछ

ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL*%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT
2VFSZ)BTIYYY 4&-&$5 '30.VTFST ύλʔϯ 5JNF͕ͳ͍ 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 4&-&$5 '30.VTFST ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE VTFUBCMFVTF͕͋Δ 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL*%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT 2VFSZ)BTIYYY 4&-&$5 '30.VTFST ύλʔϯ 5JNF೔෇ϑΥʔϚοτ͕ҧͬͨ 6TFS!)PTUVTFS<VTFS>!<>*E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL*%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT 2VFSZ)BTIYYY 4&-&$5 '30.VTFST ѥछ

ɾ"VSPSBͷϩάΛ%BUBEPHͰѻͬͯΔՕॴͷղઆ ɾॏΊͷ42-Λҙࣝग़དྷΔ࢓૊Έͱ͔͋Δͱྑ͍͔΋

AWS Auroraのスロークエリを Datadogで扱うまで / How to handle...

AWS Auroraのスロークエリを Datadogで扱うまで / How to handle slow_queries_logs in AWS Aurora with Datadog

mnuma

More Decks by mnuma

Other Decks in Technology

Featured

Transcript

"84"VSPSBͷεϩʔΫΤϦΛ %BUBEPHͰѻ͏·Ͱ .BLVBLF-51BSUZ

!NOVNB@ 5FBN43& %JTOFZ ʹೖΓ·ͨ͠ "OLFS/FCVMB$PTNPT."9ങͬͯΑ͔ͬͨ

ੈͷதʹ͸ͭͷϩά͕͋Γ·͢

ඇߏ଄Խϩά 6OTUSVDUVSFE-PHT ߏ଄Խϩά 4USVDUVSFE-PHT

ඇߏ଄Խϩά 6OTUSVDUVSFE-PHT DPNCJOFEMPHGPSNBU <%FD >(&5)551.P[JMMB 9-JOVYY@ "QQMF8FC,JU ,)5.- MJLF(FDLP

Ұൠతʹ͸KTPO ࣄલఆٛ͞ΕͨϝοηʔδϑΥʔϚοτ ςΩετͰ͸ͳ͘σʔληοτ ϩάͷॲཧ͕؆୯ʹͳΓϩάͷ෼ੳ͕ḿΔ ѻ͍΍͍͢ ߏ଄Խϩά 4USVDUVSFE-PHT KTPO1BZMPBE\ lpSTU@OBNF+PIO

ɾ&SSPSMPH ɾ(FOFSBMRVFSZMPH ɾ4MPXRVFSZMPH ɾ"VEJUMPH "NB[PO"VSPSBͷϩά͸ $MPVE8BUDIʹΤΫεϙʔτՄೳ

IUUQTEPDTEBUBEPHIRDPNKBTFSWFSMFTTGPSXBSEFS $MPVE8BUDI-PHT͔Β%BUBEPH΁ͷసૹ %BUBEPH੡ͷϑΥϫʔμʔ͕ఏڙ͞Εͯ·͢ɻ

εϩʔΫΤϦϩά 4MPXRVFSZMPH

ϩάग़ྗ೔࣌ Ϣʔβʔɺ઀ଓαʔό 2VFSZ@UJNFΫΤϦ࣮ߦ࣌ؒ -PDL@UJNFϩοΫ࣌ؒ 3PXT@TFOUग़ྗߦ਺ 3PXT@FYBNJOFEॲཧର৅ߦ਺

εϩʔΫΤϦϩά ඇߏ଄Խϩά Λ%BUBEPHͰѻ͍͍ͨ

ɾඇߏ଄Խϩά ɾෳ਺ߦ ɾσϦϛλ͕ڰؾཚ෣൒֯εϖʔε!

l*HSPLJOGVMMOFTTz3PCFSU")FJOMFJO 4USBOHFSJOB4USBOHF-BOE (SPL

(SPL ਖ਼نදݱηοτ ओʹϩάσʔλ޲͚ͷநग़ϑΟϧλɻ ඇߏ଄σʔλΛਖ਼نදݱʹΑͬͯߏ଄σʔλʹม׵ग़དྷΔɻ

https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/grok-patterns

(SPL Datadog LogsͰ͸ϩάऩू࣌ʹGrokΛϑΟϧλ͢Δ͜ͱ͕ग़དྷ·͢ɻ

ߏจ SVMF@OBNF\NBUDIFSpFMEpMUFS লུՄ ^ʜ ྫ VTFSPSEFSTUBUVTDPNQMFUF (SPLύʔαʔ IPHF@QBSTFS\EBUF ZZZZ..EE))NNTT444 UJNFTUBNQ^VTFS\OVNCFSVTFSJE^PSEFS

ߏจ SVMF@OBNF\NBUDIFSpFMEpMUFS লུՄ ^ʜ ྫ VTFSPSEFSTUBUVTDPNQMFUF (SPLύʔαʔ IPHF@QBSTFS\EBUF ZZZZ..EE))NNTT444 UJNFTUBNQ^VTFS\OVNCFSVTFSJE^PSEFS

ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT

ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT

ύλʔϯ 5JNF 6TFS!)PTUVTFS<VTFS>!<>E 2VFSZ@UJNF-PDL@UJNF3PXT@TFOU3PXT@FYBNJOFE 4&5UJNFTUBNQ 6TFSOBNF4DIFEVMFE 5BTL%YYY 2VFSZ*% 2VFVFTDIFEVMFE@RVFSJFT

ɾ"VSPSBͷϩάΛ%BUBEPHͰѻͬͯΔՕॴͷղઆ ɾॏΊͷ42-Λҙࣝग़དྷΔ࢓૊Έͱ͔͋Δͱྑ͍͔΋