AWS Auroraのスロークエリを Datadogで扱うまで / How to handle slow_queries_logs in AWS Aurora with Datadog

Transcript

1. "84
   "VSPSBͷεϩʔΫΤϦΛ
   %BUBEPHͰѻ͏·Ͱ .BLVBLF
   -5
   1BSUZ
   
2. !NOVNB@
   5FBN
   43& %JTOFZ ʹೖΓ·ͨ͠
   "OLFS
   /FCVMB
   $PTNPT
   ."9ങͬͯΑ͔ͬͨ
3. ੈͷதʹ͸ͭͷϩά͕͋Γ·͢
4. ඇߏ଄Խϩά 6OTUSVDUVSFE
   -PHT ߏ଄Խϩά 4USVDUVSFE
   -PHT
5. ඇߏ଄Խϩά 6OTUSVDUVSFE
   -PHT DPNCJOFE
   MPH
   GPSNBU
   
   
   
   <%FD
   >
   (&5
   
   )551
   
   
   
   .P[JMMB
   9
   -JOVY
   Y@
   "QQMF8FC,JU
   ,)5.-
   MJLF
   (FDLP
   $ISPNF
   4BGBSJ
   
6. Ұൠతʹ͸KTPO
   ࣄલఆٛ͞ΕͨϝοηʔδϑΥʔϚοτ
   ςΩετͰ͸ͳ͘σʔληοτ
   ϩάͷॲཧ͕؆୯ʹͳΓϩάͷ෼ੳ͕ḿΔ
   
   ѻ͍΍͍͢ ߏ଄Խϩά 4USVDUVSFE
   -PHT KTPO1BZMPBE
   \
   
   
   
   
   
   
   
   
   lpSTU@OBNF
   +PIO
   
   
   
   
   
   
   
   
   lMBTU@OBNF
   l4NJUIz
   
   
   
   
   
   
   
   
   BHF
   
   
   
   
   
   
   
   
   
   NFTTBHF
   l)J
   
   
   
   
   ^
7. ɾ&SSPS
   MPH
   
   ɾ(FOFSBM
   RVFSZ
   MPH
   ɾ4MPX
   RVFSZ
   MPH
   
   ɾ"VEJU
   MPH
   "NB[PO
   "VSPSBͷϩά͸
   $MPVE8BUDIʹΤΫεϙʔτՄೳ
8. IUUQTEPDTEBUBEPHIRDPNKBTFSWFSMFTTGPSXBSEFS $MPVE8BUDI
   -PHT͔Β%BUBEPH΁ͷసૹ
   %BUBEPH੡ͷϑΥϫʔμʔ͕ఏڙ͞Εͯ·͢ɻ
9. εϩʔΫΤϦϩά
   4MPX
   RVFSZ
   MPH
   
11. 
    ϩάग़ྗ೔࣌
    
    Ϣʔβʔɺ઀ଓαʔό
    
    2VFSZ@UJNF
    ΫΤϦ࣮ߦ࣌ؒ
    -PDL@UJNF
    ϩοΫ࣌ؒ
    3PXT@TFOU
    ग़ྗߦ਺
    3PXT@FYBNJOFE
    ॲཧର৅ߦ਺ 
    42-จ
    
12. εϩʔΫΤϦϩά
    ඇߏ଄Խϩά
    
    Λ%BUBEPHͰѻ͍͍ͨ
13. ɾඇߏ଄Խϩά
    ɾෳ਺ߦ
    ɾσϦϛλ͕ڰؾཚ෣
    
    
    ൒֯εϖʔε
    !
    
    
14. l*
    HSPL
    JO
    GVMMOFTTz
    3PCFSU
    "
    )FJOMFJO
    4USBOHFS
    JO
    B
    4USBOHF
    -BOE (SPL
15. (SPL ਖ਼نදݱηοτ ओʹϩάσʔλ޲͚ͷநग़ϑΟϧλɻ ඇߏ଄σʔλΛਖ਼نදݱʹΑͬͯߏ଄σʔλʹม׵ग़དྷΔɻ
16. https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/grok-patterns
17. (SPL Datadog LogsͰ͸ϩάऩू࣌ʹGrokΛϑΟϧλ͢Δ͜ͱ͕ग़དྷ·͢ɻ
18. ߏจ
    SVMF@OBNF
    \NBUDIFSpFMEpMUFS লུՄ ^
    ʜ ྫ
    
    
    VTFS
    
    PSEFS
    TUBUVTDPNQMFUF (SPL
    ύʔαʔ
    IPHF@QBSTFS
    \EBUF ZZZZ..EE
    ))NNTT444 UJNFTUBNQ^
    VTFS
    \OVNCFSVTFSJE^
    PSEFS
    
    \EBUBPSEFSLFZWBMVF^
    
19. ߏจ
    SVMF@OBNF
    \NBUDIFSpFMEpMUFS লུՄ ^
    ʜ ྫ
    
    
    VTFS
    
    PSEFS
    TUBUVTDPNQMFUF (SPL
    ύʔαʔ
    IPHF@QBSTFS
    \EBUF ZZZZ..EE
    ))NNTT444 UJNFTUBNQ^
    VTFS
    \OVNCFSVTFSJE^
    PSEFS
    
    \EBUBPSEFSLFZWBMVF^
    
21. ύλʔϯ
    
    5JNF
    
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    5JNF
    
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    VTF
    UBCMF
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    5JNF
    
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ѥछ
22. ύλʔϯ
    
    5JNF
    
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    
    5JNF͕ͳ͍
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    5JNF
    
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    VTF
    UBCMF
    VTF͕͋Δ
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    5JNF
    
    
    ೔෇ϑΥʔϚοτ͕ҧͬͨ
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ѥछ
23. ύλʔϯ
    
    5JNF
    
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    
    5JNF͕ͳ͍
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    5JNF
    
    
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    VTF
    UBCMF
    VTF͕͋Δ
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ύλʔϯ
    
    5JNF
    
    
    ೔෇ϑΥʔϚοτ͕ҧͬͨ
    
    6TFS!)PTU
    VTFS<VTFS>
    !
    <>
    *E
    
    
    2VFSZ@UJNF
    
    -PDL@UJNF
    
    3PXT@TFOU
    
    3PXT@FYBNJOFE
    
    4&5
    UJNFTUBNQ
    
    6TFSOBNF
    4DIFEVMFE
    5BTL
    *%YYY
    2VFSZ
    *%
    
    
    2VFVF
    TDIFEVMFE@RVFSJFT
    2VFSZ
    )BTI
    YYY
    
    4&-&$5
    
    '30.
    VTFST
    ѥछ
24. ɾ"VSPSBͷϩάΛ%BUBEPHͰѻͬͯΔՕॴͷղઆ
    ɾॏΊͷ42-Λҙࣝग़དྷΔ࢓૊Έͱ͔͋Δͱྑ͍͔΋