Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Amazonの Athenaで楽々 ログ集計

T. MOTOOKA
February 18, 2017

Amazonの Athenaで楽々 ログ集計

2017.02.18 中国地方DB勉強会 #19
https://dbstudychugoku.connpass.com/event/46019/

T. MOTOOKA

February 18, 2017
Tweet

More Decks by T. MOTOOKA

Other Decks in Technology

Transcript

  1. "NB[POͷ
    "UIFOBͰָʑ
    ϩάूܭ
    தࠃ஍ํ%#ษڧձ
    CZ5.0500,"

    View Slide

  2. ࣗݾ঺հͦͷ̍
    w [email protected]
    w IFBMUIDIFDL௨Βͳ͍αʔόͷ؅ཧऀ
    w 1)10CKFDUJWF$4XJGU47(1%'
    w :(){ :|:& };:ɹ˞ʮϑΥʔΫര஄ʯͰ͢ɻةݥͰ͢ɻ
    w ςΫχΧϧΤϯδχΞʢσʔλϕʔεʣ
    w "84$FSUJpFE4PMVUJPO"SDIJUFDU

    "TTPDJBUF-FWFM

    View Slide

  3. ࣗݾ঺հͦͷ̎
    ॴଐͱɺॴଐઌͷ੡඼ͷ঺հɺͰͨ͠ɻ
    ʢձ৔ͰͷΈͷ͝঺հʣ

    View Slide

  4. ࣗݾ঺հͦͷ̏
    w 1PTUHSF42-Y࣌୅ͷ೤৺ͳϢʔβ
    w ͻͨ͢ΒެࣜϚχϡΞϧΛಡΉੜ׆
    w 4MPOZͰͷϨϓϦέʔγϣϯ
    w ࢓ࣄͷ౎߹ʢస৬ʣͰ.Z42-ʹվफ
    w ଞʹ͸ɿ42-4FSWFS 0SBDMF
    w ΄Μͷͪΐͬͱ͚ͩɿ%# 42-JUF

    View Slide

  5. ͱ͜ΖͰ

    View Slide

  6. ϩάͷूܭ΍ௐࠪ
    Ͳ͏ͯ͠·͔͢ʁ

    View Slide

  7. ϩάͷूܭ΍ௐࠪ
    w ઐ༻ͷπʔϧʹಥͬࠐΉʁ
    w ࣗ෼͕औΓ͍߲ͨ໨ɺऔΕ·͔͢ʁ

    42-ͰΫΤϦॻ͖͍ͨͰ͢ΑͶʙ
    w ηοτΞοϓ͕໘౗ͩͬͨΓ
    w 3%#ʹ৯ΘͤͯΫΤϦॻ͖·͔͢ʁ
    w ͏ͬɺσΟεΫαΠζ͕͕͕ʜʜ

    View Slide

  8. ͜ΕΒͷ՝୊Λ
    ղܾͰ͖Δ͔΋͠Εͳ͍
    πʔϧΛ͝঺հ͠·͠ΐ͏

    View Slide

  9. ໨࣍
    w 4ͱ͸ʁ
    w "84"UIFOBͱ͸ʁ
    w ࣮ࡍʹ࢖ͬͯΈ·͠ΐ͏
    w UJQT

    View Slide

  10. 4ͱ͸
    "NB[PO"UIFOBͷ࿩ͷલʹ

    View Slide

  11. 4ͱ͸
    w 4JNQMF4UPSBHF4FSWJDFΦϒδΣΫτετϨʔδ
    w ༰ྔ੍ݶɿࣄ্࣮ແ͠
    w ߴ͍৑௕ੑʢ৑௕ੑΛԼ͛ͯ҆͘ࡁ·ͤΔϓϥϯ΋͋Δʣ
    w අ༻
    w ஷଂσʔλྔʹԠͯ͡ͷ՝ۚɿ͍҆
    w SFBEXSJUFϦΫΤετ਺Ͱͷ՝ۚ
    w ωοτϫʔΫసૹྔͰͷ՝ۚɿ"84ಉҰϦʔδϣϯ಺͸λμ

    View Slide

  12. 4ͷ༻్
    w 8FCΞϓϦͷҰ෦ͱͯ͠
    w TUBUJDͳ8FCϖʔδ
    w ը૾ͳͲͷஔ͖৔ॴ
    w γεςϜͷҰ෦ͱͯ͠
    w ϩάͷ௕ظอ؅ɹ˞(MBDJFSͱ͍͏બ୒ࢶ΋
    w όοΫΞοϓϑΝΠϧͷஔ͖৔ॴ

    View Slide

  13. 4ͷ༻్
    w 8FCΞϓϦͷҰ෦ͱͯ͠
    w TUBUJDͳ8FCϖʔδ
    w ը૾ͳͲͷஔ͖৔ॴ
    w γεςϜͷҰ෦ͱͯ͠
    w ϩάͷ௕ظอ؅ɹ˞(MBDJFSͱ͍͏બ୒ࢶ΋
    w όοΫΞοϓϑΝΠϧͷஔ͖৔ॴ

    View Slide

  14. "NB[PO"UIFOB
    ͱ͸

    View Slide

  15. "NB[PO"UIFOBͱ͸
    w 4ʹஔ͍ͨϑΝΠϧΛ
    w 42-ͰॲཧʢTFMFDUʣͯ͘͠ΕΔ
    w 4͔ΒಡΈࠐΜͩσʔλྔͰ՝ۚ
    w ΫΤϦ݁Ռ͸4ʹอଘͯ͘͠ΕΔ
    w TJODF/PW

    View Slide

  16. "UIFOBଞͱͷҧ͍
    σʔλूܭαʔϏε͸ɺଞʹ΋͍Ζ͍Ζ͋Δ͚ΕͲʜ
    w αʔόεϖοΫ͸ؾʹ͠ͳ͍͍ͯ͘
    w ઃఆ͸DSFBUFUBCMF͘Β͍
    w ެ͕ࣜݴ͏ʹ͸ʮBEIPD޲͖ʯ
    w "1*͸੔උ͞Ε͍ͯͳ͍
    w ͦͷ࣌ͷճݶΓͷΫΤϦɺ࣌ʑྲྀ͢ΫΤϦ޲͖

    View Slide

  17. "UIFOBͲ͏࢖͏ͷ͔ʁ
    w 4ʹஔ͍͍ͯΔϑΝΠϧͰDSFBUFUBCMF
    w ඞཁͳΒύʔςΟγϣϯઃఆ
    w 42-Λॻ͍࣮ͯߦʂ
    w ܁Γฦ͠࢖͏ΫΤϦ͸อଘ

    View Slide

  18. ࣮ࡍʹ࢖ͬͯΈ·͠ΐ͏
    w DSFBUFUBCMF
    w ΫΤϦΛྲྀͯ͠ΈΔ

    View Slide

  19. σϞͰ঺հͨ͠΋ͷ
    w ༣ศ൪߸σʔλ
    w μ΢ϯϩʔυIUUQXXXQPTUKBQBOQPTUKQ[JQDPEFEMLPHBLJ[JQIUNM
    w ΧϥϜͷઆ໌IUUQXXXQPTUKBQBOQPTUKQ[JQDPEFEMSFBENFIUNM
    w "UIFOBͰ࣮ࡍʹDSFBUFUBCMF
    w ΫΤϦ
    w ถࢠͷொͷҰཡ
    w ௗऔݝͷதͰɺಉ͡༣ศ൪߸͕ෳ਺ͷொͰ࢖ΘΕ͍ͯΔ΋ͷ
    w ʮҰͭͷ༣ศ൪߸ͰೋҎ্ͷொҬΛද͢৔߹ͷදࣔʯͰ͸ͳ͍ͷʹ
    ෳ਺ߦ͋Δσʔλ
    w ͷσʔλ

    View Slide

  20. UJQT

    View Slide

  21. ࢖͏্ͰͷUJQT
    w 65'
    w EFMJNJUFS͕୯७Ͱͳ͍ͱ͖ɿ

    ɹਖ਼نදݱΛ׆༻
    w ࠷ॳ͸ਖ਼نදݱΛ࢖Θͳ͍ϑΥʔϚοτͰ࿅श

    ɹ˞׳Εͯͳ͍ͱϋϚΔ
    w σΟϨΫτϦͷதΛશ෦ಡΉ

    ɹ༨ܭͳϑΝΠϧ͸ೖΕͳ͍Α͏ʹ͠Α͏

    View Slide

  22. ίετ࡟ݮUJQT
    w 4ͱ"UIFOB͸ಉ͡Ϧʔδϣϯʹஔ͜͏

    㲎σʔλసૹྉۚ
    w ύʔςΟγϣϯ੾ΕΔߏ੒Λߟ͑Α͏

    㲎ͦ΋ͦ΋ϑΝΠϧʹΞΫηεͤ͞ͳ͍
    w H[JQΛ࢖͓͏
    w ྻࢤ޲ͷϑΝΠϧϑΥʔϚοτ

    View Slide

  23. ·ͱΊ
    w VQEBUF΍EFMFUF͸Ͱ͖ͳ͍
    w 42-ͷ࿅शʹ΋࢖͑Δ͔΋
    w ϩάΛஔ͍ͱ͘4
    w ΫΤϦྲྀͤΔ"UIFOBʹͯ
    w ͠͝ͱָ͘͠Ͱ͖ͪΌ͏Ͷ

    View Slide

  24. ׬

    View Slide