Amazonの Athenaで楽々 ログ集計

2017.02.18 中国地方DB勉強会 #19
https://dbstudychugoku.connpass.com/event/46019/

Transcript

1. "NB[POͷ
   "UIFOBͰָʑ
   ϩάूܭ
   தࠃ஍ํ%#ษڧձ
   CZ5.0500,"
   

   View Slide

2. ࣗݾ঺հͦͷ̍
   w !U@NPUPPLB
   w IFBMUIDIFDL௨Βͳ͍αʔόͷ؅ཧऀ
   w 1)10CKFDUJWF$4XJGU47(1%'
   w :(){ :|:& };:ɹ˞ʮϑΥʔΫര஄ʯͰ͢ɻةݥͰ͢ɻ
   w ςΫχΧϧΤϯδχΞʢσʔλϕʔεʣ
   w "84$FSUJpFE4PMVUJPO"SDIJUFDU

   "TTPDJBUF-FWFM
   

   View Slide

3. ࣗݾ঺հͦͷ̎
   ॴଐͱɺॴଐઌͷ੡඼ͷ঺հɺͰͨ͠ɻ
   ʢձ৔ͰͷΈͷ͝঺հʣ
   

   View Slide

4. ࣗݾ঺հͦͷ̏
   w 1PTUHSF42-Y࣌୅ͷ೤৺ͳϢʔβ
   w ͻͨ͢ΒެࣜϚχϡΞϧΛಡΉੜ׆
   w 4MPOZͰͷϨϓϦέʔγϣϯ
   w ࢓ࣄͷ౎߹ʢస৬ʣͰ.Z42-ʹվफ
   w ଞʹ͸ɿ42-4FSWFS 0SBDMF
   w ΄Μͷͪΐͬͱ͚ͩɿ%# 42-JUF
   

   View Slide

5. ͱ͜ΖͰ
   

   View Slide

6. ϩάͷूܭ΍ௐࠪ
   Ͳ͏ͯ͠·͔͢ʁ
   

   View Slide

7. ϩάͷूܭ΍ௐࠪ
   w ઐ༻ͷπʔϧʹಥͬࠐΉʁ
   w ࣗ෼͕औΓ͍߲ͨ໨ɺऔΕ·͔͢ʁ

   42-ͰΫΤϦॻ͖͍ͨͰ͢ΑͶʙ
   w ηοτΞοϓ͕໘౗ͩͬͨΓ
   w 3%#ʹ৯ΘͤͯΫΤϦॻ͖·͔͢ʁ
   w ͏ͬɺσΟεΫαΠζ͕͕͕ʜʜ
   

   View Slide

8. ͜ΕΒͷ՝୊Λ
   ղܾͰ͖Δ͔΋͠Εͳ͍
   πʔϧΛ͝঺հ͠·͠ΐ͏
   

   View Slide

9. ໨࣍
   w 4ͱ͸ʁ
   w "84"UIFOBͱ͸ʁ
   w ࣮ࡍʹ࢖ͬͯΈ·͠ΐ͏
   w UJQT
   

   View Slide

10. 4ͱ͸
    "NB[PO"UIFOBͷ࿩ͷલʹ
    

    View Slide

11. 4ͱ͸
    w 4JNQMF4UPSBHF4FSWJDFΦϒδΣΫτετϨʔδ
    w ༰ྔ੍ݶɿࣄ্࣮ແ͠
    w ߴ͍৑௕ੑʢ৑௕ੑΛԼ͛ͯ҆͘ࡁ·ͤΔϓϥϯ΋͋Δʣ
    w අ༻
    w ஷଂσʔλྔʹԠͯ͡ͷ՝ۚɿ͍҆
    w SFBEXSJUFϦΫΤετ਺Ͱͷ՝ۚ
    w ωοτϫʔΫసૹྔͰͷ՝ۚɿ"84ಉҰϦʔδϣϯ಺͸λμ
    

    View Slide

12. 4ͷ༻్
    w 8FCΞϓϦͷҰ෦ͱͯ͠
    w TUBUJDͳ8FCϖʔδ
    w ը૾ͳͲͷஔ͖৔ॴ
    w γεςϜͷҰ෦ͱͯ͠
    w ϩάͷ௕ظอ؅ɹ˞(MBDJFSͱ͍͏બ୒ࢶ΋
    w όοΫΞοϓϑΝΠϧͷஔ͖৔ॴ
    

    View Slide

13. 4ͷ༻్
    w 8FCΞϓϦͷҰ෦ͱͯ͠
    w TUBUJDͳ8FCϖʔδ
    w ը૾ͳͲͷஔ͖৔ॴ
    w γεςϜͷҰ෦ͱͯ͠
    w ϩάͷ௕ظอ؅ɹ˞(MBDJFSͱ͍͏બ୒ࢶ΋
    w όοΫΞοϓϑΝΠϧͷஔ͖৔ॴ
    

    View Slide

14. "NB[PO"UIFOB
    ͱ͸
    

    View Slide

15. "NB[PO"UIFOBͱ͸
    w 4ʹஔ͍ͨϑΝΠϧΛ
    w 42-ͰॲཧʢTFMFDUʣͯ͘͠ΕΔ
    w 4͔ΒಡΈࠐΜͩσʔλྔͰ՝ۚ
    w ΫΤϦ݁Ռ͸4ʹอଘͯ͘͠ΕΔ
    w TJODF/PW
    

    View Slide

16. "UIFOBଞͱͷҧ͍
    σʔλूܭαʔϏε͸ɺଞʹ΋͍Ζ͍Ζ͋Δ͚ΕͲʜ
    w αʔόεϖοΫ͸ؾʹ͠ͳ͍͍ͯ͘
    w ઃఆ͸DSFBUFUBCMF͘Β͍
    w ެ͕ࣜݴ͏ʹ͸ʮBEIPD޲͖ʯ
    w "1*͸੔උ͞Ε͍ͯͳ͍
    w ͦͷ࣌ͷճݶΓͷΫΤϦɺ࣌ʑྲྀ͢ΫΤϦ޲͖
    

    View Slide

17. "UIFOBͲ͏࢖͏ͷ͔ʁ
    w 4ʹஔ͍͍ͯΔϑΝΠϧͰDSFBUFUBCMF
    w ඞཁͳΒύʔςΟγϣϯઃఆ
    w 42-Λॻ͍࣮ͯߦʂ
    w ܁Γฦ͠࢖͏ΫΤϦ͸อଘ
    

    View Slide

18. ࣮ࡍʹ࢖ͬͯΈ·͠ΐ͏
    w DSFBUFUBCMF
    w ΫΤϦΛྲྀͯ͠ΈΔ
    

    View Slide

19. σϞͰ঺հͨ͠΋ͷ
    w ༣ศ൪߸σʔλ
    w μ΢ϯϩʔυIUUQXXXQPTUKBQBOQPTUKQ[JQDPEFEMLPHBLJ[JQIUNM
    w ΧϥϜͷઆ໌IUUQXXXQPTUKBQBOQPTUKQ[JQDPEFEMSFBENFIUNM
    w "UIFOBͰ࣮ࡍʹDSFBUFUBCMF
    w ΫΤϦ
    w ถࢠͷொͷҰཡ
    w ௗऔݝͷதͰɺಉ͡༣ศ൪߸͕ෳ਺ͷொͰ࢖ΘΕ͍ͯΔ΋ͷ
    w ʮҰͭͷ༣ศ൪߸ͰೋҎ্ͷொҬΛද͢৔߹ͷදࣔʯͰ͸ͳ͍ͷʹ
    ෳ਺ߦ͋Δσʔλ
    w ͷσʔλ
    

    View Slide

20. UJQT
    

    View Slide

21. ࢖͏্ͰͷUJQT
    w 65'
    w EFMJNJUFS͕୯७Ͱͳ͍ͱ͖ɿ

    ɹਖ਼نදݱΛ׆༻
    w ࠷ॳ͸ਖ਼نදݱΛ࢖Θͳ͍ϑΥʔϚοτͰ࿅श

    ɹ˞׳Εͯͳ͍ͱϋϚΔ
    w σΟϨΫτϦͷதΛશ෦ಡΉ

    ɹ༨ܭͳϑΝΠϧ͸ೖΕͳ͍Α͏ʹ͠Α͏
    

    View Slide

22. ίετ࡟ݮUJQT
    w 4ͱ"UIFOB͸ಉ͡Ϧʔδϣϯʹஔ͜͏

    㲎σʔλసૹྉۚ
    w ύʔςΟγϣϯ੾ΕΔߏ੒Λߟ͑Α͏

    㲎ͦ΋ͦ΋ϑΝΠϧʹΞΫηεͤ͞ͳ͍
    w H[JQΛ࢖͓͏
    w ྻࢤ޲ͷϑΝΠϧϑΥʔϚοτ
    

    View Slide

23. ·ͱΊ
    w VQEBUF΍EFMFUF͸Ͱ͖ͳ͍
    w 42-ͷ࿅शʹ΋࢖͑Δ͔΋
    w ϩάΛஔ͍ͱ͘4
    w ΫΤϦྲྀͤΔ"UIFOBʹͯ
    w ͠͝ͱָ͘͠Ͱ͖ͪΌ͏Ͷ
    

    View Slide

24. ׬
    

    View Slide