Amazonの Athenaで楽々 ログ集計

2377be1c3f33751ea7c73a7bd8d58996?s=47 T. MOTOOKA
February 18, 2017

Amazonの Athenaで楽々 ログ集計

2017.02.18 中国地方DB勉強会 #19
https://dbstudychugoku.connpass.com/event/46019/

2377be1c3f33751ea7c73a7bd8d58996?s=128

T. MOTOOKA

February 18, 2017
Tweet

Transcript

  1. "NB[POͷ "UIFOBͰָʑ ϩάूܭ தࠃ஍ํ%#ษڧձ CZ5.0500,"

  2. ࣗݾ঺հͦͷ̍ w !U@NPUPPLB w IFBMUIDIFDL௨Βͳ͍αʔόͷ؅ཧऀ w 1)10CKFDUJWF$4XJGU47(1%' w :(){ :|:&

    };:ɹ˞ʮϑΥʔΫര஄ʯͰ͢ɻةݥͰ͢ɻ w ςΫχΧϧΤϯδχΞʢσʔλϕʔεʣ w "84$FSUJpFE4PMVUJPO"SDIJUFDU
 "TTPDJBUF-FWFM
  3. ࣗݾ঺հͦͷ̎ ॴଐͱɺॴଐઌͷ੡඼ͷ঺հɺͰͨ͠ɻ ʢձ৔ͰͷΈͷ͝঺հʣ

  4. ࣗݾ঺հͦͷ̏ w 1PTUHSF42-Y࣌୅ͷ೤৺ͳϢʔβ w ͻͨ͢ΒެࣜϚχϡΞϧΛಡΉੜ׆ w 4MPOZͰͷϨϓϦέʔγϣϯ w ࢓ࣄͷ౎߹ʢస৬ʣͰ.Z42-ʹվफ w

    ଞʹ͸ɿ42-4FSWFS 0SBDMF w ΄Μͷͪΐͬͱ͚ͩɿ%# 42-JUF
  5. ͱ͜ΖͰ

  6. ϩάͷूܭ΍ௐࠪ Ͳ͏ͯ͠·͔͢ʁ

  7. ϩάͷूܭ΍ௐࠪ w ઐ༻ͷπʔϧʹಥͬࠐΉʁ w ࣗ෼͕औΓ͍߲ͨ໨ɺऔΕ·͔͢ʁ
 42-ͰΫΤϦॻ͖͍ͨͰ͢ΑͶʙ w ηοτΞοϓ͕໘౗ͩͬͨΓ w 3%#ʹ৯ΘͤͯΫΤϦॻ͖·͔͢ʁ

    w ͏ͬɺσΟεΫαΠζ͕͕͕ʜʜ
  8. ͜ΕΒͷ՝୊Λ ղܾͰ͖Δ͔΋͠Εͳ͍ πʔϧΛ͝঺հ͠·͠ΐ͏

  9. ໨࣍ w 4ͱ͸ʁ w "84"UIFOBͱ͸ʁ w ࣮ࡍʹ࢖ͬͯΈ·͠ΐ͏ w UJQT

  10. 4ͱ͸ "NB[PO"UIFOBͷ࿩ͷલʹ

  11. 4ͱ͸ w 4JNQMF4UPSBHF4FSWJDFΦϒδΣΫτετϨʔδ w ༰ྔ੍ݶɿࣄ্࣮ແ͠ w ߴ͍৑௕ੑʢ৑௕ੑΛԼ͛ͯ҆͘ࡁ·ͤΔϓϥϯ΋͋Δʣ w අ༻ w

    ஷଂσʔλྔʹԠͯ͡ͷ՝ۚɿ͍҆ w SFBEXSJUFϦΫΤετ਺Ͱͷ՝ۚ w ωοτϫʔΫసૹྔͰͷ՝ۚɿ"84ಉҰϦʔδϣϯ಺͸λμ
  12. 4ͷ༻్ w 8FCΞϓϦͷҰ෦ͱͯ͠ w TUBUJDͳ8FCϖʔδ w ը૾ͳͲͷஔ͖৔ॴ w γεςϜͷҰ෦ͱͯ͠ w

    ϩάͷ௕ظอ؅ɹ˞(MBDJFSͱ͍͏બ୒ࢶ΋ w όοΫΞοϓϑΝΠϧͷஔ͖৔ॴ
  13. 4ͷ༻్ w 8FCΞϓϦͷҰ෦ͱͯ͠ w TUBUJDͳ8FCϖʔδ w ը૾ͳͲͷஔ͖৔ॴ w γεςϜͷҰ෦ͱͯ͠ w

    ϩάͷ௕ظอ؅ɹ˞(MBDJFSͱ͍͏બ୒ࢶ΋ w όοΫΞοϓϑΝΠϧͷஔ͖৔ॴ
  14. "NB[PO"UIFOB ͱ͸

  15. "NB[PO"UIFOBͱ͸ w 4ʹஔ͍ͨϑΝΠϧΛ w 42-ͰॲཧʢTFMFDUʣͯ͘͠ΕΔ w 4͔ΒಡΈࠐΜͩσʔλྔͰ՝ۚ w ΫΤϦ݁Ռ͸4ʹอଘͯ͘͠ΕΔ w

    TJODF/PW
  16. "UIFOBଞͱͷҧ͍ σʔλूܭαʔϏε͸ɺଞʹ΋͍Ζ͍Ζ͋Δ͚ΕͲʜ w αʔόεϖοΫ͸ؾʹ͠ͳ͍͍ͯ͘ w ઃఆ͸DSFBUFUBCMF͘Β͍ w ެ͕ࣜݴ͏ʹ͸ʮBEIPD޲͖ʯ w "1*͸੔උ͞Ε͍ͯͳ͍

    w ͦͷ࣌ͷճݶΓͷΫΤϦɺ࣌ʑྲྀ͢ΫΤϦ޲͖
  17. "UIFOBͲ͏࢖͏ͷ͔ʁ w 4ʹஔ͍͍ͯΔϑΝΠϧͰDSFBUFUBCMF w ඞཁͳΒύʔςΟγϣϯઃఆ w 42-Λॻ͍࣮ͯߦʂ w ܁Γฦ͠࢖͏ΫΤϦ͸อଘ

  18. ࣮ࡍʹ࢖ͬͯΈ·͠ΐ͏ w DSFBUFUBCMF w ΫΤϦΛྲྀͯ͠ΈΔ

  19. σϞͰ঺հͨ͠΋ͷ w ༣ศ൪߸σʔλ w μ΢ϯϩʔυIUUQXXXQPTUKBQBOQPTUKQ[JQDPEFEMLPHBLJ[JQIUNM w ΧϥϜͷઆ໌IUUQXXXQPTUKBQBOQPTUKQ[JQDPEFEMSFBENFIUNM w "UIFOBͰ࣮ࡍʹDSFBUFUBCMF w

    ΫΤϦ w ถࢠͷொͷҰཡ w ௗऔݝͷதͰɺಉ͡༣ศ൪߸͕ෳ਺ͷொͰ࢖ΘΕ͍ͯΔ΋ͷ w ʮҰͭͷ༣ศ൪߸ͰೋҎ্ͷொҬΛද͢৔߹ͷදࣔʯͰ͸ͳ͍ͷʹ ෳ਺ߦ͋Δσʔλ w ͷσʔλ
  20. UJQT

  21. ࢖͏্ͰͷUJQT w 65' w EFMJNJUFS͕୯७Ͱͳ͍ͱ͖ɿ
 ɹਖ਼نදݱΛ׆༻ w ࠷ॳ͸ਖ਼نදݱΛ࢖Θͳ͍ϑΥʔϚοτͰ࿅श
 ɹ˞׳Εͯͳ͍ͱϋϚΔ w

    σΟϨΫτϦͷதΛશ෦ಡΉ
 ɹ༨ܭͳϑΝΠϧ͸ೖΕͳ͍Α͏ʹ͠Α͏
  22. ίετ࡟ݮUJQT w 4ͱ"UIFOB͸ಉ͡Ϧʔδϣϯʹஔ͜͏
 㲎σʔλసૹྉۚ w ύʔςΟγϣϯ੾ΕΔߏ੒Λߟ͑Α͏
 㲎ͦ΋ͦ΋ϑΝΠϧʹΞΫηεͤ͞ͳ͍ w H[JQΛ࢖͓͏ w

    ྻࢤ޲ͷϑΝΠϧϑΥʔϚοτ
  23. ·ͱΊ w VQEBUF΍EFMFUF͸Ͱ͖ͳ͍ w 42-ͷ࿅शʹ΋࢖͑Δ͔΋ w ϩάΛஔ͍ͱ͘4 w ΫΤϦྲྀͤΔ"UIFOBʹͯ w

    ͠͝ͱָ͘͠Ͱ͖ͪΌ͏Ͷ
  24. ׬