Apache Drillで 身の回りのログを集計してみる

9480e27b8d6ae2a668a98144516b5513?s=47 acidlemon
September 15, 2015
Technology
0
940

Apache Drillで 身の回りのログを集計してみる

Tokyo Apache Drill Meetup (2015/09/15)の資料です。

9480e27b8d6ae2a668a98144516b5513?s=128

acidlemon

September 15, 2015
Tweet

More Decks by acidlemon

See All by acidlemon
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
0
560
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
1
2.5k
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
1
300
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
2
580
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
1
800
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
2
1.3k

Other Decks in Technology

See All in Technology
9e7a653ed313b3da4b263a772bfc5026?s=48 clustervr
0
280
C5e26822fb2aa64410b50eac63ef7d84?s=48 fill9120
1
230
3dc29e8cfc6ef333e2b41a1b0e826b57?s=48 cortinico
5
250
Ca7e4f1680e175e6462a039923e71fc5?s=48 kyokonishito
0
180
2102a6b8760bd6f57f672805723dd83a?s=48 line_developers_tw
0
3.8k
26a00012c475c2380cd98cfe5e2e70ef?s=48 ozaki25
0
220
3115a782126be714b5f94d24073c957d?s=48 oracle4engineer
3
290
75fd80a8ace6ab292a7de563e018ae11?s=48 takashi_toyosaki
0
240
332f89cc697355902a817506b6995f2b?s=48 ytaka23
8
1.7k
92e7a56a50535ef4c51c112c71d3f9c1?s=48 jkubota
0
280
706ff501573a736401aa4de5adc88e05?s=48 nihonbuson
3
1k
F68a145ec870bf173a932bc409b20fab?s=48 jyamamoto
0
320

Featured

See All Featured
24fc194843a71f10949be18d5a692682?s=48 gr2m
82
11k
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
61
7.4k
D8fc2580cfaca035f666d9e4ee79a7f7?s=48 mongodb
23
3.7k
44b54d2ffcb7857004071cc6795dde11?s=48 cassininazir
342
20k
C0390e8b11079f8761c0cd3274ed61cb?s=48 productmarketing
3
440
016edace78ffe826f2348d1e0c504afd?s=48 maggiecrowley
2
180
78b475797a14c84799063c7cd073962f?s=48 holman
458
270k
168ccec72eee0530b818d44f3fedaacf?s=48 shlominoach
174
7.1k
A9704266587836f7e784235e5073b93e?s=48 jmmastey
1
35
Bfd6b681ec6e8c9bef82ff0521c364f7?s=48 kastner
51
1.8k
Af6a12710770ad9a7cfd08c97efd40d3?s=48 pedronauck
648
110k
6bb82b13cda86d3b821fa44100335ddf?s=48 thoeni
2
300

Transcript

  1. "QBDIF%SJMMͰ ਎ͷճΓͷϩάΛूܭͯ͠ΈΔ -FU`TUSZUPBHHSFHBUF JOEJWJEVBMMPHTVTJOH"QBDIF%SJMM 5PLZP"QBDIF%SJMM.FFUVQ !BDJEMFNPO

  2. "CPVU.F w 1SPHSBNNJOH(PMBOH 1FSM $  w %#%8).Z42-3FETIJGU w "QBDIF%SJMMIJTUPSZXFFLT

    !BDJEMFNPO .BTBUPTIJ,BXB[PF 4PGUXBSF&OHJOFFS BU,":"$*OD

  3. "QBDIF%SJMM w 4DIFNBGSFF42-&OHJOF NPEF  w %JTUSJCVUJPO.PEF
 XJUI)BEPPQ /P42- $MPVE4UPSBHF

    w &NCFEEFE.PEF
 XJUI-PDBMpMF +40/ $47 547 147 5SZUIJTUPEBZ

  4. 8IZ%SJMM .Z3FBTPO w 8IFO*OFFEUPJNQSPWFXFCBQQ QFSGPSNBODFʜ w *XBOUUPBHHSFHBUFSFTQPOTFUJNF QFSFOEQPJOUʜ w %SJMMDPVMESVORVFSZUP+40/

    ZFBI

  5. 2VJDL4UBSU w 4FF0GpDJBM5VUPSJBM%PDVNFOU
 l%SJMMJONJOVUFTz
 IUUQTESJMMBQBDIFPSHEPDTESJMMJONJOVUFT  w PS%FWFMPQFST*0#MPH&OUSZBCPVU "QBDIF%SJMM*NQSFTTJPO
 IUUQEFWDMBTTNFUIPEKQDMPVEBXTBQBDIFESJMMpSTUJNQSFTTJPO

    w 'PS.BD6TFSVTF)PNFCSFX
 
 SFRVJSFT+%,PSMBUFS $ brew install apache-drill

  6. $POWFSUOHJOYMPH w 8FVTFl-547zGPSNBUGPSOHJOYMPH w -547-BCFMFE5BCTFQBSBUFE7BMVFT
 IUUQMUTWPSH w "QBDIF%SJMMEPFTOPUTVQQPSU-547ZFU TP DPOWFSUMPHGSPN-547UP+40/

    w VTFMUTWJFXDPNNBOE WJBSVCZHFNT host:217.235.96.155 time:2015-09-14T00:00:00+09:00 method:POST uri:/api/hunting/challenge protocol:HTTP/1.1 status:200 size: 5790 request_time:0.383 upstream_response_time:0.438 referer:- user_agent:MyApp/11000 CFNetwork/711.3.18 Darwin/14.0.0 user_id: 76005617 geo:JP

  7. %FNP .MJOFT .#+40/

  8. $VU2VFSZ4USJOH w (SPVQCZVSJ
 CVUVSJDPOUBJOT2VFSZ4USJOHʜ w 4PMVUJPO
 3&(&91@3&1-"$& VSJ `a 

      BTQBUI +------------------------------------------------------------------------------------------------------------+----------+ | uri | maxtime | +------------------------------------------------------------------------------------------------------------+----------+ | /api/costume/hunting_item/equip | 9.695 | | /api/hunting/families?hunting_id=4000222&session=XXXXXXXXe937077b8cbc06ad3aec80fe&client_data_version=1329 | 9.273 | | /api/mypage?os_type=1&platform_type=1&session=XXXXXXXX7968eb69dd20d2bb1aec3943&client_data_version=1329 | 8.316 | | /api/mypage?os_type=2&platform_type=2&session=XXXXXXXXb63727f12bd2724ab9725885&client_data_version=1329 | 8.279 | | /api/hunting/families?hunting_id=4026012&session=XXXXXXXX2dc4a6668288c5f4a675f071&client_data_version=1330 | 7.926 | | /api/hunting/families?hunting_id=4025518&session=XXXXXXXX04634d3293a8c2317454b6a3&client_data_version=1329 | 7.896 |

  9. 1BSTFUJNFTUSJOH w UJNF5  w KVTUBTUSJOH OPUUJNFTUBNQʜ
 where `time` >

    ‘2015-09-14 07:00:00’
 EPFTOPUXPSLBTFYQFDUFEʜ w 4PMVUJPO
 50@5*.&45".1 AUJNFA `ZZZZ..EE5))NNTT; 
 "4BDDFTT@UJNF

  10. %FNP (3061#:  QFSDFOUJMFBOBMZTJT

  11. $PODMVTJPO w "QBDIF%SJMMJTSFBTPOBCMZGBTU w 5FNQPSBSZUBCMFJTVTFGVMGPSMPOH RVFSZ w $"45JTJNQPSUBOUUPSVORVFSZ w 4UJMMMJUUMFIBSEUPVTFZFU

    SFBE EPDVNFOUDBSFGVMMZ

  12. 5IBOLZPV