Apache Drillで 身の回りのログを集計してみる

9480e27b8d6ae2a668a98144516b5513?s=47 acidlemon
September 15, 2015
Technology
0
950

Apache Drillで 身の回りのログを集計してみる

Tokyo Apache Drill Meetup (2015/09/15)の資料です。

9480e27b8d6ae2a668a98144516b5513?s=128

acidlemon

September 15, 2015
Tweet

More Decks by acidlemon

See All by acidlemon
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
0
600
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
1
2.6k
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
1
340
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
2
600
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
1
800
9480e27b8d6ae2a668a98144516b5513?s=48 acidlemon
2
1.3k

Other Decks in Technology

See All in Technology
E783e2d26dc6388730b73ced1348c638?s=48 vkbaba
0
220
C636093440dd4a8be6416e83cb980979?s=48 iselegant
13
2.7k
9b600b6d2f592d0944507e989770b9b3?s=48 issei126
1
750
5af8e5bd2f24e4ea0cee732c6cc259b3?s=48 haruharuharuby
0
210
27a17f6dcd75a913de398d1ed4d75a9e?s=48 hinatades
0
430
57e8d22493c141fd3c7e7dbe62196c1b?s=48 uenitty
0
410
Bf7fe621f4fe1615c228ef8a79b87282?s=48 shirayanagiryuji
2
690
11d3072d628a7b976cd2f4e6a3cf750f?s=48 yuyaabo
0
700
97a7f7899e0df28c3636b8d44bbe6578?s=48 korodroid
3
1.3k
1dc713fe291d5746d6646e45391326a9?s=48 nottegra
0
190
D98ee74ffe0fafbdc83b23907dda3665?s=48 doublemarket
2
220
84907687e50c8ac2a09b02e0d1b36ab1?s=48 toricls
14
4k

Featured

See All Featured
A16eb159db895e3b01d3dc95767ad595?s=48 jonyablonski
7
750
5f83ef806155b403c3393160ce51f955?s=48 jlugia
216
16k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
293
39k
24fc194843a71f10949be18d5a692682?s=48 gr2m
82
11k
7edec06b5435e0dac07a353b2cc26253?s=48 geeforr
331
29k
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
65
2.9k
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
356
62k
5f50f94346fbcb23706f0707169317a4?s=48 aarron
255
36k
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
770
190k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
309
21k
016edace78ffe826f2348d1e0c504afd?s=48 maggiecrowley
5
310
719435d98d452de7ac367c828266cf01?s=48 erikaheidi
12
3.9k

Transcript

  1. "QBDIF%SJMMͰ ਎ͷճΓͷϩάΛूܭͯ͠ΈΔ -FU`TUSZUPBHHSFHBUF JOEJWJEVBMMPHTVTJOH"QBDIF%SJMM 5PLZP"QBDIF%SJMM.FFUVQ !BDJEMFNPO

  2. "CPVU.F w 1SPHSBNNJOH(PMBOH 1FSM $  w %#%8).Z42-3FETIJGU w "QBDIF%SJMMIJTUPSZXFFLT

    !BDJEMFNPO .BTBUPTIJ,BXB[PF 4PGUXBSF&OHJOFFS BU,":"$*OD

  3. "QBDIF%SJMM w 4DIFNBGSFF42-&OHJOF NPEF  w %JTUSJCVUJPO.PEF
 XJUI)BEPPQ /P42- $MPVE4UPSBHF

    w &NCFEEFE.PEF
 XJUI-PDBMpMF +40/ $47 547 147 5SZUIJTUPEBZ

  4. 8IZ%SJMM .Z3FBTPO w 8IFO*OFFEUPJNQSPWFXFCBQQ QFSGPSNBODFʜ w *XBOUUPBHHSFHBUFSFTQPOTFUJNF QFSFOEQPJOUʜ w %SJMMDPVMESVORVFSZUP+40/

    ZFBI

  5. 2VJDL4UBSU w 4FF0GpDJBM5VUPSJBM%PDVNFOU
 l%SJMMJONJOVUFTz
 IUUQTESJMMBQBDIFPSHEPDTESJMMJONJOVUFT  w PS%FWFMPQFST*0#MPH&OUSZBCPVU "QBDIF%SJMM*NQSFTTJPO
 IUUQEFWDMBTTNFUIPEKQDMPVEBXTBQBDIFESJMMpSTUJNQSFTTJPO

    w 'PS.BD6TFSVTF)PNFCSFX
 
 SFRVJSFT+%,PSMBUFS $ brew install apache-drill

  6. $POWFSUOHJOYMPH w 8FVTFl-547zGPSNBUGPSOHJOYMPH w -547-BCFMFE5BCTFQBSBUFE7BMVFT
 IUUQMUTWPSH w "QBDIF%SJMMEPFTOPUTVQQPSU-547ZFU TP DPOWFSUMPHGSPN-547UP+40/

    w VTFMUTWJFXDPNNBOE WJBSVCZHFNT host:217.235.96.155 time:2015-09-14T00:00:00+09:00 method:POST uri:/api/hunting/challenge protocol:HTTP/1.1 status:200 size: 5790 request_time:0.383 upstream_response_time:0.438 referer:- user_agent:MyApp/11000 CFNetwork/711.3.18 Darwin/14.0.0 user_id: 76005617 geo:JP

  7. %FNP .MJOFT .#+40/

  8. $VU2VFSZ4USJOH w (SPVQCZVSJ
 CVUVSJDPOUBJOT2VFSZ4USJOHʜ w 4PMVUJPO
 3&(&91@3&1-"$& VSJ `a 

      BTQBUI +------------------------------------------------------------------------------------------------------------+----------+ | uri | maxtime | +------------------------------------------------------------------------------------------------------------+----------+ | /api/costume/hunting_item/equip | 9.695 | | /api/hunting/families?hunting_id=4000222&session=XXXXXXXXe937077b8cbc06ad3aec80fe&client_data_version=1329 | 9.273 | | /api/mypage?os_type=1&platform_type=1&session=XXXXXXXX7968eb69dd20d2bb1aec3943&client_data_version=1329 | 8.316 | | /api/mypage?os_type=2&platform_type=2&session=XXXXXXXXb63727f12bd2724ab9725885&client_data_version=1329 | 8.279 | | /api/hunting/families?hunting_id=4026012&session=XXXXXXXX2dc4a6668288c5f4a675f071&client_data_version=1330 | 7.926 | | /api/hunting/families?hunting_id=4025518&session=XXXXXXXX04634d3293a8c2317454b6a3&client_data_version=1329 | 7.896 |

  9. 1BSTFUJNFTUSJOH w UJNF5  w KVTUBTUSJOH OPUUJNFTUBNQʜ
 where `time` >

    ‘2015-09-14 07:00:00’
 EPFTOPUXPSLBTFYQFDUFEʜ w 4PMVUJPO
 50@5*.&45".1 AUJNFA `ZZZZ..EE5))NNTT; 
 "4BDDFTT@UJNF

  10. %FNP (3061#:  QFSDFOUJMFBOBMZTJT

  11. $PODMVTJPO w "QBDIF%SJMMJTSFBTPOBCMZGBTU w 5FNQPSBSZUBCMFJTVTFGVMGPSMPOH RVFSZ w $"45JTJNQPSUBOUUPSVORVFSZ w 4UJMMMJUUMFIBSEUPVTFZFU

    SFBE EPDVNFOUDBSFGVMMZ

  12. 5IBOLZPV