Ryo Suzuki

KINESUSHI 2016(仮)
Kinesis Stream、Firehose、Analyticsでサーバレス

Transcript

2. classmethod.jp ,JOFTJTͰ͍͍ײ͡ʹαʔόϨε 2 2016/9/9 Classmethod ླ໦
3. Copylight © Classmethod, Inc. ࣗݾ঺հ 3 • ࢯ໊ɹླ໦ɹ྄ʢ͖ͣ͢Γΐ͏ʣ
   • 5XJUUFSɹTV[SZP
   • ॴଐɹΫϥεϝιουגࣜձࣾ
4. Copylight © Classmethod, Inc. 4 ޷͖ͳ"84 Amazon Route 53 Amazon Kinesis
5. classmethod.jp ຊ೔ͷ͓୊ 5 ,*/&464)* Ծ
6. classmethod.jp ,*/&464)*
    6
7. classmethod.jp ,*/&464)*
    Ծ 7
8. classmethod.jp AmazonKinesisͱ͸ 8 w"84
   ͷετϦʔϛϯάσʔλ޲͚ͷϓϥοτϑΥʔϜ
   w࿈ଓͯ͠ൃੜ͢ΔϩάͳͲͷσʔλΛ࣮֬ʹड͚औΓɺ ॲཧܥʹల։͢ΔػೳΛఏڙ
   w&$ͳͲͷՔಇ৘ใΛऩू͢Δ"84ͷγεςϜ͕લ਎
   wߴ͍ඇػೳཁ݅Λඋ͑Δ
9. classmethod.jp AWS࠶ೖ໳ AmazonKinesisฤ 9 w IUUQEFWDMBTTNFUIPEKQDMPVEBXTDNBEWFOUDBMFOEBSBXTSFFOUFSJOHLJOFTJT
10. classmethod.jp KinesisStream 10 w೥ɺ,JOFTJTͱͯ͠ϦϦʔε
    w.#ἬͷσʔλΛ࣌ؒ ࠷େ೔ อ؅
    wཧ࿦্ͷੑೳ্ݶͳ͠
    wσʔλ͸܁Γฦ͠ར༻Մೳ
    w-BNCEB
    Πϕϯτιʔεͱͯ͠ར༻Մೳ
11. classmethod.jp KinesisFirehose 11 w೥݄ϦϦʔε
    w64 ΦϨΰϯɺόʔδχΞ ɺ&6 ΞΠϧϥϯυ ͰՔಇத
    wొ࿥͞ΕͨσʔλΛόοϑΝ͠ ʙඵɺʙ .# ɺ4ɺ3FETIJGUɺ&MBTUJTFSDI4FSWJDF
    ʹग़ྗ
    w׬શैྔ՝ۚɺੑೳ γϟʔυ ؅ཧෆཁ
    
12. classmethod.jp Kinesis Streamར༻Πϝʔδ 12
13. classmethod.jp KinesisFirehoseར༻Πϝʔδ 13
14. classmethod.jp Kinesis,Firehose࿈ܞ 14
15. classmethod.jp blueprint kinesis-process-record-python 15
16. classmethod.jp Firehose(put_record_batch)ରԠ 16
17. classmethod.jp -BNCEB
    Πϕϯτઃఆ 17
18. classmethod.jp -BNCEB
    .POJUPSJOH 18
19. classmethod.jp 7JFX
    -PHT
    JO
    $MPVEXBUDI-PHT 19
20. classmethod.jp σʔλऔΓࠐΈඅ༻ (# 20 ΦϨΰϯ ౦ژ CloudwatchLogs $0.5 $0.76 KinesisFirehose $0.035 w$MPVEXBUDI-PHTͷసૹ୯Ձʹ஫ҙ
21. classmethod.jp ,JOFTJT
    4USFBN
    $MPVEXBUDI 21 w (FU3FDPSET4VDDFTT
    
    w (FU3FDPSET#ZUFT
    w (FU3FDPSET*UFSBUPS"HF.JMMJTFDPOET
    
22. classmethod.jp (FU3FDPSET
    *UFSBUPS"HF.JMMJTFDPOET 22 w Ϩίʔυ͕,JOFTJTͷετϦʔϜʹॻ͖ࠐ·Εͨ࣌ࠁ͔ ΒɺಡΈग़͞ΕΔ·Ͱͷ஗Ԇ
    wʹ͍ۙ΄ͲϦΞϧλΠϜͰ(&5͞Ε͍ͯΔࣄΛࣔ͢
    w,JOFTJT
    ίϯγϡϚʔΞϓϦέʔγϣϯ
 (&5
    ͢Δ-BNCEB ͷੑೳෆ଍΍ɺ࿈ଓͨ͠ҟৗऴྃ ʹΑΓॲཧ͕ਐ·ͳ͍৔߹ɺ૿Ճ܏޲Λࣔ͠·͢ɻ
    wNT ࣌ؒ ʹࢸͬͨ৔߹ɺϨίʔυ͸࡟আ ͞ΕΔͨΊσʔλϩετͱͳΓ·͢ɻ
    
23. classmethod.jp ίϯγϡϚʔͷ஗Ԇରࡦ  23 w,JOFTJT
    σʔλอ࣋࣌ؒͷԆ௕
    w࣌ؒˠ೔ʹԆ௕
    wෛՙͷऩଋΛ଴ͭ
    wόονॲཧ"1*ͷ׆༻
    w,JOFTJT
    4USFBN
    
    QVUSFDPSET
    w'JSFIPTF
    
    QVUSFDPSETCBUDI
    w%ZOBNP%#
    #BUDI8SJUF*UFN
24. classmethod.jp ίϯγϡϚʔͷ஗Ԇରࡦ  24 w,JOFTJT
    γϟʔυ਺Λ૿΍͢
    w-BNCEBͷಉ࣮࣌ߦ਺Λ֬อ
    w-BNCEBׂ౰ϝϞϦͷ૿ڧ
    wϝϞϦɺ$16͕ϘτϧωοΫͷ৔߹
    wΞʔΩςΫνϟݟ௚͠
    w,JOFTJTΛଟஈॲཧ
    w,JOFTJT
    "OBMZUJDTɺ'JSFIPTF׆༻
    w&$ɺ&.3
25. classmethod.jp Kinesis Analytics 25 w೥݄ϦϦʔε
    w64 ΦϨΰϯɺόʔδχΞ ɺ&6 ΞΠϧϥϯυ ɺϦʔ δϣϯͰՔಇத
    
26. classmethod.jp KinesisAnalytics 26 w,JOFTJT
    4USFBN
    'JSFIPTFઐ༻ͷ$&1Τϯδϯ
 $PNQMFY
    &WFOU
    1SPDFTTJOHɿෳ߹Πϕϯτॲཧʣ
    w42-ͰϑΟϧλɺλΠϜ΢Οϯυ΢ॲཧ
27. classmethod.jp Kinesis Analytics,Firehose,Stream 27
28. classmethod.jp /PSJLSB 28 wIUUQOPSJLSBHJUIVCJP
29. /PSJLSB 'MVFOUEͰ%P4߈ܸΛϒϩοΫ ͢Δ࢓૊ΈΛ࡞ͬͯΈͨ 29 http://dev.classmethod.jp/cloud/aws/block_dos_attack_by_norikra/
30. classmethod.jp ଟஈKinesisΞʔΩςΫνϟ 30