Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ryo Suzuki

B88e743f16c9365d6cd988d787e6b8ff?s=47 suzryo
September 09, 2016

Ryo Suzuki

KINESUSHI 2016(仮)
Kinesis Stream、Firehose、Analyticsでサーバレス

B88e743f16c9365d6cd988d787e6b8ff?s=128

suzryo

September 09, 2016
Tweet

Transcript

  1. None
  2. classmethod.jp ,JOFTJTͰ͍͍ײ͡ʹαʔόϨε 2 2016/9/9 Classmethod ླ໦

  3. Copylight © Classmethod, Inc. ࣗݾ঺հ 3 • ࢯ໊ɹླ໦ɹ྄ʢ͖ͣ͢Γΐ͏ʣ • 5XJUUFSɹTV[SZP

    • ॴଐɹΫϥεϝιουגࣜձࣾ
  4. Copylight © Classmethod, Inc. 4 ޷͖ͳ"84 Amazon Route 53 Amazon

    Kinesis
  5. classmethod.jp ຊ೔ͷ͓୊ 5 ,*/&464)* Ծ

  6. classmethod.jp ,*/&464)*  6

  7. classmethod.jp ,*/&464)* Ծ 7

  8. classmethod.jp AmazonKinesisͱ͸ 8 w"84ͷετϦʔϛϯάσʔλ޲͚ͷϓϥοτϑΥʔϜ w࿈ଓͯ͠ൃੜ͢ΔϩάͳͲͷσʔλΛ࣮֬ʹड͚औΓɺ ॲཧܥʹల։͢ΔػೳΛఏڙ w&$ͳͲͷՔಇ৘ใΛऩू͢Δ"84ͷγεςϜ͕લ਎ wߴ͍ඇػೳཁ݅Λඋ͑Δ

  9. classmethod.jp AWS࠶ೖ໳ AmazonKinesisฤ 9 w IUUQEFWDMBTTNFUIPEKQDMPVEBXTDNBEWFOUDBMFOEBSBXTSFFOUFSJOHLJOFTJT

  10. classmethod.jp KinesisStream 10 w೥ɺ,JOFTJTͱͯ͠ϦϦʔε w.#ἬͷσʔλΛ࣌ؒ ࠷େ೔ อ؅ wཧ࿦্ͷੑೳ্ݶͳ͠ wσʔλ͸܁Γฦ͠ར༻Մೳ w-BNCEBΠϕϯτιʔεͱͯ͠ར༻Մೳ

  11. classmethod.jp KinesisFirehose 11 w೥݄ϦϦʔε w64 ΦϨΰϯɺόʔδχΞ ɺ&6 ΞΠϧϥϯυ ͰՔಇத wొ࿥͞ΕͨσʔλΛόοϑΝ͠

    ʙඵɺʙ .# ɺ4ɺ3FETIJGUɺ&MBTUJTFSDI4FSWJDFʹग़ྗ w׬શैྔ՝ۚɺੑೳ γϟʔυ ؅ཧෆཁ
  12. classmethod.jp Kinesis Streamར༻Πϝʔδ 12

  13. classmethod.jp KinesisFirehoseར༻Πϝʔδ 13

  14. classmethod.jp Kinesis,Firehose࿈ܞ 14

  15. classmethod.jp blueprint kinesis-process-record-python 15

  16. classmethod.jp Firehose(put_record_batch)ରԠ 16

  17. classmethod.jp -BNCEBΠϕϯτઃఆ 17

  18. classmethod.jp -BNCEB.POJUPSJOH 18

  19. classmethod.jp 7JFX-PHTJO$MPVEXBUDI-PHT 19

  20. classmethod.jp σʔλऔΓࠐΈඅ༻ (# 20 ΦϨΰϯ ౦ژ CloudwatchLogs $0.5 $0.76 KinesisFirehose

    $0.035 w$MPVEXBUDI-PHTͷసૹ୯Ձʹ஫ҙ
  21. classmethod.jp ,JOFTJT4USFBN$MPVEXBUDI 21 w (FU3FDPSET4VDDFTT  w (FU3FDPSET#ZUFT w (FU3FDPSET*UFSBUPS"HF.JMMJTFDPOET

  22. classmethod.jp (FU3FDPSET *UFSBUPS"HF.JMMJTFDPOET 22 w Ϩίʔυ͕,JOFTJTͷετϦʔϜʹॻ͖ࠐ·Εͨ࣌ࠁ͔ ΒɺಡΈग़͞ΕΔ·Ͱͷ஗Ԇ wʹ͍ۙ΄ͲϦΞϧλΠϜͰ(&5͞Ε͍ͯΔࣄΛࣔ͢ w,JOFTJTίϯγϡϚʔΞϓϦέʔγϣϯ
 (&5͢Δ-BNCEB

    ͷੑೳෆ଍΍ɺ࿈ଓͨ͠ҟৗऴྃ ʹΑΓॲཧ͕ਐ·ͳ͍৔߹ɺ૿Ճ܏޲Λࣔ͠·͢ɻ wNT ࣌ؒ ʹࢸͬͨ৔߹ɺϨίʔυ͸࡟আ ͞ΕΔͨΊσʔλϩετͱͳΓ·͢ɻ
  23. classmethod.jp ίϯγϡϚʔͷ஗Ԇରࡦ  23 w,JOFTJTσʔλอ࣋࣌ؒͷԆ௕ w࣌ؒˠ೔ʹԆ௕ wෛՙͷऩଋΛ଴ͭ wόονॲཧ"1*ͷ׆༻ w,JOFTJT4USFBNQVUSFDPSET w'JSFIPTFQVUSFDPSETCBUDI

    w%ZOBNP%##BUDI8SJUF*UFN
  24. classmethod.jp ίϯγϡϚʔͷ஗Ԇରࡦ  24 w,JOFTJTγϟʔυ਺Λ૿΍͢ w-BNCEBͷಉ࣮࣌ߦ਺Λ֬อ w-BNCEBׂ౰ϝϞϦͷ૿ڧ wϝϞϦɺ$16͕ϘτϧωοΫͷ৔߹ wΞʔΩςΫνϟݟ௚͠ w,JOFTJTΛଟஈॲཧ

    w,JOFTJT"OBMZUJDTɺ'JSFIPTF׆༻ w&$ɺ&.3
  25. classmethod.jp Kinesis Analytics 25 w೥݄ϦϦʔε w64 ΦϨΰϯɺόʔδχΞ ɺ&6 ΞΠϧϥϯυ ɺϦʔ

    δϣϯͰՔಇத
  26. classmethod.jp KinesisAnalytics 26 w,JOFTJT4USFBN 'JSFIPTFઐ༻ͷ$&1Τϯδϯ
 $PNQMFY&WFOU1SPDFTTJOHɿෳ߹Πϕϯτॲཧʣ w42-ͰϑΟϧλɺλΠϜ΢Οϯυ΢ॲཧ

  27. classmethod.jp Kinesis Analytics,Firehose,Stream 27

  28. classmethod.jp /PSJLSB 28 wIUUQOPSJLSBHJUIVCJP

  29. /PSJLSB 'MVFOUEͰ%P4߈ܸΛϒϩοΫ ͢Δ࢓૊ΈΛ࡞ͬͯΈͨ 29 http://dev.classmethod.jp/cloud/aws/block_dos_attack_by_norikra/

  30. classmethod.jp ଟஈKinesisΞʔΩςΫνϟ 30

  31. None