AWSをフル活用した大規模ログ収集基盤 / log collecting foundation of big data by AWS

0431014d47f66420bb69ffcf6eea13f6?s=47 yu
December 16, 2018

AWSをフル活用した大規模ログ収集基盤 / log collecting foundation of big data by AWS

SoftBank × AWS Drink Meetup #1

0431014d47f66420bb69ffcf6eea13f6?s=128

yu

December 16, 2018
Tweet

Transcript

  1. 6.
  2. 7.
  3. 9.
  4. 14.

    γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB

    1SFTUP PO&.3 4 4QBSL PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF
  5. 15.

    γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB

    1SFTUP PO&.3 4 4QBSL PO&.3 (MVF +FOLJOT PO&$ -BNCEB %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF ऩूɾ஝ੵ
  6. 17.

    γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB

    1SFTUP PO&.3 4 4QBSL PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF &5-
  7. 19.

    &5- 3FETIJGUɾ)JWFϩʔυ 4QBSLPO&.3Ͱ͸࣌ؒ෼ͷϩάΛೖྗͱͯ͠ҎԼεςοϓΛ࣮ߦ 4%JTU$QͰ໿ ݸ ,#ڃ ͷϑΝΠϧΛ໿ݸ .#d(#ڃ ͷϑΝΠϧʹू໿ <1PJOU>4QBSL

    )BEPPQ ͸େྔͷখ͞ͳϑΝΠϧΛѻ͏ͷ͸ෆಘҙ 4QBSLͰ([JQQFE+40/Λग़ྗ)JWFςʔϒϧʹ*/4&3507&383*5& εςοϓऴྃޙɺ&.3Ϋϥελʔ͸ࣗಈ࡟আ ࣌ؒ෼ͷॲཧΛಠཱͨ͠ΫϥελʔͰ࣮ߦ͢ΔͷͰϦΧόϦʔͳͲ͕΍Γ΍͍͢ 4্ͷ([JQϑΝΠϧΛ3FETIJGUͷ$01:ίϚϯυͰϩʔυ 4QBSL PO&.3 4 ([JQ 4 1BSRVFU 3FETIJGU 3%4 )JWF.FUBTUPSF ऩूɾ஝ੵ 4
  8. 20.

    γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB

    1SFTUP PO&.3 4 4QBSL PO&.3 (MVF +FOLJOT PO&$ -BNCEB %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF ෼ੳ
  9. 21.

    ෼ੳπʔϧ "UIFOB 1SFTUP PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT 3FETIJGU "UIFOB 1SFTUPPO&.3

    ೥ࠒΑΓར༻։࢝ ɹ 3FETIJGU ϩάऩू։࢝౰ॳΑΓར༻ ࠓޙͷϩά૿ՃΛݟࠐΈɺ &.3 "UIFOB΁Ҡߦத 4 "UIFOBͷར༻ྉۚߴಅ
  10. 23.

    "UIFOBར༻ͷڭ܇ ίετҙࣝ ͜ͷΫΤϦΛ࣮ߦ͢Δ͜ͱͰԿ(#εΩϟϯ͢Δͷ͔ɺͦͷ݁Ռྉۚ͸͍͘Βֻ ͔Δ͔Λҙࣝ͢Δ͜ͱ͸ඇৗʹॏཁ "84؅ཧऀ޲͚ σʔλΞφϦετʹྉۚΛೝࣝͤ͞Δ࢓૊Έ͕ඞཁ %3:ݪଇ %PO`U3FQFBU:PVSTFMG  ϔϏʔͳΫΤϦΛԿճ΋࣮ߦ͠ͳ͍ɾͤ͞ͳ͍

    Α͋͘ΔΫΤϦ͸ճ͚࣮ͩߦͯ݁͠ՌΛอଘ͢Δ ͓࡞๏ͷపఈ εΩϟϯྔ௿ݮͷͨΊύʔςΟγϣϯΛඞͣࢦఆ͢Δ ඞཁ࠷௿ݶͷΧϥϜΛ4&-&$5͢Δ 4&-&$5 ͸μϝ FUD "UIFOBഁ࢈͠ͳ͍ͨΊʹϢʔβʔ͕࣋ͭ΂͖ϚΠϯυηοτ
  11. 25.