Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
AWSをフル活用した大規模ログ収集基盤 / log collecting foundation of big data by AWS
Search
yu
December 16, 2018
Technology
0
900
AWSをフル活用した大規模ログ収集基盤 / log collecting foundation of big data by AWS
SoftBank × AWS Drink Meetup #1
yu
December 16, 2018
Tweet
Share
More Decks by yu
See All by yu
Spark Streamingで全世界の 混雑状況を20分ごとに集計 / All over the world with Spark Streaming Congested situation every 20 minutes
hamada
0
1k
AWSをフル活用した大規模ログ収集基盤.pdf
hamada
0
40
Other Decks in Technology
See All in Technology
サーバー間 GraphQL と webmock-graphql の話 / server-to-server graphql and webmock-graphql
qsona
2
190
「スニダン」開発組織の構造に込めた意図 ~組織作りはパッションや政治ではない!~
rinchsan
3
570
一生覚えておきたい「システム開発=コミュニケーション」〜初めての実務案件振り返りLT〜
maimyyym
1
160
地理空間データ可視化・解析・活用ソリューション Pacific Spatial Solutions (PSS)
pacificspatialsolutions
0
300
JAWS-UG Bedrock Claude Night
yamahiro
3
610
LangSmith入門―トレース/評価/プロンプト管理などを担うLLMアプリ開発プラットフォーム
os1ma
3
350
KubeCon EU 2024 Recap “Kubernetes Policy Time Machine: Where to Next?”
ryysud
0
220
LayerXにおけるLLMプロダクト開発の今までとこれから
layerx
PRO
1
390
JSON攻略法.pdf
miyakemito
8
5.1k
GraphQL 成熟度モデルの紹介と、プロダクトに当てはめた事例 / GraphQL maturity model
mh4gf
7
1.4k
Além do else! Categorizando Pokemóns com Pattern Matching no JavaScript
wmsbill
0
640
Reducing Cross-Zone Egress at Spotify with Custom gRPC Load Balancing Recap
koh_naga
0
210
Featured
See All Featured
We Have a Design System, Now What?
morganepeng
43
6.8k
The Cult of Friendly URLs
andyhume
74
5.7k
Pencils Down: Stop Designing & Start Developing
hursman
117
11k
Intergalactic Javascript Robots from Outer Space
tanoku
266
26k
A Tale of Four Properties
chriscoyier
151
22k
Clear Off the Table
cherdarchuk
84
310k
Designing with Data
zakiwarfel
96
4.8k
Adopting Sorbet at Scale
ufuk
68
8.6k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
40
4.4k
Producing Creativity
orderedlist
PRO
337
39k
The Cost Of JavaScript in 2023
addyosmani
16
3.9k
GraphQLとの向き合い方2022年版
quramy
32
12k
Transcript
"84Λϑϧ׆༻ͨ͠ େنϩάऩूج൫ 4PGUCBOL$PSQ
ᖛాɹ༎ ιϑτόϯΫגࣜձࣾ ݉ "HPPQ ͖ͳ"84αʔϏε "UIFOB(MVF όοΫΤϯυશൠ
Ґஔใऩू ม ׆༻
Ґஔใऩू ม ׆༻
εϚϗΞϓϦͷاը։ൃ اը͔Β։ൃ·ͰશͯԽ ϩάΛूΊΔػೳΛΞϓϦʹՃ ϏοάσʔλͷऩूɾՁͷఏڙ
None
None
Ґஔใऩू ม ׆༻
None
Title Text Main Point -! - 10 ϐϯϙΠϯτਓྲྀσʔλͷՄࢹԽ
ڵຯ͕͋Δํฐࣾ)1·Ͱ IUUQTXXXBHPPQDPKQ
Ґஔใऩू ม ਓͷྲྀΕ
ϩάσʔλͷ֓ཁ εϚʔτϑΥϯΞϓϦ͔Βऩू த௨৴ঢ়گͳͲʹؔ͢Δϩά +40/ܗࣜ Ͱऩू͢ΔσʔλϘϦϡʔϜ ݅ԯ݅ σʔλαΠζ5# γεςϜ͕ऩू͢Δϩά
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF +FOLJOT PO&$ -BNCEB %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF ऩूɾੵ
ऩूɾੵ +BWB൛ͷ,JOFTJT1SPEVDFS-JCSBSZͱ,JOFTJT$POTVNFS-JCSBSZΛར༻ ,JOFTJTϓϩσϡʔαʔड৴ͨ͠+40/Λ΄΅ͦͷ··,JOFTJTʹೖ ,JOFTJTʹೖΕ͓͚ͯ࣌ؒ ࠷ؒ σʔλϩετͷ৺͕ແ͍ͨΊ ,JOFTJTίϯγϡʔϚʔҎԼͷॲཧΛ࣮ࢪ +40/Λύʔεͯ͠ޙଓͷੳͰ༻͢ΔใΛՃ &$ͰՔಇ͢ΔqVFOUEʹόοϑΝͯ͠ҰఆִؒͰ4ʹ([JQܗࣜͰग़ྗ <1PJOU>,JOFTJTಋೖͰ҆ఆੑ͕͔ͳΓ্ˠσʔλऩूܥʹ͔ͳΓΦεεϝ
"VUP4DBMF&$ ,JOFTJT "VUP4DBMF&$ 4
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF &5-
&5- 3FETIJGUɾ)JWFϩʔυ <1PJOU>)JWFϝλετΞ3%4ΑΓ(MVF%BUB$BUBMPH͕Φεεϝ 3%4͕410' ୯Ұো ʹͳΒͳ͍Α͏ʹؾΛݣ͏ඞཁ͕͋Δ 3%4ಉ࣌ଓͷ੍ݶ͕͋ΔͨΊ&.3Ϋϥελʔͷಉ࣌ىಈʹ੍ݶ͕ੜ͡Δ ಉ࣌ଓϝϞϦґଘͷύϥϝʔλʔ ಉ࣌ଓͷ্ݶΛ্͛ΔͨΊʹΠϯελϯελΠϓΛ্͛Δඞཁ͕͋Δ ϝλσʔλ͔͠ཧ͠ͳ͍ͷʹϦονͳεϖοΫମແ͍
(MVF%BUB$BUBMPHϑϧϚωʔδυ͔ͭಉ࣌ଓͷ੍ݶͳ͠ 4QBSL PO&.3 4 ([JQ 4 1BSRVFU 3FETIJGU 3%4 )JWF.FUBTUPSF ऩूɾੵ 4
&5- 3FETIJGUɾ)JWFϩʔυ 4QBSLPO&.3Ͱ࣌ؒͷϩάΛೖྗͱͯ͠ҎԼεςοϓΛ࣮ߦ 4%JTU$QͰ ݸ ,#ڃ ͷϑΝΠϧΛݸ .#d(#ڃ ͷϑΝΠϧʹू <1PJOU>4QBSL
)BEPPQ େྔͷখ͞ͳϑΝΠϧΛѻ͏ͷෆಘҙ 4QBSLͰ([JQQFE+40/Λग़ྗ)JWFςʔϒϧʹ*/4&3507&383*5& εςοϓऴྃޙɺ&.3Ϋϥελʔࣗಈআ ࣌ؒͷॲཧΛಠཱͨ͠ΫϥελʔͰ࣮ߦ͢ΔͷͰϦΧόϦʔͳͲ͕Γ͍͢ 4্ͷ([JQϑΝΠϧΛ3FETIJGUͷ$01:ίϚϯυͰϩʔυ 4QBSL PO&.3 4 ([JQ 4 1BSRVFU 3FETIJGU 3%4 )JWF.FUBTUPSF ऩूɾੵ 4
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF +FOLJOT PO&$ -BNCEB %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF ੳ
ੳπʔϧ "UIFOB 1SFTUP PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT 3FETIJGU "UIFOB 1SFTUPPO&.3
ࠒΑΓར༻։࢝ ɹ 3FETIJGU ϩάऩू։࢝ॳΑΓར༻ ࠓޙͷϩά૿ՃΛݟࠐΈɺ &.3 "UIFOBҠߦத 4 "UIFOBͷར༻ྉۚߴಅ
"UIFOBͷར༻ྉۚߴಅͷݪҼ 3FEBTIͷΫΤϦεέδϡʔϧػೳ 3FEBTIʹอଘͨ͠ΫΤϦΛࢦఆͨ͠සͰ࣮ߦͰ͖Δ "UIFOBͷ͍উखͷྑ͞ ͋ΔఔɺແͳΫΤϦݱ࣮తͳ࣌ؒͰॲཧͰ͖Δ 5#ΛεΩϟϯ͢ΔΫΤϦ܈͕සൟʹ࣮ߦ τʔλϧεΩϟϯαΠζ͕1#ΛΦʔόʔ
"UIFOBར༻ͷڭ܇ ίετҙࣝ ͜ͷΫΤϦΛ࣮ߦ͢Δ͜ͱͰԿ(#εΩϟϯ͢Δͷ͔ɺͦͷ݁Ռྉ͍ۚ͘Βֻ ͔Δ͔Λҙࣝ͢Δ͜ͱඇৗʹॏཁ "84ཧऀ͚ σʔλΞφϦετʹྉۚΛೝࣝͤ͞ΔΈ͕ඞཁ %3:ݪଇ %PO`U3FQFBU:PVSTFMG ϔϏʔͳΫΤϦΛԿճ࣮ߦ͠ͳ͍ɾͤ͞ͳ͍
Α͋͘ΔΫΤϦճ͚࣮ͩߦͯ݁͠ՌΛอଘ͢Δ ͓࡞๏ͷపఈ εΩϟϯྔݮͷͨΊύʔςΟγϣϯΛඞͣࢦఆ͢Δ ඞཁ࠷ݶͷΧϥϜΛ4&-&$5͢Δ 4&-&$5 μϝ FUD "UIFOBഁ࢈͠ͳ͍ͨΊʹϢʔβʔ͕͖࣋ͭϚΠϯυηοτ
ࠓޙͷల SFJOWFOUͰൃද͞Εͨ৽αʔϏεΛੵۃతʹಋೖ༧ఆ 5JNFTUSFBN $POUPM5PXFS -BLF'PSNBUJPO 5SBOTJU(BUFXBZ
&0'