Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
AWSをフル活用した大規模ログ収集基盤 / log collecting foundation...
Search
yu
December 16, 2018
Technology
0
940
AWSをフル活用した大規模ログ収集基盤 / log collecting foundation of big data by AWS
SoftBank × AWS Drink Meetup #1
yu
December 16, 2018
Tweet
Share
More Decks by yu
See All by yu
Spark Streamingで全世界の 混雑状況を20分ごとに集計 / All over the world with Spark Streaming Congested situation every 20 minutes
hamada
0
1k
AWSをフル活用した大規模ログ収集基盤.pdf
hamada
0
48
Other Decks in Technology
See All in Technology
KiCadでPad on Viaの基板作ってみた
iotengineer22
0
250
ドメイン特化なCLIPモデルとデータセットの紹介
tattaka
2
540
生成AI開発案件におけるClineの業務活用事例とTips
shinya337
0
200
AIとともに進化するエンジニアリング / Engineering-Evolving-with-AI_final.pdf
lycorptech_jp
PRO
0
140
asken AI勉強会(Android)
tadashi_sato
0
150
mrubyと micro-ROSが繋ぐロボットの世界
kishima
3
390
LangChain Interrupt & LangChain Ambassadors meetingレポート
os1ma
2
250
CI/CD/IaC 久々に0から環境を作ったらこうなりました
kaz29
1
210
Zephyr RTOSを使った開発コンペに参加した件
iotengineer22
1
170
Tech-Verse 2025 Keynote
lycorptech_jp
PRO
0
1.5k
生成AIで小説を書くためにプロンプトの制約や原則について学ぶ / prompt-engineering-for-ai-fiction
nwiizo
6
3.8k
Geminiとv0による高速プロトタイピング
shinya337
0
210
Featured
See All Featured
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
252
21k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
125
52k
4 Signs Your Business is Dying
shpigford
184
22k
Designing for humans not robots
tammielis
253
25k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.4k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.4k
Automating Front-end Workflow
addyosmani
1370
200k
Making Projects Easy
brettharned
116
6.3k
Optimising Largest Contentful Paint
csswizardry
37
3.3k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
46
9.6k
The Language of Interfaces
destraynor
158
25k
Transcript
"84Λϑϧ׆༻ͨ͠ େنϩάऩूج൫ 4PGUCBOL$PSQ
ᖛాɹ༎ ιϑτόϯΫגࣜձࣾ ݉ "HPPQ ͖ͳ"84αʔϏε "UIFOB(MVF όοΫΤϯυશൠ
Ґஔใऩू ม ׆༻
Ґஔใऩू ม ׆༻
εϚϗΞϓϦͷاը։ൃ اը͔Β։ൃ·ͰશͯԽ ϩάΛूΊΔػೳΛΞϓϦʹՃ ϏοάσʔλͷऩूɾՁͷఏڙ
None
None
Ґஔใऩू ม ׆༻
None
Title Text Main Point -! - 10 ϐϯϙΠϯτਓྲྀσʔλͷՄࢹԽ
ڵຯ͕͋Δํฐࣾ)1·Ͱ IUUQTXXXBHPPQDPKQ
Ґஔใऩू ม ਓͷྲྀΕ
ϩάσʔλͷ֓ཁ εϚʔτϑΥϯΞϓϦ͔Βऩू த௨৴ঢ়گͳͲʹؔ͢Δϩά +40/ܗࣜ Ͱऩू͢ΔσʔλϘϦϡʔϜ ݅ԯ݅ σʔλαΠζ5# γεςϜ͕ऩू͢Δϩά
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF +FOLJOT PO&$ -BNCEB %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF ऩूɾੵ
ऩूɾੵ +BWB൛ͷ,JOFTJT1SPEVDFS-JCSBSZͱ,JOFTJT$POTVNFS-JCSBSZΛར༻ ,JOFTJTϓϩσϡʔαʔड৴ͨ͠+40/Λ΄΅ͦͷ··,JOFTJTʹೖ ,JOFTJTʹೖΕ͓͚ͯ࣌ؒ ࠷ؒ σʔλϩετͷ৺͕ແ͍ͨΊ ,JOFTJTίϯγϡʔϚʔҎԼͷॲཧΛ࣮ࢪ +40/Λύʔεͯ͠ޙଓͷੳͰ༻͢ΔใΛՃ &$ͰՔಇ͢ΔqVFOUEʹόοϑΝͯ͠ҰఆִؒͰ4ʹ([JQܗࣜͰग़ྗ <1PJOU>,JOFTJTಋೖͰ҆ఆੑ͕͔ͳΓ্ˠσʔλऩूܥʹ͔ͳΓΦεεϝ
"VUP4DBMF&$ ,JOFTJT "VUP4DBMF&$ 4
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF &5-
&5- 3FETIJGUɾ)JWFϩʔυ <1PJOU>)JWFϝλετΞ3%4ΑΓ(MVF%BUB$BUBMPH͕Φεεϝ 3%4͕410' ୯Ұো ʹͳΒͳ͍Α͏ʹؾΛݣ͏ඞཁ͕͋Δ 3%4ಉ࣌ଓͷ੍ݶ͕͋ΔͨΊ&.3Ϋϥελʔͷಉ࣌ىಈʹ੍ݶ͕ੜ͡Δ ಉ࣌ଓϝϞϦґଘͷύϥϝʔλʔ ಉ࣌ଓͷ্ݶΛ্͛ΔͨΊʹΠϯελϯελΠϓΛ্͛Δඞཁ͕͋Δ ϝλσʔλ͔͠ཧ͠ͳ͍ͷʹϦονͳεϖοΫମແ͍
(MVF%BUB$BUBMPHϑϧϚωʔδυ͔ͭಉ࣌ଓͷ੍ݶͳ͠ 4QBSL PO&.3 4 ([JQ 4 1BSRVFU 3FETIJGU 3%4 )JWF.FUBTUPSF ऩूɾੵ 4
&5- 3FETIJGUɾ)JWFϩʔυ 4QBSLPO&.3Ͱ࣌ؒͷϩάΛೖྗͱͯ͠ҎԼεςοϓΛ࣮ߦ 4%JTU$QͰ ݸ ,#ڃ ͷϑΝΠϧΛݸ .#d(#ڃ ͷϑΝΠϧʹू <1PJOU>4QBSL
)BEPPQ େྔͷখ͞ͳϑΝΠϧΛѻ͏ͷෆಘҙ 4QBSLͰ([JQQFE+40/Λग़ྗ)JWFςʔϒϧʹ*/4&3507&383*5& εςοϓऴྃޙɺ&.3Ϋϥελʔࣗಈআ ࣌ؒͷॲཧΛಠཱͨ͠ΫϥελʔͰ࣮ߦ͢ΔͷͰϦΧόϦʔͳͲ͕Γ͍͢ 4্ͷ([JQϑΝΠϧΛ3FETIJGUͷ$01:ίϚϯυͰϩʔυ 4QBSL PO&.3 4 ([JQ 4 1BSRVFU 3FETIJGU 3%4 )JWF.FUBTUPSF ऩूɾੵ 4
γεςϜΞʔΩςΫνϟ "VUP4DBMJOH &$ ,JOFTJT "VUP4DBMJOH &$ 4 4 3FETIJGU "UIFOB
1SFTUP PO&.3 4 4QBSL PO&.3 (MVF +FOLJOT PO&$ -BNCEB %FWFMPQFST %BUB"OBMZTUT σʔλϑϩʔ ࢀরͳͲ 3%4 )JWF.FUBTUPSF ੳ
ੳπʔϧ "UIFOB 1SFTUP PO&.3 (MVF %FWFMPQFST %BUB"OBMZTUT 3FETIJGU "UIFOB 1SFTUPPO&.3
ࠒΑΓར༻։࢝ ɹ 3FETIJGU ϩάऩू։࢝ॳΑΓར༻ ࠓޙͷϩά૿ՃΛݟࠐΈɺ &.3 "UIFOBҠߦத 4 "UIFOBͷར༻ྉۚߴಅ
"UIFOBͷར༻ྉۚߴಅͷݪҼ 3FEBTIͷΫΤϦεέδϡʔϧػೳ 3FEBTIʹอଘͨ͠ΫΤϦΛࢦఆͨ͠සͰ࣮ߦͰ͖Δ "UIFOBͷ͍উखͷྑ͞ ͋ΔఔɺແͳΫΤϦݱ࣮తͳ࣌ؒͰॲཧͰ͖Δ 5#ΛεΩϟϯ͢ΔΫΤϦ܈͕සൟʹ࣮ߦ τʔλϧεΩϟϯαΠζ͕1#ΛΦʔόʔ
"UIFOBར༻ͷڭ܇ ίετҙࣝ ͜ͷΫΤϦΛ࣮ߦ͢Δ͜ͱͰԿ(#εΩϟϯ͢Δͷ͔ɺͦͷ݁Ռྉ͍ۚ͘Βֻ ͔Δ͔Λҙࣝ͢Δ͜ͱඇৗʹॏཁ "84ཧऀ͚ σʔλΞφϦετʹྉۚΛೝࣝͤ͞ΔΈ͕ඞཁ %3:ݪଇ %PO`U3FQFBU:PVSTFMG ϔϏʔͳΫΤϦΛԿճ࣮ߦ͠ͳ͍ɾͤ͞ͳ͍
Α͋͘ΔΫΤϦճ͚࣮ͩߦͯ݁͠ՌΛอଘ͢Δ ͓࡞๏ͷపఈ εΩϟϯྔݮͷͨΊύʔςΟγϣϯΛඞͣࢦఆ͢Δ ඞཁ࠷ݶͷΧϥϜΛ4&-&$5͢Δ 4&-&$5 μϝ FUD "UIFOBഁ࢈͠ͳ͍ͨΊʹϢʔβʔ͕͖࣋ͭϚΠϯυηοτ
ࠓޙͷల SFJOWFOUͰൃද͞Εͨ৽αʔϏεΛੵۃతʹಋೖ༧ఆ 5JNFTUSFBN $POUPM5PXFS -BLF'PSNBUJPO 5SBOTJU(BUFXBZ
&0'