Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Spark Streamingで全世界の 混雑状況を20分ごとに集計 / All over the world with Spark Streaming Congested situation every 20 minutes
Search
yu
March 14, 2019
Technology
0
1k
Spark Streamingで全世界の 混雑状況を20分ごとに集計 / All over the world with Spark Streaming Congested situation every 20 minutes
yu
March 14, 2019
Tweet
Share
More Decks by yu
See All by yu
AWSをフル活用した大規模ログ収集基盤.pdf
hamada
0
40
AWSをフル活用した大規模ログ収集基盤 / log collecting foundation of big data by AWS
hamada
0
900
Other Decks in Technology
See All in Technology
Janus
bkuhlmann
1
490
小さな開発会社がWebサービスを作る理由
polidog
PRO
1
160
OpenTelemetry を使ったトレースエグザンプラーの活用 / otel-trace-exemplar
k6s4i53rx
2
640
Databricks:『生成AI World Cup』のご案内
databricksjapan
2
150
AWS を使う上で知っておきたいオンプレミス知識/aws-on-premise-essentials
emiki
1
4.2k
ChatGPT for IT Service Management (IT Pro)
dahatake
2
200
コードを書く隙間を見つけて生きていく技術/Findy 思考の現在地
fujiwara3
24
5.2k
The CloudCompare project by Dr. Daniel Girardeau-Montaut
kentaitakura
0
510
Reducing Cross-Zone Egress at Spotify with Custom gRPC Load Balancing Recap
koh_naga
0
130
転移学習とドメイン適応の基礎
kmatsui
2
570
o11y入門_外形監視を利用したWebアプリケーションへの最適なモニタリング_TechBrew
k5k
3
100
Databricks におけるデータエンジニアリング
databricksjapan
0
380
Featured
See All Featured
Imperfection Machines: The Place of Print at Facebook
scottboms
258
12k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
9
8.3k
Music & Morning Musume
bryan
41
5.6k
[RailsConf 2023] Rails as a piece of cake
palkan
22
3.9k
Principles of Awesome APIs and How to Build Them.
keavy
120
16k
Art, The Web, and Tiny UX
lynnandtonic
288
19k
Producing Creativity
orderedlist
PRO
336
39k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
243
20k
Building Better People: How to give real-time feedback that sticks.
wjessup
354
18k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
1
3.4k
Building Applications with DynamoDB
mza
88
5.6k
Ruby is Unlike a Banana
tanoku
96
10k
Transcript
݄ ιϑτόϯΫגࣜձࣾᖛా༎ 4QBSL4USFBNJOHͰશੈքͷ ࠞࡶঢ়گΛ͝ͱʹूܭ )BEPPQ4QBSL$POGFSFODF+BQBO
ᖛాɹ༎ ιϑτόϯΫגࣜձࣾ ݉ גࣜձࣾ"HPPQ ͖ͳ"84αʔϏε "UIFOB(MVF όοΫΤϯυશൠ
"HPPQʹ͍ͭͯ اۀ໊ גࣜձࣾ"HPPQ ઃཱ࣌ظ ݄ දऔక ࣲࢁٱ גओ ιϑτόϯΫגࣜձࣾ
ࢿຊۚ ԯ ສԁ ैۀһ ໊ ॅॴ ˟౦ژौ୩۠ਆٶલ ࣄۀ༰ ɹҐஔใϏοάσʔλࣄۀ ɹɹɾҐஔใϏοάσʔλऩूղੳ ɹɹɾҐஔใؔ࿈σʔλൢച ɹɹɾҐஔใαʔϏεΞϓϦఏڙ ˞݄ݱࡏ ҐஔใºϏοάσʔλઐاۀ
ਓྲྀάϩʔόϧϏοάσʔλ ਓʑͷߦಈΛৄࡉʹѲ
Strictly Confidential άϩʔόϧϏοάσʔλ εϚʔτϑΥϯΞϓϦέʔγϣϯ͔Β ੈքͷ(14ҐஔใσʔλΛऔಘ /VNCFSPG-PHT %BUB4J[F ԯ݅
EBZ 5#ڃ EBZ
None
ࠞࡶϚοϓ
ΞʔΩςΫνϟ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH "VUP4DBMJOH ,JOFTJT 4 &MBTUJD4FBSDI &.3
4 ࠞࡶϚοϓ ϩάऩूج൫ "1* ࠞࡶϚοϓ &5- ɾɾɾ
"1* ࠞࡶϚοϓ ΞʔΩςΫνϟ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH "VUP4DBMJOH ,JOFTJT 4
&MBTUJD4FBSDI &.3 4 ࠞࡶϚοϓ ϩάऩूج൫ &5- ɾɾɾ
ϩάऩूج൫ ,JOFTJTʢେنετϦʔϛϯάσʔλ༻ΩϡʔΠϯάαʔϏεʣΛத৺ͱͨ͠ߏ લஈͷ"VUP4DBMJOH,JOFTJT1SPEVDFS-JCSBSZΛ༻͠ɺͦͷ··,JOFTJTʹೖ ޙஈͷ"VUP4DBMJOH̎ͭͷॲཧΛ࣮ࢪ ,JOFTJT$POTVNFS-JCSBSZΛ༻͠ɺ,JOFTJT͔Β+40/Λऔಘɾύʔεͯ͠ޙ ଓͷੳͰ༻͢ΔใΛՃ qVFOUEΛ༻͍ͯɺҰఆִؒͰ4ʹ([JQܗࣜͰग़ྗ ,JOFTJTʹೖΕ͓͚ͯ࣌ؒ ࠷ؒ σʔλϩετͷ৺͕ແ͍ͨΊ
<1PJOU>,JOFTJTಋೖͰ҆ఆੑ͕͔ͳΓ্ˠσʔλऩूܥʹ͔ͳΓΦεεϝ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH 4 1SPEVDFS -JCSBSZ $POTVNFS -JCSBSZ &5- ɾɾɾ
ΞʔΩςΫνϟ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH "VUP4DBMJOH ,JOFTJT 4 &MBTUJD4FBSDI &.3
4 ࠞࡶϚοϓ "1* ࠞࡶϚοϓ ϩάऩूج൫ &5- ɾɾɾ
ࠞࡶϚοϓલॲཧ ,JOFTJT1SPEVDFS$POTVNFS-JCSBSZ྆ํར༻ લॲཧͰҎԼͭͷॲཧΛ࣮ࢪ ඞཁͳ߲ͷΈʹߜΔޙଓॲཧͰඞཁͳσʔλΛΞλον͢Δ ࠞࡶϚοϓઐ༻ͷ,JOFTJTॻ͖ࠐΈ ,JOFTJTγϟʔυઃఆʹΑΓಡΈࠐΈɾॻ͖ࠐΈΩϟύγςΟ͕ܾఆ͞Εɺ ॻ͖ࠐΈಡΈࠐΈͱͳ͍ͬͯΔ ➡ϩάऩूج൫ɺࠞࡶϚοϓʢຊ൪ɾ։ൃʣͷڥߏங͢ΔͱɺίετޮѱԽ "VUP4DBMJOH ,JOFTJT
&MBTUJD4FBSDI &.3 4 ,JOFTJT ʢϩάऩूج൫ʣ 1SPEVDFS $POTVNFS -JCSBSZ "1* ࠞࡶϚοϓ
ࠞࡶϚοϓσʔλೖग़ྗ &.3্Ͱ4QBSLΛՔಇʢݴޠɿ4DBMBʣͤ͞ॲཧΛ࣮ࢪ ,JOFTJTͷσʔλऔಘʹ"844%,ɿ"NB[PO,JOFTJT$MJFOUΛ༻ TUSFBNJOHॲཧͰͱͳΓ͍͢νΣοΫϙΠϯτॲཧΛ4%,෦Ͱࣗಈཧ %ZOBNP%#ʹνΣοΫϙΠϯτΛॻ͖ࠐΈɺෳαʔόʔ͔Βॻ͖ࠐΈɾࢀর &MBTUJD4FBSDIͷσʔλೖ4QBSLͷجຊػೳΛ༻͍ͯɺ3%%Λ%BUB'SBNFʹม ͨ͠ޙɺ4BWF5P&4Ͱอଘ "VUP4DBMJOH ,JOFTJT &.3
4 ,JOFTJT ʢϩάऩूج൫ʣ 1SPEVDFS $POTVNFS -JCSBSZ &MBTUJD4FBSDI "1* ࠞࡶϚοϓ ࣍ॲཧ༻&.3
ࠞࡶϚοϓूܭॲཧ 4QBSL4USFBNJOHʹִͯؒͰूܭ͠ɺ݁ՌΛ&MBTUJD4FBSDIʹอଘ ΟϯυαΠζΛͱ͍͏͔ͳΓେ͖ͳͰӡ༻ ूܭ୯ҐλΠϧʢϝογϡʣΛ࠾༻͓ͯ͠ΓɺζʔϜϨϕϧɾλΠϧຖʹूܭ ฐࣾϩάຊɾ64ɾ&6Λத৺ʹϩάྔ͕ଟ͘ɺࠃຖʹϩάྔʹେ͖͘ภΓ͕͋Δ ࣍ॲཧͰࠃຖͷฏۉϩάΛूܭ͠ɺϩάྔͷҧ͍Λฏ४Խ ϩάྔ͕গͳ͍ࠃͰࠞࡶঢ়گΛѲ͢Δ͜ͱ͕Ͱ͖Δ ࠷ͨ͠ɺࡏΛՃຯͨࠞ͠ࡶूܭ "VUP4DBMJOH ,JOFTJT
&.3 4 ,JOFTJT ʢϩάऩूج൫ʣ 1SPEVDFS $POTVNFS -JCSBSZ &MBTUJD4FBSDI "1* ࠞࡶϚοϓ ࣍ॲཧ༻&.3
۱ాՖՐେձ มߋޙ վળޙ վળલ ۱ాՖՐେձ ՖՐਅͬ࠷த
۱ాՖՐେձ վળલ ϝΠϯձ ઙӺ ϝΠϯձ͕ ࠞΜͰ͍ͳ͍
ͳͥձ͕ࠞ·ͳ͍ͷ͔ʁ
ͳͥձ͕ࠞ·ͳ͍ͷ͔ʁ ूܭϩδοΫมߋ
มߋલ ࠞࡶϚοϓूܭॲཧ ,JOFTJT &.3 &MBTUJD4FBSDI ,JOFTJT &.3 4 &MBTUJD4FBSDI &.3
,JOFTJT͔ΒؒͷϩάΛऔಘ ूܭͨ݁͠ՌΛ &MBTUJD4FBSDIʹ֨ೲ มߋޙ &.3ॲཧΛҎԼʹׂ ,JOFTJT͔ΒؒͷϩάΛऔಘ͠ ɹɹIJWFςʔϒϧʹͦͷ··ग़ྗ IJWFςʔϒϧ͔Β࣌ؒͷσʔλΛऔ ಘ͠ɺ࠷ޙʹग़ྗ͞ΕͨϩάͷΈΛूܭ
վળޙ ۱ాՖՐେձ վળޙ վળલ ୈҰձ ઙӺ ୈҰձ͕ ࠞΜͩʂ ࣮ଶʹ͍ۙ
ࠓޙͷల ࡏΛՃຯͨࠞ͠ࡶूܭΛ4QBSL4USFBNJOHͷ 4MJEJOH8JOEPXΛ༻͍࣮ͯࢪ͢Δ &.3Ϋϥελʔͷ֤छઃఆͷνϡʔχϯάΛ࣮ࢪ͠ɺί ετޮ্ɺूܭظؒͷॖʢʣΛ࣮ݱ
THANK YOU! ANY QUESTIONS?