Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
Spark Streamingで全世界の 混雑状況を20分ごとに集計 / All over the world with Spark Streaming Congested situation every 20 minutes
yu
March 14, 2019
Technology
0
980
Spark Streamingで全世界の 混雑状況を20分ごとに集計 / All over the world with Spark Streaming Congested situation every 20 minutes
yu
March 14, 2019
Tweet
Share
More Decks by yu
See All by yu
hamada
0
24
hamada
0
770
Other Decks in Technology
See All in Technology
opelab
2
290
line_developers
PRO
0
150
line_developers
PRO
3
510
ray_30cm_ns
0
280
saoritakita
0
350
kaga
0
190
torisoup
0
290
masakick
0
120
neo_analytics
1
1k
yukitodate
2
330
yokatsuki
1
190
hololab
0
220
Featured
See All Featured
morganepeng
92
14k
mojombo
358
62k
shpigford
165
19k
paulrobertlloyd
71
3.6k
phodgson
87
3.9k
reverentgeek
27
1.9k
bryan
30
3.3k
gr2m
83
11k
lemiorhan
626
42k
kastner
54
1.9k
yeseniaperezcruz
302
31k
roundedbygravity
84
7.8k
Transcript
݄ ιϑτόϯΫגࣜձࣾᖛా༎ 4QBSL4USFBNJOHͰશੈքͷ ࠞࡶঢ়گΛ͝ͱʹूܭ )BEPPQ4QBSL$POGFSFODF+BQBO
ᖛాɹ༎ ιϑτόϯΫגࣜձࣾ ݉ גࣜձࣾ"HPPQ ͖ͳ"84αʔϏε "UIFOB(MVF όοΫΤϯυશൠ
"HPPQʹ͍ͭͯ اۀ໊ גࣜձࣾ"HPPQ ઃཱ࣌ظ ݄ දऔక ࣲࢁٱ גओ ιϑτόϯΫגࣜձࣾ
ࢿຊۚ ԯ ສԁ ैۀһ ໊ ॅॴ ˟౦ژौ୩۠ਆٶલ ࣄۀ༰ ɹҐஔใϏοάσʔλࣄۀ ɹɹɾҐஔใϏοάσʔλऩूղੳ ɹɹɾҐஔใؔ࿈σʔλൢച ɹɹɾҐஔใαʔϏεΞϓϦఏڙ ˞݄ݱࡏ ҐஔใºϏοάσʔλઐاۀ
ਓྲྀάϩʔόϧϏοάσʔλ ਓʑͷߦಈΛৄࡉʹѲ
Strictly Confidential άϩʔόϧϏοάσʔλ εϚʔτϑΥϯΞϓϦέʔγϣϯ͔Β ੈքͷ(14ҐஔใσʔλΛऔಘ /VNCFSPG-PHT %BUB4J[F ԯ݅
EBZ 5#ڃ EBZ
None
ࠞࡶϚοϓ
ΞʔΩςΫνϟ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH "VUP4DBMJOH ,JOFTJT 4 &MBTUJD4FBSDI &.3
4 ࠞࡶϚοϓ ϩάऩूج൫ "1* ࠞࡶϚοϓ &5- ɾɾɾ
"1* ࠞࡶϚοϓ ΞʔΩςΫνϟ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH "VUP4DBMJOH ,JOFTJT 4
&MBTUJD4FBSDI &.3 4 ࠞࡶϚοϓ ϩάऩूج൫ &5- ɾɾɾ
ϩάऩूج൫ ,JOFTJTʢେنετϦʔϛϯάσʔλ༻ΩϡʔΠϯάαʔϏεʣΛத৺ͱͨ͠ߏ લஈͷ"VUP4DBMJOH,JOFTJT1SPEVDFS-JCSBSZΛ༻͠ɺͦͷ··,JOFTJTʹೖ ޙஈͷ"VUP4DBMJOH̎ͭͷॲཧΛ࣮ࢪ ,JOFTJT$POTVNFS-JCSBSZΛ༻͠ɺ,JOFTJT͔Β+40/Λऔಘɾύʔεͯ͠ޙ ଓͷੳͰ༻͢ΔใΛՃ qVFOUEΛ༻͍ͯɺҰఆִؒͰ4ʹ([JQܗࣜͰग़ྗ ,JOFTJTʹೖΕ͓͚ͯ࣌ؒ ࠷ؒ σʔλϩετͷ৺͕ແ͍ͨΊ
<1PJOU>,JOFTJTಋೖͰ҆ఆੑ͕͔ͳΓ্ˠσʔλऩूܥʹ͔ͳΓΦεεϝ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH 4 1SPEVDFS -JCSBSZ $POTVNFS -JCSBSZ &5- ɾɾɾ
ΞʔΩςΫνϟ &-# "VUP4DBMJOH ,JOFTJT "VUP4DBMJOH "VUP4DBMJOH ,JOFTJT 4 &MBTUJD4FBSDI &.3
4 ࠞࡶϚοϓ "1* ࠞࡶϚοϓ ϩάऩूج൫ &5- ɾɾɾ
ࠞࡶϚοϓલॲཧ ,JOFTJT1SPEVDFS$POTVNFS-JCSBSZ྆ํར༻ લॲཧͰҎԼͭͷॲཧΛ࣮ࢪ ඞཁͳ߲ͷΈʹߜΔޙଓॲཧͰඞཁͳσʔλΛΞλον͢Δ ࠞࡶϚοϓઐ༻ͷ,JOFTJTॻ͖ࠐΈ ,JOFTJTγϟʔυઃఆʹΑΓಡΈࠐΈɾॻ͖ࠐΈΩϟύγςΟ͕ܾఆ͞Εɺ ॻ͖ࠐΈಡΈࠐΈͱͳ͍ͬͯΔ ➡ϩάऩूج൫ɺࠞࡶϚοϓʢຊ൪ɾ։ൃʣͷڥߏங͢ΔͱɺίετޮѱԽ "VUP4DBMJOH ,JOFTJT
&MBTUJD4FBSDI &.3 4 ,JOFTJT ʢϩάऩूج൫ʣ 1SPEVDFS $POTVNFS -JCSBSZ "1* ࠞࡶϚοϓ
ࠞࡶϚοϓσʔλೖग़ྗ &.3্Ͱ4QBSLΛՔಇʢݴޠɿ4DBMBʣͤ͞ॲཧΛ࣮ࢪ ,JOFTJTͷσʔλऔಘʹ"844%,ɿ"NB[PO,JOFTJT$MJFOUΛ༻ TUSFBNJOHॲཧͰͱͳΓ͍͢νΣοΫϙΠϯτॲཧΛ4%,෦Ͱࣗಈཧ %ZOBNP%#ʹνΣοΫϙΠϯτΛॻ͖ࠐΈɺෳαʔόʔ͔Βॻ͖ࠐΈɾࢀর &MBTUJD4FBSDIͷσʔλೖ4QBSLͷجຊػೳΛ༻͍ͯɺ3%%Λ%BUB'SBNFʹม ͨ͠ޙɺ4BWF5P&4Ͱอଘ "VUP4DBMJOH ,JOFTJT &.3
4 ,JOFTJT ʢϩάऩूج൫ʣ 1SPEVDFS $POTVNFS -JCSBSZ &MBTUJD4FBSDI "1* ࠞࡶϚοϓ ࣍ॲཧ༻&.3
ࠞࡶϚοϓूܭॲཧ 4QBSL4USFBNJOHʹִͯؒͰूܭ͠ɺ݁ՌΛ&MBTUJD4FBSDIʹอଘ ΟϯυαΠζΛͱ͍͏͔ͳΓେ͖ͳͰӡ༻ ूܭ୯ҐλΠϧʢϝογϡʣΛ࠾༻͓ͯ͠ΓɺζʔϜϨϕϧɾλΠϧຖʹूܭ ฐࣾϩάຊɾ64ɾ&6Λத৺ʹϩάྔ͕ଟ͘ɺࠃຖʹϩάྔʹେ͖͘ภΓ͕͋Δ ࣍ॲཧͰࠃຖͷฏۉϩάΛूܭ͠ɺϩάྔͷҧ͍Λฏ४Խ ϩάྔ͕গͳ͍ࠃͰࠞࡶঢ়گΛѲ͢Δ͜ͱ͕Ͱ͖Δ ࠷ͨ͠ɺࡏΛՃຯͨࠞ͠ࡶूܭ "VUP4DBMJOH ,JOFTJT
&.3 4 ,JOFTJT ʢϩάऩूج൫ʣ 1SPEVDFS $POTVNFS -JCSBSZ &MBTUJD4FBSDI "1* ࠞࡶϚοϓ ࣍ॲཧ༻&.3
۱ాՖՐେձ มߋޙ վળޙ վળલ ۱ాՖՐେձ ՖՐਅͬ࠷த
۱ాՖՐେձ վળલ ϝΠϯձ ઙӺ ϝΠϯձ͕ ࠞΜͰ͍ͳ͍
ͳͥձ͕ࠞ·ͳ͍ͷ͔ʁ
ͳͥձ͕ࠞ·ͳ͍ͷ͔ʁ ूܭϩδοΫมߋ
มߋલ ࠞࡶϚοϓूܭॲཧ ,JOFTJT &.3 &MBTUJD4FBSDI ,JOFTJT &.3 4 &MBTUJD4FBSDI &.3
,JOFTJT͔ΒؒͷϩάΛऔಘ ूܭͨ݁͠ՌΛ &MBTUJD4FBSDIʹ֨ೲ มߋޙ &.3ॲཧΛҎԼʹׂ ,JOFTJT͔ΒؒͷϩάΛऔಘ͠ ɹɹIJWFςʔϒϧʹͦͷ··ग़ྗ IJWFςʔϒϧ͔Β࣌ؒͷσʔλΛऔ ಘ͠ɺ࠷ޙʹग़ྗ͞ΕͨϩάͷΈΛूܭ
վળޙ ۱ాՖՐେձ վળޙ վળલ ୈҰձ ઙӺ ୈҰձ͕ ࠞΜͩʂ ࣮ଶʹ͍ۙ
ࠓޙͷల ࡏΛՃຯͨࠞ͠ࡶूܭΛ4QBSL4USFBNJOHͷ 4MJEJOH8JOEPXΛ༻͍࣮ͯࢪ͢Δ &.3Ϋϥελʔͷ֤छઃఆͷνϡʔχϯάΛ࣮ࢪ͠ɺί ετޮ্ɺूܭظؒͷॖʢʣΛ࣮ݱ
THANK YOU! ANY QUESTIONS?