Share
Embed
AWS(Amazon Redshift)とTableauではじめるビッグデータ分析 / Getting started Bigdata Analysis with Amazon Redshift and Tableau in Innovation Egg 8th
shinyaa31
July 02, 2016
Transcript
61 slides
-
ձࣾհ Ϋϥεϝιουגࣜձࣾ ɾཱɿ݄ ͦΖͦΖཱप ɾࣾһɿਓ ݄ݱࡏ ɾදɿԣా૱
"84$PNNVOJUZ)FSPFT ɾओͳࣄۀ #IEgg ˞"84ίϛϡχςΟώʔϩʔʹͳΓ·ͨ͠ʛ%FWFMPQFST*0 IUUQEFWDMBTTNFUIPEKQDMPVEBXTDPNNVOJUZIFSPFT ɾ ϒϩά -
ձࣾհ Ϋϥεϝιουגࣜձࣾ ɾཱɿ݄ ͦΖͦΖཱप ɾࣾһɿਓ ݄ݱࡏ ɾදɿԣా૱
"84$PNNVOJUZ)FSPFT ɾओͳࣄۀ #IEgg ˞"84ίϛϡχςΟώʔϩʔʹͳΓ·ͨ͠ʛ%FWFMPQFST*0 IUUQEFWDMBTTNFUIPEKQDMPVEBXTDPNNVOJUZIFSPFT ɾ"84 ɾJ04 ɾϏοάσʔλ ɾ*P5 ͳͲ -
%FWFMPQFST*0 IUUQEFWDMBTTNFUIPEKQ ɾ݄ΑΓ։ઃ ͦΖͦΖप ɾ૯ϒοΫϚʔΫ ɹ ࠃ*5ܥاۀҐ
ɾྦྷܭΤϯτϦຊຊ ɾྦྷܭ"84ؔ࿈ΤϯτϦຊຊ ɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹ ˞ݱࡏ -
ࣗݾհ ໊લɿ͠Μ 5XJUUFS*%ɿ!TIJOZBB ɾ݄ʹΫϥεϝιουʹ+0*/ ɾओʹϏοάσʔλʗ#*पΓͷҊ݅Λ୲ ɾ͋ͱࣾϒϩάࣥචଅਐ׆ಈ ɾ͖ͳ"84αʔϏεɿ"NB[PO3FETIJGU ɾ͖ͳ#*πʔϧɿ5BCMFBV ɾ͖ͳөըɿϚουϚοΫεౖΓͷσεɾϩʔυ
ܶʹͯճؑࡁ ɾࣗࣾϒϩάʰ%FWFMPQFST*0ʱࣥච ɹ͠Μʛ%FWFMPQFST*0IUUQEFWDMBTTNFUIPEKQBVUIPSTIJOZBB ɹ݄ݱࡏͷྦྷܭߘຊɿຊ ຊʹຊ #IEgg -
"NB[PO3FETIJGU ɾߴฒྻॲཧϑϧϚωʔδυ%8) ɾ1PTUHSF42-४ڌ W ɹ3%#Λѻ͏ײ֮Ͱར༻Մೳ ɾখ࢝͘͞ΊͯɺඞཁʹԠͯ͡ॊೈʹ֦ுՄೳ ɹˠ࠷খαΠζɿ(# ɹˠ࠷େαΠζɿ1#
ɾΧϥϜφܕ ྻࢦܕ ɿྻຖʹσʔλΛѹॖར༻ ɾ.11 ฒྻॲཧ ΞʔΩςΫνϟɿ ɹϊʔυ૿Ͱॲཧੑೳ্ #IEgg ˞"NB[PO3FETIJGUͱ "NB[PO3FETIJGUIUUQEPDTBXTBNB[PODPNKB@KQSFETIJGUMBUFTUNHNUXFMDPNFIUNM -
5BCMFBV4PGUXBSF ɾຊࣾɿถࠃγΞτϧઃཱɺ্ ɾຊ๏ਓ 5BCMFBV+BQBO ɿ݄ઃཱ ɾཱऀͷਓ1JYBS ถࠃө૾੍࡞ձࣾ ग़ ɹ
1BU)BOSBIBOɿΞΧσϛʔՊֶٕज़ଞଟͷडྺ #IEgg -
5BCMFBV4PGUXBSF ϥΠϯφοϓ ɾ5BCMFBV%FTLUPQɿΫϥΠΞϯτɺߴػೳɺଟ࠼ͳଓσʔλιʔεɺৄࡉͳੳ ɾ5BCMFBV4FSWFSɿαʔόɺใڞ༗ɺίϯςϯπཧɺεέδϡʔϧ ɾ5BCMFBV0OMJOFɿ5BCMFBV4FSWFSͷ4BB4൛ ɾ5BCMFBV.PCJMFɿ5BCMFBV4FSWFSʗ0OMJOFͱ࿈ܞɺରԠ04ɿJ04ˍ"OESPJE ɾ5BCMFBV1VCMJDɿແঈɺެ։8FCαΠτͰίϯςϯπڞ༗ɺରσʔλιʔεݶఆ ɾ5BCMFBV3FBEFSɿ5BCMFBVϫʔΫϒοΫಡΈऔΓઐ༻πʔϧ ɾ7JTBCMFɿJ04J1BE༻ΞϓϦέʔγϣϯɺ5BCMFBVͱͷͷؔແ͠
˞c5BCMFBV4PGUXBSFIUUQXXXUBCMFBVDPNKBKQQSPEVDUT ˞7J[BCMFCZ5BCMFBV%BUBBOBMZUJDTGPSFWFSZPOFIUUQTWJ[BCMFUBCMFBVDPN ˞5BCMFBV%FTLUPQͰग़དྷΔࣄͷ·ͱΊʛ%FWFMPQFST*0 ɹIUUQEFWDMBTTNFUIPEKQDMPVEBXTUBCMFBVEFTLUPQGFBUVSFTNBUPNF ˞5BCMFBV4FSWFSͰग़དྷΔࣄͷ·ͱΊʛ%FWFMPQFST*0 ɹIUUQEFWDMBTTNFUIPEKQCVTJOFTTCVTJOFTTBOBMZUJDTUBCMFBVTFSWFSGFBUVSFT #IEgg -
5BCMFBV4PGUXBSF ɾεϜʔζͳૢ࡞ײ ɾ׳Εͯ͘ΔͱײͰՄࢹԽΛ࡞ग़དྷΔ ɾඳըͷࣗ༝͕ߴ͘ɺΞΠσΞ࣍ୈͰ৭ʑ࡞ΕΔ ɾࢀߟใ͕ॆ࣮͍ͯ͠Δ ɹɾެࣜϔϧϓɺφϨοδϕʔε ,# ɹɾ5BCMFBV1VCMJDੈքத͔Βίϯςϯπ͕ू݁
ɹɾݴٴϒϩά͕ଟ͍ ಛʹւ֎ ɹɾࠃɿ%FWFMPQFST*0 ɾϊϦ͕ྑ͍ #IEgg -
3FETIJGUY5BCMFBV ɾ"845BCMFBVڞʹΨʔτφʔʹͯʰϦʔμʔʱධՁɻ ɹ ˞ڞʹ࿈ଓ ˞ "84 IUUQTBXTBNB[PODPNKQSFTPVSDFTHBSUOFSNRMFBSONPSF ˞ 5BCMFBV
IUUQHFUUBCMFBVDPNKBKQHBSUOFSNBHJDRVBESBOUIUNM #IEgg -
ՄࢹԽ࡞ۀͷ࣮ફ #IEgg 5BCMFBVͰՄࢹԽϏϡʔΛ࡞ ՄࢹԽΠϝʔδͷڞ༗ αϚϦɾϚʔτςʔϒϧͷ४උ σʔλͷϩʔυฤूՃ ςʔϒϧఆٛͷઃܭɾ࡞ ϑΝΠϧग़ྗ ϑΝΠϧՃ
ݸผςʔϒϧɾதؒςʔϒϧͷ४උ 5BCMFBVͰͲ͏ͬͯ ϏϡʔΛΈཱͯΔ͔ʁ 5BCMFBVͰ͏%#߲ Կ͕͋ΕࣄΓΔ͔ʁ ୯ҰςʔϒϧͰ0,ʁ ෳςʔϒϧ݁߹͕ඞཁʁ ϩʔυࡁͷσʔλ ฤूɾՃ͕ඞཁʁ ͲͷΑ͏ͳςʔϒϧఆ͕ٛ σʔλ֨ೲ্·͍͔͠ʁ σʔλϩʔυલʹՃΛ ࢪ͓͖͔ͯ͘͠ʁ ՃͷखؒΛল͘ʹ Ͳ͏͍ͬͨग़ྗ͕ྑ͍͔ʁ -
ՄࢹԽ࡞ۀͷ࣮ફ #IEgg 5BCMFBVͰՄࢹԽϏϡʔΛ࡞ ՄࢹԽΠϝʔδͷڞ༗ αϚϦɾϚʔτςʔϒϧͷ४උ σʔλͷϩʔυฤूՃ ςʔϒϧఆٛͷઃܭɾ࡞ ϑΝΠϧग़ྗ ϑΝΠϧՃ
ݸผςʔϒϧɾதؒςʔϒϧͷ४උ &5-πʔϧ ϓϩάϥϜͰ σʔλΛՃ ϑΝΠϧΛ4ʹΞοϓϩʔυ $01:ॲཧͰೖ 42-ͰฤूɾՃ σʔλ͔ΒखಈͰઃܭ γεςϜͰࣗಈผ 42-Ͱ݁߹ ผςʔϒϧʹೖ Ϗϡʔμογϡ Ϙʔυͷ࡞ 5BCMFBVʹΑΔ σʔλͷฤूͳͲ $47ɾ547ͱͯ͠ग़ྗ -
ՄࢹԽ࡞ۀͷ࣮ફ #IEgg 3FETIJGU 5BCMFBV 5BCMFBVͷ͍ํʹ׳ΕΔ ՄࢹԽͷΞΠσΞग़͠ ඞཁͳσʔλɾ߲ɾςʔϒϧͷચ͍ग़͠ ೖσʔλͷ४උ ೖσʔλͷ&5-Ճݕ౼
4Ξοϓϩʔυˍσʔλϩʔυ $01: தؒςʔϒϧσʔλϚʔτ࡞ʗ&5- 5BCMFBV%FTLUPQϩʔΧϧσʔλͰ ϓϩτλΠϓ࡞ 5BCMFBV%FTLUPQܦ༝Ͱ࣮σʔλࢀর ύϑΥʔϚϯενϡʔχϯά σʔλྔɺ૿αΠΫϧ͔ΒΫϥελͷ ॳظαΠζΛݕ౼ ΫϥελεΩʔϚߏͷݕ౼ ύϑΥʔϚϯενϡʔχϯά ςʔϒϧఆٛɺ42-ͷݟ͠ αϚϦςʔϒϧͷݕ౼ Ϋϥελઃఆͷݟ͠ ϫʔΫϒοΫɾϏϡʔߏͷݟ͠ ࣌ ؒ ࣠ -
ՄࢹԽ࡞ۀͷ࣮ફ #IEgg 3FETIJGU 5BCMFBV 5BCMFBV%FTLUPQɿগਓར༻Ͱ࢝ΊΔ σ ʛ λ ྔ
গ ଟ গ ଟ ར ༻ ऀ 5BCMFBV%FTLUPQɿར༻ऀ૿Ճ 5BCMFBV4FSWFSɿՄࢹԽͷڞ༗ 5BCMFBV4FSWFSɿσʔλͷߋ৽ 5BCMFBV4FSWFSɿՄࢹԽͷ৴ ॳظར༻࣌ͷσʔλ͕ऩ·Δ ΫϥελαΠζͰӡ༻։࢝ Ϋϥελσʔλ૿ϖʔεΛѲ ΫϥελύϑΥʔϚϯεΛ֬ೝ ඞཁʹԠͨ͡Ϋϥελ֦ுௐͷ࣮ࢪ ϊʔυͷ૿Ճ ϊʔυλΠϓͷมߋ ύϑΥʔϚϯενϡʔχϯάͷݕ౼ɾ࣮ࢪ 5BCMFBV4FSWFSɿࢄڥͷҠߦ ϫʔΫϩʔυཧͷݟ͠ 5BCMFBV.PCJMFɿ4FSWFSʴ.PCJMFͰͷར༻ 5BCMFBV3FBEFSɿࢀরܥίϯςϯπͷӾཡ -
ɾ લड़ͷ ݱͰͷݟڞ༗ɺϑΟʔυόοΫ ɾϕετϓϥΫςΟεΛࢀߟʹ͢Δ ɹɾςʔϒϧઃܭ 3FETIJGU ɹɾσʔλϩʔυ 3FETIJGU
ɹɾύϑΥʔϚϯενϡʔχϯά 3FETIJGU5BCMFBV ɹɾՄࢹԽɺϫʔΫϒοΫ࡞ 5BCMFBV #IEgg ՄࢹԽͷಓͷΓ -
5BCMFBV ʲσʔλʳ ɾΫϩεσʔλϕʔεδϣΠϯ ɾ৽نσʔλιʔεରԠ ɹɾ(PPHMF4IFFU .BSLFUP ,PHOJUP ɾϫΠϧυΧʔυϢχΦϯ ɾநग़ࣦഊ࣌ͷ௨ػೳ
ʲϞόΠϧʳ ɾ"OESPJEରԠ ɾσόΠεຖͷը໘ϨΠΞτཧ ɾϞόΠϧσόΠεཧػೳ ɾετϦʔϜϥΠϯαΠϯΠϯػೳ ʲ8FCʳ ɾ8FC্ͰͷՄࢹԽฤूػೳ ɾσʔλιʔεͷར༻ঢ়گੳ ɾϦϏδϣϯཤྺػೳͷվળ ɾύϒϦογϡػೳͷվળ ʲੳʳ ɾΫϥελϦϯά ɾ৭ృΓϚοϓͷΧελϚΠζ ݁߹ ɾΫϩεσʔλιʔεϑΟϧλ ɾબཁૉͷϋΠϥΠτػೳ )JHIMJHIUFS ɾόʔνϟʔτͷվળ ɾ֤छάϥϑػೳͷػೳՃ ʲΤϯλʔϓϥΠζʳ ɾଞऀͷϝʔϧ৴͕Մೳʹ ɾ8FC%BUB$POOFDUPS ɾ֤छ"1*ػೳͷվળ ɾϒϥβύϑΥʔϚϯεͷվળ ʲσβΠϯʳ ɾσβΠϯ໘ͷશ໘ϦχϡʔΞϧ ɾॻࣜઃఆ ओͳػೳIUUQXXXUBCMFBVDPNDPNJOHTPPO #IEgg -
5BCMFBV ɾ$PNJOH4PPO ɹIUUQXXXUBCMFBVDPNDPNJOHTPPO ɾ#VTJOFTT*OUFMMJHFODF#MPHc5BCMFBV4PGUXBSF ɹIUUQTXXXUBCMFBVDPNKBKQBCPVUCMPH ɾ5BCMFBVϕʔλϓϩάϥϜʹࢀՃ͢Δͷཧ༝c5BCMFBV4PGUXBSF ɹIUUQXXXUBCMFBVDPNKBKQBCPVUCMPHSFBTPOTKPJOUBCMFBVCFUB ɾ5BCMFBV1BEBXBOT5JQT5SJDLT ɹIUUQUBCMFBVKQOCMPHTQPUKQ
ɾ5BCMFBV৽ػೳհʛγϦʔζʛ%FWFMPQFST*0 ɹIUUQEFWDMBTTNFUIPEKQTFSJFTUBCMFBVOFXGFBUVSFT #IEgg -
"NB[PO2VJDL4JHIU ɾ݄ɺ"84SF*OWFOUʹͯൃද ɾඇৗʹߴͳɺΫϥυରԠͷ#*αʔϏε ɾݱࡏϓϨϏϡʔ൛ͰͷΈར༻Մೳ ɾใݯ ɹ "84ެࣜ ֓ཁIUUQTBXTBNB[PODPNKQRVJDLTJHIU ɹ
"84ެࣜ ྉۚIUUQTBXTBNB[PODPNKQRVJDLTJHIUQSJDJOH ɹ "84ެࣜ '"2IUUQTBXTBNB[PODPNKQRVJDLTJHIUGBRT ɹ %FWFMPQFST*0 2VJDL4JHIUಛू ɹIUUQEFWDMBTTNFUIPEKQSFGFSFODFDBUBXTRVJDLTUBSU #IEgg -
"NB[PO2VJDL4JHIU #IEgg ओͳػೳɾಛ '"2ΑΓൈਮ ɾσʔληοτͷ࡞ ɾੳͷ࡞ ɾੳͷڞ༗ ɾରσʔλιʔε
ɹɾϦϨʔγϣφϧσʔλετΞ "NB[PO"VSPSBɺ"NB[PO3FETIJGUɺ ɹɹ"NB[PO3%4r.Z42-ɺ1PTUHSF42-ɺ.BSJB%#ɺ0SBDMFɺ42-TFSWFSɺ ɹɹ"NB[PO&$Ͱ࣮ߦ͞ΕΔΧελϜͷ+%#$0%#$σʔλϕʔεɺ·ͨΦϯϓϨϛε ɹɾϑΝΠϧΞοϓϩʔυ $47ɺ547ɺ$-'ɺ͓Αͼ&-' ɺ ɹɾ.BQ3FEVDFσʔλετΞ "NB[PO&.3 ɹɾ/P42-σʔλετΞ "NB[PO%ZOBNP%# ɹɾετϦʔϛϯάσʔλιʔε "NB[PO,JOFTJT͓Αͼ"NB[PO%ZOBNP%#ετϦʔϜ ɹɾ"1*ϕʔεͷσʔλιʔε 4BMFTGPSDF ˞Α͋͘Δ࣭"NB[PO2VJDL4JHIUc"84IUUQTBXTBNB[PODPNKQRVJDLTJHIUGBRT -
41*$& #IEgg ˞"NB[PO2VJDL4JHIUʢߴͷϏδωεΠϯςϦδΣϯεʣc"84IUUQTBXTBNB[PODPNKQRVJDLTJHIU ΫϥυͷͨΊʹҰ͔Βઃܭ͞Εͨ"NB[PO2VJDL4JHIUͷߴͰύϥϨϧɺΠϯϝϞϦͷܭࢉΤϯδϯ ʮ41*$&ʯɺྻࢦετϨʔδͷΈ߹Θͤɺ࠷৽ͷϋʔυΣΞΠϊϕʔγϣϯʹΑͬͯՄೳʹͳͬͨΠϯϝ ϞϦٕज़ɺϚγϯίʔυੜɺσʔλѹॖΛར༻͍ͯ͠ΔͷͰɺϢʔβʔ͕େنσʔληοτʹΠϯλϥΫςΟ ϒͳΫΤϦΛ࣮ߦ͠ɺ͘͢ϨεϙϯεΛಘΔ͜ͱΛՄೳʹ͠·͢ɻ41*$&ॆ࣮ͨ͠ܭࢉΛαϙʔτ͍ͯ͠Δ ͷͰɺސ٬͕ΠϯϑϥετϥΫνϟͷϓϩϏδϣχϯάཧʹ͍ͭͯҰ৺͢Δ͜ͱͳ͘ੳ͔ΒՁ͋Δಎ ΛಘΔͷʹཱͪ·͢ɻ41*$&Ͱσʔλ͕ߴՄ༻ੑͷͨΊʹࣗಈతʹෳ͞Εɺ·ͨ"NB[PO2VJDL4JHIU
ΛઍਓͷϢʔβʔ͕ɺଟ࠼ͳ"84ͷσʔλιʔεશମͰߴ͔ͭΠϯλϥΫςΟϒͳੳΛͯ͢ಉ࣌ʹ࣮ ߦ͢ΔͨΊʹεέʔϧͤ͞Δ͜ͱՄೳʹ͠·͢ɻ 4VQFSGBTU 1BSBMMFM *ONFNPSZ $BMDVMBUJPO &OHJOF -
ΧελϚʔετʔϦʔɾΞφϦςΟΫε Ծ #IEgg ɾҰݴͰݴ͏ͱʮσʔλੳج൫ૣظಋೖςϯϓϨʔτʯɻ ɾσʔλੳͷج൫ͱͳΔڥΛ"84্ʹૣ͘ɺ҆͘ߏங ˞ఏڙ༧ఆػೳ ͷҰ෦ ɾςʔϒϧࣗಈੜɺΧϥϜՃରԠ
ɾϩʔυσʔλࣗಈมʢจࣈίʔυɺ࣌ࠁදهʣ ɾϑΝΠϧϩʔυॲཧࣗಈԽɺࣦഊ࣌ॲཧϧʔϧԽ ɾอकӡ༻αϙʔτʢεέʔϧΞοϓɺεέʔϧΞτʣ ɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹ˞ఏڙ։࢝༧ఆɹ