Data Engineering Study #7「Redshift最新アップデートと活用事例」での発表資料です。 https://forkwell.connpass.com/event/203403/
.JOFSP"PLJ ͳͥΫοΫύου3FETIJGUΛσʔλج൫ʹબͼଓ͚Δͷ͔ʙσʔλج൫͕Ռׂ͖ͨ͢ʙ
View Slide
ࣗݾհ‣ ੨ๆʢ͓͖͋ΈͶΖ͏ʣ‣ ݩ3VCZίϛολʔ‣ લ৬ฒྻ3%#.4ϕϯμʔ‣ ฒྻσʔλϕʔεͱग़ձ͏‣ ݱ৬ΫοΫύου‣ ੳαʔϏεʮͨΈΔʯͷ։ൃ‣ σʔλ׆༻ج൫ͷߏங‣ ϨγϐαʔϏεͷϦΞʔΩςΫνϟ
ΫοΫύουͷσʔλج൫ͷ֓ཁ
ݕࡧαʔϏεʮͨΈΔʯʹ3FETIJGUಋೖશࣾσʔλج൫Λ3FETIJGUҠߦ4QFDUSVNಋೖ$PODVSSFODZ4DBMJOHɺ6TBHF-JNJUಋೖ'FEFSBUFE2VFSZɺ"VUP8-.ಋೖ3"ಋೖ3FETIJGUར༻ͷྺ࢙
ΫοΫύουͷσʔλج൫ͷ֓ཁ3FETIJGUSBYMBSHFº5# OPEFTMJDFόϧΫΤΫεϙʔτ12 +%#$.Z42-1PTUHSF42-%ZOBNP%#qVFOUEϚελʔϩά+40/4ଞγεςϜ42-DMJFOUCEBTI5BCMFBVཧը໘8PSLEBZ4BMFTGPSDF;FOEFTLτϥϯβΫγϣϯςʔϒϧఔຊऑຊऑϩάαϚϦʔαϚϦʔ42-όονຊ12 +%#$ఆܕΫΤϦʔ2VFVFSZඇఆܕΫΤϦʔ
3FETIJGU4w 1SJTNʢʣʹΑΔϩάͷετϦʔϛϯάϩʔυw 1BSRVFUͷϚʔδͱɺҙλΠϜκʔϯͰͷύʔςΟγϣχϯά͕Մೳw 1SJTNৄࡉIUUQTUFDIMJGFDPPLQBEDPNFOUSZ1SJTNʹΑΔϩάϩʔυ֎෦ςʔϒϧ+40/+40/+40/1SJTN4USFBN1BSRVFU1BSRVFUMJWFPCKFDUT1BSRVFU1SJTN.FSHF1BSRVFUNFSHFEPCKFDUT౸ண͍ͩ͠ॲཧ࣌ؒ͝ͱ(MVFΧλϩάͰΓସ͑
ϚελʔςʔϒϧͷऔΓࠐΈ%#λΠϓ ςʔϒϧ γεςϜ ִؒ ํࣜ.Z42- 1JQFMJOFE.JHSBUPSʢʣ ࣍ શߦચ͍ସ͑1PTUHSF42- 3FETIJGU'FEFSBUFE2VFSZ"84%BUBCBTF.JHSBUJPO4FSWJDF࣍ શߦચ͍ସ͑%ZOBNP%# %ZOBNP%#4USFBNTˠ1SJTN ৗ࣌ ࠩߋ৽
σʔλج൫ԿΛ͖͔͢
σʔλج൫ͭͷ͍ಓ ఆܕΫΤϦʔ,1*ޮՌଌఆͷμογϡϘʔυ ඇఆܕʢΞυϗοΫʣΫΤϦʔঢ়گʹԠͯ͡ਓ͕ؒߟ࣮͑ͯߦ͢ΔΫΤϦʔ όϧΫΤΫεϙʔτଞγεςϜͷσʔλసૹ͜Ε͕Ұ൪Ձ͕ߴ͍ʂʜʜ͠ɺ੍େ͖͍
σʔλج൫ΞϓϦέʔγϣϯͷͨΊʹαʔϏεσʔλج൫αʔϏε αʔϏεϚελʔɺϩάվળϑΟʔυόοΫ,1*μογϡϘʔυΞυϗοΫΫΤϦʔσʔλΤΫεϙʔτ݁ہͷͱ͜ΖαʔϏεͷύϑΥʔϚϯεΛվળ͢ΔͨΊʹ͋Δɻલऀͭਓؒܦ༝ͰϑΟʔυόοΫ͞ΕɺޙऀϓϩάϥϜ͔ΒϑΟʔυόοΫ͞ΕΔɻ
σʔλ׆༻ࣄྫ
ࣄྫͨΈΔʢݕࡧසੳʣ‣ ಛఆͷޠ͕ݕࡧ͞ΕͨසͷมԽΛάϥϑͰݟΔ͜ͱ͕Ͱ͖Δ‣ ͍·Γ্͕͍ͬͯΔݕࡧɺΈ߹ΘͤΒΕ͍͢ޠ͕ݟΒΕΔ৯͍ͨ࡞Γ͍ͨʢݕࡧʣ
ͨΈΔͷΞʔΩςΫνϟ‣ ݕࡧϩάͱϢʔβʔϚελʔΛδϣΠϯͯ͠ͱޠͰूܭ͢Δ‣ ࡞ͨ͠αϚϦʔΞϓϦ༻ͷ3FETIJGUΫϥελʔసૹͯ͠ར༻3FETIJGUʢ%8)Ϋϥελʔʣ 3FETIJGUʢͨΈΔΫϥελʔʣݕࡧϩάϢʔβʔϚελʔαϚϦʔɺ୯ޠ*%ɺ౷ܭαϚϦʔDPPLQBE42-όον
ࣄྫਓؾॱϨγϐݕࡧ‣ ݕࡧ݁ՌΛʮਓؾʯͷ͋ΔॱʹݟΒΕΔ‣ ༗ྉձһϝχϡʔͰ࠷ΘΕ͍ͯΔػೳ
ਓؾॱݕࡧͷΞʔΩςΫνϟ‣ γϯϓϧͳ42-όονͰਓؾॱϥϯΫΛܭࢉ͠ɺ"UIFOBͰ࠷ऴυΩϡϝϯτΛੜͯ͠4PMSʹಥͬࠐΉ‣ ͯ͢3VCZͰॻ͔Ε͍ͯͨόονΛҠ২ͨͨ͠Ί·ͩແବ͕ଟ͍3FETIJGU 417ϩάϚελʔਓؾॱϥϯΫDPPLQBEͦͷଞͷΠϯσοΫεਓؾॱϥϯΫͦͷଞͷΠϯσοΫε4PMSυΩϡϝϯτ"UIFOBͰ݁߹6/-0"%42-όον4PMS
ࣄྫλʔήςΟϯάࠂ‣ ಉ͡ଐੑΛ࣋ͭϢʔβʔͷηάϝϯτΛ࡞͠ɺΑΓޮՌ͕͋ΔͱࢥΘΕΔࠂΛબతʹ৴͢Δ‣ ֦ுใ42-ͱ1ZUIPOͰੜ͍ͯ͠Δ3FETIJGU %ZOBNP%#17ϩάϚελʔϢʔβʔηάϝϯτDPPLQBE֦ுϢʔβʔηάϝϯτηάϝϯτ42-όονΦʔσΟΤϯε֦ு֦ுใ
ͳͥ3FETIJGUͳͷ͔ʁ
3FETIJGUΛબͿཧ༝ ΞϓϦέʔγϣϯ͕"84ʹ͋Δ͔Βσʔλج൫͢Δ΄ͲΞϓϦέʔγϣϯͱͷσʔλͷΓͱΓ͕૿͍͑ͯ͘ɻ͕ͨͬͯ͠ΞϓϦέʔγϣϯͱ࿈ܞ͍͢͠ɺ͍ۙॴʹ͋Δ͖ɻ ଞγεςϜͱͷ࿈ܞ͕༏Ε͍ͯΔ͔Β'FEFSBUFE2VFSZ4QFDUSVNɺ%BUB"1*ͷΑ͏ͳɺଞγεςϜͱͷ࿈ܞͷͨΊͷػೳ͕༏लɻ·ͨ*".Ͱͯ͢ͷ࿈ܞΛ౷ҰతʹཧͰ͖Δຯ͕ͩඇৗʹॏཁɻ ඞཁͳػೳͳΒՃ͞ΕΔͱ͍͏৴པײ͕͋Δ4QFDUSVN3"ɺ1BSUJ2-ͷΑ͏ͳڊେͳػೳͰɺඞཁʹͳͬͨ͜Ζʹண࣮ʹՃ͞Ε͍ͯ͘ͷͰɺ͍·ػೳ͕ෆ͍͍ͯͯۙ͠কདྷʹղܾ͢ΔͩΖ͏ͱָ؍Ͱ͖Δɻ
·ͱΊ
·ͱΊ σʔλج൫ʹओʹ௨Γͷ͍ಓ͕͋Δ όϧΫΤΫεϙʔτʢతͳσʔλ׆༻ʣ͕࠷Ձ͕ߴ੍͘ڧ͍ͷͰɺΞʔΩςΫνϟͦΕʹ࠷దԽ͖͢ ΫοΫύουͷγνϡΤʔγϣϯͰ3FETIJGU্͕هͷ݅ʹরΒͯ͠࠷దͰ͋ͬͨ
͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠