Sumallyにおける Amazon Redshift 導入事例

How Sumally uses Redshift

Transcript

1. 4VNBMMZʹ͓͚Δ "NB[PO
   3FETIJGU
   ಋೖࣄྫ ೥݄೔
   גࣜձࣾαϚϦʔ
   ยࢁ
   ݑত 
2. ࣗݾ঺հ wยࢁ
   ݑত
   ͔ͨ΍·
   ͷΓ͖͋ wגࣜձࣾαϚϦʔ
   ιϑτ΢ΣΞΤϯδχΞ wόοΫΤϯυશൠˍΠϯϑϥʢ"84ʣ w"84ྺɿ೥ wલ৬ɿ:BIPP+BQBOͰݕࡧɾϞόΠϧ w!LBUBSJOH 
3. ຊ೔ͷΞδΣϯμ   4VNBMMZͱ͸  3FETIJGUಋೖʹࢸͬͨܦҢ  3FETIJGUͷઃఆ·ΘΓ  σʔλ౤ೖͷ΍Γํʢ&5-ʣ  ͦͷଞ5JQT  ·ͱΊ
4. 4VNBMMZͱ͸ 
5. ͲͷΑ͏ͳϩάΛղੳ͍ͯ͠Δ͔ʁ w ΞΫςΟϏςΟϩάʢXBOU
   IBWF
   ʣ w "#ςετ DMJDL
   WJFX w ΞΫηεϩάɺΤϥʔϩάɺϝʔϧϩά
   ʜ
   ʢͦͷଞඞཁʹԠͯ͡ར༻ʣ 
6.  3FETIJGUಋೖʹࢸͬͨܦҢ
7. ҎલͷϩάղੳγεςϜʢCFGPSFʣ 
8. 3FETIJGUಋೖલ w σʔλղੳ୲౰ऀ͕ඇΤϯδχΞʢ.JDSPTPGU
   &YDFMͱ"DDFTTͷѪ޷Ոʣ w "DDFTT
   ʹ(#ͷนʢϩʔΧϧϚγϯͷ.Z42-0%#$઀ଓͰ৐Γ੾Δʣ w σʔλྔͷ૿Ճʹ൐͍௕ظؒσʔλͷूܭΛ͍ͨ͠ 
9.  ৽ϩάղੳج൫ʢBGUFSʣ $01: 42- ᶄ ᶃ
10. 3FETIJGUಋೖޙ  w શظؒͷσʔλΛૉૣ͘ूܭͰ͖ΔΑ͏ʹͳͬͨʢྫ͑͹ɺ"DDFTTͰ ෼͔͔͍ͬͯͨΫΤϦ͕ඵʹ୹ॖ͞Εͨʣ w ूܭ͕࣌ؒ୹ॖ͞Εͨ෼ɺෳࡶͳूܭʢܧଓ཰ௐࠪͱ͔ʣ͕Մೳʹͳ Γɺςετճ਺΋૿΍͢͜ͱ͕Ͱ͖ͨɻͦͷ݁Ռɺղੳͷ෯͕޿͕ͬͨ w 42-΋ֶशͰ͖ͯྑ͔ͬͨʢσʔλղੳ୲౰ऀஊʣ
11.  3FETIJGUͷઃఆ·ΘΓ
12. 3FETIJGUͷຊ൪؀ڥ w $MVTUFS
    5ZQF
    4JOHMF
    /PEF w /PEF
    5ZQF
    EXMBSHF w ;POF
    VTXFTUB w $16
    &$
    $PNQVUF
    6OJUT
    
    WJSUVBM
    DPSFT w .FNPSZ
    (J# w 4UPSBHF%JTL
    (#
    44% w &$$MBTTJD 
13. 3FETIJGUͷӡ༻ํ਑ w 4VNBMMZͷϝΠϯγεςϜ͸$BMJGPSOJB VTXFTU w 3FETIJGU͸0SFHPO VTXFTU Ͱӡ༻ w ஍ཧతʹ$BMJGPSOJBͱ͍ۙˍ౦ژΑΓ͍҆ w
    44% w ·ͩ·ͩσʔλྔ͕গͳ͍ͷͰ଎͍ํΛ࢖͏ w (#͘Β͍·Ͱ͸)%%ΑΓ͓ಘ w ೚ҙͷλΠϛϯάͰ͸όοΫΞοϓ͠ͳ͍ʢࣗಈεφοϓγϣοτͷΈʣ w ϓϩμΫγϣϯ͔Β੾Γ཭͞Εͨσʔλղੳ༻؀ڥͳͷͰ࠷ѱΫϥελ͕ ແ͘ͳͬͯ΋4͔Β෮چͰ͖Ε͹ྑ͍ʢ࣮ࡍ෼Ͱ෮چͰ͖Δʣ 
14. ͱΓ͋͑ͣઃఆ߲ͨ͠໨ w ΞΫηε؅ཧ w ઐ༻ͷ*".Λ࡞੒ w ΫϥελʔηΩϡϦςΟάϧʔϓ w ࣾ಺ͱQTRMίϚϯυΛ࣮ߦ͢ΔΠϯελϯεͷ*1ΛڐՄ w Ϋϥελʔ҉߸Խ w ىಈ࣌ʹ0/ w 44-઀ଓ w SFRVJSF@TTMUSVF 
15. ։ൃʹ͋ͨͬͯઃఆ߲ͨ͠໨ w Ϋϥελ಺ʹෳ਺σʔλϕʔε w εςʔδϯά༻ w ຊ൪༻ w ઐ༻Ϣʔβ w ؅ཧऀ w σʔλղੳ୲౰ 
16.  εΩʔϚઃܭ ΠϕϯτຖͰਖ਼نԽͰ͖ͳ͍ʢೖΕΔ஋ͷܕΛҰҙʹ ܾΊΒΕͳ͍ʣΧϥϜ͸+40/ͷ஋ΛೖΕ͓͖ͯɺ 3FETIJGUͷ+40/ؔ਺Λ࢖ͬͯूܭ͍ͯ͠Δ
17. ద੾ͳΤϯίʔυͷબ୒ ࣗ෼Ͱࡉ͔͘ΤϯίʔυΛࢦఆ͍͕ͯͨ͠ɺ 3FETIJGU͕ಋ͖ग़ͨ݁͠Ռͷํ͕σʔλαΠζ͕ খ࣮͘͞ߦ଎౓΋଎͔ͬͨ   ॳճ$01:࣌͸ɺΤϯίʔυઃఆͳ͠ͰςʔϒϧΛఆٛ  $0.161%"5&
    0/
    ࢦఆͰ$01:Λ࣮ߦͯ͠Πϯϙʔτʢ3FETIJGUଆ Ͱࣗಈݕग़ʣ  Ͱద༻͞ΕͨΤϯίʔυͰςʔϒϧΛఆٛɻ࠶౓Πϯϙʔτ͠ӡ༻։࢝  ӡ༻ޙ͸ɺ"/"-:;&
    $0.13&44*0/
    ͷ݁ՌΛʹϑΟʔυόοΫ
18. WBSDIBS NBY ͱCZUFEJDUͷ૊Έ ߹Θͤ໰୊  3FETIJGUͷط஌ͷόάʹΑΓ WBSDIBS NBY ʹCZUFEJDUΛࢦఆͨ͠ΧϥϜΛ࣋ͭςʔϒϧ͸ʢΠϯϙʔτ͢ ΔσʔλྔʹؔΘΒͣʣ$01:࣌ʹσΟεΫͷ࢖༻཰͕ʹͳͬͯ͠· ͍ɺΠϯϙʔτ͢Δ͜ͱ͕Ͱ͖ͳ͍ʂ
19.  &5-
20. σʔλΠϯϙʔτͷྲྀΕ  χΞϦΞϧλΠϜσʔλߋ৽ w ߋ৽ස౓ͷૣ͍ϩάʢߦಈϩάʣΛqVFOUEܦ༝ͰΠϯϙʔτ w ෼ִؒͰ$01:Λ࣮ߦʢ෼ִؒͰ΋໰୊͸ແ͍͕νϟϯΫαΠζͷ݉ Ͷ߹͍Ͱ͜ͷ஋ʹܾΊͨʣ  Ϛελʔσʔλߋ৽ w ೔ճߋ৽͢ΔΑ͏ͳϚελʔͱͳΔσʔλ w શ݅ߋ৽ 
21. 
    χΞϦΞϧλΠϜߋ৽  աڈͷߦಈϩάͷม׵ w αʔϏεϩʔϯν͔ΒͷߦಈϩάΛ$47ʹ$01:ͨ͠ w  
    SPXTTFDʢσʔλͷಛੑʹΑΔͷͰҰ֓ʹݴ͑ͳ͍ʣ  qVFOUE
    㱺
    4
    㱺
    3FETIJU w ʙ
    NTͰճͷ$01:࣮ߦ w qVFOUQMVHJOSFETIJGUʢλΠϜΞ΢τ͢ΔͱqVFOUE͝ͱམͪΔʣ w qVFOUQMVHJOKTPOCVDLFUʢෆਖ਼ͳόΠτྻ͕ೖΔͱσʔλফ͑Δʣ w $01:ίϚϯυͷ+40/ΦϓγϣϯରԠʢࠓޙ͜ͷܗࣜʹҠߦ༧ఆʣ 
22.  
    Ϛελʔσʔλߋ৽ํ๏ w "84
    %BUB1JQFMJOF͕0SFHPOͰͷ$01:Λαϙʔτͯ͠ͳ͍ʢࠓ͸ରԠ͍͠ΔΈ͍ͨʣ w .POHP%#
    㱺
    4
    㱺
    3FETIJU w Ұ౓εςʔδϯάςʔϒϧʹೖΕ͔ͯΒ"-5&3Ͱ੾Γସ͑Δ ग़యɿ8&# %#
    13&44
    7PM
    Q
    ੨໦
    ๆ࿠ʮϦετ
    ΞτϛοΫચ͍ସ͑ʯ
23. $01:ίϚϯυΦϓγϣϯ w(;*1 w$0.161%"5&
    0'' w5*.&'03."5
    "4
    BVUP w *40
    ܗࣜʢ
    5 ʣ͸bBVUPbͰ͠ ͔ೝࣝ͞Εͳ͍ʂ w$47
    ὎
    +40/ 
24.  ͜Μͳͱ͖͸ʂ
25. $01:ίϚϯυͰΤϥʔ͕ى͖ͨΒʂ  
    TFMFDU
    FSS@SFBTPO
    GSPN
    TUM@MPBE@FSSPST
    PSEFS
    CZ
    TUBSUUJNF
    EFTD
    MJNJU
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    FSS@SFBTPO 
    &YQFDU
    FJUIFS
    BO
    PCKFDU
    PS
    BSSBZ
    BU
    SPPU
26. $01:ίϚϯυͷৄࡉͳਐ௙ঢ়گΛ ஌Γ͍ͨʂ # select trim(name) tablename, col, to_char(sum(num_values), '999,999,999,999') count from SVV_DISKUSAGE where name = 'event_log' group by name, col order by 1, 2; tablename | col | count -----------+-----+------------------ event_log | 0 | 101,532 event_log | 1 | 101,532 event_log | 2 | 101,532 event_log | 3 | 101,532 event_log | 4 | 101,532 event_log | 5 | 101,532 event_log | 6 | 101,532 event_log | 7 | 101,532 event_log | 8 | 101,532 event_log | 9 | 101,532 event_log | 10 | 101,532 
27. σΟεΫ࢖༻ྔΛ೺Ѳ͍ͨ͠ʂ # select trim(name) name, count(*) size from SVV_DISKUSAGE where name = 'event_log' group by name order by 1; name | size -----------+------ event_log | 23 ˞TJ[Fͷ୯Ґ͸.# 
28. ˞0SFHPO
    ೥
    3*ɿ
    
    
    
    
    
    
    
    $1407  ೥ͷՔಇίετ ສԁ
29. ·ͱΊ w3FETIJGUʹͨ͜͠ͱͰεέʔϧΛؾʹͤͣ ԆʑͱϩάΛ஝ੵͰ͖ΔγεςϜ͕࡞Δ͜ͱ ͕Ͱ͖ͨ w͓ۚΛ͔͚ͣʹεϞʔϧελʔτͰ͖ͨ wͦͷ݁Ռɺղੳۀ຿ͷޮ཰Խʹ΋ܨ͕ͬͨ wӡ༻࢝Ίͨ͹͔ΓͰɺ·ͩϊ΢ϋ΢͕ແ͍ͷ Ͱ৘ใڞ༗͍͖͍ͯͨ͠ 
30.  4VNBMMZͰ͸3FETIJGUͳͲͷٕज़ʹڵຯͷ͋Δ όοΫΤϯυΤϯδχΞΛืू͓ͯ͠Γ·͢ʂ IUUQTVNBMMZDPNKPCT