Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ベンチャーならではのRedshift低コスト運用

tama
April 27, 2015

 ベンチャーならではのRedshift低コスト運用

pairsでのRedshiftの運用方法について、その構成とコスト面での効果を説明します。

tama

April 27, 2015
Tweet

More Decks by tama

Other Decks in Technology

Transcript

  1. CONFIDENTIAL Copyright © 2009-2014 eureka, Inc. All rights reserved. 2015/04/23

    ͑ͼελʂ#2 ϕϯνϟʔͳΒͰ͸ͷ Redshiftͷ௿ίετӡ༻ Tamaki Tetsumoto
  2. Copyright © 2009-2015 eureka, Inc. All rights reserved. • pairsαʔόʔαΠυ


    ΤϯδχΞ • PhpStorm • Πϯλʔϯ͔Βೖࣾ • ࣾձਓ3೥໨ • PHPer΋͏͙͢5೥໨ಥೖ • ͜Ε͔ΒGopher גࣜձࣾΤ΢ϨΧ మຊ ؀
  3. ΤϯδχΞͷਓ਺ 29% 71% ΤϯδχΞ ඇΤϯδχΞ ϋΠϒϦουɿ21ਓ WebΤϯδχΞɿ10ਓ iOS/AndroidΤϯδχΞɿ16ਓ Copyright ©

    2009-2015 eureka, Inc. All rights reserved. 47ਓ 27.6 ࡀ ฏۉ೥ྸ
  4. pairs Couples Copyright © 2009-2015 eureka, Inc. All rights reserved.

  5. Copyright © 2009-2014 eureka, Inc. All rights reserved. pairs Couples

  6. Copyright © 2009-2014 eureka, Inc. All rights reserved. iOS android

    Couples Target Users are 18-26
  7. Copyright © 2009-2014 eureka, Inc. All rights reserved. DL਺ਪҠ Couples

    562,500 1,125,000 1,687,500 2,250,000 2014/5 2014/6 2014/7 2014/8 2014/9 2014/10 2014/11 2014/12 2015/1 2015/2 2015/3 200ສ DLୡ੒
  8. Copyright © 2009-2014 eureka, Inc. All rights reserved. pairs Couples

  9. Copyright © 2009-2014 eureka, Inc. All rights reserved. PC Browser

    iOS android SP Browser pairs
  10. Copyright © 2009-2014 eureka, Inc. All rights reserved. 500,000 1,000,000

    1,500,000 2,000,000 2012/10 2012/12 2013/2 2013/4 2013/6 2013/8 2013/10 2013/12 2014/2 2014/4 2014/6 2014/8 2014/10 2014/12 2015/2 ྦྷܭϢʔβʔ਺ਪҠ pairs 220ສ Ϣʔβʔୡ੒
  11. QBJSTͷΠϯϑϥߏ੒ Copyright © 2009-2015 eureka, Inc. All rights reserved.

  12. Copyright © 2009-2015 eureka, Inc. All rights reserved. "84ϑϧ׆༻ ൺֱతελϯμʔυͳߏ੒Ͱ͢

  13. 3%4ʢ.Z42-ʣ w ϢʔβʔϓϩϑΟʔϧ w ചΓ্͛ w ϚονϯάFUD Copyright © 2009-2015

    eureka, Inc. All rights reserved.
  14. Copyright © 2009-2015 eureka, Inc. All rights reserved. %ZOBNP%# w

    ϩάΠϯΞΫγϣϯ w ࠓ೔ͷϐοΫΞοϓ w ଍͋ͱFUD
  15. ڈΔɺ೥݄ Copyright © 2009-2015 eureka, Inc. All rights reserved.

  16. ʕ̡̢̡ʘ̅͟ ͡ ͜ 㷌 â @ ʔ̢̡̢ ؅ཧը໘Λվम͍ͨ͠ Copyright ©

    2009-2015 eureka, Inc. All rights reserved.
  17. Copyright © 2009-2015 eureka, Inc. All rights reserved. ʕ̡̢̡ʘ̅͟ ͡

    ͜ 㷌 â @ ʔ̢̡̢ ؅ཧը໘Λվम͍ͨ͠ ,1*ݟ௚͠·͢ ΞϧΰϦζϜௐ੔ͷώϯτཉ͍͠ ചΓ্͛༧ଌཱ͍ͯͨ
  18. બ୒ࢶ͸ͭ Copyright © 2009-2015 eureka, Inc. All rights reserved.

  19.  (PPHMF#JH2VFSZ  "NB[PO3FETIJGU  "NB[PO&MBTUJD.BQ3FEVDF Copyright © 2009-2015 eureka,

    Inc. All rights reserved.
  20. Copyright © 2009-2015 eureka, Inc. All rights reserved. ͦͷલʹɺ3FETIJGUͱ͸ʜ

  21. w ྻࢦ޲ʢΧϥϜφʔʣ%# w ϚωʔδυαʔϏεʢࣗಈόοΫΞοϓͳͲʣ w ࣌ؒ՝ۚ w "NB[PO4͔Βͷσʔλసૹ͸ແྉ "NB[PO3FETIJGU Copyright

    © 2009-2015 eureka, Inc. All rights reserved.
  22. ϫϯϥΠφʔͰσʔλΛऔΓࠐΊΔ ʢ4ͱ%ZOBNP%#͔Βʣ "NB[PO4 "NB[PO%ZOBNP%# "NB[PO3FETIJGU Copyright © 2009-2015 eureka, Inc.

    All rights reserved.
  23. $ COPY [コピー先DB名] FROM ‘s3://[Bucket名]/[ディレクトリパス]/’ σΟϨΫτϦࢦఆͰ $01:Մೳ "NB[PO4͔Βͷ$01: "NB[PO4 $01:

    "NB[PO3FETIJGU Copyright © 2009-2015 eureka, Inc. All rights reserved.
  24. $ COPY pairs FROM ‘dynamodb://[テーブル名]’ "NB[PO%ZOBNP%#͔Βͷ$01: Copyright © 2009-2015 eureka,

    Inc. All rights reserved. "NB[PO%ZOBNP%# $01: "NB[PO3FETIJGU ͨͩ͠ɺશ݅$01:ͷΈ
  25. Copyright © 2009-2015 eureka, Inc. All rights reserved. Ͱ͸ɺൺֱͯ͠Έ·͢

  26. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU

    &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5& %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º
  27. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU

    &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5& %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º #JH2VFSZ͸ΫΤϦ՝ۚ ࣌ؒ՝ۚͰൺֱ͢Δͱ 3FETIJGU&.3
  28. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU

    &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5& %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º σʔλసૹྉ͕ۚ #JH2VFSZͷJNQPSUͱ "84ͷPVUQVUͰ͔͔Δ 4͔Β3FETIJGU΁ͷ σʔλసૹ͸ແྉ
  29. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU

    &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5& %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˚ º ਂ໷όονͰूܭͳͷͰ ࠓճ͸଎͞͸ͦ͜·Ͱ ٻΊ͍ͯͳ͍
  30. #JH2VFSZ 3FETIJGU &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚

    ˓ ଎͞ ˕ ˓ ˚ 61%"5& %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º Copyright © 2009-2015 eureka, Inc. All rights reserved. ຖ೔61%"5&͍ͨ͠ σʔλ͕͋ΔͷͰக໋తʜ
  31. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU

    &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5& %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º ܹ͍͠ςʔϒϧͷ ֻ͚߹Θ͕ͤ͋ΔͷͰ ؤுͬͯཉ͔ͬͨ͠ʂ
  32. Copyright © 2009-2015 eureka, Inc. All rights reserved. 3FETIJGUʹܾΊ·ͨ͠ w

    1PTUHSF42-ϕʔεɹ w 61%"5& %&-&5&ɹɹɹɹ w ෳࡶͳΫΤϦɹɹɹɹɹɹɹ w ӡ༻ίετ͸ઃܭͰΧόʔɹ ͷ42-͕࢖͑Δ ͕ൃߦͰ͖Δ ͕ൃߦͰ͖Δ ͢Δ
  33. 3FETIJGUΛ࣮ࡍʹͲ͏࢖͍ͬͯΔ͔ Copyright © 2009-2015 eureka, Inc. All rights reserved.

  34. Copyright © 2009-2015 eureka, Inc. All rights reserved. 4 3FETIJGU

    &$ 3%4.Z42- 3%4.Z42- %ZOBNP%# 'MVFOUE 4OBQTIPU
  35. 4 3FETIJGU &$ 3%4.Z42- 3%4 %ZOBNP%# 'MVFOUE σʔλநग़ ਂ໷όονͰ લ೔ͷσʔλΛநग़ɺ

    UTWϑΝΠϧग़ྗ 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved.
  36. 4 3FETIJGU &$ 3%4 'MVFOUE 4OBQTIPU Copyright © 2009-2015 eureka,

    Inc. All rights reserved. UTWϑΝΠϧΛ 4΁อଘ 3%4 %ZOBNP%# ϑΝΠϧΞοϓϩʔυ
  37. 4 3FETIJGU &$ 3%4 3%4 %ZOBNP%# 'MVFOUE "1*Ͱ4OBQTIPU͔Β $MVTUFSΛىಈ 4OBQTIPU

    Copyright © 2009-2015 eureka, Inc. All rights reserved. 3FETIJGUىಈ
  38. 4 3FETIJGU &$ 3%4 3%4 %ZOBNP%# 'MVFOUE $01:ίϚϯυͰ 3FETIJGU͕4͔Β σʔλΛಡΈࠐΈ

    $01:ίϚϯυ࣮ߦ 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved. UTWϑΝΠϧͷ ಡΈࠐΈ σʔλϩʔυ
  39. 4 3FETIJGU &$ 3%4 3%4.Z42- %ZOBNP%# 'MVFOUE "NB[PO3FETIJGU42- ʢ1PTUHSF42-ϕʔεʣ ΫΤϦ࣮ߦ

    4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved. ΫΤϦ࣮ߦ ूܭ
  40. 4 3FETIJGU &$ 3%4 3%4.Z42- %ZOBNP%# 'MVFOUE 4OBQTIPU ूܭ݁Ռͷ อଘ

    Copyright © 2009-2015 eureka, Inc. All rights reserved. ूܭ݁ՌΛ ؅ཧը໘ઐ༻ͷ 3%4΁อଘ ूܭ݁Ռͷอଘ
  41. 4 3FETIJGU &$ 3%4 3%4 %ZOBNP%# 'MVFOUE "1*Ͱ4OBQTIPUʹ όοΫΞοϓΛอଘ $MVTUFSΛ࡟আ

    4OBQTIPU "1*Ͱ 4OBQTIPU΁ อଘɾ࡟আ ˞"1*ͷҾ਺Ͱ$MVTUFS࡟আ࣌ʹ ɹόοΫΞοϓΛऔΔ͔ࢦఆՄೳ Copyright © 2009-2015 eureka, Inc. All rights reserved. 3FETIJGUͷऴྃ
  42. Ͱɺ݁ہͲΕ͘Β͍௿ίετͰ ࣮ݱͰ͖ͨͷ͔ʁ Copyright © 2009-2015 eureka, Inc. All rights reserved.

  43. Copyright © 2009-2015 eureka, Inc. All rights reserved.  

     ˞ίετ࡟ݮ෯ʹ͍ͭͯ͸σʔλྔ΍ܭࢉྔͳͲ ɹ࢖༻؀ڥɾ༻్ʹΑͬͯҟͳΓ·͢ɻ
  44. Copyright © 2009-2015 eureka, Inc. All rights reserved. ΍ͬͨ͜ͱ

  45. Copyright © 2009-2015 eureka, Inc. All rights reserved. ᶃ3FETIJGUىಈ͸ඞཁͳ͚࣌ͩ

  46. Copyright © 2009-2015 eureka, Inc. All rights reserved. 3FETIJGUՔಇ࣌ؒ ࣌ؒˠ࣌ؒ΁

  47. Copyright © 2009-2015 eureka, Inc. All rights reserved. ᶄूܭ݁ՌΛ3%4΁อଘ

  48. Copyright © 2009-2015 eureka, Inc. All rights reserved. ઐ༻؅ཧը໘ͳͷͰ খ͍͞ΠϯελϯεͰ࣌ؒՔಇ

  49. 4 3FETIJGU &$ 3%4 %ZOBNP%# 'MVFOUE 4OBQTIPU Copyright © 2009-2015

    eureka, Inc. All rights reserved. EXMBSHF 3FETIJGUৗ࣌Քಇ ˞౦ژΦϯσϚϯυྉۚͰܭࢉ   IՔಇ ͍͍ͩͨ
  50. 4 3FETIJGU &$ 3%4 3%4.Z42- %ZOBNP%# 'MVFOUE 4OBQTIPU  

    Copyright © 2009-2015 eureka, Inc. All rights reserved. ˞౦ژΦϯσϚϯυྉۚͰܭࢉ ௿ίετӡ༻ IOFXՔಇ 3FETIJGUɿEXMBSHF IˣՔಇ 3%4ɿUTNBMM  ͍͍ͩͨ
  51. Copyright © 2009-2015 eureka, Inc. All rights reserved. ·ͱΊ

  52. 3FETIJGU͕޲͍͍ͯΔ৚݅ w "84ϑϧ׆༻ͷΠϯϑϥߏ੒ w %ZOBNP%#ͷσʔλ΋࢖͏ ɹɹɹˠશσʔλͳΒ௚઀ಡΈࠐΈ΋Մೳʂ ɹɹɹˠࠩ෼͚ͩऔΓࠐΈ͍ͨͳΒ4Λ࢖͓͏ w ߋ৽ɾ࡟আ͍ͨ͠σʔλ͕͋Δ w

    ͳ͔ͳ͔ܹ͍͠+0*/ͷཛྷ Copyright © 2009-2015 eureka, Inc. All rights reserved.
  53. ௿ίετӡ༻͕Ͱ͖Δ৚݅ w σʔλूܭ͸ҰఆͷλΠϛϯάͰྑ͍ w ूܭύλʔϯ͕ܾ·͍ͬͯΔ ɹɹɹˠઐ༻ͷ3%4Λ࢖ͬͯूܭ݁ՌͷΈอଘʂ Copyright © 2009-2015 eureka,

    Inc. All rights reserved.
  54. ͜ͷ෼ੳج൫Ͱ QBJST͸੒௕தʂ Copyright © 2009-2015 eureka, Inc. All rights reserved.

  55. େن໛Ϗοάσʔλ
 ղੳ ϚονϯάΞϧΰϦζϜ Big Data (PϑϧεΫϥον ϋΠϒϦου ΤϯδχΞ ✕ Engineering

    ʮੈքͰѪ͞ΕΔαʔϏεʯΛҰॹʹ࡞Γ·ͤΜ͔ʁ ྆Ϗδωε͕
 ηάϝϯτ/P άϩʔόϧల։த Business
  56. CONFIDENTIAL Copyright © 2009-2014 eureka, Inc. All rights reserved. Thank

    you :)