Redshift with Not Enterprise

C786d7772602b488a7972c38c143f61c?s=47 con_mame
August 24, 2013

Redshift with Not Enterprise

エンタープライズじゃなくてもDHWをRedshiftでという話

C786d7772602b488a7972c38c143f61c?s=128

con_mame

August 24, 2013
Tweet

Transcript

  1. /PU &OUFSQSJTFͳձࣾͰ 3FETIJGUΛ࢖ͬͯΈͨ

  2. ੕໺ ๛ !DPO@NBNF ΫοΫύουגࣜձࣾ ΠϯϑϥετϥΫνϟʔ෦ "84  .Z42-  %BUB4UPSF

    FUD IUUQEDPONBNF IUUQGBDFCPPLDPNDPONBNF
  3. #*( %"5"

  4. ੈ͸·͞ʹϏοάσʔλ ϩά ΞΫηεϩά ߦಈϩά ߪೖɾܾࡁϩά ΫϦοΫɾಈઢ

  5. Ϗοάσʔλ

  6. %8)  #* UPPM

  7. ਺ઍສʙ਺ԯ

  8. (  ゚д゚)  ・・・        (つд⊂)ゴシゴシ        (;゚д゚)

     ・・・        (つд⊂)ゴシゴシゴシ       _̲,  ._̲   (;゚  Д゚)  …!?
  9.     ∧_̲∧   ⊂(#・ω・)  置き場所が無い!     /      ノ∪     し―-‐‑‒J  |l|  |  

                      ⼈人ペシッ!!                 __                 \    \                      ̄ ̄
  10. 3FETIJGU

  11. 3FETIJGU

  12. 3FETIJGU σʔλ΢ΣΞϋ΢ε ϑϧϚωʔδυ ֦ுੑ͕ߴ͍ ਺5#ʙ਺1# ΧϥϜφܕ Ϧʔζφϒϧ

  13. "SDIJUFDUVSF

  14. None
  15. None
  16. ࢖ͬͯΈͨ

  17. #* UPPM ࢢ৔ಈ޲ Ϣʔβಈ޲ αΠτճ༡ ϚʔέςΟϯά ঎඼։ൃ

  18. 0SJHJOBM UPPM Ϣʔβಈ޲ ݕࡧϫʔυಈ޲ ؂ࠪ αϙʔτ EFWFMPQFS NPSF VTFS

  19. $00,1"%త3FETIJGU ߦಈϩά ݕࡧϩά Ϣʔβଐੑ ձһ৘ใ ؂ࠪϩά

  20. 3FETIJGUΛબΜͩΘ͚ .Z42- *OTUBODF όοΫΞοϓ  ࣗલ ༰ྔ  ૿͑ଓ͚Δ ΫΤϦ࣮ߦ଎౓

     Ϩίʔυ਺ͷ૿Ճͱڞʹ஗͘ͳΔ ӡ༻ෛՙ  ύʔςγϣχϯάͳͲͷεΫϦϓτ࡞੒ 3%4 ༰ྔ  ૿΍͠΍͍͕͢૿͑ଓ͚Δ ΫΤϦ࣮ߦ଎౓  Ϩίʔυ਺ͷ૿Ճͱڞʹ஗͘ͳΔ
  21. 3FETIJGUΛબΜͩΘ͚ ,74 ༰ྔ  ϝϞϦαΠζʹҾͬுΒΕΔ ݕࡧੑ  ॊೈͳΫΤϦ͸࢖͑ͳ͍ ӡ༻ෛՙ 

    όοΫΞοϓͳͲ͸ࣗલ 3FETIJGU ΫϥελΛ֦ு͠΍͍͢ όοΫΞοϓɾεφοϓγϣοτࣗಈ ϦΧόϦ΋؆୯ 42-͕࢖͑Δ
  22. εέδϡʔϧ  ݕূʙ3*ߪೖ  XFFLT TQFFE  CBDLVQ  PQFSBUJPO

     TQFDJGJD ༷ʑͳϝτϦΫεͰଌఆ ࠷ॳ͸؂ࠪϩά͸ߟྀ͍ͯ͠ͳ͔ͬͨ 3*ߪೖʙϩάऩू։࢝ 9-    XFFL
  23.  ೔ͷݕূ͕ऴΘͬͨΒ4OBQTIPUΛ࡞੒ͯ͠ΫϥελΛ %FMFUF ΫϥελΛ%FMFUF͢ΔͷͰ4OBQTIPUͷ4อଘྉۚ͸͔͔Δ ͕ΫϥελΛىಈ͍ͯ͠ΔΑΓ͍҆ ݕূ։࢝࣌͸4OBQTIPU͔ΒΫϥελΛىಈ σʔλ ϝλσʔλ ϢʔβɾΫϥελεϖοΫɾ୆਺ '2%/

    ɾ 1BSBNFUFS (SPVQ 4OBQTIPUʹඞཁͳσʔλ͕શͯೖ͍ͬͯΔͷͰ͙͢ʹݕূΛ ࠶։ग़དྷΔ ͨͩ͠ɺ4FDVSJUZ (SPVQ͸ຖճ.PEJGZ͢Δ
  24. app app app fluent proxy fluent proxy manage Separate audit

    from general logs TREASURE DATA
  25. app app app fluent proxy fluent proxy manage Separate audit

    from general logs DataPipline support TREASURE DATA
  26. BQQ  NBOBHF TFSWFS  GMVFOUQSPYZ ௨ৗͷϩάͱ؂ࠪ༻ϩά͸ผQSPYZ΁ GMVFOUEQMVHJO  4

    ෼ຖʹ4ʹ6QMPBE 4  3FETIJGU DPQZΛൃߦ
  27. %FWFMPQNFOU

  28. staging

  29. %# ෳ਺ͷ%#Λ࡞੒ EFWFMPQNFOU NBOZ EFWFMPQNFOU UBCMFT QSPEVDUJPO NBOZ UBCMFT &BDI

    TZTUFN
  30. 6TFS 3PPU 6TFS .BOBHFNFOU "MM %# BOE $MVTUFS 4FSWJDF 6TFS

    &BDI 4FSWJDF BOE 8-. 6TFS (SPVQ %FWFMPQNFOU 6TFS
  31. ͭͷΫϥελʹෳ਺ͷ%# ։ൃ༻ͷ%# ෳ਺αʔϏε༻ͷςʔϒϧ αʔϏεɾ༻్͝ͱʹҟͳΔΫΤϦ ࣮ߦ࣌ؒ ର৅σʔλ

  32. 8PSL -PBE .BOBHFNFOU

  33. 3FETIJGU΁ͷΫΤϦ͸Ωϡʔ͝ͱʹ؅ཧ͞ΕΔ Ωϡʔຖʹฒྻ౓͕ઃఆ͞Ε͍ͯΔ EFGBVMUͰ͸ͭͷΩϡʔɾฒྻ ฒྻ౓Λ௒͑ͨ৔߹͸ઌߦΫΤϦ͕ऴΘΔͷΛ଴ͭ Ωϡʔͷࣝผ Ϣʔβ ΫΤϦάϧʔϓ αʔόϦιʔε͸શͯͷΩϡʔͰڞ༗

  34. ࠷༏ઌ ΞϓϦέʔγϣϯ͔Βൃߦ͞ΕΔΫΤϦ ฒྻ౓ߴΊ ༏ઌ౓௿ όονͳͲ͔Βൃߦ͞Ε͋Δఔ౓͕͔͔͍࣌ؒͬͯ ͍΋ͷ Ͳ͏ʹ΋͜͏ʹ΋࣌ؒ಺ʹऩ·Βͳ͍৔߹͸Ϋϥε λαΠζΞοϓ΋ݕ౼ ࠷௿ ։ൃ༻

  35. 1BSBNFUFS (SPVQ  8-. .BY Ωϡʔ EFGBVMU Ωϡʔؚ ฒྻ౓߹ܭ 

    4VQFSVTFSΩϡʔ ฒྻ౓ ઃఆෆՄ XJMEDBSE QSPEVDUJPO@B QSPEVDUJPO@C 5JNFPVU TUBUFNFOU@UJNFPVU 5JNFPVUͱTUBUFNFOU@UJNFPVU ୹͍ํ༏ઌ EFGBVMU RVFVF
  36.  4VQFSVTFSͰϩάΠϯ͍ͯͯ͠ɺΫΤϦάϧʔ ϓͰ4VQFSVTFSΛࢦఆ͍ͯ͠Δ৔߹͸4VQFSVTFSΩ ϡʔͰ࣮ߦ  ϩάΠϯϢʔβ͕Ϣʔβάϧʔϓʹؚ·Εͯ ͍Δ৔߹͸ɺҰ൪࠷ॳʹϚον͢ΔϢʔβάϧʔ ϓͰࢦఆ͞Ε͍ͯΔΩϡʔͰ࣮ߦ  Ϣʔβάϧʔϓʹଘࡏ͓ͯ͠ΒͣɺΫΤϦά

    ϧʔϓ͕ࢦఆ͞Ε͍ͯΔ৔߹͸ɺ࠷ॳʹϚον͠ ͨΫΤϦάϧʔϓͷΩϡʔͰ࣮ߦ  ͲΕʹ΋౰ͯ͸·Βͳ͍৔߹͸σϑΥϧτΩ ϡʔͰ࣮ߦ Ϣʔβάϧʔϓ  ΫΤϦάϧʔϓ
  37. IUUQCJUMZ1/"W% Ϣʔβάϧʔϓ ΫΤϦάϧʔϓ

  38. "DDFTT $POUSPM

  39. None
  40. ΫΤϦ΍σʔλͷϩʔυঢ়گΛ֬ೝ͍ͨ͠ ࣮ߦܭը ΫϥελϦιʔεঢ়گ ΫΤϦຖͷϦιʔε࢖༻ঢ়گɾ࣮ߦ࣌ؒ

  41. 7JFX2VFSJFT*O$POTPMF Describe*

  42. redshift:get*

  43. 3FTPVSDF 5ZQF "3/ $MVTUFS BSOBXTSFETIJGUBQOPSUIFBTUDMVTUFSPSFPSF DMVTUFS 1BSBNFUFS (SPVQ BSOBXTSFETIJGUBQ OPSUIFBTUQBSBNFUFSHSPVQPSFPSFQNHSPVQ

    4FDVSJUZ (SPVQ BSOBXTSFETIJGUBQ OPSUIFBTUTFDVSJUZHSPVQPSFPSFTH 4OBQTIPU BSOBXTSFETIJGUBQOPSUIFBTUTOBQTIPUPSFPSF DMVTUFS 4VCOFU (SPVQ BSOBXTSFETIJGUBQ OPSUIFBTUTVCOFUHSPVQPSFPSFTVCOFU
  44. \   ʠ4UBUFNFOU <     \

          "DUJPO <         SFETIJGU$SFBUF$MVTUFS4OBQTIPU       >       &GGFDU "MMPX       3FTPVSDF <           BSOBXTSFETIJGUBQOPSUIFBTUTOBQTIPUPSFPSFDMVTUFS      ^   > ^ ؅ཧݖݶΛࡉ͔͘*".ϢʔβʹׂΓ౰ͯՄೳ
  45. 2VFSZ

  46. None
  47. None
  48. (FOFSBUF $PNQJMFE $PEF MJCQR BOE 0%#$ +%#$ ࣄલʹΞΫηε͞Εͦ͏ͳΫΤϦ͸ྲྀ͓ͯ͘͠ ࠷ॳͷ࣮ߦ͸਺ඵ͔͔Δ ϓϨʔεϗϧμʹೖΔ஋͕มΘͬͯ΋0,

  49. )BQQFOJOH

  50. Ωʔϫʔυ ˛Ωʔϫʔυ ˛Ωʔϫʔ υ TFMFDU TVCTUSJOH DBTU TVCTUSJOH LFZXPSET GSPN

      BT WBSDIBS   GSPN   GSPN IPHF
  51. ʊਓਓਓਓਓਓਓਓਓਓਓਓʊ ʼ  -FBEFS /PEF JT %&"%   ʻ

    ʉ?:?:?:?:?:?:?:??:?:?:?:?ʉ
  52. 65' ͳจࣈͷόΠτڥքΛԼखʹͿͬͨ੾Δͱ -FBEFS /PEF͕མͪͯΔΆ͍Α͏Ͱ ੾அ͞Εͯ਺ेඵܨ͕Βͳ͘ͳΔ ݄Լ०ʹ࣏ͬͨ

  53. .BJOUFOBODF 8JOEPXதͰ΋$01:͕੒ޭ͠ ͯ͠·͏ ௐ͓ࠪئ͍தʜ

  54. .BJOUFOBODF 8JOEPXͷ࣌ؒͰϝϯςφϯ ε͕ࠂ஌͞Ε͍ͯΔ৔߹͸$01:Λ࣮ߦ͠ ͳ͍Α͏ʹվྑ

  55. $PODMVTJPO

  56. Ϣʔβಈ޲͚ͩ͡Όͳ͍ ؂ࠪϩάʹ΋ ࠷ॳ͸ෳ਺γεςϜ·ͱΊͯ΋0, 8-.͸͔ͬ͠Γͱ ϝϯςφϯεಈ޲͸ཁ֬ೝ 8BUDI 'PSVN

  57. 5IBOL ZPV