Upgrade to Pro — share decks privately, control downloads, hide ads and more …

BigQueryで金を溶かさない知識

Avatar for Aipa Aipa
April 22, 2019

 BigQueryで金を溶かさない知識

「【沖縄開催!】中国地方DB勉強会 in 沖縄」でLTしてきたスライド

https://dbstudychugoku.connpass.com/event/127067/

Avatar for Aipa

Aipa

April 22, 2019
Tweet

More Decks by Aipa

Other Decks in Technology

Transcript

  1. BigQueryͷྉۚΛ஌Δ • ετϨʔδྉۚ ྉۚ ৄࡉ ΞΫςΟϒ (# ຖ݄(#·Ͱແྉ ௕ظอଘ (#

    ຖ݄(#·Ͱແྉ ※ΞΫςΟϒ ŋŋŋ աڈ90೔ؒͰมߋ͞Εͨσʔλʹର͢Δֹ݄ྉۚ ※௕ظ ŋŋŋ աڈ90೔ؒͰมߋ͞Ε͍ͯͳ͍σʔλʹλ΢͢Δֹ݄ྉۚ
  2. BigQueryͷྉۚΛ஌Δ • σʔλૢ࡞ྉۚ: σʔλͷಡΈࠐΈ • ओʹํ๏͕2ͭ • ᶃGCSʹΞοϓϩʔυͯ͠ → BigQuery΁อଘ

    • BigQueryͱͯ͠ͷྉۚ͸ແྉͳΜ͚ͩͲɺGCSͷετϨʔδྉۚͱσʔλ సૹྉ͕͔͔ۚΔ • ᶄετϦʔϛϯάΠϯαʔτ ໿$0.06/GB • ϦΞϧλΠϜੑΛٻΊΔͳΒ͜Ε͚ͩͲɺྲྀΕΔσʔλྔʹ஫ҙ • ଞͷํ๏ͱͯ͠ɺBigQueryͷ΢ΣϒUIΛ༻͍ͯJSON΍CSVܗࣜͰΞοϓϩʔυ͢ Δ͜ͱ͕Ͱ͖·͢ → ࢼ͙͢Β͍ͳΒͪ͜ΒΛ࠾༻ͨ͠΄͏͕ྑ͍ʢແྉʣ
  3. • ʮSELECT *ʯېࢭ • BigQuery͸ΧϥϜܕσʔλߏ଄ͷͨΊɺʮSELECT *ʯΛར༻͢Δͱ
 ͢΂ͯͷྻΛεΩϟϯ͢ΔͨΊɺͦͷ෼՝ۚ͞ΕΔ • ඞཁͳྻ͚ͩࢦఆ͍ͯͩ͘͠͞ •

    Լ͸ʮbigquery-public-data.hacker_news.fullʯͷςʔϒϧͰ֬ೝͨ݁͠Ռ BigQueryͷඅ༻ͷ཈͑ํΛ஌Δ ɾSELECT * FROM xxx ɾSELECT title FROM xxx
  4. • ʮLIMITʯʹ஫ҙ • ʮSELECT * FROM xxxʯͰ΋ɺʮLIMIT Nʯ͢Ε͹͍͍ͷͰ͸ɾɾɾɾʁ • !Ͱ͢

    • ಡΈऔΔόΠτ਺͸มΘΒͣɺ݁Ռͷग़ྗߦ਺੍͕ݶ͞ΕΔ͚ͩ BigQueryͷඅ༻ͷ཈͑ํΛ஌Δ ɾSELECT * FROM xxx ɾSELECT * FROM xxx LIMIT 100
  5. • BigQuery Mate • BigQueryͷWeb UI͔Βར༻͢Δͱ͖ʹͳʹ ͔ͱศར • ChromeͷΈ ศརͳPlugin

    https://chrome.google.com/webstore/detail/bigquery-mate/nepgdloeceldecnoaaegljlichnfognh/related