Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
BigQueryで金を溶かさない知識
Search
Aipa
April 22, 2019
Technology
0
610
BigQueryで金を溶かさない知識
「【沖縄開催!】中国地方DB勉強会 in 沖縄」でLTしてきたスライド
https://dbstudychugoku.connpass.com/event/127067/
Aipa
April 22, 2019
Tweet
Share
More Decks by Aipa
See All by Aipa
ピンチヒッターです。なにか話します
commander_aipa
0
130
おれたちはいつDXできるのか
commander_aipa
1
78
ウンケーニオキタコワイハナシ
commander_aipa
0
130
Nuxt3 Deeeeeeeeeeeeeeeeeeeeeploy
commander_aipa
0
180
Meilisearchでハイブリッドベクトル検索
commander_aipa
0
150
Honoの導入を検討していたが、Honoの人が来沖するらしいので、急いでHonoを導入した話
commander_aipa
0
200
Dの意思は神を殺す
commander_aipa
0
100
ファインチューニングがしたい
commander_aipa
0
200
サクッと検索サーバを用意する
commander_aipa
0
210
Other Decks in Technology
See All in Technology
AWS Top Engineer、浮いてませんか? / As an AWS Top Engineer, Are You Out of Place?
yuj1osm
2
220
OCI Network Firewall 概要
oracle4engineer
PRO
2
7.9k
Node.js 2025: What's new and what's next
ruyadorno
0
350
データ戦略部門 紹介資料
sansan33
PRO
1
3.8k
Sansan Engineering Unit 紹介資料
sansan33
PRO
1
3k
Introduction to Bill One Development Engineer
sansan33
PRO
0
300
AWS Control Tower に学ぶ! IAM Identity Center 権限設計の第一歩 / IAM Identity Center with Control Tower
y___u
0
170
物体検出モデルでシイタケの収穫時期を自動判定してみた。 #devio2025
lamaglama39
0
160
[Codex Meetup Japan #1] Codex-Powered Mobile Apps Development
korodroid
2
870
「れきちず」のこれまでとこれから - 誰にでもわかりやすい歴史地図を目指して / FOSS4G 2025 Japan
hjmkth
1
310
業務効率化をさらに加速させる、ノーコードツールとStep Functionsのハイブリッド化
smt7174
2
140
LLMアプリの地上戦開発計画と運用実践 / 2025.10.15 GPU UNITE 2025
smiyawaki0820
1
580
Featured
See All Featured
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
1.2k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
49
3.1k
Building a Modern Day E-commerce SEO Strategy
aleyda
44
7.8k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
980
Writing Fast Ruby
sferik
629
62k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
162
15k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.5k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
115
20k
The World Runs on Bad Software
bkeepers
PRO
72
11k
Rails Girls Zürich Keynote
gr2m
95
14k
Building Applications with DynamoDB
mza
96
6.7k
Transcript
தࠃํDBษڧձ in ԭೄ LT ΞΠύʔୂ
ࣗݾհ
ࣗݾհ • ΞΠύʔୂ(ࠓ 29) • ͪΎΒσʔλגࣜձࣾ • PyData.OkinawaڞಉΦʔΨφΠβʔ • Python͖Ͱ͕͢SQLΫιࡶڕͰ͢
ࠓ͢͜ͱ
BigQueryͰML
υΩϡϝϯτݟʹߦ͘
υΩϡϝϯτݟʹߦ͘
͔̎ͭ͠ͳ͍(´ɾωɾʆ)
͔̎ͭ͠ͳ͍ ʢेͬͪΌे͚ͩͲʣ Ϟνϕʔγϣϯ͕Լ͕ͬͨ
վΊͯ ࠓ͢͜ͱ
BigQueryͰ ۚΛ༹͔͞ͳ͍ςΫχοΫ
ʮBigQueryʯͰάάΔ
https://qiita.com/itkr/items/745d54c781badc148bb9 BigQuery ා͍
https://twitter.com/icoxfog417/status/821576129223872513 ΈΜͳ BigQuery ͕ා͍
https://twitter.com/icoxfog417/status/821576129223872513 ΈΜͳ BigQuery ͕ා͍
ڪාΛࠀ͍ͨ͠
ڪාΛࠀ͍ͨ͠ https://www.cocolabo.me/kyouhu1mechanism/
ڪාΛࠀ͍ͨ͠ https://www.cocolabo.me/kyouhu1mechanism/
ڪාΛࠀ͍ͨ͠ https://www.cocolabo.me/kyouhu1mechanism/
ڪාΛࠀ͍ͨ͠ • ԿʹڪΕ͍ͯΔͷ͔ ˠ Ϋϥυഁ࢈ • Ͳ͏ͬͨΒࠀͰ͖Δͷ͔ ˠ ֹۚΛݟੵΓ͍ͨ ˠ
ഁ࢈͠ͳ͍Α͏ɺదͳ͍ํ͕Ͱ͖Ε
BigQueryͷྉۚΛΔ
BigQueryͷྉۚΛΔ • ओʹ̎ͭʢ౦ژ asia-northeast1Ͱհʣ • ετϨʔδྉۚ • σʔλૢ࡞ྉۚ
BigQueryͷྉۚΛΔ • ετϨʔδྉۚ ྉۚ ৄࡉ ΞΫςΟϒ (# ຖ݄(#·Ͱແྉ ظอଘ (#
ຖ݄(#·Ͱແྉ ※ΞΫςΟϒ ŋŋŋ աڈ90ؒͰมߋ͞Εͨσʔλʹର͢Δֹ݄ྉۚ ※ظ ŋŋŋ աڈ90ؒͰมߋ͞Ε͍ͯͳ͍σʔλʹλ͢Δֹ݄ྉۚ
BigQueryͷྉۚΛΔ • ετϨʔδྉۚ • 1ϲ݄100GBͬͯͯɺ$2.23 ! • ͋Βʁ݁ߏ͓ಘͰ
BigQueryͷྉۚΛΔ • σʔλૢ࡞ྉۚ: σʔλͷಡΈࠐΈ • ओʹํ๏͕2ͭ • ᶃGCSʹΞοϓϩʔυͯ͠ → BigQueryอଘ
• BigQueryͱͯ͠ͷྉۚແྉͳΜ͚ͩͲɺGCSͷετϨʔδྉۚͱσʔλ సૹྉ͕͔͔ۚΔ • ᶄετϦʔϛϯάΠϯαʔτ $0.06/GB • ϦΞϧλΠϜੑΛٻΊΔͳΒ͜Ε͚ͩͲɺྲྀΕΔσʔλྔʹҙ • ଞͷํ๏ͱͯ͠ɺBigQueryͷΣϒUIΛ༻͍ͯJSONCSVܗࣜͰΞοϓϩʔυ͢ Δ͜ͱ͕Ͱ͖·͢ → ࢼ͙͢Β͍ͳΒͪ͜ΒΛ࠾༻ͨ͠΄͏͕ྑ͍ʢແྉʣ
BigQueryͷྉۚΛΔ • ΫΤϦྉۚ • $8.55/TBʢຖ݄1TB·Ͱແྉʣ • ΫΤϦ࣮ߦͷྉۚσʔλܕͷαΠζʹԠͯ͡ɺ MB୯Ґͷσʔλॲཧ༰ྔͰܾ·Δ • Τϥʔͱ͔Ωϟογϡͷ݁Ռʹྉۚൃੜ͠ͳ͍
• Ͱ͔͍σʔλʹΫΤϦ͛Δ࣌ҙ
BigQueryͷྉۚΛΔ • ΫΤϦྉۚ • ݄ఆֹͷϓϥϯ͋Δ͕ɺ$48,000/݄ • ೋݟͨ͠ • Կ͏ਓʹ͍҆ΜͩΖ͏ʢଟʣ
গ͠ڪා͕Β͍Ͱ͖ͨ
Ͱ·ͩා͍
BigQueryͷඅ༻ͷ ͑ํΛΔ
• ʮSELECT *ʯېࢭ • ʮLIMITʯʹҙ • ΫΤϦݕূ݁Ռͷ֬ೝ BigQueryͷඅ༻ͷ͑ํΛΔ
• ʮSELECT *ʯېࢭ • BigQueryΧϥϜܕσʔλߏͷͨΊɺʮSELECT *ʯΛར༻͢Δͱ ͯ͢ͷྻΛεΩϟϯ͢ΔͨΊɺͦͷ՝ۚ͞ΕΔ • ඞཁͳྻ͚ͩࢦఆ͍ͯͩ͘͠͞ •
Լʮbigquery-public-data.hacker_news.fullʯͷςʔϒϧͰ֬ೝͨ݁͠Ռ BigQueryͷඅ༻ͷ͑ํΛΔ ɾSELECT * FROM xxx ɾSELECT title FROM xxx
• ʮLIMITʯʹҙ • ʮSELECT * FROM xxxʯͰɺʮLIMIT Nʯ͢Ε͍͍ͷͰɾɾɾɾʁ • !Ͱ͢
• ಡΈऔΔόΠτมΘΒͣɺ݁Ռͷग़ྗߦ੍͕ݶ͞ΕΔ͚ͩ BigQueryͷඅ༻ͷ͑ํΛΔ ɾSELECT * FROM xxx ɾSELECT * FROM xxx LIMIT 100
• ΫΤϦݕূ݁Ռͷ֬ೝ • ࣮ߦ͢ΔSQL νΣοΫͯ͘͠ΕΔ ศརͳԿ͔ • ॲཧ͢ΔόΠτΛ ܭࢉͯ͘͠ΕΔͷͰ ࣮ߦ͢ΔΫΤϦͷྉۚ
Λࣄલʹ֬ೝ͢Δ ͜ͱ͕Ͱ͖Δʢखಈʣ BigQueryͷඅ༻ͷ͑ํΛΔ
BigQueryͷඅ༻ͷ͑ํΛΔ https://cloud.google.com/products/calculator/ ྉۚܭࢉπʔϧ͋Δ
ʢܭࢉʣͩΔ͍
ศརͳPlugin
• BigQuery Mate • BigQueryͷWeb UI͔Βར༻͢Δͱ͖ʹͳʹ ͔ͱศར • ChromeͷΈ ศརͳPlugin
https://chrome.google.com/webstore/detail/bigquery-mate/nepgdloeceldecnoaaegljlichnfognh/related
• ը໘͜Μͳײ͡ ศརͳPlugin
• SQLม͑ͯΈΔͱྉ͕ۚ࠶ܭࢉ͞ΕΔ ศརͳPlugin
ศར!!!
• Ҏલɺ৽͍͠UIʹͳͬͨΜ͚ͩͲɺͦ͜Ͱ ͑ͳͦ͞͏(´ɾωɾʆ) • ΞοϓσʔτΛͭ or GASͰܭࢉεΫϦϓτ Λ༻ҙ͢Δ͔ ͕͔ͩ͠͠…
ࡶײ
• BigQuery͜Θͳ͘ͳ͍Α • ࣄલʹγϡϛϨʔγϣϯͯ͠ྉۚܭࢉ͠Α͏ • ࣮ߦ͢ΔSQL͕εΩϟϯ͢Δσʔλྔ ࣄલʹ֬ೝͨ͠΄͏͕͍͍Α ࡶײ
None