Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
140
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
350
FPGAによる大規模データ処理の高速化
kazunori279
0
170
Googleがめざす、誰もが使える機械学習
kazunori279
4
5.1k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.7k
Distributed TensorFlow
kazunori279
3
2.6k
Cloud Vision API and TensorFlow
kazunori279
7
9.5k
Having fun with Google Cloud + RasPi
kazunori279
0
1.4k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
330
Other Decks in Programming
See All in Programming
【やさしく解説 設計編・中級 #6】良いアーキテクチャとは ~ 一本の登り道の、行き先 ~
panda728
PRO
0
210
プロポーザルを書いてもらう
pvcresin
0
500
PHP に部分適用が来るぞ!……ところで何それ?おいしいの? #phpcon / phpcon-2026
shogogg
0
650
ITヒヤリハットを整理してみた ~ライフサイクルと原因から考える再発防止策~
koukimiura
1
140
AI時代のPHPer生存戦略 ~「言語、もうなんでもよくない?」に本気で向き合う~
vivion
0
360
Claude Code全社展開のためにやったことn選~プラグイン302個・コミッター271人を支えるために~
kenchan
5
1.5k
ソフトウェア設計に溶けるインフラ ― AWS CDK のインフラ認識論
konokenj
3
780
Building a Meta Ray-Ban display app
akkeylab
0
140
GDG Korea Android: 2026 I/O Extended ~ What's new in Android development tools
pluu
0
220
型も通る、synthも通る、それでも危ない 〜AIのCDKの権限とコストを機械で検証する〜 / It Passes Type Checks, It Passes Synth Checks, but It’s Still Risky — Automatically Verifying Permissions and Costs in AI’s CDK —
seike460
PRO
1
550
ルールを書いて終わらせないハーネスエンジニアリング
yug1224
4
1.9k
AWS CDK を「作」ってみた 〜フルスクラッチで見えた CDK の裏側〜 / aws-cdk-from-scratch
gotok365
3
2.8k
Featured
See All Featured
WCS-LA-2024
lcolladotor
0
790
Amusing Abliteration
ianozsvald
1
240
The Spectacular Lies of Maps
axbom
PRO
1
910
Marketing Yourself as an Engineer | Alaka | Gurzu
gurzu
0
280
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
chikuwait
0
700
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
128
56k
We Have a Design System, Now What?
morganepeng
55
8.3k
The Limits of Empathy - UXLibs8
cassininazir
1
600
Java REST API Framework Comparison - PWX 2021
mraible
34
9.6k
Applied NLP in the Age of Generative AI
inesmontani
PRO
4
2.4k
A Tale of Four Properties
chriscoyier
163
24k
Lightning talk: Run Django tests with GitHub Actions
sabderemane
0
230
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you