Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
83
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
250
FPGAによる大規模データ処理の高速化
kazunori279
0
120
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.9k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.6k
Distributed TensorFlow
kazunori279
3
2.4k
Cloud Vision API and TensorFlow
kazunori279
7
9.3k
Having fun with Google Cloud + RasPi
kazunori279
0
1.2k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
280
Other Decks in Programming
See All in Programming
管你要 trace 什麼、bpftrace 用下去就對了 — COSCUP 2025
shunghsiyu
0
470
Laravel Boost 超入門
fire_arlo
1
120
TROCCO×dbtで実現する人にもAIにもやさしいデータ基盤
nealle
0
330
Dart 参戦!!静的型付き言語界の隠れた実力者
kno3a87
0
210
AIレビュアーをスケールさせるには / Scaling AI Reviewers
technuma
2
230
『リコリス・リコイル』に学ぶ!! 〜キャリア戦略における計画的偶発性理論と変わる勇気の重要性〜
wanko_it
1
590
SOCI Index Manifest v2が出たので調べてみた / Introduction to SOCI Index Manifest v2
tkikuc
1
110
TanStack DB ~状態管理の新しい考え方~
bmthd
2
330
サイトを作ったらNFCタグキーホルダーを爆速で作れ!
yuukis
0
490
コンテキストエンジニアリング Cursor編
kinopeee
1
700
大規模FlutterプロジェクトのCI実行時間を約8割削減した話
teamlab
PRO
0
490
STUNMESH-go: Wireguard NAT穿隧工具的源起與介紹
tjjh89017
0
380
Featured
See All Featured
How STYLIGHT went responsive
nonsquared
100
5.7k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
36
2.5k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
RailsConf 2023
tenderlove
30
1.2k
The Cost Of JavaScript in 2023
addyosmani
53
8.8k
Embracing the Ebb and Flow
colly
87
4.8k
Typedesign – Prime Four
hannesfritz
42
2.8k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
48
9.6k
Building an army of robots
kneath
306
46k
[RailsConf 2023] Rails as a piece of cake
palkan
56
5.8k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.4k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you