Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
56
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
210
FPGAによる大規模データ処理の高速化
kazunori279
0
100
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.8k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.5k
Distributed TensorFlow
kazunori279
3
2.4k
Cloud Vision API and TensorFlow
kazunori279
7
9.2k
Having fun with Google Cloud + RasPi
kazunori279
0
1.2k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
270
Other Decks in Programming
See All in Programming
技術を改善し続ける
gumioji
0
150
Serverless Rust: Your Low-Risk Entry Point to Rust in Production (and the benefits are huge)
lmammino
1
160
AWS Step Functions は CDK で書こう!
konokenj
4
640
Go 1.24でジェネリックになった型エイリアスの紹介
syumai
2
300
Jakarta EE meets AI
ivargrimstad
0
500
なぜイベント駆動が必要なのか - CQRS/ESで解く複雑系システムの課題 -
j5ik2o
14
4.7k
LINE messaging APIを使ってGoogleカレンダーと連携した予約ツールを作ってみた
takumakoike
0
120
苦しいTiDBへの移行を乗り越えて快適な運用を目指す
leveragestech
0
1.1k
Boos Performance and Developer Productivity with Jakarta EE 11
ivargrimstad
0
470
1年目の私に伝えたい!テストコードを怖がらなくなるためのヒント/Tips for not being afraid of test code
push_gawa
1
630
PHPカンファレンス名古屋2025 タスク分解の試行錯誤〜レビュー負荷を下げるために〜
soichi
1
730
.NET Frameworkでも汎用ホストが使いたい!
tomokusaba
0
200
Featured
See All Featured
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
Bash Introduction
62gerente
611
210k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
160
15k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.5k
Building Flexible Design Systems
yeseniaperezcruz
328
38k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
11
1.3k
Designing on Purpose - Digital PM Summit 2013
jponch
117
7.1k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
49k
Building Your Own Lightsaber
phodgson
104
6.2k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.1k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
193
16k
Optimizing for Happiness
mojombo
377
70k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you