Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
43
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
160
FPGAによる大規模データ処理の高速化
kazunori279
0
86
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.6k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.3k
Distributed TensorFlow
kazunori279
3
2.3k
Cloud Vision API and TensorFlow
kazunori279
7
9k
Having fun with Google Cloud + RasPi
kazunori279
0
1.1k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
240
Other Decks in Programming
See All in Programming
DynamoDB コスト最適化っぽいことの基本 with Terraform
kuro_kurorrr
2
250
Namespace on read
tagomoris
2
370
生成AIをkintoneに連携してみた
hideg
0
230
さきがけから振り返るアーキテクチャ刷新 / Reflecting on the Architectural Renewal from the Vanguard
nrslib
2
780
Webエディタライブラリ 「CodeMirror」から学ぶ Webアプリ開発のテクニック
ryosukeigarashi
0
250
3 Effective Rules for Success with Signals in Angular
manfredsteyer
PRO
0
120
MIERUNE BBQにおけるユーザー中心設計()
mierune
PRO
1
110
Advanced App Shrinking Techniques
cbeyls
2
150
コード生成を伴うLLMエージェント - 2024.07.18 Tokyo AI
smiyawaki0820
11
4.1k
Cloudflare Workers x AWS Lambdaの組み合わせユースケース / Cloudflare Workers x AWS Lambda Combination Use Case
seike460
PRO
2
310
SDCon2024: Enabling DevOps and Team Topologies thru architecture: architecting for fast flow
cer
PRO
0
780
Android開発者のための Kotlin Multiplatform入門
ntaro
0
190
Featured
See All Featured
Dealing with People You Can't Stand - Big Design 2015
cassininazir
360
22k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
248
20k
jQuery: Nuts, Bolts and Bling
dougneiner
61
7.4k
RailsConf 2023
tenderlove
16
720
ReactJS: Keep Simple. Everything can be a component!
pedronauck
662
120k
Build your cross-platform service in a week with App Engine
jlugia
227
17k
Practical Orchestrator
shlominoach
185
10k
Art, The Web, and Tiny UX
lynnandtonic
291
20k
Robots, Beer and Maslow
schacon
PRO
157
8.1k
In The Pink: A Labor of Love
frogandcode
139
22k
Gamification - CAS2011
davidbonilla
78
4.9k
Why Our Code Smells
bkeepers
PRO
332
56k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you