Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
56
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
210
FPGAによる大規模データ処理の高速化
kazunori279
0
100
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.8k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.5k
Distributed TensorFlow
kazunori279
3
2.4k
Cloud Vision API and TensorFlow
kazunori279
7
9.2k
Having fun with Google Cloud + RasPi
kazunori279
0
1.2k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
270
Other Decks in Programming
See All in Programming
sappoRo.R #12 初心者セッション
kosugitti
0
280
メンテが命: PHPフレームワークのコンテナ化とアップグレード戦略
shunta27
0
300
Rails アプリ地図考 Flush Cut
makicamel
1
130
未経験でSRE、はじめました! 組織を支える役割と軌跡
curekoshimizu
1
150
Djangoアプリケーション 運用のリアル 〜問題発生から可視化、最適化への道〜 #pyconshizu
kashewnuts
1
260
苦しいTiDBへの移行を乗り越えて快適な運用を目指す
leveragestech
0
1k
「個人開発マネタイズ大全」が教えてくれたこと
bani24884
1
190
Unity Android XR入門
sakutama_11
0
180
Honoのおもしろいミドルウェアをみてみよう
yusukebe
1
230
機能が複雑化しても 頼りになる FactoryBotの話
tamikof
0
140
GoとPHPのインターフェイスの違い
shimabox
2
210
PRレビューのお供にDanger
stoticdev
1
230
Featured
See All Featured
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.1k
Building Adaptive Systems
keathley
40
2.4k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.7k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
45
9.4k
Raft: Consensus for Rubyists
vanstee
137
6.8k
A Modern Web Designer's Workflow
chriscoyier
693
190k
Bootstrapping a Software Product
garrettdimon
PRO
306
110k
Gamification - CAS2011
davidbonilla
80
5.2k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
10
1.3k
Practical Orchestrator
shlominoach
186
10k
Automating Front-end Workflow
addyosmani
1368
200k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you