Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
38
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
150
FPGAによる大規模データ処理の高速化
kazunori279
0
78
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.5k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.2k
Distributed TensorFlow
kazunori279
3
2.2k
Cloud Vision API and TensorFlow
kazunori279
7
8.9k
Having fun with Google Cloud + RasPi
kazunori279
0
1k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
240
Other Decks in Programming
See All in Programming
Blue/Greenデプロイの導入による 運用フローの改善
kudoas
1
360
HUIT新歓2024「競技プログラミング、やってみませんか?」
slephy2784
1
250
PHPの次期バージョンはこの時期どうなっているのか - Internalsの開発体制について - PHPカンファレンス小田原
youkidearitai
PRO
1
180
TYPO3 v13 – The road to LTS: What's new and new APIs
luisasofie_xoxo
0
180
try! Swift Tokyo 2024 参加報告 / try! Swift Tokyo 2024 Report
hironytic
0
180
StreamlitとTerraformでデータカタログを作った話
gussan0223
0
310
Prepare for Jakarta EE 11 - Performance and Developer Productivity
ivargrimstad
0
500
雑に思考を整理する技術と効能
konifar
57
26k
What We Can Learn From OSS
inouehi
0
410
FigmaとPHPで作る1ミリたりとも表示崩れしない最強の帳票印刷ソリューション
ttskch
39
18k
Milestoner
bkuhlmann
1
400
DMMプラットフォームがTiDB Cloudを採用した背景
pospome
8
3.7k
Featured
See All Featured
Designing the Hi-DPI Web
ddemaree
276
33k
Fashionably flexible responsive web design (full day workshop)
malarkey
397
65k
Testing 201, or: Great Expectations
jmmastey
27
6.3k
The MySQL Ecosystem @ GitHub 2015
samlambert
242
12k
Fantastic passwords and where to find them - at NoRuKo
philnash
36
2.5k
GitHub's CSS Performance
jonrohan
1023
450k
Visualization
eitanlees
135
14k
Optimizing for Happiness
mojombo
370
69k
The Language of Interfaces
destraynor
151
23k
Rebuilding a faster, lazier Slack
samanthasiow
72
8.2k
Building Flexible Design Systems
yeseniaperezcruz
318
37k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
186
16k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you