Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What is Google BigQuery?
Search
Kazunori Sato
February 04, 2016
Programming
0
71
What is Google BigQuery?
For CROSS 2016 presentation
Kazunori Sato
February 04, 2016
Tweet
Share
More Decks by Kazunori Sato
See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
kazunori279
0
240
FPGAによる大規模データ処理の高速化
kazunori279
0
120
Googleがめざす、誰もが使える機械学習
kazunori279
4
4.9k
Machine Intelligence at Google Scale
kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
kazunori279
3
5.5k
Distributed TensorFlow
kazunori279
3
2.4k
Cloud Vision API and TensorFlow
kazunori279
7
9.3k
Having fun with Google Cloud + RasPi
kazunori279
0
1.2k
[GCPUG India] Firebase - Build Extraordinary Apps
kazunori279
2
280
Other Decks in Programming
See All in Programming
Team topologies and the microservice architecture: a synergistic relationship
cer
PRO
0
100
TypeScript LSP の今までとこれから
quramy
1
500
コード書くの好きな人向けAIコーディング活用tips #orestudy
77web
3
300
GoのGenericsによるslice操作との付き合い方
syumai
2
480
Elixir で IoT 開発、 Nerves なら簡単にできる!?
pojiro
1
120
AWS CDKの推しポイント 〜CloudFormationと比較してみた〜
akihisaikeda
3
210
Haskell でアルゴリズムを抽象化する / 関数型言語で競技プログラミング
naoya
17
4.1k
RubyKaigiで得られる10の価値 〜Ruby話を聞くことだけが RubyKaigiじゃない〜
tomohiko9090
0
140
実践ArchUnit ~実例による検証パターンの紹介~
ogiwarat
2
250
iOSアプリ開発で 関数型プログラミングを実現する The Composable Architectureの紹介
yimajo
2
200
ワンバイナリWebサービスのススメ
mackee
10
7.7k
人には人それぞれのサービス層がある
shimabox
3
670
Featured
See All Featured
Building Applications with DynamoDB
mza
95
6.4k
Producing Creativity
orderedlist
PRO
346
40k
Facilitating Awesome Meetings
lara
54
6.4k
Writing Fast Ruby
sferik
628
61k
Bash Introduction
62gerente
614
210k
How to Ace a Technical Interview
jacobian
276
23k
We Have a Design System, Now What?
morganepeng
52
7.6k
Reflections from 52 weeks, 52 projects
jeffersonlam
350
20k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.3k
Being A Developer After 40
akosma
90
590k
Product Roadmaps are Hard
iamctodd
PRO
53
11k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
123
52k
Transcript
What is Google BigQuery?
+Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead
for Data & Analytics, Cloud Platform, Google Inc.
= The Datacenter as a Computer
None
Enterprise
Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps
CLOS topology Software Defined Network
Borg Launches 2B containers / week Manages 10K machines /
Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store
Google BigQuery
1 B 1 B 100 B 900 M
At Google, MapReduce is classic. We use BigQuery. Confidential &
Proprietary Google Cloud Platform 10
SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1
TB in 1 sec with 5,000 - 10,000 disk spindles
BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import
How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
Blazingly Fast Capable of scanning 10B rows in ~10 sec
Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery
Thank you