Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Google BigQuery?

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
150
0

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
350
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
170
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5.1k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.7k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.6k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.5k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.4k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
330

Other Decks in Programming

See All in Programming
【QA Test Talk Vol.8】AI-DLC による Whole Team Approach の加速
Avatar for PKSHA Technology（パークシャテクノロジー） pkshadeck
PRO
0
250
S3 を使うアプリケーションをローカル完結で動かすことに全力を注いでみた / Running S3 Apps Offline
Avatar for Daisuke Garaike contour_gara
0
670
引き算の組織 ― アウトカムとAIに全振りするために辞めたこと ― / Organization by Subtraction
Avatar for ヤマモトヒロキ hirokiyamamoto14
PRO
0
310
Loosening the Reins: Go Generics Get More Flexible
Avatar for kuro kuro_kurorrr
0
350
生成AIで帳票OCRが「簡単に」作れる時代になった？
Avatar for Shohei Kondo kon_shou
0
1.2k
VibeCodingからAgenticWorkflowへ
Avatar for starfish719 starfish719
0
940
【デモ】Kiroで体験する仕様駆動開発｜設計からコーディングまでAIと進める開発フロー
Avatar for 工藤皓夢 cmkudo
0
500
AIと壁打ちしながら進めるコスト管理
Avatar for Ryoma Fujiwara fufuhu
2
1.8k
コンパウンドプロダクト開発のためのローカルプロセスマネージャー再発明 #layerxgo
Avatar for izumin5210 izumin5210
0
460
AI駆動開発にグラフDBを重ねてみた
Avatar for Satoshi Kaneyasu satoshi256kbyte
1
370
初心者DevRelとして参加者だった私が、DevRel Talks!#2に登壇するまでにしてきたこと
Avatar for Rai sokohirai
0
160
Dockerfile CMD for Node.js
Avatar for Ohno Keita grazie1999
0
140

Featured

See All Featured
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
880
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
141
7.7k
Evolving SEO for Evolving Search Engines
Avatar for Ryan Jones ryanjones
0
270
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
560
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
3k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
270
14k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
9.2k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
28
3.6k
HTML-Aware ERB: The Path to Reactive Rendering @ RubyCon 2026, Rimini, Italy
Avatar for Marco Roth marcoroth
4
500
Side Projects
Avatar for Sacha Greif sachag
455
43k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
201
75k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
19k

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you