Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Google BigQuery?

Avatar for Kazunori Sato Kazunori Sato
February 04, 2016
Programming
120
0

What is Google BigQuery?

For CROSS 2016 presentation

Avatar for Kazunori Sato

Kazunori Sato

February 04, 2016

More Decks by Kazunori Sato

See All by Kazunori Sato
Tensor Processing Unit (TPU) Overview (July 6, 2018)
Avatar for Kazunori Sato kazunori279
0
310
FPGAによる大規模データ処理の高速化
Avatar for Kazunori Sato kazunori279
0
150
Googleがめざす、誰もが使える機械学習
Avatar for Kazunori Sato kazunori279
4
5.1k
Machine Intelligence at Google Scale
Avatar for Kazunori Sato kazunori279
3
1.4k
Machine Intelligence at Google Scale: Vision/Speech API, TensorFlow and Cloud Machine Learning
Avatar for Kazunori Sato kazunori279
3
5.6k
Distributed TensorFlow
Avatar for Kazunori Sato kazunori279
3
2.5k
Cloud Vision API and TensorFlow
Avatar for Kazunori Sato kazunori279
7
9.4k
Having fun with Google Cloud + RasPi
Avatar for Kazunori Sato kazunori279
0
1.3k
[GCPUG India] Firebase - Build Extraordinary Apps
Avatar for Kazunori Sato kazunori279
2
310

Other Decks in Programming

See All in Programming
アクセシビリティ試験の"その後"を仕組み化する
Avatar for yuuumin yuuumiravy
0
140
t *testing.T は どこからやってくるの？
Avatar for Kotaro Otaka otakakot
0
500
Radical Imagining - LIFT 2025-2027 Policy Agenda
Avatar for LIFT lift1998
0
300
Mastering Event Sourcing: Your Parents Holidayed in Yugoslavia
Avatar for Marek Matulka super_marek
0
150
RSAが破られる前に知っておきたい 耐量子計算機暗号(PQC)入門 / Intro to PQC: Preparing for the Post-RSA Era
Avatar for mackey0225 mackey0225
3
130
Swift Concurrency Type System
Avatar for Yasuhiro Inami inamiy
0
510
Don't Prompt Harder, Structure Better
Avatar for Yusuke Kita kitasuke
0
750
「Linuxサーバー構築標準教科書」を読んでみた #ツナギメオフライン.7
Avatar for akase244 akase244
0
1.4k
ローカルで稼働する AI エージェントを超えて / beyond-local-ai-agents
Avatar for geeawa gawa
3
270
10年分の技術的負債、完済へ ― Claude Code主導のAI駆動開発でスポーツブルを丸ごとリプレイスした話
Avatar for nero15 takuya_houshima
0
2.5k
書籍「ユーザーストーリーマッピング」が私のバイブル
Avatar for asumikam asumikam
3
250
Go_College_最終発表資料__外部公開用_.pdf
Avatar for xe-pc23 xe_pc23
0
210

Featured

See All Featured
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
54k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
432
67k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
170
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
320
Done Done
Avatar for chrislema chrislema
186
16k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1.2k
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
Avatar for Sara Fernández Carmona sarafernandez
0
170
Music & Morning Musume
Avatar for Bryan Veloso bryan
47
7.2k
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
1
350
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
1
340
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k

Transcript

  1. What is Google BigQuery?

  2. +Kazunori Sato @kazunori_279 Kaz Sato Staff Developer Advocate, Tech Lead

    for Data & Analytics, Cloud Platform, Google Inc.

  3. = The Datacenter as a Computer

  4. None

  5. Enterprise

  6. Jupiter network 40GbE ports 10GbE x 100K = 1 Pbps

    CLOS topology Software Defined Network

  7. Borg Launches 2B containers / week Manages 10K machines /

    Cell DC-scale proactive job sched (CPU, mem, disk IO, TCP ports) Paxos-based metadata store

  8. Google BigQuery

  9. 1 B 1 B 100 B 900 M

  10. At Google, MapReduce is classic. We use BigQuery. Confidential &

    Proprietary Google Cloud Platform 10

  11. SELECT your_data FROM billions_of_rows WHERE full_disk_scan_required = true; Scanning 1

    TB in 1 sec with 5,000 - 10,000 disk spindles

  12. BigQuery Analytic Service in the Cloud BigQuery Analyze Export Import

    How to use BigQuery? Google Analytics ETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop

  13. Blazingly Fast Capable of scanning 10B rows in ~10 sec

    Low Cost Storage: $0.020 per GB per month Queries: $5 per TB Fully Managed Use thousands of servers with zero-ops SQL Simple and Intuitive SQL with JS UDF Benefits of BigQuery

  14. Thank you