Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Google BigQuery for the Big Data win
Search
Sponsored
·
Ship Features Fearlessly
Turn features on and off without deploys. Used by thousands of Ruby developers.
→
Ken Taylor
April 08, 2014
Technology
0
48
Google BigQuery for the Big Data win
April 8th, 2014 talk given to the Hampton Roads .NET users group.
Ken Taylor
April 08, 2014
Tweet
Share
More Decks by Ken Taylor
See All by Ken Taylor
Ruby 2.0 Keyword Arguments
switchspan
0
120
Github Back to Basics
switchspan
1
66
Lighten the load with RabbitMQ
switchspan
0
180
RabbitMQ and EasyNetQ
switchspan
1
140
Other Decks in Technology
See All in Technology
MCPでつなぐElasticsearchとLLM - 深夜の障害対応を楽にしたい / Bridging Elasticsearch and LLMs with MCP
sashimimochi
0
150
We Built for Predictability; The Workloads Didn’t Care
stahnma
0
140
Sansan Engineering Unit 紹介資料
sansan33
PRO
1
3.8k
AzureでのIaC - Bicep? Terraform? それ早く言ってよ会議
torumakabe
1
500
顧客との商談議事録をみんなで読んで顧客解像度を上げよう
shibayu36
0
210
会社紹介資料 / Sansan Company Profile
sansan33
PRO
15
400k
配列に見る bash と zsh の違い
kazzpapa3
1
130
Bill One 開発エンジニア 紹介資料
sansan33
PRO
4
17k
Kiro IDEのドキュメントを全部読んだので地味だけどちょっと嬉しい機能を紹介する
khmoryz
0
170
What happened to RubyGems and what can we learn?
mikemcquaid
0
250
SREチームをどう作り、どう育てるか ― Findy横断SREのマネジメント
rvirus0817
0
110
外部キー制約の知っておいて欲しいこと - RDBMSを正しく使うために必要なこと / FOREIGN KEY Night
soudai
PRO
12
5.2k
Featured
See All Featured
Making the Leap to Tech Lead
cromwellryan
135
9.7k
Sam Torres - BigQuery for SEOs
techseoconnect
PRO
0
180
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
mfonobong
2
280
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
greggifford
PRO
0
77
Tips & Tricks on How to Get Your First Job In Tech
honzajavorek
0
430
Google's AI Overviews - The New Search
badams
0
900
Rebuilding a faster, lazier Slack
samanthasiow
85
9.4k
The Spectacular Lies of Maps
axbom
PRO
1
520
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
659
61k
Designing for humans not robots
tammielis
254
26k
30 Presentation Tips
portentint
PRO
1
210
Context Engineering - Making Every Token Count
addyosmani
9
650
Transcript
Google BigQuery for the BigData win
There are lots of tools to analyze Big Data
There are lots of tools to analyze Big Data
You are here to learn about one of the tools
The current OSS tools can be complicated
You would like a fast and cost effective tool
Use Google BigQuery to analyze your Big Data
BigQuery makes analyzing Big Data easy!
Google learned from initial BigData technologies
Google learned from initial BigData technologies
Google learned from initial BigData technologies
Dremel provides the query system
Data can be nested
The storage format is columar
Google provides a familiar developer experience
Queries have a common SQL-ish syntax
Dremel has functions
Table joins are a little different
BigQuery Building Blocks
Projects
Tables and Datasets
Jobs
There are several options for working with data
Google Cloud Storage
BigQuery REST API
Command-line Tools
BigQuery is very cost effective
No equipment to maintain
On-Demand Pricing
Reserved Capacity Pricing
Questions? Important Links: BigQuery: http://goo.gl/hCOMZ Dremel: http://goo.gl/0EMwl MapReduce: http://goo.gl/n0agd GFS:
http://goo.gl/WeuPy4 About Me: Ken Taylor Twitter: @taylorka Blog: switchspan.com