Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Google BigQuery for the Big Data win

Avatar for Ken Taylor Ken Taylor
April 08, 2014
Technology
0
45

Google BigQuery for the Big Data win

April 8th, 2014 talk given to the Hampton Roads .NET users group.

Avatar for Ken Taylor

Ken Taylor

April 08, 2014
Tweet

More Decks by Ken Taylor

See All by Ken Taylor
Ruby 2.0 Keyword Arguments
Avatar for Ken Taylor switchspan
0
120
Github Back to Basics
Avatar for Ken Taylor switchspan
1
60
Lighten the load with RabbitMQ
Avatar for Ken Taylor switchspan
0
170
RabbitMQ and EasyNetQ
Avatar for Ken Taylor switchspan
1
140

Other Decks in Technology

See All in Technology
COVESA VSSによる車両データモデルの標準化とAWS IoT FleetWiseの活用
Avatar for Yuto Osawa osawa
1
340
未経験者・初心者に贈る！40分でわかるAndroidアプリ開発の今と大事なポイント
Avatar for operandoOS operando
5
710
【実演版】カンファレンス登壇者・スタッフにこそ知ってほしいマイクの使い方 / 大吉祥寺.pm 2025
Avatar for Arthur arthur1
1
890
開発者を支える Internal Developer Portal のイマとコレカラ / To-day and To-morrow of Internal Developer Portals: Supporting Developers
Avatar for Kento Kimura aoto
PRO
1
470
AI時代を生き抜くエンジニアキャリアの築き方 (AI-Native 時代、エンジニアという道は 「最大の挑戦の場」となる) / Building an Engineering Career to Thrive in the Age of AI (In the AI-Native Era, the Path of Engineering Becomes the Ultimate Arena of Challenge)
Avatar for JaeSoon Jeong jeongjaesoon
0
210
S3アクセス制御の設計ポイント
Avatar for tommy tommy0124
3
200
CDK CLIで使ってたあの機能、CDK Toolkit Libraryではどうやるの？
Avatar for Makky12 smt7174
4
190
下手な強制、ダメ！絶対！ 「ガードレール」を「檻」にさせない"ガバナンス"の取り方とは？
Avatar for Masataka Tsukamoto tsukaman
2
450
「Linux」という言葉が指すもの
Avatar for Satoru Takeuchi sat
PRO
4
140
品質視点から考える組織デザイン/Organizational Design from Quality
Avatar for miisan mii3king
0
210
TS-S205_昨年対比2倍以上の機能追加を実現するデータ基盤プロジェクトでのAI活用について
Avatar for K.Mitsuhashi kaz3284
1
210
サラリーマンの小遣いで作るtoCサービス - Cloudflare Workersでスケールする開発戦略
Avatar for shinaps shinaps
2
470

Featured

See All Featured
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
285
13k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.1k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
32
1.1k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k
Navigating Team Friction
Avatar for Lara Hogan lara
189
15k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
26
1.9k
Building Adaptive Systems
Avatar for Chris Keathley keathley
43
2.7k
Writing Fast Ruby
Avatar for Erik Berlin sferik
628
62k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
64
7.9k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
87
4.8k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
83
9.2k

Transcript

  1. Google BigQuery for the BigData win

  2. There are lots of tools to analyze Big Data

  3. There are lots of tools to analyze Big Data

  4. You are here to learn about one of the tools

  5. The current OSS tools can be complicated

  6. You would like a fast and cost effective tool

  7. Use Google BigQuery to analyze your Big Data

  8. BigQuery makes analyzing Big Data easy!

  9. Google learned from initial BigData technologies

  10. Google learned from initial BigData technologies

  11. Google learned from initial BigData technologies

  12. Dremel provides the query system

  13. Data can be nested

  14. The storage format is columar

  15. Google provides a familiar developer experience

  16. Queries have a common SQL-ish syntax

  17. Dremel has functions

  18. Table joins are a little different

  19. BigQuery Building Blocks

  20. Projects

  21. Tables and Datasets

  22. Jobs

  23. There are several options for working with data

  24. Google Cloud Storage

  25. BigQuery REST API

  26. Command-line Tools

  27. BigQuery is very cost effective

  28. No equipment to maintain

  29. On-Demand Pricing

  30. Reserved Capacity Pricing

  31. Questions? Important Links: BigQuery: http://goo.gl/hCOMZ Dremel: http://goo.gl/0EMwl MapReduce: http://goo.gl/n0agd GFS:

    http://goo.gl/WeuPy4 About Me: Ken Taylor Twitter: @taylorka Blog: switchspan.com