Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg Theo Hultberg
May 16, 2018
Programming
0
94

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg

Theo Hultberg

May 16, 2018
Tweet

More Decks by Theo Hultberg

See All by Theo Hultberg
Building a CQL driver
Avatar for Theo Hultberg iconara
0
57
Chasing the Elephant
Avatar for Theo Hultberg iconara
0
92
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
140
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
210
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.1k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
660
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
160
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
go test -json そして testing.T.Attr / Kyoto.go #63
Avatar for utagawa kiki utgwkk
3
300
速いWebフレームワークを作る
Avatar for Yusuke Wada yusukebe
5
1.7k
ProxyによるWindow間RPC機構の構築
Avatar for syumai syumai
3
1.2k
rage against annotate_predecessor
Avatar for Junichi Kobayashi junk0612
0
170
時間軸から考えるTerraformを使う理由と留意点
Avatar for Ryoma Fujiwara fufuhu
16
4.8k
Testing Trophyは叫ばない
Avatar for toms toms74209200
0
860
Reading Rails 1.0 Source Code
Avatar for Masafumi Okura okuramasafumi
0
100
意外と簡単！？フロントエンドでパスキー認証を実現する WebAuthn
Avatar for teamLab teamlab
PRO
2
740
奥深くて厄介な「改行」と仲良くなる20分
Avatar for おぐえもん oguemon
1
520
CloudflareのChat Agent Starter Kitで簡単！AIチャットボット構築
Avatar for syumai syumai
2
480
はじめてのMaterial3 Expressive
Avatar for yume ym223
2
290
AI Coding Agentのセキュリティリスク：PRの自己承認とメルカリの対策
Avatar for さうす s3h
0
200

Featured

See All Featured
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
45
7.7k
Building Adaptive Systems
Avatar for Chris Keathley keathley
43
2.7k
Facilitating Awesome Meetings
Avatar for Lara Hogan lara
55
6.5k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
29
5.5k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.1k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
268
13k
It's Worth the Effort
Avatar for 3n 3n
187
28k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
512
110k
How GitHub (no longer) Works
Avatar for Zach Holman holman
315
140k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
56
13k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.4k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
48
9.7k

Transcript

  1. Theo Hultberg director of technology @iconara

  2. None

  3. volume variety

  4. S3 ETL

  5. S3

  6. ? S3

  7. None

  8. S3 ETL API Athena

  9. API SELECT "app", "account", SUM("logged_in_users") FROM "usage" WHERE "date" BETWEEN

    DATE '2018-05-01' AND DATE '2018-05-16' GROUP BY 1, 2 Athena

  10. S3 ETL API Athena

  11. S3 Glue Aurora API ETL Redshift Athena

  12. None

  13. thank you! @iconara