Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Datalakes at AWS Summit Stockholm 2018

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Theo Hultberg Theo Hultberg
May 16, 2018
Programming
100
0

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg

Theo Hultberg

May 16, 2018

More Decks by Theo Hultberg

See All by Theo Hultberg
Building a CQL driver
Avatar for Theo Hultberg iconara
0
79
Chasing the Elephant
Avatar for Theo Hultberg iconara
0
100
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
150
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
220
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.2k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
700
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
170
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
代数的データ型って何が嬉しいの？ #frontend_phpcon_do
Avatar for Takuma Kajikawa kajitack
1
520
今さら聞けないCancellationToken
Avatar for tkym htkym
0
200
The Arts and Crafts of Work in the AI Era — Toward Mastery in Software Development
Avatar for Yoshihito Kuranuki / 倉貫義人 kuranuki
1
680
AI駆動開発勉強会 広島支部 第一回勉強会 AI駆動開発概要とワークショップ
Avatar for smz hyt hayatoshimiu
0
410
AIエージェントの隔離技術の徹底比較
Avatar for kawayu kawayu
0
440
TSKaigi 2026 TypeScriptバックエンドのオブザーバビリティ戦略 — Datadog × NestJSの実践
Avatar for Taisei Yamamoto taiseiyamamotoan
1
210
Moments When Things Go Wrong
Avatar for Aurimas Liutikas aurimas
3
130
不変条件と整合性境界—ビジネスが決める設計判断と実現パターン / Invariants and Consistency Boundaries
Avatar for nrs nrslib
11
3.1k
tsserverとは何だったのか、これからどうなるのか
Avatar for Ryota Nakamura nowaki28
1
420
技術記事、AIに書かせるか、自分で書くか？ 〜それでも私が自分の手で書く理由〜 / #QiitaConference
Avatar for Junichi Ito jnchito
2
1.2k
柔軟なPDFレイアウトエディタを支える型システム設計 — Discriminated UnionとConditional Typeの実践
Avatar for minako-ph minako__ph
4
1.2k
AIとRubyの静的型付け
Avatar for ukin0k0 ukin0k0
0
460

Featured

See All Featured
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
190
The innovator’s Mindset - 
Leading Through an Era of Exponential Change - McGill University 2025
Avatar for Jean-Marc De Jonghe jdejongh
PRO
1
180
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
Avatar for soudai sone soudai
PRO
65
55k
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
320
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
130
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.7k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
370
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
11
930
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
2
1.1k
Navigating Team Friction
Avatar for Lara Hogan lara
192
16k
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
75
12k

Transcript

  1. Theo Hultberg director of technology @iconara

  2. None

  3. volume variety

  4. S3 ETL

  5. S3

  6. ? S3

  7. None

  8. S3 ETL API Athena

  9. API SELECT "app", "account", SUM("logged_in_users") FROM "usage" WHERE "date" BETWEEN

    DATE '2018-05-01' AND DATE '2018-05-16' GROUP BY 1, 2 Athena

  10. S3 ETL API Athena

  11. S3 Glue Aurora API ETL Redshift Athena

  12. None

  13. thank you! @iconara