Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg Theo Hultberg
May 16, 2018
Programming
100
0

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg

Theo Hultberg

May 16, 2018

More Decks by Theo Hultberg

See All by Theo Hultberg
Building a CQL driver
Avatar for Theo Hultberg iconara
0
79
Chasing the Elephant
Avatar for Theo Hultberg iconara
0
100
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
150
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
230
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.2k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
700
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
170
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
AI駆動開発で崩れていくコードベースを立て直す
Avatar for Kyoko NR kyoko_nr_nr
1
430
PHPで使える日時の表現と、その知り方 #frontend_phpcon_do
Avatar for hideki kinjyo o0h
PRO
0
180
Datadog × OpenTelemetry 入門と実践のあいだ
Avatar for Max Kento kn_to_maxpno
1
140
AI 時代のソフトウェア設計の学び方
Avatar for 増田 亨 masuda220
PRO
29
12k
「AIで開発し、AIを届ける」をEvalでつなぐ 〜AIネイティブに始めるプロダクト開発の実践〜 / Connecting "Develop with AI, deliver AI" with Eval
Avatar for r-kagaya rkaga
4
2.1k
LLM本来の能力を解き放つサンドボックス技術とAI民主化への適用
Avatar for Yuku Kotani yukukotani
3
2.6k
ユニットテストの先へ：テスト技法で要求・仕様を整理するJava開発実践 / Beyond_Unit_Testing_Practical_Java_Development_Techniques_for_Organizing_Requirements_and_Specifications
Avatar for SHIMANE, Yoshikazu shimashima35
0
350
AI駆動開発勉強会 広島支部 第一回勉強会 AI駆動開発概要とワークショップ
Avatar for smz hyt hayatoshimiu
0
440
ADKを使って簡単にAIエージェントを作ってみよう
Avatar for K1mu21 k1mu21
0
200
エージェンティックRAGにAWSで入門しよう！
Avatar for Har1101 har1101
5
540
Composerを使ったサプライチェーン攻撃の様子を眺めてみる #phpstudy
Avatar for hideki kinjyo o0h
PRO
2
220
開発体験を左右するライブラリの API 設計 - GraphQL スキーマ構築ライブラリから考える #tskaigi
Avatar for izumin5210 izumin5210
2
1.6k

Featured

See All Featured
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
3
600
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
550
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
210k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
211
24k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
Done Done
Avatar for chrislema chrislema
186
16k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
10k
More Than Pixels: Becoming A User Experience Designer
Avatar for Michelle Schulp Hunt marktimemedia
3
430
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
2
390
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
408
66k

Transcript

  1. Theo Hultberg director of technology @iconara

  2. None

  3. volume variety

  4. S3 ETL

  5. S3

  6. ? S3

  7. None

  8. S3 ETL API Athena

  9. API SELECT "app", "account", SUM("logged_in_users") FROM "usage" WHERE "date" BETWEEN

    DATE '2018-05-01' AND DATE '2018-05-16' GROUP BY 1, 2 Athena

  10. S3 ETL API Athena

  11. S3 Glue Aurora API ETL Redshift Athena

  12. None

  13. thank you! @iconara