Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg Theo Hultberg
May 16, 2018
Programming
0
89

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg

Theo Hultberg

May 16, 2018
Tweet

More Decks by Theo Hultberg

See All by Theo Hultberg
Building a CQL driver
Avatar for Theo Hultberg iconara
0
51
Chasing the Elephant
Avatar for Theo Hultberg iconara
0
87
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
140
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
200
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.1k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
640
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
150
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
160

Other Decks in Programming

See All in Programming
Instrumentsを使用した アプリのパフォーマンス向上方法
Avatar for hinakko hinakko
0
260
CursorとDevinが仲間！？AI駆動で新規プロダクト開発に挑んだ３ヶ月を振り返る / A Story of New Product Development with Cursor and Devin
Avatar for r-kagaya rkaga
5
1.5k
知識0からカンファレンスやってみたらこうなった！
Avatar for syossan27 syossan27
5
300
External SecretsのさくらProvider初期実装を担当しています
Avatar for logica / Takuto Nagami logica0419
0
100
JVM の仕組みを理解して PHP で実装してみよう
Avatar for memory m3m0r7
PRO
1
160
コンポーネントライブラリで実現する、アクセシビリティの正しい実装パターン
Avatar for Tajima Sachiko schktjm
1
220
エンジニア向けCursor勉強会 @ SmartHR
Avatar for Yuki Horikoshi yukisnow1823
3
13k
鯛変だったRubyKaigi 2025 ── それでも楽しかった！
Avatar for なっちゃん pndcat
0
100
Design Pressure
Avatar for Hynek Schlawack hynek
0
190
Beyond_the_Prompt__Evaluating__Testing__and_Securing_LLM_Applications.pdf
Avatar for Mete Atamel meteatamel
0
120
私のRubyKaigi 2025 Kaigi Effect / My RubyKaigi 2025 Kaigi Effect
Avatar for chobishiba chobishiba
1
180
型安全なDrag and Dropの設計を考える
Avatar for yudppp yudppp
5
370

Featured

See All Featured
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
32
5.8k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
47
2.8k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
40
7.3k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
227
22k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
299
50k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
378
70k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
329
24k
BBQ
Avatar for Matthew Crist matthewcrist
88
9.6k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
42
7.5k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
52
2.7k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
187
11k

Transcript

  1. Theo Hultberg director of technology @iconara

  2. None

  3. volume variety

  4. S3 ETL

  5. S3

  6. ? S3

  7. None

  8. S3 ETL API Athena

  9. API SELECT "app", "account", SUM("logged_in_users") FROM "usage" WHERE "date" BETWEEN

    DATE '2018-05-01' AND DATE '2018-05-16' GROUP BY 1, 2 Athena

  10. S3 ETL API Athena

  11. S3 Glue Aurora API ETL Redshift Athena

  12. None

  13. thank you! @iconara