Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg Theo Hultberg
May 16, 2018
Programming
100
0

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg

Theo Hultberg

May 16, 2018

More Decks by Theo Hultberg

See All by Theo Hultberg
Building a CQL driver
Avatar for Theo Hultberg iconara
0
85
Chasing the Elephant
Avatar for Theo Hultberg iconara
0
100
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
160
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
230
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.2k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
700
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
180
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
Apache Hive: そしてCloud Native Lakehouseへ
Avatar for okumin okumin
1
160
壊れたパーサから始める関数型設計と構成的なパーサ #fp_matsuri
Avatar for ライガー raiga0310
2
390
Embedded SREと共に達成した会員管理システムのAWS移行 - SRE NEXT 2026 ランチスポンサーセッション
Avatar for ニフティ株式会社 niftycorp
PRO
1
2.9k
JAWS-UG横浜 #102 AWSサ終供養LT会 成仏できない AWS サービスたち 〜本日、三体供養します〜
Avatar for maroon1st maroon1st
0
220
Generative UI & AI-Assistants for Your Angular Solutions
Avatar for Manfred Steyer manfredsteyer
PRO
1
210
地域 SRE コミュニティ最前線 - ホンマでっかSRE勉強会
Avatar for tk3fftk tk3fftk
0
270
PHPだって関数型したい 〜できること、できないこと〜 / fp-in-php
Avatar for jsoizo jsoizo
1
240
Augmenting AI with the Power of Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
140
SREの積み重ねがAI駆動開発のガードレールになった ― 7つの実践/SRE Guardrails The 7
Avatar for TomoyaKitaura tomoyakitaura
8
5.3k
生成AI導入の「期待外れ」を乗り越える ー 開発フロー改革が目指す、真の組織変革
Avatar for starfish719 starfish719
0
1.8k
コーディングルールの鮮度を保ちたい for SRE NEXT 2026 / keep-fresh-go-internal-conventions-sre-next-2026
Avatar for NAGATA Hiroaki handlename
0
150
Laravel Boostに学ぶ、AIにPHPを書かせる技術 〜OSSの実装から蒸留するエージェント制御の王道〜
Avatar for 武田 憲太郎 kentaroutakeda
3
520

Featured

See All Featured
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
52k
AI Search:
Where Are We & What Can We Do About It?
Avatar for Aleyda Solis aleyda
0
7.7k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
490
Jess Joyce - The Pitfalls of Following Frameworks
Avatar for Tech SEO Connect techseoconnect
PRO
1
310
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
380
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
3k
Deep Space Network (abreviated)
Avatar for Tony Rice tonyrice
0
230
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
510
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.8k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
190

Transcript

  1. Theo Hultberg director of technology @iconara

  2. None

  3. volume variety

  4. S3 ETL

  5. S3

  6. ? S3

  7. None

  8. S3 ETL API Athena

  9. API SELECT "app", "account", SUM("logged_in_users") FROM "usage" WHERE "date" BETWEEN

    DATE '2018-05-01' AND DATE '2018-05-16' GROUP BY 1, 2 Athena

  10. S3 ETL API Athena

  11. S3 Glue Aurora API ETL Redshift Athena

  12. None

  13. thank you! @iconara