Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Datalakes at AWS Summit Stockholm 2018

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Theo Hultberg Theo Hultberg
May 16, 2018
Programming
100
0

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg

Theo Hultberg

May 16, 2018

More Decks by Theo Hultberg

See All by Theo Hultberg
Building a CQL driver
Avatar for Theo Hultberg iconara
0
85
Chasing the Elephant
Avatar for Theo Hultberg iconara
0
100
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
150
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
230
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.2k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
700
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
180
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
ECSアプリログをFireLensでコスト削減しようとしたけど諦めた話 in Fargate×Node.js
Avatar for アキキー | Akihisa Ikeda akihisaikeda
2
4.2k
エンジニアと一緒にテストコードの設計と実装を改善した話
Avatar for mototakatsu mototakatsu
0
230
Make SRE Operations Easier with Azure SRE Agent
Avatar for KAMEGAWA Kazushi kkamegawa
0
8.3k
Dataformのリポジトリを立ち上げるときにまずやること / dataform-day0-2026
Avatar for snhryt snhryt
0
190
セキュリティの専門家じゃなくてもできる。「セキュリティ意識」をアップデートして サプライチェーン攻撃への耐性を高めよう。
Avatar for tk3fftk tk3fftk
5
970
Datadog × OpenTelemetry 入門と実践のあいだ
Avatar for Max Kento kn_to_maxpno
1
180
どこまでゆるくて許されるのか
Avatar for tk3fftk tk3fftk
0
260
フロントエンドとバックエンドで「1文字」を揃えよう
Avatar for てきめん tekimen youkidearitai
PRO
0
750
1B+ /day規模のログを管理する技術
Avatar for Broadleaf Co., Ltd. broadleaf
0
120
気圧・高度・GPSを記録&可視化するアプリ「Koudo」を作った話
Avatar for Hajime Kato hjmkth
1
320
はてなアカウント基盤 State of the Union
Avatar for cockscomb cockscomb
1
890
なぜ型を書くのか？ TSKaigi2026で改めて考える #tskaigi_smarthr
Avatar for Takuma Kajikawa kajitack
0
170

Featured

See All Featured
Leo the Paperboy
Avatar for Maya Tellez mayatellez
7
1.9k
Discover your Explorer Soul
Avatar for Emna emna__ayadi
2
1.1k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
870
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
370
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
420
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.7k
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
63k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
10k
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
320
Ecommerce SEO: The Keys for Success Now & Beyond - #SERPConf2024
Avatar for Aleyda Solis aleyda
1
2k
How GitHub (no longer) Works
Avatar for Zach Holman holman
316
150k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
Avatar for Mfonobong Umondia mfonobong
2
450

Transcript

  1. Theo Hultberg director of technology @iconara

  2. None

  3. volume variety

  4. S3 ETL

  5. S3

  6. ? S3

  7. None

  8. S3 ETL API Athena

  9. API SELECT "app", "account", SUM("logged_in_users") FROM "usage" WHERE "date" BETWEEN

    DATE '2018-05-01' AND DATE '2018-05-16' GROUP BY 1, 2 Athena

  10. S3 ETL API Athena

  11. S3 Glue Aurora API ETL Redshift Athena

  12. None

  13. thank you! @iconara