Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg Theo Hultberg
May 16, 2018
Programming
0
95

Datalakes at AWS Summit Stockholm 2018

Avatar for Theo Hultberg

Theo Hultberg

May 16, 2018
Tweet

More Decks by Theo Hultberg

See All by Theo Hultberg
Building a CQL driver
Avatar for Theo Hultberg iconara
0
59
Chasing the Elephant
Avatar for Theo Hultberg iconara
0
92
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
1
140
Learning to Build Distributed Systems the Hard Way
Avatar for Theo Hultberg iconara
2
210
Learning to Build Distributed Systems the Hard Way 
Avatar for Theo Hultberg iconara
3
5.1k
Concurrency and Distributed Systems in JRuby
Avatar for Theo Hultberg iconara
3
660
A Guide to the Post Relational Revolution
Avatar for Theo Hultberg iconara
4
5.4k
Standing on the Shoulders of Giants with JRuby
Avatar for Theo Hultberg iconara
4
160
Shortcuts Around the Mistakes I've Made Scaling MongoDB
Avatar for Theo Hultberg iconara
4
170

Other Decks in Programming

See All in Programming
ドメイン駆動設計のエッセンス
Avatar for 増田 亨 masuda220
PRO
15
7.5k
Webサーバーサイド言語としてのRustについて
Avatar for kaza kouyuume
1
5.1k
Bakuraku E2E Scenario Test System Architecture #bakuraku_qa_study
Avatar for teyamagu teyamagu
PRO
0
460
Vueのバリデーション、結局どれを選べばいい？ ― 自作バリデーションの限界と、脱却までの道のり ― / Which Vue Validation Library Should We Really Use? The Limits of Self-Made Validation and How I Finally Moved On
Avatar for ねぎなす neginasu
3
1.8k
SUZURIの規約違反チェックにおけるクリエイタフィードバックの試⾏錯誤/Trial and Error in Creator Feedback for SUZURI's Terms of Service Violation Checks
Avatar for watasan ae14watanabe
1
130
Health Kit × Foundation Models でAIコーチを作ってみた
Avatar for Ryu-nakayama ryunakayama
0
100
PyCon mini 東海 2025「個人ではじめるマルチAIエージェント入門 〜LangChain × LangGraphでアイデアを形にするステップ〜」
Avatar for komo_fr komofr
3
800
Dive into Triton Internals
Avatar for Liam Jongsu Kim appleparan
0
460
Module Proxyのマニアックな話 / Niche Topics in Module Proxy
Avatar for kuro kuro_kurorrr
0
2.5k
AI 駆動開発におけるコミュニティと AWS CDK の価値
Avatar for Kenji Kono konokenj
5
350
テーブル定義書の構造化抽出して、生成AIでDWH分析を試してみた / devio2025tokyo
Avatar for kasacchiful kasacchiful
0
400
AsyncSequenceとAsyncStreamのプロポーザルを全部読む！！
Avatar for Shigure Shimotori s_shimotori
1
250

Featured

See All Featured
Fireside Chat
Avatar for paigeccino paigeccino
41
3.7k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
8
360
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
8k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
76
5.1k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.6k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
186
22k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.6k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
671
58k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
140
7.2k
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
60
9.6k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.1k

Transcript

  1. Theo Hultberg director of technology @iconara

  2. None

  3. volume variety

  4. S3 ETL

  5. S3

  6. ? S3

  7. None

  8. S3 ETL API Athena

  9. API SELECT "app", "account", SUM("logged_in_users") FROM "usage" WHERE "date" BETWEEN

    DATE '2018-05-01' AND DATE '2018-05-16' GROUP BY 1, 2 Athena

  10. S3 ETL API Athena

  11. S3 Glue Aurora API ETL Redshift Athena

  12. None

  13. thank you! @iconara