Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Modern Data Pipelines

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Fernando Sedrez Fernando Sedrez
December 13, 2020
Technology
0
40

Modern Data Pipelines

Avatar for Fernando Sedrez

Fernando Sedrez

December 13, 2020
Tweet

More Decks by Fernando Sedrez

See All by Fernando Sedrez
Explorando dados com Google Colab
Avatar for Fernando Sedrez fmsedrez
0
61
Construindo Data Lake no Google Cloud
Avatar for Fernando Sedrez fmsedrez
0
16
AWS: mais do que uma sopa de letrinhas, ferramentas para o desenvolvedor
Avatar for Fernando Sedrez fmsedrez
0
42
Fernando_Sedrez_-_Community_Building_-_Keep_your_data_safe.pdf
Avatar for Fernando Sedrez fmsedrez
0
27

Other Decks in Technology

See All in Technology
Amazon S3 Vectorsを使って資格勉強用AIエージェントを構築してみた
Avatar for usanchuu usanchuu
3
440
M&A 後の統合をどう進めるか ─ ナレッジワーク × Poetics が実践した組織とシステムの融合
Avatar for KNOWLEDGE WORK / 株式会社ナレッジワーク kworkdev
PRO
1
420
Introduction to Sansan, inc / Sansan Global Development Center, Inc.
Avatar for Sansan, Inc. sansan33
PRO
0
3k
Oracle Cloud Observability and Management Platform - OCI 運用監視サービス概要 -
Avatar for oracle4engineer oracle4engineer
PRO
2
14k
入社1ヶ月でデータパイプライン講座を作った話
Avatar for Yuta Ozaki waiwai2111
1
260
ファインディの横断SREがTakumi byGMOと取り組む、セキュリティと開発スピードの両立
Avatar for adachi.ryo rvirus0817
1
1.2k
ZOZOにおけるAI活用の現在 ~開発組織全体での取り組みと試行錯誤~
Avatar for ZOZO Developers zozotech
PRO
5
4.9k
Bill One急成長の舞台裏 開発組織が直面した失敗と教訓
Avatar for SansanTech sansantech
PRO
2
310
生成AIを活用した音声文字起こしシステムの2つの構築パターンについて
Avatar for Kazuki Miura miu_crescent
PRO
1
130
プロダクト成長を支える開発基盤とスケールに伴う課題
Avatar for yuu26 yuu26
4
1.3k
学生・新卒・ジュニアから目指すSRE
Avatar for Hiroya Onoe hiroyaonoe
2
570
データ民主化のための LLM 活用状況と課題紹介（IVRy の場合）
Avatar for 和田 悠佑 wxyzzz
2
680

Featured

See All Featured
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.5k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
130
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
34k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
19k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
230k
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
1
1.3k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
0
200
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.3k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Pawsitive SEO: Lessons from My Dog (and Many Mistakes) on Thriving as a Consultant in the Age of AI
Avatar for David Carrasco davidcarrasco
0
62
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
62k

Transcript

  1. MODERN DATA PIPELINES Community Building Fernando Sedrez Data Engineer at

    Elixir AI Organizer at GDG Pelotas @fmsedrez

  2. ETL

  3. ELT

  4. EL(T)

  5. Why use EL(T) instead of ETL or ELT?

  6. References ➔ https://www.kdnuggets.com/2020/12/future-etl-is-elt.html ➔ https://a16z.com/2020/10/15/the-emerging-architectures-for-modern-data-infrastructure/

  7. Thank you! EMAIL [email protected] SOCIAL @fmsedrez Slides https://speakerdeck.com/fmsedrez/