Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Airflow: Data Workflow Management
Search
Gilson Filho
October 20, 2017
Programming
0
470
Airflow: Data Workflow Management
Apresentação do Airflow como Lightning Talk na Python Brasil[13] em Belo Horizonte
Gilson Filho
October 20, 2017
Tweet
Share
More Decks by Gilson Filho
See All by Gilson Filho
Como monitorar os erros da sua aplicação com o Sentry
gilsondev
0
2.1k
Airflow - Automatizando seu fluxo de trabalho
gilsondev
1
1.3k
Protocolo HTTP
gilsondev
0
550
Workshop Docker
gilsondev
0
430
Django: framework web para perfeccionistas com prazos
gilsondev
0
430
Django - Framework para perfeccionistas em prazos
gilsondev
0
47
Vim - Um editor onipresente e flexível
gilsondev
2
470
Vim - Um editor onipresente e flexível
gilsondev
2
130
Desenvolvendo aplicações web com python e web2py
gilsondev
0
600
Other Decks in Programming
See All in Programming
非同期jobをtransaction内で 呼ぶなよ!絶対に呼ぶなよ!
alstrocrack
0
560
ポスターセッション: 「まっすぐ行って、右!」って言ってラズパイカーを動かしたい 〜生成AI × Raspberry Pi Pico × Gradioの試作メモ〜
komofr
0
1k
Your Perfect Project Setup for Angular @BASTA! 2025 in Mainz
manfredsteyer
PRO
0
140
overlayPreferenceValue で実現する ピュア SwiftUI な AdMob ネイティブ広告
uhucream
0
170
CSC509 Lecture 02
javiergs
PRO
0
410
「ちょっと古いから」って避けてた技術書、今だからこそ読もう
mottyzzz
5
2.2k
タスクの特性や不確実性に応じた最適な作業スタイルの選択(ペアプロ・モブプロ・ソロプロ)と実践 / Optimal Work Style Selection: Pair, Mob, or Solo Programming.
honyanya
3
140
dynamic!
moro
9
6.8k
Swift Concurrency - 状態監視の罠
objectiveaudio
2
480
CSC305 Lecture 01
javiergs
PRO
1
400
Pull-Requestの内容を1クリックで動作確認可能にするワークフロー
natmark
2
480
Introducing ReActionView: A new ActionView-Compatible ERB Engine @ Kaigi on Rails 2025, Tokyo, Japan
marcoroth
3
940
Featured
See All Featured
Scaling GitHub
holman
463
140k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
189
55k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
51k
Writing Fast Ruby
sferik
629
62k
The Pragmatic Product Professional
lauravandoore
36
6.9k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
36
2.5k
Navigating Team Friction
lara
189
15k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
9
850
Building an army of robots
kneath
306
46k
Why Our Code Smells
bkeepers
PRO
339
57k
Transcript
Airflow Data Workflow Management
O que é? Execução de workflow de dados Escritos em
Python Forma de DAGs Criado pelo Airbnb Open Source (Apache License) Desenvolvido em Python Flask, SQLAlchemy, Jinja, etc Alternativa ao Luigi do Spotify
DAG Directed Acyclic Graphs Rede de jobs Possui agendamento próprio
Código enxuto e fácil de entender quando criado
DAG Airflow - Backfill
DAG Airflow - Visualização de Grafos
DAG Airflow - Detalhes
Alguns processos feitos com Airflow Data warehousing: cleanse, organize, data
quality check Growth analytics Experimentation: compute our A/B testing Email targeting Sessionization: compute clickstream Search: compute search ranking related metrics Data infrastructure maintenance: database scrapes, folder cleanup, applying data retention policies, … feitos pelo Airbnb
meucandidato.me
Blog: Telegram: Meetup: df.python.org.br @grupydf meetup.com/pt-BR/pythondf
Email:
[email protected]
Blog: Telegram/Github: @gilsondev Twitter: gilsondev.in @gilsonfilho Em que
posso ajudar?