Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Airflow: Data Workflow Management
Search
Gilson Filho
October 20, 2017
Programming
0
470
Airflow: Data Workflow Management
Apresentação do Airflow como Lightning Talk na Python Brasil[13] em Belo Horizonte
Gilson Filho
October 20, 2017
Tweet
Share
More Decks by Gilson Filho
See All by Gilson Filho
Como monitorar os erros da sua aplicação com o Sentry
gilsondev
0
2.1k
Airflow - Automatizando seu fluxo de trabalho
gilsondev
1
1.3k
Protocolo HTTP
gilsondev
0
550
Workshop Docker
gilsondev
0
420
Django: framework web para perfeccionistas com prazos
gilsondev
0
420
Django - Framework para perfeccionistas em prazos
gilsondev
0
47
Vim - Um editor onipresente e flexível
gilsondev
2
470
Vim - Um editor onipresente e flexível
gilsondev
2
130
Desenvolvendo aplicações web com python e web2py
gilsondev
0
600
Other Decks in Programming
See All in Programming
Rails Frontend Evolution: It Was a Setup All Along
skryukov
0
300
Claude Code派?Gemini CLI派? みんなで比較LT会!_20250716
junholee
1
640
レトロゲームから学ぶ通信技術の歴史
kimkim0106
0
120
ご注文の差分はこちらですか? 〜 AWS CDK のいろいろな差分検出と安全なデプロイ
konokenj
4
620
顧客の画像データをテラバイト単位で配信する 画像サーバを WebP にした際に起こった課題と その対応策 ~継続的な取り組みを添えて~
takutakahashi
4
1.3k
リッチエディターを安全に開発・運用するために
unachang113
1
150
Android 16KBページサイズ対応をはじめからていねいに
mine2424
0
520
スタートアップの急成長を支えるプラットフォームエンジニアリングと組織戦略
sutochin26
1
7.5k
A full stack side project webapp all in Kotlin (KotlinConf 2025)
dankim
0
150
PHPUnitの限界をPlaywrightで補完するテストアプローチ
yuzneri
0
240
Agentic Coding: The Future of Software Development with Agents
mitsuhiko
0
160
レベル1の開発生産性向上に取り組む − 日々の作業の効率化・自動化を通じた改善活動
kesoji
1
320
Featured
See All Featured
Practical Orchestrator
shlominoach
189
11k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.7k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
138
34k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
Designing for humans not robots
tammielis
253
25k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
750
Into the Great Unknown - MozCon
thekraken
40
1.9k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
161
15k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
229
22k
Producing Creativity
orderedlist
PRO
346
40k
Transcript
Airflow Data Workflow Management
O que é? Execução de workflow de dados Escritos em
Python Forma de DAGs Criado pelo Airbnb Open Source (Apache License) Desenvolvido em Python Flask, SQLAlchemy, Jinja, etc Alternativa ao Luigi do Spotify
DAG Directed Acyclic Graphs Rede de jobs Possui agendamento próprio
Código enxuto e fácil de entender quando criado
DAG Airflow - Backfill
DAG Airflow - Visualização de Grafos
DAG Airflow - Detalhes
Alguns processos feitos com Airflow Data warehousing: cleanse, organize, data
quality check Growth analytics Experimentation: compute our A/B testing Email targeting Sessionization: compute clickstream Search: compute search ranking related metrics Data infrastructure maintenance: database scrapes, folder cleanup, applying data retention policies, … feitos pelo Airbnb
meucandidato.me
Blog: Telegram: Meetup: df.python.org.br @grupydf meetup.com/pt-BR/pythondf
Email: me@gilsondev.in Blog: Telegram/Github: @gilsondev Twitter: gilsondev.in @gilsonfilho Em que
posso ajudar?