Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Airflow: Data Workflow Management
Search
Gilson Filho
October 20, 2017
Programming
0
450
Airflow: Data Workflow Management
Apresentação do Airflow como Lightning Talk na Python Brasil[13] em Belo Horizonte
Gilson Filho
October 20, 2017
Tweet
Share
More Decks by Gilson Filho
See All by Gilson Filho
Como monitorar os erros da sua aplicação com o Sentry
gilsondev
0
2k
Airflow - Automatizando seu fluxo de trabalho
gilsondev
1
1.1k
Protocolo HTTP
gilsondev
0
480
Workshop Docker
gilsondev
0
390
Django: framework web para perfeccionistas com prazos
gilsondev
0
400
Django - Framework para perfeccionistas em prazos
gilsondev
0
36
Vim - Um editor onipresente e flexível
gilsondev
2
450
Vim - Um editor onipresente e flexível
gilsondev
2
110
Desenvolvendo aplicações web com python e web2py
gilsondev
0
490
Other Decks in Programming
See All in Programming
VS Code をプロダクトにどう取り込むか
onomax
1
360
『Railsオワコン』と言われる時代に、なぜブルーモ証券はRailsを選ぶのか
free_world21
0
240
Apache Hive 4 on Treasure Data
ryukobayashi
0
330
Elm 0.19.0 Changes
bkuhlmann
0
490
Hanami and htmx
bkuhlmann
0
210
Amazon SQSコンシューマー疎結合への旅 - 出張! #DevelopersIO IT技術ブログの中の人が語る勉強会 #3
quiver
0
270
デフォルトにして至高、RubyMineの大好きな所
ruzia
0
390
Build Apps for iOS, Android & Desktop in 100% Kotlin With Compose Multiplatform (mDevCamp 2024)
zsmb
0
340
SwiftUIで使いやすいToastの作り方 / How to build a Toast system which is easy to use in SwiftUI
lovee
3
150
TYPO3 v13 – The road to LTS: What's new and new APIs
luisasofie_xoxo
0
200
Code Reviews
bkuhlmann
4
890
Fast JSX: Don't clone props object #28768
yossydev
1
100
Featured
See All Featured
[RailsConf 2023] Rails as a piece of cake
palkan
23
4k
GraphQLの誤解/rethinking-graphql
sonatard
50
9.2k
Gamification - CAS2011
davidbonilla
76
4.6k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
78
42k
Code Reviewing Like a Champion
maltzj
514
39k
Designing on Purpose - Digital PM Summit 2013
jponch
110
6.5k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
2
3.4k
Art, The Web, and Tiny UX
lynnandtonic
289
19k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
17
1.4k
Optimising Largest Contentful Paint
csswizardry
8
2.4k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
221
21k
Designing the Hi-DPI Web
ddemaree
276
33k
Transcript
Airflow Data Workflow Management
O que é? Execução de workflow de dados Escritos em
Python Forma de DAGs Criado pelo Airbnb Open Source (Apache License) Desenvolvido em Python Flask, SQLAlchemy, Jinja, etc Alternativa ao Luigi do Spotify
DAG Directed Acyclic Graphs Rede de jobs Possui agendamento próprio
Código enxuto e fácil de entender quando criado
DAG Airflow - Backfill
DAG Airflow - Visualização de Grafos
DAG Airflow - Detalhes
Alguns processos feitos com Airflow Data warehousing: cleanse, organize, data
quality check Growth analytics Experimentation: compute our A/B testing Email targeting Sessionization: compute clickstream Search: compute search ranking related metrics Data infrastructure maintenance: database scrapes, folder cleanup, applying data retention policies, … feitos pelo Airbnb
meucandidato.me
Blog: Telegram: Meetup: df.python.org.br @grupydf meetup.com/pt-BR/pythondf
Email:
[email protected]
Blog: Telegram/Github: @gilsondev Twitter: gilsondev.in @gilsonfilho Em que
posso ajudar?