Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Starts Airflow task execution directly from the...
Search
Lee Wei
May 08, 2024
Technology
270
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Starts Airflow task execution directly from the triggerer
Lee Wei
May 08, 2024
Transcript
18 slides
Starts Air fl ow task execution directly from the triggerer
$ cat weilee.py __name__ = 李唯 / Wei Lee __what_i_am_doing__
= [ Software Engineer @ Astronomer, Committer @ Apache Airflow, Volunteers @ PyCon Taiwan, Maintainer of commitizen-tools, ] __github__ = G Lee-W __linkedin__ = l clleew __site__ = p http://wei-lee.me
File "weilee.py", line 1 __name__ = 李唯 / Wei Lee
^^^ SyntaxError: invalid syntax $ python weilee.py
None
How did deferrable operators work before this change?
What has been changed?
What has been changed?
What it could be in the future
But why?
"execute" methods are not always needed This is the only
logic when deferrable is set to true and does not need to be executed in the worker.
How does it affect DAG authors? More ef fi cient
operators to come
How does it affect operator authors? A new way to
implement operators in an async manner
The Original Way
The New Way
How does it work under the hook?
How does it work under the hook?
How does it work under the hook?
Limitations • It is necessary to go back to workers
to run the next_method (e.g., "execute_complete") • This feature does not yet fully support MappedOperator.
More Decks by Lee Wei
See All by Lee Wei
Apache Airflow Introduction
leew
1
38
Airflow Beyond Python: New Languages for Tasks and Workflows
leew
0
30
Orchestration Still Matters: Apache Airflow in the Age of AI
leew
0
97
Asset Partitions: Matching Workflow to the Right Data
leew
0
97
Your Al Is Only As Good As Your Data Pipeline
leew
0
42
觸發觸發器器,那個你可能不熟的 Apache Airflow 元件
leew
0
160
20251127 開源菜雞的隨意雜談
leew
0
97
住手啊,這樣用 Python 寫程式沒有人會獲得幸福的
leew
0
170
Unlocking the Future of Data Pipeline
leew
0
300
Other Decks in Technology
See All in Technology
AIで実装が加速したのに、 なぜ私は仕事の大半で人と話し続けていたのか?
say_no_w
0
170
さようならSSH鍵、こんにちはゼロトラスト ― AIフレンドリーで快適な自宅鯖SSH
atalie2m
14
6.5k
AWS Emulator を評価する: 手元で動く AWS の API の仕組み、始め方、確かめ方
inariku
PRO
1
730
落とし穴にハマってわかった 開発生産性を測るときに気をつけたいこと
munakata
3
270
閉域網でのAPI公開の選択肢全部比較!
takano0131
2
390
Kansai WordPress Meetup@大阪『ブロックテーマを作る上で知っておくべきこと
torounit
0
190
あの日、見つかっていなかったらどうなっていたか
kazzpapa3
2
240
変更差分を読むために環境を整備しよう
pipepasta
1
410
2026-11-11 Tamachi.sre#7 PaCにインフラリソースの命を救われました。 / PaC saves the infra resource life
masasuzu
1
200
Del vibe coding a un Desarrollo (agéntico) fiable
jcabot
0
140
Quick Automate | 目指せ Quick マスター 12
inariku
PRO
1
120
サーバーラックは作る時代! 3Dプリンターで作る10インチラックのススメ
jacopen
1
390
Featured
See All Featured
Darren the Foodie - Storyboard
khoart
PRO
5
4.1k
What Being in a Rock Band Can Teach Us About Real World SEO
427marketing
0
1.1k
Imperfection Machines: The Place of Print at Facebook
scottboms
270
14k
B2B Lead Gen: Tactics, Traps & Triumph
marketingsoph
1
300
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
greggifford
PRO
0
400
The SEO Collaboration Effect
kristinabergwall1
1
620
Stewardship and Sustainability of Urban and Community Forests
pwiseman
0
600
Highjacked: Video Game Concept Design
rkendrick25
PRO
2
580
Believing is Seeing
oripsolob
1
280
The innovator’s Mindset - Leading Through an Era of Exponential Change - McGill University 2025
jdejongh
PRO
1
400
Reality Check: Gamification 10 Years Later
codingconduct
0
2.4k
Git: the NoSQL Database
bkeepers
PRO
433
67k