[COSCUP 2025] 從 0 成為 Apache Airflow Committer

https://coscup.org/2025/sessions/

從未接觸 Data Engineering 的小白 / 資工系大三的學生，如何在 5 個月，以 70+ PR，300 小時的貢獻成為 Apache Airflow Committer。

Apache Airflow 是 Data Engineering 領域最大的開源工具之一，目前在 GitHub 有 39.3k stars。 以輕鬆的角度介紹如何實際投入開源專案，實際開始的心路歷程，還有一些需要注意的眉眉角角。 順便推坑大家一起來寫 Apache Airflow！

Transcript

1. 從 0 成為 Apache Airflow Committer Design By COSCUP 2025 Marketing Team CC-BY 4.0
2. Table of Content Design By COSCUP 2025 Marketing Team CC-BY 4.0 1. What is Apache Airflow? 2. Why Contribute to Open Source? 3. From First PR to Committer 4. Getting Started with Airflow Contributions
3. @Zhe-You(Jason) Liu Design By COSCUP 2025 Marketing Team CC-BY 4.0 - Apache Airflow Committer - LFX'25 @CNCF - Krkn - Backend Intern @Appier - NCKU CSIE Senior LinkedIn: zhe-you-liu GitHub: jason810496
4. What is Apache Airflow? 01 Design By COSCUP 2025 Marketing Team CC-BY 4.0
5. • Most Common Data Orchstration Tool • 40k+ stars on GitHub • Used by over 70k companies ◦ including Apple, Uber, LinkedIn …
6. Workflow as Code
7. DAG (Directed Acyclic Graph)
8. 1. Dag Design By COSCUP 2025 Marketing Team CC-BY 4.0
9. 2. Task
10. 3. Dependency
11. Operator • PythonOperator • BashOperator • GCSToS3Operator • HiveToMySqlOperator • KubernetesPodOperator • BranchOperator • … 173 integrations
16. What Problems Does Apache Airflow Solve? 1. Integration with Data Ecosystems 2. Retry-ability of Workflows 3. Workflow Observability Significantly reduce operational workload
17. Wait, What is “Apache”?
18. Introduction to the ASF Reference from https://maximilianmichels.com/2017/an-introduction-to-apache-software/
19. Why Contribute to Open Source? 02 Design By COSCUP 2025 Marketing Team CC-BY 4.0
20. https://youtu.be/dRs2QO6yRMk?si=o3ph66eneIng_289
21. There are 4 Taiwanese contributors among the top 10 collaborators of Apache Kafka! OpenSource4You 源來適你
22. Why Apache Airflow? 1. Written in Python! 2. Ranked as the 4th most popular project in the ASF 3. Over 40k stars on GitHub 4. Widely used in Data Engineering
23. Benefits of Contributing to OSS • Coding skills ◦ Design Patterns, Unit Test, Code Review • System Level Design • Career Opportunities (?)
24. • Collaborate with top contributors over the world • Communication Skills • Design Documentation Benefits of Contributing to OSS
25. From First PR to Committer 03 Design By COSCUP 2025 Marketing Team CC-BY 4.0
26. The First PR
27. API Server Refactor
28. Authn & Authz for API Server
29. Authn & Authz for API Server
30. Resolve OOM when reading large task logs It took half a year to get merged!
31. Resolve OOM when reading large task logs
32. 70+ Pull Requests
33. 300 Hours in 5 months avg 2 hours per day
35. Your own Apache email address!
36. Getting Started with Airflow Contributions 04 Design By COSCUP 2025 Marketing Team CC-BY 4.0
37. Setup Airflow Dev Env with 1 Step - Breeze
38. How to find Issues to Resolve? 1. Look for "Good First Issue" labels 2. Recent Issues and Pull Requests 3. Apache Airflow Slack 4. Airflow Improvement Proposals (AIPs) 5. Dev mailing list discussions
39. 1. Good First Issue
40. 2. Recent Issues and Pull Requests
41. 3. Apache Airflow Slack
42. 4. Airflow Improvement Proposals (AIPs)
43. 5. Dev mailing list discussions
44. Note for Using AI to Contribute AI and Open Source: Expanding Apache Airflow’s Global Impact Through Collaboration • Yes! • Human-driven, AI-friendly tooling • Quality Through Collaboration
45. How to become a Committer? • Contribute consistently • Participate in discussions • Get noticed by the community
46. How to become a Committer? • Contribute consistently • Participate in discussions • Get noticed by the community Demonstrate your impact!
47. OpenSource4You (源來適你) • Mentor of #apache-airflow • Bi-weekly Meetings Facebook: opensource4you
48. OpenSource4You (源來適你)
49. Community Over Code
50. Community Over Code - Code Review
51. Community Over Code - Meme
52. CommunityOverCode - Airflow Town Hall #protm ➞ PR of The Month
53. CommunityOverCode - Airflow Town Hall
54. CommunityOverCode - Airflow Town Hall
55. Welcome to the Apache Airflow Community!
56. Thank You! Any Questions? Design By COSCUP 2025 Marketing Team CC-BY 4.0 LinkedIn: zhe-you-liu GitHub: jason810496