プロダクションでのPython非同期ユースケース - Trio/Trio-Utilを中心に

プロダクションでのPython非同期ユースケース - Trio/Trio-Utilを中心に (PyCon JP 2024)

Description
Pythonの非同期を利用されていますか？おそらく、市場での多くのユースケースはIOを多用するWebでの活用で、FastAPIやDjangoでasyncioを利用されている方も多いのではないでしょうか。今回のトークでは、asyncioと同時期にリリースされ「structured concurrency」という概念に強く影響を受けた Python非同期のサードパーティライブラリ「Trio」について、asyncioとの比較を交えお話しします。

asyncio以外のpython非同期って何？anyioってとは？なぜTrioを選択したのか、にお答えします。世界的に見ても稀有なTrioをプロダクションで利用している事例を中心に、実際のコードを交えTrioとasyncioの比較をしながら、ユースケースをご紹介します。

Session: https://2024.pycon.jp/ja/talk/HFE3MV
X: https://x.com/JunyaFff
linkedin: https://www.linkedin.com/in/junya-fukuda-4622a863/

Transcript

1. プロダクションでのPython 非 同期ユースケース Trio/Trio-Utilを中 心 に Junya Fukuda PyCon JP 2024
2. •book •Python࣮ફϨγϐ •ΤΩεύʔτPythonϓϩάϥϛϯάվగ4൛ •Junya Fukudaʢ@JunyaFffʣ •Photos 📷 post 👍 •Software Engineer at Groove X, inc. •࿈ࡌ: Python Monthly Topics | gihyo.jp ͖ΐ͏ͷίʔυ 🔍GitHub jrfk talk
3. Python の 非 同期を使っていますか？ ✋
4. Thank You! Python の 非 同期を使っていますか？ ✋
5. Web? ✋ Python の 非 同期を使っていますか？ ✋
6. Web? ✋ Database? ✋ Python の 非 同期を使っていますか？ ✋
7. Web? ✋ Database? ✋ API calls? ✋ Python の 非 同期を使っていますか？ ✋
8. Trio? ✋ ✋ ✋
9. 🤝🤝🤝🤝🤝
10. わたしたちはロボット開発で Python 非 同期を使っています
12. 😊😊😊
13. プロダクションでのPython 非 同期ユースケース Trio/Trio-Utilを中 心 に
14. プロダクションでのPython 非 同期ユースケース Trio/Trio-Utilを中 心 に
15. プロダクションでのPython 非 同期ユースケース Trio/Trio-Utilを中 心 に
16. •Trio ͱ Trio-util, asyncio ͷAPIൺֱ •anyio ͦͯ͠ subinterpreter/free threading ͱasync •Python async ͱ ϩϘοτͰͷϢʔεέʔε
17. •Python async ͱ ϩϘοτͰͷϢʔεέʔε •Why Python Async •Why Trio •Trio ͱ Trio-util, asyncio ͷAPIൺֱ •anyio ͦͯ͠ subinterpreter/free threading ͱasync
18. •Python async ͱ ϩϘοτͰͷϢʔεέʔε •Why Python Async •Why Trio •Trio ͱ Trio-util, asyncio ͷAPIൺֱ •anyio ͦͯ͠ subinterpreter/free threading ͱasync
19. •Python async ͱ ϩϘοτͰͷϢʔεέʔε •Why Python Async •Why Trio •Trio ͱ Trio-util, asyncio ͷAPIൺֱ •anyio ͦͯ͠ subinterpreter/free threading ͱasync
20. •Python async ͱ ϩϘοτͰͷϢʔεέʔε •Why Python Async •Why Trio •Trio ͱ Trio-util, asyncio ͷAPIൺֱ •anyio ͦͯ͠ subinterpreter/free threading ͱasync
21. •TrioΛ༻͍ͨϓϩμΫγϣϯϢʔεέʔεͷ۩ମྫ
22. •Trioͱasyncioͷҧ͍ͱʮstructured concurrencyʯͷ֓೦ •TrioΛ༻͍ͨϓϩμΫγϣϯϢʔεέʔεͷ۩ମྫ
23. •ͨ͘͞ΜͷIOͷ͋ΔඇಉظΞϓϦέʔγϣϯͰͷώϯτ •Trioͱasyncioͷҧ͍ͱʮstructured concurrencyʯͷ֓೦ •TrioΛ༻͍ͨϓϩμΫγϣϯϢʔεέʔεͷ۩ମྫ
24. •Python async ͱ ϩϘοτͰͷϢʔεέʔε •Why Python Async •Why Trio •Trio ͱ Trio-util, asyncio ͷAPIൺֱ •anyio ͦͯ͠ subinterpreter/free threading ͱasync
25. •Python async ͱ ϩϘοτͰͷϢʔεέʔε
26. •Python async ͱ ϩϘοτͰͷϢʔεέʔε
27. ͳͥҙࢥܾఆΤϯδϯʹ Python ඇಉظΛ࠾༻ͨ͠ͷ͔ʁ
28. Why Python Async •1ͭ໨ͷཧ༝ •2ͭ໨ͷཧ༝
29. Why Python Async •Ո଒ܕϩϘοτʮLOVOTʯ
30. Why Python Async •Ո΍ΦϑΟεͳͲͰ฻Β͢ •Ո଒ܕϩϘοτʮLOVOTʯ
31. Why Python Async •ͨ͘͞Μͷηϯαʔ •Ո଒ܕϩϘοτʮLOVOTʯ •Ո΍ΦϑΟεͳͲͰ฻Β͢
32. Why Python Async •൴Β͸֎ͷ৘ใΛͨ͘͞Μಘ͍ͯΔ
33. Why Python Async •൴Β͸֎ͷ৘ใΛͨ͘͞Μಘ͍ͯΔ 
    $16
    DPSFT
    
    .$6T
    
    TFOTPST
34. Why Python Async •ͨ͘͞Μͷηϯαʔ •Ո଒ܕϩϘοτʮLOVOTʯ •Ո΍ΦϑΟεͳͲͰ฻Β͢ •؀ڥΛೝࣝͨ͠ΓɺҙࢥܾఆΛ͢ΔͨΊ
35. Ұॹʹ฻Β͢LOVOT
36. ೔ৗੜ׆ʹ͓͚Δେྔͷ Πϯϓοτ Ұॹʹ฻Β͢LOVOT
37. ೔ৗੜ׆ʹ͓͚Δେྔͷ Πϯϓοτ Ξ΢τϓοτ Ұॹʹ฻Β͢LOVOT
38. ೔ৗੜ׆ʹ͓͚Δେྔͷ Πϯϓοτ Ξ΢τϓοτ ͦΕΒΛಉ࣌ʹߦ͏ඞཁ Ұॹʹ฻Β͢LOVOT
39. Why Python Async •1ͭ໨ͷཧ༝ - ฒߦॲཧ͕ඞཁ •ͨ͘͞Μͷ I/O Λಉ࣌ʹ
40. Why Python Async •1ͭ໨ͷཧ༝ - ฒߦॲཧ͕ඞཁ •ͨ͘͞Μͷ I/O Λಉ࣌ʹ
41. Why Python Async •1ͭ໨ͷཧ༝ - ฒߦॲཧ͕ඞཁ •2ͭ໨ͷཧ༝ •ͨ͘͞Μͷ I/O Λಉ࣌ʹ
42. Why Python Async •ͨ͘͞ΜͷϚΠΫϩαʔϏε͕ಈ͍͍ͯΔ
43. Why Python Async •ϋʔυ΢ΣΞ͔Βͷ৘ใɺΫϥ΢υ࿈ܞͳͲ΋ •ͨ͘͞ΜͷϚΠΫϩαʔϏε͕ಈ͍͍ͯΔ
44. Why Python Async •ͦͯͦ͠ΕΒΛݶΒΕͨϦιʔεͰ •ϋʔυ΢ΣΞ͔Βͷ৘ใɺΫϥ΢υ࿈ܞͳͲ΋ •ͨ͘͞ΜͷϚΠΫϩαʔϏε͕ಈ͍͍ͯΔ
45. Why Python Async •ͦͯͦ͠ΕΒΛݶΒΕͨϦιʔεͰ •ϋʔυ΢ΣΞ͔Βͷ৘ใɺΫϥ΢υ࿈ܞͳͲ΋ •ͨ͘͞ΜͷϚΠΫϩαʔϏε͕ಈ͍͍ͯΔ
46. Why Python Async •1ͭ໨ͷཧ༝ - ฒߦॲཧ͕ඞཁ •2ͭ໨ͷཧ༝ •ͨ͘͞Μͷ I/O Λಉ࣌ʹ
47. Why Python Async •ͨ͘͞Μͷ I/O Λಉ࣌ʹ •1ͭ໨ͷཧ༝ - ฒߦॲཧ͕ඞཁ •2ͭ໨ͷཧ༝ •ݶΒΕͨϦιʔε
48. Why Python Async •ͨ͘͞Μͷ I/O Λಉ࣌ʹ •1ͭ໨ͷཧ༝ - ฒߦॲཧ͕ඞཁ •2ͭ໨ͷཧ༝ •ݶΒΕͨϦιʔε Python Async
49. 🤔
50. なぜ asyncio でなく Trio? 🌷
51. なぜ asyncio でなく Trio? asyncio Trio
52. なぜ asyncio でなく Trio? asyncio Trio 標準ライブラリ
53. なぜ asyncio でなく Trio? asyncio Trio 標準ライブラリ サードパーティ
54. たとえば Urllib（純正シンプル） requests（使いやすい） みたいな違いはない
55. Trio? ✋ ✋ ✋
56. Trio? ✋ ✋ ✋ （🙈PyConUS2024 でもいなかった 🤫）
57. なぜ asyncio でなく Trio? 🌷
58. なぜ asyncio でなく Trio? 🌷 わざわざ選ぶ理由ないよね
60. Why Trio? •Robust cancellation •Structured Concurrency •User-friendly API ·ͩߴϨϕϧAPIͳ͍࣌୅ 😢 •͜ΕΛܾఆͨ͠ͷ͸ 2017೥ౙ •Python3.6ͷ࣌୅
61. 🤔 Structured Concurrencyとキャンセル
62. •Structured Concurrency ͬͯԿʁ •ߏ଄Խ͞Εͨฒߦੑ •Martin Sustrik ࢯ͕2016೥2݄ʹఏএͨ֓͠೦ Structured Concurrency | 250bpm.com : https://250bpm.com/blog:71/ Why Trio? - Structured Concurrencyとキャンセル
63. •ඇಉظॲཧͷ։࢝ͱऴ͕ྃ໌֬ʹ ೖΕࢠʹͳΔ͜ͱ ͳͥೖΕࢠʹʁ Why Trio? - Structured Concurrencyとキャンセル •Structured Concurrency ͬͯ֓೦
64. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() Why Trio? - Structured Concurrencyとキャンセル
65. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() 👍 Why Trio? - Structured Concurrencyとキャンセル
66. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() Why Trio? - Structured Concurrencyとキャンセル
67. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() 🤔 Why Trio? - Structured Concurrencyとキャンセル
68. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() Why Trio? - Structured Concurrencyとキャンセル 1. ଙεϨου͸ͦͷ··ॲཧ͢Δέʔε 2. Ωϟϯηϧͯ͠ཉ͍͠έʔε
69. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() Why Trio? - Structured Concurrencyとキャンセル 1. ଙεϨου͸ͦͷ··ॲཧ͢Δέʔε 2. Ωϟϯηϧͯ͠ཉ͍͠έʔε
70. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() TrioはStructured Concurrencyとキャンセルを2017時点で実現 Why Trio? - Structured Concurrencyとキャンセル
71. •Structured Concurrency Why Trio? - Structured Concurrencyとキャンセル
72. •Structured Concurrency IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED Why Trio? - Structured Concurrencyとキャンセル
73. •Structured Concurrency IUUQTPQFOKELPSHKFQT Why Trio? - Structured Concurrencyとキャンセル
74. •Structured Concurrency IUUQTLPUMJOMBOHPSHBQJLPUMJOYDPSPVUJOFTLPUMJOYDPSPVUJOFTDPSFLPUMJOYDPSPVUJOFTDPSPVUJOFTDPQF Why Trio? - Structured Concurrencyとキャンセル
75. •Structured Concurrency Why Trio? - Structured Concurrencyとキャンセル
76. •Structured Concurrency Async Rust can be a pleasure to work with (without `Send + Sync + 'static`) Why Trio? - Structured Concurrencyとキャンセル
77. ೖࣾ ͯ͠ͳ͍
78. ͭ·Γ
79. બఆʹ ؔΘ͓ͬͯΓ·ͤΜ
82. Why Trio? •Robust cancellation •Structured Concurrency •User-friendly API •Trioͷΰʔϧʮusability and correctnessʯ
83. ͳͥϢʔβʔϑϨϯυϦʔͳAPI͕ඞཁʁ 🤔
84. Why Trio? - User-friendly API Python Engineers
85. Python Engineers Why Trio? - User-friendly API
86. Python Engineers Why Trio? - User-friendly API
87. Python Engineers Animators Why Trio? - User-friendly API
88. Python Engineers Animators Why Trio? - User-friendly API
89. Python Engineers Animators Kawaii Behavior Why Trio? - User-friendly API
90. Kawaii Behavior Why Trio? - User-friendly API
91. Why Trio? •Robust cancellation •Structured Concurrency •User-friendly API •Trioͷΰʔϧʮusability and correctnessʯ - Ξχϝʔλʔͱͷڠۀ
92. なぜ asyncio でなく Trio? 🌷 👍
93. Trioとasyncioの交えた 比 較 🌷 👍
94. •Robust cancellation •Structured Concurrency •User-friendly API Trio asyncio 比 較 ͜ͷ3ͭͷ؍఺Ͱ APIΛݟͯΈ·͠ΐ͏
95. 🔍 GitHub jrfk talk
96. 🔍 GitHub jrfk talk PEP 723対応！
97. 🔍 GitHub jrfk talk PEP 723対応！
98. trio asyncio ·ͱΊ࣮ͯߦ Nursery Taskgroup Nඵޙʹ λεΫऴྃ move_on_after Timeout ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ Trio asyncio 比 較
99. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 1PUFOUJBM
    "1*
    DIBOHFT
    UP
    IFMQ
    VTFST
    XIP
    EPOU
    SFBMJ[F
    QBSFOUJOH
    JT
    B
    GVMMUJNF
    KPC
    u
    *TTVF
     IUUQTHJUIVCDPNQZUIPOUSJPUSJPJTTVFT 4IPVME
    XF
    SFOBNF
    OVSTFSJFT
     IUUQTHJUIVCDPNQZUIPOUSJPUSJPJTTVFT
100. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 1PUFOUJBM
     "1*
     DIBOHFT
     UP
     IFMQ
     VTFST
     XIP
     EPOU
     SFBMJ[F
     QBSFOUJOH
     JT
     B
     GVMMUJNF
     KPC
     u
     *TTVF
      IUUQTHJUIVCDPNQZUIPOUSJPUSJPJTTVFT 4IPVME
     XF
     SFOBNF
     OVSTFSJFT
      IUUQTHJUIVCDPNQZUIPOUSJPUSJPJTTVFT •ίʔυΛݟͯΈ·͠ΐ͏
101. async def child(): print("👶ࢠίϧʔνϯ ͜Μʹͪ͸") await grandchild() print("👶 ͞Α͏ͳΒ") async def grandchild(): print("👶👶ଙίϧʔνϯ ͜Μʹͪ͸") await trio.sleep(0.1) print("👶👶 ͞Α͏ͳΒ")
102. async def main(): async with trio.open_nursery() as nursery: nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) print("ดԂ")
103. async def main(): async with trio.open_nursery() as nursery: nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) print("ดԂ")
104. async def main(): async with trio.open_nursery() as nursery: nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) print("ดԂ")
105. async def main(): async with trio.open_nursery() as nursery: nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) print("ดԂ")
106. $ uv run 1_trio_nursery.py … 👶ࢠίϧʔνϯ ͜Μʹͪ͸ 👶👶ଙίϧʔνϯ ͜Μʹͪ͸ … 👶👶 ͞Α͏ͳΒ 👶 ͞Α͏ͳΒ ดԂ
107. $ uv run 1_trio_nursery.py … 👶ࢠίϧʔνϯ ͜Μʹͪ͸ 👶👶ଙίϧʔνϯ ͜Μʹͪ͸ … 👶👶 ͞Α͏ͳΒ 👶 ͞Α͏ͳΒ ดԂ
108. $ uv run 1_trio_nursery.py … 👶ࢠίϧʔνϯ ͜Μʹͪ͸ 👶👶ଙίϧʔνϯ ͜Μʹͪ͸ … 👶👶 ͞Α͏ͳΒ 👶 ͞Α͏ͳΒ ดԂ
109. $ uv run 1_trio_nursery.py … 👶ࢠίϧʔνϯ ͜Μʹͪ͸ 👶👶ଙίϧʔνϯ ͜Μʹͪ͸ … 👶👶 ͞Α͏ͳΒ 👶 ͞Α͏ͳΒ ดԂ
110. async def main(): async with trio.open_nursery() as nursery: nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) print("ดԂ")
111. async def main(): async with trio.open_nursery() as nursery: nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) nursery.start_soon(child) print("ดԂ") •Structured Concurrency 🎉
112. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery
113. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main
114. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery
115. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery 子 ：
116. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery 子 ： 孫：
117. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery 子 ： 孫：
118. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery 子 ：
119. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery
120. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main
121. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main ࣮ࡍʹtrio discussionͷͳ͔Ͱ ʮશͯͷࢠλεΫ͕ແࣄʹऴྃ͢Δ·ͰݟकΔʯ
122. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main ࣮ࡍʹtrio discussionͷͳ͔Ͱ ʮશͯͷࢠλεΫ͕ແࣄʹऴྃ͢Δ·ͰݟकΔʯ •ଓ͍ͯΩϟϯηϧʹ͍ͭͯɺΈͯΈ·͠ΐ͏
123. async def main(): try: async with trio.open_nursery() as nursery: nursery.start_soon(coro_success) nursery.start_soon(coro_value_err) nursery.start_soon(coro_type_err) nursery.start_soon(triplet_nap) # ৸ͯΔ except* Exception as err: print(f"{err.exceptions=}") await trio.sleep(5) # 👶👶👶͕print͞Εͳ͍ print("ดԂ")
124. async def main(): try: async with trio.open_nursery() as nursery: nursery.start_soon(coro_success) nursery.start_soon(coro_value_err) nursery.start_soon(coro_type_err) nursery.start_soon(triplet_nap) # ৸ͯΔ except* Exception as err: print(f"{err.exceptions=}") await trio.sleep(5) # 👶👶👶͕print͞Εͳ͍ print("ดԂ")
125. async def main(): try: async with trio.open_nursery() as nursery: nursery.start_soon(coro_success) nursery.start_soon(coro_value_err) nursery.start_soon(coro_type_err) nursery.start_soon(triplet_nap) # ৸ͯΔ except* Exception as err: print(f"{err.exceptions=}") await trio.sleep(5) # 👶👶👶͕print͞Εͳ͍ print("ดԂ")
126. async def main(): try: async with trio.open_nursery() as nursery: nursery.start_soon(coro_success) nursery.start_soon(coro_value_err) nursery.start_soon(coro_type_err) nursery.start_soon(triplet_nap) # ৸ͯΔ except* Exception as err: print(f"{err.exceptions=}") await trio.sleep(5) # 👶👶👶͕print͞Εͳ͍ print("ดԂ")
127. async def triplet_nap(): print("௕͍ίϧʔνϯ ։࢝") await trio.sleep(3) print("👶👶👶") return "ดԂ͔ͩΒؼΓ·͠ΐ͏"
128. async def triplet_nap(): print("௕͍ίϧʔνϯ ։࢝") await trio.sleep(3) print("👶👶👶") return "ดԂ͔ͩΒؼΓ·͠ΐ͏"
129. async def triplet_nap(): print("௕͍ίϧʔνϯ ։࢝") await trio.sleep(3) print("👶👶👶") return "ดԂ͔ͩΒؼΓ·͠ΐ͏"
130. •՝୊͸ʮΩϟϯηϧʯ main() foo() bar() Why Trio? - Structured Concurrencyとキャンセル
131. $ uv run 2_trio_nursery_exceptiongroup.py ௕͍ίϧʔνϯ ։࢝ err.exceptions=(ValueError(), TypeError()) ดԂ
132. $ uv run 2_trio_nursery_exceptiongroup.py ௕͍ίϧʔνϯ ։࢝ err.exceptions=(ValueError(), TypeError()) ดԂ 👶👶👶ͳ͍
133. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main
134. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery
135. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery 子 ：
136. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery 子 ：
137. •APIͱͯ͠ෆࢥٞͳ໊લ •nursery: อҭԂ trio.nursery 親：main 保育園 ：open_nursery 子 ： •Structured Concurrency •Ωϟϯηϧ
138. trio asyncio ·ͱΊ࣮ͯߦ Nursery Taskgroup Nඵޙʹ λεΫऴྃ move_on_after Timeout ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ Trio asyncio 比 較
139. •3.11Ͱ௥Ճ͞ΕͨAPI asyncio.Taskgroup
140. •3.11Ͱ௥Ճ͞ΕͨAPI asyncio.Taskgroup
141. •3.11Ͱ௥Ճ͞ΕͨAPI asyncio.Taskgroup
142. •3.11Ͱ௥Ճ͞ΕͨAPI asyncio.Taskgroup
143. async def child(): print("👶ࢠίϧʔνϯ ͜Μʹͪ͸") await grandchild() print("👶 ͞Α͏ͳΒ") async def grandchild(): print("👶👶ଙίϧʔνϯ ͜Μʹͪ͸") await trio.sleep(0.1) print("👶👶 ͞Α͏ͳΒ")
144. async def main(): async with asyncio.TaskGroup() as g: g.create_task(child()) g.create_task(child()) g.create_task(child()) g.create_task(child(), name="Α͘৸ͯΔ") print("ดԂ")
145. async def main(): async with asyncio.TaskGroup() as g: g.create_task(child()) g.create_task(child()) g.create_task(child()) g.create_task(child(), name="Α͘৸ͯΔ") print("ดԂ")
146. $ uv run 1_asyncio_taskgroup.py … 👶ࢠίϧʔνϯ ͜Μʹͪ͸ 👶👶ଙίϧʔνϯ ͜Μʹͪ͸ … 👶👶 ͞Α͏ͳΒ 👶 ͞Α͏ͳΒ ดԂ
147. async def main(): async with asyncio.TaskGroup() as g: g.create_task(child()) g.create_task(child()) g.create_task(child()) g.create_task(child(), name="Α͘৸ͯΔ") print("ดԂ")
148. async def main(): async with asyncio.TaskGroup() as g: g.create_task(child()) g.create_task(child()) g.create_task(child()) g.create_task(child(), name="Α͘৸ͯΔ") print("ดԂ") •Structured Concurrency 🎉
149. async def main(): async with asyncio.TaskGroup() as g: g.create_task(child()) g.create_task(child()) g.create_task(child()) g.create_task(child(), name="Α͘৸ͯΔ") print("ดԂ") •Structured Concurrency 🎉 •Ωϟϯηϧ΋ΈͯΈ·͠ΐ͏
150. async def main(): try: async with asyncio.TaskGroup() as g: task1 = g.create_task(coro_success()) task2 = g.create_task(coro_value_err()) task3 = g.create_task(coro_type_err()) task4 = g.create_task(triplet_nap(), name="Α͘৸ͯΔ") results = [task1.result(), task2.result(), task3.result()] print(f"{results=}") except* Exception as err: print(f"{err.exceptions=}") await asyncio.sleep(5) # 👶👶👶͕print͞Εͳ͍͜ͱΛ֬ೝ print("ดԂ")
151. async def main(): try: async with asyncio.TaskGroup() as g: task1 = g.create_task(coro_success()) task2 = g.create_task(coro_value_err()) task3 = g.create_task(coro_type_err()) task4 = g.create_task(triplet_nap(), name="Α͘৸ͯΔ") results = [task1.result(), task2.result(), task3.result()] print(f"{results=}") except* Exception as err: print(f"{err.exceptions=}") await asyncio.sleep(5) # 👶👶👶͕print͞Εͳ͍͜ͱΛ֬ೝ print("ดԂ")
152. $ uv run 2_asyncio_taskgroup_exceptiongroup.py ௕͍ίϧʔνϯ ։࢝ err.exceptions=(ValueError(), TypeError()) ดԂ
153. $ uv run 2_asyncio_taskgroup_exceptiongroup.py ௕͍ίϧʔνϯ ։࢝ err.exceptions=(ValueError(), TypeError()) ดԂ 👶👶👶ͳ͍
154. Trio asyncio 交 比 較 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup Nඵޙʹ λεΫऴྃ move_on_after Timeout ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
155. Trio asyncio 交 比 較 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
156. Trio asyncio 交 比 較 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
157. async def main(): with trio.move_on_after(1) as cancel_scope: await triplet_nap() if cancel_scope.cancelled_caught: print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ")
158. async def main(): with trio.move_on_after(1) as cancel_scope: await triplet_nap() if cancel_scope.cancelled_caught: print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ") 時間 設定
159. async def main(): with trio.move_on_after(1) as cancel_scope: await triplet_nap() if cancel_scope.cancelled_caught: print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ")
160. async def main(): with trio.move_on_after(1) as cancel_scope: await triplet_nap() if cancel_scope.cancelled_caught: print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ")
161. async def main(): with trio.move_on_after(1) as cancel_scope: await triplet_nap() if cancel_scope.cancelled_caught: print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ") •Structured Concurrency 🎉
162. async def triplet_nap(): print("௕͍ίϧʔνϯ ։࢝") await trio.sleep(3) print("👶👶👶") return "ดԂ͔ͩΒؼΓ·͠ΐ͏"
163. async def triplet_nap(): print("௕͍ίϧʔνϯ ։࢝") await trio.sleep(3) print("👶👶👶") return "ดԂ͔ͩΒؼΓ·͠ΐ͏"
164. $ uv run 3_trio_move_on_after_except.py … ௕͍ίϧʔνϯ ։࢝ ͪΌΜͱ͓͖ͯͶ ͓ΘΓ 👶👶👶ͳ͍
165. Trio asyncio 交 比 較 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
166. async def main(): try: async with asyncio.timeout(1): await triplet_nap() except TimeoutError as err: print(f"{err=}") print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ")
167. async def main(): try: async with asyncio.timeout(1): await triplet_nap() except TimeoutError as err: print(f"{err=}") print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ") 時間 設定
168. async def main(): try: async with asyncio.timeout(1): await triplet_nap() except TimeoutError as err: print(f"{err=}") print("ͪΌΜͱ͓͖ͯͶ") print("͓ΘΓ") 時間 設定 •Structured Concurrency 🎉
169. async def triplet_nap(): print("௕͍ίϧʔνϯ ։࢝") await asyncio.sleep(3) print("👶👶👶") return "ดԂ͔ͩΒؼΓ·͠ΐ͏"
170. async def triplet_nap(): print("௕͍ίϧʔνϯ ։࢝") await trio.sleep(3) print("👶👶👶") return "ดԂ͔ͩΒؼΓ·͠ΐ͏"
171. $ uv run 3_asyncio_timeout.py … ௕͍ίϧʔνϯ ։࢝ err=TimeoutError() ͪΌΜͱ͓͖ͯͶ ͓ΘΓ
172. $ uv run 3_asyncio_timeout.py … ௕͍ίϧʔνϯ ։࢝ err=TimeoutError() ͪΌΜͱ͓͖ͯͶ ͓ΘΓ 👶👶👶ͳ͍
173. Trio asyncio 交 比 較 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
174. Trio asyncio 交 比 較 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
175. 🤔
176. 🤔
177. Trio asyncio 交 比 較 Python >= 3.11 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
178. Trio asyncio 交 比 較 Python < 3.11 trio asyncio asyncioͷಛ௃ ·ͱΊ࣮ͯߦ Nursery gather ߏ଄Խ 🙅 Ωϟϯηϧ 🤔 ϑϨϯυϦ 🤔 Nඵޙʹ λεΫऴྃ move_on_after wait_for ߏ଄Խ 🙅 Ωϟϯηϧ 🤔 ϑϨϯυϦ 🤔 ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ 今 使 ！ ！
179. 🤔 🌷 👍
180. 🤔 🌷 👍
181. 🤔 🌷 👍
182. 🤔 🌷 👍
183. Trio asyncio 交 比 較 Python >= 3.11 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
184. Trio asyncio 交 比 較 Python >= 3.11 trio asyncio ಛ௃ ·ͱΊ࣮ͯߦ Nursery Taskgroup ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 Nඵޙʹ λεΫऴྃ move_on_after Timeout ߏ଄Խ 🙆 Ωϟϯηϧ 🙆 ϑϨϯυϦ 🙆 ஋ͷมԽΛ଴ͭ trio-util.AsyncValue ʁ
185. 大 量の 入力 に対して状態管理をする AsyncValue
186. 大 量の 入力 に対して状態管理をする AsyncValue trio_util.AsyncValue
187. Handling Multiple Inputs •Event-Driven ͳΞϓϩʔνͷAPI܈ ΑΓϑϨϯυϦʔͳ֦ு •Trio-util 🔍
     HJUIVC
     USJPVUJM IUUQTHJUIVCDPN HSPPWFYUSJPVUJM
188. Handling Multiple Inputs •AsyncValue Class 👀
189. Handling Multiple Inputs •AsyncValue Class 👀 •஋΍awaitable ΛҾ਺ʹ •val = AyncValue(2024) Έ͍ͨͳײ͡
190. Handling Multiple Inputs •AsyncValue Class 👀 •஋΍awaitable ΛҾ਺ʹ •val = AyncValue(2024) Έ͍ͨͳײ͡ •ͦΕΛ·ͱΊΔ compose_event ΋͋Γ·͢
191. Handling Multiple Inputs •AsyncValue Class 👀 •஋΍awaitable ΛҾ਺ʹ •val = AyncValue(2024) Έ͍ͨͳײ͡ •ओͳAPI͸3ͭ঺հ
192. Handling Multiple Inputs •AsyncValue Class 👀 •஋΍awaitable ΛҾ਺ʹ •val.wait_value(஋ or ؔ਺) •Ҿ਺͕஋ͷ৔߹ɺvalue͕Ҿ਺ͷ஋ʹͳΔ·Ͱ଴ͭ
193. Handling Multiple Inputs •AsyncValue Class 👀 •஋΍awaitable ΛҾ਺ʹ •val.wait_value(஋ or ؔ਺) •val.wait_transition(ۭ or ஋ or ؔ਺) •஋ͷભҠɾมԽɾؔ਺ͷঢ়ଶΛ଴ͭ
194. Handling Multiple Inputs •AsyncValue Class 👀 •஋΍awaitable ΛҾ਺ʹ •val.wait_value(஋ or ؔ਺) •val.wait_transition(ۭ or ஋ or ؔ਺) •Val.eventual_value(ۭ or ஋ or ؔ਺) •৚݅Λຬͨͨ͠ΒloopΛճ͢
195. Handling Multiple Inputs •AsyncValue Class 👀 •஋΍awaitable ΛҾ਺ʹ •val.wait_value(஋ or ؔ਺) •val.wait_transition(ۭ or ஋ or ؔ਺) •eventual_value(ۭ or ஋ or ؔ਺) •࣮ࡍʹͲ͏ಈ͔͘ΈͯΈ·͠ΐ͏
196. Handling Multiple Inputs •४උ 👀
197. Handling Multiple Inputs •४උ 👀 •ϥϯμϜͳ਺ࣈΛฦ͢WebSocketαʔό VW
     SVO
     @TJNQMF@XFCTPDLFU@TFSWFSQZ
198. Handling Multiple Inputs •४උ 👀 •ϥϯμϜͳ਺ࣈΛฦ͢WebSocketαʔό VW
     SVO
     @TJNQMF@XFCTPDLFU@TFSWFSQZ •AsyncValueΛcompose_eventͰ·ͱΊɺͦΕΛ؂ࢹ͢Δ
199. Handling Multiple Inputs •४උ 👀 •ϥϯμϜͳ਺ࣈΛฦ͢WebSocketαʔό VW
     SVO
     @TJNQMF@XFCTPDLFU@TFSWFSQZ •👶 ͕ ஋͕มԽ͢Δͨͼʹɺग़ྗ͠·͢ •AsyncValueΛcompose_eventͰ·ͱΊɺͦΕΛ؂ࢹ͢Δ
200. async def main(): async with trio.open_nursery() as nursery: ws = await connect_websocket( nursery=nursery, host="localhost", port=8888, resource="/", ) event1 = AsyncValue("👶") event2 = AsyncValue("🍼") nursery.start_soon(fetch, ws, event1, event2) with compose_values(event1=event1, event2=event2) as composite_eve async for v in composite_event.eventual_values(): print(f"{v=}") •Continuously watch for value changes 👀
201. async def main(): async with trio.open_nursery() as nursery: ws = await connect_websocket( nursery=nursery, host="localhost", port=8888, resource="/", ) event1 = AsyncValue("👶") event2 = AsyncValue("🍼") nursery.start_soon(fetch, ws, event1, event2) with compose_values(event1=event1, event2=event2) as composite_eve async for v in composite_event.eventual_values(): print(f"{v=}") •Continuously watch for value changes 👀
202. async def main(): async with trio.open_nursery() as nursery: ws = await connect_websocket( nursery=nursery, host="localhost", port=8888, resource="/", ) event1 = AsyncValue("👶") event2 = AsyncValue("🍼") nursery.start_soon(fetch, ws, event1, event2) with compose_values(event1=event1, event2=event2) as composite_eve async for v in composite_event.eventual_values(): print(f"{v=}") •Continuously watch for value changes 👀
203. async def main(): async with trio.open_nursery() as nursery: ws = await connect_websocket( nursery=nursery, host="localhost", port=8888, resource="/", ) event1 = AsyncValue("👶") event2 = AsyncValue("🍼") nursery.start_soon(fetch, ws, event1, event2) with compose_values(event1=event1, event2=event2) as composite_eve async for v in composite_event.eventual_values(): print(f"{v=}") •Continuously watch for value changes 👀
204. async def main(): async with trio.open_nursery() as nursery: ws = await connect_websocket( nursery=nursery, host="localhost", port=8888, resource="/", ) event1 = AsyncValue("👶") event2 = AsyncValue("🍼") nursery.start_soon(fetch, ws, event1, event2) with compose_values(event1=event1, event2=event2) as composite_eve async for v in composite_event.eventual_values(): print(f"{v=}") •Continuously watch for value changes 👀
205. async def main(): async with trio.open_nursery() as nursery: ws = await connect_websocket( nursery=nursery, host="localhost", port=8888, resource="/", ) event1 = AsyncValue("👶") event2 = AsyncValue("🍼") nursery.start_soon(fetch, ws, event1, event2) with compose_values(event1=event1, event2=event2) as composite_eve async for v in composite_event.eventual_values(): print(f"{v=}") •Continuously watch for value changes 👀
206. async def main(): async with trio.open_nursery() as nursery: ws = await connect_websocket( nursery=nursery, host="localhost", port=8888, resource="/", ) event1 = AsyncValue("👶") event2 = AsyncValue("🍼") nursery.start_soon(fetch, ws, event1, event2) with compose_values(event1=event1, event2=event2) as composite_eve async for v in composite_event.eventual_values(): print(f"{v=}") •Continuously watch for value changes 👀
207. •Continuously watch for value changes 👀
208. 大 量の 入力 に対して状態管理をする AsyncValue trio_util.AsyncValue
209. Handling Multiple Inputs •Trio-util does not support anyio yet •There is no API that performs the same function. •asyncio-util IUUQTHJUIVCDPNKSGLBTZODJPVUJM Here is today's code
210. •Python async ͱ ϩϘοτͰͷϢʔεέʔε •Why Python Async •Why Trio •Trio ͱ Trio-util, asyncio ͷAPIൺֱ •anyio ͦͯ͠ subinterpreter/free threading ͱasync
211. anyio •asyncio ͱ trio Λܨ͙Χέϋγ •2018 2018೥10݄ Alex Grönholm ࢯ •࡞੒ͨ͠ओͳཧ༝ •Pythonͷඇಉظϓϩάϥϛϯάʹ͓͚Δॊೈੑͱ ߴϨϕϧͷந৅ԽΛఏڙ •ΑΓ࢖͍΍͘͢ɺΑΓҰ؏ੑͷ͋Δ ඇಉظϓϩάϥϛϯάͷܦݧΛఏڙ͔ͨͬͨ͠ #385: Higher level Python asyncio with AnyIO Transcript
212. anyio •asyncio ͱ trio Λܨ͙Χέϋγ #385: Higher level Python asyncio with AnyIO Transcript •Global backend ͱ͍͏ߟ͑ํ •ଟ͘ͷඇಉظϥΠϒϥϦͰ࠾༻, FastAPI, HTTPX…
213. if __name__ == "__main__": anyio.run(main, backend="asyncio") # ͜ΕΛtrioʹม͑Δ͚ͩͰಈ͘
214. if __name__ == "__main__": anyio.run(main, backend="asyncio") # ͜ΕΛtrioʹม͑Δ͚ͩͰಈ͘ uv run 5_anyio_sample.py
215. subinterpreter/free threading •subinterpreter/free threading
216. subinterpreter/free threading •subinterpreter/free threading
217. # αϒΠϯλϓϦλͰ࣮ߦ͢Δؔ਺ def run_sub_interpreter(): interp_id = interpreters.create() interpreters.run_string( interp_id, """ import asyncio async def async_task(): for i in range(5): ...
218. # αϒΠϯλϓϦλͰ࣮ߦ͢Δؔ਺ def run_sub_interpreter(): interp_id = interpreters.create() interpreters.run_string( interp_id, """ import asyncio async def async_task(): for i in range(5): ... uv run 6_subinterpreters_asyncio.py
219. •ΑΓշదͳඇಉظϥΠϑΛ •ͨ͘͞ΜͷIOͷ͋ΔඇಉظΞϓϦέʔγϣϯͰͷώϯτ •Trioͱasyncioͷҧ͍ͱʮstructured concurrencyʯͷ֓೦ •TrioΛ༻͍ͨϓϩμΫγϣϯϢʔεέʔεͷ۩ମྫ
220. reference •Simplifying Python's Async with Trio •https://talkpython.fm/episodes/show/167/simplifying-pythons-async-with-trio •Higher level Python asyncio with AnyIO •https://talkpython.fm/episodes/show/385/higher-level-python-asyncio-with-anyio •groove-x / trio-util •https://github.com/groove-x/trio-util •Structured Concurrency - Martin Sústrik •https://250bpm.com/blog:71/
221. ご静聴ありがとうございました 👋