LLM Meetup Tokyo #2 手続きを記憶するコマンド型エージェントの実装

LLM Meetup Tokyo #2 でのデモ発表資料
https://lu.ma/llm-meetup-tokyo-2

command-agent
https://github.com/rynsuke/command-agent

[Demo1 (Planning)]
https://drive.google.com/file/d/1XRov3ax1FrfgIsFtG-Ckpdkh2oY_PeUj/view

[Demo2 (Command Execution)]
https://drive.google.com/file/d/101DozhSsx44K4fzCMvwrpAk9wmUB2D_6/view

Transcript

1. LLM Meetup Tokyo #2 खଓ͖ΛهԱ͢Δ ίϚϯυܕΤʔδΣϯτͷ࣮૷ @ey_ryunosuke 2023/05/18
2. ݱࡏ લ৬ גࣜձࣾϝϧΧϦ Microservices Platform CI/CD ࣾ಺ͷ৽CIγεςϜͷ։ൃɾҠߦ @ey_ryunosuke ࣗݾ঺հ Cloudbaseגࣜձࣾ ιϑτ΢ΣΞΤϯδχΞ Ϋϥ΢υηΩϡϦςΟαʔϏεͷ։ൃ AI Labͷ্ཱͪ͛ʢ1ਓʣ ٕज़ελοΫ: Golang, TypeScript, AWS Twitter: @ey_nosukeru
3. ࣗ཯ܕΤʔδΣϯτͷۀ຿׆༻ʹ޲͚ͯ • ࣗ཯ܕΤʔδΣϯτ = ༩͑ΒΕͨπʔϧΛ࢖͍ͳ͕Βɺ ࣗ෼Ͱߟ͑ͯ৭ʑ΍ͬͯ͘ΕΔ܅ ◦ BabyAGI, AutoGPT ͳͲ͕࿩୊ʹ • ເͷΑ͏ͳٕज़͕ͩɺ՝୊΋ଟ͍ ◦ ಈ࡞ͷෆ҆ఆੑ ▪ ظ଴ͨ͠ग़ྗΛग़ͯ͘͠Εͳ͍ ▪ ແݶϧʔϓͯ͠Δ ◦ ͔͔࣌ؒΓ͗͢ɺτʔΫϯ৯΂͗͢ ◦ ίϯςΩετ௕ͷݶք https://github.com/yoheinakajima/babyagi
4. ࣗ཯ܕΤʔδΣϯτͷۀ຿׆༻ʹ޲͚ͯ • ·ͩʮ;Θͬͱͨ͠λεΫΛ҆৺ͯ͠೚ͤΒΕΔʯ΄Ͳਫ਼౓͸ߴ͘ͳ͍ • ͦΕΑΓ΋ɺʮఆܕλεΫΛ࣮֬ʹ͜ͳͯ͘͠ΕΔʯํ͕Ϣʔεέʔε͸ଟ͍ • ඞͣ͠΋શ෦ࣗ෼Ͱߟ͑ͯ΍ͬͯ͘Εͳͯ͘΋͍͍ ◦ Ұ౓ڭ͑ͨ͜ͱΛ֮͑ͯ͘ΕΔ ◦ 2ճ໨Ҏ߱ʮ͋Ε΍ͬͱ͍ͯʂʯͰ΍ͬͯ͘ΕΔ
5. ࣗ཯ܕΤʔδΣϯτͷۀ຿׆༻ʹ޲͚ͯ • ·ͩʮ;Θͬͱͨ͠λεΫΛ҆৺ͯ͠೚ͤΒΕΔʯ΄Ͳਫ਼౓͸ߴ͘ͳ͍ • ͦΕΑΓ΋ɺʮఆܕλεΫΛ࣮֬ʹ͜ͳͯ͘͠ΕΔʯํ͕Ϣʔεέʔε͸ଟ͍ • ඞͣ͠΋શ෦ࣗ෼Ͱߟ͑ͯ΍ͬͯ͘Εͳͯ͘΋͍͍ ◦ Ұ౓ڭ͑ͨ͜ͱΛ֮͑ͯ͘ΕΔ ◦ 2ճ໨Ҏ߱ʮ͋Ε΍ͬͱ͍ͯʂʯͰ΍ͬͯ͘ΕΔ
6. Command Agent • ϕʔε͸ langchainͷΤʔδΣϯτ࣮૷ ◦ λεΫͱπʔϧΛ༩͑ͯɺthought, action, action inputΛ܁Γฦ͠ग़ྗͤ͞Δ • λεΫͱεςοϓΛςϯϓϨʔτԽ͍ͨ͠ → ม਺ͰύϥϝʔλԽ • Commandͱ͍͏ΞΫγϣϯ୯Ґ (≒ ؔ਺) 1. Ұ࿈ͷखଓ͖ΛύοέʔδԽͨ͠΋ͷ 2. ࣄલఆٛͨ͠֎෦πʔϧ (langchainͷToolͷϥούʔ) • ίϚϯυͱ࢖͏ม਺ΛܾΊΔPlannning Agentͱɺ࢖͏ม਺͔ΒίϚϯυͷೖྗΛ࡞Δ Command Executor
7. ྫɿ[URL]ͷ಺༰Λ[NotionDB]ʹอଘ͢Δʢϓϥϯχϯάʣ • step1: ◦ Planning Agentʮ[URL]Λ࢖ͬͯɺGetURLContentΛ࣮ߦʯ ◦ Command ExecutorʮGetURLContent(url: [URL])ʯ • step2: ◦ Planning Agentʮ[NotionDB]Λ࢖ͬͯɺSearchNotionDatabaseΛ࣮ߦʯ ◦ Command ExecutorʮSearchNotionDatabase(database_name: [NotionDB])ʯ • step3: ◦ Planning Agentʮ[step1.output]ͱ[step2.output]Λ࢖ͬͯɺInsertNotionPageΛ࣮ߦʯ ◦ Command ExecutorʮInsertNotionPage(database_id: [step2.output.database_id], content: [step1.output])ʯ • step 4: ◦ Planning Agentʮ[step3.output]Λ࢖ͬͯɺReturnΛ࣮ߦʯ ◦ Command ExecutorʮReturn(page_url: step3.output)ʯˠಈ࡞׬ྃ
8. ྫɿ[URL]ͷ಺༰Λ[NotionDB]ʹอଘ͢ΔʢίϚϯυ࣮ߦʣ • step1: ◦ Planning Agentʮ[URL]Λ࢖ͬͯɺGetURLContentΛ࣮ߦʯ ◦ Command ExecutorʮGetURLContent(url: [URL])ʯ • step2: ◦ Planning Agentʮ[NotionDB]Λ࢖ͬͯɺSearchNotionDatabaseΛ࣮ߦʯ ◦ Command ExecutorʮSearchNotionDatabase(database_name: [NotionDB])ʯ • step3: ◦ Planning Agentʮ[step1.output]ͱ[step2.output]Λ࢖ͬͯɺInsertNotionPageΛ࣮ߦʯ ◦ Command ExecutorʮInsertNotionPage(database_id: [step2.output.database_id], content: [step1.output])ʯ • step 4: ◦ Planning Agentʮ[step3.output]Λ࢖ͬͯɺReturnΛ࣮ߦʯ ◦ Command ExecutorʮReturn(page_url: step3.output)ʯˠಈ࡞׬ྃ
9. Demo
14. https://github.com/rynsuke/command-agent