LLM Meetup Tokyo #2 手続きを記憶するコマンド型エージェントの実装

LLM Meetup Tokyo #2 でのデモ発表資料
https://lu.ma/llm-meetup-tokyo-2

command-agent
https://github.com/rynsuke/command-agent

[Demo1 (Planning)]
https://drive.google.com/file/d/1XRov3ax1FrfgIsFtG-Ckpdkh2oY_PeUj/view

[Demo2 (Command Execution)]
https://drive.google.com/file/d/101DozhSsx44K4fzCMvwrpAk9wmUB2D_6/view

Transcript

1. LLM Meetup Tokyo #2
   खଓ͖ΛهԱ͢Δ
   ίϚϯυܕΤʔδΣϯτͷ࣮૷
   @ey_ryunosuke
   2023/05/18
   

   View Slide

2. ݱࡏ
   લ৬ גࣜձࣾϝϧΧϦ Microservices Platform CI/CD
   ࣾ಺ͷ৽CIγεςϜͷ։ൃɾҠߦ
   @ey_ryunosuke
   ࣗݾ঺հ
   Cloudbaseגࣜձࣾ ιϑτ΢ΣΞΤϯδχΞ
   Ϋϥ΢υηΩϡϦςΟαʔϏεͷ։ൃ
   AI Labͷ্ཱͪ͛ʢ1ਓʣ
   ٕज़ελοΫ: Golang, TypeScript, AWS
   Twitter: @ey_nosukeru
   

   View Slide

3. ࣗ཯ܕΤʔδΣϯτͷۀ຿׆༻ʹ޲͚ͯ
   ● ࣗ཯ܕΤʔδΣϯτ = ༩͑ΒΕͨπʔϧΛ࢖͍ͳ͕Βɺ
   ࣗ෼Ͱߟ͑ͯ৭ʑ΍ͬͯ͘ΕΔ܅
   ○ BabyAGI, AutoGPT ͳͲ͕࿩୊ʹ
   ● ເͷΑ͏ͳٕज़͕ͩɺ՝୊΋ଟ͍
   ○ ಈ࡞ͷෆ҆ఆੑ
   ■ ظ଴ͨ͠ग़ྗΛग़ͯ͘͠Εͳ͍
   ■ ແݶϧʔϓͯ͠Δ
   ○ ͔͔࣌ؒΓ͗͢ɺτʔΫϯ৯΂͗͢
   ○ ίϯςΩετ௕ͷݶք
   https://github.com/yoheinakajima/babyagi
   

   View Slide

4. ࣗ཯ܕΤʔδΣϯτͷۀ຿׆༻ʹ޲͚ͯ
   ● ·ͩʮ;Θͬͱͨ͠λεΫΛ҆৺ͯ͠೚ͤΒΕΔʯ΄Ͳਫ਼౓͸ߴ͘ͳ͍
   ● ͦΕΑΓ΋ɺʮఆܕλεΫΛ࣮֬ʹ͜ͳͯ͘͠ΕΔʯํ͕Ϣʔεέʔε͸ଟ͍
   ● ඞͣ͠΋શ෦ࣗ෼Ͱߟ͑ͯ΍ͬͯ͘Εͳͯ͘΋͍͍
   ○ Ұ౓ڭ͑ͨ͜ͱΛ֮͑ͯ͘ΕΔ
   ○ 2ճ໨Ҏ߱ʮ͋Ε΍ͬͱ͍ͯʂʯͰ΍ͬͯ͘ΕΔ
   

   View Slide

5. ࣗ཯ܕΤʔδΣϯτͷۀ຿׆༻ʹ޲͚ͯ
   ● ·ͩʮ;Θͬͱͨ͠λεΫΛ҆৺ͯ͠೚ͤΒΕΔʯ΄Ͳਫ਼౓͸ߴ͘ͳ͍
   ● ͦΕΑΓ΋ɺʮఆܕλεΫΛ࣮֬ʹ͜ͳͯ͘͠ΕΔʯํ͕Ϣʔεέʔε͸ଟ͍
   ● ඞͣ͠΋શ෦ࣗ෼Ͱߟ͑ͯ΍ͬͯ͘Εͳͯ͘΋͍͍
   ○ Ұ౓ڭ͑ͨ͜ͱΛ֮͑ͯ͘ΕΔ
   ○ 2ճ໨Ҏ߱ʮ͋Ε΍ͬͱ͍ͯʂʯͰ΍ͬͯ͘ΕΔ
   

   View Slide

6. Command Agent
   ● ϕʔε͸ langchainͷΤʔδΣϯτ࣮૷
   ○ λεΫͱπʔϧΛ༩͑ͯɺthought, action, action inputΛ܁Γฦ͠ग़ྗͤ͞Δ
   ● λεΫͱεςοϓΛςϯϓϨʔτԽ͍ͨ͠ → ม਺ͰύϥϝʔλԽ
   ● Commandͱ͍͏ΞΫγϣϯ୯Ґ (≒ ؔ਺)
   1. Ұ࿈ͷखଓ͖ΛύοέʔδԽͨ͠΋ͷ
   2. ࣄલఆٛͨ͠֎෦πʔϧ (langchainͷToolͷϥούʔ)
   ● ίϚϯυͱ࢖͏ม਺ΛܾΊΔPlannning Agentͱɺ࢖͏ม਺͔ΒίϚϯυͷೖྗΛ࡞Δ
   Command Executor
   

   View Slide

7. ྫɿ[URL]ͷ಺༰Λ[NotionDB]ʹอଘ͢Δʢϓϥϯχϯάʣ
   ● step1:
   ○ Planning Agentʮ[URL]Λ࢖ͬͯɺGetURLContentΛ࣮ߦʯ
   ○ Command ExecutorʮGetURLContent(url: [URL])ʯ
   ● step2:
   ○ Planning Agentʮ[NotionDB]Λ࢖ͬͯɺSearchNotionDatabaseΛ࣮ߦʯ
   ○ Command ExecutorʮSearchNotionDatabase(database_name: [NotionDB])ʯ
   ● step3:
   ○ Planning Agentʮ[step1.output]ͱ[step2.output]Λ࢖ͬͯɺInsertNotionPageΛ࣮ߦʯ
   ○ Command ExecutorʮInsertNotionPage(database_id: [step2.output.database_id], content: [step1.output])ʯ
   ● step 4:
   ○ Planning Agentʮ[step3.output]Λ࢖ͬͯɺReturnΛ࣮ߦʯ
   ○ Command ExecutorʮReturn(page_url: step3.output)ʯˠಈ࡞׬ྃ
   

   View Slide

8. ྫɿ[URL]ͷ಺༰Λ[NotionDB]ʹอଘ͢ΔʢίϚϯυ࣮ߦʣ
   ● step1:
   ○ Planning Agentʮ[URL]Λ࢖ͬͯɺGetURLContentΛ࣮ߦʯ
   ○ Command ExecutorʮGetURLContent(url: [URL])ʯ
   ● step2:
   ○ Planning Agentʮ[NotionDB]Λ࢖ͬͯɺSearchNotionDatabaseΛ࣮ߦʯ
   ○ Command ExecutorʮSearchNotionDatabase(database_name: [NotionDB])ʯ
   ● step3:
   ○ Planning Agentʮ[step1.output]ͱ[step2.output]Λ࢖ͬͯɺInsertNotionPageΛ࣮ߦʯ
   ○ Command ExecutorʮInsertNotionPage(database_id: [step2.output.database_id], content: [step1.output])ʯ
   ● step 4:
   ○ Planning Agentʮ[step3.output]Λ࢖ͬͯɺReturnΛ࣮ߦʯ
   ○ Command ExecutorʮReturn(page_url: step3.output)ʯˠಈ࡞׬ྃ
   

   View Slide

9. Demo
   

   View Slide

10. View Slide

11. View Slide

12. View Slide

13. View Slide

14. https://github.com/rynsuke/command-agent
    

    View Slide