RAGの精度が全然上がらない!! AOSSを使った社内RAG開発の反省

1. RAGͷਫ਼౓͕શવ্͕Βͳ͍!! AOSSΛ࢖ͬͨࣾ಺RAG։ൃͷ൓ল 2024.12.13 JAWS-UG ਆށ #3 ೥๨ΕେLTେձ @tosuri13
2. ͱ͢Γ @tosuri13 MOTEXגࣜձࣾ ࡶ༻ܥΤϯδχΞ(ࣗশ) Stor a ge Browser for Am a zon S3Λ Amplifyൈ͖Ͱ࢖͑ͳ͍͔໛ࡧதͰ͢🥺
3. ࣾ಺จॻΛѻ͑ΔRAGγεςϜΛAWSͰ։ൃɾӡ༻த… RAGͷਫ਼౓޲্ʹେۤઓ!! ՝୊΍൓লϙΠϯτʹ͍ͭͯ࿩͍ͨ͠ͱࢥ͍·͢ ↑ ࠓ೥7݄ͷBedrock Night in େࡕͰ΋࿩ͨ͠RAGγεςϜͰ͢☺
4. ͬ͘͟Γݱঢ়ͷAWSߏ੒ਤ
5. RAGͷਫ਼౓͕શવ্͕Βͳ͍!!
6. AOSSʹυΩϡϝϯτΛେྔ౤ೖͯ͠ӡ༻։࢝!! → ͔͠͠ظ଴͢Δճ౴͕શવฦͬͯ͜ͳ͍!! ݪҼΛ୳Δ͜ͱʹ… ͜ͷػೳ͕௥Ճ͞Εͨͷͬͯ Ͳͷόʔδϣϯ͔Β? ͹ͳͳ ஌Βͳ͍Ͱ͢ ࣾ಺RAGϘοτ
7. RAGʹ͓͍ͯҰ൪ॏཁͳϑΣʔζ͸Ͳ͔͜? https:// a ws. a m a zon.com/jp/blogs/news/ a -pr a ctic a l-guide-to-improve-r a g-systems-with- a dv a nced-r a g-on- a ws ΑΓҾ༻
8. https:// a ws. a m a zon.com/jp/blogs/news/ a -pr a ctic a l-guide-to-improve-r a g-systems-with- a dv a nced-r a g-on- a ws ΑΓҾ༻ Ұൠతʹ͸RetrieveॲཧͩͱݴΘΕ͍ͯΔ (ແؔ܎ͳσʔλΛ౉ͯ͠͠·͏ͱɺͲΕ͚ͩ׬ᘳͳLLMͰ΋ద੾ͳճ౴͕Ͱ͖ͳ͍ͨΊ)
9. ͦͷͨΊɺRetrieveॲཧΛ࠷దԽ͢ΔΑ͏ʹ ༷ʑͳΞϓϩʔνͰ࣮ݧɺௐࠪΛॏͶΔ… Am a zon BedrockͷຒΊࠐΈϞσϧΛม͑ͯΈͨΓ… (EmbeddingҎ֎ʹ΋ϝλσʔλΛೖΕͨΓ) AOSSͷANNϥΠϒϥϦΛม͑ͨΓ HNSWͷύϥϝʔλΛ͍͔͍ͭͬͯ͘͡ΈͨΓ… F a iss͔nmslib͔…
10. ͦͷͨΊɺRetrieveॲཧΛ࠷దԽ͢ΔΑ͏ʹ ༷ʑͳΞϓϩʔνͰ࣮ݧɺௐࠪΛॏͶΔ… Am a zon BedrockͷຒΊࠐΈϞσϧΛม͑ͯΈͨΓ… (EmbeddingҎ֎ʹ΋ϝλσʔλΛೖΕͨΓ) AOSSͷANNϥΠϒϥϦΛม͑ͨΓ HNSWͷύϥϝʔλΛ͍͔͍ͭͬͯ͘͡ΈͨΓ… F a iss͔nmslib͔… …͕!! ճ౴͸શવվળ͞Εͳ͍!!
11. ճ౴ͷ඼࣭௿ԼΛট͍͍ͯͨຊ౰ͷݪҼ͸… https:// a ws. a m a zon.com/jp/blogs/news/ a -pr a ctic a l-guide-to-improve-r a g-systems-with- a dv a nced-r a g-on- a ws ΑΓҾ༻
12. ͩͬͨ͜͜!! https:// a ws. a m a zon.com/jp/blogs/news/ a -pr a ctic a l-guide-to-improve-r a g-systems-with- a dv a nced-r a g-on- a ws ΑΓҾ༻
13. ݪҼௐࠪΛਐΊΔ্Ͱ෼͔ͬͨͷ͸… ʮͦ΋ͦ΋ͷυΩϡϝϯτ͕͓͔͍͠!!ʯͱ͍͏͜ͱ ֦ுࢠͱ࣮ࡍͷத਎͕ Կނ͔ҧ͏ϑΝΠϧ ΫΫΫ… ↑ mdʹٖଶ͢Δxml ωਃExcelͷଘࡏ (ҳ୤ͨ͠࢖͍ํͷExcelγʔτ) ແҙຯͳ৘ใͰ ຒΊਚ͘͞ΕͨHTML ϦϯΫେྔʹ࣋ͬͯ·͢
14. ݪҼௐࠪΛਐΊΔ্Ͱ෼͔ͬͨͷ͸… ʮͦ΋ͦ΋ͷυΩϡϝϯτ͕͓͔͍͠!!ʯͱ͍͏͜ͱ ֦ுࢠͱ࣮ࡍͷத਎͕ Կނ͔ҧ͏ϑΝΠϧ ΫΫΫ… ↑ mdʹٖଶ͢Δxml ωਃExcelͷଘࡏ (ҳ୤ͨ͠࢖͍ํͷExcelγʔτ) ແҙຯͳ৘ใͰ ຒΊਚ͘͞ΕͨHTML ϦϯΫେྔʹ࣋ͬͯ·͢ ݕࡧͷϊΠζʹͳΓɺద੾ͳσʔλΛ ఏڙͰ͖ͳ͘ͳ͍ͬͯΔ!!
15. લॲཧ + νϟϯΩϯάΛ؁͘ݟ͍ͯͨͷ͕ݪҼ!! (L a ngCh a inඋ͑෇͚ͷϩʔμʔʹॲཧΛؙ೚͍ͤͯͨ͠΋ѱ͔ͬͨ…) ݕূ࣌ ࣮ӡ༻࣌ ͋Δఔ౓៉ྷͳυΩϡϝϯτΛ ࢖ͬͯݕূͨͨ͠Ί໰୊ʹؾ෇͚ͣ… શવେৎ෉ͩͳ!! ࣮ࡍͷυΩϡϝϯτ͸ۄੴࠞަঢ়ଶ!! اۀͷ࣮ଶʹԊͬͨॲཧΛ૊Ήඞཁ͕͋Δ
16. ֤υΩϡϝϯτͱਅ݋ʹ޲͖߹͍ ͦΕͧΕ࠷దͳܗͰม׵͍ͯ͘͠ॲཧΛߦͳͬͨ ࣄલʹυΩϡϝϯτΛ֬ೝ͠ ѻ͑ͳ͍΋ͷ͸ೖΕͳ͍ த਎XML͡ΌΜ!! ωਃ͔Β࢖͑Δ෦෼Λநग़ LLMͰཁ໿ͯ͠Ϩίʔυܗࣜʹ BS4Ͱղੳͯ͠ ෆཁͳλάΛΫϦʔχϯά
17. ͢Δͱɺಛʹߏ੒΍ઃఆ͸มΘ͍ͬͯͳ͍ͷʹ ظ଴͢Δճ౴͕໯͑ΔΑ͏ʹͳͬͨ!! ͜ͷػೳ͕௥Ճ͞Εͨͷͬͯ Ͳͷόʔδϣϯ͔Β? όʔδϣϯX.X͔ΒͰ͢ ࣾ಺RAGϘοτ ͍͍ײ͡ͷػೳ͕૿͑·ͨ͠
19. ·ͱΊ
20. ɾAIٕज़ཁૉʹਅ݋ʹ޲͖߹͓͏!! ɾRAGΛݕ౼͢ΔલʹυΩϡϝϯτ੔ཧΛ!! → ͦ΋ͦ΋RAGΛ࢖Θͣͱ΋ɺ͙͢ʹυΩϡϝϯτΛݟ͚ͭΒΕΔঢ়ଶ͕๬·͍͠Ͱ͢ → ීஈ͔Β៉ྷͳυΩϡϝϯτΛॻ͖·͠ΐ͏!! → લॲཧΛͤͣʹద౰ʹಥͬࠐΉͱμϝͩͱ͍͏ͷ͕Α͘෼͔Γ·ͨ͠ → طଘͷAIαʔϏε೚ͤͰ͸ͳ͘ɺటषͯ͘΋͍͍ͷͰਅ݋ʹ޲͖߹͏͜ͱ͕େࣄͰͨ͠
21. Th a nk you for listening!! @tosuri13 ← Α͔ͬͨΒTwitterϑΥϩʔͯ͠Ͷ