Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Amazon BedrockとOpenSearch Serviceでなんでも答えられる社内RA...
Search
とすり
July 31, 2024
Technology
3
500
Amazon BedrockとOpenSearch Serviceでなんでも答えられる社内RAGを作成する!!
とすり
July 31, 2024
Tweet
Share
More Decks by とすり
See All by とすり
RAGの精度が全然上がらない!! AOSSを使った社内RAG開発の反省
tosuri13
2
170
AWS Chaliceで始める爆速サーバレスチャットボット開発!!
tosuri13
1
120
Amazon BedrockでサーバレスなAIお料理ボットを作成する!!
tosuri13
3
510
React + TextAliveでカッコいいLyric Applicatioinを作ろう!!
tosuri13
1
580
Radix UI & shadcn/uiのススメ
tosuri13
0
120
Other Decks in Technology
See All in Technology
Classmethod AI Talks(CATs) #15 司会進行スライド(2025.02.06) / classmethod-ai-talks-aka-cats_moderator-slides_vol15_2025-02-06
shinyaa31
0
110
Active Directory の保護
eurekaberry
6
3.2k
CNAPPから考えるAWSガバナンスの実践と最適化
yuobayashi
5
730
アンチパターンのアーキテクチャと組織 / Anti-Pattern Software Architecture and Organization
oztick139
0
140
Kubernetesでメールの大量配信をしている話/k8sjp-20250205
hfukamachi
0
220
Fintech SREの挑戦 PCI DSS対応をスマートにこなすインフラ戦略/Fintech SRE’s Challenge: Smart Infrastructure Strategies for PCI DSS Compliance
maaaato
0
320
The 5 Obstacles to Empowered Teams - Twice the Value in Half the Time
mdalmijn
0
200
開発者が自律的に AWS Security Hub findings に 対応する仕組みと AWS re:Invent 2024 登壇体験談 / Developers autonomously report AWS Security Hub findings Corresponding mechanism and AWS re:Invent 2024 presentation experience
kaminashi
0
110
【5分でわかる】セーフィー エンジニア向け会社紹介
safie_recruit
0
18k
ゆもつよがこの30年間自ら経験してきたQA、テストの歴史と未来
ymty
3
500
自動と手動の両輪で開発するデータクレンジング
estie
2
150
AWSエンジニアに捧ぐLangChainの歩き方
tsukuboshi
1
320
Featured
See All Featured
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
47
5.2k
Fashionably flexible responsive web design (full day workshop)
malarkey
406
66k
It's Worth the Effort
3n
184
28k
Optimising Largest Contentful Paint
csswizardry
33
3.1k
Building a Scalable Design System with Sketch
lauravandoore
460
33k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
251
21k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
Making the Leap to Tech Lead
cromwellryan
133
9.1k
KATA
mclloyd
29
14k
Unsuck your backbone
ammeep
669
57k
How to Ace a Technical Interview
jacobian
276
23k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
Transcript
Am a zon BedrockͱOpenSe a rch Service ͰͳΜͰ͑ΒΕΔࣾRAGΛ࡞͢Δ!! @tosuri13
@tosuri13 ࣗݾհ ͱ͢Γ @tosuri13 MOTEXגࣜձࣾ ॴଐ 🐧 Μ͗Μ͕͖Ͱ͢
@tosuri13 ࠔ͍ͬͯͨ͜ͱ Γ͍ͨ͜ͱ͕ॻ͔Ε͍ͯΔࢿྉΛύοͱݟ͚ͭΒΕͳ͍!! ɹˠ طଘͷRAGιϦϡʔγϣϯϑϧϚωʔδυͳAWSαʔϏεɺυΩϡϝϯ τॲཧͷॊೈੑίετ໘Ͱؾܰʹࢼͮ͠Β͍… ɹˠ ࣗͨͪͰࣾͷυΩϡϝϯτΛݕࡧͯ͠AIʹճͯ͠Β͏ಠࣗͷRAGΞ ϓϦέʔγϣϯΛ࡞Ζ͏!!
@tosuri13 RAGͱ? RAG(Retriev a l Augmented Gener a tion)ͱɺ֎෦͔Βऔಘͨ͠ճͷࢀߟͱͳ ΔใΛLLMʹࢀরͤͯ͞ճΛੜ͢Δख๏Ͱ͢ɻ
RAGΛ͏͜ͱʹΑͬͯɺLLM͕ຊདྷΓಘͳ͍ใΛิͯ͠ճΛੜͤ͞ Δ͜ͱ͕Ͱ͖ΔΑ͏ʹͳΓ·͢!! ֎෦DB LLM AIΛ༻͍ͯݕࡧ ྨࣅ͢ΔใΛ͢ औಘͨ͠ใΛ ࢀরͯ͠ճ
@tosuri13 ϕΫτϧݕࡧʹ͍ͭͯ ·ͨɺࢀߟใͱ͍ͯͨ͠͠υΩϡϝϯτΛݕࡧ͢ΔͨΊʹɺϕΫτϧݕࡧ ͱ͍͏ख๏͕RAGγεςϜͰ͘࠾༻͞Ε͍ͯ·͢ɻϕΫτϧݕࡧʹΑΓࣗવ ݴޠΛ༻͍ͨυΩϡϝϯτͷݕࡧ͕Ͱ͖ΔΑ͏ʹͳΓ·͢!! ϕΫτϧετΞ [0.8, 0.3, 0.1 …
] [0.4, 0.4, 0.3 … ] [0.5, 0.7, 0.8 … ] େྔͷυΩϡϝϯτ ࣭ [0.8, 0.3, 0.2 … ] ࣭ϕΫτϧԽͯ͠ ࣅ͍ͯΔϕΫτϧΛݕࡧ͢Δ!! υΩϡϝϯτΛϕΫτϧԽͯ͠ ྨࣅ͢ΔจষΛ୳͘͢͢͠Δ!!
ૣRAGΞϓϦέʔγϣϯΛAWSͰ࡞ͬͯΈͨ!! @tosuri13
@tosuri13 ༻͢ΔAWSαʔϏεΛϐοΫΞοϓ!! ɾAm a zon Bedrock ɹˠ ճϕΫτϧͷੜʹ༻͠·͢ɻ༻͢Δج൫ϞσϧҎԼͷ2ͭͰ͢ɻ ɹɹ- Cl
a ude 3.5 Sonnet (ճੜ༻) ɹɹ- Tit a n Text Embedding v2 (ϕΫτϧੜ༻) ɾAm a zon OpenSe a rch Service ɹˠ ϕΫτϧΛ֨ೲͯ͠ηϚϯςΟοΫݕࡧΛߦ͏ϕΫτϧετΞͱͯ͠༻͠·͢ɻ ɾAm a zon S3 ɹˠ ݩͷυΩϡϝϯτͱࣝผࢠࢀরݩURLͳͲͷϝλσʔλΛอ͠·͢ɻ
@tosuri13 RAGΞϓϦέʔγϣϯͷAWSߏਤ νϟοτΞϓϦ ཧऀ API G a tew a y
L a mbd a SNS Bedrock L a mbd a OpenSe a rch L a mbd a S3 Bedrock ճ ͷ ฦ ৴ ճͷੜ ϕΫτϧετΞ υΩϡϝϯτཧ ϕΫτϧม ॳճԠ (λΠϜΞτରࡦ) WebhookͰ࣭Λૹ৴
@tosuri13 ԿͰฉ͚ΔΑ͏ʹͳͬͨ!! ࣮ࡍͷճΛ͓ݟͤ͢Δ͜ͱͰ͖·ͤΜ͕ɺνϟοτΞϓϦΛ༻ͯ͠ҎԼͷ Α͏ͳΠϝʔδͰճͯ͠Β͏͜ͱ͕Ͱ͖ΔΑ͏ʹͳΓ·ͨ͠!! RAGΞϓϦέʔγϣϯ ࠔ͍ͬͯΔࣾһ ͜ͷAPIͬͯͲ͏͍͏Ϩεϙϯε ฦ͢Μ͚ͩͬ… ઃܭࢿྉʹΑΔͱ͜ͷΑ͏ͳεΩʔϚͷ Ϩεϙϯε͕ฦ͞ΕϚεɻ
ɹ{JSONεΩʔϚ} ɾAPIઃܭࢿྉͷURL ɾAPIઃܭ࣌ͷMTGࢿྉͳͲͷURL νϟοτͰ࣭
ࡉ͔͍࣮ͨ͠ϙΠϯτ!! @tosuri13
@tosuri13 ᶃ νϟϯΫͷׂํ๏ νϟοτΞϓϦ ཧऀ API G a L a
SNS Bedrock L a OpenSe a rch L a mbd a S3 Bedrock ճ ͷ ฦ ৴ ճͷੜ ϕΫτϧDB υΩϡϝϯτཧ ϕΫτϧม ॳճԠ (λΠϜΞτରࡦ) WebhookͰ࣭Λૹ৴
@tosuri13 ᶃ νϟϯΫͷׂํ๏ ϕΫτϧΛੜ͢ΔݩͱͳΔจࣈྻɺա͗ͯա͗ͯճͷਫ਼͕ѱԽ ͯ͠͠·͏Մೳੑ͕͋Γ·͢ɻ ɾจࣈྻ͕ա͗Δ → LLMʹஅยతͳใ͔͠༩͑ΒΕͳ͍ ɾจࣈྻ͕ա͗Δ →
ॏཁͳจ຺͕΅͚ͯ͠·͍ɺਖ਼͘͠ݕࡧ͞Εͳ͍Մೳੑ͕ߴ·Δ ɹˠ దʹυΩϡϝϯτΛνϟϯΫׂͯ͠ϕΫτϧԽ͢Δඞཁ͕͋Δ!!
@tosuri13 ᶃ νϟϯΫͷׂํ๏ ͲͷυΩϡϝϯτ౷ҰతʹM a rkdownʹมΛߦ͍ɺH1H2λά͝ͱʹׂ͢ Δ͜ͱͰɺదͳαΠζ͔ͭจ຺Λอ࣋ͨ͠ঢ়ଶͰνϟϯΫׂΛ͍ͯ͠·͢ɻ htmlɾcsvɾtxtͳͲ M a
rkdown # ேྱMTGϝϞ ## ਐḿ֬ೝ ɹ- A͞Μ: ͍͢͝ਐΜͰΔɺେৎͦ͏ ɹ- B͞Μ: શવਐΜͰͳ͍ɺࠔͬͨ… ## ࠓͷλεΫ ɹ- Xࣾͱͷଧͪ߹Θͤ ɹ- ์ஔ͞Ε͍ͯΔίϯϑϦΫτΛमਖ਼͢Δ S3͔ΒͷΠϕϯτ௨Λड͚औͬͯ M a rkdownʹม!! ҎԼͷΑ͏ͳΠϝʔδͰνϟϯΫׂ!!
@tosuri13 ᶄ Tool useʹΑΔCit a tions νϟοτΞϓϦ ཧऀ API G
a L a SNS Bedrock L a mbd a OpenSe a rch L a S3 Bedrock ճ ͷ ฦ ৴ ճͷੜ ϕΫτϧDB υΩϡϝϯτཧ ϕΫτϧม ॳճԠ (λΠϜΞτରࡦ) WebhookͰ࣭Λૹ৴
@tosuri13 ᶄ Tool useʹΑΔCit a tions ϕΫτϧݕࡧʹΑΓऔಘͨ͠υΩϡϝϯτʹɺඞͣؔ͠࿈͢ΔใͷΈؚ͕ ·Ε͍ͯΔͱݶΓ·ͤΜɻͦͷͨΊɺҾ༻ݩͱͳΔURLΛฦ͢߹࣭ͱؔ ͷͳ͍URLؚ͕·Εͯ͠·͏ͳͲ͕͋Γ·͢ɻ RAGΞϓϦέʔγϣϯ
༗څͷਃํ๏Λڭ͑ͯ!! ͍͔ͭ͘ݟ͚͖ͭͯ·γλɻ ɾ{ܦඅਃํ๏ͷURL} ɾ{༗څਃํ๏ͷURL} ɾ{ೖୀࣨਃํ๏ͷURL} ٳΈ͍ͨࣾһ ؔͷͳ͍URL ճʹؚΊͯ΄͘͠ͳ͍
@tosuri13 ᶄ Tool useʹΑΔCit a tions LLM͕ࢀߟʹͨ͠༰ͷΈΛฦ͢ϓϩϯϓτΤϯδχΞϦϯάͷख๏ΛCit a tions ͱ͍͍ɺAm
a zon BedrockͷConverse APIʹࡌ͞Ε͍ͯΔTool use (Function C a lling)Λ༻࣮ͯ͠͠·ͨ͠ɻ Ϩεϙϯεͷܗࣜઆ໌Λهࡌͨ͠ πʔϧͷεΩʔϚΛఆٛͯ͢͠ εΩʔϚ LLM ߏԽ͞Εͨঢ়ଶͰʮԿΛࢀߟʹͨ͠ͷ͔?ʯΛड͚औΕΔ!!
@tosuri13 ᶄ Tool useʹΑΔCit a tions ·ͨɺఏڙ͞ΕͨπʔϧΛ͏͔൱͔LLM͕அͯ͠ϨεϙϯεΛฦͨ͢Ίɺ ࢀߟʹͳΔใ͕શ͘ͳ͔ͬͨ߹ͳͲʹϋϧγωʔγϣϯΛ͑ΔΑ͏ͳ͜ͱ Ͱ͖·͢!! RAGΞϓϦέʔγϣϯ
৯͍͠Μͳࣾһ େࡕपลͷඒຯ͍͠ ͓Έম͖ͷ͓ళΛڭ͑ͯ!! ͋ͳͨͷΦϑΟεʹʮܦඅਃʯ ͱ͍͏໊લͷ͓Έম͖͞Μ͕ ซઃ͞Ε͍ͯΔΑ͏σεɻ ɾ{ܦඅਃํ๏ͷURL} ࢀߟใΛݩʹӕͷ༰Λ ճ͢ΔΑ͏ͳ͜ͱΛ͛Δ!!
·ͱΊ @tosuri13
@tosuri13 ·ͱΊͱײ Am a zon BedrockͱOpenSe a rchΛ͏͜ͱͰɺؾܰʹRAGΞϓϦέʔγϣϯΛ ߏங͢Δ͜ͱ͕Ͱ͖·ͨ͠!!·ͨɺಠࣗͰRAGΛ࣮͢Δ͜ͱʹΑΓɺAIγεςϜ ͷࣝؔ࿈͢ΔAWSαʔϏεͷཧղ͕ਂ·Γ·ͨ͠!!
ࢲͷLTΛฉ͍ͯRAGʹڵຯΛ࣋ͬͨํ͕͍Εɺͥͻࣗ͝Ͱ࣮ͯ͠ࢼͯ͠Έ ͯ΄͍͠ͱࢥ͍·͢!!
@tosuri13 ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠!!