KARTE CraftにおけるLLM活用~Craft Functions Copilot~

Microsoftと語る LLM実装の最前線 でお話した KARTE CraftにおけるLLM活用 について
https://cto-a.connpass.com/event/292450/

Transcript

1. © PLAID, Incɹ KARTE Craft LLM Craft Functions Copilot 2 023 . 0 9 . 2 8 Microsoft LLM
2. © PLAID, Incɹ 
 VP of Engineering & Product, Ecosystem 2014 KARTE KARTE API Ecosystem Team 20 22 APN AWS Top Engineers 2
3. © PLAID, Incɹ ࠓ೔ͷ͓࿩ Craft Functions Copilot KARTEΛ֦ு͢Δ Javascript ͷίʔυΛ LLMΛ࢖ͬͯੜΈग़ͤΔػೳ (ઈࢍ։ൃத) 3
4. © PLAID, Incɹ KARTE 4 CX( ) ϝΠϯϢʔβʔ͸Ϛʔέλʔ 4
5. © PLAID, Incɹ KARTE Craft KARTE Craft
 KARTE ͷػೳΛ֦ு͢ΔͨΊͷ։ൃϓϥοτϑΥʔϜɻಛʹ Craft FunctionsΛར༻͢Δͱɺ
 ಠࣗαʔόʔΛཱͯͳͯ͘΋֎෦αʔϏεͱͷϦΞϧλΠϜ࿈ܞΛ࣮ݱͰ͖Δɻ KARTE಺Ͱൃੜ͢ΔϢʔβʔͷঢ়ଶͷมԽ ΍ɺಛఆͷεέδϡʔϧΛτϦΨʔʹɺ Craft FunctionsΛ௨ͯ͡൚༻ͳϓϩάϥϜΛ࣮ߦɻ
 ࣾ಺֎ͷ༷ʑͳγεςϜͱKARTEͷ࿈ܞΛεϜʔζʹ࣮ݱɻ 5
6. © PLAID, Incɹ 6
7. © PLAID, Incɹ 7
8. © PLAID, Incɹ 8
9. © PLAID, Incɹ 9
10. © PLAID, Incɹ GPT 4 ? 10
11. © PLAID, Incɹ 11 Craft Functions Copilot KARTEΛ֦ு͢Δ Javascript ͷίʔυΛ LLMΛ࢖ͬͯੜΈग़ͤΔػೳ (ઈࢍ։ൃத)
12. © PLAID, Incɹ 12 KARTE ར༻ऀ Azure OpenAI GPT4 ίʔυੜ੒ Λࢦࣔ Craft Functions Copilot (v 0 . 0 . 1 ) 12 GPT4Λར༻͢ΔϓϩϯϓτΛෳ਺༻ҙ͠ɺ Πϯϓοτ͸ࣗવݴޠೖྗͷ νϟοτΠϯλʔϑΣʔεͰ࡞੒
13. © PLAID, Incɹ KARTE API Craft - - - 13
14. © PLAID, Incɹ Ϧιʔε্ݶ 14 ຊ൪ఏڙʹ͓͚Δ੍໿ ϨΠςϯγʔ GPT-3.5 and GPT-4 API response time measurements - FYI Azure OpenAI Service ͷΫΥʔλͱ੍ݶ ίετ Azure OpenAI Service ͷՁ֨
15. © PLAID, Incɹ • ͢΂ͯΛGPT4 + ϓϩϯϓτΤϯδχΞϦϯάͷྗٕͰղ͜͏ͱ͠ͳ͍ • λεΫΛద੾ͳཻ౓ʹ෼ׂ͢Δ • ෼ׂͨ͠λεΫ͝ͱʹUIΛ΋ͨͤΔ • LLMΛ࢖͍ͬͯΔ͔Βͱݴͬͯɺશͯࣗવݴޠೖྗ+ LLMʹ౉͢ߏ଄ ͱ͠ͳ͍ ◦ ηϨΫτϘοΫεɺݕࡧɺݻఆ஋ʹର͢Δબ୒ϘλϯͳͲɺదࡐదॴͳΠ ϯϓοτํࣜΛ༻ҙ͢Δ ຊ൪ఏڙʹ͓͚Δ੍໿ Λ౿·͑ͨ ઃܭͷϙΠϯτ 15
16. © PLAID, Incɹ 16 εςοϓΛ෼ׂ ༷ʑͳΠϯϓοτํࣜ
17. © PLAID, Incɹ KARTE ར༻ऀ Azure OpenAI GPT4 εςοϓ 2 Azure OpenAI Embeddings/ GPT3.5 Azure Cognitive Search Vector Search - KARTE API Metadata - Craft Functions Metadata - etc… DB - KARTE API Metadata - Craft Functions Metadata - etc… Azure OpenAI Embeddings/ GPT3.5 Azure Cognitive Search Vector Search - KARTE API Metadata - Craft Functions Metadata - etc… DB - KARTE API Metadata - Craft Functions Metadata - etc… Azure OpenAI Embeddings Azure Cognitive Search Vector Search - Craft Functions Trigger Metadata DB - Craft Functions Trigger Metadata 2. σʔλऔಘεςοϓʹ͓͚Δ ࣭໰/ઃఆ 1.τϦΨʔεςοϓʹ͓͚Δ ࣭໰/ઃఆ 3.σʔλग़ྗεςοϓʹ͓͚Δ ࣭໰/ઃఆ τϦΨʔεςοϓʹ͓͚Δ ઃఆσʔλ 4.ίʔυੜ੒ Λࢦࣔ σʔλऔಘεςοϓʹ͓͚Δ ઃఆσʔλ σʔλग़ྗεςοϓʹ͓͚Δ ઃఆσʔλ ֤εςοϓͷઃఆσʔλΛར༻ͯ͠ίʔυੜ੒ Craft Functions Copilot (v 0 . 1 . 0 ) 17
18. © PLAID, Incɹ • GPT4Λ༗ޮతʹར༻ͨ͠UIʹΑΓ ◦ τʔΫϯ਺͕໿60%ݮ ◦ ϨΠςϯγʔ͕໿65%վળ ◦ ੜ੒͞ΕΔίʔυͷਫ਼౓޲ ◦ Ϣʔβମݧ΋޲্ ݁Ռ / ·ͱΊ • Craft Function Copilot͸v0.1.0ɻ௚ײతͰ͸ͳ͍෦෼͕͋Δ • LLMपΓͷϓϩμΫτΛ͏·͘૊Έ߹ΘͤΕ͹ɺ UI/UX΋΋ͬͱվળग़དྷΔ༨஍͸͋Γͦ͏ 18