Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KARTE CraftにおけるLLM活用~Craft Functions Copilot~
Search
tik-son
October 02, 2023
Technology
1
1.8k
KARTE CraftにおけるLLM活用~Craft Functions Copilot~
Microsoftと語る LLM実装の最前線 でお話した KARTE CraftにおけるLLM活用 について
https://cto-a.connpass.com/event/292450/
tik-son
October 02, 2023
Tweet
Share
More Decks by tik-son
See All by tik-son
Microsoft の AI 技術 をベースに構成される Craft Copilot
tikson
0
490
AWS とKARTE で作る User State Driven System / user-state-driven-system-with-aws-and-karte
tikson
0
2.4k
User State Driven System with Amazon EventBridge & KARTE
tikson
1
3.8k
PLAID’s Journey with multi cloud
tikson
1
3.7k
マルチクラウドで構築する大規模解析サービス/戦略とポイントについて/
tikson
9
27k
KARTEを支えるAutoScaling~SpotInstance編
tikson
0
1.7k
Other Decks in Technology
See All in Technology
名刺メーカーDevグループ 紹介資料
sansan33
PRO
0
770
新規プロダクト開発、AIでどう変わった? #デザインエンジニアMeetup
bengo4com
0
450
Agentic DevOps時代の生存戦略
kkamegawa
0
160
開発効率と信頼性を両立する Ubieのプラットフォームエンジニアリング
teru0x1
0
140
Cloud Native Scalability for Internal Developer Platforms
hhiroshell
2
450
vLLM meetup Tokyo
jpishikawa
1
210
AIにどこまで任せる?実務で使える(かもしれない)AIエージェント設計の考え方
har1101
3
1k
CIでのgolangci-lintの実行を約90%削減した話
kazukihayase
0
220
評価の納得感を2段階高める「構造化フィードバック」
aloerina
1
160
Whats_new_in_Podman_and_CRI-O_2025-06
orimanabu
3
180
QAはソフトウェアエンジニアリングを学んで実践するのが大事なの
ymty
1
380
TerraformをSaaSで使うとAzureの運用がこんなに楽ちん!HCP Terraformって何?
mnakabayashi
0
120
Featured
See All Featured
GitHub's CSS Performance
jonrohan
1031
460k
Git: the NoSQL Database
bkeepers
PRO
430
65k
Optimising Largest Contentful Paint
csswizardry
37
3.3k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
43
2.4k
Build your cross-platform service in a week with App Engine
jlugia
231
18k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
46
9.6k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
130
19k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
The Art of Programming - Codeland 2020
erikaheidi
54
13k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.6k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
Transcript
© PLAID, Incɹ KARTE Craft LLM Craft Functions Copilot 2
023 . 0 9 . 2 8 Microsoft LLM
© PLAID, Incɹ VP of Engineering & Product, Ecosystem
2014 KARTE KARTE API Ecosystem Team 20 22 APN AWS Top Engineers 2
© PLAID, Incɹ ࠓͷ͓ Craft Functions Copilot KARTEΛ֦ு͢Δ Javascript ͷίʔυΛ
LLMΛͬͯੜΈग़ͤΔػೳ (ઈࢍ։ൃத) 3
© PLAID, Incɹ KARTE 4 CX( ) ϝΠϯϢʔβʔϚʔέλʔ 4
© PLAID, Incɹ KARTE Craft KARTE Craft KARTE ͷػೳΛ֦ு͢ΔͨΊͷ։ൃϓϥοτϑΥʔϜɻಛʹ Craft
FunctionsΛར༻͢Δͱɺ ಠࣗαʔόʔΛཱͯͳͯ͘֎෦αʔϏεͱͷϦΞϧλΠϜ࿈ܞΛ࣮ݱͰ͖Δɻ KARTEͰൃੜ͢ΔϢʔβʔͷঢ়ଶͷมԽ ɺಛఆͷεέδϡʔϧΛτϦΨʔʹɺ Craft FunctionsΛ௨ͯ͡൚༻ͳϓϩάϥϜΛ࣮ߦɻ ࣾ֎ͷ༷ʑͳγεςϜͱKARTEͷ࿈ܞΛεϜʔζʹ࣮ݱɻ 5
© PLAID, Incɹ 6
© PLAID, Incɹ 7
© PLAID, Incɹ 8
© PLAID, Incɹ 9
© PLAID, Incɹ GPT 4 ? 10
© PLAID, Incɹ 11 Craft Functions Copilot KARTEΛ֦ு͢Δ Javascript ͷίʔυΛ
LLMΛͬͯੜΈग़ͤΔػೳ (ઈࢍ։ൃத)
© PLAID, Incɹ 12 KARTE ར༻ऀ Azure OpenAI GPT4 ίʔυੜ
Λࢦࣔ Craft Functions Copilot (v 0 . 0 . 1 ) 12 GPT4Λར༻͢ΔϓϩϯϓτΛෳ༻ҙ͠ɺ Πϯϓοτࣗવݴޠೖྗͷ νϟοτΠϯλʔϑΣʔεͰ࡞
© PLAID, Incɹ KARTE API Craft - - - 13
© PLAID, Incɹ Ϧιʔε্ݶ 14 ຊ൪ఏڙʹ͓͚Δ੍ ϨΠςϯγʔ GPT-3.5 and GPT-4
API response time measurements - FYI Azure OpenAI Service ͷΫΥʔλͱ੍ݶ ίετ Azure OpenAI Service ͷՁ֨
© PLAID, Incɹ • ͯ͢ΛGPT4 + ϓϩϯϓτΤϯδχΞϦϯάͷྗٕͰղ͜͏ͱ͠ͳ͍ • λεΫΛదͳཻʹׂ͢Δ •
ׂͨ͠λεΫ͝ͱʹUIΛͨͤΔ • LLMΛ͍ͬͯΔ͔Βͱݴͬͯɺશͯࣗવݴޠೖྗ+ LLMʹ͢ߏ ͱ͠ͳ͍ ◦ ηϨΫτϘοΫεɺݕࡧɺݻఆʹର͢ΔબϘλϯͳͲɺదࡐదॴͳΠ ϯϓοτํࣜΛ༻ҙ͢Δ ຊ൪ఏڙʹ͓͚Δ੍ Λ౿·͑ͨ ઃܭͷϙΠϯτ 15
© PLAID, Incɹ 16 εςοϓΛׂ ༷ʑͳΠϯϓοτํࣜ
© PLAID, Incɹ KARTE ར༻ऀ Azure OpenAI GPT4 εςοϓ 2
Azure OpenAI Embeddings/ GPT3.5 Azure Cognitive Search Vector Search - KARTE API Metadata - Craft Functions Metadata - etc… DB - KARTE API Metadata - Craft Functions Metadata - etc… Azure OpenAI Embeddings/ GPT3.5 Azure Cognitive Search Vector Search - KARTE API Metadata - Craft Functions Metadata - etc… DB - KARTE API Metadata - Craft Functions Metadata - etc… Azure OpenAI Embeddings Azure Cognitive Search Vector Search - Craft Functions Trigger Metadata DB - Craft Functions Trigger Metadata 2. σʔλऔಘεςοϓʹ͓͚Δ ࣭/ઃఆ 1.τϦΨʔεςοϓʹ͓͚Δ ࣭/ઃఆ 3.σʔλग़ྗεςοϓʹ͓͚Δ ࣭/ઃఆ τϦΨʔεςοϓʹ͓͚Δ ઃఆσʔλ 4.ίʔυੜ Λࢦࣔ σʔλऔಘεςοϓʹ͓͚Δ ઃఆσʔλ σʔλग़ྗεςοϓʹ͓͚Δ ઃఆσʔλ ֤εςοϓͷઃఆσʔλΛར༻ͯ͠ίʔυੜ Craft Functions Copilot (v 0 . 1 . 0 ) 17
© PLAID, Incɹ • GPT4Λ༗ޮతʹར༻ͨ͠UIʹΑΓ ◦ τʔΫϯ͕60%ݮ ◦ ϨΠςϯγʔ͕65%վળ ◦
ੜ͞ΕΔίʔυͷਫ਼ ◦ Ϣʔβମݧ্ ݁Ռ / ·ͱΊ • Craft Function Copilotv0.1.0ɻײతͰͳ͍෦͕͋Δ • LLMपΓͷϓϩμΫτΛ͏·͘Έ߹ΘͤΕɺ UI/UXͬͱվળग़དྷΔ༨͋Γͦ͏ 18