Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KARTE CraftにおけるLLM活用~Craft Functions Copilot~
Search
tik-son
October 02, 2023
Technology
0
150
KARTE CraftにおけるLLM活用~Craft Functions Copilot~
Microsoftと語る LLM実装の最前線 でお話した KARTE CraftにおけるLLM活用 について
https://cto-a.connpass.com/event/292450/
tik-son
October 02, 2023
Tweet
Share
More Decks by tik-son
See All by tik-son
AWS とKARTE で作る User State Driven System / user-state-driven-system-with-aws-and-karte
tikson
0
2.1k
User State Driven System with Amazon EventBridge & KARTE
tikson
1
3.5k
PLAID’s Journey with multi cloud
tikson
1
3.3k
マルチクラウドで構築する大規模解析サービス/戦略とポイントについて/
tikson
9
27k
KARTEを支えるAutoScaling~SpotInstance編
tikson
0
1.6k
Other Decks in Technology
See All in Technology
【NW X Security JAWS#3】L3-4:AWS環境のIPv6移行に向けて知っておきたいこと
shotashiratori
1
670
AWS学習者向けにAzureの解説スライドを作成した話
handy
3
200
自己改善からチームを動かす! 「セルフエンジニアリングマネージャー」のすゝめ
shoota
6
1k
MapLibreとAmazon Location Service
dayjournal
1
190
ルーターでプレゼンする
puhitaku
1
3.3k
Max out Local LLM in Challenging Environments
sashimimochi
1
120
Cracking the KubeCon CfP
inductor
2
270
[新卒向け研修資料] テスト文字列に「うんこ」と入れるな(2024年版)
infiniteloop_inc
5
18k
コードファーストの考え方。 Amplify Gen2から学ぶAWS次世代のWeb開発体験
yoshiitaka
2
380
生成AIの変革の時代に、直近1年で直面した課題とその解決策
ktc_wada
0
700
【SORACOM UG 東海】あらゆるモノがつながる社会へ、IoT と SORACOM
soracom
PRO
1
150
よく聞くけど使ったことないソフトウェアNo.1 KafkaとSnowflake
foursue
4
520
Featured
See All Featured
VelocityConf: Rendering Performance Case Studies
addyosmani
321
23k
Web development in the modern age
philhawksworth
203
10k
For a Future-Friendly Web
brad_frost
172
9k
Happy Clients
brianwarren
92
6.4k
How GitHub Uses GitHub to Build GitHub
holman
468
290k
Testing 201, or: Great Expectations
jmmastey
30
6.4k
Bash Introduction
62gerente
605
210k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
22
1.6k
Faster Mobile Websites
deanohume
300
30k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
12
1k
Fontdeck: Realign not Redesign
paulrobertlloyd
76
4.9k
Principles of Awesome APIs and How to Build Them.
keavy
121
16k
Transcript
© PLAID, Incɹ KARTE Craft LLM Craft Functions Copilot 2
023 . 0 9 . 2 8 Microsoft LLM
© PLAID, Incɹ VP of Engineering & Product, Ecosystem
2014 KARTE KARTE API Ecosystem Team 20 22 APN AWS Top Engineers 2
© PLAID, Incɹ ࠓͷ͓ Craft Functions Copilot KARTEΛ֦ு͢Δ Javascript ͷίʔυΛ
LLMΛͬͯੜΈग़ͤΔػೳ (ઈࢍ։ൃத) 3
© PLAID, Incɹ KARTE 4 CX( ) ϝΠϯϢʔβʔϚʔέλʔ 4
© PLAID, Incɹ KARTE Craft KARTE Craft KARTE ͷػೳΛ֦ு͢ΔͨΊͷ։ൃϓϥοτϑΥʔϜɻಛʹ Craft
FunctionsΛར༻͢Δͱɺ ಠࣗαʔόʔΛཱͯͳͯ͘֎෦αʔϏεͱͷϦΞϧλΠϜ࿈ܞΛ࣮ݱͰ͖Δɻ KARTEͰൃੜ͢ΔϢʔβʔͷঢ়ଶͷมԽ ɺಛఆͷεέδϡʔϧΛτϦΨʔʹɺ Craft FunctionsΛ௨ͯ͡൚༻ͳϓϩάϥϜΛ࣮ߦɻ ࣾ֎ͷ༷ʑͳγεςϜͱKARTEͷ࿈ܞΛεϜʔζʹ࣮ݱɻ 5
© PLAID, Incɹ 6
© PLAID, Incɹ 7
© PLAID, Incɹ 8
© PLAID, Incɹ 9
© PLAID, Incɹ GPT 4 ? 10
© PLAID, Incɹ 11 Craft Functions Copilot KARTEΛ֦ு͢Δ Javascript ͷίʔυΛ
LLMΛͬͯੜΈग़ͤΔػೳ (ઈࢍ։ൃத)
© PLAID, Incɹ 12 KARTE ར༻ऀ Azure OpenAI GPT4 ίʔυੜ
Λࢦࣔ Craft Functions Copilot (v 0 . 0 . 1 ) 12 GPT4Λར༻͢ΔϓϩϯϓτΛෳ༻ҙ͠ɺ Πϯϓοτࣗવݴޠೖྗͷ νϟοτΠϯλʔϑΣʔεͰ࡞
© PLAID, Incɹ KARTE API Craft - - - 13
© PLAID, Incɹ Ϧιʔε্ݶ 14 ຊ൪ఏڙʹ͓͚Δ੍ ϨΠςϯγʔ GPT-3.5 and GPT-4
API response time measurements - FYI Azure OpenAI Service ͷΫΥʔλͱ੍ݶ ίετ Azure OpenAI Service ͷՁ֨
© PLAID, Incɹ • ͯ͢ΛGPT4 + ϓϩϯϓτΤϯδχΞϦϯάͷྗٕͰղ͜͏ͱ͠ͳ͍ • λεΫΛదͳཻʹׂ͢Δ •
ׂͨ͠λεΫ͝ͱʹUIΛͨͤΔ • LLMΛ͍ͬͯΔ͔Βͱݴͬͯɺશͯࣗવݴޠೖྗ+ LLMʹ͢ߏ ͱ͠ͳ͍ ◦ ηϨΫτϘοΫεɺݕࡧɺݻఆʹର͢ΔબϘλϯͳͲɺదࡐదॴͳΠ ϯϓοτํࣜΛ༻ҙ͢Δ ຊ൪ఏڙʹ͓͚Δ੍ Λ౿·͑ͨ ઃܭͷϙΠϯτ 15
© PLAID, Incɹ 16 εςοϓΛׂ ༷ʑͳΠϯϓοτํࣜ
© PLAID, Incɹ KARTE ར༻ऀ Azure OpenAI GPT4 εςοϓ 2
Azure OpenAI Embeddings/ GPT3.5 Azure Cognitive Search Vector Search - KARTE API Metadata - Craft Functions Metadata - etc… DB - KARTE API Metadata - Craft Functions Metadata - etc… Azure OpenAI Embeddings/ GPT3.5 Azure Cognitive Search Vector Search - KARTE API Metadata - Craft Functions Metadata - etc… DB - KARTE API Metadata - Craft Functions Metadata - etc… Azure OpenAI Embeddings Azure Cognitive Search Vector Search - Craft Functions Trigger Metadata DB - Craft Functions Trigger Metadata 2. σʔλऔಘεςοϓʹ͓͚Δ ࣭/ઃఆ 1.τϦΨʔεςοϓʹ͓͚Δ ࣭/ઃఆ 3.σʔλग़ྗεςοϓʹ͓͚Δ ࣭/ઃఆ τϦΨʔεςοϓʹ͓͚Δ ઃఆσʔλ 4.ίʔυੜ Λࢦࣔ σʔλऔಘεςοϓʹ͓͚Δ ઃఆσʔλ σʔλग़ྗεςοϓʹ͓͚Δ ઃఆσʔλ ֤εςοϓͷઃఆσʔλΛར༻ͯ͠ίʔυੜ Craft Functions Copilot (v 0 . 1 . 0 ) 17
© PLAID, Incɹ • GPT4Λ༗ޮతʹར༻ͨ͠UIʹΑΓ ◦ τʔΫϯ͕60%ݮ ◦ ϨΠςϯγʔ͕65%վળ ◦
ੜ͞ΕΔίʔυͷਫ਼ ◦ Ϣʔβମݧ্ ݁Ռ / ·ͱΊ • Craft Function Copilotv0.1.0ɻײతͰͳ͍෦͕͋Δ • LLMपΓͷϓϩμΫτΛ͏·͘Έ߹ΘͤΕɺ UI/UXͬͱվળग़དྷΔ༨͋Γͦ͏ 18