Stripe Agent Toolkitを試してみた

Transcript

1. 
   
   
   
   
   
   !JOPVF
   
   Α͏͔Μ
   GSPN
   4UJQF
   
   -*/&%$ 4USJQF
   "HFOU
   5PPMLJUΛࢼͯ͠Έͨ
2. Ҫ্ཅհ
   
   Α͏͔Μ ؔ੢ͷେֶੜ
   
   -*/&
   "1*
   &YQFSU
   -*/&
   "1*Λ࢖ͬͨϓϩμΫτͷ։ൃΛओʹෳ਺ࣾͰιϑτ΢ΣΞ ΤϯδχΞͱͯ͠׆ಈத
   -*/&Yੜ੒"*αʔϏεͷ։ൃ
   ޷͖ಘҙͳ͜ͱɿ🏃
   
   🧑🍳
   
   ✈
   !JOPVF !JOPVF IUUQTUBUFLBBQQ
3. ༨ஊࠓ೔ͷ(FNJOJ
4. ࠓ೔ͷ(FNJOJ
5. ࠓ೔ͷ(FNJOJ
6. ࠓ೔ͷ(FNJOJ
7. ࠓ೔ͷ(FNJOJ ͗͢͢͝Δɺɺ
8. 4USJQF
   "HFOU
   5PPMLJUʹ͍ͭͯ஌Γ͍ͨ
   Կ͔ͱ૊Έ߹Θͤͯɺ৽͍͠ମݧΛ࡞Δ͜ͱ͕Ͱ͖ͳ͍͔໛ࡧ͍ͨ͠
   ͦͷաఔΛ௨ͯ͠஌ͬͨ஌ݟΛݴޠԽ͍ͨ͠ʂ ຊ೔ͷొஃͷ໨త
9. ຊ೔ͷొஃͷ໨త ௚ۙ
   0QFO"*
   3FBM5JNF
   "1*Λ࢖ͬͨ։ൃΛ͍ͯͨ͠ˠֻ͚߹ΘͤͯΈΑ͏ʂ 4USJQF
   "HFOU
   5PPMLJUʹ͍ͭͯ஌Γ͍ͨ
   Կ͔ͱ૊Έ߹Θͤͯɺ৽͍͠ମݧΛ࡞Δ͜ͱ͕Ͱ͖ͳ͍͔໛ࡧ͍ͨ͠
   ͦͷաఔΛ௨ͯ͠஌ͬͨ஌ݟΛݴޠԽ͍ͨ͠ʂ Ϗδωεͱ͍͏ΑΓ͸৮ͬͯΈͨܥ-5Ͱ͢
10. 4UJSQF
    "HFOU
    5PPMLJMͬͯ͝ଘ஌Ͱ͔͢ʁ
11. 4UJQF
    "HFOU
    5PPMLJUͱ͸ IUUQTHJUIVCDPNTUSJQFBHFOUUPPMLJU
12. 4UJQF
    "HFOU
    5PPMLJUͱ͸ IUUQTEPDTTUSJQFDPNBHFOUT MPDBMFKB+1
13. 4UJQF
    "HFOU
    5PPMLJUͱ͸ - 2024೥12݄11೔ʹStripe͔ΒެࣜϦϦʔε͞Εͨ΍ͭ - LLM޲͚ɺStripeͱͷ࿈ܞ͢ΔΠϯλʔϑΣʔεతͳ΍ͭ - ܾࡁURLͷ࡞੒ͱ͔ɺ঎඼ΛݟͨΓɺ - ॏྔ՝ۚͷܭଌͱ͔ɺ࢒ߴΛ࢖ͬͯࣗಈܾࡁʢ೔ຊݱࡏະରԠʣ΋Ͱ͖ΔΑ͏ʹͳΔΒ͍͠ - StripeͷॲཧΛશ෦AIʹ೚ͤΒΕΔ౔୆ͱͯ͠ϫΫϫΫ͢Δ΍ͭ IUUQTQSUJNFTKQNBJOIUNMSEQIUNM
14. 0QFO"*
    3FBMUJNF
    "1*ͱ͸ - OpenAI Realtime API͸Advanced Voice ModeͰ࢖ΘΕ͍ͯΔ΍ͭ - 2024೥10݄1೔ʹϕʔλ൛ͷAPI͕ެ։ - ։ൃऀ͕ϦΞϧλΠϜAIػೳΛࣗࣾͷΞϓϦέʔγϣϯʹ૊ΈࠐΉ͜ͱ͕ՄೳʹͳΔ - WebRTCܦ༝ͱɺWebSocketܦ༝Ͱ࣮૷͢Δ͜ͱ͕Ͱ͖Δ IUUQTQMBUGPSNPQFOBJDPNEPDTHVJEFTSFBMUJNFXFCSUDDSFBUJOHBOFQIFNFSBMUPLFO
15. 4UJSQF
    "HFOU
    5PPMLJMΛ࢖ͬͯΈͨܥͷࣄྫ͕શવͳ͍
16. ͱΓ͋͑ͣܨ͍ͰΈΑ͏ʂ
    %FNP
17. ਺࣌ؒલ·ͣ-*''ΞϓϦΛ࡞Ζ͏ $MJOFͰ͙Β͍೪ͬͨ ͔ͤͬ͘ͳͷͰ$MJOFͷEFNP΋ͯ͠Έ·͢
18. ਺࣌ؒલ·ͣ-*''ΞϓϦΛ࡞Ζ͏ - Create LIFF APP - App Router Ͱ࡞੒ - ϩʔΧϧ։ൃΛਐΊΔͨΊʹɺLIFF MockΛಋೖ IUUQTQMBUGPSNPQFOBJDPNEPDTHVJEFTSFBMUJNFXFCSUDDSFBUJOHBOFQIFNFSBMUPLFO
19. প
    DSFBUFMJGGBQQͷ"QQ3PVUFSςϯϓϨ͕σϑΥϧτͰಈ͔ͳ͍ ςϯϓϨ͕ίϯϑϦΫτͯ͠Δ
    "*͕͍͍ײ͡ʹಈ͘Α͏ʹͯ͘͠Εͨ
20. প0QFO"*ͷνϟοτͰ࢖͏5PPMͱ3FBMUJNF"1*ͷ5PPMͰܕ͕ҧ͏ $IBU 3FBMUJNF
21. প0QFO"*ͷνϟοτͰ࢖͏5PPMͱ3FBM5JNF"1*ͷ5PPMͰܕ͕ҧ͏ 
    πʔϧΛϑϥοτͳߏ଄ʹม׵͢Δؔ਺
    GVODUJPO
    fl BUUFO5PPMT UPPMT
    $IBU$PNQMFUJPO5PPM<> 
    "SSBZ\
    UZQF
    TUSJOH
    OBNF
    TUSJOH
    EFTDSJQUJPO
    TUSJOH
    QBSBNFUFST
    PCKFDU
    ^
    \
    
    
    SFUVSO
    UPPMTNBQ UPPM
    
    \
    
    
    
    
    DPOTU
    EFTDSJQUJPO
    
    UPPMGVODUJPOEFTDSJQUJPO
    cc
    
    
    
    
    
    DPOTU
    QBSBNFUFST
    
    UPPMGVODUJPOQBSBNFUFST
    cc
    \^
    
    
    
    
    SFUVSO
    \
    
    
    
    
    
    
    UZQF
    GVODUJPO
    
    
    
    
    
    
    
    
    OBNF
    UPPMGVODUJPOOBNF
    
    
    
    
    
    
    
    
    EFTDSJQUJPO
    EFTDSJQUJPO
    
    
    
    
    
    
    
    
    QBSBNFUFST
    QBSBNFUFST
    
    
    
    
    
    
    
    
    
    
    
    ^
    
    
    ^ 
    ^
    Ұ୴ϥοϓ͢Δؔ਺Λ࡞ͬͯղܾ
22. প
    8FC35$Λϑϩϯτ͔Β઀ଓ͢ΔͷͰUPPMͱͷ૬ੑ͕ѱ͍ IUUQTQMBUGPSNPQFOBJDPNEPDTHVJEFTSFBMUJNFXFCSUDDSFBUJOHBOFQIFNFSBMUPLFO
23. প
    8FC35$Λϑϩϯτ͔Β઀ଓ͢ΔͷͰUPPMͱͷ૬ੑ͕ѱ͍ - StripeͷTool͸γʔΫϨοτΩʔ͕ͳ͍ͱಈ͔ͤͳ͍ - WebRTCͷfunctioncallΛϑϩϯτͰड͚औΔ͜ͱʹͳΔ - WebScoketΛ࢖͑͹ϚγʹͳΔ͔΋͠Εͳ͍͕ɺWebScoket൛ͷ࣮૷͸Ի੠ݕ஌Λࣗ෼Ͱ࣮૷͠ͳ͍ͱߦ͚ͳ͍Ͱେม - Ұ୴ɺfunctionCallΛ࣮ߦ͢ΔAPIΛߏஙͯ͠ϑϩϯτ͔Βୟ͍͍ͯΔ
24. প
    8FC35$Λϑϩϯτ͔Β઀ଓ͢ΔͷͰUPPMͱͷ૬ੑ͕ѱ͍ - StripeͷTool͸γʔΫϨοτΩʔ͕ͳ͍ͱಈ͔ͤͳ͍ - WebRTCͷfunctioncallΛϑϩϯτͰड͚औΔ͜ͱʹͳΔ - WebScoketΛ࢖͑͹ϚγʹͳΔ͔΋͠Εͳ͍͕ɺWebScoket൛ͷ࣮૷͸Ի੠ݕ஌Λࣗ෼Ͱ࣮૷͠ͳ͍ͱߦ͚ͳ͍Ͱେม - Ұ୴ɺfunctionCallΛ࣮ߦ͢ΔAPIΛߏஙͯ͠ϑϩϯτ͔Βୟ͍͍ͯΔ
25. প
    QBZNFOU-JOLΛࣗಈൃߦ͍͕ͨ͠ͳ͔ͳ͔GVODJPO$BMM͞Εͳ͍ ίʔώʔͭͪΐ͏͍ͩ
26. প
    QBZNFOU-JOLΛࣗಈൃߦ͍͕ͨ͠ͳ͔ͳ͔GVODJPO$BMM͞Εͳ͍ ίʔώʔͭͪΐ͏͍ͩ ܾࡁϦϯΫΛ࡞੒͢ΔͨΊʹྉۚ*%Λڭ͍͑ͯͩ͘͞
27. প
    QBZNFOU-JOLΛࣗಈൃߦ͍͕ͨ͠ͳ͔ͳ͔GVODJPO$BMM͞Εͳ͍ ίʔώʔͭͪΐ͏͍ͩ ܾࡁϦϯΫΛ࡞੒͢ΔͨΊʹྉۚ*%Λڭ͍͑ͯͩ͘͞ QSPE@3X+83)RMJYDZ ஌ݟ͕ཉ͍͠ɺɺɺ
28. ຊ౰ʹ࡞Γ͔ͨͬͨ΋ͷ - LINEͰLIFFΛ։͘ - Α͏͔Μ͞Μʂࠓ೔͸ԿΛ͠·͠ΐ͏͔ʁ LINEͷ্ͰϢʔβʔΛೝࣝͯ͠ɺͦͷ্Ͱձ࿩ΛਐΊͯ͘ΕΔ - ʓʓͪΐ͏͍ͩʂɹ - ܾࡁURLΛ͓ૹΓ͠·͢Ͷ - ը໘ભҠ - աڈͷܾࡁঢ়گڭ͑ͯ͘ΕʂɹCSͷҰ࣌ରԠతͳ΋ͷ
29. ·ͱΊ - RealtimeAPIͷεϜʔζ͍͢͞͝ - ࠓ͸ׂͱStripeͷAPIΛྑ͠ͳʹܨ͍Ͱ͘ΕΔπʔϧʹऩ·͍ͬͯΔ͕ɺʢ͜Ε΋े෼͍͕͢͝ʣ - ࠓޙɺࣗಈͰܾࡁͱ͔ͯ͘͠ΕΔΑ͏ʹͳͬͨΒ·ͨ໘നͦ͏ - AIͱͷձ࿩΋͍ͩͿεϜʔζʹͳ͖͍ͬͯͯΔͷͰɺԻ੠*Stripe͸ΧελϚʔαϙʔτɺίϯγΣϧδϡతͳಈ͖ͱͯ͠΋͏গ͠໛ࡧ͍ͨ͠ - AI Agentʹ͍ͭͯͷཧղɺ஌ݟ͕΋ͬͱඞཁ ಛʹAgent toolkitܥͷϑϨʔϜϫʔΫ - ͳΜ΋Θ͔ΒΜ ׆༻ࣄྫɺΞΠσΞ͋Ε͹ͥͻޙ΄Ͳ͓࿩͠͠·͠ΐ͏ʂ😺
30. ੜ੒"*ͱ-*/&ʹ͍ͭͯ͸աڈʹ΋͍Ζ͍ΖࢿྉΛެ։͍ͯ͠·͢ IUUQTCJUMZ#PW+R IUUQTCJUMZ.*# IUUQTCJUMZFNV87
31. 
    
    
    
    
    
    !JOPVF
    
    Α͏͔Μ
    GSPN
    4UJQF
    
    -*/&%$ 4USJQF
    "HFOU
    5PPMLJUΛࢼͯ͠Έͨ