Stripe Agent Toolkitを試してみた

Slide 1

Slide 1 text

!JOPVFΑ͏͔ΜGSPN4UJQF-*/&%$ 4USJQF"HFOU5PPMLJUΛࢼͯ͠Έͨ

Slide 2

Slide 2 text

Ҫ্ཅհΑ͏͔Μ ؔ੢ͷେֶੜ-*/&"1*&YQFSU -*/&"1*Λ࢖ͬͨϓϩμΫτͷ։ൃΛओʹෳ਺ࣾͰιϑτ΢ΣΞ ΤϯδχΞͱͯ͠׆ಈத -*/&Yੜ੒"*αʔϏεͷ։ൃ ޷͖ಘҙͳ͜ͱɿ🏃🧑🍳✈ !JOPVF !JOPVF IUUQTUBUFLBBQQ

Slide 3

Slide 3 text

༨ஊࠓ೔ͷ(FNJOJ

Slide 4

Slide 4 text

ࠓ೔ͷ(FNJOJ

Slide 5

Slide 5 text

ࠓ೔ͷ(FNJOJ

Slide 6

Slide 6 text

ࠓ೔ͷ(FNJOJ

Slide 7

Slide 7 text

ࠓ೔ͷ(FNJOJ ͗͢͢͝Δɺɺ

Slide 8

Slide 8 text

4USJQF"HFOU5PPMLJUʹ͍ͭͯ஌Γ͍ͨ Կ͔ͱ૊Έ߹Θͤͯɺ৽͍͠ମݧΛ࡞Δ͜ͱ͕Ͱ͖ͳ͍͔໛ࡧ͍ͨ͠ ͦͷաఔΛ௨ͯ͠஌ͬͨ஌ݟΛݴޠԽ͍ͨ͠ʂ ຊ೔ͷొஃͷ໨త

Slide 9

Slide 9 text

ຊ೔ͷొஃͷ໨త ௚ۙ0QFO"*3FBM5JNF"1*Λ࢖ͬͨ։ൃΛ͍ͯͨ͠ˠֻ͚߹ΘͤͯΈΑ͏ʂ 4USJQF"HFOU5PPMLJUʹ͍ͭͯ஌Γ͍ͨ Կ͔ͱ૊Έ߹Θͤͯɺ৽͍͠ମݧΛ࡞Δ͜ͱ͕Ͱ͖ͳ͍͔໛ࡧ͍ͨ͠ ͦͷաఔΛ௨ͯ͠஌ͬͨ஌ݟΛݴޠԽ͍ͨ͠ʂ Ϗδωεͱ͍͏ΑΓ͸৮ͬͯΈͨܥ-5Ͱ͢

Slide 10

Slide 10 text

4UJSQF"HFOU5PPMLJMͬͯ͝ଘ஌Ͱ͔͢ʁ

Slide 11

Slide 11 text

4UJQF"HFOU5PPMLJUͱ͸ IUUQTHJUIVCDPNTUSJQFBHFOUUPPMLJU

Slide 12

Slide 12 text

4UJQF"HFOU5PPMLJUͱ͸ IUUQTEPDTTUSJQFDPNBHFOUT MPDBMFKB+1

Slide 13

Slide 13 text

4UJQF"HFOU5PPMLJUͱ͸ - 2024೥12݄11೔ʹStripe͔ΒެࣜϦϦʔε͞Εͨ΍ͭ - LLM޲͚ɺStripeͱͷ࿈ܞ͢ΔΠϯλʔϑΣʔεతͳ΍ͭ - ܾࡁURLͷ࡞੒ͱ͔ɺ঎඼ΛݟͨΓɺ - ॏྔ՝ۚͷܭଌͱ͔ɺ࢒ߴΛ࢖ͬͯࣗಈܾࡁʢ೔ຊݱࡏະରԠʣ΋Ͱ͖ΔΑ͏ʹͳΔΒ͍͠ - StripeͷॲཧΛશ෦AIʹ೚ͤΒΕΔ౔୆ͱͯ͠ϫΫϫΫ͢Δ΍ͭ IUUQTQSUJNFTKQNBJOIUNMSEQIUNM

Slide 14

Slide 14 text

0QFO"*3FBMUJNF"1*ͱ͸ - OpenAI Realtime API͸Advanced Voice ModeͰ࢖ΘΕ͍ͯΔ΍ͭ - 2024೥10݄1೔ʹϕʔλ൛ͷAPI͕ެ։ - ։ൃऀ͕ϦΞϧλΠϜAIػೳΛࣗࣾͷΞϓϦέʔγϣϯʹ૊ΈࠐΉ͜ͱ͕ՄೳʹͳΔ - WebRTCܦ༝ͱɺWebSocketܦ༝Ͱ࣮૷͢Δ͜ͱ͕Ͱ͖Δ IUUQTQMBUGPSNPQFOBJDPNEPDTHVJEFTSFBMUJNFXFCSUDDSFBUJOHBOFQIFNFSBMUPLFO

Slide 15

Slide 15 text

4UJSQF"HFOU5PPMLJMΛ࢖ͬͯΈͨܥͷࣄྫ͕શવͳ͍

Slide 16

Slide 16 text

ͱΓ͋͑ͣܨ͍ͰΈΑ͏ʂ %FNP

Slide 17

Slide 17 text

਺࣌ؒલ·ͣ-*''ΞϓϦΛ࡞Ζ͏ $MJOFͰ͙Β͍೪ͬͨ ͔ͤͬ͘ͳͷͰ$MJOFͷEFNP΋ͯ͠Έ·͢

Slide 18

Slide 18 text

਺࣌ؒલ·ͣ-*''ΞϓϦΛ࡞Ζ͏ - Create LIFF APP - App Router Ͱ࡞੒ - ϩʔΧϧ։ൃΛਐΊΔͨΊʹɺLIFF MockΛಋೖ IUUQTQMBUGPSNPQFOBJDPNEPDTHVJEFTSFBMUJNFXFCSUDDSFBUJOHBOFQIFNFSBMUPLFO

Slide 19

Slide 19 text

পDSFBUFMJGGBQQͷ"QQ3PVUFSςϯϓϨ͕σϑΥϧτͰಈ͔ͳ͍ ςϯϓϨ͕ίϯϑϦΫτͯ͠Δ "*͕͍͍ײ͡ʹಈ͘Α͏ʹͯ͘͠Εͨ

Slide 20

Slide 20 text

প0QFO"*ͷνϟοτͰ࢖͏5PPMͱ3FBMUJNF"1*ͷ5PPMͰܕ͕ҧ͏ $IBU 3FBMUJNF

Slide 21

Slide 21 text

প0QFO"*ͷνϟοτͰ࢖͏5PPMͱ3FBM5JNF"1*ͷ5PPMͰܕ͕ҧ͏ πʔϧΛϑϥοτͳߏ଄ʹม׵͢Δؔ਺ GVODUJPO fl BUUFO5PPMT UPPMT$IBU$PNQMFUJPO5PPM<> "SSBZ\UZQFTUSJOH OBNFTUSJOH EFTDSJQUJPOTUSJOH QBSBNFUFST PCKFDU^\ SFUVSOUPPMTNBQ UPPM \ DPOTUEFTDSJQUJPOUPPMGVODUJPOEFTDSJQUJPOcc DPOTUQBSBNFUFSTUPPMGVODUJPOQBSBNFUFSTcc\^ SFUVSO\ UZQFGVODUJPO OBNFUPPMGVODUJPOOBNF EFTDSJQUJPOEFTDSJQUJPO QBSBNFUFSTQBSBNFUFST ^ ^ ^ Ұ୴ϥοϓ͢Δؔ਺Λ࡞ͬͯղܾ

Slide 22

Slide 22 text

প8FC35$Λϑϩϯτ͔Β઀ଓ͢ΔͷͰUPPMͱͷ૬ੑ͕ѱ͍ IUUQTQMBUGPSNPQFOBJDPNEPDTHVJEFTSFBMUJNFXFCSUDDSFBUJOHBOFQIFNFSBMUPLFO

Slide 23

Slide 23 text

প8FC35$Λϑϩϯτ͔Β઀ଓ͢ΔͷͰUPPMͱͷ૬ੑ͕ѱ͍ - StripeͷTool͸γʔΫϨοτΩʔ͕ͳ͍ͱಈ͔ͤͳ͍ - WebRTCͷfunctioncallΛϑϩϯτͰड͚औΔ͜ͱʹͳΔ - WebScoketΛ࢖͑͹ϚγʹͳΔ͔΋͠Εͳ͍͕ɺWebScoket൛ͷ࣮૷͸Ի੠ݕ஌Λࣗ෼Ͱ࣮૷͠ͳ͍ͱߦ͚ͳ͍Ͱେม - Ұ୴ɺfunctionCallΛ࣮ߦ͢ΔAPIΛߏஙͯ͠ϑϩϯτ͔Βୟ͍͍ͯΔ

Slide 24

Slide 24 text

Slide 25

Slide 25 text

পQBZNFOU-JOLΛࣗಈൃߦ͍͕ͨ͠ͳ͔ͳ͔GVODJPO$BMM͞Εͳ͍ ίʔώʔͭͪΐ͏͍ͩ

Slide 26

Slide 26 text

পQBZNFOU-JOLΛࣗಈൃߦ͍͕ͨ͠ͳ͔ͳ͔GVODJPO$BMM͞Εͳ͍ ίʔώʔͭͪΐ͏͍ͩ ܾࡁϦϯΫΛ࡞੒͢ΔͨΊʹྉۚ*%Λڭ͍͑ͯͩ͘͞

Slide 27

Slide 27 text

পQBZNFOU-JOLΛࣗಈൃߦ͍͕ͨ͠ͳ͔ͳ͔GVODJPO$BMM͞Εͳ͍ ίʔώʔͭͪΐ͏͍ͩ ܾࡁϦϯΫΛ࡞੒͢ΔͨΊʹྉۚ*%Λڭ͍͑ͯͩ͘͞ QSPE@3X+83)RMJYDZ ஌ݟ͕ཉ͍͠ɺɺɺ

Slide 28

Slide 28 text

ຊ౰ʹ࡞Γ͔ͨͬͨ΋ͷ - LINEͰLIFFΛ։͘ - Α͏͔Μ͞Μʂࠓ೔͸ԿΛ͠·͠ΐ͏͔ʁ LINEͷ্ͰϢʔβʔΛೝࣝͯ͠ɺͦͷ্Ͱձ࿩ΛਐΊͯ͘ΕΔ - ʓʓͪΐ͏͍ͩʂɹ - ܾࡁURLΛ͓ૹΓ͠·͢Ͷ - ը໘ભҠ - աڈͷܾࡁঢ়گڭ͑ͯ͘ΕʂɹCSͷҰ࣌ରԠతͳ΋ͷ

Slide 29

Slide 29 text

·ͱΊ - RealtimeAPIͷεϜʔζ͍͢͞͝ - ࠓ͸ׂͱStripeͷAPIΛྑ͠ͳʹܨ͍Ͱ͘ΕΔπʔϧʹऩ·͍ͬͯΔ͕ɺʢ͜Ε΋े෼͍͕͢͝ʣ - ࠓޙɺࣗಈͰܾࡁͱ͔ͯ͘͠ΕΔΑ͏ʹͳͬͨΒ·ͨ໘നͦ͏ - AIͱͷձ࿩΋͍ͩͿεϜʔζʹͳ͖͍ͬͯͯΔͷͰɺԻ੠*Stripe͸ΧελϚʔαϙʔτɺίϯγΣϧδϡతͳಈ͖ͱͯ͠΋͏গ͠໛ࡧ͍ͨ͠ - AI Agentʹ͍ͭͯͷཧղɺ஌ݟ͕΋ͬͱඞཁ ಛʹAgent toolkitܥͷϑϨʔϜϫʔΫ - ͳΜ΋Θ͔ΒΜ ׆༻ࣄྫɺΞΠσΞ͋Ε͹ͥͻޙ΄Ͳ͓࿩͠͠·͠ΐ͏ʂ😺

Slide 30

Slide 30 text

ੜ੒"*ͱ-*/&ʹ͍ͭͯ͸աڈʹ΋͍Ζ͍ΖࢿྉΛެ։͍ͯ͠·͢ IUUQTCJUMZ#PW+R IUUQTCJUMZ.*# IUUQTCJUMZFNV87

Slide 31

Slide 31 text

!JOPVFΑ͏͔ΜGSPN4UJQF-*/&%$ 4USJQF"HFOU5PPMLJUΛࢼͯ͠Έͨ