Tweet
Tweet

Slide 1

Slide 1 text

© PLAID, Incɹ Microsoft AI Craft Copilot 2 024 . 0 7 . 2 5 Azure OpenAI Service Dev Day

Slide 2

Slide 2 text

© PLAID, Incɹ 竹 　 行 VP of Engineering & Product, Ecosystem 2014 KARTE 用 PaaS KARTE Craft 心 PLAID Ecosystem 20 22 APN AWS Top Engineers 支 士 2

Slide 3

Slide 3 text

© PLAID, Incɹ Craft Copilot Craft Copilot ? 3

Slide 4

Slide 4 text

© PLAID, Incɹ Craft Copilot 4 KARTE Craft (PaaS) Ͱͷ ։ൃࢧԉΛͯ͘͠ΕΔ AI Ξγελϯτ ݱࡏ͸ Beta ൛ͱͯ͠ఏڙத

Slide 5

Slide 5 text

© PLAID, Incɹ KARTE Craft KARTE Craft ? 5

Slide 6

Slide 6 text

© PLAID, Incɹ KARTE Craft 6 KARTE ͷ֦ு͔ΒಠࣗͷΞϓϦέʔγϣϯ·Ͱɺ ΧελϚʔσʔλυϦϒϯͳػೳΛ։ൃͰ͖ΔPaaS

Slide 7

Slide 7 text

© PLAID, Incɹ KARTE Craft 7 https://solution.karte.io/tags/craft-functions/

Slide 8

Slide 8 text

© PLAID, Incɹ Craft Copilot Craft Copilot ͸۩ମతʹԿΛͯ͘͠Ε Δ ? 8

Slide 9

Slide 9 text

© PLAID, Incɹ Craft Copilot 9 https://solution.karte.io/blog/2024/07/generate-html-with-sites-copilot/

Slide 10

Slide 10 text

© PLAID, Incɹ Craft Copilot 10

Slide 11

Slide 11 text

© PLAID, Incɹ Craft Copilot ͷཪଆ Craft Copilot ͷཪଆ 11

Slide 12

Slide 12 text

© PLAID, Incɹ Craft Copilot ͷཪଆ 12 ίʔυվળͷཪଆ HTMLੜ੒ͷཪଆ

Slide 13

Slide 13 text

© PLAID, Incɹ HTMLੜ੒ͷཪଆ HTMLੜ੒ 13 ը૾Λೖྗ͢Δͱɺ Craft Sites Ͱར༻Ͱ͖ΔHTMLΛੜ੒͢Δػೳ

Slide 14

Slide 14 text

© PLAID, Incɹ HTMLੜ੒ͷཪଆ 14

Slide 15

Slide 15 text

© PLAID, Incɹ GPT-4o ● ࠷ऴతͳHTMLϑΝΠϧͷੜ੒ ● HTMLͷੜ੒ਫ਼౓Λ͋͛ΔͨΊʹɺ ○ System messageͰٕज़ελοΫ΍ϑϨʔϜΛࢦఆ ○ Few shot ͰγϯϓϧͳHTMLੜ੒ͷྫ ● Stream Completion Λ࢖ͬͯɺମݧͷ޲্ ○ 15 sec -> 4 Sec GPT-4o mini ● ޙଓͷHTMLੜ੒ͷॲཧͰ࢖͍΍͍͢Α͏ʹɺςΩετͳͲΛ੔ཧ ● JSON Mode Ͱޙଓʹ౉͠΍͍͢σʔλߏ଄Ͱग़ྗ શମ ● جຊతʹɺMicrosoft ެ։ͷʮϓϩϯϓτ ΤϯδχΞϦϯάͷख๏ʯʹै͏ ● λεΫΛ෼ׂ͢Δ͜ͱͰޮ཰తͳϞσϧ/ϓϩϯϓτͷ࢖͍ํΛ͢Δ ● ϞσϧͷਐԽΛظ଴ͯ͠ɺϓϩϯϓτɺϑϩʔΛ࡞ΓࠐΈ͗͢ͳ͍ ○ աڈʹGPT3.5 turboͰؤு͍ͬͯͨػೳ͕ҰॠͰࡴ͞Εͨ HTMLੜ੒ͷཪଆ (Azure Open AI Service) 15

Slide 16

Slide 16 text

© PLAID, Incɹ ͳͥ AOAI ͷ GPT-4o ͔? 16 ● AI ͷτοϓϥϯφʔͰ͋Δ OpenAI ͷϞσϧ ● ։ൃணखͷλΠϛϯάͰɺ֎෦ͷධՁ + ࣗ෼ͨͪͰ৮ͬͯΈͨධՁ ○ ϕϯμʔ͕ग़͢score͸৴͡ͳ͍ͱ͍͏ελϯε ○ શମతͳύϑΥʔϚϯε͕Α͍Ϟσϧ ○ ೔ຊޠͷύϑΥʔϚϯε͕Α͍Ϟσϧ ● αϙʔτମ੍ͷ҆ఆײ ○ Microsoft Japanͷ҆ఆײ ○ Azure AOAI ͷαϙʔτͷ҆ఆײ ● API ͷ҆ఆੑ ○ Ϟσϧͱͯ͠ͷύϑΥʔϚϯε͸ྑ͍͕ɺAPIͱͯ͠͸ෆ҆ఆ ͰɺΤϥʔ͕ى͜Γ΍͍͢Ϟσϧ΋͋Δ Chatbot Arena leaderBoard(As of July 23, 2024): https://chat.lmsys.org/?leaderboard

Slide 17

Slide 17 text

© PLAID, Incɹ HTMLੜ੒ͷཪଆ (Azure API Management) 17 Մ༻ੑɺΩϟύγςΟɺϝϯςφϏϦςΟͷ޲্Λ໨తʹར༻ Introducing GenAI Gateway Capabilities in Azure API Management Backend Pool - AOAIͷϦιʔε͝ͱʹ࡞੒͞ΕͨBackend͕ඥ͚ͮΔ - priorityɺweight Λࢦఆͯ͠ɺॊೈʹίϯτϩʔϧ - (࠷ۙGAʹͳͬͨͷͰTerraform͸ະରԠ) αʔΩοτϒϨʔΧʔ - { failure Condition: { count: 1 interval: 'PT10S' statusCodeRanges: [ { min: 429 max: 429 } ] } ೝূ - AOAIͱApiMؒ - AOAI͕ॴଐ͢ΔResourceGroup΁ͷݖݶ෇༩ͰͷηΩϡΞͳೝূ

Slide 18

Slide 18 text

© PLAID, Incɹ ίʔυվળͷཪଆ ίʔυվળ 18 ίʔυΛࢦఆͯ͠Copilotʹࢦࣔ͢Δͱɺ CraftͷϧʔϧΛ౿·͑ɺίʔυΛमਖ਼ͯ͘͠ΕΔػೳ

Slide 19

Slide 19 text

© PLAID, Incɹ ίʔυվળͷཪଆ 19

Slide 20

Slide 20 text

© PLAID, Incɹ ίʔυվળͷཪଆ (Azure Open AI Service) 20 GPT-4o mini - 1. ޙଓͷॲཧͰ࢖͍΍͍͢Α͏ʹɺςΩετͳͲΛ੔ཧ - JSON Mode Ͱޙଓʹ౉͠΍͍͢σʔλߏ଄Ͱग़ྗ - 2. Azure AI ServiceͷσʔλΛ࢖ͬͯճ౴Λੜ੒ - Stream Completion Λ࢖ͬͯɺମݧͷ޲্ text-embedding-3 - υΩϡϝϯτͷ৘ใ΍ɺݕࡧʹ͓͚ΔςΩετΛϕΫτϧԽ - large(3072࣍ݩ)ɺsmall(1536࣍ݩ)Λ྆ํར༻ - smallͰ΋ΫΦϦςΟ͸ग़͍ͯΔ͕ɺࠓޙͷ֦ுΛ౿·͑ͯ

Slide 21

Slide 21 text

© PLAID, Incɹ ίʔυվળͷཪଆ (Azure AI Search 1/2) 21 AI ػೳ͕౷߹͞ΕͨɺRAG ߏ੒ͷத৺ʹͳΔ ڧྗͳݕࡧΤϯδϯ OpenAI ͷཪଆͰ΋࢖ΘΕ͍ͯΔ͜ͱ͕ൃද͞Ε͍ͯΔ อଘϕΫτϧσʔλ - Craft Developer Portal ͷ Markdown σʔλ ͕ιʔε - ݱ࣌఺ͰɺνϟϯΫ͸͍ͯ͠ͳ͍ - ݱ࣌఺Ͱ΋ਫ਼౓͕ҰఆͰ͍ͯΔ - ࠓޙͷٕज़ਐԽʹظ଴͠ɺͰ͖Δ͚ͩγϯϓϧʹ - large(3072࣍ݩ)ɺsmall(1536࣍ݩ)Λ྆ํอଘ

Slide 22

Slide 22 text

© PLAID, Incɹ ίʔυվળͷཪଆ (Azure AI Search 2/2) 22 ηϚϯςΟοΫϋΠϒϦουݕࡧ - ςΩετͱϕΫτϧͷϋΠϒϦουݕࡧ - Microsoft ͷݴޠཧղϞσϧͰݕࡧͷؔ࿈ੑΛߴΊΔ࠶ϥϯΫॲཧ - ΫΦϦςΟ্͕͕Δ͕ɺlatency͕૿͑Δ͜ͱ͕͋Δ - Azure AI Search ͷύϑΥʔϚϯε޲্ʹؔ͢Δώϯτ Ͱνϡʔχϯ ά ʮAI ʹ͖͘ʯ Ϙλϯ - Azure AI Search͸ຖճຬ఺ͷ݁ՌΛಘΕΔΘ͚Ͱͳ͍ - ؔ࿈͢ΔυΩϡϝϯτΛදࣔ͠ɺҙਤ͠ͳ͍݁Ռ͕དྷͨ৔߹ʹਓ https://qiita.com/nohanaga/items/95a4780757e89b29e93e

Slide 23

Slide 23 text

© PLAID, Incɹ ·ͱΊ 23 ίʔυվળͷཪଆ HTMLੜ੒ͷཪଆ

Slide 24

Slide 24 text

© PLAID, Incɹ ·ͱΊ 24 ίʔυվળͷཪଆ HTMLੜ੒ͷཪଆ - Craft Copilot ͸ Microsoft ͷ AIٕज़Λத৺ʹߏ੒͞Ε͍ͯΔ - Azureʹ͸ OpenAIΛ׆͔͍͢Ζ͍ΖͳαʔϏε͕ఏڙ͞Ε͍ͯΔ - ߏ੒͸ɺحΛͯΒΘͣɺϕετϓϥΫςΟεʹै͏ - ٕज़ਐԽΛظ଴͠ɺ࡞ΓࠐΉ෦෼ͱਐԽʹҕͶΔ෦෼ͷόϥϯεΛऔΔ - ·ͩ·ͩ β൛