Tweet
Tweet

Slide 1

Slide 1 text

AWS re:Invent 2023 ML/AI x SaaS ηογϣϯৼΓฦΓ 2024/02/07(Wed) @hassaku63 SaaS Engineering Meetup #6

Slide 2

Slide 2 text

9!IBTTBLV@ (JU)VCIBTTBLV 4QFBLFS%FDLIBTTBLV $%,%BZ $PO fi HVSFDSPTTBDDPVOUEFQMPZNFOUVTJOH$%, "84%FW%BZ+BQBO αʔόʔϨεͳࣾ಺ۀ຿γεςϜΛՔಇͤͯ͞ ೥ܦͬͨͷͰɺࠓ೔·Ͱͷ଍੻ΛޠΖ͏ͱࢥ͏ 5PQJDT ࣾ಺4& "844UFQ'VODUJPOT-BNCEB "84$%, 4BMFTGPSDF 1ZUIPO 5ZQF4DSJQU (P 5BLVZB)BTIJNPUP

Slide 3

Slide 3 text

Contents ࠓ೔࿩͢͜ͱ 1. SaaS × AI/ML ηογϣϯͷใࠂ 1. Workshop ηογϣϯͷ֓ཁ 2. ࢀߟࢿྉͷڞ༗ 2. re:Invent ݱ஍ࢀՃͷऩ֭

Slide 4

Slide 4 text

Contents ࠓ೔࿩͞ͳ͍͜ͱ 1. Workshop ίϯςϯπͷৄࡉͳٕज़ཁૉʹ౿ΈࠐΜͩղઆ 2. ػցֶशϓϩδΣΫτɾΞϓϦέʔγϣϯͷߏஙํ๏ͷղઆ 3. ͋Δ͍͸ SageMaker ౳֤छ AWS αʔϏεͷجຊతͳ࢖͍ํ

Slide 5

Slide 5 text

SaaS × AI/ML ηογϣϯͷใࠂ

Slide 6

Slide 6 text

ࢀՃηογϣϯ SaaS ΧςΰϦͷࢀՃ࣮੷ Session Type Title SAS301 Workshop SaaS and AI/ML: Inside a multi-tenant AI/ML solution SAS303 Chalk Talk Inside the SaaS control plane SAS306 Breakout Session SaaS meets AI/ML & generative AI: Multi-tenant patterns & strategies

Slide 7

Slide 7 text

ࢀՃηογϣϯ SaaS ΧςΰϦͷࢀՃ࣮੷ Session Type Title SAS301 Workshop SaaS and AI/ML: Inside a multi-tenant AI/ML solution SAS303 Chalk Talk Inside the SaaS control plane SAS306 Breakout Session SaaS meets AI/ML & generative AI: Multi-tenant patterns & strategies

Slide 8

Slide 8 text

ηογϣϯ֓ཁ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ஫ʣ2024/02/07 ࣌఺Ͱ͸ɺυΩϡϝϯτͱιʔείʔυͦͷ··Ͱ͸ಈ࡞͠ͳ͍Մೳੑ͋Γ [1] ϋϯζΦϯ υΩϡϝϯτ Multi-Tenant Machine Learning (ML) on AWS using Amazon SageMaker https://catalog.workshops.aws/multi-tenant-ml-as-a-service/en-US [2] ιʔείʔυ (GitHub) https://github.com/aws-samples/ml-model-as-a-service-using-amazon-sagemaker (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution

Slide 9

Slide 9 text

ηογϣϯ֓ཁ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ސ٬ͷ “Tier” Ͱఏڙ͢Δ ML αʔϏεΛࠩผԽ͢ΔΞϓϩʔνͱɺͦͷ࣮ݱʹ·ͭΘΔॾ໰୊Λٞ࿦ 1. ্Ґ Tier ͷސ٬ʹ͸ಛผͳମݧΛఏڙ 1. ސ٬ࣗ਎ͷςφϯτσʔλΛֶशͨ͠ʢΑΓਫ਼౓ͷߴ͍ʣਪ࿦αʔϏεͷఏڙ 2. Usage ʹؔ͢Δ্ݶͷ؇࿨ 3. ֶशσʔλͷ෼཭ɺઐ༗ϗεςΟϯά 2. Tier ͷ۠ผΛ࣮ݱ͢ΔͨΊͷΞʔΩςΫνϟ (Pool or Silo ?) 3. Control Plane ʹΑΔ “On-Boarding” ϓϩηεͷ՝୊ 4. ڞ༻Մೳͳ෦෼Λڞ༻͢Δ 5. ΞΫηε੍ޚ ※͜͜Ͱͷ “Tier” ͸ʮܖ໿ϓϥϯʯͱ΄΅ಉٛ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution

Slide 10

Slide 10 text

ηογϣϯ֓ཁ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ސ٬ͷ “Tier” Ͱఏڙ͢Δ ML αʔϏεΛࠩผԽ͢ΔΞϓϩʔνͱɺͦͷ࣮ݱʹ·ͭΘΔॾ໰୊Λٞ࿦ 1. ্Ґ Tier ͷސ٬ʹ͸ಛผͳମݧΛఏڙ 1. ސ٬ࣗ਎ͷςφϯτσʔλΛֶशͨ͠ʢΑΓਫ਼౓ͷߴ͍ʣਪ࿦αʔϏεͷఏڙ 2. Usage ʹؔ͢Δ্ݶͷ؇࿨ 3. ֶशσʔλͷ෼཭ɺઐ༗ϗεςΟϯά 2. Tier ͷ۠ผΛ࣮ݱ͢ΔͨΊͷΞʔΩςΫνϟ (Pool or Silo ?) 3. Control Plane ʹΑΔ “On-Boarding” ϓϩηεͷ՝୊ 4. ڞ༻Մೳͳ෦෼Λڞ༻͢Δ 5. ΞΫηε੍ޚ ※͜͜Ͱͷ “Tier” ͸ʮܖ໿ϓϥϯʯͱ΄΅ಉٛ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution “Gold” Tier = ઐ༗ܕ 
 “Bronze” Tier = ϓʔϧܕϞσϧ

Slide 11

Slide 11 text

લఏ஌ࣝ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution

Slide 12

Slide 12 text

લఏ஌ࣝ Tenant Isolation SaaS Solutions on AWS: Tenant Isolation Architectures 
 https://docs.aws.amazon.com/whitepapers/latest/saas-solutions-tenant-isolation-architectures/welcome.html (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution Silo Isolation Model Pooled Isolation Model Bridge Isolation Model

Slide 13

Slide 13 text

લఏ஌ࣝ Tenant Isolation (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution • ηΩϡϦςΟʗίϯϓϥΠΞϯε • εέʔϥϏϦςΟ • ίετ • Noisy Neighbor • ΦϯϘʔσΟϯάϓϩηε • ӡ༻ɾ؂ࢹ • etc..

Slide 14

Slide 14 text

લఏ஌ࣝ Control Plane vs. Application Plane SaaS ArchiteSaaS Architecture Fundamentals - Control plane vs. application plane 
 https://docs.aws.amazon.com/whitepapers/latest/saas-architecture-fundamentals/control-plane-vs.-application-plane.html (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution

Slide 15

Slide 15 text

No content

Slide 16

Slide 16 text

Control Plane

Slide 17

Slide 17 text

Application Plane (Tenant)

Slide 18

Slide 18 text

Training Architecture (for each Tier, or Tenant)

Slide 19

Slide 19 text

Inference Architecture (for each Tier, or Tenant)

Slide 20

Slide 20 text

(SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ෼཭͍ͯ͠Δ΋ͷ Upload trainning data Model artifact

Slide 21

Slide 21 text

(SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ෼཭͍ͯ͠ͳ͍΋ͷ Inference API (with Authorizer) Control Place

Slide 22

Slide 22 text

re:Invent ݱ஍ࢀՃͷऩ֭

Slide 23

Slide 23 text

SaaS ؔ܎ • ੜ੒ AI • ΄ͱΜͲͷδϟϯϧͰԣஅతʹίϥϘ͍ͯͨ͠ҹ৅ • SaaS ෼໺Ͱ͸ੜ੒ AI ΋ͦ͏͕ͩɺΑΓ޿͘ AI/ML ͱͷؔ܎Λѻ͏ηογϣϯ͕ෳ਺ • SaaS ؔ܎ͷτϐοΫ • Ϗδωεతͳཁ݅ͱςφϯγʔ෼཭ͷ࿩୊͕͍ۙ • ML ΞϓϦέʔγϣϯͷߏஙͱςφϯγʔ෼཭ΛབྷΊͨηογϣϯ͕ෳ਺͋ͬͨ • ʮΦϯϘʔσΟϯάʯͷॏཁੑ͸ෳ਺ͷηογϣϯͰݟฉ͖ͨ͠ • ʢ༨ஊʣAWS Marketplace Λ࢖ͬͨ MLaaS ΞʔΩςΫνϟͷ঺հهࣄ͕αΠϩܕͬΆͯ͘ڵຯਂ͔ͬͨ • MLaaS (Machine Learning as a Service) ͷͨΊͷϚϧνςφϯτػցֶशߏங؀ڥΛ Amazon SageMaker Pipelines Ͱ࣮૷ ͢Δ https://aws.amazon.com/jp/blogs/news/implementing-a-multi-tenant-mlaas-build-environment-with-amazon-sagemaker-pipelines/

Slide 24

Slide 24 text

ݱ஍Ͱͷऩ֭ EXPO • ւ֎ͷ SaaS αʔϏεͷௐࠪɺΩϟονΞοϓ GameDay • ӳޠݍͷݱ໾ΤϯδχΞͱͷٕज़ձ࿩ • ࣮຿͔Βগ͠ԕΊͷٕज़ྖҬΛ৮ͬͯΩϟονΞοϓ

Slide 25

Slide 25 text

ݱ஍Ͱͷऩ֭ Workshop ηογϣϯ • جຊతʹ৘ใ͸ʮͦͷ৔ݶΓʯ • ಈըͷΞʔΧΠϒެ։ͳ͠ • ιʔείʔυͷϦϯΫ΍ɺҰൠެ։൛ͷυΩϡϝϯτ͸Ҋ಺͞Εͳ͍ 
 ʢαΠϨϯτެ։͕ଟ͘ɺ͔ͭηογϣϯ໊Ͱ͸ݕࡧʹώοτͮ͠Β͍ʣ • ηογϣϯͷ࿮͕ऴྃ͢ΔͱϋϯζΦϯαΠτͷ OneTime τʔΫϯ͕ࣦޮ͠ɺӾཡෆՄʹ • git clone ͢Διʔεʗ๯಄ͷλΠτϧ΍จষʗεΫγϣͳͲͳͲɺͱʹ͔͘खݩʹه࿥͓ͯ͘͠΂͠ • ϋϯζΦϯαΠτͷࢀߟϦϯΫ͕ྑ͍ • ࣗ෼͕஌Βͳ͍ϒϩάهࣄ΍υΩϡϝϯτ౳ͷ৘ใݯʹग़ձ͑Δ͔΋

Slide 26

Slide 26 text

ʢએ఻ʣ

Slide 27

Slide 27 text

ʢએ఻ʣre:Invent 2023 - ݱ஍Ϩϙʔτಈը https://www.youtube.com/@ServerworksJp/playlists https://www.youtube.com/playlist?list=PLCRz5JqTKz f lpIGqFDoyfVVifB7w_Yzjr Playlist “AWS re:Invent”

Slide 28

Slide 28 text

ʢએ఻ʣre:Invent 2023 - ݱ஍Ϩϙʔτಈը AWS re:Invent 2023 ೔هಈը (Day1) - ։࠵ॳ೔ʂ (05:00) SAS301 SaaS and AI/ML: Inside a multi-tenant AI/ML solution AWS re:Invent 2023 ೔هಈը (Day4) - SaaS ؔ܎ͷηογϣϯΛݟ͖ͯͨ (01:38) SAS303 Inside the SaaS control plane (06:55) SAS306 SaaS meets AI/ML & generative AI: Multi-tenant patterns & strategies Topics: ࣋ͪ΋ͷʗݱ஍ͷա͝͠ํʗEXPOʗGameDay etc.. SaaS ؔ࿈ͷτʔΫ