AWS re:Invent 2023 ML/AI x SaaS セッション振り返り/saas-eng-meetup-6_hassaku63

イベントページ
https://saas-engineering-meetup.connpass.com/event/307955/

## 紹介した Workshop "SAS301 SaaS and AI/ML: Inside a multi-tenant AI/ML solution" のリンク

Multi-Tenant Machine Learning (ML) on AWS using Amazon SageMaker
https://catalog.workshops.aws/multi-tenant-ml-as-a-service/en-US

GitHub
https://github.com/aws-samples/ml-model-as-a-service-using-amazon-sagemaker

## スライド中に登場した URL のリスト

[1] SaaS Solutions on AWS: Tenant Isolation Architectures
https://docs.aws.amazon.com/whitepapers/latest/saas-solutions-tenant-isolation-architectures/welcome.html

[2] SaaS ArchiteSaaS Architecture Fundamentals - Control plane vs. application plane 
https://docs.aws.amazon.com/whitepapers/latest/saas-architecture-fundamentals/control-plane-vs.-application-plane.html

[3] MLaaS (Machine Learning as a Service) のためのマルチテナント機械学習構築環境を Amazon SageMaker Pipelines で実装する
thttps://aws.amazon.com/jp/blogs/news/implementing-a-multi-tenant-mlaas-build-environment-with-amazon-sagemaker-pipelines/

[4] サーバーワークス Youtube - プレイリスト「AWS re:Invent」
https://www.youtube.com/playlist?list=PLCRz5JqTKzflpIGqFDoyfVVifB7w_Yzjr

Transcript

1. AWS re:Invent 2023 ML/AI x SaaS ηογϣϯৼΓฦΓ 2024/02/07(Wed) @hassaku63 SaaS Engineering Meetup #6
2. 9
   !IBTTBLV@
   (JU)VC
   IBTTBLV
   4QFBLFS%FDL
   IBTTBLV 
   
   $%,
   %BZ
   
   $PO fi HVSF
   DSPTTBDDPVOU
   EFQMPZNFOU
   VTJOH
   $%, 
   
   "84
   %FW
   %BZ
   
   +BQBO
   αʔόʔϨεͳࣾ಺ۀ຿γεςϜΛՔಇͤͯ͞
   ೥ܦͬͨͷͰɺࠓ೔·Ͱͷ଍੻ΛޠΖ͏ͱࢥ͏ 5PQJDT ࣾ಺4&
   "84
   4UFQ
   'VODUJPOT
   
   -BNCEB
   "84
   $%,
   4BMFTGPSDF
   1ZUIPO
   5ZQF4DSJQU
   (P 5BLVZB
   )BTIJNPUP
3. Contents ࠓ೔࿩͢͜ͱ 1. SaaS × AI/ML ηογϣϯͷใࠂ 1. Workshop ηογϣϯͷ֓ཁ 2. ࢀߟࢿྉͷڞ༗ 2. re:Invent ݱ஍ࢀՃͷऩ֭
4. Contents ࠓ೔࿩͞ͳ͍͜ͱ 1. Workshop ίϯςϯπͷৄࡉͳٕज़ཁૉʹ౿ΈࠐΜͩղઆ 2. ػցֶशϓϩδΣΫτɾΞϓϦέʔγϣϯͷߏஙํ๏ͷղઆ 3. ͋Δ͍͸ SageMaker ౳֤छ AWS αʔϏεͷجຊతͳ࢖͍ํ
5. SaaS × AI/ML ηογϣϯͷใࠂ
6. ࢀՃηογϣϯ SaaS ΧςΰϦͷࢀՃ࣮੷ Session Type Title SAS301 Workshop SaaS and AI/ML: Inside a multi-tenant AI/ML solution SAS303 Chalk Talk Inside the SaaS control plane SAS306 Breakout Session SaaS meets AI/ML & generative AI: Multi-tenant patterns & strategies
7. ࢀՃηογϣϯ SaaS ΧςΰϦͷࢀՃ࣮੷ Session Type Title SAS301 Workshop SaaS and AI/ML: Inside a multi-tenant AI/ML solution SAS303 Chalk Talk Inside the SaaS control plane SAS306 Breakout Session SaaS meets AI/ML & generative AI: Multi-tenant patterns & strategies
8. ηογϣϯ֓ཁ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ஫ʣ2024/02/07 ࣌఺Ͱ͸ɺυΩϡϝϯτͱιʔείʔυͦͷ··Ͱ͸ಈ࡞͠ͳ͍Մೳੑ͋Γ [1] ϋϯζΦϯ υΩϡϝϯτ Multi-Tenant Machine Learning (ML) on AWS using Amazon SageMaker https://catalog.workshops.aws/multi-tenant-ml-as-a-service/en-US [2] ιʔείʔυ (GitHub) https://github.com/aws-samples/ml-model-as-a-service-using-amazon-sagemaker (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution
9. ηογϣϯ֓ཁ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ސ٬ͷ “Tier” Ͱఏڙ͢Δ ML αʔϏεΛࠩผԽ͢ΔΞϓϩʔνͱɺͦͷ࣮ݱʹ·ͭΘΔॾ໰୊Λٞ࿦ 1. ্Ґ Tier ͷސ٬ʹ͸ಛผͳମݧΛఏڙ 1. ސ٬ࣗ਎ͷςφϯτσʔλΛֶशͨ͠ʢΑΓਫ਼౓ͷߴ͍ʣਪ࿦αʔϏεͷఏڙ 2. Usage ʹؔ͢Δ্ݶͷ؇࿨ 3. ֶशσʔλͷ෼཭ɺઐ༗ϗεςΟϯά 2. Tier ͷ۠ผΛ࣮ݱ͢ΔͨΊͷΞʔΩςΫνϟ (Pool or Silo ?) 3. Control Plane ʹΑΔ “On-Boarding” ϓϩηεͷ՝୊ 4. ڞ༻Մೳͳ෦෼Λڞ༻͢Δ 5. ΞΫηε੍ޚ ※͜͜Ͱͷ “Tier” ͸ʮܖ໿ϓϥϯʯͱ΄΅ಉٛ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution
10. ηογϣϯ֓ཁ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ސ٬ͷ “Tier” Ͱఏڙ͢Δ ML αʔϏεΛࠩผԽ͢ΔΞϓϩʔνͱɺͦͷ࣮ݱʹ·ͭΘΔॾ໰୊Λٞ࿦ 1. ্Ґ Tier ͷސ٬ʹ͸ಛผͳମݧΛఏڙ 1. ސ٬ࣗ਎ͷςφϯτσʔλΛֶशͨ͠ʢΑΓਫ਼౓ͷߴ͍ʣਪ࿦αʔϏεͷఏڙ 2. Usage ʹؔ͢Δ্ݶͷ؇࿨ 3. ֶशσʔλͷ෼཭ɺઐ༗ϗεςΟϯά 2. Tier ͷ۠ผΛ࣮ݱ͢ΔͨΊͷΞʔΩςΫνϟ (Pool or Silo ?) 3. Control Plane ʹΑΔ “On-Boarding” ϓϩηεͷ՝୊ 4. ڞ༻Մೳͳ෦෼Λڞ༻͢Δ 5. ΞΫηε੍ޚ ※͜͜Ͱͷ “Tier” ͸ʮܖ໿ϓϥϯʯͱ΄΅ಉٛ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution “Gold” Tier = ઐ༗ܕ 
 “Bronze” Tier = ϓʔϧܕϞσϧ
11. લఏ஌ࣝ (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution
12. લఏ஌ࣝ Tenant Isolation SaaS Solutions on AWS: Tenant Isolation Architectures 
 https://docs.aws.amazon.com/whitepapers/latest/saas-solutions-tenant-isolation-architectures/welcome.html (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution Silo Isolation Model Pooled Isolation Model Bridge Isolation Model
13. લఏ஌ࣝ Tenant Isolation (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution • ηΩϡϦςΟʗίϯϓϥΠΞϯε • εέʔϥϏϦςΟ • ίετ • Noisy Neighbor • ΦϯϘʔσΟϯάϓϩηε • ӡ༻ɾ؂ࢹ • etc..
14. લఏ஌ࣝ Control Plane vs. Application Plane SaaS ArchiteSaaS Architecture Fundamentals - Control plane vs. application plane 
 https://docs.aws.amazon.com/whitepapers/latest/saas-architecture-fundamentals/control-plane-vs.-application-plane.html (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution
16. Control Plane
17. Application Plane (Tenant)
18. Training Architecture (for each Tier, or Tenant)
19. Inference Architecture (for each Tier, or Tenant)
20. (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ෼཭͍ͯ͠Δ΋ͷ Upload trainning data Model artifact
21. (SAS301) SaaS and AI/ML: Inside a multi-tenant AI/ML solution ෼཭͍ͯ͠ͳ͍΋ͷ Inference API (with Authorizer) Control Place
22. re:Invent ݱ஍ࢀՃͷऩ֭
23. SaaS ؔ܎ • ੜ੒ AI • ΄ͱΜͲͷδϟϯϧͰԣஅతʹίϥϘ͍ͯͨ͠ҹ৅ • SaaS ෼໺Ͱ͸ੜ੒ AI ΋ͦ͏͕ͩɺΑΓ޿͘ AI/ML ͱͷؔ܎Λѻ͏ηογϣϯ͕ෳ਺ • SaaS ؔ܎ͷτϐοΫ • Ϗδωεతͳཁ݅ͱςφϯγʔ෼཭ͷ࿩୊͕͍ۙ • ML ΞϓϦέʔγϣϯͷߏஙͱςφϯγʔ෼཭ΛབྷΊͨηογϣϯ͕ෳ਺͋ͬͨ • ʮΦϯϘʔσΟϯάʯͷॏཁੑ͸ෳ਺ͷηογϣϯͰݟฉ͖ͨ͠ • ʢ༨ஊʣAWS Marketplace Λ࢖ͬͨ MLaaS ΞʔΩςΫνϟͷ঺հهࣄ͕αΠϩܕͬΆͯ͘ڵຯਂ͔ͬͨ • MLaaS (Machine Learning as a Service) ͷͨΊͷϚϧνςφϯτػցֶशߏங؀ڥΛ Amazon SageMaker Pipelines Ͱ࣮૷ ͢Δ https://aws.amazon.com/jp/blogs/news/implementing-a-multi-tenant-mlaas-build-environment-with-amazon-sagemaker-pipelines/
24. ݱ஍Ͱͷऩ֭ EXPO • ւ֎ͷ SaaS αʔϏεͷௐࠪɺΩϟονΞοϓ GameDay • ӳޠݍͷݱ໾ΤϯδχΞͱͷٕज़ձ࿩ • ࣮຿͔Βগ͠ԕΊͷٕज़ྖҬΛ৮ͬͯΩϟονΞοϓ
25. ݱ஍Ͱͷऩ֭ Workshop ηογϣϯ • جຊతʹ৘ใ͸ʮͦͷ৔ݶΓʯ • ಈըͷΞʔΧΠϒެ։ͳ͠ • ιʔείʔυͷϦϯΫ΍ɺҰൠެ։൛ͷυΩϡϝϯτ͸Ҋ಺͞Εͳ͍ 
 ʢαΠϨϯτެ։͕ଟ͘ɺ͔ͭηογϣϯ໊Ͱ͸ݕࡧʹώοτͮ͠Β͍ʣ • ηογϣϯͷ࿮͕ऴྃ͢ΔͱϋϯζΦϯαΠτͷ OneTime τʔΫϯ͕ࣦޮ͠ɺӾཡෆՄʹ • git clone ͢Διʔεʗ๯಄ͷλΠτϧ΍จষʗεΫγϣͳͲͳͲɺͱʹ͔͘खݩʹه࿥͓ͯ͘͠΂͠ • ϋϯζΦϯαΠτͷࢀߟϦϯΫ͕ྑ͍ • ࣗ෼͕஌Βͳ͍ϒϩάهࣄ΍υΩϡϝϯτ౳ͷ৘ใݯʹग़ձ͑Δ͔΋
26. ʢએ఻ʣ
27. ʢએ఻ʣre:Invent 2023 - ݱ஍Ϩϙʔτಈը https://www.youtube.com/@ServerworksJp/playlists https://www.youtube.com/playlist?list=PLCRz5JqTKz f lpIGqFDoyfVVifB7w_Yzjr Playlist “AWS re:Invent”
28. ʢએ఻ʣre:Invent 2023 - ݱ஍Ϩϙʔτಈը AWS re:Invent 2023 ೔هಈը (Day1) - ։࠵ॳ೔ʂ (05:00) SAS301 SaaS and AI/ML: Inside a multi-tenant AI/ML solution AWS re:Invent 2023 ೔هಈը (Day4) - SaaS ؔ܎ͷηογϣϯΛݟ͖ͯͨ (01:38) SAS303 Inside the SaaS control plane (06:55) SAS306 SaaS meets AI/ML & generative AI: Multi-tenant patterns & strategies Topics: ࣋ͪ΋ͷʗݱ஍ͷա͝͠ํʗEXPOʗGameDay etc.. SaaS ؔ࿈ͷτʔΫ