Slide 1
Slide 1 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
ꆙ⾱ ⢕顜
Associate Solutions Architect, Amazon Web Services Japan, K.K.
2019-05-13
AWS ד MLOps 罋ִ儗ך鼅䫛肇
ML@Loft #2
#MLLoft
Slide 2
Slide 2 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
荈䊹稱➜
ꆙ⾱ ⢕顜, Ph.D.
AWS أُ٦ءّٝ،٦ؗذؙز
• أة٦ز،حفךֶ㹏圫䬐䔲
• 㣐㷕ꤍדכصُ٦ٕٓطحزٙ٦ؙ
鎘皾锷涸牞穗猰㷕
ך灇瑔㹓ד
穈さׇ剑黝⻉ך灇瑔
• 㥨ֹז؟٦ؽأכ Amazon SageMaker
Slide 3
Slide 3 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Table of contents
• $!&F;
>?< 973@%'$'
• AWS (G6A
• Jupyter Notebook / JupyterLab * #8=%'$'
• AWS Step Functions / Apache Airflow "&8=
• Kubernetes / Kubeflow *)142
• Key messages
• +,
'
• ''F;EC:
• B./B./)5D
H-0B./
Slide 4
Slide 4 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
%
!
)"
%
($'
Slide 5
Slide 5 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
ر٦ةך崧
ٌرٕ圓眠ך
崧٥濼鋅
Slide 6
Slide 6 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
%
&
'! %
#$" %
ر٦ةך崧
ٌرٕ圓眠ך
崧٥濼鋅
=
/
Slide 7
Slide 7 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
!
"
ر٦ةך崧
ٌرٕ圓眠ך
崧٥濼鋅
Slide 8
Slide 8 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
%,(-WKFE8Q/$
//$0<
+N6
UY:
• */'/. /-
!WK?; -"
@4
X
• 9SJ7.1HMD
2I>
• OPL28Q
=T>
5R: MLOps
GA CV :Z,
nB3)&#/! Vol.1, No.1 (2019).
Service
Data
ML Ops
Slide 9
Slide 9 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Jupyter Notebook / JupyterLab
⢪ٌرٕ圓眠ٙ٦ؙؿٗ٦
on AWS
Slide 10
Slide 10 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Amazon SageMaker
=341,;/5.,;
2:$!%$"
,;%
)@$6&
?/
-<0>(
,;
%#
(HPO)
,;8*
97
"#
8*
"
"#
8*
+'97
Amazon EC2 P3
Instances
Amazon SageMaker RL
Amazon SageMaker
Ground Truth
Amazon Elastic
Inference
AWS Marketplace for
Machine Learning Amazon SageMaker Neo
Slide 11
Slide 11 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
㹋ꥷ Amazon SageMaker כ㢳ֻ鍑寸׃גֻ
AWS Cloud
Jupyter ⟃㢩ךؒر؍ة٦
/IDE ⢪ְְ㜥さכծ
ך橆㞮ח [SDK] Ⰵג
API 〨ֻ
Slide 12
Slide 12 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
㹋ꥷ Amazon SageMaker כ㢳ֻ鍑寸׃גֻ
Amazon API Gateway
AWS Lambda
Amazon S3
AWS Cloud
䱿锷
ؙٔؒأز
Slide 13
Slide 13 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
AWS StepFunctions /
Apache Airflow דػ؎فٓ؎ٝ圓眠
on AWS
Slide 14
Slide 14 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
AWS Step Functions ⢪ػ؎فٓ؎ٝך圓眠⢽
Training Deploy
Train/Valid/Test
Data
Data
Scientists/
Developers
Git Push
AWS Glue Amazon S3 Amazon SageMaker
AWS CodeCommit
or
3rd party
Git repository
Amazon S3
欰ر٦ةכ S3 ח⥂㶷
㷕统幥ךٌرٕכ
S3 ח⥂㶷ׁ
鐰⣣٥劤殢欽ך
䱿锷ؒٝسه؎ٝز⡲䧭
Ⳣ椚٥㢌䳔䖓ך
㷕统欽ךر٦ة S3 ח⥂㶷
Dev
Prod
Dev Endpoint
Prod Endpoint
AWS Step Functions workflow
Start training job
Slide 15
Slide 15 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
鐰⣣٥劤殢欽ך
䱿锷ؒٝسه؎ٝز⡲䧭
AWS Step Functions ⢪ػ؎فٓ؎ٝך圓眠⢽ [Blog]
Training Deploy
Train/Valid/Test
Data
Data
Scientists/
Developers
Git Push
Git webhook Model
AWS Glue Amazon S3 Amazon SageMaker
AWS CodeCommit
or
3rd party
Git repository
Amazon S3
Amazon
Elastic Container
Registry
(ECR)
AWS CodeBuild
㷕统٥䱿锷ך؝٦سָ
ろת؝ٝذش
ٖهآزٔח縧ֻ
欰ر٦ةכ S3 ח⥂㶷
㷕统幥ךٌرٕכ
S3 ח⥂㶷ׁ
Dev
Prod
Dev Endpoint
Prod Endpoint
AWS Step Functions workflow
Ⳣ椚٥㢌䳔䖓ך
㷕统欽ךر٦ة S3 ח⥂㶷
Slide 16
Slide 16 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Apache Airflow [Blog]
• Python DAG ( )
• Amazon SageMaker
Slide 17
Slide 17 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Kubernetes / Kubeflow
⢪ְְ➂ぢֽך䞔㜠
on AWS
Slide 18
Slide 18 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Kubernetes / Kubeflow on AWS [Blog]
EKS + EC2 + ECR
Kubeflow Jupyter Hub
Amazon Elastic Container
Service for Kubernetes
(EKS)
Managed control plane
Amazon Elastic Container
Registry (ECR)
Docker images for
training/serving
Pod Pod
Pod
Model serving / inference
Model training
Worker nodes
Spawn
• Kubeflow Pipelines WIP [GitHub issue]
Slide 19
Slide 19 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Slide 20
Slide 20 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
References
• ML@Loft [Blog#1]
• Amazon SageMaker ✲⢽牸 [Web#1, Blog#2, Blog#3, Blog#4]
• AWS Black Belt Online Seminar
• Basic [Movie, Slides]
• Advanced [Movie, Slides]
• AWS ـؚٗ Apache Airflow [Blog], Kubeflow [Blog],
• HPO SageMaker default [Blog], Optuna [Blog]
•
GPU [#MPH]
• SageMaker Containers [GitHub]
• Jupyter ⟃㢩ךؒر؍ة٦/IDE ⢪ְְ㜥さכծך橆㞮ח [SDK] Ⰵג
API 〨ֻ
Slide 21
Slide 21 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
Event info
• [Startup Day ؿؓٗ٦،حف]
Upgrade UX with Data / 堣唒㷕统欽ְ؟٦ؽأ何㊣
2019 䎃 5 剢 14 傈 (抟) 19:00 - 21:00 [歍׃鴥]
• (Online) Amazon SageMaker 堣唒㷕统ؒٝآص،ぢֽ⡤꿀عٝؤؔٝ
2019 䎃 5 剢 17 傈 (ꆃ) 14:00 - 15:30 [歍׃鴥]
• 痥5㔐 Amazon SageMaker ✲⢽牸
2019 䎃 5 剢 21 傈 (抟) 13:45 - 17:30 [歍׃鴥]
• AWS Summit Tokyo 2019 (Osaka ⴽ傈ד֮תׅ)
2019 䎃 6 剢 12 傈 (宏) - 14 傈 (ꆃ) [歍׃鴥]
Slide 22
Slide 22 text
© 2019, Amazon Web Services, Inc. or its Affiliates.
© 2019, Amazon Web Services, Inc. or its Affiliates.
Thank you!
ML@Loft 如㔐 #3 כ 6/21 (ꆃ) ✮㹀דׅ