Tweet
Tweet

Slide 1

Slide 1 text

© 2019, Amazon Web Services, Inc. or its Affiliates. ꆙ⾱ ⢕顜 Associate Solutions Architect, Amazon Web Services Japan, K.K. 2019-05-13 AWS ד MLOps ׾罋ִ׷儗ך鼅䫛肇 ML@Loft #2 #MLLoft

Slide 2

Slide 2 text

© 2019, Amazon Web Services, Inc. or its Affiliates. 荈䊹稱➜ ꆙ⾱ ⢕顜, Ph.D. AWS أُ٦ءّٝ،٦ؗذؙز • أة٦ز،حفךֶ㹏圫׾䬐䔲 • 㣐㷕ꤍדכصُ٦ٕٓطحزٙ٦ؙ 鎘皾锷涸牞穗猰㷕 ך灇瑔㹓ד 穈さׇ剑黝⻉ך灇瑔 • 㥨ֹז؟٦ؽأכ Amazon SageMaker

Slide 3

Slide 3 text

© 2019, Amazon Web Services, Inc. or its Affiliates. Table of contents • $!&F; >?< 973@%'$' • AWS (G6A • Jupyter Notebook / JupyterLab * #8=%'$' • AWS Step Functions / Apache Airflow "&8= • Kubernetes / Kubeflow *)142 • Key messages • +, ' • ''F;EC: • B./B./)5D H-0B./

Slide 4

Slide 4 text

© 2019, Amazon Web Services, Inc. or its Affiliates. % ! )" % ($'

Slide 5

Slide 5 text

© 2019, Amazon Web Services, Inc. or its Affiliates. ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅

Slide 6

Slide 6 text

© 2019, Amazon Web Services, Inc. or its Affiliates. % & '! % #$" % ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅 = /

Slide 7

Slide 7 text

© 2019, Amazon Web Services, Inc. or its Affiliates. ! " ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅

Slide 8

Slide 8 text

© 2019, Amazon Web Services, Inc. or its Affiliates. %,(-WKFE8Q/$ //$0< +N6 UY: • */'/. /- !WK?; -" @4 X • 9SJ7.1HMD 2I> • OPL28Q =T> 5R: MLOps GA CV :Z, nB3)&#/! Vol.1, No.1 (2019). Service Data ML Ops

Slide 9

Slide 9 text

© 2019, Amazon Web Services, Inc. or its Affiliates. Jupyter Notebook / JupyterLab ׾⢪׏׋ٌرٕ圓眠ٙ٦ؙؿٗ٦ on AWS

Slide 10

Slide 10 text

© 2019, Amazon Web Services, Inc. or its Affiliates. Amazon SageMaker =341,;/5.,; 2:$!%$" ,;% )@$6& ?/ -<0>( ,; %# (HPO) ,;8* 97 "# 8* " "# 8* +'97 Amazon EC2 P3 Instances Amazon SageMaker RL Amazon SageMaker Ground Truth Amazon Elastic Inference AWS Marketplace for Machine Learning Amazon SageMaker Neo

Slide 11

Slide 11 text

© 2019, Amazon Web Services, Inc. or its Affiliates. 㹋ꥷ Amazon SageMaker כ㢳ֻ׾鍑寸׃גֻ׸׷ AWS Cloud Jupyter ⟃㢩ךؒر؍ة٦ /IDE ⢪ְ׋ְ㜥さכծ ׉ך橆㞮ח [SDK] Ⰵ׸ג API 〨ֻ

Slide 12

Slide 12 text

© 2019, Amazon Web Services, Inc. or its Affiliates. 㹋ꥷ Amazon SageMaker כ㢳ֻ׾鍑寸׃גֻ׸׷ Amazon API Gateway AWS Lambda Amazon S3 AWS Cloud 䱿锷 ؙٔؒأز

Slide 13

Slide 13 text

© 2019, Amazon Web Services, Inc. or its Affiliates. AWS StepFunctions / Apache Airflow דػ؎فٓ؎ٝ圓眠 on AWS

Slide 14

Slide 14 text

© 2019, Amazon Web Services, Inc. or its Affiliates. AWS Step Functions ׾⢪׏׋ػ؎فٓ؎ٝך圓眠⢽ Training Deploy Train/Valid/Test Data Data Scientists/ Developers Git Push AWS Glue Amazon S3 Amazon SageMaker AWS CodeCommit or 3rd party Git repository Amazon S3 欰ر٦ةכ S3 ח⥂㶷 㷕统幥׫ךٌرٕכ S3 ח⥂㶷ׁ׸׷ 鐰⣣٥劤殢欽ך 䱿锷ؒٝسه؎ٝز⡲䧭 ⵸Ⳣ椚٥㢌䳔䖓ך 㷕统欽ךر٦ة׮ S3 ח⥂㶷 Dev Prod Dev Endpoint Prod Endpoint AWS Step Functions workflow Start training job

Slide 15

Slide 15 text

© 2019, Amazon Web Services, Inc. or its Affiliates. 鐰⣣٥劤殢欽ך 䱿锷ؒٝسه؎ٝز⡲䧭 AWS Step Functions ׾⢪׏׋ػ؎فٓ؎ٝך圓眠⢽ [Blog] Training Deploy Train/Valid/Test Data Data Scientists/ Developers Git Push Git webhook Model AWS Glue Amazon S3 Amazon SageMaker AWS CodeCommit or 3rd party Git repository Amazon S3 Amazon Elastic Container Registry (ECR) AWS CodeBuild 㷕统٥䱿锷ך؝٦سָ ろת׸׷؝ٝذش׾ ٖهآزٔח縧ֻ 欰ر٦ةכ S3 ח⥂㶷 㷕统幥׫ךٌرٕכ S3 ח⥂㶷ׁ׸׷ Dev Prod Dev Endpoint Prod Endpoint AWS Step Functions workflow ⵸Ⳣ椚٥㢌䳔䖓ך 㷕统欽ךر٦ة׮ S3 ח⥂㶷

Slide 16

Slide 16 text

© 2019, Amazon Web Services, Inc. or its Affiliates. Apache Airflow [Blog] • Python DAG ( ) • Amazon SageMaker

Slide 17

Slide 17 text

© 2019, Amazon Web Services, Inc. or its Affiliates. Kubernetes / Kubeflow ⢪ְ׋ְ➂ぢֽך䞔㜠 on AWS

Slide 18

Slide 18 text

© 2019, Amazon Web Services, Inc. or its Affiliates. Kubernetes / Kubeflow on AWS [Blog] EKS + EC2 + ECR Kubeflow Jupyter Hub Amazon Elastic Container Service for Kubernetes (EKS) Managed control plane Amazon Elastic Container Registry (ECR) Docker images for training/serving Pod Pod Pod Model serving / inference Model training Worker nodes Spawn • Kubeflow Pipelines WIP [GitHub issue]

Slide 19

Slide 19 text

© 2019, Amazon Web Services, Inc. or its Affiliates.

Slide 20

Slide 20 text

© 2019, Amazon Web Services, Inc. or its Affiliates. References • ML@Loft [Blog#1] • Amazon SageMaker ✲⢽牸׶ [Web#1, Blog#2, Blog#3, Blog#4] • AWS Black Belt Online Seminar • Basic [Movie, Slides] • Advanced [Movie, Slides] • AWS ـؚٗ Apache Airflow [Blog], Kubeflow [Blog], • HPO SageMaker default [Blog], Optuna [Blog] • GPU [#MPH] • SageMaker Containers [GitHub] • Jupyter ⟃㢩ךؒر؍ة٦/IDE ⢪ְ׋ְ㜥さכծ׉ך橆㞮ח [SDK] Ⰵ׸ג API 〨ֻ

Slide 21

Slide 21 text

© 2019, Amazon Web Services, Inc. or its Affiliates. Event info • [Startup Day ؿؓٗ٦،حف] Upgrade UX with Data / 堣唒㷕统׾欽ְ׋؟٦ؽأ何㊣ 2019 䎃 5 剢 14 傈 (抟) 19:00 - 21:00 [歍׃鴥׫] • (Online) Amazon SageMaker 堣唒㷕统ؒٝآص،ぢֽ⡤꿀عٝؤؔٝ 2019 䎃 5 剢 17 傈 (ꆃ) 14:00 - 15:30 [歍׃鴥׫] • 痥5㔐 Amazon SageMaker ✲⢽牸׶ 2019 䎃 5 剢 21 傈 (抟) 13:45 - 17:30 [歍׃鴥׫] • AWS Summit Tokyo 2019 (Osaka ׮ⴽ傈ד֮׶תׅ) 2019 䎃 6 剢 12 傈 (宏) - 14 傈 (ꆃ) [歍׃鴥׫]

Slide 22

Slide 22 text

© 2019, Amazon Web Services, Inc. or its Affiliates. © 2019, Amazon Web Services, Inc. or its Affiliates. Thank you! ML@Loft 如㔐 #3 כ 6/21 (ꆃ) ✮㹀דׅ