AWS で MLOps を考える時の選択肢 / ML@Loft #2

AWS では Amazon SageMaker というサービスを提供していて、機械学習・深層学習ワークロードを実行するお客様に幅広い選択肢を提供しています。また、Amazon SageMaker を中心とした MLOps パイプラインの組み方にもいくつかの選択肢があります。本講演ではよくお客さまとの会話で出てくる、
- Jupyter Notebook を使った機械学習開発ワークフロー
- AWS StepFunctions / Apache Airflow でパイプライン構築
- Kubernetes / Kubeflow 使いたい人向けの情報
などのキーワードを中心にお話ししようと思います。

Transcript

1. © 2019, Amazon Web Services, Inc. or its Affiliates. ꆙ⾱ ⢕顜 Associate Solutions Architect, Amazon Web Services Japan, K.K. 2019-05-13 AWS ד MLOps ׾罋ִ׷儗ך鼅䫛肇 ML@Loft #2 #MLLoft
2. © 2019, Amazon Web Services, Inc. or its Affiliates. 荈䊹稱➜ ꆙ⾱ ⢕顜, Ph.D. AWS أُ٦ءّٝ،٦ؗذؙز • أة٦ز،حفךֶ㹏圫׾䬐䔲 • 㣐㷕ꤍדכصُ٦ٕٓطحزٙ٦ؙ 鎘皾锷涸牞穗猰㷕
   ך灇瑔㹓ד 穈さׇ剑黝⻉ך灇瑔 • 㥨ֹז؟٦ؽأכ Amazon SageMaker 
   
3. © 2019, Amazon Web Services, Inc. or its Affiliates. Table of contents • $!&F; 
   >?< 973@ %'$' • AWS ( G6A • Jupyter Notebook / JupyterLab * #8=%'$' • AWS Step Functions / Apache Airflow "&8= • Kubernetes / Kubeflow *)1 42 • Key messages • +, ' • ''F;EC: • B./
   B./
   )5D H- 0B./
4. © 2019, Amazon Web Services, Inc. or its Affiliates. %&#   !  
   )" %     ($'
5. © 2019, Amazon Web Services, Inc. or its Affiliates.          
     ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅
6. © 2019, Amazon Web Services, Inc. or its Affiliates. % &  '! %   #$" %  ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅   =  / 
   
7. © 2019, Amazon Web Services, Inc. or its Affiliates.  !  "       ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅  
    
8. © 2019, Amazon Web Services, Inc. or its Affiliates. %,(-WKFE8Q/$ / /$0<  +N6 UY: • */'/. /- ! WK?; -" @4 X • 9SJ7.1HMD 2I> • OPL 28Q =T> 5R:
   MLOps GA CV :Z, nB3)&#/! Vol.1, No.1 (2019). Service Data ML Ops
9. © 2019, Amazon Web Services, Inc. or its Affiliates. Jupyter Notebook / JupyterLab ׾⢪׏׋ٌرٕ圓眠ٙ٦ؙؿٗ٦ on AWS
10. © 2019, Amazon Web Services, Inc. or its Affiliates. Amazon SageMaker
    =341,;/5.,; 2:$!%$" ,;% )@$6&  ?/ -<0>(  ,; %# (HPO) ,;8*   97 "# 8*  " "# 8*  +'97 Amazon EC2 P3 Instances Amazon SageMaker RL Amazon SageMaker Ground Truth Amazon Elastic Inference AWS Marketplace for Machine Learning Amazon SageMaker Neo
11. © 2019, Amazon Web Services, Inc. or its Affiliates. 㹋ꥷ Amazon SageMaker כ㢳ֻ׾鍑寸׃גֻ׸׷ AWS Cloud Jupyter ⟃㢩ךؒر؍ة٦ /IDE ⢪ְ׋ְ㜥さכծ ׉ך橆㞮ח [SDK] Ⰵ׸ג API 〨ֻ     
      
12. © 2019, Amazon Web Services, Inc. or its Affiliates. 㹋ꥷ Amazon SageMaker כ㢳ֻ׾鍑寸׃גֻ׸׷ Amazon API Gateway AWS Lambda Amazon S3 AWS Cloud 䱿锷 ؙٔؒأز     
      
13. © 2019, Amazon Web Services, Inc. or its Affiliates. AWS StepFunctions / Apache Airflow דػ؎فٓ؎ٝ圓眠 on AWS
14. © 2019, Amazon Web Services, Inc. or its Affiliates. AWS Step Functions ׾⢪׏׋ػ؎فٓ؎ٝך圓眠⢽ Training Deploy Train/Valid/Test Data Data Scientists/ Developers Git Push AWS Glue Amazon S3 Amazon SageMaker AWS CodeCommit or 3rd party Git repository Amazon S3 欰ر٦ةכ S3 ח⥂㶷 㷕统幥׫ךٌرٕכ S3 ח⥂㶷ׁ׸׷ 鐰⣣٥劤殢欽ך 䱿锷ؒٝسه؎ٝز⡲䧭 ⵸Ⳣ椚٥㢌䳔䖓ך 㷕统欽ךر٦ة׮ S3 ח⥂㶷 Dev Prod Dev Endpoint Prod Endpoint AWS Step Functions workflow Start training job
15. © 2019, Amazon Web Services, Inc. or its Affiliates. 鐰⣣٥劤殢欽ך 䱿锷ؒٝسه؎ٝز⡲䧭 AWS Step Functions ׾⢪׏׋ػ؎فٓ؎ٝך圓眠⢽ [Blog] Training Deploy Train/Valid/Test Data Data Scientists/ Developers Git Push Git webhook Model AWS Glue Amazon S3 Amazon SageMaker AWS CodeCommit or 3rd party Git repository Amazon S3 Amazon Elastic Container Registry (ECR) AWS CodeBuild 㷕统٥䱿锷ך؝٦سָ ろת׸׷؝ٝذش׾ ٖهآزٔח縧ֻ 欰ر٦ةכ S3 ח⥂㶷 㷕统幥׫ךٌرٕכ S3 ח⥂㶷ׁ׸׷ Dev Prod Dev Endpoint Prod Endpoint AWS Step Functions workflow ⵸Ⳣ椚٥㢌䳔䖓ך 㷕统欽ךر٦ة׮ S3 ח⥂㶷
16. © 2019, Amazon Web Services, Inc. or its Affiliates. Apache Airflow [Blog] • Python  DAG (  ) 
      • Amazon SageMaker   
17. © 2019, Amazon Web Services, Inc. or its Affiliates. Kubernetes / Kubeflow ⢪ְ׋ְ➂ぢֽך䞔㜠 on AWS
18. © 2019, Amazon Web Services, Inc. or its Affiliates. Kubernetes / Kubeflow on AWS [Blog] EKS + EC2 + ECR   Kubeflow  Jupyter Hub 
     Amazon Elastic Container Service for Kubernetes (EKS) Managed control plane Amazon Elastic Container Registry (ECR) Docker images for training/serving Pod Pod Pod Model serving / inference Model training Worker nodes Spawn • Kubeflow Pipelines  WIP [GitHub issue]
19. © 2019, Amazon Web Services, Inc. or its Affiliates.
    
20. © 2019, Amazon Web Services, Inc. or its Affiliates. References • ML@Loft [Blog#1] • Amazon SageMaker ✲⢽牸׶ [Web#1, Blog#2, Blog#3, Blog#4] • AWS Black Belt Online Seminar • Basic [Movie, Slides] • Advanced [Movie, Slides] • AWS ـؚٗ Apache Airflow [Blog], Kubeflow [Blog], • HPO SageMaker default [Blog], Optuna [Blog] •   GPU 
     [#MPH] • SageMaker Containers [GitHub] • Jupyter ⟃㢩ךؒر؍ة٦/IDE ⢪ְ׋ְ㜥さכծ׉ך橆㞮ח [SDK] Ⰵ׸ג API 〨ֻ
21. © 2019, Amazon Web Services, Inc. or its Affiliates. Event info • [Startup Day ؿؓٗ٦،حف] Upgrade UX with Data / 堣唒㷕统׾欽ְ׋؟٦ؽأ何㊣ 2019 䎃 5 剢 14 傈 (抟) 19:00 - 21:00 [歍׃鴥׫] • (Online) Amazon SageMaker 堣唒㷕统ؒٝآص،ぢֽ⡤꿀عٝؤؔٝ 2019 䎃 5 剢 17 傈 (ꆃ) 14:00 - 15:30 [歍׃鴥׫] • 痥5㔐 Amazon SageMaker ✲⢽牸׶ 2019 䎃 5 剢 21 傈 (抟) 13:45 - 17:30 [歍׃鴥׫] • AWS Summit Tokyo 2019 (Osaka ׮ⴽ傈ד֮׶תׅ) 2019 䎃 6 剢 12 傈 (宏) - 14 傈 (ꆃ) [歍׃鴥׫]
22. © 2019, Amazon Web Services, Inc. or its Affiliates. © 2019, Amazon Web Services, Inc. or its Affiliates. Thank you! ML@Loft 如㔐 #3 כ 6/21 (ꆃ) ✮㹀דׅ