Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWS で MLOps を考える時の選択肢 / ML@Loft #2

AWS で MLOps を考える時の選択肢 / ML@Loft #2

AWS では Amazon SageMaker というサービスを提供していて、機械学習・深層学習ワークロードを実行するお客様に幅広い選択肢を提供しています。また、Amazon SageMaker を中心とした MLOps パイプラインの組み方にもいくつかの選択肢があります。本講演ではよくお客さまとの会話で出てくる、
- Jupyter Notebook を使った機械学習開発ワークフロー
- AWS StepFunctions / Apache Airflow でパイプライン構築
- Kubernetes / Kubeflow 使いたい人向けの情報
などのキーワードを中心にお話ししようと思います。

5c772b62f1974e9da3a88fbb4ef02696?s=128

Yoshitaka Haribara

May 13, 2019
Tweet

Transcript

  1. © 2019, Amazon Web Services, Inc. or its Affiliates. ꆙ⾱

    ⢕顜 Associate Solutions Architect, Amazon Web Services Japan, K.K. 2019-05-13 AWS ד MLOps ׾罋ִ׷儗ך鼅䫛肇 ML@Loft #2 #MLLoft
  2. © 2019, Amazon Web Services, Inc. or its Affiliates. 荈䊹稱➜

    ꆙ⾱ ⢕顜, Ph.D. AWS أُ٦ءّٝ،٦ؗذؙز • أة٦ز،حفךֶ㹏圫׾䬐䔲 • 㣐㷕ꤍדכصُ٦ٕٓطحزٙ٦ؙ 鎘皾锷涸牞穗猰㷕 ך灇瑔㹓ד 穈さׇ剑黝⻉ך灇瑔 • 㥨ֹז؟٦ؽأכ Amazon SageMaker 
  3. © 2019, Amazon Web Services, Inc. or its Affiliates. Table

    of contents • $!&F;  >?< 973@ %'$' • AWS ( G6A • Jupyter Notebook / JupyterLab * #8=%'$' • AWS Step Functions / Apache Airflow "&8= • Kubernetes / Kubeflow *)1 42 • Key messages • +, ' • ''F;EC: • B./B./)5D H- 0B./
  4. © 2019, Amazon Web Services, Inc. or its Affiliates. %&#

      !   )" %     ($'
  5. © 2019, Amazon Web Services, Inc. or its Affiliates. 

              ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅
  6. © 2019, Amazon Web Services, Inc. or its Affiliates. %

    &  '! %   #$" %  ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅   =  / 
  7. © 2019, Amazon Web Services, Inc. or its Affiliates. 

    !  "       ر٦ةך崧׸ ٌرٕ圓眠ך 崧׸٥濼鋅    
  8. © 2019, Amazon Web Services, Inc. or its Affiliates. %,(-WKFE8Q/$

    / /$0<  +N6 UY: • */'/. /- ! WK?; -" @4 X • 9SJ7.1HMD 2I> • OPL 28Q =T> 5R: MLOps GA CV :Z, nB3)&#/! Vol.1, No.1 (2019). Service Data ML Ops
  9. © 2019, Amazon Web Services, Inc. or its Affiliates. Jupyter

    Notebook / JupyterLab ׾⢪׏׋ٌرٕ圓眠ٙ٦ؙؿٗ٦ on AWS
  10. © 2019, Amazon Web Services, Inc. or its Affiliates. Amazon

    SageMaker =341,;/5.,; 2:$!%$" ,;% )@$6&  ?/ -<0>(  ,; %# (HPO) ,;8*   97 "# 8*  " "# 8*  +'97 Amazon EC2 P3 Instances Amazon SageMaker RL Amazon SageMaker Ground Truth Amazon Elastic Inference AWS Marketplace for Machine Learning Amazon SageMaker Neo
  11. © 2019, Amazon Web Services, Inc. or its Affiliates. 㹋ꥷ

    Amazon SageMaker כ㢳ֻ׾鍑寸׃גֻ׸׷ AWS Cloud Jupyter ⟃㢩ךؒر؍ة٦ /IDE ⢪ְ׋ְ㜥さכծ ׉ך橆㞮ח [SDK] Ⰵ׸ג API 〨ֻ         
  12. © 2019, Amazon Web Services, Inc. or its Affiliates. 㹋ꥷ

    Amazon SageMaker כ㢳ֻ׾鍑寸׃גֻ׸׷ Amazon API Gateway AWS Lambda Amazon S3 AWS Cloud 䱿锷 ؙٔؒأز         
  13. © 2019, Amazon Web Services, Inc. or its Affiliates. AWS

    StepFunctions / Apache Airflow דػ؎فٓ؎ٝ圓眠 on AWS
  14. © 2019, Amazon Web Services, Inc. or its Affiliates. AWS

    Step Functions ׾⢪׏׋ػ؎فٓ؎ٝך圓眠⢽ Training Deploy Train/Valid/Test Data Data Scientists/ Developers Git Push AWS Glue Amazon S3 Amazon SageMaker AWS CodeCommit or 3rd party Git repository Amazon S3 欰ر٦ةכ S3 ח⥂㶷 㷕统幥׫ךٌرٕכ S3 ח⥂㶷ׁ׸׷ 鐰⣣٥劤殢欽ך 䱿锷ؒٝسه؎ٝز⡲䧭 ⵸Ⳣ椚٥㢌䳔䖓ך 㷕统欽ךر٦ة׮ S3 ח⥂㶷 Dev Prod Dev Endpoint Prod Endpoint AWS Step Functions workflow Start training job
  15. © 2019, Amazon Web Services, Inc. or its Affiliates. 鐰⣣٥劤殢欽ך

    䱿锷ؒٝسه؎ٝز⡲䧭 AWS Step Functions ׾⢪׏׋ػ؎فٓ؎ٝך圓眠⢽ [Blog] Training Deploy Train/Valid/Test Data Data Scientists/ Developers Git Push Git webhook Model AWS Glue Amazon S3 Amazon SageMaker AWS CodeCommit or 3rd party Git repository Amazon S3 Amazon Elastic Container Registry (ECR) AWS CodeBuild 㷕统٥䱿锷ך؝٦سָ ろת׸׷؝ٝذش׾ ٖهآزٔח縧ֻ 欰ر٦ةכ S3 ח⥂㶷 㷕统幥׫ךٌرٕכ S3 ח⥂㶷ׁ׸׷ Dev Prod Dev Endpoint Prod Endpoint AWS Step Functions workflow ⵸Ⳣ椚٥㢌䳔䖓ך 㷕统欽ךر٦ة׮ S3 ח⥂㶷
  16. © 2019, Amazon Web Services, Inc. or its Affiliates. Apache

    Airflow [Blog] • Python  DAG (  )   • Amazon SageMaker   
  17. © 2019, Amazon Web Services, Inc. or its Affiliates. Kubernetes

    / Kubeflow ⢪ְ׋ְ➂ぢֽך䞔㜠 on AWS
  18. © 2019, Amazon Web Services, Inc. or its Affiliates. Kubernetes

    / Kubeflow on AWS [Blog] EKS + EC2 + ECR   Kubeflow  Jupyter Hub  Amazon Elastic Container Service for Kubernetes (EKS) Managed control plane Amazon Elastic Container Registry (ECR) Docker images for training/serving Pod Pod Pod Model serving / inference Model training Worker nodes Spawn • Kubeflow Pipelines  WIP [GitHub issue]
  19. © 2019, Amazon Web Services, Inc. or its Affiliates. 

  20. © 2019, Amazon Web Services, Inc. or its Affiliates. References

    • ML@Loft [Blog#1] • Amazon SageMaker ✲⢽牸׶ [Web#1, Blog#2, Blog#3, Blog#4] • AWS Black Belt Online Seminar • Basic [Movie, Slides] • Advanced [Movie, Slides] • AWS ـؚٗ Apache Airflow [Blog], Kubeflow [Blog], • HPO SageMaker default [Blog], Optuna [Blog] •   GPU  [#MPH] • SageMaker Containers [GitHub] • Jupyter ⟃㢩ךؒر؍ة٦/IDE ⢪ְ׋ְ㜥さכծ׉ך橆㞮ח [SDK] Ⰵ׸ג API 〨ֻ
  21. © 2019, Amazon Web Services, Inc. or its Affiliates. Event

    info • [Startup Day ؿؓٗ٦،حف] Upgrade UX with Data / 堣唒㷕统׾欽ְ׋؟٦ؽأ何㊣ 2019 䎃 5 剢 14 傈 (抟) 19:00 - 21:00 [歍׃鴥׫] • (Online) Amazon SageMaker 堣唒㷕统ؒٝآص،ぢֽ⡤꿀عٝؤؔٝ 2019 䎃 5 剢 17 傈 (ꆃ) 14:00 - 15:30 [歍׃鴥׫] • 痥5㔐 Amazon SageMaker ✲⢽牸׶ 2019 䎃 5 剢 21 傈 (抟) 13:45 - 17:30 [歍׃鴥׫] • AWS Summit Tokyo 2019 (Osaka ׮ⴽ傈ד֮׶תׅ) 2019 䎃 6 剢 12 傈 (宏) - 14 傈 (ꆃ) [歍׃鴥׫]
  22. © 2019, Amazon Web Services, Inc. or its Affiliates. ©

    2019, Amazon Web Services, Inc. or its Affiliates. Thank you! ML@Loft 如㔐 #3 כ 6/21 (ꆃ) ✮㹀דׅ