Upgrade to Pro — share decks privately, control downloads, hide ads and more …

SIH_AWS_ML.pdf

Suman Debnath
February 04, 2020

 SIH_AWS_ML.pdf

AWS ML Introduction

Suman Debnath

February 04, 2020
Tweet

More Decks by Suman Debnath

Other Decks in Technology

Transcript

  1. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | AWS | Introduction to Machine Learning Suman Debnath, Principal Developer Advocate
  2. AI | ML | DL – Maybe a picture is

    better? Great Resource: The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World by Pedro Domingos
  3. F2 U' R' L F2 R L' U' Learning function

    1% accuracy R U r U R U2 r U 2% accuracy
  4. Supervised Learning – How Machines Learn Human intervention and validation

    required e.g. Photo classification and tagging Input Label Machine Learning Algorithm Labrador Prediction Cat Training Data ? Label Labrador Adjust Model
  5. Unsupervised Learning (learning without labels) No human intervention required (e.g.

    Customer segmentation) Input Machine Learning Algorithm Prediction
  6. Machine Learning Use Cases Supervised Learning Ø Classification • Spam

    detection • Customer churn prediction Ø Regression • House price prediction • Demand forecasting Unsupervised Learning Ø Clustering • Customer segmentation There are other types as well (Reinforcement Learning, for example) but these two are the primary areas today
  7. AI/ML/DL Workflow Performance monitoring & adaptation 8 Data Acquisition &

    Storage 1 Model & Framework selection 3 Model Training 4 Hyper parameter tuning 5 Model testing and simulation 6 Model Deployment (inference) 7 Data Labelling 2
  8. © 2020 Amazon Web Services, Inc. or its affiliates. All

    rights reserved | Machine Learning with AWS
  9. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW NEW NEW NEW
  10. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW NEW NEW NEW
  11. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Vision: Amazon Rekognition Key Features Object & Scene Detection Image Moderation Facial Analysis Facial Comparison Facial Recognition Celebrity Recognition
  12. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Polly “The temperature in Brussels is 15°C” “The temperature in Brussels is 15 degrees Celsius” Speech: Amazon Polly Text in; lifelike speech out Key Features • 60+ Voices • 25+ Languages • Lip-Syncing & Text Highlighting • Fine-grained Voice Control • Custom Vocabularies
  13. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Speech: Amazon Transcribe Automatic Speech Recognition Time stamps Support for both regular & telephony audio Punctuation & formatting S3 integration Recognize multiple speakers Custom dictionaries ? !
  14. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Text: Amazon Comprehend Natural Language Processing Sentiment Entities Languages Key phrases Topic modeling
  15. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Text: Amazon Comprehend Extract insights from text Amazon.com, Inc. is located in Seattle, WA and was founded July 5th, 1994 by Jeff Bezos. Our customers love buying everything from books to blenders at great prices Named Entities - Amazon.com: Organization - Seattle, WA: Location - July 5th,1994: Date - Jeff Bezos: Person Keyphrases - Our customers - books - blenders - great prices Sentiment Positive Language English
  16. © 2018, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Trademark The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW NEW NEW NEW
  17. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker |
  18. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Adjust Iterate
  19. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Ground Truth Notebooks Training Inference Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate
  20. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker AWS Console Dashboard
  21. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  22. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Easy instructions for human labeling
  23. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  24. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | • Jupyter notebooks • Support Jupyter Lab • Multiple built-in kernels • Bring your own kernels • Integrate with Git • Sample notebooks
  25. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  26. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | More than 300 example notebooks • ML Introduction • Advanced functionality • Hyper parameter optimization • Reinforcement learning • Ground Truth • Neo • Python SDK • Tensorflow • Mxnet • Pytorth • FastAI
  27. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Amazon SageMaker Dev desktops SageMaker Environment SageMaker Notebook EC2 EC2 EC2 Training Inference Control plane (create notebook, start training, … ) Data plane
  28. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | One click in Console Using API/SDK - OR - Launch Training Amazon SageMaker |
  29. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Estimators: Encapsulate training on SageMaker. Models: Encapsulate built ML models. Predictors: Provide real-time inference and transformation using Python data-types against a SageMaker endpoint. Session: Provides a collection of methods for working with SageMaker resources. SageMaker Python SDK
  30. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Built-in algorithms XGBoost, Linear Learner K-means, K-nearest Neighbors, PCA, Obejct2vec, BlazingText Image classification, Object detection, semantic segmentation LDA and NTM for topic modeling, seq2seq for translation Random Cut Forest, IP insights Regression and Classification Clustering and pre-processing Computer Vision Text and documents Anomaly detection Forecasting and Recommendations DeepAR and Factorization Machines
  31. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  32. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Hosting Services Batch Transform Elastic Inference Trained Model Neo Run Anywhere DeepRacer Amazon SageMaker | DeepLens Marketplace
  33. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Practical education on ML for new & experienced practitioners Based on the same material used to train Amazon developers To learn more: AWS Machine Learning University
  34. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | ml.aws
  35. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Free AWS
  36. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | /suman-d /_sumand
  37. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Thank You