Upgrade to Pro — share decks privately, control downloads, hide ads and more …

SIH_AWS_ML.pdf

 SIH_AWS_ML.pdf

AWS ML Introduction

F741e7e29aa3a4476d48a64ac2a73874?s=128

Suman Debnath

February 04, 2020
Tweet

Transcript

  1. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | AWS | Introduction to Machine Learning Suman Debnath, Principal Developer Advocate
  2. AI | ML | DL – Maybe a picture is

    better? Great Resource: The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World by Pedro Domingos
  3. 43,252,003,274,489,856,000 43 QUINTILLION UNIQUE COMBINATIONS

  4. F2 U' R' L F2 R L' U' Learning function

  5. F2 U' R' L F2 R L' U' Learning function

    1% accuracy R U r U R U2 r U 2% accuracy
  6. Learning function 20% accuracy 40% accuracy 60% accuracy 80% accuracy

    95% accuracy 2% accuracy
  7. Learning function 95% accuracy ? F2 R F R′ B′

    D F D′ B D F
  8. SOLVED IN 0.9 SECONDS

  9. Don’t code the patterns Let the system Learn Through Data

  10. We Call This Approach Machine Learning

  11. Types Of Machine Learning

  12. Supervised Learning (depends on labeled datasets) Kid No, it’s a

    Labrador.
  13. Supervised Learning – How Machines Learn Human intervention and validation

    required e.g. Photo classification and tagging Input Label Machine Learning Algorithm Labrador Prediction Cat Training Data ? Label Labrador Adjust Model
  14. Unsupervised Learning (learning without labels) No human intervention required (e.g.

    Customer segmentation) Input Machine Learning Algorithm Prediction
  15. Machine Learning Use Cases Supervised Learning Ø Classification • Spam

    detection • Customer churn prediction Ø Regression • House price prediction • Demand forecasting Unsupervised Learning Ø Clustering • Customer segmentation There are other types as well (Reinforcement Learning, for example) but these two are the primary areas today
  16. AI/ML/DL Workflow Performance monitoring & adaptation 8 Data Acquisition &

    Storage 1 Model & Framework selection 3 Model Training 4 Hyper parameter tuning 5 Model testing and simulation 6 Model Deployment (inference) 7 Data Labelling 2
  17. © 2020 Amazon Web Services, Inc. or its affiliates. All

    rights reserved | Machine Learning with AWS
  18. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW NEW NEW NEW
  19. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW NEW NEW NEW
  20. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Vision: Amazon Rekognition Key Features Object & Scene Detection Image Moderation Facial Analysis Facial Comparison Facial Recognition Celebrity Recognition
  21. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Polly “The temperature in Brussels is 15°C” “The temperature in Brussels is 15 degrees Celsius” Speech: Amazon Polly Text in; lifelike speech out Key Features • 60+ Voices • 25+ Languages • Lip-Syncing & Text Highlighting • Fine-grained Voice Control • Custom Vocabularies
  22. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Speech: Amazon Transcribe Automatic Speech Recognition Time stamps Support for both regular & telephony audio Punctuation & formatting S3 integration Recognize multiple speakers Custom dictionaries ? !
  23. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Text: Amazon Comprehend Natural Language Processing Sentiment Entities Languages Key phrases Topic modeling
  24. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Text: Amazon Comprehend Extract insights from text Amazon.com, Inc. is located in Seattle, WA and was founded July 5th, 1994 by Jeff Bezos. Our customers love buying everything from books to blenders at great prices Named Entities - Amazon.com: Organization - Seattle, WA: Location - July 5th,1994: Date - Jeff Bezos: Person Keyphrases - Our customers - books - blenders - great prices Sentiment Positive Language English
  25. © 2018, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Trademark The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH NEW CHATBOTS PERSONALIZATION FORECASTING FRAUD NEW DEVELOPMENT NEW CONTACT CENTERS NEW Amazon SageMaker Ground Truth Augmented AI SageMaker Neo Built-in algorithms SageMaker Notebooks NEW SageMaker Experiments NEW Model tuning SageMaker Debugger NEW SageMaker Autopilot NEW Model hosting SageMaker Model Monitor NEW Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE NEW NEW NEW NEW NEW
  26. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker |
  27. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Adjust Iterate
  28. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Ground Truth Notebooks Training Inference Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate
  29. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker AWS Console Dashboard
  30. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  31. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Easy instructions for human labeling
  32. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  33. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | • Jupyter notebooks • Support Jupyter Lab • Multiple built-in kernels • Bring your own kernels • Integrate with Git • Sample notebooks
  34. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  35. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | More than 300 example notebooks • ML Introduction • Advanced functionality • Hyper parameter optimization • Reinforcement learning • Ground Truth • Neo • Python SDK • Tensorflow • Mxnet • Pytorth • FastAI
  36. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Amazon SageMaker Dev desktops SageMaker Environment SageMaker Notebook EC2 EC2 EC2 Training Inference Control plane (create notebook, start training, … ) Data plane
  37. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | One click in Console Using API/SDK - OR - Launch Training Amazon SageMaker |
  38. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Estimators: Encapsulate training on SageMaker. Models: Encapsulate built ML models. Predictors: Provide real-time inference and transformation using Python data-types against a SageMaker endpoint. Session: Provides a collection of methods for working with SageMaker resources. SageMaker Python SDK
  39. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker | Built-in algorithms XGBoost, Linear Learner K-means, K-nearest Neighbors, PCA, Obejct2vec, BlazingText Image classification, Object detection, semantic segmentation LDA and NTM for topic modeling, seq2seq for translation Random Cut Forest, IP insights Regression and Classification Clustering and pre-processing Computer Vision Text and documents Anomaly detection Forecasting and Recommendations DeepAR and Factorization Machines
  40. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Amazon SageMaker Build, train, and deploy machine learning models quickly Adjust Iterate Ground Truth Notebooks Training Inference
  41. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Hosting Services Batch Transform Elastic Inference Trained Model Neo Run Anywhere DeepRacer Amazon SageMaker | DeepLens Marketplace
  42. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Practical education on ML for new & experienced practitioners Based on the same material used to train Amazon developers To learn more: AWS Machine Learning University
  43. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | ml.aws
  44. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Free AWS
  45. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | /suman-d /_sumand
  46. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Confidential and Trademark © 2020 Amazon Web Services, Inc. or its affiliates. All rights reserved | Thank You