AI and Machine Learning on AWS

Keynote presentation for the AI For Good Hackathon by Deep Berlin -- April 2020.

https://deep-berlin.ai/hackathon2020/
https://github.com/data-science-on-aws/ai4good-hackathon
https://www.youtube.com/watch?v=y2VvcR26EOY

Transcript

1. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Antje Barth Developer Advocate AI/ML Amazon Web Services @anbarth data-science-on-aws
3. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. The reach of ML is growing
4. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
5. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Our mission at AWS Put machine learning in the hands of every developer
6. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
7. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training & tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon SageMaker DeepGraphLibrary
8. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. K e r a s Frameworks and interfaces NVIDIA Tesla V100 GPUs (14x faster than P2) P3 ML AMIs 5,120 Tensor Cores 128 GB of memory 1 petaflop of compute NVLink 2.0 Infrastructure (GPU) Intel Xeon 3.0 GHz Skylake CPU (25% better performance/price than C4) ML AMIs 72 vCPUs 144 GB of memory AVX-512 Nitro Hypervisor Infrastructure (CPU) C5 Complete control over frameworks & infrastructure: For the data scientist, AI researcher, or advanced ML practitioner
9. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. GPU-accelerated instances
10. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Well-suited for AI/ML simulation and inference workloads Well-suited for AI/ML training workloads Well-suited for notebooks Amazon EC2 Instance Options
11. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training & tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon SageMaker DeepGraphLibrary
12. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. ML workflow
13. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ground Truth Notebooks Training Inference Amazon SageMaker
14. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon SageMaker Ground Truth Annotating data at scale
15. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon SageMaker Notebook Instances • Fully managed instances, from ml.t2.medium to p3.16xlarge • Pre-installed with Jupyter and Conda environments • Python 2.7 & 3.6 • Open-source libraries (TensorFlow, Apache MXNet, etc.) • Beta support for R • Amazon Elastic Inference for cost-effective GPU acceleration • Lifecycle configurations • VPC, encryption, etc. • Get to work in minutes
16. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon SageMaker built-in algorithms Supported frameworks AWS Marketplace algorithms Model Data Data Data Data Orchestration Built-in algorithms Amazon SageMaker Model Model Model Orchestration Amazon SageMaker Custom script Algorithms or models Custom script on supported framework BYO algorithm and framework 17 built-in high- performance algorithms Supported frameworks: Apache MXNet, TensorFlow, Scikit- learn, PyTorch, Chainer Docker containers with your own algorithms and frameworks Third-party algorithms and models Supported frameworks Orchestration Amazon SageMaker Custom script and custom framework Orchestration Amazon SageMaker Amazon SageMaker training
17. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Deployment Options Model in Amazon S3 Amazon SageMaker real-time endpoint 1 line of code Vanilla HTTPS Post data, get a prediction Any tool, any language Auto Scaling available Fully managed deployment Amazon SageMaker batch transform 1 line of code Predict data stored in S3 Read results from S3 Amazon container services (ECS, EKS, Fargate) Use AWS Deep Learning containers Use your own container Anywhere you like Grab the model in S3 and run!
18. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. The AWS ML Stack Broadest and most complete set of Machine Learning capabilities VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training & tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Comprehend +Medical Amazon Translate Amazon Lex Amazon Personalize Amazon Forecast Amazon Fraud Detector Amazon CodeGuru AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon SageMaker DeepGraphLibrary
19. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Rekognition Deep-Learning-Based Image and Video Analysis
20. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Labels (object, scenes, and activities) Face detection and analysis Text in image Unsafe image and video detection Pathing Face search Real-time video analysis Celebrity recognition Amazon Rekognition Image and video analysis
21. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Custom Labels
22. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Custom Labels Torque Converter
23. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
24. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Curated and trusted catalog of over hundreds of ML model packages and algorithms • 14 industry segments • 54 APN Partners Simple software provisioning from AWS Marketplace • Consolidated into your AWS billing • Free | Free trial | Paid subscriptions Amazon SageMaker AWS Marketplace for machine learning
25. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Quickly find diverse data in one place Efficiently access third-party data Easily analyze data • Discover data products in the AWS Console and in AWS Marketplace • Data gets delivered into your Amazon Simple Storage Service (Amazon S3) bucket • Over 500 product datasets can be tried for free! • Use Amazon CloudWatch event rules to trigger the ML pipeline on availability of new data revisions Use AWS Data Exchange for your data needs!
26. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Getting started http://aws.amazon.com/free https://ml.aws https://aws.amazon.com/sagemaker https://github.com/aws/sagemaker-python-sdk https://github.com/aws/sagemaker-spark https://github.com/awslabs/amazon-sagemaker-examples
27. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://github.com/data-science-on-aws/ai4good-hackathon
28. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Go Build! Here to help you build