AWS AI Services Overview (Oct 2020)

A high level overview of all the AWS AI Services (pre re:Invent 2020!)

Transcript

1. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Gillian Armstrong, @virtualgill 10 Oct 2020 AWS AI Services Overview Pre-reInvent Edition!
2. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training and tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon CodeGuru Amazon SageMaker DeepGraphLibrary Amazon Fraud Detector Amazon Translate The AWS ML Stack
3. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training and tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon CodeGuru Amazon SageMaker DeepGraphLibrary Amazon Fraud Detector Amazon Translate The AWS ML Stack
4. If I needed Butter…. Managed AI Services Custom Models Custom Models and Algorithms - Purchase Churn - Churn Maintenance - Time to make Butter - Purchase Cow, Churn, Field, Barn - Look after Cow (food, shelter, care, milking) - Field/Barn/Churn Maintenance - Time to make Butter Buy butter from shop Buy raw milk from farm Self-Sufficient – own Cow
5. The AWS ML Stack
6. Amazon Polly Text to Speech Nov 2016 Serverless - Choose from dozens of languages and voices - Adjust Speaking Style, Speech Rate, Pitch and Loudness - Custom Lexicons - Newscaster and Conversational style Modes - Standard TTS and Neural TTS options Standard TTS $4.00 per 1 million characters Neural TTS $16.00 per 1 million characters for speech
7. Amazon Lex Conversational Interface Builder Nov 2016 Serverless $0.004 per voice request, $0.00075 per text request **plus charges as per service - High quality speech recognition - Natural Language Understanding - Multi-turn conversations, Intent Chaining - Quick deploy to multiple platforms - Native integrations with Amazon Polly, AWS Lambda, Amazon Comprehend Sentiment and Kendra**
8. Amazon Rekognition Image and Video Analysis Nov 2016 Serverless - Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) Standard: $0.001/image, $0.10/min Live Video Face Search: $0.12/min Face storage: $0.00001/face per month
9. Amazon Rekognition Image and Video Analysis Nov 2016 Serverless - Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) - Custom Labels (images) – Nov 2019 Custom Label Training $1/hour Custom Label Inference $4/hour
10. - Offline and Real-time transcription - Custom vocabulary - Vocabulary filtering - Multiple speaker and channel identification - Automatic content redaction - Automatic language identification - Custom language models (Aug 2020) Amazon Transcribe Speech to Text Nov 2017 Serverless Transcription: $0.0004/second Custom Transcription: $0.060/second additional cost Content Redaction: $0.00004/second
11. Amazon Translate Neural Machine Translation Nov 2017 Serverless - Language Identification - Batch and Real-Time Translations - Custom Terminology $0.000015 per character, billed monthly
12. - Keyphrase Extraction - Sentiment Analysis - Syntax Analysis - Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sept 2020) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Standard APIs: $0.0001/100 characters Topic Modelling: $1 (first 100MB) + $0.004/additional MB
13. - Keyphrase Extraction - Sentiment Analysis - Syntax Analysis - Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sep 2020) - Custom Classification (Nov 2018) - Custom Named Entity Recognition (Nov 2018) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Custom Training $3/hour, Model Management $0.50/month Inference Batch $0.0005/100 chars, Real Time $0.0005/instance per second
14. Amazon Textract OCR – text, forms and tables Nov 2018 Serverless OCR - $0.0015/page Tables - $0.015/page (OCR included) Forms - $0.05/page (OCR included) - Optical Character Recognition (OCR) - Table Detection - Forms Extraction (key-value pairs)
15. Amazon Personalize Recommendations Engine Nov 2018 Serverless $0.05 data ingestion/GB, $0.24/training hour Real Time: $0.20 per TPS-hour Batch: $0.067/ 1000 recommendations - Real Time and Batch Recommendations - New user and new item recommendations - Contextual recommendations - Similar item recommendations
16. Amazon Forecast Forecasts Nov 2018 Serverless $0.088 data ingestion/GB, $0.24 per training hour Forecasts $0.60 per 1,000 forecasts - AutoML using historical time series data to create forecast - Visualisations - Probabilistic forecasts
17. Amazon Fraud Detector Fraud Detection Dec 2019 Serverless $0.39 training/hour, $0.06 model hosting/hour Real Time: $0.030/prediction Real Time with Rules: $0.005/prediction - Real time Fraud Detection - AutoML for Fraud Detection - Integrated Rules Engine - SageMaker Integration
18. Amazon Kendra Enterprise Search with Natural Language Capabilities Dec 2019 Serverless $7.00/hour up to 500,000 docs and 40,000 requests/day Connector: $0.000001/document and $0.35/hour when syncing - Natural language & keyword support - Reading comprehension & FAQ matching - Document ranking - Connectors - Relevance tuning - Domain optimization
19. Amazon CodeGuru Automated Code Review and Application Performance Recommendations Dec 2019 Serverless Code Profiler: $0.005/hour (for first 36,000 per month, then free) Review Full Repo: $0.50 per 100 lines of code Review Pull Request: $0.75 per 100 lines of code - Runtime Profiler - Intelligent recommendations - Anomaly detection - Code Reviewer (Java only) - Pull Request Automated Recommendations - Full Repository Analysis
20. Special Mentions… (technically in the ML Services layer)
21. Amazon SageMaker Ground Truth Label Training Data Nov 2018 Serverless Standard Dataset Unit: $0.08/object 3D point cloud: $3.00/frame (additional charges for using Mechanical Turk for reviewer) - Out of the Box templates for: - Video object detection, tracking and clip classification - 3D point clouds object detection, tracking and semantic segmentation - Image object detection, classification and semantic segmentation - Text classification and NER (named entity recognition) - Ability to use either private or public workforces - Ability to create custom templates and workflows
22. Amazon Augmented AI (A2I) Human Review of Machine Learning Predictions Dec 2019 Serverless Rekognition Review: $0.03 / image Textract Review: $0.03 / page Custom Model: $0.08 / object (additional charges for using Mechanical Turk for reviewer) - Integration with AI Services for Human Review of low confidence machine learning predictions - Built in Workflows - Ability to use either private or public workforces - Out of the Box Templates for reviewer instructions - Ability to use Custom Templates and Workflows
23. AWS AI Services Vision • Amazon Rekognition Speech • Amazon Polly • Amazon Transcribe Text • Amazon Comprehend • Amazon Translate • Amazon Textract Search • Amazon Kendra Chatbots • Amazon Lex Personalization • Amazon Personalize Forecasting • Amazon Forecast Fraud • Amazon Fraud Detector Development • Amazon CodeGuru Labeling • Amazon SageMaker Ground Truth Review • Amazon Augmented AI
24. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES Amazon Textract Amazon Kendra Contact Lens For Amazon Connect Amazon CodeGuru Amazon Fraud Detector Amazon Translate The AWS ML Stack
25. Thank you! Questions? Reach out to me @virtualgill