Slide 1

Slide 1 text

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Gillian Armstrong, @virtualgill 10 Oct 2020 AWS AI Services Overview Pre-reInvent Edition!

Slide 2

Slide 2 text

VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training and tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon CodeGuru Amazon SageMaker DeepGraphLibrary Amazon Fraud Detector Amazon Translate The AWS ML Stack

Slide 3

Slide 3 text

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training and tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon CodeGuru Amazon SageMaker DeepGraphLibrary Amazon Fraud Detector Amazon Translate The AWS ML Stack

Slide 4

Slide 4 text

If I needed Butter…. Managed AI Services Custom Models Custom Models and Algorithms - Purchase Churn - Churn Maintenance - Time to make Butter - Purchase Cow, Churn, Field, Barn - Look after Cow (food, shelter, care, milking) - Field/Barn/Churn Maintenance - Time to make Butter Buy butter from shop Buy raw milk from farm Self-Sufficient – own Cow

Slide 5

Slide 5 text

The AWS ML Stack

Slide 6

Slide 6 text

Amazon Polly Text to Speech Nov 2016 Serverless - Choose from dozens of languages and voices - Adjust Speaking Style, Speech Rate, Pitch and Loudness - Custom Lexicons - Newscaster and Conversational style Modes - Standard TTS and Neural TTS options Standard TTS $4.00 per 1 million characters Neural TTS $16.00 per 1 million characters for speech

Slide 7

Slide 7 text

Amazon Lex Conversational Interface Builder Nov 2016 Serverless $0.004 per voice request, $0.00075 per text request **plus charges as per service - High quality speech recognition - Natural Language Understanding - Multi-turn conversations, Intent Chaining - Quick deploy to multiple platforms - Native integrations with Amazon Polly, AWS Lambda, Amazon Comprehend Sentiment and Kendra**

Slide 8

Slide 8 text

Amazon Rekognition Image and Video Analysis Nov 2016 Serverless - Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) Standard: $0.001/image, $0.10/min Live Video Face Search: $0.12/min Face storage: $0.00001/face per month

Slide 9

Slide 9 text

Amazon Rekognition Image and Video Analysis Nov 2016 Serverless - Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) - Custom Labels (images) – Nov 2019 Custom Label Training $1/hour Custom Label Inference $4/hour

Slide 10

Slide 10 text

- Offline and Real-time transcription - Custom vocabulary - Vocabulary filtering - Multiple speaker and channel identification - Automatic content redaction - Automatic language identification - Custom language models (Aug 2020) Amazon Transcribe Speech to Text Nov 2017 Serverless Transcription: $0.0004/second Custom Transcription: $0.060/second additional cost Content Redaction: $0.00004/second

Slide 11

Slide 11 text

Amazon Translate Neural Machine Translation Nov 2017 Serverless - Language Identification - Batch and Real-Time Translations - Custom Terminology $0.000015 per character, billed monthly

Slide 12

Slide 12 text

- Keyphrase Extraction - Sentiment Analysis - Syntax Analysis - Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sept 2020) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Standard APIs: $0.0001/100 characters Topic Modelling: $1 (first 100MB) + $0.004/additional MB

Slide 13

Slide 13 text

- Keyphrase Extraction - Sentiment Analysis - Syntax Analysis - Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sep 2020) - Custom Classification (Nov 2018) - Custom Named Entity Recognition (Nov 2018) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Custom Training $3/hour, Model Management $0.50/month Inference Batch $0.0005/100 chars, Real Time $0.0005/instance per second

Slide 14

Slide 14 text

Amazon Textract OCR – text, forms and tables Nov 2018 Serverless OCR - $0.0015/page Tables - $0.015/page (OCR included) Forms - $0.05/page (OCR included) - Optical Character Recognition (OCR) - Table Detection - Forms Extraction (key-value pairs)

Slide 15

Slide 15 text

Amazon Personalize Recommendations Engine Nov 2018 Serverless $0.05 data ingestion/GB, $0.24/training hour Real Time: $0.20 per TPS-hour Batch: $0.067/ 1000 recommendations - Real Time and Batch Recommendations - New user and new item recommendations - Contextual recommendations - Similar item recommendations

Slide 16

Slide 16 text

Amazon Forecast Forecasts Nov 2018 Serverless $0.088 data ingestion/GB, $0.24 per training hour Forecasts $0.60 per 1,000 forecasts - AutoML using historical time series data to create forecast - Visualisations - Probabilistic forecasts

Slide 17

Slide 17 text

Amazon Fraud Detector Fraud Detection Dec 2019 Serverless $0.39 training/hour, $0.06 model hosting/hour Real Time: $0.030/prediction Real Time with Rules: $0.005/prediction - Real time Fraud Detection - AutoML for Fraud Detection - Integrated Rules Engine - SageMaker Integration

Slide 18

Slide 18 text

Amazon Kendra Enterprise Search with Natural Language Capabilities Dec 2019 Serverless $7.00/hour up to 500,000 docs and 40,000 requests/day Connector: $0.000001/document and $0.35/hour when syncing - Natural language & keyword support - Reading comprehension & FAQ matching - Document ranking - Connectors - Relevance tuning - Domain optimization

Slide 19

Slide 19 text

Amazon CodeGuru Automated Code Review and Application Performance Recommendations Dec 2019 Serverless Code Profiler: $0.005/hour (for first 36,000 per month, then free) Review Full Repo: $0.50 per 100 lines of code Review Pull Request: $0.75 per 100 lines of code - Runtime Profiler - Intelligent recommendations - Anomaly detection - Code Reviewer (Java only) - Pull Request Automated Recommendations - Full Repository Analysis

Slide 20

Slide 20 text

Special Mentions… (technically in the ML Services layer)

Slide 21

Slide 21 text

Amazon SageMaker Ground Truth Label Training Data Nov 2018 Serverless Standard Dataset Unit: $0.08/object 3D point cloud: $3.00/frame (additional charges for using Mechanical Turk for reviewer) - Out of the Box templates for: - Video object detection, tracking and clip classification - 3D point clouds object detection, tracking and semantic segmentation - Image object detection, classification and semantic segmentation - Text classification and NER (named entity recognition) - Ability to use either private or public workforces - Ability to create custom templates and workflows

Slide 22

Slide 22 text

Amazon Augmented AI (A2I) Human Review of Machine Learning Predictions Dec 2019 Serverless Rekognition Review: $0.03 / image Textract Review: $0.03 / page Custom Model: $0.08 / object (additional charges for using Mechanical Turk for reviewer) - Integration with AI Services for Human Review of low confidence machine learning predictions - Built in Workflows - Ability to use either private or public workforces - Out of the Box Templates for reviewer instructions - Ability to use Custom Templates and Workflows

Slide 23

Slide 23 text

AWS AI Services Vision • Amazon Rekognition Speech • Amazon Polly • Amazon Transcribe Text • Amazon Comprehend • Amazon Translate • Amazon Textract Search • Amazon Kendra Chatbots • Amazon Lex Personalization • Amazon Personalize Forecasting • Amazon Forecast Fraud • Amazon Fraud Detector Development • Amazon CodeGuru Labeling • Amazon SageMaker Ground Truth Review • Amazon Augmented AI

Slide 24

Slide 24 text

VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES Amazon Textract Amazon Kendra Contact Lens For Amazon Connect Amazon CodeGuru Amazon Fraud Detector Amazon Translate The AWS ML Stack

Slide 25

Slide 25 text

Thank you! Questions? Reach out to me @virtualgill