Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWS AI Services Overview (Oct 2020)

AWS AI Services Overview (Oct 2020)

A high level overview of all the AWS AI Services (pre re:Invent 2020!)

705df02f597ff36f900251c749e879cf?s=128

Gillian Armstrong

October 10, 2020
Tweet

Transcript

  1. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Gillian Armstrong, @virtualgill 10 Oct 2020 AWS AI Services Overview Pre-reInvent Edition!
  2. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT

    CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training and tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon CodeGuru Amazon SageMaker DeepGraphLibrary Amazon Fraud Detector Amazon Translate The AWS ML Stack
  3. © 2020, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training and tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon CodeGuru Amazon SageMaker DeepGraphLibrary Amazon Fraud Detector Amazon Translate The AWS ML Stack
  4. If I needed Butter…. Managed AI Services Custom Models Custom

    Models and Algorithms - Purchase Churn - Churn Maintenance - Time to make Butter - Purchase Cow, Churn, Field, Barn - Look after Cow (food, shelter, care, milking) - Field/Barn/Churn Maintenance - Time to make Butter Buy butter from shop Buy raw milk from farm Self-Sufficient – own Cow
  5. The AWS ML Stack

  6. Amazon Polly Text to Speech Nov 2016 Serverless - Choose

    from dozens of languages and voices - Adjust Speaking Style, Speech Rate, Pitch and Loudness - Custom Lexicons - Newscaster and Conversational style Modes - Standard TTS and Neural TTS options Standard TTS $4.00 per 1 million characters Neural TTS $16.00 per 1 million characters for speech
  7. Amazon Lex Conversational Interface Builder Nov 2016 Serverless $0.004 per

    voice request, $0.00075 per text request **plus charges as per service - High quality speech recognition - Natural Language Understanding - Multi-turn conversations, Intent Chaining - Quick deploy to multiple platforms - Native integrations with Amazon Polly, AWS Lambda, Amazon Comprehend Sentiment and Kendra**
  8. Amazon Rekognition Image and Video Analysis Nov 2016 Serverless -

    Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) Standard: $0.001/image, $0.10/min Live Video Face Search: $0.12/min Face storage: $0.00001/face per month
  9. Amazon Rekognition Image and Video Analysis Nov 2016 Serverless -

    Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) - Custom Labels (images) – Nov 2019 Custom Label Training $1/hour Custom Label Inference $4/hour
  10. - Offline and Real-time transcription - Custom vocabulary - Vocabulary

    filtering - Multiple speaker and channel identification - Automatic content redaction - Automatic language identification - Custom language models (Aug 2020) Amazon Transcribe Speech to Text Nov 2017 Serverless Transcription: $0.0004/second Custom Transcription: $0.060/second additional cost Content Redaction: $0.00004/second
  11. Amazon Translate Neural Machine Translation Nov 2017 Serverless - Language

    Identification - Batch and Real-Time Translations - Custom Terminology $0.000015 per character, billed monthly
  12. - Keyphrase Extraction - Sentiment Analysis - Syntax Analysis -

    Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sept 2020) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Standard APIs: $0.0001/100 characters Topic Modelling: $1 (first 100MB) + $0.004/additional MB
  13. - Keyphrase Extraction - Sentiment Analysis - Syntax Analysis -

    Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sep 2020) - Custom Classification (Nov 2018) - Custom Named Entity Recognition (Nov 2018) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Custom Training $3/hour, Model Management $0.50/month Inference Batch $0.0005/100 chars, Real Time $0.0005/instance per second
  14. Amazon Textract OCR – text, forms and tables Nov 2018

    Serverless OCR - $0.0015/page Tables - $0.015/page (OCR included) Forms - $0.05/page (OCR included) - Optical Character Recognition (OCR) - Table Detection - Forms Extraction (key-value pairs)
  15. Amazon Personalize Recommendations Engine Nov 2018 Serverless $0.05 data ingestion/GB,

    $0.24/training hour Real Time: $0.20 per TPS-hour Batch: $0.067/ 1000 recommendations - Real Time and Batch Recommendations - New user and new item recommendations - Contextual recommendations - Similar item recommendations
  16. Amazon Forecast Forecasts Nov 2018 Serverless $0.088 data ingestion/GB, $0.24

    per training hour Forecasts $0.60 per 1,000 forecasts - AutoML using historical time series data to create forecast - Visualisations - Probabilistic forecasts
  17. Amazon Fraud Detector Fraud Detection Dec 2019 Serverless $0.39 training/hour,

    $0.06 model hosting/hour Real Time: $0.030/prediction Real Time with Rules: $0.005/prediction - Real time Fraud Detection - AutoML for Fraud Detection - Integrated Rules Engine - SageMaker Integration
  18. Amazon Kendra Enterprise Search with Natural Language Capabilities Dec 2019

    Serverless $7.00/hour up to 500,000 docs and 40,000 requests/day Connector: $0.000001/document and $0.35/hour when syncing - Natural language & keyword support - Reading comprehension & FAQ matching - Document ranking - Connectors - Relevance tuning - Domain optimization
  19. Amazon CodeGuru Automated Code Review and Application Performance Recommendations Dec

    2019 Serverless Code Profiler: $0.005/hour (for first 36,000 per month, then free) Review Full Repo: $0.50 per 100 lines of code Review Pull Request: $0.75 per 100 lines of code - Runtime Profiler - Intelligent recommendations - Anomaly detection - Code Reviewer (Java only) - Pull Request Automated Recommendations - Full Repository Analysis
  20. Special Mentions… (technically in the ML Services layer)

  21. Amazon SageMaker Ground Truth Label Training Data Nov 2018 Serverless

    Standard Dataset Unit: $0.08/object 3D point cloud: $3.00/frame (additional charges for using Mechanical Turk for reviewer) - Out of the Box templates for: - Video object detection, tracking and clip classification - 3D point clouds object detection, tracking and semantic segmentation - Image object detection, classification and semantic segmentation - Text classification and NER (named entity recognition) - Ability to use either private or public workforces - Ability to create custom templates and workflows
  22. Amazon Augmented AI (A2I) Human Review of Machine Learning Predictions

    Dec 2019 Serverless Rekognition Review: $0.03 / image Textract Review: $0.03 / page Custom Model: $0.08 / object (additional charges for using Mechanical Turk for reviewer) - Integration with AI Services for Human Review of low confidence machine learning predictions - Built in Workflows - Ability to use either private or public workforces - Out of the Box Templates for reviewer instructions - Ability to use Custom Templates and Workflows
  23. AWS AI Services Vision • Amazon Rekognition Speech • Amazon

    Polly • Amazon Transcribe Text • Amazon Comprehend • Amazon Translate • Amazon Textract Search • Amazon Kendra Chatbots • Amazon Lex Personalization • Amazon Personalize Forecasting • Amazon Forecast Fraud • Amazon Fraud Detector Development • Amazon CodeGuru Labeling • Amazon SageMaker Ground Truth Review • Amazon Augmented AI
  24. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT

    CENTERS Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES Amazon Textract Amazon Kendra Contact Lens For Amazon Connect Amazon CodeGuru Amazon Fraud Detector Amazon Translate The AWS ML Stack
  25. Thank you! Questions? Reach out to me @virtualgill