$30 off During Our Annual Pro Sale. View Details »

AWS AI Services Overview (Oct 2020)

AWS AI Services Overview (Oct 2020)

A high level overview of all the AWS AI Services (pre re:Invent 2020!)

Gillian Armstrong

October 10, 2020
Tweet

More Decks by Gillian Armstrong

Other Decks in Technology

Transcript

  1. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
    Gillian Armstrong, @virtualgill
    10 Oct 2020
    AWS AI Services Overview
    Pre-reInvent Edition!

    View Slide

  2. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT
    CONTACT
    CENTERS
    Ground
    Truth
    AWS Marketplace
    for ML
    Neo
    Augmented
    AI
    Built-in
    algorithms
    Notebooks Experiments Processing
    Model training
    and tuning
    Debugger Autopilot
    Model
    hosting
    Model
    Monitor
    Deep Learning
    AMIs & Containers
    GPUs &
    CPUs
    Elastic
    Inference
    Inferentia FPGA
    Amazon
    Rekognition
    Amazon
    Polly
    Amazon
    Transcribe
    +Medical
    Amazon
    Lex
    Amazon
    Personalize
    Amazon
    Forecast
    Amazon
    Comprehend
    +Medical
    AI SERVICES
    ML SERVICES
    ML FRAMEWORKS & INFRASTRUCTURE
    Amazon
    Textract
    Amazon
    Kendra
    Contact Lens
    For Amazon Connect
    SageMaker Studio IDE
    Amazon
    CodeGuru
    Amazon
    SageMaker
    DeepGraphLibrary
    Amazon
    Fraud Detector
    Amazon
    Translate
    The AWS ML Stack

    View Slide

  3. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
    VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT
    CONTACT
    CENTERS
    Ground
    Truth
    AWS Marketplace
    for ML
    Neo
    Augmented
    AI
    Built-in
    algorithms
    Notebooks Experiments Processing
    Model training
    and tuning
    Debugger Autopilot
    Model
    hosting
    Model
    Monitor
    Deep Learning
    AMIs & Containers
    GPUs &
    CPUs
    Elastic
    Inference
    Inferentia FPGA
    Amazon
    Rekognition
    Amazon
    Polly
    Amazon
    Transcribe
    +Medical
    Amazon
    Lex
    Amazon
    Personalize
    Amazon
    Forecast
    Amazon
    Comprehend
    +Medical
    AI SERVICES
    ML SERVICES
    ML FRAMEWORKS & INFRASTRUCTURE
    Amazon
    Textract
    Amazon
    Kendra
    Contact Lens
    For Amazon Connect
    SageMaker Studio IDE
    Amazon
    CodeGuru
    Amazon
    SageMaker
    DeepGraphLibrary
    Amazon
    Fraud Detector
    Amazon
    Translate
    The AWS ML Stack

    View Slide

  4. If I needed Butter….
    Managed AI Services Custom Models Custom Models and Algorithms
    - Purchase Churn
    - Churn Maintenance
    - Time to make Butter
    - Purchase Cow, Churn, Field, Barn
    - Look after Cow
    (food, shelter, care, milking)
    - Field/Barn/Churn Maintenance
    - Time to make Butter
    Buy butter from shop Buy raw milk from farm
    Self-Sufficient – own Cow

    View Slide

  5. The AWS ML Stack

    View Slide

  6. Amazon Polly
    Text to Speech
    Nov 2016
    Serverless
    - Choose from dozens of languages and voices
    - Adjust Speaking Style, Speech Rate, Pitch and Loudness
    - Custom Lexicons
    - Newscaster and Conversational style Modes
    - Standard TTS and Neural TTS options
    Standard TTS $4.00 per 1 million characters
    Neural TTS $16.00 per 1 million characters for speech

    View Slide

  7. Amazon Lex
    Conversational Interface Builder
    Nov 2016
    Serverless
    $0.004 per voice request, $0.00075 per text request
    **plus charges as per service
    - High quality speech recognition
    - Natural Language Understanding
    - Multi-turn conversations, Intent Chaining
    - Quick deploy to multiple platforms
    - Native integrations with Amazon Polly, AWS Lambda, Amazon Comprehend
    Sentiment and Kendra**

    View Slide

  8. Amazon Rekognition
    Image and Video Analysis
    Nov 2016
    Serverless
    - Object and Scene Detection (built-in labels)
    - Content Moderation
    - Text detection
    - Face detection and analysis
    - Celebrity recognition
    - Pathing
    - Facial recognition (face search)
    Standard: $0.001/image, $0.10/min
    Live Video Face Search: $0.12/min
    Face storage: $0.00001/face per month

    View Slide

  9. Amazon Rekognition
    Image and Video Analysis
    Nov 2016
    Serverless
    - Object and Scene Detection (built-in labels)
    - Content Moderation
    - Text detection
    - Face detection and analysis
    - Celebrity recognition
    - Pathing
    - Facial recognition (face search)
    - Custom Labels (images) – Nov 2019
    Custom Label Training $1/hour
    Custom Label Inference $4/hour

    View Slide

  10. - Offline and Real-time transcription
    - Custom vocabulary
    - Vocabulary filtering
    - Multiple speaker and channel identification
    - Automatic content redaction
    - Automatic language identification
    - Custom language models (Aug 2020)
    Amazon Transcribe
    Speech to Text
    Nov 2017
    Serverless
    Transcription: $0.0004/second
    Custom Transcription: $0.060/second additional cost
    Content Redaction: $0.00004/second

    View Slide

  11. Amazon Translate
    Neural Machine Translation
    Nov 2017
    Serverless
    - Language Identification
    - Batch and Real-Time Translations
    - Custom Terminology
    $0.000015 per character, billed monthly

    View Slide

  12. - Keyphrase Extraction
    - Sentiment Analysis
    - Syntax Analysis
    - Entity Recognition
    - Language Detection
    - Topic Modelling
    - PII Detection (Sept 2020)
    Amazon Comprehend
    Natural Language Processing (NLP)
    Nov 2017
    Serverless
    Standard APIs: $0.0001/100 characters
    Topic Modelling: $1 (first 100MB) + $0.004/additional MB

    View Slide

  13. - Keyphrase Extraction
    - Sentiment Analysis
    - Syntax Analysis
    - Entity Recognition
    - Language Detection
    - Topic Modelling
    - PII Detection (Sep 2020)
    - Custom Classification (Nov 2018)
    - Custom Named Entity Recognition (Nov 2018)
    Amazon Comprehend
    Natural Language Processing (NLP)
    Nov 2017
    Serverless
    Custom Training $3/hour, Model Management $0.50/month
    Inference Batch $0.0005/100 chars, Real Time
    $0.0005/instance per second

    View Slide

  14. Amazon Textract
    OCR – text, forms and tables
    Nov 2018
    Serverless
    OCR - $0.0015/page
    Tables - $0.015/page (OCR included)
    Forms - $0.05/page (OCR included)
    - Optical Character Recognition (OCR)
    - Table Detection
    - Forms Extraction (key-value pairs)

    View Slide

  15. Amazon Personalize
    Recommendations Engine
    Nov 2018
    Serverless
    $0.05 data ingestion/GB, $0.24/training hour
    Real Time: $0.20 per TPS-hour
    Batch: $0.067/ 1000 recommendations
    - Real Time and Batch Recommendations
    - New user and new item recommendations
    - Contextual recommendations
    - Similar item recommendations

    View Slide

  16. Amazon Forecast
    Forecasts
    Nov 2018
    Serverless
    $0.088 data ingestion/GB, $0.24 per training hour
    Forecasts $0.60 per 1,000 forecasts
    - AutoML using historical time series data to create forecast
    - Visualisations
    - Probabilistic forecasts

    View Slide

  17. Amazon Fraud Detector
    Fraud Detection
    Dec 2019
    Serverless
    $0.39 training/hour, $0.06 model hosting/hour
    Real Time: $0.030/prediction
    Real Time with Rules: $0.005/prediction
    - Real time Fraud Detection
    - AutoML for Fraud Detection
    - Integrated Rules Engine
    - SageMaker Integration

    View Slide

  18. Amazon Kendra
    Enterprise Search with Natural Language Capabilities
    Dec 2019
    Serverless
    $7.00/hour up to 500,000 docs and 40,000 requests/day
    Connector: $0.000001/document and $0.35/hour when syncing
    - Natural language & keyword support
    - Reading comprehension & FAQ matching
    - Document ranking
    - Connectors
    - Relevance tuning
    - Domain optimization

    View Slide

  19. Amazon CodeGuru
    Automated Code Review and Application Performance Recommendations
    Dec 2019
    Serverless
    Code Profiler: $0.005/hour (for first 36,000 per month, then free)
    Review Full Repo: $0.50 per 100 lines of code
    Review Pull Request: $0.75 per 100 lines of code
    - Runtime Profiler
    - Intelligent recommendations
    - Anomaly detection
    - Code Reviewer (Java only)
    - Pull Request Automated Recommendations
    - Full Repository Analysis

    View Slide

  20. Special Mentions…
    (technically in the ML Services layer)

    View Slide

  21. Amazon SageMaker Ground Truth
    Label Training Data
    Nov 2018
    Serverless
    Standard Dataset Unit: $0.08/object
    3D point cloud: $3.00/frame
    (additional charges for using Mechanical Turk for reviewer)
    - Out of the Box templates for:
    - Video object detection, tracking and clip classification
    - 3D point clouds object detection, tracking and semantic
    segmentation
    - Image object detection, classification and semantic segmentation
    - Text classification and NER (named entity recognition)
    - Ability to use either private or public workforces
    - Ability to create custom templates and workflows

    View Slide

  22. Amazon Augmented AI (A2I)
    Human Review of Machine Learning Predictions
    Dec 2019
    Serverless
    Rekognition Review: $0.03 / image
    Textract Review: $0.03 / page
    Custom Model: $0.08 / object
    (additional charges for using Mechanical Turk for reviewer)
    - Integration with AI Services for Human Review of low confidence
    machine learning predictions
    - Built in Workflows
    - Ability to use either private or public workforces
    - Out of the Box Templates for reviewer instructions
    - Ability to use Custom Templates and Workflows

    View Slide

  23. AWS AI Services
    Vision
    • Amazon Rekognition
    Speech
    • Amazon Polly
    • Amazon Transcribe
    Text
    • Amazon Comprehend
    • Amazon Translate
    • Amazon Textract
    Search
    • Amazon Kendra
    Chatbots
    • Amazon Lex
    Personalization
    • Amazon Personalize
    Forecasting
    • Amazon Forecast
    Fraud
    • Amazon Fraud Detector
    Development
    • Amazon CodeGuru
    Labeling
    • Amazon SageMaker Ground Truth
    Review
    • Amazon Augmented AI

    View Slide

  24. VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT
    CONTACT
    CENTERS
    Amazon
    Rekognition
    Amazon
    Polly
    Amazon
    Transcribe
    +Medical
    Amazon
    Lex
    Amazon
    Personalize
    Amazon
    Forecast
    Amazon
    Comprehend
    +Medical
    AI SERVICES
    Amazon
    Textract
    Amazon
    Kendra
    Contact Lens
    For Amazon Connect
    Amazon
    CodeGuru
    Amazon
    Fraud Detector
    Amazon
    Translate
    The AWS ML Stack

    View Slide

  25. Thank you!
    Questions?
    Reach out to me @virtualgill

    View Slide