AWS re:Invent 2023 re-cap: GenAI

© 2023, Amazon Web Services, Inc. or its affiliates. All
rights reserved.

rights reserved. What’s new in Generative AI Gillian Armstrong Senior Specialist Builder Solutions Architect, AWS

rights reserved. Image generated using Titan

rights reserved. How to outsmart a genie Gillian Armstrong Senior Specialist Builder Solutions Architect, AWS

rights reserved.

rights reserved. Images generated using Stability AI

rights reserved. Images generated using Titan

rights reserved. Be careful what you wish for

rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro

rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Create your own genie Capture a genie and let it crash on your sofa and raid your fridge

rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities Call up a genie someone else has captured and is housing and feeding

rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities Don’t worry about how those wishes are getting granted

rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S A managed service to build and scale generative AI applications

rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API

rights reserved. All magic has a price

rights reserved. Amazon Titan Foundation Models TITAN TEXT EMBEDDINGS Translates text into numerical representations TITAN MULTIMODAL EMBEDDINGS Search, recommendation, personalization TITAN TEXT LITE Summarization, copywriting, fine-tuning TITAN TEXT EXPRESS Open-ended text generation, conversational chat, RAG support TITAN IMAGE GENERATOR Generate realistic, studio-quality images Preview

rights reserved. Claude 2 Claude 2.1 Claude Instant Jurassic-2 Ultra Jurassic-2 Mid Titan Text Embeddings Titan Multimodal Embeddings Titan Text Lite Titan Text Express Titan Image Generator Llama 2 Llama 2 13B Llama 2 70B Command + Embed Cohere Command Light Cohere Embed English Cohere Embed Multilingual Broad choice of models Stable Diffusion XL1.0 Amazon Bedrock

rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models

rights reserved. Maximizing accuracy for specific tasks Small number of labeled examples P U R P O S E D A T A N E E D Customizing models in Amazon Bedrock C O M I N G S O O N

rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models

rights reserved. Make sure you know what you really want

rights reserved. Model Evaluation Evaluate, compare, and select the best foundation model for your use case Preview Create automatic evaluations with predefined set of evaluation metrics and built-in datasets, or use your own datasets Set up and run custom evaluations and metrics using human work teams Create reusable benchmarks

rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities

rights reserved. Understand the rules and limitations of your wishes

rights reserved. Generative AI models… …are NOT a knowledge store

rights reserved. Generative AI models… Can be combined with a knowledge store

rights reserved. Be really really specific with your questions

rights reserved. Retrieval Augmented Generation (RAG) Question Vector-based storage Foundation model Answer

rights reserved. Knowledge Bases for Fully-managed native support for retrieval augmented generation Automatically converts text documents into embeddings Stores embeddings in your vector database Retrieves embeddings and augments prompts

rights reserved. Generative AI models… …are NOT a knowledge store …CANNOT take actions on their own

rights reserved. Generative AI models… Can be combined with tools

rights reserved. Agents for Enable generative AI applications to complete tasks in just a few clicks Automated prompt engineering Secure access to company systems and data sources Fully managed infrastructure

rights reserved. Be careful what actions you allow

rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities • Features to ensure security, privacy and responsible AI

rights reserved. Always keep a close eye on what your genie is up to…

rights reserved. Securely build generative AI applications with your data using Amazon Bedrock • Your data is not used by, or shared with, AWS or the model providers • Supports Tagging, CloudTrail and CloudWatch • Support for GDPR, SOC, ISO, CSA compliance and HIPAA eligibility • Intellectual property (IP) indemnity for copyright claims for the generally available Titan models • Watermarking for Titan Image Generator model outputs

rights reserved. Don’t give your wishes away to someone else with no restrictions

rights reserved. Guardrails for Implement safeguards customized to your application requirements and responsible AI policies Apply guardrails to multiple foundation models and Agents for Amazon Bedrock Configure harmful content filtering based on your responsible AI policies Define and disallow denied topics with short natural language descriptions Preview

rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities • Features to ensure security, privacy and responsible AI

rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I Your generative AI- powered assistant designed for work, that can be tailored to your business, code, data, and operations

rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I

rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I Trainee Trainee Trainee Trainee Trainee Trainee Trainee

rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q

rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q Genie rulebook

rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q

rights reserved. Preview Amazon Q for builders • All the functionality of Q for business B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console • Works alongside CodeWhisperer Pro in your IDE § Available in Visual Studio Code and in JetBrains § Assists with debugging, testing, and optimizing your code § Helps developers get up to speed on unfamiliar code B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console • Works alongside CodeWhisperer Pro in your IDE § Available in Visual Studio Code and in JetBrains § Assists with debugging, testing, and optimizing your code § Helps developers get up to speed on unfamiliar code • … and more… B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

rights reserved. • Be careful what you wish for - make sure you are certain what you want • Understand the rules and limitations of your wishes • All magic has a price • Be really really specific with your questions • Be careful what actions you allow • Don’t give your wishes away to someone else with no restrictions • Always keep a close eye on what your genie is up to… Guide to not regretting wishes…

rights reserved. G I T H U B . C O M / A W S L A B S / G E N E R A T I V E - A I - C D K - C O N S T R U C T S Generative AI CDK constructs Amazon Bedrock Workshop G I T H U B . C O M / A W S - S A M P L E S / A M A Z O N - B E D R O C K - W O R K S H O P

rights reserved. Thank you! Gillian Armstrong [email protected] @virtualgill gillian-armstrong

AWS re:Invent 2023 re-cap: GenAI

AWS re:Invent 2023 re-cap: GenAI

Transcript

More Decks by Gillian Armstrong

Other Decks in Technology

Featured