Tweet
Tweet

Slide 1

Slide 1 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 2

Slide 2 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. What’s new in Generative AI Gillian Armstrong Senior Specialist Builder Solutions Architect, AWS

Slide 3

Slide 3 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Image generated using Titan

Slide 4

Slide 4 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to outsmart a genie Gillian Armstrong Senior Specialist Builder Solutions Architect, AWS

Slide 5

Slide 5 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Image generated using Titan

Slide 6

Slide 6 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 7

Slide 7 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Images generated using Stability AI

Slide 8

Slide 8 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Images generated using Stability AI

Slide 9

Slide 9 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Images generated using Titan

Slide 10

Slide 10 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Be careful what you wish for

Slide 11

Slide 11 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 12

Slide 12 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro

Slide 13

Slide 13 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Create your own genie Capture a genie and let it crash on your sofa and raid your fridge

Slide 14

Slide 14 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 15

Slide 15 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities Call up a genie someone else has captured and is housing and feeding

Slide 16

Slide 16 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 17

Slide 17 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities Don’t worry about how those wishes are getting granted

Slide 18

Slide 18 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 19

Slide 19 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 20

Slide 20 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S A managed service to build and scale generative AI applications

Slide 21

Slide 21 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API

Slide 22

Slide 22 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. All magic has a price

Slide 23

Slide 23 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Titan Foundation Models TITAN TEXT EMBEDDINGS Translates text into numerical representations TITAN MULTIMODAL EMBEDDINGS Search, recommendation, personalization TITAN TEXT LITE Summarization, copywriting, fine-tuning TITAN TEXT EXPRESS Open-ended text generation, conversational chat, RAG support TITAN IMAGE GENERATOR Generate realistic, studio-quality images Preview

Slide 24

Slide 24 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Claude 2 Claude 2.1 Claude Instant Jurassic-2 Ultra Jurassic-2 Mid Titan Text Embeddings Titan Multimodal Embeddings Titan Text Lite Titan Text Express Titan Image Generator Llama 2 Llama 2 13B Llama 2 70B Command + Embed Cohere Command Light Cohere Embed English Cohere Embed Multilingual Broad choice of models Stable Diffusion XL1.0 Amazon Bedrock

Slide 25

Slide 25 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models

Slide 26

Slide 26 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Maximizing accuracy for specific tasks Small number of labeled examples P U R P O S E D A T A N E E D Customizing models in Amazon Bedrock C O M I N G S O O N

Slide 27

Slide 27 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models

Slide 28

Slide 28 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Make sure you know what you really want

Slide 29

Slide 29 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Model Evaluation Evaluate, compare, and select the best foundation model for your use case Preview Create automatic evaluations with predefined set of evaluation metrics and built-in datasets, or use your own datasets Set up and run custom evaluations and metrics using human work teams Create reusable benchmarks

Slide 30

Slide 30 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities

Slide 31

Slide 31 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Understand the rules and limitations of your wishes

Slide 32

Slide 32 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI models… …are NOT a knowledge store

Slide 33

Slide 33 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI models… Can be combined with a knowledge store

Slide 34

Slide 34 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Be really really specific with your questions

Slide 35

Slide 35 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Retrieval Augmented Generation (RAG) Question Vector-based storage Foundation model Answer

Slide 36

Slide 36 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Knowledge Bases for Fully-managed native support for retrieval augmented generation Automatically converts text documents into embeddings Stores embeddings in your vector database Retrieves embeddings and augments prompts

Slide 37

Slide 37 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI models… …are NOT a knowledge store …CANNOT take actions on their own

Slide 38

Slide 38 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI models… Can be combined with tools

Slide 39

Slide 39 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agents for Enable generative AI applications to complete tasks in just a few clicks Automated prompt engineering Secure access to company systems and data sources Fully managed infrastructure

Slide 40

Slide 40 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Be careful what actions you allow

Slide 41

Slide 41 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities • Features to ensure security, privacy and responsible AI

Slide 42

Slide 42 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Always keep a close eye on what your genie is up to…

Slide 43

Slide 43 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Securely build generative AI applications with your data using Amazon Bedrock • Your data is not used by, or shared with, AWS or the model providers • Supports Tagging, CloudTrail and CloudWatch • Support for GDPR, SOC, ISO, CSA compliance and HIPAA eligibility • Intellectual property (IP) indemnity for copyright claims for the generally available Titan models • Watermarking for Titan Image Generator model outputs

Slide 44

Slide 44 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Don’t give your wishes away to someone else with no restrictions

Slide 45

Slide 45 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Guardrails for Implement safeguards customized to your application requirements and responsible AI policies Apply guardrails to multiple foundation models and Agents for Amazon Bedrock Configure harmful content filtering based on your responsible AI policies Define and disallow denied topics with short natural language descriptions Preview

Slide 46

Slide 46 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities • Features to ensure security, privacy and responsible AI

Slide 47

Slide 47 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 48

Slide 48 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I Your generative AI- powered assistant designed for work, that can be tailored to your business, code, data, and operations

Slide 49

Slide 49 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I

Slide 50

Slide 50 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I Trainee Trainee Trainee Trainee Trainee Trainee Trainee

Slide 51

Slide 51 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q

Slide 52

Slide 52 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q Genie rulebook

Slide 53

Slide 53 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q

Slide 54

Slide 54 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for builders • All the functionality of Q for business B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

Slide 55

Slide 55 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

Slide 56

Slide 56 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

Slide 57

Slide 57 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console • Works alongside CodeWhisperer Pro in your IDE § Available in Visual Studio Code and in JetBrains § Assists with debugging, testing, and optimizing your code § Helps developers get up to speed on unfamiliar code B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

Slide 58

Slide 58 text

No content

Slide 59

Slide 59 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console • Works alongside CodeWhisperer Pro in your IDE § Available in Visual Studio Code and in JetBrains § Assists with debugging, testing, and optimizing your code § Helps developers get up to speed on unfamiliar code • … and more… B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I

Slide 60

Slide 60 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 61

Slide 61 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Be careful what you wish for - make sure you are certain what you want • Understand the rules and limitations of your wishes • All magic has a price • Be really really specific with your questions • Be careful what actions you allow • Don’t give your wishes away to someone else with no restrictions • Always keep a close eye on what your genie is up to… Guide to not regretting wishes…

Slide 62

Slide 62 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Image generated using Titan

Slide 63

Slide 63 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. G I T H U B . C O M / A W S L A B S / G E N E R A T I V E - A I - C D K - C O N S T R U C T S Generative AI CDK constructs Amazon Bedrock Workshop G I T H U B . C O M / A W S - S A M P L E S / A M A Z O N - B E D R O C K - W O R K S H O P

Slide 64

Slide 64 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! Gillian Armstrong [email protected] @virtualgill gillian-armstrong