Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWS re:Invent 2023 re-cap: GenAI

AWS re:Invent 2023 re-cap: GenAI

A review of the launches around Generative AI from AWS re:Invent 2023

Gillian Armstrong

January 23, 2024
Tweet

More Decks by Gillian Armstrong

Other Decks in Technology

Transcript

  1. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. What’s new in Generative AI Gillian Armstrong Senior Specialist Builder Solutions Architect, AWS
  2. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Image generated using Titan
  3. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. How to outsmart a genie Gillian Armstrong Senior Specialist Builder Solutions Architect, AWS
  4. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Image generated using Titan
  5. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Images generated using Stability AI
  6. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Images generated using Stability AI
  7. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Images generated using Titan
  8. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Be careful what you wish for
  9. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
  10. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro
  11. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Create your own genie Capture a genie and let it crash on your sofa and raid your fridge
  12. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
  13. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities Call up a genie someone else has captured and is housing and feeding
  14. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
  15. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities Don’t worry about how those wishes are getting granted
  16. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
  17. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
  18. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S A managed service to build and scale generative AI applications
  19. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API
  20. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. All magic has a price
  21. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Titan Foundation Models TITAN TEXT EMBEDDINGS Translates text into numerical representations TITAN MULTIMODAL EMBEDDINGS Search, recommendation, personalization TITAN TEXT LITE Summarization, copywriting, fine-tuning TITAN TEXT EXPRESS Open-ended text generation, conversational chat, RAG support TITAN IMAGE GENERATOR Generate realistic, studio-quality images Preview
  22. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Claude 2 Claude 2.1 Claude Instant Jurassic-2 Ultra Jurassic-2 Mid Titan Text Embeddings Titan Multimodal Embeddings Titan Text Lite Titan Text Express Titan Image Generator Llama 2 Llama 2 13B Llama 2 70B Command + Embed Cohere Command Light Cohere Embed English Cohere Embed Multilingual Broad choice of models Stable Diffusion XL1.0 Amazon Bedrock
  23. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models
  24. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Maximizing accuracy for specific tasks Small number of labeled examples P U R P O S E D A T A N E E D Customizing models in Amazon Bedrock C O M I N G S O O N
  25. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models
  26. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Make sure you know what you really want
  27. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Model Evaluation Evaluate, compare, and select the best foundation model for your use case Preview Create automatic evaluations with predefined set of evaluation metrics and built-in datasets, or use your own datasets Set up and run custom evaluations and metrics using human work teams Create reusable benchmarks
  28. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities
  29. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Understand the rules and limitations of your wishes
  30. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI models… …are NOT a knowledge store
  31. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI models… Can be combined with a knowledge store
  32. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Be really really specific with your questions
  33. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Retrieval Augmented Generation (RAG) Question Vector-based storage Foundation model Answer
  34. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Knowledge Bases for Fully-managed native support for retrieval augmented generation Automatically converts text documents into embeddings Stores embeddings in your vector database Retrieves embeddings and augments prompts
  35. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI models… …are NOT a knowledge store …CANNOT take actions on their own
  36. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI models… Can be combined with tools
  37. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Agents for Enable generative AI applications to complete tasks in just a few clicks Automated prompt engineering Secure access to company systems and data sources Fully managed infrastructure
  38. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Be careful what actions you allow
  39. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities • Features to ensure security, privacy and responsible AI
  40. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Always keep a close eye on what your genie is up to…
  41. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Securely build generative AI applications with your data using Amazon Bedrock • Your data is not used by, or shared with, AWS or the model providers • Supports Tagging, CloudTrail and CloudWatch • Support for GDPR, SOC, ISO, CSA compliance and HIPAA eligibility • Intellectual property (IP) indemnity for copyright claims for the generally available Titan models • Watermarking for Titan Image Generator model outputs
  42. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Don’t give your wishes away to someone else with no restrictions
  43. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Guardrails for Implement safeguards customized to your application requirements and responsible AI policies Apply guardrails to multiple foundation models and Agents for Amazon Bedrock Configure harmful content filtering based on your responsible AI policies Define and disallow denied topics with short natural language descriptions Preview
  44. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Amazon Bedrock T H E E A S I E S T W A Y T O B U I L D A N D S C A L E G E N A I A P P L I C A T I O N S • Access to best-in-class Foundation Models (FMs) through an API • Customize models • Tools to test and evaluate models • Tools to extend your model’s capabilities • Features to ensure security, privacy and responsible AI
  45. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
  46. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I Your generative AI- powered assistant designed for work, that can be tailored to your business, code, data, and operations
  47. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I
  48. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q E M P O W E R Y O U R W O R K F O R C E W I T H G E N E R A T I V E A I Trainee Trainee Trainee Trainee Trainee Trainee Trainee
  49. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q
  50. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q Genie rulebook
  51. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for business • Is an expert in your organization's knowledge, connecting to over 40 popular enterprise applications and document repositories • Get crisp, relevant answers based on your business data, and provides references and citations for easy fact-checking • Understands your users’ role and permissions • Streamlines day-to-day communications and tasks • Enables administrators to easily apply guardrails to customize and control responses B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I Amazon Q
  52. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for builders • All the functionality of Q for business B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I
  53. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I
  54. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I
  55. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console • Works alongside CodeWhisperer Pro in your IDE § Available in Visual Studio Code and in JetBrains § Assists with debugging, testing, and optimizing your code § Helps developers get up to speed on unfamiliar code B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I
  56. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Preview Amazon Q for builders • All the functionality of Q for business • Can answer questions on AWS capabilities, services, and solutions • Can support troubleshooting applications in the AWS Management Console • Works alongside CodeWhisperer Pro in your IDE § Available in Visual Studio Code and in JetBrains § Assists with debugging, testing, and optimizing your code § Helps developers get up to speed on unfamiliar code • … and more… B O O S T Y O U R W O R K F O R C E P R O D U C T I V I T Y W I T H G E N E R A T I V E A I
  57. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Generative AI Stack Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
  58. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. • Be careful what you wish for - make sure you are certain what you want • Understand the rules and limitations of your wishes • All magic has a price • Be really really specific with your questions • Be careful what actions you allow • Don’t give your wishes away to someone else with no restrictions • Always keep a close eye on what your genie is up to… Guide to not regretting wishes…
  59. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Image generated using Titan
  60. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. G I T H U B . C O M / A W S L A B S / G E N E R A T I V E - A I - C D K - C O N S T R U C T S Generative AI CDK constructs Amazon Bedrock Workshop G I T H U B . C O M / A W S - S A M P L E S / A M A Z O N - B E D R O C K - W O R K S H O P
  61. © 2023, Amazon Web Services, Inc. or its affiliates. All

    rights reserved. Thank you! Gillian Armstrong [email protected] @virtualgill gillian-armstrong