AWS re:Invent 2023 re:Cap Taipei (for Developer): New Launch & Generative AI that facilitate Developer Workflow

AWS re:Invent 2023 re:Cap Taipei
at TICC
with Scott Hsieh
on 2024-01-11

✳️ Chinese Title = AWS re:Invent 2023 現場直擊：重磅發佈 如何助力開發者工作流程及生成創新

✳️ Blog post (zh) = https://www.ernestchiang.com/zh/posts/2024/aws-reinvent-2023-recap-taipei-by-aws-heroes-scotthsieh-ernestchiang/

Transcript

1. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. re:Invent 2023 現場直擊：重磅發佈 如何助 力 開發者 工 作流程及 生 成創新？ re:Invent 2023 New Launch & Generative AI that facilitate Developer Workflow Scott Hsieh Data Architect 104 Corporation AWS Data Hero Ernest Chiang Director of Product & Technology Integration PAFERS Tech AWS Community Hero 3
2. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 01 AWS Heroes 02 Let's Go to re:Invent 03 re:Cap New Launch & Generative AI that facilitate Developer Workflow 04 How to re:Invent Agenda
3. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Data Hero https://aws.amazon.com/developer/community/heroes/scott-hsieh/
4. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Community Hero https://aws.amazon.com/developer/community/heroes/ernest-chiang/
5. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://aws.amazon.com/developer/community/heroes/ AWS Heroes Program The AWS Heroes program recognizes a vibrant, worldwide group of AWS experts whose enthusiasm for knowledge-sharing has a real impact within the community. Heroes go above and beyond to share knowledge in a variety of ways including online via social media, blog posts, open source projects, videos, and forums; or in person at conferences, workshops, and user group events.
6. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
7. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
8. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
9. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://reinvent.awsevents.com/learn/attendee-guides/
10. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let's follow AWS Heroes to Las Vegas
11. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
12. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
13. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
14. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Numbers of re:Invent • 5 days • 300,000 attendees (remote) • 50,000 attendees (in-person) • 2,000+ sessions • 50+ content tracks • 4 keynotes (7-hour) • USD 2,099 in-person ticket
15. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Campus at glance
16. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Time to Badge Pickup
17. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
18. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. New Launch & Generative AI
19. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Generative AI Stack APPLICATIONS THAT LEVERAGE FMs TOOLS TO BUILD WITH FMS AND LLMS INFRASTRUCTURE FOR FM TRAINING & INFERENCE Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities
20. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
21. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Summarization, complex reasoning, writing, coding Claude Contextual answers, summarization, paraphrasing Jurassic High-quality images and art Stable Diffusion Text generation, search, classification Command + Embed Q&A and reading comprehension Llama 2 Text summarization, generation, Q&A, search Amazon Titan 200K token context window
 2x reduction in hallucination rate
 25% cost reduction on Bedrock Claude 2.1 Supports large-scale tasks, 
 like language-modeling
 and dialogue systems
 Llama 2 70B NEW NEW TITAN TEXT
 EMBEDDINGS Translates text into numerical representations TITAN IMAGE 
 GENERATOR Generate realistic, studio-quality images TITAN MULTIMODAL EMBEDDINGS Search, recommendation, personalization TITAN TEXT LITE Summarization, copywriting, fine-tuning TITAN TEXT EXPRESS Open-ended text generation, conversational chat, RAG support Amazon Bedrock
22. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. User Query (Natural Language) Prompt Large Language Model (Amazon Bedrock/Amazon SageMaker JumpStart FMs) Validate Return SQL statement Execute Query Central Data Catalog Vector Database Create Vector Embeddings Of Data Catalog Database Collect and Catalog Databases RAG using Data Catalog Vectors Results https://aws.amazon.com/blogs/machine-learning/generating-value-from-enterprise-data-best-practices-for-text2sql-and-generative-ai/
23. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Data Foundation https://aws.amazon.com/blogs/big-data/unlocking-the-value-of-data-as-your-differentiator/ © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. APPS DE VICE S PE OPLE Data Sources A P P / L O G S T H I R D - P A R T Y D A T A I O T /D E V I C E S Catalog & govern AWS Glue Data Catalog, AWS Lake Formation, Amazon Data Zone Integrate Ingest DATABASES Amazon Kinesis & Amazon MSK AWS Database Migration Service AWS Glue connectors BIG DATA Process Amazon EMR AWS Glue jobs AWS Glue Data Quality Store Amazon Redshift DATA WAREHOUSE Amazon S3 DATA LAKE Amazon RDS Amazon DynamoDB DATABASES Amazon OpenSearch Service Act MACHINE LEARNING Amazon SageMaker BUSINESS INTELLIGENCE Amazon QuickSight GENERATIVE AI Amazon Bedrock
24. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://aws.amazon.com/blogs/machine-learning/build-generative-ai-agents-with- amazon-bedrock-amazon-dynamodb-amazon-kendra-amazon-lex-and-langchain/ Amazon Lex: Natural Language Chatbot AWS Amplify: Website AWS Lambda: Lex Bot Logic Handler Virtual private cloud (VPC) Amazon DynamoDB: User Account Information Amazon Bedrock: Anthropic Claude 2.1 FM Amazon Kendra: FAQ Search Index Amazon Connect: Contact Center + Amazon S3: Customer Data fine-tunable Voice SMS Web
25. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Chalk Talk MFG304-R Knowledge Graph and AI-powered Manufacturing (1/4) 93% of companies believe AI will be a game changer in driving growth and innovation in the manufacturing sector.
26. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Knowledge Graph and AI-powered Manufacturing (2/4) Combine knowledge graph (KG) and LLM. Chalk Talk MFG304-R
27. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Knowledge Graph and AI-powered Manufacturing (3/4) Live demo using Amazon Bedrock/Anthropic-v2 in this Chalk Talk :) Q: Who are the suppliers for the part Turbo-Motor-11234? Chalk Talk MFG304-R
28. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now Go Build with Knowledge Graph (4/4) Personal Knowledge Workflow vs Enterprise Knowledge Workflow. https://www.ernestchiang.com/en/posts/2023/ernest-pkm-workflow/
29. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gen AI trends: Increasing developer satisfaction Strongly agree Somewhat agree Neither agree or disagree Somewhat disagree Strongly disagree Agreement with statement, % of respondents Without generative AI With generative AI Without generative AI With generative AI Without generative AI With generative AI I felt happy I was able to focus on satisfying and meaningful work I was in a “flow” state 15 30 25 30 50 38 13 20 31 30 56 30 15 13 5 25 44 30 50 20 20 5 6 Source: McKinsey & Company
30. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Plan Create Operate Improve Amazon Q P R E V IE W Q & A
31. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
32. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Chat with Amazon Q to explore new AWS capabilities and architect solutions Plan Create Operate Improve Amazon Q P R E V IE W Q & A
33. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. feature development capability Plan Create Operate Improve Amazon Q P R E V IE W * CodeWhisperer Professional tier needed
34. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Optimize Amazon EC2 instance selection Plan Create Operate Improve Amazon Q PR EVI EW Amazon Q brings generative AI-powered assistance to IT pros and developers
35. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. network troubleshooting Plan Create Operate Improve Amazon Q PR EVI EW * Only in the US East (N. Virginia) currently Amazon Q brings generative AI-powered assistance to IT pros and developers
36. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. troubleshooting Plan Create Operate Improve Amazon Q PR EVI EW * Only in the US West (Oregon) currently * Supports Amazon EC2, Amazon S3, Amazon ECS, and AWS Lambda Introducing Amazon Q support for network troubleshooting
37. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Plan Create Operate Improve Amazon Q P R E V IE W code transformation Upgrade your Java applications with Amazon Q Code Transformation * CodeWhisperer Professional tier needed
38. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. DevOps Amazon CodeCatalyst Amazon QuickSight Amazon Q PR EVI E W
39. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon CodeWhisperer Amazon CodeWhisperer, Free for Individual Use, is Now Generally Available Generate code suggestions in real time Flag code that resembles open source training data or filter by default Scan code and remediate hard-to-find vulnerabilities
40. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon CodeWhisperer New Customization Capability in Amazon CodeWhisperer Generates Even Better Suggestions Customization Capability Steps 1. Connect to a repository 2. Create a customization 3. Activate customization Available repositories 1. Github 2. GitLab 3. BitBucket 4. S3 PR E V IE W
41. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graviton Chalk Talk Graviton Family (1/5) • Graviton1 = Scale out • Graviton2 = GP • Graviton3 = ML, HPC, SIMD • Graviton4 = Scale up
42. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. CEO Keynote - https://www.ernestchiang.com/zh/awscategories/aws-reinvent-keynote/ Graviton 4 (2/5) • 96-core ARMv9-A Neoverse V2 • 12 DDR5-5600 channels • 30% higher compute performance compared to Graviton3
43. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graviton 4 (3/5) • TSMC's N4 process • 536.7 GB/s peak bandwidth, which is 75% higher compared to the previous-generation AWS CPU • Higher memory bandwidth improves performance of CPUs in memory intensive applications (e.g. database) Graviton Chalk Talk
44. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graviton Workshop Now Go Build with Graviton (4/5)
45. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to re:Invent
46. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to Prepare for Next AWS re:Invent?
47. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to Prepare for Next AWS re:Invent?
48. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to Prepare for Next AWS re:Invent?
49. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote Expand knowledge / Professional Growth ✅ New tools / products ✅ Find a solution ⚠ Reduce company time cost (in some way) ⚠ Learn beyond your field/interest ⚠
50. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote Expand knowledge / Professional Growth ✅ ✅ New tools / products ✅ ✅ Find a solution ✅ ⚠ Reduce company time cost (in some way) ✅ ⚠ Learn beyond your field/interest ✅ ⚠
51. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://www.ernestchiang.com/posts/2019/2019-12-17-amazon-ecs-capacity-providers/ Case Study • Amazon ECS Cluster Capacity Provider • AWS re:Invent 2019 New Launch • Timeline • 2019-12-05: I attended CON312 chalk talk • 2020-01-03: Nick Coult (Principal PM) published Deep Dive on Amazon ECS Cluster Auto Scaling on AWS Container Blog. • Result • My team and I know whom to follow or to ask questions. 👉 Network • We cancelled one internal project that originally intents to do the "auto scaling" manually by our own scripts, by replacing with CP, which saved some sorts of man-hour. 👉 Reduce company time cost
52. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote Expand knowledge / Professional Growth ✅ ✅ New tools / products ✅ ✅ Find a solution ✅ ⚠ Reduce company time cost (in some way) ✅ ⚠ Learn beyond your field/interest ✅ ⚠ Network / Ecosystem ✅ Oppotunities ✅ For people to meet you ✅ Present ideas and works ✅ Break out of your comfort zone ✅ New tips / tactics ✅ Focus ✅ Recharge / energy ✅ Have fun / relax ✅ https://speakerdeck.com/dwchiang
53. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote People ✅ Focus ✅ Knowledge ✅ ✅ https://speakerdeck.com/dwchiang
54. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Takeaway
55. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Takeaway • AWS Heroes x Community • New Launch & GAI • AI Stack • KG + LLM • Amazon Q • CodeWhisper • Graviton4 • How-to & Why re:Invent
56. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Reference
57. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now Go Build with Werner Vogels https://www.youtube.com/playlist?list=PLhr1KZpdzukdIpgzSSCkNsnRAwDz6Xx5B
58. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ernest 的 AWS 筆記、想法、觀察 https://www.ernestchiang.com/zh/awscategories/
59. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Hero-built PHP Docker Image for AWS Graviton (arm64) https://hub.docker.com/r/dwchiang/nginx-php-fpm
60. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS 宣布「AI 就緒」新計畫
 2025 年前 提供 200萬 人 免費 AI 技能培訓 © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 全新 生 成式 AI 系列課程 : • Generative AI Learning Plan for Decision Makers • Foundations of Prompt Engineering • Low-Code Machine Learning on AWS • Building Language Models on AWS • Amazon Transcribe - Getting Started • Building Generative AI Applications Using Amazon Bedrock Skill Builder
61. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Please complete the session survey in the mobile app Please complete the session survey in the mobile app Scott Hsieh @fantasticHsieh Ernest Chiang AWSUGTW @dwchiang 👉 Facebook Group 👉 每個 月 各種 星期四
62. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.