Slide 1

Slide 1 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. re:Invent 2023 現場直擊:重磅發佈 如何助 力 開發者 工 作流程及 生 成創新? re:Invent 2023 New Launch & Generative AI that facilitate Developer Workflow Scott Hsieh Data Architect 104 Corporation AWS Data Hero Ernest Chiang Director of Product & Technology Integration PAFERS Tech AWS Community Hero 3

Slide 2

Slide 2 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 01 AWS Heroes 02 Let's Go to re:Invent 03 re:Cap New Launch & Generative AI that facilitate Developer Workflow 04 How to re:Invent Agenda

Slide 3

Slide 3 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Data Hero https://aws.amazon.com/developer/community/heroes/scott-hsieh/

Slide 4

Slide 4 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Community Hero https://aws.amazon.com/developer/community/heroes/ernest-chiang/

Slide 5

Slide 5 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://aws.amazon.com/developer/community/heroes/ AWS Heroes Program The AWS Heroes program recognizes a vibrant, worldwide group of AWS experts whose enthusiasm for knowledge-sharing has a real impact within the community. Heroes go above and beyond to share knowledge in a variety of ways including online via social media, blog posts, open source projects, videos, and forums; or in person at conferences, workshops, and user group events.

Slide 6

Slide 6 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 7

Slide 7 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 8

Slide 8 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 9

Slide 9 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://reinvent.awsevents.com/learn/attendee-guides/

Slide 10

Slide 10 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let's follow AWS Heroes to Las Vegas

Slide 11

Slide 11 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 12

Slide 12 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 13

Slide 13 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 14

Slide 14 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Numbers of re:Invent • 5 days • 300,000 attendees (remote) • 50,000 attendees (in-person) • 2,000+ sessions • 50+ content tracks • 4 keynotes (7-hour) • USD 2,099 in-person ticket

Slide 15

Slide 15 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Campus at glance

Slide 16

Slide 16 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Time to Badge Pickup

Slide 17

Slide 17 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 18

Slide 18 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. New Launch & Generative AI

Slide 19

Slide 19 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Generative AI Stack APPLICATIONS THAT LEVERAGE FMs TOOLS TO BUILD WITH FMS AND LLMS INFRASTRUCTURE FOR FM TRAINING & INFERENCE Amazon Q Amazon Q in Amazon QuickSight Amazon Q in Amazon Connect Amazon CodeWhisperer GPUs Inferentia Trainium SageMaker EC2 Capacity Blocks Neuron UltraClusters EFA Nitro Amazon Bedrock Guardrails Agents Customization capabilities

Slide 20

Slide 20 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 21

Slide 21 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Summarization, complex reasoning, writing, coding Claude Contextual answers, summarization, paraphrasing Jurassic High-quality images and art Stable Diffusion Text generation, search, classification Command + Embed Q&A and reading comprehension Llama 2 Text summarization, generation, Q&A, search Amazon Titan 200K token context window
 2x reduction in hallucination rate
 25% cost reduction on Bedrock Claude 2.1 Supports large-scale tasks, 
 like language-modeling
 and dialogue systems
 Llama 2 70B NEW NEW TITAN TEXT
 EMBEDDINGS Translates text into numerical representations TITAN IMAGE 
 GENERATOR Generate realistic, studio-quality images TITAN MULTIMODAL EMBEDDINGS Search, recommendation, personalization TITAN TEXT LITE Summarization, copywriting, fine-tuning TITAN TEXT EXPRESS Open-ended text generation, conversational chat, RAG support Amazon Bedrock

Slide 22

Slide 22 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. User Query (Natural Language) Prompt Large Language Model (Amazon Bedrock/Amazon SageMaker JumpStart FMs) Validate Return SQL statement Execute Query Central Data Catalog Vector Database Create Vector Embeddings Of Data Catalog Database Collect and Catalog Databases RAG using Data Catalog Vectors Results https://aws.amazon.com/blogs/machine-learning/generating-value-from-enterprise-data-best-practices-for-text2sql-and-generative-ai/

Slide 23

Slide 23 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Data Foundation https://aws.amazon.com/blogs/big-data/unlocking-the-value-of-data-as-your-differentiator/ © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. APPS DE VICE S PE OPLE Data Sources A P P / L O G S T H I R D - P A R T Y D A T A I O T /D E V I C E S Catalog & govern AWS Glue Data Catalog, AWS Lake Formation, Amazon Data Zone Integrate Ingest DATABASES Amazon Kinesis & Amazon MSK AWS Database Migration Service AWS Glue connectors BIG DATA Process Amazon EMR AWS Glue jobs AWS Glue Data Quality Store Amazon Redshift DATA WAREHOUSE Amazon S3 DATA LAKE Amazon RDS Amazon DynamoDB DATABASES Amazon OpenSearch Service Act MACHINE LEARNING Amazon SageMaker BUSINESS INTELLIGENCE Amazon QuickSight GENERATIVE AI Amazon Bedrock

Slide 24

Slide 24 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://aws.amazon.com/blogs/machine-learning/build-generative-ai-agents-with- amazon-bedrock-amazon-dynamodb-amazon-kendra-amazon-lex-and-langchain/ Amazon Lex: Natural Language Chatbot AWS Amplify: Website AWS Lambda: Lex Bot Logic Handler Virtual private cloud (VPC) Amazon DynamoDB: User Account Information Amazon Bedrock: Anthropic Claude 2.1 FM Amazon Kendra: FAQ Search Index Amazon Connect: Contact Center + Amazon S3: Customer Data fine-tunable Voice SMS Web

Slide 25

Slide 25 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Chalk Talk MFG304-R Knowledge Graph and AI-powered Manufacturing (1/4) 93% of companies believe AI will be a game changer in driving growth and innovation in the manufacturing sector.

Slide 26

Slide 26 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Knowledge Graph and AI-powered Manufacturing (2/4) Combine knowledge graph (KG) and LLM. Chalk Talk MFG304-R

Slide 27

Slide 27 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Knowledge Graph and AI-powered Manufacturing (3/4) Live demo using Amazon Bedrock/Anthropic-v2 in this Chalk Talk :) Q: Who are the suppliers for the part Turbo-Motor-11234? Chalk Talk MFG304-R

Slide 28

Slide 28 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now Go Build with Knowledge Graph (4/4) Personal Knowledge Workflow vs Enterprise Knowledge Workflow. https://www.ernestchiang.com/en/posts/2023/ernest-pkm-workflow/

Slide 29

Slide 29 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gen AI trends: Increasing developer satisfaction Strongly agree Somewhat agree Neither agree or disagree Somewhat disagree Strongly disagree Agreement with statement, % of respondents Without generative AI With generative AI Without generative AI With generative AI Without generative AI With generative AI I felt happy I was able to focus on satisfying and meaningful work I was in a “flow” state 15 30 25 30 50 38 13 20 31 30 56 30 15 13 5 25 44 30 50 20 20 5 6 Source: McKinsey & Company

Slide 30

Slide 30 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Plan Create Operate Improve Amazon Q P R E V IE W Q & A

Slide 31

Slide 31 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Slide 32

Slide 32 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Chat with Amazon Q to explore new AWS capabilities and architect solutions Plan Create Operate Improve Amazon Q P R E V IE W Q & A

Slide 33

Slide 33 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. feature development capability Plan Create Operate Improve Amazon Q P R E V IE W * CodeWhisperer Professional tier needed

Slide 34

Slide 34 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Optimize Amazon EC2 instance selection Plan Create Operate Improve Amazon Q PR EVI EW Amazon Q brings generative AI-powered assistance to IT pros and developers

Slide 35

Slide 35 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. network troubleshooting Plan Create Operate Improve Amazon Q PR EVI EW * Only in the US East (N. Virginia) currently Amazon Q brings generative AI-powered assistance to IT pros and developers

Slide 36

Slide 36 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. troubleshooting Plan Create Operate Improve Amazon Q PR EVI EW * Only in the US West (Oregon) currently * Supports Amazon EC2, Amazon S3, Amazon ECS, and AWS Lambda Introducing Amazon Q support for network troubleshooting

Slide 37

Slide 37 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Plan Create Operate Improve Amazon Q P R E V IE W code transformation Upgrade your Java applications with Amazon Q Code Transformation * CodeWhisperer Professional tier needed

Slide 38

Slide 38 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. DevOps Amazon CodeCatalyst Amazon QuickSight Amazon Q PR EVI E W

Slide 39

Slide 39 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon CodeWhisperer Amazon CodeWhisperer, Free for Individual Use, is Now Generally Available Generate code suggestions in real time Flag code that resembles open source training data or filter by default Scan code and remediate hard-to-find vulnerabilities

Slide 40

Slide 40 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon CodeWhisperer New Customization Capability in Amazon CodeWhisperer Generates Even Better Suggestions Customization Capability Steps 1. Connect to a repository 2. Create a customization 3. Activate customization Available repositories 1. Github 2. GitLab 3. BitBucket 4. S3 PR E V IE W

Slide 41

Slide 41 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graviton Chalk Talk Graviton Family (1/5) • Graviton1 = Scale out • Graviton2 = GP • Graviton3 = ML, HPC, SIMD • Graviton4 = Scale up

Slide 42

Slide 42 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. CEO Keynote - https://www.ernestchiang.com/zh/awscategories/aws-reinvent-keynote/ Graviton 4 (2/5) • 96-core ARMv9-A Neoverse V2 • 12 DDR5-5600 channels • 30% higher compute performance compared to Graviton3

Slide 43

Slide 43 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graviton 4 (3/5) • TSMC's N4 process • 536.7 GB/s peak bandwidth, which is 75% higher compared to the previous-generation AWS CPU • Higher memory bandwidth improves performance of CPUs in memory intensive applications (e.g. database) Graviton Chalk Talk

Slide 44

Slide 44 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graviton Workshop Now Go Build with Graviton (4/5)

Slide 45

Slide 45 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to re:Invent

Slide 46

Slide 46 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to Prepare for Next AWS re:Invent?

Slide 47

Slide 47 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to Prepare for Next AWS re:Invent?

Slide 48

Slide 48 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to Prepare for Next AWS re:Invent?

Slide 49

Slide 49 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote Expand knowledge / Professional Growth ✅ New tools / products ✅ Find a solution ⚠ Reduce company time cost (in some way) ⚠ Learn beyond your field/interest ⚠

Slide 50

Slide 50 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote Expand knowledge / Professional Growth ✅ ✅ New tools / products ✅ ✅ Find a solution ✅ ⚠ Reduce company time cost (in some way) ✅ ⚠ Learn beyond your field/interest ✅ ⚠

Slide 51

Slide 51 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://www.ernestchiang.com/posts/2019/2019-12-17-amazon-ecs-capacity-providers/ Case Study • Amazon ECS Cluster Capacity Provider • AWS re:Invent 2019 New Launch • Timeline • 2019-12-05: I attended CON312 chalk talk • 2020-01-03: Nick Coult (Principal PM) published Deep Dive on Amazon ECS Cluster Auto Scaling on AWS Container Blog. • Result • My team and I know whom to follow or to ask questions. 👉 Network • We cancelled one internal project that originally intents to do the "auto scaling" manually by our own scripts, by replacing with CP, which saved some sorts of man-hour. 👉 Reduce company time cost

Slide 52

Slide 52 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote Expand knowledge / Professional Growth ✅ ✅ New tools / products ✅ ✅ Find a solution ✅ ⚠ Reduce company time cost (in some way) ✅ ⚠ Learn beyond your field/interest ✅ ⚠ Network / Ecosystem ✅ Oppotunities ✅ For people to meet you ✅ Present ideas and works ✅ Break out of your comfort zone ✅ New tips / tactics ✅ Focus ✅ Recharge / energy ✅ Have fun / relax ✅ https://speakerdeck.com/dwchiang

Slide 53

Slide 53 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Attending AWS re:Invent? Why Attending? In-person Remote People ✅ Focus ✅ Knowledge ✅ ✅ https://speakerdeck.com/dwchiang

Slide 54

Slide 54 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Takeaway

Slide 55

Slide 55 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Takeaway • AWS Heroes x Community • New Launch & GAI • AI Stack • KG + LLM • Amazon Q • CodeWhisper • Graviton4 • How-to & Why re:Invent

Slide 56

Slide 56 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Reference

Slide 57

Slide 57 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now Go Build with Werner Vogels https://www.youtube.com/playlist?list=PLhr1KZpdzukdIpgzSSCkNsnRAwDz6Xx5B

Slide 58

Slide 58 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ernest 的 AWS 筆記、想法、觀察 https://www.ernestchiang.com/zh/awscategories/

Slide 59

Slide 59 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Hero-built PHP Docker Image for AWS Graviton (arm64) https://hub.docker.com/r/dwchiang/nginx-php-fpm

Slide 60

Slide 60 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS 宣布「AI 就緒」新計畫
 2025 年前 提供 200萬 人 免費 AI 技能培訓 © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 全新 生 成式 AI 系列課程 : • Generative AI Learning Plan for Decision Makers • Foundations of Prompt Engineering • Low-Code Machine Learning on AWS • Building Language Models on AWS • Amazon Transcribe - Getting Started • Building Generative AI Applications Using Amazon Bedrock Skill Builder

Slide 61

Slide 61 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Please complete the session survey in the mobile app Please complete the session survey in the mobile app Scott Hsieh @fantasticHsieh Ernest Chiang AWSUGTW @dwchiang 👉 Facebook Group 👉 每個 月 各種 星期四

Slide 62

Slide 62 text

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.