AWS re:Invent 2024 re:Cap Taipei (for Developer): New Launches that facilitate Developer Workflow and Continuous Innovation

AWS re:Invent 2024 re:Cap Taipei
at TICC
with Scott Hsieh
on 2025-01-17

✳️ Chinese Title = AWS re:Invent 2024 re:Cap 現場直擊：重磅發佈 如何助力開發者工作流程及生成創新

✳️ Blog post (zh) = https://www.ernestchiang.com/zh/posts/2025/aws-reinvent-2024-recap-taipei-by-aws-heroes-scotthsieh-ernestchiang/

Transcript

1. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS re:Invent 2024 現場直擊：重磅發佈 如何助力開發者工作流程及生成創新？ AWS re:Invent 2024 Insights: New Launches that facilitate Developer Workflow and Continuous Innovation Scott Hsieh Data Architect 104 Corporation AWS Data Hero Ernest Chiang Director of Product & Technology Integration PAFERS Tech AWS Community Hero
2. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda • 01 AWS Heroes • 02 Let's Go to AWS re:Invent • 03 AWS re:Invent New Launches that facilitate Developer Workflow ▪ 1️⃣ 發佈趨勢 ▪ 2️⃣ 視覺化 / 看得到 / 預先規劃 ▪ 3️⃣ AWS Glue x Gen AI x Apache Spark ▪ 4️⃣ 節省時間 / 提升效率 ▪ 5️⃣ Amazon SageMaker Lakehouse • 04 How to navigate and adopt AWS re:Invent New Launches ▪ 6️⃣ 知識整理 / 現學活用
3. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Data Hero https://aws.amazon.com/developer/community/heroes/scott-hsieh/ https://aws.amazon.com/developer/community/heroes/scott-hsieh/
4. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Community Hero https://aws.amazon.com/developer/community/heroes/ernest-chiang/
5. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://aws.amazon.com/developer/community/heroes/ AWS Heroes Program The AWS Heroes program recognizes a vibrant, worldwide group of AWS experts whose enthusiasm for knowledge-sharing has a real impact within the community. Heroes go above and beyond to share knowledge in a variety of ways including online via social media, blog posts, open source projects, videos, and forums; or in person at conferences, workshops, and user group events.
6. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved.
7. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved.
8. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved.
9. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. #Ernest #DrSwami #Nandini
10. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved.
11. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://reinvent.awsevents.com/learn/attendee-guides/
12. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://bit.ly/reinvent-2024-peertalk-meetup
13. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. What happens in Vegas stays in Vegas…
14. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://www.ernestchiang.com
15. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. https://bit.ly/reinvent-2024-ceo-keynote
16. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Campus at glance
17. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. re:Invent New Launches that facilitate Developer Workflow
18. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS re:Invent 2024 Insights: New Launches that facilitate Developer Workflow and Continuous Innovation 發佈趨勢
19. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 60,000+ 名親赴參與 400,000+ 名觀看主題演講 3,000+ 場場次 3,500 名講者 506 項更新 2024.10.30 (三）- 2024.12.06（五） 382 項更新 re:Invent 暖身，2024.10.30-2024.11.30 124 項更新 re:Invent，2024.12.01 (日)-2024.12.06 (五) 發佈趨勢 (1/3) AWS re:Invent 2024
20. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 發佈趨勢 (2/3) Top-5 categories = AI, Data, Governance, Compute, Enterprise App
21. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Bedrock 打造、規模化生成式 AI 應用程式最快、最簡單的途徑 1 選擇最適合的 模型 • Amazon Nova • Luma Ray 2 • poolside • Stable Diffusion 3.5 • 自訂模型匯入 • 模型評估 • 市集 2 優化：成本、 延遲時間、以 及準確性 • 延遲優化推論 • 模型蒸餾 • 提示快取 • 智能提示路由 3 用你的資料客 製化 • 微調 • 知識庫 Knowledge Bases • 支援 GraphRAG • 資料擴增 • 結構化資料檢索 • Kendra 的生成式 AI 索引 4 實踐安全性以 及負責任 AI 的 核對 • Guardrails • 自動推論核對 automated reasoning checks • 多模態有毒性偵測 （toxicity） 5 打造並編排智 能代理 • 智能代理團 • 多智能代理協作 發佈趨勢 (3/3)
22. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS re:Invent 2024 Insights: New Launches that facilitate Developer Workflow and Continuous Innovation 視覺化 / 看得到 / 預先規劃
23. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS CloudFormation Deployments with timeline view 視覺化 / 看得到 / 預先規劃 (1/2) Timeline view in AWS CloudFormation.
24. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Container Insights for Amazon ECS 視覺化 / 看得到 / 預先規劃 (2/2) Container Insights for Amazon ECS.
25. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS re:Invent 2024 Insights: New Launches that facilitate Developer Workflow and Continuous Innovation AWS Glue x Gen AI x Apache Spark
26. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS 資料中心 資料 串流資料 其他 資料庫 連結 連結眾多 資料源 AWS Glue Connector 探索 資料綱要 AWS Glue Crawlers 轉化 以視覺化方式轉化 資料 AWS Glue Studio 以互動方式轉化資料 AWS Glue Studio Notebooks 和 Interactive Sessions 不需要撰寫程式碼 即可轉化資料 AWS Glue DataBrew 00 1010111001 10 000010111110110100011110010110010 01000110000101001100001001010111 10111001010100110000100101011 01011111011010001111001011 100001010011000010010 110100011 現代化 資料平台 資料湖 NoSQL 資料倉儲 日誌分析 大數據 平台 關聯式 機器學習 字典（目錄） 記錄結構 化和半結 構化資料 AWS Glue Data Catalog 機器學習驅動 AWS Glue Data Quality 無伺服器資料整合引擎 Python | Spark AWS Glue x Gen AI x Apache Spark (1/2)
27. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 筆記本 APACHE Spark IDE 視覺化 自然語言 除錯有 AI 升級有 AI AWS Glue x Gen AI x Apache Spark (2/2)
28. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS re:Invent 2024 Insights: New Launches that facilitate Developer Workflow and Continuous Innovation 節省時間 / 提升效率
29. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Shrink storage volumes for your RDS databases 節省時間 / 提升效率 (1/3) Amazon RDS storage volume shrink before Blue/Green deployments. Traditional methods like logical backup/restore or native database replication are no longer needed, significantly reducing the risk of human error and cost. 50% reduction in storage size or any size you want
30. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon S3 now supports up to 1 million buckets per AWS account 節省時間 / 提升效率 (2/3) Amazon S3 default bucket quota from 100 to 10,000, up to 1M per account. No need to worry about urgent quota request.
31. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Improve your app authentication workflow with new Amazon Cognito features 節省時間 / 提升效率 (3/3) Amazon Cognito Password-less Login + Pricing update. Build your SaaS faster with the enhanced authentication workflow.
32. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS re:Invent 2024 Insights: New Launches that facilitate Developer Workflow and Continuous Innovation Amazon SageMaker Lakehouse
33. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 什麼是資料湖倉 結合資料倉儲與資料湖的最佳特性。 無縫處理結構化、半結構化及非結構化數據。 提供元資料及資料沿襲（血脈）功能 以支持進階分析與機器學習。 利用低成本存儲方案來提升性能與擴展性。 採用開源文件格式以避免供應商鎖定。
34. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 一零四湖倉 2019年底開啟旅程至今
35. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 元資料目錄和湖倉架構 平台 資料目錄（Catalogs）和湖倉聯盟 AWS •A AWS Glue Data Catalog + Lake Formation [正式發佈] •B Amazon SageMaker Lakehouse [正式發佈] Databricks •C Unity Catalog [正式發佈] •D Lakehouse Federation [正式發佈] Snowflake •E Snowflake Horizon Catalog [正式發佈] •F Snowflake Open Catalog (managed Polaris) [正式發佈] Starburst •G Gravity catalog [正式發佈] •H Galaxy 與 Icehouse [正式發佈] Dremio •I Dremio Data Catalog for Apache Iceberg [正式發佈] •J Dremio’s data lakehouse [正式發佈] Others AWS A B Databricks C D Snowflake E F Starburst G H Dremio I J
36. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 元資料聯盟能力 Starburst 其他 Dremio Databricks 4 1 4 1 4 2 2 Snowflake 4 3 4 3 AWS 4 4 1 4 1 平台 整合能力 提供者 使用者 AWS Lake Formation 第三方整合 [正式發佈] 1 GDCAPIs 透過 IAM 角色存取 S3 [正式發佈] 2 使用 AWS Glue Iceberg REST 端點 [正式發佈] 3 GDC 爬蟲 與 Spark ETL [正式發佈] 4 Athena 聯合查詢 [正式發佈] Amazon SageMaker Unified Studio [預覽] Databricks UC 與 GDC 聯合 [私人預覽] 2 Delta Lake 框架與 Delta Sharing 4 開源 UC[正式發佈] UC第三方憑證供應商 [preview] Snowflake Apache IRC 的目錄整合 [正式發佈] 3 在 Glue Studio 中連接 Snowflake [正式發佈] 4 Snowflake 開源目錄 (Apache Polaris )[正式發佈] Starburst Lake Formation 第三方整合 [正式發佈] 1 GDCAPIs 透過 IAM 角色存取 [正式發佈] 4 Dremio Lake Formation 第三方整合 [正式發佈] 1 連接至 Dremio 軟體叢集 [正式發佈] 4
37. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon SageMaker Lakehouse 開放 統一 安全
38. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS IAM Identity Center 管理用戶對 Amazon SageMaker Unified Studio 的存取，並提供單一登錄功能，讓資料工程師能夠無 縫進入工作環境。 Amazon SageMaker Unified Studio 讓資料工程師和資料分析師能夠在銷售預測專案中 協作，共享數據與工具。 將銷售預測專案的資料集存儲在基於 Amazon S3 的 Lakehouse 架構中。使用 AWS Glue 進行資料目錄管理，並透過 Amazon Redshift Serverless 實現快速資料檢索。 透過 AWS Lake Formation 管理資料權限，並使用 Iceberg API 實現 Amazon S3 和 Amazon Redshift Serverless 之間的無縫整合。 Amazon SageMaker Unified Studio 提供網頁介面，讓資料工程師能夠在 SageMaker 中完成必要的數據轉換，無需切換控制台。除此之外 ，能夠使用 Amazon Q Developer 提供 AI 生成的撰碼建議，提升開發效率。 在 Amazon SageMaker 的工作室 IDE 介面中，使用 Amazon Athena 進行資料探索，並使用 Amazon Redshift 進行大規模數據轉換。 將銷售資料集及轉換後的中間資料集存儲在 Amazon S3 中。 使用 Amazon Managed Workflows for Apache Airflow (Amazon MWAA) 進行協調，並透過 AWS Glue執行任務，自動化資料消化的端到端流程。 SageMaker 的 Query Editor 提供 SQL 筆記本風格的介面，讓用戶能夠編寫、運行並保存 針對 Amazon Redshift 和 AWS Glue Data Catalog 的查詢，並上傳和查看樣本資料。 1 2 3 4 5 6 目錄 資料工程 師和資料 分析師 AWS Cloud AWS IAM Identity Center AWS 區域 銷售預測專案 資料庫資產 Git 版本庫 Amazon SageMaker 資料處理和分析服 務 Amazon Redshift Amazon Athena 5 Tools AWS Glue ETL Amazon EMR Amazon MWAA 6 Studio IDE 4 Amazon Q Developer 儲存 Amazon S3 AWS Glue Data Catalog Amazon Redshift Serverless 3 撰碼能力 1 Amazon SageMaker Amazon SageMaker Unified Studio 2 生成式 AI Lakehouse Amazon SageMaker 如何透過 Lakehouse 架構、基於網頁的生成式 AI 工作室， 以及統一入口的協調工具，為銷售預測提供協作式數據工程與分析體驗。 Amazon SageMaker Lakehouse
39. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Lakehouse Unified Studio (預覽) 模型 開發 SQL 分析 資料 處理 串流 Gen AI App 開發 搜尋 即將到來 Amazon SageMaker 商業 智慧 即將到來 即將到來 資料 & AI 治理
40. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon SageMaker Unified Studio Amazon SageMaker Lakehouse Amazon SageMaker Catalog 生成式 AI 與 ML 工具
41. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. How to navigate and adopt AWS re:Invent New Launches
42. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS re:Invent 2024 Insights: How to navigate and adopt AWS re:Invent New Launches 知識整理 / 現學活用
43. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Knowledge System | PKM 知識整理 / 現學活用 (1/5) • Q: How to navigate and leverage the abundance of pre:Invent and re:Invent new launches, new features, and releases to apply to our projects and products
44. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 知識整理 / 現學活用 (2/5) AWS re:Invent 2024 has 3,000+ sessions in total, including 900+ breakout sessions with recorded videos available. Total Videos 922 AWS re:Invent 2024 Videos (by 2025-01-10) Total Views 6,788,967 Total Likes 114,974 Total Comments 770 Total Duration 637h
45. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 知識整理 / 現學活用 (3/5) As you know, I’m a fan of Ernest PKM. Ernest PKM (v2023.25)
46. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. 知識整理 / 現學活用 (4/5) Ernest PKM (v2023.25) • A: Write them down. 一言不合，先寫下來 • A: List keywords. 關鍵字，新功能 • A: List goals/issues. 誰在意，誰痛苦 • A: Find top-3. 老闆開心，大家舒服
47. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Breakout Session DAT317 知識整理 / 現學活用 (5/5) GraphRAG for multiple documents and data sources, and summarization.
48. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Takeaway
49. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Takeaway • AWS Heroes x Community • AWS re:Invent 2024 New Launches ▪ 發佈趨勢 ▪ 視覺化 / 看得到 / 預先規劃 ▪ AWS Glue x Gen AI x Apache Spark ▪ 節省時間 / 提升效率 ▪ Amazon SageMaker Lakehouse ▪ 知識整理 / 現學活用
50. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Reference
51. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now Go Build with Werner Vogels https://www.youtube.com/playlist?list=PLhr1KZpdzukdIpgzSSCkNsnRAwDz6Xx5B
52. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now Go Build with Knowledge Graph Personal Knowledge Workflow vs Enterprise Knowledge Workflow. https://www.ernestchiang.com/en/posts/2023/ernest-pkm-workflow/
53. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ernest 的 AWS 筆記、想法、觀察 https://www.ernestchiang.com/zh/awscategories/
54. © 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! Thank you! Please complete the session survey in the mobile app Please complete the session survey in the mobile app Scott Hsieh @fantasticHsieh Ernest Chiang AWSUGTW @dwchiang Facebook Group 每個月 各種 星期四