refactoring-serverless - Speaker Deck

Slide 1

Slide 1 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 淡路大輔アマゾンウェブサービスジャパン合同会社ソリューションアーキテクト S E R V E R L E S S D A Y S T O K Y O 2 0 2 3 Refactoring serverless ※ 本資料に記載されているプログラムはプレゼンテーション向けに簡略化された表記である場合があります

Slide 2

Slide 2 text

Slide 3

Slide 3 text

Slide 4

Slide 4 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 5 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 Introducing AWS Lambda Available in Tokyo 5 Minute Functions Access resources within a VPC Up to 15 minutes Custom runtimes Provisioned concurrency Supports EFS, container images Lambda extentions 10GB Memory Graviton2 10GB /tmp function URL Lambda SnapStart Response payload streaming 10th Anniversary Introducing Amazon API Gateway Introducing Amazon EventBridge Introducing AWS Step Functions 2004 Introducing Amazon SQS 2006 Introducing Amazon S3 ~ 2006 Support SQS as Event Source Step Functions Express Workflows Step Functions AWS SDK Integration

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 8 Function Node.js Python Java C# Go Ruby Runtime API Container images Service Many more… Event データの更新 API リクエスト状態の変更 etc…

Slide 8

Slide 8 text

Slide 9

Slide 9 text

Slide 10

Slide 10 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 既存のコード本体を再構築し、外部の動作を変更せずに内部構造を変更するための規律ある⼿法 Martin Fowler, Refactoring.com リファクタリングとは

Slide 11

Slide 11 text

Slide 12

Slide 12 text

Slide 13

Slide 13 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverlessland - Testing Patterns Collection 14 https://serverlessland.com/testing/patterns

Slide 14

Slide 14 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless Refactoring Pattern 15 Extract send message (using Lambda Destination) AWS Step Functions Service Integration Send Message via EventBridge Pipes 02 03 01

Slide 15

Slide 15 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless Refactoring Pattern 16 Extract send message (using Lambda Destination) AWS Step Functions Service Integration Send Message via EventBridge Pipes 02 03 01

Slide 16

Slide 16 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Extract send message (using Lambda Destination) 17 AWS Lambda Amazon SQS (success) Amazon SNS async invocation Amazon SQS (failure) https://aws.amazon.com/jp/blogs/compute/introducing-aws-lambda-destinations/

Slide 17

Slide 17 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Extract send message (using Lambda Destination) 18 AWS Lambda import { SQS } from "aws-sdk"; export const handler = async (event) => { const result = // Business Logic const params = { QueueUrl: process.env.QUEUE_URL, MessageBody: result, }; await sqs.sendMessage(params).promise(); };

Slide 18

Slide 18 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Extract send message (using Lambda Destination) 19 AWS Lambda QueueUrl: process.env.QUEUE_URL, await sqs.sendMessage(params).promise(); ・トポロジーが環境変数に隠れている・アプリケーションコードにロジックとサービスの依存関係が混在

Slide 19

Slide 19 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Extract send message (using Lambda Destination) 20 AWS Lambda AWS Lambda export const handler = async (event) => { const result = // Business Logic return { message: result }; }; AWS CDK new Function(this, ”orderFunction", { runtime: Runtime.NODEJS_18_X, code: Code.fromAsset("app/functions//index.ts”), handler: ”order.handler", onSuccess: new SqsDestination(queue), }); Original Refactored ・トポロジーは CDK コードに集約される・アプリケーションコードには、ロジックのみ記述される import { SQS } from "aws-sdk"; export const handler = async (event) => { const result = // Business Logic const params = { QueueUrl: process.env.QUEUE_URL, MessageBody: result, }; await sqs.sendMessage(params).promise(); }; ・トポロジーが環境変数に隠れている・アプリケーションコードにロジックとサービスの依存関係が混在

Slide 20

Slide 20 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Extract send message – Error handling 21 AWS Lambda AWS Lambda export const handler = async (event) => { const result = // Business Logic return { message: result }; }; AWS CDK new Function(this, ”orderFunction", { runtime: Runtime.NODEJS_18_X, code: Code.fromAsset("app/functions//index.ts”), handler: ”order.handler", onSuccess: new SqsDestination(queue), onFailure: new SqsDestination(failureQueue), }); Original Refactored import { SQS } from "aws-sdk"; export const handler = async (event) => { try { const result = // Business Logic const params = { QueueUrl: process.env.QUEUE_URL, MessageBody: result, }; await sqs.sendMessage(params).promise(); } catch (e) { const error = // Error handling Logic await sqs.sendMessage(error).promise(); } };

Slide 21

Slide 21 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Extract send message – 注意するポイント 22 ・Lambda の非同期呼び出しのみサポート・SQS への送信処理は Function の処理の最後に実⾏される複数の Queue に送信するシーンでは活⽤できない複数の Queue に “同⼀” メッセージを送信したい場合は SNS を Destination の送信先に設定し、Fan Out する・SDK による実装と⽐べて、SQS への送信メッセージの形式が変更される SQS Message using AWS SDK SQS Message using Lambda Destination

Slide 22

Slide 22 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. サーバーレスをリファクタリングする目的 23 アプリ要件に適⽤する AWS の機能追加に適応するコストを削減するランタイム特性を改善するマネージドサービスを活⽤する

Slide 23

Slide 23 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless Refactoring Pattern 24 Extract send message (using Lambda Destination) AWS Step Functions Service Integration Send Message via EventBridge Pipes 02 03 01

Slide 24

Slide 24 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Step Functions Service Integration 25 AWS Step Functions workflow Lambda: Invoke Detect Labels start Pass state Extract Name Choice state Is Pizza? Fail state Failed Succeed state Passed End Lambda Function Amazon Rekognition image Amazon S3 Image Bucket Detect Labels API AWS Step Functions workflow Rekognition: Detect Object start Pass state Extract Name Choice state Is Pizza? Fail state Failed Succeed state Passed End Amazon Rekognition image Amazon S3 Image Bucket AWS Step Functions から直接 AWS サービスの API をコールする

Slide 25

Slide 25 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Step Functions Service Integration 26 ・ランタイム要素（Lambda）を無くすことで、コスト・実⾏時間・複雑さを減らす Lambda の同時実⾏数消費の緩和、 15 分の timeout の壁を越えるライブラリのアップデートなどの運⽤負荷も軽減する・余分なサービスホップを排除することで、レイテンシーを減らす

Slide 26

Slide 26 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Lambda 27 const handler = async (event) => { const result = await rekognition.detectLabels({ Image: { S3Object: { Bucket: event.s3Bucket, Name: event.imageName } }, }); }; AWS CDK const detectObjectLambda = new lambda.Function(this, {…}); const detectObject = new tasks.LambdaInvoke(this, "Detect Object", { lambdaFunction: detectObjectLambda, payload: sfn.TaskInput.fromObject({ s3Bucket: imageBucket.bucketName, imageName: this.IMAGE_TO_LABEL, }), outputPath: "$.Payload", }); Original AWS Step Functions Service Integration

Slide 27

Slide 27 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Lambda 28 const result = await rekognition.detectLabels({ Bucket: event.s3Bucket, Name: event.imageName } AWS CDK const detectObjectLambda = new lambda.Function(this, {…}); Glue Code としての Lambda Step Functions workflow だけで完結しない複雑さ Lambda コードにトポロジーが隠蔽されてしまう Original AWS Step Functions Service Integration

Slide 28

Slide 28 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Lambda 29 const handler = async (event) => { const result = await rekognition.detectLabels({ Image: { S3Object: { Bucket: event.s3Bucket, Name: event.imageName } }, }); }; AWS CDK const detectObjectLambda = new lambda.Function(this, {…}); const detectObject = new tasks.LambdaInvoke(this, "Detect Object", { lambdaFunction: detectObjectLambda, payload: sfn.TaskInput.fromObject({ s3Bucket: imageBucket.bucketName, imageName: this.IMAGE_TO_LABEL, }), outputPath: "$.Payload", }); AWS CDK const detectObject = new tasks.CallAwsService(this,””, { service: "rekognition", action: "detectLabels", parameters: { Image: { S3Object: { Bucket: imageBucket.bucketName, Name: this.IMAGE_TO_LABEL, }, }, }, … }); AWS Lambda 不要 Original Refactored AWS Step Functions Service Integration

Slide 29

Slide 29 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless Refactoring Pattern 30 Extract send message (using Lambda Destination) AWS Step Functions Service Integration Send Message via EventBridge Pipes 02 03 01

Slide 30

Slide 30 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Send Message via EventBridge Pipes 31 DynamoDB にドメインイベントを保存してから、 EventBridge にイベントを送信する Original Lambda Application EventBridge DynamoDB Lambda Function Table Event Custom event bus Integration ・トポロジーが環境変数に隠れている（DynamoDB テーブル名, Event Bus 名など） Rollback どうする？・複数サービスへの通信が、同じトランザクションスコープではない

Slide 31

Slide 31 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Send Message via EventBridge Pipes 32 Stream Pipes Original Lambda Application EventBridge Integration DynamoDB Lambda Function Table Event Custom event bus Refactored EventBridge Lambda Application EventBridge DynamoDB Lambda Function Table Event Custom event bus Integration

Slide 32

Slide 32 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Send Message via EventBridge Pipes 33 ・ビジネスロジックの明確化 Event Bridge への送信ロジックがアプリケーションコードから排除される・トポロジーの明確化イベントの送信先は Lambda Function の環境変数で指定せず⾃動化コード（AWS CDK, CloudFormation など）に委譲される・トランザクションの整合性保証 Lambda のエラーハンドリングやロールバック実装を簡略化・DynamoDB Streams による dedupe 同じ Item を put しても DDB Strems は最初の変更のみ Capture する

Slide 33

Slide 33 text

Slide 34

Slide 34 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. “Lambda-lith” 35 AWS Lambda Amazon DynamoDB Amazon API Gateway Client /* /create /update /delete ルーティングロジックを内包した Function ・セキュリティ（IAM Role）・パフォーマンス設定（メモリ、CPU）・クォータ（同時実⾏数など）・スケーリング Function 単位に適⽤される設定

Slide 35

Slide 35 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. “Nano Lambda” 36 Amazon DynamoDB Amazon API Gateway Client /create /update /delete

Slide 36

Slide 36 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 37 https://speakerdeck.com/_kensh/monolith-first-serverless-development AWS Dev Day 2023

Slide 37

Slide 37 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. delete.js “Nano Lambda” 38 Amazon DynamoDB Amazon API Gateway Client /create /update /delete import { DynamoDB } from "aws-sdk"; const dynamodb = new DynamoDB(); export const handler = async (event: any) => { const params = { TableName: "serverless-days-tokyo-2023", Key: { id: { S: event.id }, }, }; try { const data = await dynamodb.getItem(params).promise(); return { body: JSON.stringify(data) }; } catch (err) { return { error: err }; } }; update.js import { DynamoDB } from "aws-sdk"; const dynamodb = new DynamoDB(); export const handler = async (event: any) => { const params = { TableName: "serverless-days-tokyo-2023", Key: { id: { S: event.id }, }, }; try { const data = await dynamodb.getItem(params).promise(); return { body: JSON.stringify(data) }; } catch (err) { return { error: err }; } }; create.js import { DynamoDB } from "aws-sdk"; const dynamodb = new DynamoDB(); export const handler = async (event: any) => { const params = { TableName: "serverless-days-tokyo-2023", Key: { id: { S: event.id }, name: { S: event.name }, }, }; try { const data = await dynamodb.putItem(params).promise(); return { body: JSON.stringify(data) }; } catch (err) { return { error: err }; } };

Slide 38

Slide 38 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. API Gateway to Step Functions 39 AWS Step Functions Express Workflow を REST API に活⽤する start What’s method? End Choice state DynamoDB GET DynamoDB PUT DynamoDB POST DynamoDB DELETE AWS Step Functions Express workflow Amazon API Gateway Client sync ・ワークフローとロジックの可視化・Lambda ランタイムの削減・コスト効率の向上 Express workflow は同期的なレスポンスが可能

Slide 39

Slide 39 text

Slide 40

Slide 40 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverlesspresso Order Manager workflow 41 Order Manager API Mobile Order App Barista App AWS Workshop 🚀 オーダー管理アプリを Step Functions で実装しよう

Slide 41

Slide 41 text

Slide 42

Slide 42 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. まとめ・単なる “Gule Code” としての Lambda をやめることで AWS プラットフォームの恩恵を最⼤化する・AWS CDK のような⾃動化コードでトポロジーを表現することで役割を明確化し、変更に柔軟なアーキテクチャにしていく・Lambda Function の粒度を⾒つめ直す “Nano Lambda” が唯⼀解ではない、”Lambda-lith” は必ずしも悪ではない 43

Slide 43

Slide 43 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverlessland – Refactoring to Serverless 44 https://serverlessland.com/content/guides/refactoring-serverless/introduction

Slide 44

Slide 44 text

SERVERLESS DAYS TOKYO 2023 – REFACTORING SERVERLESS © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 淡路⼤輔アマゾンウェブサービスジャパン合同会社ソリューションアーキテクト @gee0awa