The serverless journey of shop.LEGO.com

re:Invent, Las Vegas, December 2nd, 2019

Connecting the LEGO play experience with millions of people requires an innovative platform. This has fueled the cloud migration of the legacy e-commerce application. In this session, we walk you through the principles, the approach, the learnings, and of course the serverless technologies that made the vision a reality. We cover multiple real-world use cases such as the integration of the e-commerce platform with the tax system, and the implementation of an event-streaming platform.

Transcript

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
   The serverless journey of
   shop.LEGO.com
   S V S 3 2 0
   Sheen Brisals
   Senior Application Engineer
   The LEGO Group
   Danilo Poccia
   Principal Evangelist
   Amazon Web Services
   

   View Slide

2. Agenda
   How it all started
   A journey through patterns
   Takeaways
   

   View Slide

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
   

   View Slide

4. View Slide

5. The “monolith” at the start of this journey
   Corporate
   data center
   Server contents Server contents
   Tax
   Products CRM
   Fulfillment Rewards
   Server contents
   

   View Slide

6. The “monolith” at the start of this journey
   VPC
   Node.js
   +
   React
   Elastic Beanstalk
   container
   Corporate
   data center
   Server contents Server contents
   Tax
   Products CRM
   Fulfillment Rewards
   Server contents
   

   View Slide

7. The “monolith” at the start of this journey
   VPC
   Node.js
   +
   React
   Elastic Beanstalk
   container
   Server contents Server contents
   Tax
   Products CRM
   Fulfillment Rewards
   VPC
   Gateway
   Corporate
   data center
   Server contents
   

   View Slide

8. Then, during Black Friday 2017 …
   VPC
   Node.js
   +
   React
   Elastic Beanstalk
   container
   Server contents Server contents
   Tax
   Products CRM
   Fulfillment Rewards
   VPC
   Gateway
   503 Service
   Unavailable
   Corporate
   data center
   Server contents
   

   View Slide

9. Consolation in chaos …
   

   View Slide

10. September 2018 – Decoupling the backend
    VPC
    Node.js
    +
    React
    Elastic Beanstalk
    container
    Server contents Server contents
    Tax
    Products CRM
    Fulfillment Rewards
    AWS Cloud
    SaaS
    VPC
    Gateway
    Server contents
    Corporate
    data center
    Amazon API
    Gateway
    AWS Lambda
    function
    

    View Slide

11. September 2018 – First production Lambda function
    

    View Slide

12. And the serverless journey begins!
    

    View Slide

13. Black Friday 2018
    

    View Slide

14. July 10, 2019
    shop.LEGO.com
    was switched to
    serverless
    on AWS
    

    View Slide

15. AWS services in use
    Amazon S3
    Amazon SNS
    AWS Fargate
    AWS Lambda
    Amazon Kinesis Data Firehose
    Amazon DynamoDB
    Amazon API Gateway
    AWS Step Functions
    Amazon SQS
    Amazon EC2
    Amazon ECS
    Amazon ECR
    Amazon VPC
    AWS WAF
    AWS KMS
    AWS Identity and Access
    Management (IAM)
    AWS X-Ray
    Amazon Route 53
    AWS CloudTrail
    Amazon ElastiCache
    Amazon CloudWatch
    Amazon EventBridge
    AWS CloudFormation
    Parameter Store
    

    View Slide

16. Growing usage stats from production
    165+ Lambda functions
    35+ microservices
    30+ API Gateway endpoints
    10+ DynamoDB tables
    5+ S3 buckets
    20+ SNS topics
    60+ SQS queues + DLQs
    70+ Systems Manager params
    

    View Slide

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    

    View Slide

18. Use case – Add item to shopping basket
    Customer Product Validation Basket
    

    View Slide

19. Pattern – Atomic request-response API
    Shopping app Add item API Business logic Basket data store
    Commerce platform
    Request
    Response
    Invoke Check/add
    • Performance is priority
    • Logic evaluation
    • No partial failure
    • Success or error response
    • Validation steps
    • Limit data relay
    

    View Slide

20. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    

    View Slide

21. Use case – Status polling for long-running processes
    “What’s the status of my order?”
    

    View Slide

22. Pattern – CQRS* with status cache
    Shop
    POST
    GET
    Submit order
    API
    Submit order
    function
    Submit order
    queue
    Process order
    function
    Update
    status
    Order status
    API
    Status provider
    function
    Order
    cache
    (TTL)
    Order number
    Query status
    Payment
    providers
    New
    commerce
    platform
    Frontend visibility Processing Failed Complete
    Backend visibility
    Validating Validation failed Payment authorized
    Payment processing Card declined Sent to fulfillment
    * Command Query Responsibility Segregation
    

    View Slide

23. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    

    View Slide

24. Use case – Voucher codes generation and notification
    Admin Voucher codes Voucher store Admin
    File download
    Email
    

    View Slide

25. Pattern – Email notification with signed URL
    Admin user Vouchers API Request handler Generate vouchers Voucher backup
    Voucher table
    Voucher topic
    Email notification
    Email with Amazon S3 signed URL
    Acknowledge
    POST
    1. Create vouchers
    2. Update voucher table
    3. Store batch on Amazon S3
    4. Generate Amazon S3 signed URL
    5. Send out notification
    • Vouchers from 1 to 1M
    • Unique voucher codes
    • Secure download option
    • User notification
    GET
    Async
    Sync
    

    View Slide

26. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    

    View Slide

27. Use case – User identity lookup in different systems
    Customer Customer
    identity
    Authenticate Authorize Rewards
    

    View Slide

28. What happens if identities don’t match?
    Customer Profile API Request handler
    LEGO
    identity
    Client app
    Rewards
    platform
    Commerce
    platform
    LEGO ID
    Rewards ID
    

    View Slide

29. Pattern – API authorizer with identity lookup
    Customer Profile API Request handler
    • Session must be valid
    • Session must belong to the user
    • Profile must exist
    • Profile ID must match
    LEGO
    identity
    Authorizer
    Commerce
    platform
    Rewards
    platform
    LEGO ID
    Rewards ID
    Client app
    

    View Slide

30. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    

    View Slide

31. Use case – On-demand customer data migration
    Customer New site New platform Notify Process
    New
    commerce
    platform
    Fetch
    Update
    

    View Slide

32. Pattern – Publish-subscribe sync
    • On-demand data sync
    • Real-time migration
    • Data in JSON format
    • No impact to user experience
    Customer topic
    New
    commerce
    platform
    New customer
    handler
    Customer
    created
    Fetch
    data
    Update data
    

    View Slide

33. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    

    View Slide

34. Use case – Product catalog import and update
    Commerce
    platform
    Feeds transform
    Products
    feeds
    

    View Slide

35. Pattern – Event-driven data pipeline with buffering
    Transform
    feed
    Transformed
    feeds queue
    Feeds
    store
    Commerce
    platform API
    Update
    data
    Data
    feeds Trigger Push Trigger Update
    • Feeds in JSON format
    • Independent feed flow
    • Immediate handling of feeds
    • Decoupled processing
    • Failure retry process
    • Failure notification
    DLQ
    Thousands per day processed as soon as possible Fine-grained control on throughput and errors
    Observability
    

    View Slide

36. Same pattern works for multiple object types
    Commerce
    platform API
    Data
    feeds
    Trigger
    Push Trigger
    Update
    Push Trigger
    Push Trigger
    Product
    Pricing
    SKU
    Observability
    DLQs
    

    View Slide

37. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    ✓ Product catalog import and update Event-driven data pipeline with buffering
    

    View Slide

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    “Code is a liability.
    Write less functions.”
    On Twitter
    Lots of People
    

    View Slide

39. Use case – API-driven data ingestion
    Processing
    Data store
    Data ingestion
    pipeline
    Event
    producer
    Ingest
    API
    

    View Slide

40. A first solution… Can we do better?
    Lambda
    function
    receive event
    & send to Kinesis
    Kinesis
    Data Firehose
    buffering
    API
    Gateway
    receive
    events
    Processing
    application
    S3
    bucket
    store events
    Event
    producer
    

    View Slide

41. Pattern – Codeless data ingestion
    Kinesis
    Data Firehose
    API
    Gateway
    S3
    bucket
    Event
    producer
    • API to stream directly
    • Less point of failures
    • Native integration
    • Less compute costs
    • Less code to maintain
    • Fully managed and scalable
    Transformation
    and validation
    Backup
    Fan-out
    function
    Processing
    functions
    Trigger
    Async
    Errors
    

    View Slide

42. https://bit.ly/2qhsBYH
    

    View Slide

43. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    ✓ Product catalog import and update Event-driven data pipeline with buffering
    ✓ API-driven data ingestion Codeless data ingestion
    

    View Slide

44. Use case – Unique order ID generation
    Checkout flow
    Loyalty customers
    Order number
    Customer ID
    

    View Slide

45. Pattern – Codeless sequence generator
    Sequences
    table
    Sequence
    number API
    Sequence
    item
    • No Lambda function
    • Repeatable pattern
    • Fully managed
    • Stateful resource
    • Atomic counter
    • Single table partition
    Counter
    attribute
    Any
    microservice
    

    View Slide

46. DynamoDB Atomic Counter
    {
    "TableName": ”sequences",
    "Key": {
    "id": {
    ”S": ”order"
    }
    },
    "ExpressionAttributeValues": {
    ":one": {
    "N": 1
    }
    },
    "UpdateExpression": "SET num = num + :one",
    "ReturnValues": "UPDATED_NEW"
    }
    Atomic update
    

    View Slide

47. https://bit.ly/33z1G8W
    

    View Slide

48. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    ✓ Product catalog import and update Event-driven data pipeline with buffering
    ✓ API-driven data ingestion Codeless data ingestion
    ✓ Unique order number generation Codeless sequence generator
    

    View Slide

49. August 15, 2019 – Unified LEGO.com
    

    View Slide

50. Use case – Website migration with URL changes
    Old site URL New site
    Identify
    destination
    Content
    provider
    

    View Slide

51. Pattern – URL redirects cached by CDN
    URL redirect
    function
    Content
    store
    URL rules
    Cache
    on /tmp
    Application
    Load
    Balancer
    CDN
    • 512 MB /tmp storage
    • 128MB – 3GB memory
    

    View Slide

52. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    ✓ Product catalog import and update Event-driven data pipeline with buffering
    ✓ API-driven data ingestion Codeless data ingestion
    ✓ Unique order number generation Codeless sequence generator
    ✓ Website migration with URL changes URL redirects cached by CDN
    

    View Slide

53. Use case – Keeping website sitemaps updated
    Timer Process Store
    sitemaps
    Publish Search
    engines
    

    View Slide

54. Pattern – Scheduled workflow
    Step
    Functions
    Trigger
    rule
    • Amazon S3 for storage
    • Amazon S3 as origin server
    • Runs daily – off peak
    • Sitemaps in XML
    Amazon CloudWatch
    Events
    

    View Slide

55. Pattern – Scheduled workflow
    /work
    /release
    CDN
    

    View Slide

56. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    ✓ Product catalog import and update Event-driven data pipeline with buffering
    ✓ API-driven data ingestion Codeless data ingestion
    ✓ Unique order number generation Codeless sequence generator
    ✓ Website migration with URL changes URL redirects cached by CDN
    ✓ Keeping website sitemaps updated Scheduled workflow
    

    View Slide

57. Use case – Checkout event processing
    Login
    Checkout
    Payment
    Order
    Data
    sync
    Shipping
    

    View Slide

58. Use case – Hub-and-spoke event bus
    Login
    Checkout
    Payment
    Order
    Data
    sync
    Shipping
    

    View Slide

59. July 10, 2019
    shop.LEGO.com
    was switched to
    serverless
    on AWS
    Flashback!
    

    View Slide

60. July 11, 2019
    The day after,
    Amazon EventBridge
    was launched
    

    View Slide

61. Pattern
    Customer
    login
    Login Shipping
    Send order
    to SAP
    Data sync
    Customer, VIP,
    wishlist sync
    Checkout
    Submit
    order
    Payment
    Authorize
    payment
    Commerce
    platform
    Order
    Process
    order
    Order and
    customer
    updates
    Event
    relay
    Customer
    login
    Invoke
    every
    minute
    Events Order
    complete
    Customer
    login
    Payment
    authorized
    Order
    submit
    Order
    complete
    EventBridge
    FIFO
    queue
    

    View Slide

62. Pattern – Hub-and-spoke event bus
    {
    "version": "0",
    "id": "6a7e8feb-b491-4cf7-a9f1-bf3703467718",
    "detail-type": "State change Notification",
    "source": "service-order-submit-dev",
    "account": "111122223333",
    "time": "2019-08-29T12:10:21Z",
    "region": "eu-central-1",
    "resources": [
    "arn:aws:events:event-bus/checkout-bus"
    ],
    "detail": {
    }
    }
    Customer-specific
    data goes in the
    “detail”
    

    View Slide

63. Pattern – Hub-and-spoke event bus
    {
    "version": "0",
    "id": "6a7e8feb-b491-4cf7-a9f1-bf3703467718",
    "detail-type": "State change Notification",
    "source": "service-order-submit-dev",
    "account": "123456789012",
    "time": "2019-08-29T12:10:21Z",
    "region": "eu-central-1",
    "resources": ["arn:aws:events:event-bus/checkout-bus"],
    "detail": {
    "event": {
    "meta_data": {
    "site_id": "LEGO Shop",
    "type": "CHECKOUT",
    "subtype": "ORDER",
    "status": "COMPLETE"
    },
    "data": {
    "order_number": "T123456789",
    "customer_id": "bf3703467718-29T12-6a7e8feb"
    }
    }
    }
    }
    Standard syntax
    across multiple
    services
    Custom for each
    service
    

    View Slide

64. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    ✓ Product catalog import and update Event-driven data pipeline with buffering
    ✓ API-driven data ingestion Codeless data ingestion
    ✓ Unique order number generation Codeless sequence generator
    ✓ Website migration with URL changes URL redirects cached by CDN
    ✓ Keeping website sitemaps updated Scheduled workflow
    ✓ Checkout event processing Hub-and-spoke event bus
    

    View Slide

65. A journey through patterns
    Use case Pattern
    ✓ Add item to shopping basket Atomic request-response API
    ✓ Status polling for long-running processes CQRS with status cache
    ✓ Voucher codes generation and notification Email notification with signed URL
    ✓ User identity lookup in different systems API authorizer with identity lookup
    ✓ On-demand customer data migration Publish-subscribe sync
    ✓ Product catalog import and update Event-driven data pipeline with buffering
    ✓ API-driven data ingestion Codeless data ingestion
    ✓ Unique order number generation Codeless sequence generator
    ✓ Website migration with URL changes URL redirects cached by CDN
    ✓ Keeping website sitemaps updated Scheduled workflow
    ✓ Checkout event processing Hub-and-spoke event bus
    

    View Slide

66. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    

    View Slide

67. Takeaways
    Look for something simple to begin with
    Implement automated integration tests
    Separate dev, test, prod accounts
    Architect in “set pieces”
    No throwaway PoCs
    Leverage patterns
    

    View Slide

68. Thank you!
    © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Sheen Brisals
    @sheenbrisals
    Danilo Poccia
    @danilop
    

    View Slide