Safe Lambda Deployments 2019-02-19

PDX Serverless Architecture Meetup
February 19, 2019
Portland Oregon

#awscloud #awslambda #serverless #pdxtech

Transcript

1. Sean Sullivan February 19, 2019 Serverless Meetup Portland Oregon SAFE LAMBDA DEPLOYMENTS
2. www.stackery.io
3. software engineer Portland Oregon e-commerce systems Hudson’s Bay Company About me
5. saksfifthavenue.com saksoff5th.com lordandtaylor.com thebay.com
6. saksfifthavenue.com
7. “Your deploys should be as boring, straightforward, and stress-free as possible” Zach Holman March 2016 https://zachholman.com/posts/deploying-software
8. “You don't need release managers, you don't need special deploy days, you don't need all hands on deck for every single deploy.” Zach Holman March 2016 https://zachholman.com/posts/deploying-software
9. “We love to deploy new code incrementally hundreds of times a day. And there's good reason for that: it's safer overall. Incremental deploys are easier to understand and fix than one gigantic deploy once a year.” https://zachholman.com/talk/move-fast-break-nothing/ Zach Holman October 2014
10. https://twitter.com/gwenshap/status/1059870433736937472 QCon San Francisco November 2018
11. “You go to production with the code you have, not the code you might want or wish to have at a later time.” Donald Rumsfeld December 2004 * fake quote
12. https://twitter.com/CodeWisdom/status/1097852555118432257
13. undifferentiated heavy lifting AWS
14. provisioning servers AWS serverless
16. system plumbing business logic
18. HBC 2019 microservice architecture multi-tenant services increased adoption of AWS Lambda safe deployments
20. HBC email types • order acknowledgement • order shipment partial • order shipment full • order cancel • ready for pickup in store
21. Queue consumer Event queue Email Dashboard UI Email Sender Email Render External Email Provider Feature Flag service
22. Email Render Product Detail service Delivery Date Estimation service request HTML Feature Flag service
23. HBC email system • multi-tenant design • Cloudwatch Metrics • Cloudwatch Alerts
24. HBC email system • code coverage threshold • components deployed independently • safe deployments
25. Mark Zuckerberg
26. Move Fast and Break Things Move Slow and Don’t Break Things
27. Move Fast and Don’t Break Things Move Purposefully and Fix Things
28. manual testing automated testing
29. how often do you release code to production?
30. safe AWS Lambda deployments?
31. https://www.youtube.com/watch?v=UIp6sLyvoC0 Gerardo Estaba August 2018
34. Traffic Shifting
35. You can now shift incoming traffic between two AWS Lambda function versions based on pre-assigned weights. You can now also use AWS CodeDeploy to automatically manage the rollout of new function versions. This allows you to gradually shift traffic between two versions source: aws.amazon.com
36. Traffic Shifting configurations AllAtOnce Canary10Percent30Minutes Canary10Percent5Minutes Canary10Percent10Minutes Canary10Percent15Minutes
37. Linear10PercentEvery10Minutes Linear10PercentEvery1Minute Linear10PercentEvery2Minutes Linear10PercentEvery3Minutes Traffic Shifting configurations
38. all-at-once traffic shifting gradual traffic shifting
39. AWS command line tools
40. $ brew update $ brew tap aws/tap $ brew install aws/tap/aws-sam-cli $ brew install aws-cli
41. Live demo
42. aws cloudformation package \ --template-file my-template.yaml \ --s3-bucket mycorp-codedeploy \ --s3-prefix my-lambda-func/jars \ --output-template-file package/2325bd1e.yaml
43. aws cloudformation deploy \ --template-file package/2325bd1e.yaml \ --stack-name mylambda-func—xyz \ --parameter-overrides Stage=xyz \ --region us-east-1 \ --capabilities CAPABILITY_IAM \ --notification-arns arn:aws:sns:us- east-1:123456789:myteam-cf-notifications
44. aws cloudformation deploy \ --template-file package/2325bd1e.yaml \ --stack-name mylambda-func—xyz \ --parameter-overrides Stage=xyz \ --parameter-overrides DeploymentPref=Canary10Percent5Minutes \ --region us-east-1 \ --capabilities CAPABILITY_IAM \ --notification-arns arn:aws:sns:us- east-1:123456789:myteam-cf-notifications
45. Traffic Hooks
46. AWS traffic hooks • PreTraffic hook • PostTraffic hook
47. AWS CodeDeploy UI https://console.aws.amazon.com/codesuite/codedeploy/deployments
48. https://github.com/awslabs/serverless-application-model/pull/605
49. AWS re:Invent 2018
50. Clare Liguori November 2018 https://www.youtube.com/watch?v=01ewawuL-IY
51. Clare Liguori November 2018 https://www.youtube.com/watch?v=01ewawuL-IY
52. additional validation logic in Pre Traffic hook implement Post Traffic hook utilize AWS Cloud9 IDE Future work at HBC
53. Final thoughts
54. traffic shifting
55. small incremental releases
56. engineering velocity is a competitive advantage
57. The end