How to build a global serverless service [AWS Dev Day @ Kyiv]

Transcript

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. 0 6 . 1 1 . 1 9 How to build a global serverless service Alex Casalboni Technical Evangelist Amazon Web Services @alex_casalboni
2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. About me • Software Engineer & Web Developer • Worked in a startup for 4.5 years • ServerlessDays Organizer • AWS Customer since 2013
4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How (and why) do we build global serverless services?
5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Some fundamentals first!
6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability in parallel A = 1 – (1 – Ax)2 Part X Part X
7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability in parallel Component Availability Downtime X 99% (2-nines) 3 days 15 hours Two X in parallel 99.99% (4-nines) 52 minutes Three X in parallel 99.9999% (6-nines) 31 seconds
8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Component redundancy increases availability significantly!
9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. 21 Geographic Regions 66 Availability Zones (AZs) Upcoming: 4 regions and 12 AZs
10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Region and availability zones Region Availability zone a Availability zone b Availability zone c data center data center data center data center data center data center data center data center data center
11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-AZ Region Availability zone a Availability zone b Availability zone c Application Application Application ELB
12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-region Region Availability zone a Availability zone b Availability zone c Application Region Availability zone a Availability zone b Availability zone c Application Application Application Application Application Route 53
13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless components Region Availability zone a Availability zone b Availability zone c Serverless Services
14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why serverless components?? No provisioning, no management Pay for value Fault Tolerant and Automatic scaling Highly available and secure
15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why build a multi-region active-active architecture?
16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Improve latency for end-users ~300ms ~140ms
17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Improve availability and disaster recovery Applications in US West Applications in US East Users from San Francisco Users from New York Service 1 Service 2 Service 3 Service 4 Service 1 Service 2 Service 3 Service 4
18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Prerequisites to building a multi-region architecture
19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. CAP Theorem Consistency Availability Partition Tolerance Data is consistent. All nodes see the same state. Every request is non-failing. Service still responds as expected if some nodes crash. Distributed System In the presence of a network partition, you must choose between consistency and availability!
20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Embrace eventual consistency … if no new updates are made to a given data item, eventually all accesses to that item will return the last updated value. Availability An eventually consistent system can return any value before it converges!! https://en.wikipedia.org/wiki/Eventual_consistency Distributed System Every request is non-failing.
21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Secure and reliable global network youtube.com/watch?v=AyOAjFNPAbA
22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How can you achieve data replication?
23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Build high performance, globally distributed applications Low latency reads & writes to locally available tables Disaster proof with multi-region redundancy Easy to set up and no application rewrites required Globally dispersed users Replica (N. America) Replica (Europe) Replica (Asia) Global App Global Table Amazon DynamoDB Global Tables Fully managed, multi-master, multi-region database
24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replicates your data with no impact on database performance Typical cross-region replication latencies below 1 second An Aurora cluster can recover in less than 1 minute even in the event of a complete regional outage Recovery Point Objective (RPO) of 1 second Recovery Time Objective (RTO) of less than 1 minute Amazon Aurora Global Database Designed for globally distributed applications Globally dispersed users Replica (N. America) Replica (Europe) Replica (Asia) Global App Global Table
25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon S3 cross-region replication S3 Bucket S3 Bucket
26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. What about routing?
27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Global routing with Route 53 Route 53
28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Latency based routing Region Region Application Application
29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Geo-based routing Region us-east-1 Region us-west-2 Application Application
30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Weighted round robin routing Region us-east-1 Region us-west-2 Application Application
31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. DNS failover Region us-east-1 Region us-west-2 Application Application
32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Global Accelerator
33. AWS Global Accelerator: Before and After
34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 Global Table AWS Lambda AWS Lambda Amazon DynamoDB Amazon DynamoDB Amazon API Gateway Amazon API Gateway Amazon Route 53
36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 Global Table Amazon DynamoDB Amazon DynamoDB
37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 Global Table AWS Lambda AWS Lambda Amazon DynamoDB Amazon DynamoDB
43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 Global Table AWS Lambda AWS Lambda Amazon DynamoDB Amazon DynamoDB Amazon API Gateway Amazon API Gateway
45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 Global Table AWS Lambda AWS Lambda Amazon DynamoDB Amazon DynamoDB Amazon API Gateway Amazon API Gateway Amazon Route 53
48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Route53: Latency-based routing
49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let’s see it in action! https://map.global.faas.website
50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
51. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. A quick look at SLA’s AWS Lambda: 99.95% (4h of downtime) Amazon API Gateway: 99.95% (4h of downtime) Amazon DynamoDB: 99.999% (5min of downtime) Route 53: 100% (no downtime)
52. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 AWS Lambda AWS Lambda Amazon DynamoDB Amazon DynamoDB Amazon API Gateway Amazon API Gateway Amazon Route 53
53. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 99.95% 99.95% 99.999% 99.95% 99.95% 99.999% 100%
54. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 99.899% 100% 99.95% 99.95% 99.999%
55. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region eu-west-1 Region eu-central-1 99.899% 100% 99.9898% (2 regions) 99.95% 99.95% 99.999%
56. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. With 1 region: 99.899% (9h of downtime) With 2 regions: 99.9898% (1h of downtime) With 3 regions: 99.999% (5min of downtime) With 4 regions: 99.9999% (30s of downtime) With 5 regions: 100% (no downtime)
57. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
58. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Want to read more? bit.ly/adhorn-serverless-multi-region
59. Thank you! © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Alex Casalboni @alex_casalboni