AWS Meetup Geneva - Prepare for the new Swiss Region

AWS Swiss Region is coming in 2022. During the meetup, we described how AWS build the Regions, what services you can leverage to migrate your data and workloads in a Region, and how to leverage infrastructure as code to deploy your workload anywhere.

Transcript

1. © 2021, Amazon Web Services, Inc. or its Affiliates. Eric Bianchi Jérôme Van Der Linden AWS Meetup Migrating to the new Swiss region
2. © 2021, Amazon Web Services, Inc. or its Affiliates. How AWS builds its infrastructure regions
3. © 2021, Amazon Web Services, Inc. or its Affiliates. Making your life easier since 2006 Just choose the services you need and the region where to store your data or run your workloads, without worrying about the infrastructure. Today we want to show you how that “invisible infrastructure” is built.
4. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS is opening a region in Switzerland Will be operating in H2 – 2022 3 Availability Zones (more about this later) 7th European region (Ireland, Frankfurt, London, Paris, Stockholm, Milan) Even lower latency for end users Execute your workloads and store your data in Switzerland Geneva AWS Office Edge Location Zurich AWS Office Location of the upcoming region
5. © 2021, Amazon Web Services, Inc. or its Affiliates. How hard can it be? • Servers (CPU + RAM) • Storage • Networking • A control panel • A building • Some energy
6. © 2021, Amazon Web Services, Inc. or its Affiliates. Millions of Active Customers Customers like you care about security, performance, scalability, choice, global reach, price, reliability... As an example, Amazon S3 —one of our services— now stores over 100 trillion (1014, or 100,000,000,000,000) objects, and regularly peaks at tens of millions of requests per second. 2012 2013 2015 2018 2014 2016 2008 2009 2010 2011
7. © 2021, Amazon Web Services, Inc. or its Affiliates. How hard can it be? Quite actually. • What if someone tries to tamper with our firmware? • How can we enable high availability and ultra low latency? • Is speed of light fast enough? • Can we make cement/concrete production emit less CO2? • How many global component providers do we need to make sure we always have supplies?
8. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS approach to reliability
9. © 2021, Amazon Web Services, Inc. or its Affiliates. At ~2001 Amazon.com ran on a single Data Center
10. © 2021, Amazon Web Services, Inc. or its Affiliates. Obvious plan for improved availability
11. © 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?
12. © 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?
13. © 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?
14. © 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?
15. © 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?
16. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS Global Infrastructure as of today 25 geographical regions, 81 availability zones, 230+ POPs Region & Number of Availability Zones (AZs) GovCloud (US) Europe US-East (3), US-West (3) Frankfurt (3), Paris (3), Ireland (3), Stockholm (3), US West London (3), Milan (3) Oregon (4) Northern California (3) US East N. Virginia (6), Ohio (3) Middle East Bahrain (3) Canada Asia Pacific Central (3) Singapore (3), Sydney (3), Tokyo (4), Osaka (3) South America São Paulo (3) Seoul (4), Mumbai (3), Hong Kong (3) Africa China Cape Town (3) Beijing (2), Ningxia (3) Announced Regions 8 Regions and 24 AZs in Australia, India, Indonesia, Israel, Australia, Switzerland, Spain, and United Arab Emirates (UAE)
17. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS Region design AWS Regions are comprised of multiple AZs for high availability, high scalability, and high fault tolerance. Applications and data are replicated in real time and consistent in the different AZs. AWS Availability Zone (AZ) A Region is a physical location in the world where we have multiple Availability Zones. Availability Zones consist of one or more discrete data centers, each with redundant power, networking, and connectivity, housed in separate facilities. AZ AZ AZ AZ Transit Transit Datacenter Datacenter Datacenter AWS Region
18. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS Availability Zone (AZ) design • Fully isolated infrastructure with one or more datacenters • Meaningful distance of separation • Unique power infrastructure • Many 100Ks of servers at scale • Datacenters connected via fully redundant and isolated metro fiber
19. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS network design At least 2 redundant transit centers Highly peered & connected Transit center connections Inter-AZ connections Intra-AZ connections
20. © 2021, Amazon Web Services, Inc. or its Affiliates. Global network: Redundant 100GbE network and private capacity between all regions except China Direct Connect: 80+ locations; customers can reach every AWS Region from their local Direct Connect PoP
21. © 2021, Amazon Web Services, Inc. or its Affiliates. Innovation at lower costs 3456 fibers into a single conduit
22. © 2021, Amazon Web Services, Inc. or its Affiliates. Innovation at lower costs 3456 6912 fibers into a single conduit *
23. © 2021, Amazon Web Services, Inc. or its Affiliates. Traditional datacenters tend to standardize their servers
24. © 2021, Amazon Web Services, Inc. or its Affiliates. At scale, many specialized configurations make sense
25. © 2021, Amazon Web Services, Inc. or its Affiliates. Broad and deep platform choice Categories Capabilities Options + + = 475+ instance types
26. © 2021, Amazon Web Services, Inc. or its Affiliates. Choice of processors and architectures Intel Xeon Scalable (Skylake) processor Right compute for each application and workload Choice of GPUs and FPGAs for compute acceleration AWS Graviton processor 64-bit Arm AMD EPYC processor
27. © 2021, Amazon Web Services, Inc. or its Affiliates.
28. © 2021, Amazon Web Services, Inc. or its Affiliates. Number of cores available
29. © 2021, Amazon Web Services, Inc. or its Affiliates. What is Nitro?
30. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon EC2 Mac hardware: Mac mini with the AWS Nitro System
31. © 2021, Amazon Web Services, Inc. or its Affiliates. Generators, UPSs, and Switches How can do we do predictive maintenance, taking the devices offline, while still on a highly available environment?
32. © 2021, Amazon Web Services, Inc. or its Affiliates. Two independent power line-ups We’ve been getting ~99.99997% Availability in our DCs with this design
33. © 2021, Amazon Web Services, Inc. or its Affiliates. But you can always simplify … Battery packs and custom power supplies integrated into the rack
34. © 2021, Amazon Web Services, Inc. or its Affiliates. Investing in wind and solar energy Amazon Web Services (AWS) is committed to running our business in the most environmentally friendly way possible and achieving 100% renewable energy usage for our global infrastructure. Cloud efficiency “Our results show that AWS’s infrastructure is 3.6 times more energy efficient than the median of the surveyed U.S. enterprise data centers. More than two-thirds of this advantage is attributable to the combination of a more energy efficient server population and much higher server utilization. AWS data centers are also more energy efficient than enterprise sites due to comprehensive efficiency programs that touch every facet of the facility. When we factor in the carbon intensity of consumed electricity and renewable energy purchases, which reduce associated carbon emissions, AWS performs the same task with an 88% lower carbon footprint.” Source: 451 Research, 2019, All Rights Reserved.
35. © 2021, Amazon Web Services, Inc. or its Affiliates. © 2021, Amazon Web Services, Inc. or its Affiliates. Do you still believe cloud is just someone’s else computer?
36. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS Services for a multi-region approach
37. © 2021, Amazon Web Services, Inc. or its Affiliates. Single-region high-availability approach Leverage multiple Availability Zones (AZs) Zurich VPC Instances Database Instances Database Instances Database Availability Zone A Availability Zone B Availability Zone C
38. © 2021, Amazon Web Services, Inc. or its Affiliates. How to replicate data and services across region ?
39. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon S3 Replication at a glance S3 Replication is an elastic, fully managed, low-cost feature that replicates objects between buckets S3 Replication offers flexibility via a rich set of features that allow you to configure where and how you want to replicate Once the replication rule is configured, S3 Replication automatically replicates objects and metadata in the source bucket
40. © 2021, Amazon Web Services, Inc. or its Affiliates. S3 Batch Replication • Replicate existing objects • Filtering capabilities • Granular visibility into replication progress
41. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon Elastic Block Store snapshots • Point-in-time backup • Stored in S3 • Incremental • Cross-region copy EBS volume EBS snapshot
42. © 2021, Amazon Web Services, Inc. or its Affiliates. Source Destination Introducing Amazon EFS Replication You can enable replication on an existing file system and select the replica settings independent of its source READ ONLY A read-only replica is automatically created in the selected Region and changes to your file system are transparently applied to its replica You can use the AWS Console, API, or CLI to enable replication or initiate failover to the replica
43. © 2021, Amazon Web Services, Inc. or its Affiliates. DynamoDB Global Tables Replica (US) Replica (Europe) Replica (Asia)
44. © 2021, Amazon Web Services, Inc. or its Affiliates. Amazon RDS cross-region replication Master Replica Replica Replica Replica
45. © 2021, Amazon Web Services, Inc. or its Affiliates. Cross-region backup with AWS Backup
46. © 2021, Amazon Web Services, Inc. or its Affiliates. Source region Application users Internet VPN DMS – Database Migration Process • Start a replication instance • Connect to source and target databases • Select tables, schemas, or databases • Let AWS DMS load data and keep them in sync • Switch applications over to the target after they are in sync at your convenience AWS DMS
47. © 2021, Amazon Web Services, Inc. or its Affiliates. Copy AMIs across Regions AMI (Amazon Machine Image) Distribute image AWS account AWS regions Golden AMI: “Known good” EC2 instance type, OS, packages Create them with Packer or EC2 Image Builder Get Them from running instances
48. © 2021, Amazon Web Services, Inc. or its Affiliates. EC2 Image Builder Image Recipe Image Recipe defines image configuration. It consists of source image and one or more components to be applied to the source image. Component describes how to build, validate, and test your image. Build Validate Test Build Component Test Component Source Image Output Image Image Recipe Image Builder Image Or Customer AMI
49. © 2021, Amazon Web Services, Inc. or its Affiliates. Handling Region parity with infrastructure as code
50. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Manually in the Console ? Amazon EC2 👍 Easy to get started 🤔 Not reproducible 🤔 Error prone 🤔 Time consuming
51. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Scripting with the AWS CLI or an AWS SDK? 🤔 What happens if an API call fails? 🤔 How do I make updates? 🤔 How do I know a resource is ready? 🤔 How do I roll back? Amazon EC2 Ex with python sdk (boto3) Amazon SQS
52. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Using infrastructure as “code” AWS CloudFormation template (JSON/YAML) HashiCorp Configuration Language (HCL) Desired state configuration AWS CloudFormation 👍 Easy to automate 👍 Reproducible & consistent 😩 Configuration syntax 🤔 No abstraction, lots of details* Amazon EC2 Amazon SQS * Terraform modules and Cloudformation modules can help reduce the amount of code
53. © 2021, Amazon Web Services, Inc. or its Affiliates. Key principles of infrastructure as code Declarative: define the desired state, not how to achieve it. Idempotent: reapplying the same code should not modify or add resources. Immutable: do not change the infrastructure manually (drift), use IaC to update or create a new one. Reproducible: can be applied in the same way in any region and will produce the same infrastructure with the same resources.
54. © 2021, Amazon Web Services, Inc. or its Affiliates. Reproducibility / Repeatability Amazon EC2 us-east-1 Amazon EC2 us-west-1 Amazon EC2 eu-west-1 Amazon SQS Amazon SQS Amazon SQS
55. © 2021, Amazon Web Services, Inc. or its Affiliates. Infrastructure as code, you said?
56. © 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Using infrastructure as REAL code AWS Cloud Development Kit (CDK) CLI Templates + assets AWS CloudFormation Amazon EC2 Amazon SQS synthesize deploy Declarative?! Imperative Declarative
57. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS CDK main components
58. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS CDK Constructs
59. © 2021, Amazon Web Services, Inc. or its Affiliates. AWS CDK DEMO