Slide 1

Slide 1 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Eric Bianchi Jérôme Van Der Linden AWS Meetup Migrating to the new Swiss region

Slide 2

Slide 2 text

© 2021, Amazon Web Services, Inc. or its Affiliates. How AWS builds its infrastructure regions

Slide 3

Slide 3 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Making your life easier since 2006 Just choose the services you need and the region where to store your data or run your workloads, without worrying about the infrastructure. Today we want to show you how that “invisible infrastructure” is built.

Slide 4

Slide 4 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS is opening a region in Switzerland Will be operating in H2 – 2022 3 Availability Zones (more about this later) 7th European region (Ireland, Frankfurt, London, Paris, Stockholm, Milan) Even lower latency for end users Execute your workloads and store your data in Switzerland Geneva AWS Office Edge Location Zurich AWS Office Location of the upcoming region

Slide 5

Slide 5 text

© 2021, Amazon Web Services, Inc. or its Affiliates. How hard can it be? • Servers (CPU + RAM) • Storage • Networking • A control panel • A building • Some energy

Slide 6

Slide 6 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Millions of Active Customers Customers like you care about security, performance, scalability, choice, global reach, price, reliability... As an example, Amazon S3 —one of our services— now stores over 100 trillion (1014, or 100,000,000,000,000) objects, and regularly peaks at tens of millions of requests per second. 2012 2013 2015 2018 2014 2016 2008 2009 2010 2011

Slide 7

Slide 7 text

© 2021, Amazon Web Services, Inc. or its Affiliates. How hard can it be? Quite actually. • What if someone tries to tamper with our firmware? • How can we enable high availability and ultra low latency? • Is speed of light fast enough? • Can we make cement/concrete production emit less CO2? • How many global component providers do we need to make sure we always have supplies?

Slide 8

Slide 8 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS approach to reliability

Slide 9

Slide 9 text

© 2021, Amazon Web Services, Inc. or its Affiliates. At ~2001 Amazon.com ran on a single Data Center

Slide 10

Slide 10 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Obvious plan for improved availability

Slide 11

Slide 11 text

© 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?

Slide 12

Slide 12 text

© 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?

Slide 13

Slide 13 text

© 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?

Slide 14

Slide 14 text

© 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?

Slide 15

Slide 15 text

© 2021, Amazon Web Services, Inc. or its Affiliates. What’s the right trade off latency/distance?

Slide 16

Slide 16 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS Global Infrastructure as of today 25 geographical regions, 81 availability zones, 230+ POPs Region & Number of Availability Zones (AZs) GovCloud (US) Europe US-East (3), US-West (3) Frankfurt (3), Paris (3), Ireland (3), Stockholm (3), US West London (3), Milan (3) Oregon (4) Northern California (3) US East N. Virginia (6), Ohio (3) Middle East Bahrain (3) Canada Asia Pacific Central (3) Singapore (3), Sydney (3), Tokyo (4), Osaka (3) South America São Paulo (3) Seoul (4), Mumbai (3), Hong Kong (3) Africa China Cape Town (3) Beijing (2), Ningxia (3) Announced Regions 8 Regions and 24 AZs in Australia, India, Indonesia, Israel, Australia, Switzerland, Spain, and United Arab Emirates (UAE)

Slide 17

Slide 17 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS Region design AWS Regions are comprised of multiple AZs for high availability, high scalability, and high fault tolerance. Applications and data are replicated in real time and consistent in the different AZs. AWS Availability Zone (AZ) A Region is a physical location in the world where we have multiple Availability Zones. Availability Zones consist of one or more discrete data centers, each with redundant power, networking, and connectivity, housed in separate facilities. AZ AZ AZ AZ Transit Transit Datacenter Datacenter Datacenter AWS Region

Slide 18

Slide 18 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS Availability Zone (AZ) design • Fully isolated infrastructure with one or more datacenters • Meaningful distance of separation • Unique power infrastructure • Many 100Ks of servers at scale • Datacenters connected via fully redundant and isolated metro fiber

Slide 19

Slide 19 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS network design At least 2 redundant transit centers Highly peered & connected Transit center connections Inter-AZ connections Intra-AZ connections

Slide 20

Slide 20 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Global network: Redundant 100GbE network and private capacity between all regions except China Direct Connect: 80+ locations; customers can reach every AWS Region from their local Direct Connect PoP

Slide 21

Slide 21 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Innovation at lower costs 3456 fibers into a single conduit

Slide 22

Slide 22 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Innovation at lower costs 3456 6912 fibers into a single conduit *

Slide 23

Slide 23 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Traditional datacenters tend to standardize their servers

Slide 24

Slide 24 text

© 2021, Amazon Web Services, Inc. or its Affiliates. At scale, many specialized configurations make sense

Slide 25

Slide 25 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Broad and deep platform choice Categories Capabilities Options + + = 475+ instance types

Slide 26

Slide 26 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Choice of processors and architectures Intel Xeon Scalable (Skylake) processor Right compute for each application and workload Choice of GPUs and FPGAs for compute acceleration AWS Graviton processor 64-bit Arm AMD EPYC processor

Slide 27

Slide 27 text

© 2021, Amazon Web Services, Inc. or its Affiliates.

Slide 28

Slide 28 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Number of cores available

Slide 29

Slide 29 text

© 2021, Amazon Web Services, Inc. or its Affiliates. What is Nitro?

Slide 30

Slide 30 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Amazon EC2 Mac hardware: Mac mini with the AWS Nitro System

Slide 31

Slide 31 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Generators, UPSs, and Switches How can do we do predictive maintenance, taking the devices offline, while still on a highly available environment?

Slide 32

Slide 32 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Two independent power line-ups We’ve been getting ~99.99997% Availability in our DCs with this design

Slide 33

Slide 33 text

© 2021, Amazon Web Services, Inc. or its Affiliates. But you can always simplify … Battery packs and custom power supplies integrated into the rack

Slide 34

Slide 34 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Investing in wind and solar energy Amazon Web Services (AWS) is committed to running our business in the most environmentally friendly way possible and achieving 100% renewable energy usage for our global infrastructure. Cloud efficiency “Our results show that AWS’s infrastructure is 3.6 times more energy efficient than the median of the surveyed U.S. enterprise data centers. More than two-thirds of this advantage is attributable to the combination of a more energy efficient server population and much higher server utilization. AWS data centers are also more energy efficient than enterprise sites due to comprehensive efficiency programs that touch every facet of the facility. When we factor in the carbon intensity of consumed electricity and renewable energy purchases, which reduce associated carbon emissions, AWS performs the same task with an 88% lower carbon footprint.” Source: 451 Research, 2019, All Rights Reserved.

Slide 35

Slide 35 text

© 2021, Amazon Web Services, Inc. or its Affiliates. © 2021, Amazon Web Services, Inc. or its Affiliates. Do you still believe cloud is just someone’s else computer?

Slide 36

Slide 36 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS Services for a multi-region approach

Slide 37

Slide 37 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Single-region high-availability approach Leverage multiple Availability Zones (AZs) Zurich VPC Instances Database Instances Database Instances Database Availability Zone A Availability Zone B Availability Zone C

Slide 38

Slide 38 text

© 2021, Amazon Web Services, Inc. or its Affiliates. How to replicate data and services across region ?

Slide 39

Slide 39 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Amazon S3 Replication at a glance S3 Replication is an elastic, fully managed, low-cost feature that replicates objects between buckets S3 Replication offers flexibility via a rich set of features that allow you to configure where and how you want to replicate Once the replication rule is configured, S3 Replication automatically replicates objects and metadata in the source bucket

Slide 40

Slide 40 text

© 2021, Amazon Web Services, Inc. or its Affiliates. S3 Batch Replication • Replicate existing objects • Filtering capabilities • Granular visibility into replication progress

Slide 41

Slide 41 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Amazon Elastic Block Store snapshots • Point-in-time backup • Stored in S3 • Incremental • Cross-region copy EBS volume EBS snapshot

Slide 42

Slide 42 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Source Destination Introducing Amazon EFS Replication You can enable replication on an existing file system and select the replica settings independent of its source READ ONLY A read-only replica is automatically created in the selected Region and changes to your file system are transparently applied to its replica You can use the AWS Console, API, or CLI to enable replication or initiate failover to the replica

Slide 43

Slide 43 text

© 2021, Amazon Web Services, Inc. or its Affiliates. DynamoDB Global Tables Replica (US) Replica (Europe) Replica (Asia)

Slide 44

Slide 44 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Amazon RDS cross-region replication Master Replica Replica Replica Replica

Slide 45

Slide 45 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Cross-region backup with AWS Backup

Slide 46

Slide 46 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Source region Application users Internet VPN DMS – Database Migration Process • Start a replication instance • Connect to source and target databases • Select tables, schemas, or databases • Let AWS DMS load data and keep them in sync • Switch applications over to the target after they are in sync at your convenience AWS DMS

Slide 47

Slide 47 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Copy AMIs across Regions AMI (Amazon Machine Image) Distribute image AWS account AWS regions Golden AMI: “Known good” EC2 instance type, OS, packages Create them with Packer or EC2 Image Builder Get Them from running instances

Slide 48

Slide 48 text

© 2021, Amazon Web Services, Inc. or its Affiliates. EC2 Image Builder Image Recipe Image Recipe defines image configuration. It consists of source image and one or more components to be applied to the source image. Component describes how to build, validate, and test your image. Build Validate Test Build Component Test Component Source Image Output Image Image Recipe Image Builder Image Or Customer AMI

Slide 49

Slide 49 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Handling Region parity with infrastructure as code

Slide 50

Slide 50 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Manually in the Console ? Amazon EC2 👍 Easy to get started 🤔 Not reproducible 🤔 Error prone 🤔 Time consuming

Slide 51

Slide 51 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Scripting with the AWS CLI or an AWS SDK? 🤔 What happens if an API call fails? 🤔 How do I make updates? 🤔 How do I know a resource is ready? 🤔 How do I roll back? Amazon EC2 Ex with python sdk (boto3) Amazon SQS

Slide 52

Slide 52 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Using infrastructure as “code” AWS CloudFormation template (JSON/YAML) HashiCorp Configuration Language (HCL) Desired state configuration AWS CloudFormation 👍 Easy to automate 👍 Reproducible & consistent 😩 Configuration syntax 🤔 No abstraction, lots of details* Amazon EC2 Amazon SQS * Terraform modules and Cloudformation modules can help reduce the amount of code

Slide 53

Slide 53 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Key principles of infrastructure as code Declarative: define the desired state, not how to achieve it. Idempotent: reapplying the same code should not modify or add resources. Immutable: do not change the infrastructure manually (drift), use IaC to update or create a new one. Reproducible: can be applied in the same way in any region and will produce the same infrastructure with the same resources.

Slide 54

Slide 54 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Reproducibility / Repeatability Amazon EC2 us-east-1 Amazon EC2 us-west-1 Amazon EC2 eu-west-1 Amazon SQS Amazon SQS Amazon SQS

Slide 55

Slide 55 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Infrastructure as code, you said?

Slide 56

Slide 56 text

© 2021, Amazon Web Services, Inc. or its Affiliates. Provisionning infrastructure in the cloud Using infrastructure as REAL code AWS Cloud Development Kit (CDK) CLI Templates + assets AWS CloudFormation Amazon EC2 Amazon SQS synthesize deploy Declarative?! Imperative Declarative

Slide 57

Slide 57 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS CDK main components

Slide 58

Slide 58 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS CDK Constructs

Slide 59

Slide 59 text

© 2021, Amazon Web Services, Inc. or its Affiliates. AWS CDK DEMO