$30 off During Our Annual Pro Sale. View Details »

AWS Meetup Geneva - Prepare for the new Swiss Region

AWS Meetup Geneva - Prepare for the new Swiss Region

AWS Swiss Region is coming in 2022. During the meetup, we described how AWS build the Regions, what services you can leverage to migrate your data and workloads in a Region, and how to leverage infrastructure as code to deploy your workload anywhere.

Jérôme Van Der Linden

April 05, 2022
Tweet

More Decks by Jérôme Van Der Linden

Other Decks in Technology

Transcript

  1. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Eric Bianchi
    Jérôme Van Der Linden
    AWS Meetup
    Migrating to the new Swiss region

    View Slide

  2. © 2021, Amazon Web Services, Inc. or its Affiliates.
    How AWS builds its
    infrastructure regions

    View Slide

  3. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Making your life easier since 2006
    Just choose the services you need and the region where to store your data or
    run your workloads, without worrying about the infrastructure.
    Today we want to show you how that “invisible infrastructure” is built.

    View Slide

  4. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS is opening a region in Switzerland
    Will be operating in H2 – 2022
    3 Availability Zones (more about this later)
    7th European region (Ireland, Frankfurt,
    London, Paris, Stockholm, Milan)
    Even lower latency
    for end users
    Execute your workloads
    and store your data in Switzerland
    Geneva
    AWS Office
    Edge Location
    Zurich
    AWS Office
    Location of the upcoming region

    View Slide

  5. © 2021, Amazon Web Services, Inc. or its Affiliates.
    How hard can it be?
    • Servers (CPU + RAM)
    • Storage
    • Networking
    • A control panel
    • A building
    • Some energy

    View Slide

  6. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Millions of Active Customers
    Customers like you care about security, performance,
    scalability, choice, global reach, price, reliability...
    As an example, Amazon S3 —one of our services—
    now stores over 100 trillion (1014, or
    100,000,000,000,000) objects, and regularly peaks
    at tens of millions of requests per second.
    2012 2013 2015 2018
    2014 2016
    2008 2009 2010 2011

    View Slide

  7. © 2021, Amazon Web Services, Inc. or its Affiliates.
    How hard can it be? Quite actually.
    • What if someone tries to tamper with our firmware?
    • How can we enable high availability and ultra low latency?
    • Is speed of light fast enough?
    • Can we make cement/concrete production emit less CO2?
    • How many global component providers do we need to make sure we
    always have supplies?

    View Slide

  8. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS approach to reliability

    View Slide

  9. © 2021, Amazon Web Services, Inc. or its Affiliates.
    At ~2001 Amazon.com ran on a single Data Center

    View Slide

  10. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Obvious plan for improved availability

    View Slide

  11. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?

    View Slide

  12. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?

    View Slide

  13. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?

    View Slide

  14. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?

    View Slide

  15. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?

    View Slide

  16. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Global Infrastructure as of today
    25 geographical regions, 81 availability zones, 230+ POPs
    Region & Number of Availability Zones (AZs)
    GovCloud (US) Europe
    US-East (3), US-West (3) Frankfurt (3), Paris (3),
    Ireland (3), Stockholm (3),
    US West London (3), Milan (3)
    Oregon (4)
    Northern California (3)
    US East
    N. Virginia (6), Ohio (3)
    Middle East
    Bahrain (3)
    Canada Asia Pacific
    Central (3) Singapore (3), Sydney (3),
    Tokyo (4), Osaka (3)
    South America
    São Paulo (3)
    Seoul (4), Mumbai (3),
    Hong Kong (3)
    Africa China
    Cape Town (3) Beijing (2), Ningxia (3)
    Announced Regions
    8 Regions and 24 AZs in Australia, India, Indonesia, Israel, Australia, Switzerland,
    Spain, and United Arab Emirates (UAE)

    View Slide

  17. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Region design
    AWS Regions are comprised of multiple AZs for high availability, high scalability, and
    high fault tolerance. Applications and data are replicated in real time and consistent
    in the different AZs.
    AWS Availability Zone (AZ)
    A Region is a physical location in the world
    where we have multiple Availability Zones.
    Availability Zones consist of one or more discrete data
    centers, each with redundant power, networking, and
    connectivity, housed in separate facilities.
    AZ
    AZ
    AZ AZ
    Transit
    Transit
    Datacenter
    Datacenter
    Datacenter
    AWS Region

    View Slide

  18. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Availability Zone (AZ) design
    • Fully isolated infrastructure with
    one or more datacenters
    • Meaningful distance of separation
    • Unique power infrastructure
    • Many 100Ks of servers at scale
    • Datacenters connected via
    fully redundant and isolated metro
    fiber

    View Slide

  19. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS network design
    At least 2 redundant transit centers Highly peered & connected
    Transit center connections
    Inter-AZ connections
    Intra-AZ connections

    View Slide

  20. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Global network:
    Redundant 100GbE network
    and private capacity between
    all regions except China
    Direct Connect:
    80+ locations; customers can
    reach every AWS Region from
    their local Direct Connect PoP

    View Slide

  21. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Innovation at lower costs
    3456 fibers into a single conduit

    View Slide

  22. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Innovation at lower costs
    3456 6912 fibers into a single conduit *

    View Slide

  23. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Traditional datacenters tend to standardize their servers

    View Slide

  24. © 2021, Amazon Web Services, Inc. or its Affiliates.
    At scale, many specialized configurations make sense

    View Slide

  25. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Broad and deep platform choice
    Categories Capabilities Options
    + + =
    475+
    instance types

    View Slide

  26. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Choice of processors and architectures
    Intel Xeon Scalable
    (Skylake) processor
    Right compute for each application and workload
    Choice of GPUs and FPGAs for compute acceleration
    AWS Graviton processor
    64-bit Arm
    AMD EPYC processor

    View Slide

  27. © 2021, Amazon Web Services, Inc. or its Affiliates.

    View Slide

  28. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Number of cores available

    View Slide

  29. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What is Nitro?

    View Slide

  30. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon EC2 Mac hardware: Mac mini with the AWS Nitro System

    View Slide

  31. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Generators, UPSs, and Switches
    How can do we do
    predictive maintenance,
    taking the devices offline,
    while still on a highly
    available environment?

    View Slide

  32. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Two independent power line-ups
    We’ve been getting
    ~99.99997%
    Availability in our
    DCs with this design

    View Slide

  33. © 2021, Amazon Web Services, Inc. or its Affiliates.
    But you can always simplify …
    Battery packs and custom power supplies integrated into the rack

    View Slide

  34. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Investing in wind and solar energy
    Amazon Web Services (AWS) is committed to running our business
    in the most environmentally friendly way possible and achieving
    100% renewable energy usage for our global infrastructure.
    Cloud efficiency
    “Our results show that AWS’s infrastructure is 3.6 times more
    energy efficient than the median of the surveyed U.S. enterprise
    data centers. More than two-thirds of this advantage is
    attributable to the combination of a more energy efficient
    server population and much higher server utilization. AWS
    data centers are also more energy efficient than enterprise
    sites due to comprehensive efficiency programs that touch
    every facet of the facility.
    When we factor in the carbon intensity of consumed electricity
    and renewable energy purchases, which reduce associated carbon
    emissions, AWS performs the same task with an 88% lower
    carbon footprint.”
    Source: 451 Research, 2019, All Rights Reserved.

    View Slide

  35. © 2021, Amazon Web Services, Inc. or its Affiliates.
    © 2021, Amazon Web Services, Inc. or its Affiliates.
    Do you still believe
    cloud is just someone’s
    else computer?

    View Slide

  36. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Services for a
    multi-region approach

    View Slide

  37. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Single-region high-availability approach
    Leverage multiple Availability Zones (AZs)
    Zurich
    VPC
    Instances
    Database
    Instances
    Database
    Instances
    Database
    Availability Zone A Availability Zone B Availability Zone C

    View Slide

  38. © 2021, Amazon Web Services, Inc. or its Affiliates.
    How to replicate data and services across region
    ?

    View Slide

  39. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon S3 Replication at a glance
    S3 Replication is an elastic, fully
    managed, low-cost feature that
    replicates objects between buckets
    S3 Replication offers flexibility via a
    rich set of features that allow you to
    configure where and how you want
    to replicate
    Once the replication rule is
    configured, S3 Replication
    automatically replicates objects and
    metadata in the source bucket

    View Slide

  40. © 2021, Amazon Web Services, Inc. or its Affiliates.
    S3 Batch Replication
    • Replicate existing objects
    • Filtering capabilities
    • Granular visibility into replication
    progress

    View Slide

  41. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon Elastic Block Store snapshots
    • Point-in-time backup
    • Stored in S3
    • Incremental
    • Cross-region copy
    EBS volume
    EBS snapshot

    View Slide

  42. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Source
    Destination
    Introducing Amazon EFS Replication
    You can enable replication on an existing file
    system and select the replica settings
    independent of its source
    READ ONLY
    A read-only replica is automatically created in the
    selected Region and changes to your file system
    are transparently applied to its replica
    You can use the AWS Console, API, or CLI to
    enable replication or initiate failover to the replica

    View Slide

  43. © 2021, Amazon Web Services, Inc. or its Affiliates.
    DynamoDB Global Tables
    Replica (US)
    Replica (Europe)
    Replica (Asia)

    View Slide

  44. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon RDS cross-region replication
    Master
    Replica
    Replica
    Replica
    Replica

    View Slide

  45. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Cross-region backup with AWS Backup

    View Slide

  46. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Source region
    Application users
    Internet
    VPN
    DMS – Database Migration Process
    • Start a replication instance
    • Connect to source and target databases
    • Select tables, schemas, or databases
    • Let AWS DMS load data and keep
    them in sync
    • Switch applications over to the
    target after they are in sync at your
    convenience
    AWS DMS

    View Slide

  47. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Copy AMIs across Regions
    AMI
    (Amazon Machine Image) Distribute image
    AWS account
    AWS regions
    Golden AMI:
    “Known good” EC2 instance type, OS, packages
    Create them with Packer or EC2 Image Builder
    Get Them from running instances

    View Slide

  48. © 2021, Amazon Web Services, Inc. or its Affiliates.
    EC2 Image Builder Image Recipe
    Image Recipe defines image configuration. It consists of source image and one or more
    components to be applied to the source image. Component describes how to build, validate,
    and test your image.
    Build Validate Test
    Build Component Test Component
    Source Image
    Output Image
    Image Recipe
    Image Builder
    Image
    Or
    Customer AMI

    View Slide

  49. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Handling Region parity
    with infrastructure as code

    View Slide

  50. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Manually in the Console ?
    Amazon EC2
    👍 Easy to get started
    🤔 Not reproducible
    🤔 Error prone
    🤔 Time consuming

    View Slide

  51. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Scripting with the AWS CLI or an AWS SDK?
    🤔 What happens if an API call fails?
    🤔 How do I make updates?
    🤔 How do I know a resource is ready?
    🤔 How do I roll back?
    Amazon EC2
    Ex with python sdk (boto3)
    Amazon SQS

    View Slide

  52. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Using infrastructure as “code”
    AWS CloudFormation
    template
    (JSON/YAML)
    HashiCorp Configuration
    Language (HCL)
    Desired state configuration
    AWS CloudFormation
    👍 Easy to automate
    👍 Reproducible & consistent
    😩 Configuration syntax
    🤔 No abstraction, lots of details*
    Amazon EC2
    Amazon SQS
    * Terraform modules and Cloudformation modules can help reduce the amount of code

    View Slide

  53. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Key principles of infrastructure as code
    Declarative: define the desired state, not how to achieve it.
    Idempotent: reapplying the same code should not modify or add
    resources.
    Immutable: do not change the infrastructure manually (drift), use IaC to
    update or create a new one.
    Reproducible: can be applied in the same way in any region and will
    produce the same infrastructure with the same resources.

    View Slide

  54. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Reproducibility / Repeatability
    Amazon EC2
    us-east-1
    Amazon EC2
    us-west-1
    Amazon EC2
    eu-west-1
    Amazon SQS
    Amazon SQS
    Amazon SQS

    View Slide

  55. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Infrastructure as code, you said?

    View Slide

  56. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Using infrastructure as REAL code
    AWS
    Cloud Development Kit
    (CDK) CLI
    Templates
    + assets
    AWS
    CloudFormation
    Amazon EC2
    Amazon SQS
    synthesize deploy
    Declarative?!
    Imperative Declarative

    View Slide

  57. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS CDK main components

    View Slide

  58. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS CDK Constructs

    View Slide

  59. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS CDK
    DEMO

    View Slide