AWS Meetup Geneva - Prepare for the new Swiss Region

AWS Swiss Region is coming in 2022. During the meetup, we described how AWS build the Regions, what services you can leverage to migrate your data and workloads in a Region, and how to leverage infrastructure as code to deploy your workload anywhere.

Transcript

1. © 2021, Amazon Web Services, Inc. or its Affiliates.
   Eric Bianchi
   Jérôme Van Der Linden
   AWS Meetup
   Migrating to the new Swiss region
   

   View Slide

2. © 2021, Amazon Web Services, Inc. or its Affiliates.
   How AWS builds its
   infrastructure regions
   

   View Slide

3. © 2021, Amazon Web Services, Inc. or its Affiliates.
   Making your life easier since 2006
   Just choose the services you need and the region where to store your data or
   run your workloads, without worrying about the infrastructure.
   Today we want to show you how that “invisible infrastructure” is built.
   

   View Slide

4. © 2021, Amazon Web Services, Inc. or its Affiliates.
   AWS is opening a region in Switzerland
   Will be operating in H2 – 2022
   3 Availability Zones (more about this later)
   7th European region (Ireland, Frankfurt,
   London, Paris, Stockholm, Milan)
   Even lower latency
   for end users
   Execute your workloads
   and store your data in Switzerland
   Geneva
   AWS Office
   Edge Location
   Zurich
   AWS Office
   Location of the upcoming region
   

   View Slide

5. © 2021, Amazon Web Services, Inc. or its Affiliates.
   How hard can it be?
   • Servers (CPU + RAM)
   • Storage
   • Networking
   • A control panel
   • A building
   • Some energy
   

   View Slide

6. © 2021, Amazon Web Services, Inc. or its Affiliates.
   Millions of Active Customers
   Customers like you care about security, performance,
   scalability, choice, global reach, price, reliability...
   As an example, Amazon S3 —one of our services—
   now stores over 100 trillion (1014, or
   100,000,000,000,000) objects, and regularly peaks
   at tens of millions of requests per second.
   2012 2013 2015 2018
   2014 2016
   2008 2009 2010 2011
   

   View Slide

7. © 2021, Amazon Web Services, Inc. or its Affiliates.
   How hard can it be? Quite actually.
   • What if someone tries to tamper with our firmware?
   • How can we enable high availability and ultra low latency?
   • Is speed of light fast enough?
   • Can we make cement/concrete production emit less CO2?
   • How many global component providers do we need to make sure we
   always have supplies?
   

   View Slide

8. © 2021, Amazon Web Services, Inc. or its Affiliates.
   AWS approach to reliability
   

   View Slide

9. © 2021, Amazon Web Services, Inc. or its Affiliates.
   At ~2001 Amazon.com ran on a single Data Center
   

   View Slide

10. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Obvious plan for improved availability
    

    View Slide

11. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?
    

    View Slide

12. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?
    

    View Slide

13. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?
    

    View Slide

14. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?
    

    View Slide

15. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What’s the right trade off latency/distance?
    

    View Slide

16. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Global Infrastructure as of today
    25 geographical regions, 81 availability zones, 230+ POPs
    Region & Number of Availability Zones (AZs)
    GovCloud (US) Europe
    US-East (3), US-West (3) Frankfurt (3), Paris (3),
    Ireland (3), Stockholm (3),
    US West London (3), Milan (3)
    Oregon (4)
    Northern California (3)
    US East
    N. Virginia (6), Ohio (3)
    Middle East
    Bahrain (3)
    Canada Asia Pacific
    Central (3) Singapore (3), Sydney (3),
    Tokyo (4), Osaka (3)
    South America
    São Paulo (3)
    Seoul (4), Mumbai (3),
    Hong Kong (3)
    Africa China
    Cape Town (3) Beijing (2), Ningxia (3)
    Announced Regions
    8 Regions and 24 AZs in Australia, India, Indonesia, Israel, Australia, Switzerland,
    Spain, and United Arab Emirates (UAE)
    

    View Slide

17. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Region design
    AWS Regions are comprised of multiple AZs for high availability, high scalability, and
    high fault tolerance. Applications and data are replicated in real time and consistent
    in the different AZs.
    AWS Availability Zone (AZ)
    A Region is a physical location in the world
    where we have multiple Availability Zones.
    Availability Zones consist of one or more discrete data
    centers, each with redundant power, networking, and
    connectivity, housed in separate facilities.
    AZ
    AZ
    AZ AZ
    Transit
    Transit
    Datacenter
    Datacenter
    Datacenter
    AWS Region
    

    View Slide

18. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Availability Zone (AZ) design
    • Fully isolated infrastructure with
    one or more datacenters
    • Meaningful distance of separation
    • Unique power infrastructure
    • Many 100Ks of servers at scale
    • Datacenters connected via
    fully redundant and isolated metro
    fiber
    

    View Slide

19. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS network design
    At least 2 redundant transit centers Highly peered & connected
    Transit center connections
    Inter-AZ connections
    Intra-AZ connections
    

    View Slide

20. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Global network:
    Redundant 100GbE network
    and private capacity between
    all regions except China
    Direct Connect:
    80+ locations; customers can
    reach every AWS Region from
    their local Direct Connect PoP
    

    View Slide

21. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Innovation at lower costs
    3456 fibers into a single conduit
    

    View Slide

22. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Innovation at lower costs
    3456 6912 fibers into a single conduit *
    

    View Slide

23. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Traditional datacenters tend to standardize their servers
    

    View Slide

24. © 2021, Amazon Web Services, Inc. or its Affiliates.
    At scale, many specialized configurations make sense
    

    View Slide

25. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Broad and deep platform choice
    Categories Capabilities Options
    + + =
    475+
    instance types
    

    View Slide

26. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Choice of processors and architectures
    Intel Xeon Scalable
    (Skylake) processor
    Right compute for each application and workload
    Choice of GPUs and FPGAs for compute acceleration
    AWS Graviton processor
    64-bit Arm
    AMD EPYC processor
    

    View Slide

27. © 2021, Amazon Web Services, Inc. or its Affiliates.
    

    View Slide

28. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Number of cores available
    

    View Slide

29. © 2021, Amazon Web Services, Inc. or its Affiliates.
    What is Nitro?
    

    View Slide

30. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon EC2 Mac hardware: Mac mini with the AWS Nitro System
    

    View Slide

31. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Generators, UPSs, and Switches
    How can do we do
    predictive maintenance,
    taking the devices offline,
    while still on a highly
    available environment?
    

    View Slide

32. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Two independent power line-ups
    We’ve been getting
    ~99.99997%
    Availability in our
    DCs with this design
    

    View Slide

33. © 2021, Amazon Web Services, Inc. or its Affiliates.
    But you can always simplify …
    Battery packs and custom power supplies integrated into the rack
    

    View Slide

34. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Investing in wind and solar energy
    Amazon Web Services (AWS) is committed to running our business
    in the most environmentally friendly way possible and achieving
    100% renewable energy usage for our global infrastructure.
    Cloud efficiency
    “Our results show that AWS’s infrastructure is 3.6 times more
    energy efficient than the median of the surveyed U.S. enterprise
    data centers. More than two-thirds of this advantage is
    attributable to the combination of a more energy efficient
    server population and much higher server utilization. AWS
    data centers are also more energy efficient than enterprise
    sites due to comprehensive efficiency programs that touch
    every facet of the facility.
    When we factor in the carbon intensity of consumed electricity
    and renewable energy purchases, which reduce associated carbon
    emissions, AWS performs the same task with an 88% lower
    carbon footprint.”
    Source: 451 Research, 2019, All Rights Reserved.
    

    View Slide

35. © 2021, Amazon Web Services, Inc. or its Affiliates.
    © 2021, Amazon Web Services, Inc. or its Affiliates.
    Do you still believe
    cloud is just someone’s
    else computer?
    

    View Slide

36. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS Services for a
    multi-region approach
    

    View Slide

37. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Single-region high-availability approach
    Leverage multiple Availability Zones (AZs)
    Zurich
    VPC
    Instances
    Database
    Instances
    Database
    Instances
    Database
    Availability Zone A Availability Zone B Availability Zone C
    

    View Slide

38. © 2021, Amazon Web Services, Inc. or its Affiliates.
    How to replicate data and services across region
    ?
    

    View Slide

39. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon S3 Replication at a glance
    S3 Replication is an elastic, fully
    managed, low-cost feature that
    replicates objects between buckets
    S3 Replication offers flexibility via a
    rich set of features that allow you to
    configure where and how you want
    to replicate
    Once the replication rule is
    configured, S3 Replication
    automatically replicates objects and
    metadata in the source bucket
    

    View Slide

40. © 2021, Amazon Web Services, Inc. or its Affiliates.
    S3 Batch Replication
    • Replicate existing objects
    • Filtering capabilities
    • Granular visibility into replication
    progress
    

    View Slide

41. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon Elastic Block Store snapshots
    • Point-in-time backup
    • Stored in S3
    • Incremental
    • Cross-region copy
    EBS volume
    EBS snapshot
    

    View Slide

42. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Source
    Destination
    Introducing Amazon EFS Replication
    You can enable replication on an existing file
    system and select the replica settings
    independent of its source
    READ ONLY
    A read-only replica is automatically created in the
    selected Region and changes to your file system
    are transparently applied to its replica
    You can use the AWS Console, API, or CLI to
    enable replication or initiate failover to the replica
    

    View Slide

43. © 2021, Amazon Web Services, Inc. or its Affiliates.
    DynamoDB Global Tables
    Replica (US)
    Replica (Europe)
    Replica (Asia)
    

    View Slide

44. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Amazon RDS cross-region replication
    Master
    Replica
    Replica
    Replica
    Replica
    

    View Slide

45. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Cross-region backup with AWS Backup
    

    View Slide

46. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Source region
    Application users
    Internet
    VPN
    DMS – Database Migration Process
    • Start a replication instance
    • Connect to source and target databases
    • Select tables, schemas, or databases
    • Let AWS DMS load data and keep
    them in sync
    • Switch applications over to the
    target after they are in sync at your
    convenience
    AWS DMS
    

    View Slide

47. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Copy AMIs across Regions
    AMI
    (Amazon Machine Image) Distribute image
    AWS account
    AWS regions
    Golden AMI:
    “Known good” EC2 instance type, OS, packages
    Create them with Packer or EC2 Image Builder
    Get Them from running instances
    

    View Slide

48. © 2021, Amazon Web Services, Inc. or its Affiliates.
    EC2 Image Builder Image Recipe
    Image Recipe defines image configuration. It consists of source image and one or more
    components to be applied to the source image. Component describes how to build, validate,
    and test your image.
    Build Validate Test
    Build Component Test Component
    Source Image
    Output Image
    Image Recipe
    Image Builder
    Image
    Or
    Customer AMI
    

    View Slide

49. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Handling Region parity
    with infrastructure as code
    

    View Slide

50. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Manually in the Console ?
    Amazon EC2
    👍 Easy to get started
    🤔 Not reproducible
    🤔 Error prone
    🤔 Time consuming
    

    View Slide

51. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Scripting with the AWS CLI or an AWS SDK?
    🤔 What happens if an API call fails?
    🤔 How do I make updates?
    🤔 How do I know a resource is ready?
    🤔 How do I roll back?
    Amazon EC2
    Ex with python sdk (boto3)
    Amazon SQS
    

    View Slide

52. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Using infrastructure as “code”
    AWS CloudFormation
    template
    (JSON/YAML)
    HashiCorp Configuration
    Language (HCL)
    Desired state configuration
    AWS CloudFormation
    👍 Easy to automate
    👍 Reproducible & consistent
    😩 Configuration syntax
    🤔 No abstraction, lots of details*
    Amazon EC2
    Amazon SQS
    * Terraform modules and Cloudformation modules can help reduce the amount of code
    

    View Slide

53. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Key principles of infrastructure as code
    Declarative: define the desired state, not how to achieve it.
    Idempotent: reapplying the same code should not modify or add
    resources.
    Immutable: do not change the infrastructure manually (drift), use IaC to
    update or create a new one.
    Reproducible: can be applied in the same way in any region and will
    produce the same infrastructure with the same resources.
    

    View Slide

54. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Reproducibility / Repeatability
    Amazon EC2
    us-east-1
    Amazon EC2
    us-west-1
    Amazon EC2
    eu-west-1
    Amazon SQS
    Amazon SQS
    Amazon SQS
    

    View Slide

55. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Infrastructure as code, you said?
    

    View Slide

56. © 2021, Amazon Web Services, Inc. or its Affiliates.
    Provisionning infrastructure in the cloud
    Using infrastructure as REAL code
    AWS
    Cloud Development Kit
    (CDK) CLI
    Templates
    + assets
    AWS
    CloudFormation
    Amazon EC2
    Amazon SQS
    synthesize deploy
    Declarative?!
    Imperative Declarative
    

    View Slide

57. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS CDK main components
    

    View Slide

58. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS CDK Constructs
    

    View Slide

59. © 2021, Amazon Web Services, Inc. or its Affiliates.
    AWS CDK
    DEMO
    

    View Slide