Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Value of Infrastructure

The Value of Infrastructure

AWS re:Invent reCap, Dublin, January 30th, 2024

Opening keynote. The value of infrastructure, from "clean water" to "generative AI".

Danilo Poccia

January 30, 2024
Tweet

More Decks by Danilo Poccia

Other Decks in Programming

Transcript

  1. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Danilo Poccia (he/him)
    Chief Evangelist (EMEA)
    AWS
    The Value
    of Infrastructure

    View full-size slide

  2. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Clean water
    Sewage
    Natural gas
    Electricity
    Communication
    Transportation

    View full-size slide

  3. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Clean water
    Sewage
    Natural gas
    Electricity
    Communication
    Transportation

    View full-size slide

  4. Construction
    of the
    “Great Eastern”
    ship

    View full-size slide

  5. Concept Construction starts
    1852 1854
    First trip
    1860
    Suez Canal opens
    1869
    Scrapped
    1888

    View full-size slide

  6. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Clean water
    Sewage
    Gas
    Electricity
    Communication
    Transportation

    View full-size slide

  7. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Clean water
    Sewage
    Gas
    Electricity
    Communication
    Transportation
    Networking
    Computing
    Storage

    View full-size slide

  8. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  9. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  10. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  11. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  12. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  13. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  14. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    “TV
    Pickup”

    View full-size slide

  15. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    D
    inorw
    ig
    Pow
    er Station
    https://www.fhc.co.uk/en/power-stations/dinorwig-power-station/

    View full-size slide

  16. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Electric
    M
    ountain
    https://www.fhc.co.uk/en/power-stations/dinorwig-power-station/

    View full-size slide

  17. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Am
    azon
    EC2
    Auto
    Scaling
    Spot Instances

    View full-size slide

  18. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    General purpose
    M5 | M5a | M5ad | M5d | M5dn | M5n | M5zn | M6a | M6g | M6gd | M6i | M6id | M6idn | M6in | M7a
    M7g | M7gd | M7i | M7i-flex | Mac1 | Mac2 | Mac2-m2 | Mac2-m2pro | T2 | T3 | T3a | T4g
    Compute optimized
    C5 | C5a | C5ad | C5d | C5n | C6a | C6g | C6gd | C6gn | C6i | C6id | C6in | C7a | C7g | C7gd | C7gn | C7i
    Memory optimized
    R5 | R5a | R5ad | R5b | R5d | R5dn | R5n | R6a | R6g | R6gd | R6i | R6idn | R6in | R6id
    R7a | R7g | R7gd | R7i | R7iz | U-3tb1 | U-6tb1 | U-9tb1 | U-12tb1 | U-18tb1 | U-24tb1
    X1 | X2gd | X2idn | X2iedn | X2iezn | X1e | z1d
    Storage optimized
    D2 | D3 | D3en | H1 | I3 | I3en | I4g | I4i | Im4gn | Is4gen
    Accelerated computing
    DL1 | DL2q | F1 | G3 | G4ad | G4dn | G5 | G5g | Inf1 | Inf2
    P2 | P3 | P3dn | P4d | P4de | P5 | Trn1 | Trn1n | VT1
    High-performance computing
    Hpc6a | Hpc6id | Hpc7a | Hpc7g
    Am
    azon
    EC2
    Instance
    Types

    View full-size slide

  19. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    aws ec2 get-instance-types-from-instance-requirements \
    --cli-input-yaml file://requirements.yaml \
    --output table
    ------------------------------------------
    |GetInstanceTypesFromInstanceRequirements|
    +----------------------------------------+
    || InstanceTypes ||
    |+--------------------------------------+|
    || InstanceType ||
    |+--------------------------------------+|
    || c5.xlarge ||
    || c5a.xlarge ||
    || c5ad.xlarge ||
    || c5d.xlarge ||
    || c6a.xlarge ||
    || c6i.xlarge ||
    || c6id.xlarge ||
    || c6in.xlarge ||
    || c7a.xlarge ||
    || c7i.xlarge ||
    || inf1.xlarge ||
    |+--------------------------------------+|
    ArchitectureTypes: # [REQUIRED]
    - x86_64
    VirtualizationTypes: # [REQUIRED]
    - hvm
    InstanceRequirements: # [REQUIRED]
    VCpuCount:
    Min: 4
    Max: 6
    MemoryMiB:
    Min: 2048
    Max: 8192
    InstanceGenerations:
    - current
    requirements.yaml
    AW
    S
    CLI
    Get Instance
    Types
    From
    Instance
    Requirem
    ents

    View full-size slide

  20. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Am
    azon
    Q

    View full-size slide

  21. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Am
    azon
    Q

    View full-size slide

  22. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Am
    azon
    Q

    View full-size slide

  23. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Am
    azon
    Q
    Transform
    ation

    View full-size slide

  24. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Am
    azon
    Q
    Transform
    ation

    View full-size slide

  25. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Am
    azon
    Q
    Transform
    ation

    View full-size slide

  26. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Write a Blog
    How to win at Tic Tac Toe
    Title:
    Game theory
    Topic:
    10
    Length (paragraphs):
    OK
    Software development is changing…

    View full-size slide

  27. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Prompt engineering
    Write a Blog
    How to win at Tic Tac Toe
    Title:
    Game theory
    Topic:
    10
    Length (paragraphs):
    OK
    “You are a journalist for amazing-acme-
    blogs.com, an online publication for
    sophisticated game players aged 18 and
    up. Articles are written to inform and
    entertain and represent a unique and non-
    intuitive perspective.
    Write a blog post titled “How to win at
    Tic Tac Toe” on the topic of game theory.
    The article should be no longer than 10
    paragraphs long.
    At the end list 3 prompts that can be
    used to generate images for the article.”

    View full-size slide

  28. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    chatbot = Chatbot(
    default_reply_length = 20,
    bot_persona = pmodel[‘friendly’],
    users_name =“User”,
    bots_name = “Chatbot”,
    topic = “tech support”
    )
    prompt = """This is a friendly and safe
    chat session between a user and a
    computer called Chatbot.
    User:I am a real person with a question
    to ask. Who are you?
    Chatbot:I am a chatbot, and I am here
    to help.
    User:What kind of questions will you
    answer?
    Chatbot:I will answer questions about
    tech support.
    User:My computer has crashed. What
    should I do?
    Chatbot:"""
    A new way to program…

    View full-size slide

  29. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Demo

    View full-size slide

  30. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Generative AI Stack
    GPUs Inferentia
    Trainium SageMaker
    EC2 Capacity Blocks Neuron
    UltraClusters EFA Nitro
    Amazon Bedrock
    Guardrails Agents Customization Capabilities
    Amazon Q Amazon Q in
    Amazon QuickSight
    Amazon Q in
    Amazon Connect
    Amazon
    CodeWhisperer

    View full-size slide

  31. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    AWS AWS
    AWS

    View full-size slide

  32. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    The Builder 1927-12-02: Volume 133, Issue 4426
    Electric
    H
    ouse,
    Battersea, 1927

    View full-size slide

  33. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  34. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    • Project Kuiper is an initiative
    to increase global broadband
    access through a
    constellation of 3,236
    satellites in low Earth orbit
    (LEO)
    • Its mission is to bring fast,
    affordable broadband to
    unserved and underserved
    communities around the
    world

    View full-size slide

  35. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Project Kuiper
    Private connectivity to AWS
    ANNOUNCEMENT
    Gateway stations with
    tracking, telemetry, and
    command terminals
    Fiber links
    On-premises /
    service provider networks
    Internet Amazon VPC
    Low Earth Orbit (LEO)
    satellite broadband
    network

    View full-size slide

  36. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://ourworldindata.org

    View full-size slide

  37. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Amazon is the world's largest
    corporate purchaser of
    renewable energy for the
    fourth year in a row

    View full-size slide

  38. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.

    View full-size slide

  39. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    https://thefrugalarchitect.com

    View full-size slide

  40. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    LAW I.
    Make Cost a Non-functional Requirement
    LAW II.
    Systems that Last Align Cost to Business
    LAW III.
    Architecting is a Series of Trade-offs
    LAW IV.
    Unobserved Systems Lead to Unknown Costs
    LAW V.
    Cost Aware Architectures Implement Cost Controls
    LAW VI.
    Cost Optimization is Incremental
    LAW VII.
    Unchallenged Success Leads to Assumptions

    View full-size slide

  41. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.

    View full-size slide

  42. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    “The value of infrastructure can be
    defined as the perception of worth, or
    benefit, that accrues to stakeholders,
    communities and other beneficiaries
    over time”
    “Technologies are combined and
    assembled on top of other
    technologies”
    How Infrastructure Works:
    Transforming our shared systems for a changing world,
    Deb Chachra, 2023

    View full-size slide

  43. © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Thank you!
    © 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Danilo Poccia
    @danilop

    View full-size slide