Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWS re:Invent 2016 Keynotes Announcements

AWS re:Invent 2016 Keynotes Announcements

December 8th, 2016

All the AWS announcements in the re:Invent 2016 keynotes on Wednesday and Thursday.

Danilo Poccia

December 08, 2016
Tweet

More Decks by Danilo Poccia

Other Decks in Programming

Transcript

  1. A W S r e : I n v e n t r e : C a p
    Danilo Poccia
    Technical Evangelist
    @danilop

    View Slide

  2. Wednesday
    re:Invent 2016

    View Slide

  3. Most Robust,
    Fully-Featured
    Technology
    Infrastructure
    Platform
    HYBRID ARCHITECTURE
    Data Backups
    Integrated App
    Deployments
    Direct
    Connect
    Identity
    Federation
    Integrated Resource
    Management
    Integrated
    Networking
    VMware
    Integration
    MARKETPLACE
    Business
    Apps
    Databases
    DevOps
    Tools
    Networking
    Security Storage
    Business
    Intelligence
    INFRASTRUCTURE
    Availability
    Zones
    Points of
    Presence
    Regions
    CORE SERVICES
    Compute
    VMs, Auto-scaling, Load Balancing,
    Containers, Cloud functions
    Storage
    Object, Blocks, File,
    Archivals, Import/Export
    Databases
    Relational, NoSQL,
    Caching, Migration
    CDN Networking
    VPC, DX, DNS
    Access Control
    Identity
    Management
    Key Management
    & Storage
    Monitoring
    & Logs
    SECURITY & COMPLIANCE
    Resource &
    Usage Auditing
    Configuration
    Compliance
    Web application
    firewall
    Assessment and
    reporting
    TECHNICAL & BUSINESS SUPPORT
    Support
    Professional
    Services
    Account
    Management
    Partner
    Ecosystem
    Solutions
    Architects
    Training &
    Certification
    Security &
    Billing Reports
    Optimization
    Guidance
    ENTERPRISE APPS
    Backup
    Corporate
    Email
    Sharing &
    Collaboration
    Virtual
    Desktops
    IoT
    Rules
    Engine
    Registry
    Device
    Shadows
    Device
    Gateway
    Device
    SDKs
    DEVELOPMENT & OPERATIONS
    MOBILE SERVICES
    APP SERVICES
    ANALYTICS
    Data
    Warehousing
    Hadoop/
    Spark
    Streaming Data
    Collection
    Machine
    Learning
    Elastic
    Search
    Push
    Notifications
    Identity
    Sync
    Resource
    Templates
    One-click App
    Deployment
    Triggers
    Containers
    DevOps Resource
    Management
    Application Lifecycle
    Management
    API
    Gateway
    Transcoding
    Queuing &
    Notifications
    Email
    Workflow
    Search
    Streaming Data
    Analysis
    Business
    Intelligence
    Mobile
    Analytics
    Single Integrated
    Console
    Mobile App
    Testing
    Data
    Pipelines
    Petabyte-Scale
    Data Migration
    Database
    Migration
    Schema
    Conversion
    Application
    Migration
    MIGRATION

    View Slide

  4. 516
    0
    250
    500
    750
    1000
    2008 2009 2010 2011 2012 2013 2014 2015 2016
    Pace Of Innovation: New Capabilities Daily
    Launches
    24
    ~1000
    48 61 82
    159
    280
    722

    View Slide

  5. A Broad Spectrum Of Compute Capabilities In The AWS Cloud
    P2
    M4 D2 X1 G2
    T2 R3 I2 C4
    General Purpose
    GPU
    General Purpose
    Dense storage Large memory
    Graphics intensive
    Memory intensive High I/O
    Compute intensive
    Burstable

    View Slide

  6. Expanding The T2 Family With Larger Instance Types
    Generally Available Today
    T2.large
    8 GiB
    2 vCPU
    T2.xlarge
    16 GiB
    4 vCPU
    T2.2xlarge
    32 GiB
    8 vCPU
    2X memory 4X memory
    T2.medium
    4 GiB
    2 vCPU
    T2.small
    2 GiB
    1 vCPU
    T2.micro
    1 GiB
    1 vCPU
    T2.nano
    0.5GiB
    1 vCPU

    View Slide

  7. R4: Next Generation
    Memory-Optimized
    Instances
    488 GiB
    memory
    DDR4
    64 vCPUs
    L3 cache
    R4
    2X vCPUs
    R3
    244 GiB
    memory
    DDR3
    32 vCPUs
    L3 cache
    Generally Available Today
    1.8X size
    2X fast
    2X memory
    High performance databases
    Distributed memory caches
    In-memory analytics
    Genome analysis

    View Slide

  8. I2
    365k IOPS
    32 vCPUs
    I3: Next Generation
    I/O-Intensive Instances 3.3 million
    IOPS
    488 GiB
    memory
    64 vCPUs
    15.2 TB
    NVMe SSD
    I3
    2X vCPUs
    2X memory
    2.3X storage
    9X IOPS
    Coming Soon
    NoSQL databases (Cassandra and MongoDB)
    Scale out transactional databases
    Data warehousing
    Hadoop
    Cluster file systems
    244 GiB
    memory
    6.4 TB
    SSD

    View Slide

  9. C5: Next Generation
    Compute-Optimized
    Instances with
    Intel “Skylake”
    AVX 512 2X performance
    Coming Soon
    72 vCPUs
    “Skylake”
    144 GiB
    memory
    C5
    12 Gbps
    to EBS
    2.4X memory
    3X throughput
    2X vCPUs
    C4
    36 vCPUs
    “Haswell”
    60 GiB
    memory
    4 Gbps
    to EBS

    View Slide

  10. A Broad Spectrum Of Compute Capabilities In The AWS Cloud
    P2
    M4 D2 X1 G2
    T2 R4 I3 C5
    General Purpose
    GPU
    General Purpose
    Dense storage Large memory
    Graphics intensive
    Memory intensive High I/O
    Compute intensive
    Burstable

    View Slide

  11. Elastic GPUs For EC2
    Use Graphics GPUs As If They Were EBS Volumes
    Preview Available Today

    View Slide

  12. Elastic GPUs For EC2:
    GPU Acceleration
    For Graphics Workloads
    1GiB
    GPU Memory
    2 GiB
    4 GiB
    8 GiB
    Current
    Generation
    EC2
    Instance

    View Slide

  13. Simple Workloads Often Have Simple Requirements
    Web sites Blogs Dev Environment Prototyping Build Servers
    VPC networking
    Subnets
    IAM policies
    Storage
    Security groups

    View Slide

  14. Amazon Lightsail
    Virtual Private Servers (VPS) Made Easy
    Generally Available Today

    View Slide

  15. 1. Choose Image 2. Select Size 3. Pick A Name
    Amazon Lightsail: VPS Made Easy on AWS
    Two flavors of Linux,
    Wordpress, Magneto, Drupal, Joomla
    and other popular tools
    Up To 8GiB, 2 vCPUs, 80GiB SSD Click ‘Create instance’,
    and you’re done.

    View Slide

  16. $5
    Per month
    Amazon Lightsail: VPS Made Easy on AWS
    Launch
    VM
    Attach SSD
    Storage
    Create Security
    Groups
    Manage
    IAM
    Create
    Static IP
    Create Instance
    Created By Amazon Lightsail
    Setup
    DNS
    GO!

    View Slide

  17. What About Hardware Acceleration?

    View Slide

  18. F1 Instances
    New Instance Family With Customizable
    Field Programmable Gate Arrays
    Run Your Custom Logic On EC2
    Preview Available Today

    View Slide

  19. Bringing Hardware
    Acceleration To All
    F1 Instances
    F1 Instance
    With your custom logic
    running on an FPGA
    Develop, simulate, debug
    & compile your code
    Package as
    FPGA Images
    FPGA Images Available In AWS Marketplace

    View Slide

  20. We Love Ourselves Some Compute
    General Purpose
    GPU
    General Purpose
    Dense storage Large memory
    Burstable
    Memory intensive High I/O
    Compute intensive
    Simple VPS FPGAs
    P2
    M4 D2 X1 G2
    T2 R4 I3 C5
    Lightsail F1
    Graphics intensive
    Elastic GPUs On EC2

    View Slide

  21. The Ability to Understand Your Customers And Business Better Through Analytics
    Real-time
    streaming data
    Data
    Warehouse
    Hadoop, Spark,
    HBase, Hive, Presto,
    Mahout, Pig, Zeppelin
    Elasticsearch Business
    Intelligence
    Machine
    Learning
    Amazon
    Kinesis
    Amazon
    Redshift
    Amazon
    EMR
    Amazon
    Elasticsearch
    Amazon
    QuickSight
    Amazon
    Machine Learning

    View Slide

  22. Making Petabyte-scale Analytics
    Accessible To Companies Of All Sizes
    Data
    Warehouse
    Amazon Redshift
    Hadoop, Spark
    & Presto
    Amazon EMR
    Ad-hoc queries
    against S3
    Without spinning
    up clusters
    of instances

    View Slide

  23. Amazon Athena
    Interactive query service that makes it easy to
    analyze data in Amazon S3 using standard SQL
    Generally Available Today

    View Slide

  24. Amazon Athena: Interactive Queries On Data In S3
    No need to move
    data to Athena
    Query S3 directly
    & right away
    No infrastructure or
    clusters to setup &
    manage
    Fast results
    within seconds
    Pay for just the
    queries you run

    View Slide

  25. Introducing Amazon AI
    Bringing Powerful Artificial Intelligence To All Developers

    View Slide

  26. Amazon Rekognition
    Image Recognition And Analysis
    Powered By Deep Learning
    Generally Available Today
    1

    View Slide

  27. Amazon Rekognition: Images In, Categories and Facial Analysis Out
    Amazon
    Rekognition
    Car
    Outside
    Daytime
    Driving
    Objects
    & Scenes
    Female
    Smiling
    Sunglasses
    Faces

    View Slide

  28. Amazon Rekognition: Recognize, Search & Understand Images
    Easy to use Batch
    analysis
    Real time
    analysis
    Low cost
    Continually
    improving

    View Slide

  29. Amazon Polly
    Text To Speech Powered By Deep Learning
    Generally Available Today
    2

    View Slide

  30. Amazon Polly: Text In, Life-like Speech Out
    Amazon Polly
    “The temperature
    in WA is 75°F”
    “The temperature
    in Washington is 75
    degrees Fahrenheit”

    View Slide

  31. Amazon Polly: Text In, Life-like Speech Out
    Returns an MP3
    audio stream
    Unlimited
    replay
    Fully managed
    Lightning fast
    responses

    View Slide

  32. Amazon ALEXA
    (It’s what’s inside Alexa)
    Preview Available Today
    3
    Natural Language Understanding (NLU) &
    Automatic Speech Recognition (ASR) Powered By Deep Learning
    Natural Language Understanding (NLU) &
    Automatic Speech Recognition (ASR) Powered By Deep Learning

    View Slide

  33. Amazon Lex: Speech Recognition & Natural Language Understanding
    Amazon Lex
    Automatic Speech Recognition
    Natural Language Understanding
    “What’s the
    weather forecast?”
    Weather
    Forecast

    View Slide

  34. Amazon Lex: Speech Recognition & Natural Language Understanding
    Amazon Lex
    Automatic Speech Recognition
    Natural Language Understanding
    “What’s the
    weather forecast?”
    “It will be sunny
    and 75°F”
    Weather
    Forecast

    View Slide

  35. Amazon Lex: Build Natural, Conversational Interactions In Voice & Text
    Integrated
    development
    in the AWS console
    Fully
    managed
    Trigger
    Lambda
    functions
    Continually
    improving ASR & NLU
    models
    Enterprise
    connectors
    Multi-step
    conversations

    View Slide

  36. Migrating Databases To AWS
    14,000+
    databases migrated
    Migrate between
    on-prem and AWS
    Migrate between
    databases
    Automated schema
    conversion
    Data replication for
    zero downtime
    migrations

    View Slide

  37. PostgreSQL For Aurora
    Aurora is now fully compatible with both
    PostgreSQL and MySQL
    Preview Available Today

    View Slide

  38. Amazon Aurora PostgreSQL-Compatible Edition
    1/10th The Cost Of
    Commercial Grade
    Databases
    Fully PostgreSQL
    Compatible
    Several times better
    performance than typical
    PostgreSQL database
    Scalable,
    Durable and Secure
    Migrate From
    RDS For PostgreSQL

    View Slide

  39. What Constitutes On-Premises Infrastructure?
    Sensors & IoT Devices
    Physical Servers
    In Data Centers

    View Slide

  40. Challenges Of Devices Living On The Edge
    Round-trip latency
    Intermittent connectivity
    Expensive bandwidth
    Programming and updating embedded software needs specialized skills
    Limited to what is on the device unless you rewrite or program the device

    View Slide

  41. AWS Greengrass
    Embed Lambda Compute (& Other AWS Services) in
    Connected Devices
    Preview Available Today
    Use The Same AWS Programming Model In Devices And The Cloud

    View Slide

  42. AWS Greengrass: Local Compute, Messaging & Data Caching
    Local
    compute
    Local
    data caching
    Secure
    communications
    Local
    messaging

    View Slide

  43. AWS Greengrass: How It Works
    Built into
    devices at
    manufacture
    Install the
    Greengrass
    runtime
    Lambda functions
    on AWS & devices
    Manage from
    AWS Console
    Same programming
    model
    Local
    communication
    and orchestration

    View Slide

  44. Excitement for
    Amazon Greengrass
    From Partners
    & Customers
    Operating Systems, Devices,
    & System-On-A-Chip
    IoT Products &
    Deployments

    View Slide

  45. AWS Snowball Edge
    A New Hybrid Device With On-Board Storage & Compute
    Generally Available Today

    View Slide

  46. AWS Snowball Edge: Petabyte-Scale Data Transport, With On-board Compute
    E-ink shipping label
    Rugged enclosure
    Color control
    touchscreen
    Rack
    mountable
    Integrated cable housing
    100TB
    capacity
    On-device encryption

    View Slide

  47. Clustering
    capabilities
    100 TB
    storage
    S3
    endpoint
    Greengrass
    inside
    Lambda on
    m4.4xl equivalent
    Automatic sharing
    across devices
    AWS Snowball Edge: Petabyte-Scale Data Transport, With On-board Compute

    View Slide

  48. AWS Snowmobile
    Generally Available Today
    Introducing

    View Slide

  49. AWS Snowmobile: 100PB Container
    45-foot long
    rugged container
    & truck
    Connect to your
    datacenter with
    fiber cable
    Fill ‘er Up! Transports Data
    To AWS

    View Slide

  50. AWS Snowmobile:
    Exabyte-Scale Data Transport
    With 10Gbps, dedicated
    connection
    ~6 months
    With AWS
    Snowmobile(s)
    ~26 years

    View Slide

  51. Thursday
    re:Invent 2016

    View Slide

  52. What Are The Best Practices Of
    Transformational Development?

    View Slide

  53. Security Performance
    efficiency
    Cost
    optimization
    Reliability
    Well-Architected Framework
    Operational
    excellence
    NEW

    View Slide

  54. Introducing
    The Well-Architected Framework Course
    With Broader And Deeper Content

    View Slide

  55. A Year In Amazon CloudFormation
    20 additional services
    20 services updated
    YAML support
    Role-based stack creation
    Change sets
    Cross-stack references
    Failure recovery
    Resource schemas
    Prepare

    View Slide

  56. AWS OpsWorks For Chef Automate
    Fully managed Chef server
    NEW
    Prepare
    Generally Available Today

    View Slide

  57. Amazon EC2 Systems Manager
    Collection of AWS tools for package installation, patching,
    resource configuration, and task automation
    Prepare
    NEW
    Generally Available Today

    View Slide

  58. AWS CodeBuild
    NEW
    Operate
    Generally Available Today
    Build service for compiling source code
    and running unit tests
    !"#

    View Slide

  59. AWS X-Ray
    NEW
    Operate
    Analyze and debug distributed applications
    in production
    Preview Available Today

    View Slide

  60. fanout-00002
    AWS X-Ray
    NEW
    hello-1.mbfzqxzcpe.us-east-..
    hello-2.mbfzqxzcpe.us-east-..
    fanout-00005
    fanout-00003
    throttle
    DynamoDB
    index
    DynamoDB
    fanout-00004
    400 traces/min
    avg - 0.30 ms
    600 traces / min
    avg - 0.19 ms
    1000 traces /min
    avg - 0.13 ms
    400 traces / min
    avg - 0.30 ms
    1000 traces / min
    avg - 0.28 ms
    400 traces / min
    avg - 0.30 ms
    850 traces / min
    avg - 0.16 ms
    850 traces / min
    avg - 0.17 ms
    Client
    Client
    800 traces / min
    avg - 0.19 ms
    fanout-00001
    560 traces / min
    avg - 0.19 ms
    fanout-00006

    View Slide

  61. AWS X-Ray
    NEW

    View Slide

  62. AWS X-Ray
    NEW

    View Slide

  63. AWS Personal Health Dashboard
    NEW
    Respond
    Personalized view of AWS service health
    Generally Available Today

    View Slide

  64. Web applications running on AWS are already protected
    by Shield Standard - no action is required
    Protection from volumetric and state exhaustion attacks
    NEW
    Respond
    Generally Available Today
    AWS Shield For Everyone

    View Slide

  65. For additional protection against very
    large and sophisticated attacks
    AWS Shield Advanced
    Respond
    NEW
    Generally Available Today

    View Slide

  66. Respond
    Advanced notifications
    via CloudWatch
    Cost protection on ELB,
    CloudFront, Route 53
    24/7 DDoS response
    team and support
    WAF included at
    no additional cost
    AWS Shield Advanced

    View Slide

  67. NEW
    Targeting
    Targeted push notifications for mobile apps
    Amazon Pinpoint
    Generally Available Today

    View Slide

  68. Understand user
    behavior
    Define who to
    engage
    Deliver
    notifications
    Track campaign
    results
    Amazon Pinpoint

    View Slide

  69. S3 Storage Management
    S3 Data Events in CloudTrail
    S3 Object Tagging
    S3 Analytics - Storage Class Analysis
    S3 CloudWatch Metrics
    S3 Inventory
    Innovations In S3
    NEW

    View Slide

  70. Integrated with:
    Fully-managed data catalog and ETL service
    S3, RDS, Redshift & any
    JDBC-compliant data store
    AWS Glue
    NEW

    View Slide

  71. Build Your
    Data Catalog

    View Slide

  72. Generate And Edit
    Transformations

    View Slide

  73. Schedule And Run
    Your Jobs

    View Slide

  74. 2. Source Data
    S3 Upload
    Kinesis Firehose
    DynamoDB Streams
    Snowball
    Snowball Edge
    Snowmobile
    3. Lifecycle management
    and cold storage
    5. Data governance,
    security, privacy
    8. Preparing for
    Analytics
    9. Orchestration
    and job scheduling
    Analytics
    Database Migration
    Service
    1. Ingestion
    Datastore target
    4. Metadata
    capture
    10. Capturing data
    change
    Athena
    EMR
    Elasticsearch
    Redshift
    AI
    Machine Learning
    Quicksight
    RDS
    DynamoDB
    EFS
    S3 EBS
    6. Self-service discovery,
    search, access
    Glacier
    7. Managing
    data quality
    EMR
    Glue
    The Modern Data Architecture On AWS

    View Slide

  75. Install
    batch software
    Manage job
    interdependencies
    Manage
    job queues
    Schedule
    jobs
    Provision
    server cluster
    Scale server
    cluster
    Challenges Of Large-Scale Batch Processing

    View Slide

  76. AWS Batch
    Fully-managed batch processing at any scale
    NEW
    Preview Available Today

    View Slide

  77. Dynamic provisioning
    and scaling
    Priority-based queues
    and scheduling
    Cost optimization
    through EC2 Spot fleet
    Fully managed
    AWS Batch

    View Slide

  78. Containers
    A Spectrum Of Compute

    View Slide

  79. High
    availability
    Infrastructure
    management
    Security Task
    scheduling
    Pipeline
    integration
    Container
    management
    Service
    discovery
    Resource
    access
    The Challenges Of Container Based Operations

    View Slide

  80. Amazon ECS
    Managed platform for:
    Cluster Management Container Orchestration Deep AWS Integration

    View Slide

  81. ELB
    Container
    Auto Scaling
    CloudTrail
    VPC
    IAM CloudWatch
    Metrics
    Instance
    Auto Scaling
    CloudWatch
    Logs
    CloudWatch
    Events
    X-Ray
    Deep Integration With AWS Platform

    View Slide

  82. You can now determine scheduling policies based on:
    AMI ID Availability
    zone
    Instance
    type
    Distinct
    instances
    Custom
    Task Placement Engine
    (Coming Soon)

    View Slide

  83. Real-time notifications of current state
    Container
    instance events
    Task
    events
    Event Stream

    View Slide

  84. They need the ability to:
    Create custom schedulers Integrate 3rd party schedulers Develop and test locally
    Developers Want More Control

    View Slide

  85. Introducing
    NEW
    A collection of open source projects for:
    Container management and orchestration

    View Slide

  86. Today we are releasing:
    cluster-state-service daemon-scheduler
    Blox
    NEW

    View Slide

  87. Open Source
    blox.github.io

    View Slide

  88. Serverless
    AWS Lambda
    A Spectrum Of Compute

    View Slide

  89. Languages Integrations
    Node.js (JavaScript)
    Java (Java 8 compatible)
    Python
    Amazon API Gateway AWS CodeCommit
    AWS CloudFormation
    AWS Config
    Amazon Simple Notification Service
    Amazon Simple Email Service
    State Of AWS Lambda
    Amazon CloudWatch
    Amazon Kinesis Streams
    Amazon DynamoDB
    Amazon RDS
    Amazon Aurora
    Amazon Cognito
    Amazon S3

    View Slide

  90. VPC Support
    Node 4.3
    Simple Proxy
    API Gateway Binary Support
    Environment Variables
    Serverless Application Model
    NEW
    New Serverless Features In 2016

    View Slide

  91. NEW
    C# In AWS Lambda

    View Slide

  92. AWS [email protected]
    NEW
    Preview Available Today
    Run AWS Lambda functions at CloudFront locations

    View Slide

  93. “I want to sequence
    functions”
    “I want to run
    functions in parallel”
    “I want to select
    functions based on data”
    “I want to retry
    functions”
    “I want to try/
    catch/finally”
    “I have code that
    runs for hours”
    Turning Functions Into Applications

    View Slide

  94. Method Call Function Chaining Database Queues
    Different Ways To Coordinate Functions

    View Slide

  95. NEW
    AWS Step Functions
    Generally Available Today
    Coordinate the components of distributed
    applications using visual workflows

    View Slide

  96. AWS Step Functions

    View Slide

  97. Branching Steps
    Select image
    converter
    RAW to JPEG RAW to PNG
    RAW to TIFF
    Load in
    Database
    Start
    End
    Unsupported
    image type
    Upload RAW
    file
    Delete RAW
    file
    Start
    End
    Process photo
    Resize image
    Start
    End
    Extract
    metadata
    Facial
    recognition
    Load in
    Database
    Parallel Steps
    Sequential Steps
    AWS Step Functions

    View Slide

  98. Virtual Machines Containers Serverless
    First-Class Primitives With Deep AWS Integration

    View Slide

  99. Transformations

    View Slide

  100. AWS OpsWorks For Chef Automate
    Amazon EC2 Systems Manager
    AWS CodeBuild
    AWS X-Ray
    AWS Personal Health Dashboard
    AWS Shield
    >
    >
    Amazon Pinpoint
    AWS Glue
    AWS Batch
    C# In AWS Lambda
    AWS [email protected]
    AWS Step Functions
    Elastic GPUs For EC2
    Amazon Lightsail
    F1 Instances
    Amazon Athena
    Amazon AI
    Amazon Rekognition
    Amazon Polly
    Amazon Lex
    PostgreSQL For Aurora
    AWS Greengrass
    AWS Snowball Edge
    AWS Snowmobile
    Day 1 Day 2

    View Slide

  101. Thank You

    View Slide

  102. AWS re:Invent 2016 re:Cap
    Danilo Poccia
    Technical Evangelist
    @danilop

    View Slide