Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Cloud Computing with AWS: Overview - Mark Ryland

Cloud Computing with AWS: Overview - Mark Ryland

Advancing Autism Discovery Workshop, April 22, 2013. Mark Ryland, Chief Solutions Architect - Amazon Web Services

More Decks by National Database for Autism Research

Other Decks in Science

Transcript

  1. CLOUD COMPUTING WITH AWS
    OVERVIEW
    Mark Ryland
    Chief Solutions Architect
    4/22/2013
    ©2012, Amazon Web Services LLC or its affiliates. All rights reserved. Reproduction and distribution of this
    publication in any form without prior written permission is forbidden. Amazon Web Services LLC shall have no
    liability for errors, omissions or inadequacies in the information contained herein or for interpretations thereof. 1

    View full-size slide

  2. • $5.2B e-commerce company
    • 7,800 employees
    • A whole lot of servers!
    Every day (on average), AWS
    adds server capacity equivalent
    to that entire $5.2B enterprise
    Perspectives on Scaling: Compute

    View full-size slide

  3. Total Number of Objects Stored in Amazon Simple Storage Service
    2.9 Billion 14 Billion 40 Billion
    102 Billion
    262 Billion
    762 Billion
    Peak Requests:
    1,100,000+
    per second
    2 Trillion
    Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011 April 2013
    Perspectives on Scaling: Storage

    View full-size slide

  4. 9 AWS regions
    35+ AWS edge Locations
    GovCloud US
    Global Infrastructure

    View full-size slide

  5. US REGIONS GLOBAL REGIONS
    Availability
    Zone A
    Availability
    Zone B
    Availability
    Zone C
    EU (Ireland)
    Availability
    Zone A
    Availability
    Zone B
    South America (Sao Paulo)
    Availability
    Zone A
    Availability
    Zone B
    Asia Pacific (Sydney)
    Availability
    Zone A
    Availability
    Zone B
    GovCloud (OR)
    Availability
    Zone A
    Availability
    Zone B
    Availability
    Zone C
    Availability
    Zone D
    US East (VA)
    Availability
    Zone A
    Availability
    Zone B
    US West (CA)
    Availability
    Zone A
    Availability
    Zone B
    Asia Pacific (Singapore)
    Availability
    Zone A
    Availability
    Zone B
    Availability
    Zone C
    Asia Pacific (Tokyo)
    Availability
    Zone A
    Availability
    Zone B
    Availability
    Zone C
    US West (OR)
    AWS Regions & Availability Zones
    Customer Decides Where Applications and Data Reside
    Note: Conceptual drawing only. The number of Availability Zones may vary.

    View full-size slide

  6. Security is a Shared Responsibility
    Facilities
    Physical security
    Compute infrastructure
    Storage infrastructure
    Network infrastructure
    Virtualization layer (EC2)
    Hardened service endpoints
    Rich IAM capabilities
    Network configuration
    Security groups
    OS firewalls
    Operating systems
    Applications
    Proper service configuration
    AuthN & acct management
    Authorization policies
    + =
    Customer
    • Re-focus your security professionals on a subset of the problem
    • Take advantage of high levels of uniformity and automation

    View full-size slide

  7. Operating Systems Languages & Libraries Certified Applications
    AWS is Open and Flexible
    ©2012, Amazon Web Services LLC or its affiliates.
    All rights reserved.
    7

    View full-size slide

  8. What is Amazon Web Services?
    AWS Global Infrastructure
    Application Services
    Networking
    Deployment & Administration
    Database
    Storage
    Compute

    View full-size slide

  9. Vertical Scaling
    From $0.02/hr
    Elastic Compute Cloud (EC2)
    Basic unit of compute capacity
    Range of CPU, memory & local disk options
    13 Instance types available, from micro to cluster compute
    Feature Details
    Flexible Run windows or Linux distributions
    Scalable Wide range of instance types from micro to cluster
    compute
    Machine Images Configurations can be saved as machine images
    (AMIs) from which new instances can be created
    Full control Full root or administrator rights
    Secure Full firewall control via Security Groups
    Monitoring Publishes metrics to Cloud Watch
    Inexpensive On-demand, Reserved and Spot instance types
    VM Import/Export Import and export VM images to transfer
    configurations in and out of EC2
    Compute
    Compute Storage
    AWS Global Infrastructure
    Database
    App Services
    Deployment & Administration
    Networking

    View full-size slide

  10. 256
    128
    64
    32
    16
    8
    4
    2
    1
    1 2 4 8 16 32 64 128
    EC2 Compute Units
    Memory (GB)
    Small 1.7 GB,
    1 EC2 Compute Unit
    1 virtual core
    $0.08/0.115
    Micro 613 MB
    Up to 2 ECUs (for
    short bursts)
    $0.02/0.03
    Large 7.5 GB
    4 EC2 Compute Units
    2 virtual cores
    $0.32/0.46
    Extra Large 15 GB
    8 EC2 Compute Units
    4 virtual cores
    $0.64/0.92
    Hi-Mem XL 17.1 GB
    6.5 EC2 Compute Units
    2 virtual cores
    $0.45/0.57
    Hi-Mem 2XL 34.2 GB
    13 EC2 Compute Units
    4 virtual cores
    $0.90/1.14
    Hi-Mem 4XL 68.4 GB
    26 EC2 Compute Units
    8 virtual cores
    $1.80/2.28
    High-CPU Med 1.7 GB
    5 EC2 Compute Units
    2 virtual cores
    $0.165/0.285
    High-CPU XL 7 GB
    20 EC2 Compute Units
    8 virtual cores
    $0.66/1.14
    Cluster GPU 4XL 22 GB
    33.5 EC2 Compute Units,
    2 x NVIDIA Tesla “Fermi”
    M2050 GPUs
    $2.10/2.60
    Cluster Compute 4XL 23 GB
    33.5 EC2 Compute Units
    $1.30/1.61
    Medium 3.7 GB,
    2 EC2 Compute Units
    1 virtual core
    $0.16/0.23
    Cluster Compute 8XL 60.5 GB
    88 EC2 Compute Units
    $2.40/2.97
    High I/O 4XL 60.5
    GB, 35 EC2 Compute
    Units, 2 * 1024 GB
    of SSD-based local
    instance storage
    High Storage 8XL 117 GB
    35 EC2 Compute Units
    24 * 2 TB instance store
    Cluster High Mem 8XL
    89 EC2 Compute Units
    240 GB SSD instance storage

    View full-size slide

  11. Elastic Block Store
    High performance block storage device
    1GB to 1TB in size
    Mount as drives to instances
    Feature Details
    High performance file
    system
    Mount EBS as drives and format as required
    Flexible size Volumes from 1GB to 1TB in size
    Secure Private to your instances
    Performance Use provisioned IOPS to get desired level of IO
    performance
    Available Replicated within an Availability Zone
    Backups Volumes can be snapshotted for point in time restore
    Monitoring Detailed metrics captured via Cloud Watch
    Storage
    Compute Storage
    AWS Global Infrastructure
    Database
    App Services
    Deployment & Administration
    Networking

    View full-size slide

  12. S3 - Durable storage, any object
    99.999999999% durability of objects
    Unlimited storage of objects of any type
    Up to 5TB size per object
    Feature Details
    Flexible object store Buckets act like drives, folder structures within
    Access control Granular control over object permissions
    Server-side encryption 256bit AES encryption of objects
    Multi-part uploads Improved throughput & control
    Object versioning Archive old objects and version new ones
    Object expiry Automatically remove old objects
    Access logging Full audit log of bucket/object actions
    Web content hosting Serve content as web site with built in page handling
    Notifications Receive notifications on key events
    Import/Export Physical device import/export service
    Storage
    Compute Storage
    AWS Global Infrastructure
    Database
    App Services
    Deployment & Administration
    Networking

    View full-size slide

  13. Glacier
    Low-cost storage service
    Secure and durable storage for backup and archive
    For data that is infrequently accessed
    Feature Details
    Low cost $0.01/GB/month with no up-front capital
    commitments
    Durable Same 99.999999999% durability as S3
    Flexible Store any amount of data on-demand. Eliminate the
    need for capacity planning
    Secure Leverage AWS’ robust security platform.
    Control access to your data.
    API REST-based API to send and receive data
    Import/Export Optionally use portable storage devices to
    import/export mass data
    Vault inventory Index for real-time view of the contents of the vault
    Storage
    Compute Storage
    AWS Global Infrastructure
    Database
    App Services
    Deployment & Administration
    Networking

    View full-size slide

  14. Relational Database Service
    Database-as-a-Service
    No need to install or manage database instances
    Scalable and fault tolerant configurations
    Feature Details
    Platform support Create MySQL, SQL Server and Oracle RDBMS
    Preconfigured Get started instantly with sensible default settings
    Automated patching Keep your database platform up to date
    automatically
    Backups Automatic backups and point in time recovery and
    full DB backups
    Provisioned IOPS Specify IO throughput depending on requirements
    Failover Automated failover to slave hosts in event of a
    failure
    Replication Easily create read-replicas of your data and
    seamlessly replicate data across availability zones
    Database
    Compute Storage
    AWS Global Infrastructure
    Database
    App Services
    Deployment & Administration
    Networking

    View full-size slide

  15. AWS Platform
    Your Applications
    Foundation Services
    Compute
    Amazon EC2
    Auto Scale
    Storage
    Amazon S3
    Amazon Glacier
    Amazon EBS
    Amazon StorageGateway
    Database
    Amazon RDS
    Amazon SimpleDB
    Amazon ElastiCache
    Amazon DynamoDB
    Amazon RedShift
    Networking
    Amazon VPC
    Elastic Load Balancing
    Amazon Route 53
    AWS Direct Connect
    Management & Administration
    Application Platform Services
    Content Distribution
    Amazon CloudFront
    Application Svcs
    Simple Workflow Service
    CloudSearch
    Amazon SNS, SQS, SES
    Parallel Processing
    Elastic MapReduce
    Data Pipeline
    Libraries & SDKs
    Java, PHP, Python,
    Ruby, .NET
    Identity & Access
    AWS IAM
    Identity Federation
    Consolidated Billing
    Web Interface
    Management Console
    Monitoring
    Amazon CloudWatch
    Deployment & Automation
    AWS Elastic Beanstalk
    AWS CloudFormation
    AWS Global Infrastructure
    Regions
    Availability Zones
    Edge Locations
    15

    View full-size slide