Cloud Computing with AWS: Overview - Mark Ryland

Advancing Autism Discovery Workshop, April 22, 2013. Mark Ryland, Chief Solutions Architect - Amazon Web Services

Transcript

1. CLOUD COMPUTING WITH AWS OVERVIEW Mark Ryland Chief Solutions Architect 4/22/2013 ©2012, Amazon Web Services LLC or its affiliates. All rights reserved. Reproduction and distribution of this publication in any form without prior written permission is forbidden. Amazon Web Services LLC shall have no liability for errors, omissions or inadequacies in the information contained herein or for interpretations thereof. 1
2. • $5.2B e-commerce company • 7,800 employees • A whole lot of servers! Every day (on average), AWS adds server capacity equivalent to that entire $5.2B enterprise Perspectives on Scaling: Compute
3. Total Number of Objects Stored in Amazon Simple Storage Service 2.9 Billion 14 Billion 40 Billion 102 Billion 262 Billion 762 Billion Peak Requests: 1,100,000+ per second 2 Trillion Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011 April 2013 Perspectives on Scaling: Storage
4. 9 AWS regions 35+ AWS edge Locations GovCloud US Global Infrastructure
5. US REGIONS GLOBAL REGIONS Availability Zone A Availability Zone B Availability Zone C EU (Ireland) Availability Zone A Availability Zone B South America (Sao Paulo) Availability Zone A Availability Zone B Asia Pacific (Sydney) Availability Zone A Availability Zone B GovCloud (OR) Availability Zone A Availability Zone B Availability Zone C Availability Zone D US East (VA) Availability Zone A Availability Zone B US West (CA) Availability Zone A Availability Zone B Asia Pacific (Singapore) Availability Zone A Availability Zone B Availability Zone C Asia Pacific (Tokyo) Availability Zone A Availability Zone B Availability Zone C US West (OR) AWS Regions & Availability Zones Customer Decides Where Applications and Data Reside Note: Conceptual drawing only. The number of Availability Zones may vary.
6. Security is a Shared Responsibility Facilities Physical security Compute infrastructure Storage infrastructure Network infrastructure Virtualization layer (EC2) Hardened service endpoints Rich IAM capabilities Network configuration Security groups OS firewalls Operating systems Applications Proper service configuration AuthN & acct management Authorization policies + = Customer • Re-focus your security professionals on a subset of the problem • Take advantage of high levels of uniformity and automation
7. Operating Systems Languages & Libraries Certified Applications AWS is Open and Flexible ©2012, Amazon Web Services LLC or its affiliates. All rights reserved. 7
8. What is Amazon Web Services? AWS Global Infrastructure Application Services Networking Deployment & Administration Database Storage Compute
9. Vertical Scaling From $0.02/hr Elastic Compute Cloud (EC2) Basic unit of compute capacity Range of CPU, memory & local disk options 13 Instance types available, from micro to cluster compute Feature Details Flexible Run windows or Linux distributions Scalable Wide range of instance types from micro to cluster compute Machine Images Configurations can be saved as machine images (AMIs) from which new instances can be created Full control Full root or administrator rights Secure Full firewall control via Security Groups Monitoring Publishes metrics to Cloud Watch Inexpensive On-demand, Reserved and Spot instance types VM Import/Export Import and export VM images to transfer configurations in and out of EC2 Compute Compute Storage AWS Global Infrastructure Database App Services Deployment & Administration Networking
10. 256 128 64 32 16 8 4 2 1 1 2 4 8 16 32 64 128 EC2 Compute Units Memory (GB) Small 1.7 GB, 1 EC2 Compute Unit 1 virtual core $0.08/0.115 Micro 613 MB Up to 2 ECUs (for short bursts) $0.02/0.03 Large 7.5 GB 4 EC2 Compute Units 2 virtual cores $0.32/0.46 Extra Large 15 GB 8 EC2 Compute Units 4 virtual cores $0.64/0.92 Hi-Mem XL 17.1 GB 6.5 EC2 Compute Units 2 virtual cores $0.45/0.57 Hi-Mem 2XL 34.2 GB 13 EC2 Compute Units 4 virtual cores $0.90/1.14 Hi-Mem 4XL 68.4 GB 26 EC2 Compute Units 8 virtual cores $1.80/2.28 High-CPU Med 1.7 GB 5 EC2 Compute Units 2 virtual cores $0.165/0.285 High-CPU XL 7 GB 20 EC2 Compute Units 8 virtual cores $0.66/1.14 Cluster GPU 4XL 22 GB 33.5 EC2 Compute Units, 2 x NVIDIA Tesla “Fermi” M2050 GPUs $2.10/2.60 Cluster Compute 4XL 23 GB 33.5 EC2 Compute Units $1.30/1.61 Medium 3.7 GB, 2 EC2 Compute Units 1 virtual core $0.16/0.23 Cluster Compute 8XL 60.5 GB 88 EC2 Compute Units $2.40/2.97 High I/O 4XL 60.5 GB, 35 EC2 Compute Units, 2 * 1024 GB of SSD-based local instance storage High Storage 8XL 117 GB 35 EC2 Compute Units 24 * 2 TB instance store Cluster High Mem 8XL 89 EC2 Compute Units 240 GB SSD instance storage
11. Elastic Block Store High performance block storage device 1GB to 1TB in size Mount as drives to instances Feature Details High performance file system Mount EBS as drives and format as required Flexible size Volumes from 1GB to 1TB in size Secure Private to your instances Performance Use provisioned IOPS to get desired level of IO performance Available Replicated within an Availability Zone Backups Volumes can be snapshotted for point in time restore Monitoring Detailed metrics captured via Cloud Watch Storage Compute Storage AWS Global Infrastructure Database App Services Deployment & Administration Networking
12. S3 - Durable storage, any object 99.999999999% durability of objects Unlimited storage of objects of any type Up to 5TB size per object Feature Details Flexible object store Buckets act like drives, folder structures within Access control Granular control over object permissions Server-side encryption 256bit AES encryption of objects Multi-part uploads Improved throughput & control Object versioning Archive old objects and version new ones Object expiry Automatically remove old objects Access logging Full audit log of bucket/object actions Web content hosting Serve content as web site with built in page handling Notifications Receive notifications on key events Import/Export Physical device import/export service Storage Compute Storage AWS Global Infrastructure Database App Services Deployment & Administration Networking
13. Glacier Low-cost storage service Secure and durable storage for backup and archive For data that is infrequently accessed Feature Details Low cost $0.01/GB/month with no up-front capital commitments Durable Same 99.999999999% durability as S3 Flexible Store any amount of data on-demand. Eliminate the need for capacity planning Secure Leverage AWS’ robust security platform. Control access to your data. API REST-based API to send and receive data Import/Export Optionally use portable storage devices to import/export mass data Vault inventory Index for real-time view of the contents of the vault Storage Compute Storage AWS Global Infrastructure Database App Services Deployment & Administration Networking
14. Relational Database Service Database-as-a-Service No need to install or manage database instances Scalable and fault tolerant configurations Feature Details Platform support Create MySQL, SQL Server and Oracle RDBMS Preconfigured Get started instantly with sensible default settings Automated patching Keep your database platform up to date automatically Backups Automatic backups and point in time recovery and full DB backups Provisioned IOPS Specify IO throughput depending on requirements Failover Automated failover to slave hosts in event of a failure Replication Easily create read-replicas of your data and seamlessly replicate data across availability zones Database Compute Storage AWS Global Infrastructure Database App Services Deployment & Administration Networking
15. AWS Platform Your Applications Foundation Services Compute Amazon EC2 Auto Scale Storage Amazon S3 Amazon Glacier Amazon EBS Amazon StorageGateway Database Amazon RDS Amazon SimpleDB Amazon ElastiCache Amazon DynamoDB Amazon RedShift Networking Amazon VPC Elastic Load Balancing Amazon Route 53 AWS Direct Connect Management & Administration Application Platform Services Content Distribution Amazon CloudFront Application Svcs Simple Workflow Service CloudSearch Amazon SNS, SQS, SES Parallel Processing Elastic MapReduce Data Pipeline Libraries & SDKs Java, PHP, Python, Ruby, .NET Identity & Access AWS IAM Identity Federation Consolidated Billing Web Interface Management Console Monitoring Amazon CloudWatch Deployment & Automation AWS Elastic Beanstalk AWS CloudFormation AWS Global Infrastructure Regions Availability Zones Edge Locations 15