AWS: Leveraging the Cloud

A talk I gave in a virtual machines class about AWS products and how they are used.

* This design was heavily influenced (read straight up jacked) from Zach Holman's Aggressively Probing Ruby Projects (http://speakerdeck.com/u/holman/p/aggressively-probing-ruby-projects)

Transcript

1. AMAZON WEB SERVICES LEVERAGING THE CLOUD
2. THE NIST DEFINITION OF CLOUD COMPUTING “Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or service provider interaction.” ON-DEMAND SHARED POOL RAPIDLY PROVISIONED 2 http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf
3. http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf ON-DEMAND “A consumer can unilaterally provision computing capabilities, such as server time and network storage, as needed automatically without requiring human interaction with each service provider.” “Computing resources are pooled to serve multiple consumers.” “Capabilities can be elastically provisioned and released, in some cases automatically, to scale rapidly outward and inward commensurate with demand.” SHARED POOL RAPIDLY PROVISIONED 3 THE NIST DEFINITION OF CLOUD COMPUTING
4. OVERVIEW 1 HISTORY: WHY AMAZON? 2 SERVICES: WHAT’S FOR SELL 3 EXAMPLES: HOW AWS IS USED 4
5. 5 1 HISTORY: WHY AMAZON? 2002 “All teams will henceforth expose their data and functionality through service interfaces.” - Jeff Bezos https://plus.google.com/112678702228711889851/posts/eVeouesvaVX
6. 6 1 HISTORY: WHY AMAZON? “All teams will henceforth expose their data and functionality through service interfaces.” - Jeff Bezos “Teams must communicate with each other through these interfaces.” “All service interfaces, without exception, must be designed from the ground up to be externalizable.”
7. 7 1 HISTORY: WHY AMAZON? http://en.wikipedia.org/wiki/File:Cloud_computing.svg
8. 8 2 SERVICES: WHAT’S FOR SELL WORKFORCE Mechanical Turk Elastic Compute Cloud COMPUTE Elastic MapReduce Elastic Load Balancing Auto Scaling CloudFront CONTENT DELIVERY NETWORKING Route 53 Direct Connect Virtual Private Cloud SimpleDB DATABASE Relational Database Service ElastiCache DynamoDB Simple Storage Service STORAGE Import/Export Storage Gateway Elastic Block Store APPLICATION SERVICES CloudSearch Simple Email Service Simple Notification Service Simple Queue Service Simple Workflow Service http://aws.amazon.com/products/
9. 9 Mechanical Turk Elastic Compute Cloud SimpleDB Simple Storage Service CloudSearch 2 SERVICES: WHAT’S FOR SELL http://aws.amazon.com/products/ a web service that provides resizable compute capacity in the cloud. It is designed to make web-scale computing easier for developers a highly available and flexible non-relational data store that offloads the work of database administration. Developers simply store and query data items via web services requests a simple web services interface that can be used to store and retrieve any amount of data, at any time, from anywhere on the web. a fully-managed search service in the cloud that allows customers to easily integrate fast and highly scalable search functionality into their applications a marketplace for work that requires human intelligence
10. 10 3 EXAMPLES: HOW AWS IS USED http://aws.amazon.com/solutions/case-studies/
11. 11 3 EXAMPLES: HOW AWS IS USED SEARCH ENGINES RECOMMENDATION ENGINES A|B TESTING INFRASTRUCTURE STREAMING SERVERS ENCODING SOFTWARE HUGE DATA STORES CACHING ARCHITECTURES http://techblog.netflix.com/2010/12/four-reasons-we-choose-amazons-cloud-as.html
12. 12 3 EXAMPLES: HOW AWS IS USED “We’re not very good at predicting customer growth or device engagement.” - John Ciancutti http://techblog.netflix.com/2010/12/four-reasons-we-choose-amazons-cloud-as.html
13. 13 3 EXAMPLES: HOW AWS IS USED “How many subscribers would you guess used our Wii application the week it launched? How many would you guess will use it next month?” http://techblog.netflix.com/2010/12/four-reasons-we-choose-amazons-cloud-as.html
14. 14 3 EXAMPLES: HOW AWS IS USED “Cloud environments are ideal for horizontally scaling architectures. We don’t have to guess months ahead what our hardware, storage, and networking needs are going to be. We can programmatically access more of these resources from shared pools within AWS almost instantly.” http://techblog.netflix.com/2010/12/four-reasons-we-choose-amazons-cloud-as.html
15. 15 3 EXAMPLES: HOW AWS IS USED http://techblog.netflix.com/search/label/autoscaling identify the constraining resources (e.g. memory, CPU) track the constraining resource in CloudWatch configure alarms and polices to take the correct action when the profile associated with your constraining resource changes
16. 16 REQUESTS # SERVERS CPU UTILIZATION
17. 17 3 EXAMPLES: HOW AWS IS USED Chaos Monkey “a tool that randomly disables our production instances to make sure we can survive this common type of failure without any customer impact.” “The name comes from the idea of unleashing a wild monkey with a weapon in your data center (or cloud region) to randomly shoot down instances and chew through cables -- all the while we continue serving our customers without interruption.” RUNS IN LIVE PRODUCTION ENVIRONMENT http://techblog.netflix.com/2011/07/netflix-simian-army.html
18. 18 3 EXAMPLES: HOW AWS IS USED Chaos Monkey Latency Monkey Conformity Monkey Doctor Monkey Janitor Monkey Security Monkey 10-18 Monkey Chaos Gorilla http://techblog.netflix.com/2011/07/netflix-simian-army.html
19. 19 WRAP UP