AWS 102 - A thorough Introduction to AWS

An overview of AWS services, how to integrate AWS with your on-premise applications and how to extend your on-premises environment with cloud capabilities

Transcript

2. Agenda • AWS  Platform  Overview • Integration  with  On-­‐Premises – Hybrid  Cloud – Docker • Extending  On-­‐Premises – Content  Delivery – Dev &  Test – Big  Data – Backup  &  Disaster  Recovery
3. Agenda • AWS  Platform  Overview • Integration  with  On-­‐Premises – Hybrid  Cloud – Docker • Extending  On-­‐Premises – Content  Delivery – Dev &  Test – Big  Data – Backup  &  Disaster  Recovery
4. Cloud  Benefits Apps  not   Ops Low   Ongoing   Cost Flexible   Capacity Speed  &   Agility No  Upfront   Investment Global   Reach
5. Leveraging  Cloud AWS   Platform Core  Services Global   Infrastructure Platform   Services Administration   &  Security Enterprise   Applications
6. AWS  Benefits • Scale • Accelerating  Innovation • Fast  Adoption • Enterprise  Ready • Breadth  &  Depth  of  Services
7. Scale Every day, AWS adds enough new server capacity to support all of Amazon’s global infrastructure when it was a $7B annual revenue enterprise.
8. Innovation
9. Innovation
10. Adoption “It  is  the  overwhelming  market  share   leader,  with  more  than  five  times  the   cloud  IaaS compute  capacity  in  use  than   the  aggregate  total  of  the  other  14   providers” Magic  Quadrant  for  Cloud  IaaS,  28  May   2014
11. ENTERPRISE   APPLICATIONS PLATFORM   SERVICES ADMINISTRATION   &  SECURITY CORE  SERVICES INFRASTRUCTURE Regions Availability  Zones Points  of  Presence Compute Storage CDN Databases Networking Identity Access Audit Key  Storage Monitoring Logs Virtual  Desktops Sharing  &  Collaboration Analytics App  Services Ops  &  Mgmt Mobile  Services • Hadoop • Real-­‐time   Streaming • Data   Warehouse • Data  Pipelines • Queuing    &   Notifications • Workflow • App  Streaming • Transcoding • Email • Search • One-­‐Click  Web   App  Deploys • DevOps Resource  Mgmt • Resource   Templates • Identity • Sync • Mobile   Analytics • Push   Notifications
12. ENTERPRISE   APPLICATIONS PLATFORM   SERVICES ADMINISTRATION   &  SECURITY CORE  SERVICES INFRASTRUCTURE Regions Availability  Zones Points  of  Presence Compute Storage CDN Databases Networking Identity Access Audit Key  Storage Monitoring Logs Virtual  Desktops Sharing  &  Collaboration Analytics App  Services Ops  &  Mgmt Mobile  Services • Hadoop • Real-­‐time   Streaming • Data   Warehouse • Data  Pipelines • Queuing    &   Notifications • Workflow • App  Streaming • Transcoding • Email • Search • One-­‐Click  Web   App  Deploys • DevOps Resource  Mgmt • Resource   Templates • Identity • Sync • Mobile   Analytics • Push   Notifications
13. <  2-­‐5  Availability  Zones • AZs  <  2ms  apart usually  <  1ms • Transit  center  connects  to   – AWS  regions  &  Direct   Connect  (private  links) – Internet  (public  link) • Redundant  paths  to  transit   center <  1-­‐6  Data  Centers • No  DC  is  in  2  AZs • DCs  within  AZ  <  ¼ms   apart +  >50  Edge  Locations • DNS • Caching 11  Regions • Private  AWS  fiber  links   interconnect  all  major   regions – Increased  availability  &   performance,  lower   jitter  &  costs • Compute  &  storage  to   customers  or  required   jurisdictional  boundaries Infrastructure
14. ENTERPRISE   APPLICATIONS PLATFORM   SERVICES ADMINISTRATION   &  SECURITY CORE  SERVICES INFRASTRUCTURE Regions Availability  Zones Points  of  Presence Compute Storage CDN Databases Networking Identity Access Audit Key  Storage Monitoring Logs Virtual  Desktops Sharing  &  Collaboration Analytics App  Services Ops  &  Mgmt Mobile  Services • Hadoop • Real-­‐time   Streaming • Data   Warehouse • Data  Pipelines • Queuing    &   Notifications • Workflow • App  Streaming • Transcoding • Email • Search • One-­‐Click  Web   App  Deploys • DevOps Resource  Mgmt • Resource   Templates • Identity • Sync • Mobile   Analytics • Push   Notifications
15. Compute • Elastic  Compute  Cloud  (EC2) – Virtual  servers  in  the  cloud • Auto  Scaling – Automatically  scale  your  EC2  fleet • Elastic  Load  Balancing  (ELB) – Automatically  distribute  incoming  traffic • EC2  Container  Service  (ECS)  PREVIEW – Run  distributed  applications  on  a  managed  EC2  cluster • Lambda  PREVIEW – Run  code  in  response  to  events • Marketplace – Buy  &  immediately  start  using  software  &  services
16. Feature  Highlight: EC2 • Fit  For  All  Workloads – Shared – General – Compute  Intensive – Memory  Intensive – GPU • Multiple  Pricing  Models – On-­‐Demand – Reserved  Instances – SPOT  Market • SSD-­‐Backed  EBS  Storage  Standard • New  C4  Instance  Types – Custom  Intel  Silicon
17. Feature  Highlight: AWS  Marketplace • Buy  3rd Party  Software  &  Services • Ready  to  Use  on  EC3 • Pricing  Models • Pay-­‐As-­‐You-­‐Go  Hourly  Pricing • Yearly  Subscriptions • Bring  Your  Own  License
18. Storage  &  Content  Delivery • Simple  Storage  Service  (S3) – Scalable  storage  in  the  cloud • Glacier – Archive  storage  in  the  cloud • CloudFront – Global  content  delivery  network • Elastic  Block  Store  (EBS) – Block  level  storage  for  use  with  EC2 • Storage  Gateway – Integrates  on-­‐premises  IT  environments  with  cloud  storage • Import/Export – High  latency,  high  throughput  data  import/export  service
19. Database • Relational  Database  Service  (RDS) – MySQL,  Postgres,  Oracle,  SQL  Server   – Amazon  Aurora  PREVIEW • DynamoDB – Predictable  and  scalable  NoSQL data  store • ElasticCache – In-­‐memory  cache  (Memcached or  Redis) • Redshift – Managed  petabyte-­‐scale  data  warehouse  service
20. Networking • Virtual  Private  Cloud  (VPC) – Isolated  Cloud  Resources • VPN  /  Virtual  Private  Gateway – Enable  Access  to  Your  Network  from  Your  VPC • Direct  Connect – Dedicated  Network  Connection  to  AWS • Route53 – Scalable  DNS  &  Domain  Name  Registration
21. Feature  Highlight: VPC VPC  with  Public  and  Private  Subnets   and  Hardware  VPN  Access
22. Feature  Highlight: Integration 2-­‐Tier  Auto-­‐scalable  Web   Application  Architecture   In  2  AZs
23. ENTERPRISE   APPLICATIONS PLATFORM   SERVICES ADMINISTRATION   &  SECURITY CORE  SERVICES INFRASTRUCTURE Regions Availability  Zones Points  of  Presence Compute Storage CDN Databases Networking Identity Access Audit Key  Storage Monitoring Logs Virtual  Desktops Sharing  &  Collaboration Analytics App  Services Ops  &  Mgmt Mobile  Services • Hadoop • Real-­‐time   Streaming • Data   Warehouse • Data  Pipelines • Queuing    &   Notifications • Workflow • App  Streaming • Transcoding • Email • Search • One-­‐Click  Web   App  Deploys • DevOps Resource  Mgmt • Resource   Templates • Identity • Sync • Mobile   Analytics • Push   Notifications
24. Administration  &  Security • Identity  &  Access  Management  (IAM) – Access  Control – Key  Management   Service  (KMS)  NEW • Create  and  control  the  encryption  keys  used  to  encrypt  your  data • Directory  Service – Managed  Active  Directory • CloudWatch – Resource  &  application   monitoring • CloudTrail – User  activity  &  change  tracking  (audit  trail) • Config PREVIEW – CMDB • Trusted  Advisor – Cloud  optimisation
25. ENTERPRISE   APPLICATIONS PLATFORM   SERVICES ADMINISTRATION   &  SECURITY CORE  SERVICES INFRASTRUCTURE Regions Availability  Zones Points  of  Presence Compute Storage CDN Databases Networking Identity Access Audit Key  Storage Monitoring Logs Virtual  Desktops Sharing  &  Collaboration Analytics App  Services Ops  &  Mgmt Mobile  Services • Hadoop • Real-­‐time   Streaming • Data   Warehouse • Data  Pipelines • Queuing    &   Notifications • Workflow • App  Streaming • Transcoding • Email • Search • One-­‐Click  Web   App  Deploys • DevOps Resource  Mgmt • Resource   Templates • Identity • Sync • Mobile   Analytics • Push   Notifications
26. Analytics • Elastic  MapReduce (EMR) – Hosted  Hadoop framework • Kinesis – Real-­‐time  processing  of  streaming  big  data • Data  Pipeline – Orchestration  of  data-­‐driven  workflows • Redshift – Managed  petabyte-­‐scale  data  warehouse  service
27. Application  Services • Simple  Queue  Service  (SQS) – Message  queue  service • Simple  Workflow  Service  (SWF) – Workflow  service  for  coordinating  application  components • AppStream – Low  latency  application  streaming • Elastic  Transcoder – Easy-­‐to-­‐use  scalable  media  transcoding • Simple  Email  Service  (SES) – Email  sending  service • CloudSearch – Managed  search  service
28. Deployment  &  Management • Elastic  Beanstalk – AWS  application   container • OpsWorks – DevOps application  management   service  (hosted  Chef) • CloudFormation – Templated AWS  resource  creation • EC2  Container  Service   (ECS)  PREVIEW – Run  distributed  applications  on  a  managed  EC2  cluster • CodeDeploy – Automated  deployments • CodePipeline EARLY  2015 – Model  &  automate   your  release  process • CodeCommit EARLY  2015 – Managed  git revision  control  service
29. Feature  Highlight: CloudFormation • Describe  your  entire  AWS   infrastructure  in  JSON • Can  be  version  controlled • Easy  deployments   globally • DevOps Concepts • ‘Immutable  Infrastructure’ • ‘Infrastructure  as  Code’
30. Mobile  Services • Cognito – User  identity  &  app  data  synchronisation • Mobile  Analytics – Understand  app  usage  data  at  scale • Simple  Notification  Service  (SNS) – Push  notification  service
31. ENTERPRISE   APPLICATIONS PLATFORM   SERVICES ADMINISTRATION   &  SECURITY CORE  SERVICES INFRASTRUCTURE Regions Availability  Zones Points  of  Presence Compute Storage CDN Databases Networking Identity Access Audit Key  Storage Monitoring Logs Virtual  Desktops Sharing  &  Collaboration Analytics App  Services Ops  &  Mgmt Mobile  Services • Hadoop • Real-­‐time   Streaming • Data   Warehouse • Data  Pipelines • Queuing    &   Notifications • Workflow • App  Streaming • Transcoding • Email • Search • One-­‐Click  Web   App  Deploys • DevOps Resource  Mgmt • Resource   Templates • Identity • Sync • Mobile   Analytics • Push   Notifications
32. Enterprise  Applications • Zocalo – Secure  enterprise  storage  &  sharing  service • Workspaces – Desktops  in  the  cloud
33. SDKs Java Python (boto) PHP .NET Ruby Node.js iOS Android AWS Toolkit for Visual Studio AWS Toolkit for Eclipse AWS Tools for Windows PowerShell AWS CLI JavaScript
34. Support  &  Ecosystem Support Partner   Ecosystem Solutions   Architects Professional   Services Training  &   Certification Account   Management
35. IT-­‐as-­‐a-­‐service Experimentation VC  funding Lower  barriers  to  entry Disruptive  innovation Unbundling Long  tail Multi-­‐sided  platform Open  business Capex Opex Growth Upgradeability Reputation Compliance Disruption Obsolescence Responsiveness Effectiveness Adaptability Rapid  Change Time  to  delivery Time  to  market Work  efficiency Parallellism Cloud  Value Value Tactical Detriments Benefits Strategic IT  Innovation New  Business   Models Cost Risk Speed Agility
36. Cloud  Adoption • AWS  Cloud  Adoption   Framework  (CAF) • AWS  Cloud  Adoption   Methodologies   (CAM)SOON
37. Agenda • AWS  Platform  Overview • Integration  with  On-­‐Premises – Hybrid  Cloud – Docker • Extending  On-­‐Premises – Content  Delivery – Dev &  Test – Big  Data – Backup  &  Disaster  Recovery
38. Hybrid • VPN  /  Virtual  Private  Gateway – Enable  Access  to  Your  Network  from  Your  VPC • Direct  Connect – Dedicated  Network  Connection  to  AWS • Storage  Gateway – Integrates  on-­‐premises  IT  environments  with  cloud  storage • IAM  +  Directory  Service – Integrated  security/access  management
39. Docker on  AWS EC2 ECS  PREVIEW Elastic  Beanstalk You have  complete  control   over  the  infrastructure You  control the  EC2   instances,  AWS  manages   the  cluster  &  containers   running   on  it AWS  manages  the whole   underlying   infrastructure
40. Feature  Highlight: Vagrant  +  Docker Vagrant.configure(VAGRANTFILE_API_VERSION)   do  |config| config.vm.provider :virtualbox do  |vb,   override| override.vm.box =  "phusion/ubuntu-­‐14.04-­‐amd64" … end config.vm.provider :aws do  |aws,   override| aws.instance_type =  "m3.medium" aws.region =  "eu-­‐west-­‐1" aws.ami=   "ami-­‐f0b11187" … end … config.vm.provision "docker"   do  |d| d.pull_images "sequenceiq/spark:1.1.0" d.pull_images "tpires/neo4j" d.run "tpires/neo4j", args: "-­‐d  -­‐p  0.0.0.0:80:7474   -­‐v  /data:/data   -­‐v  /home/ubuntu/neo4jdata:/var/lib/neo4j/data" d.run "spark", cmd: "/etc/bootstrap.sh -­‐bash”, args: "-­‐i -­‐t  -­‐h  sandbox   -­‐d" end end Start  a  local  development  VM $ vagrant   up Start  a  development  VM  on  AWS $ vagrant   up  -­‐-­‐provider=aws
41. Demo  Time Moving  a  docker container  between  development  environment  &  AWS
42. Agenda • AWS  Platform  Overview • Integration  with  On-­‐Premises – Hybrid  Cloud – Docker • Extending  On-­‐Premises – Content  Delivery – Dev &  Test – Big  Data – Backup  &  Disaster  Recovery
43. Content  Delivery • CloudFront – Origins • S3 • EC2 • Custom  Origin – Supports  dynamic  content • Cookies • Query  Strings • Low  TTLs – Device  Detection – Geo  Targeting – Reporting – Private  Content – Streaming Support
44. Auto Scaling group Availability Zone #1 security group security  group root volume data volume media.example.com Elastic Load Balancing Amazon S3 bucket logs Amazon EBS snapshot CloudFront distribution EC2 instance web app server Feature  Highlight: CloudFront www.example.com Load  Balanced  Web  Application With  Static  Content  Served Through  CDN
45. Demo  Time ‘Zero  Tier’  Web  Application  with  S3  &  CloudFront
46. Dev &  Test • Spin  environments  up  &  down  quickly • One-­‐click  deploy  with  Elastic  Beanstalk – eb push • Can  be  fully  scripted  &  automated • Enables  new  scenarios  at  low  cost – E.g.  Heavier  load  testing – E.g.  Route53  weighted  records
47. Big  Data  /  Analytics • Elastic  MapReduce – Hosted  Hadoop – Optimized  for  S3 – Integration  with  DynamoDB • Kinesis – Process  Real-­‐Time  Data • Data  Pipeline – ETL  Jobs • Data  Orchestrator – Schedule  Jobs
48. Backup  /  Disaster  Recovery • Backup – S3 • Versioning – Integration  with  on-­‐premises • Direct  Connect • Storage  Gateway • VPN • Archive – Glacier • S3  Lifecycle  Policies
49. Backup  /  Disaster  Recovery • Disaster  Recovery – Backup  &  Restore • Golden  images • Data  backups  stored  in  S3 – Pilot  Light • Core  data  synced • Other  resources  templated – Cold  Standby • Configured,  but  not  running – Warm  Standby • Secondary  site  up  and  running • Scale  up  for  production  use – Multi  Site • High  Availability  – Always  On • Ready  for  production  use