MongoNYC 2012: Scaling in the Cloud

MongoNYC 2012: Scaling in the Cloud; Claudio Gentile, RightScale.

Transcript

1. Cloud Management! MongoDB – Scaling in the Cloud Claudio Gentile – Sales Engineer @ RightScale
2. # 2 Cloud Management! # 2 •  World’s #1 cloud management system •  Managing cloud deployments for 6+ Years – globally •  More than 45,000 users; nearly 4MM servers launched •  Powering the largest production deployments on the cloud RightScale
3. # 3 Cloud Management! # 3 Let’s define “Cloud” first… What I’m talking about: •  IaaS = Infrastructure driven by an API and delivered on-demand •  “Cloud” = An API endpoint to infrastructure resources •  Public = Vendor infrastructure with utility pricing •  Private = Your own infrastructure driven by an API •  Hybrid = Multi-vendor, multi-datacenter, or public/ private infrastructure
4. # 4 Cloud Management! # 4 Multi-Cloud Dominates Compute power managed by companies using more than one cloud provider = 84%
5. # 5 Cloud Management! # 5 Every Company Not Every App
6. # 6 Cloud Management! # 6 Challenges in the Cloud •  Images and their contents •  Lack of standardization and consistency across versions, regions and clouds •  No software license management •  Often do not follow best practices •  By design, open to security vulnerabilities •  Pre-install required software and applications •  Custom configuration in “baked” images •  Long development iterations •  Lack of Automation •  Trust relationships hard-coded •  No automated orchestration (How do I set up my application?)
7. # 7 Cloud Management! # 7 Overcoming Multi-Cloud Pain Points •  APIs differ •  Different sets of available resources •  Different formats, encodings and versions •  Abstractions and features differ •  Network architectures differ: VLANs, security groups, NAT, IPs, ACLs, … •  Storage architectures differ: local/attachable disks, backup, snapshots, … •  Hypervisors, machine images, cost models, billing, reporting…etc. Each cloud is unique in some/many/all respects, with different access mechanisms and varying functionalities provided by the managed resources.
8. # 8 Cloud Management! # 8 Overcoming Multi-Cloud Pain Points •  Navigating the obstacles •  Design using generic concepts (“durable storage”) yet deploy using cloud specifics (“EBS volumes”) •  Have tools that translate your concepts to cloud-specific ones (e.g. scripts/ recipes that choose the correct provider for the desired resource) •  Think of how to share resources across clouds (i.e. data sharing)
9. # 9 Cloud Management! # 9 The Visibility Challenge Business Unit 2 Business Unit 1 Marketing Site QA Stage Prod Dev Business Unit 2 Business Unit 1 Marketing Site Chicago San Diego Tokyo Region n Region 1 Region z Enterprise Business Unit C Business Unit B Business Unit A
10. # 10 Cloud Management! # 10 One “Cloud” – Many Resource Pools Rackspace Amazon Web Services SoftLayer Logicworks Datapipe Singapore Hong Kong Tokyo Dallas DC Area NYC Area SF Area Seattle Chicago Dublin London Amsterdam IDCF / Yahoo! Japan Fukuoka Korea Telecom Seoul Beijing UnGeo Tata Hyderabad Private Clouds Public & Managed Clouds Oregon São Paulo KINX
11. # 11 Cloud Management! # 11 IaaS Bridging Apps and Infrastructure Dashboard Governance Controls – Access, Security, Reporting MultiCloud Platform – Provisioning Automation Engine – Monitoring, Alerting, Scaling Configuration Framework – ServerTemplates, RightScripts Hardware Hypervisor Cloud Infrastructure Software API Private Clouds Public Clouds
12. # 12 Cloud Management! # 12 The Reasons for RightScale Abstraction with Customization Complete customization without the hassle Tap into Cloud Expertise Automation is the Core Massively scalable and super agile applications Choose Your Own Clouds Vendor freedom across hardware and software Visibility and Control One place to manage your infrastructure Experienced architects and support teams
13. # 13 Cloud Management! # 13 Applica'on   Por-olio   Requirements   Filter   Resource     Pools   App  1   App  2   App  3   Performance   Cost   Compliance   Reliability   Security   Workload Deployment Freedom It’s  about  using  mul=ple  resource  pools,  not  choosing  one.   App  N   … App  1   App  2   App  3   App  N   … Private  Cloud   Virtual     Private  Cloud   Private  Cloud  
14. # 14 Cloud Management! # 14 RightScale ServerTemplates™ •  Reproducible: Predictable deployment •  Dynamic: Configuration from scripts at boot time •  Multi-cloud: Cloud agnostic and portable •  Modular: Role and behavior abstracted from cloud infrastructure Configuration Framework
15. # 15 Cloud Management! # 15 App & Web Servers Community ISV Partners RightScale MultiCloud Marketplace Cloud-ready stacks Pre-built by our ecosystem Databases & Caches And more…
16. # 16 Cloud Management! # 16
17. # 17 Cloud Management! # 17 In Plain English – How RightScale Helps •  Deploy infrastructure where you need it, when you need it •  No-barrier deployment solution across many diverse clouds •  Less time managing systems, more time managing applications. •  Rapid path to execute Disaster Recovery plan. •  Extensive collection of ServerTemplates = Fast deployment •  Easy to use tool for managing all cloud systems you deploy.
18. # 18 Cloud Management! # 18 MongoDB in RightScale •  Sharding support •  Large data set, shard it! •  Increase your write capacity. •  Increase IOPS •  3 + nodes, no arbiter needed •  Continuing Support •  New MongoDB ServerTemplate release coming soon! •  Support for multiple clouds
19. # 19 Cloud Management! # 19 MongoDB in RightScale
20. # 20 Cloud Management! # 20 MongoDB in RightScale – Deeper Dive •  Lets take a look at the dashboard…
21. Cloud Management! Thank You! Claudio Gentile claudio@rightscale.com 805-243-0909