MongoNYC 2012: MongoDB on Amazon EC2

MongoNYC 2012: MongoDB on Amazon EC2, Dan Costa, 10gen. Gain valuable insights on running MongoDB on Amazon EC2. EC2 provides a simple and flexible deployment model for your application and databases. However, you still need to manage, maintain, and monitor your system. So how do you do this with EC2? We'll explore these questions and more in this session.

Transcript

1. MongoDB In The Cloud with Amazon Web Services Dan Crosta, 10gen dcrosta@10gen.com @lazlofruvous
2. EC2 EBS MongoDB
3. Agenda MongoDB & AWS Review MongoDB Components on AWS Administration of MongoDB in AWS • • •
5. Shard Server Disk Speed Disk Capacity RAM CPU • • • • High High High Moderate
6. Shard Server in EC2 MongoDB designed for OS defaults Don't tweak too much! • •
7. Shard Server in EC2 Use 64-bit instance Use standard virtual memory page size Raise "nofiles" ulimit Use RAID10 Use modern filesystem (ext4, XFS) Use "noatime" mount option • • • • • •
8. Shard Server in EC2 Readahead: how much more to read than what you asked for If set too high, can impact performance Set to 0 on EBS devices Set to desired value on RAID device • • • •
9. Config Server Disk Speed Disk Capacity RAM CPU • • • • Low Low Moderate Low
10. Config Server in EC2 Use RAID10 Use 64-bit instance Can run on shard servers • • •
11. Arbiter Disk Speed Disk Capacity RAM CPU • • • • Low Low Low Low
12. Arbiter in EC2 Can use Micro instance Might make elections slower Can use instance store Still want backups! • • • •
13. Mongos Disk Speed Disk Capacity RAM CPU • • • • None None Moderate Low
14. Mongos in EC2 Often run on application servers 32-bit mongos with 64-bit mongod OK • •
15. Administration Topics Deployment Strategy Networking Security Backup • • • •
16. High Availability Always use Replica Sets! EC2 Availability Zones • •
17. Disaster Recovery Always use Replica Sets! EC2 Regions • •
18. Networking Resist the urge to use IP addresses Instead, use DNS with Route53 or Chef/Puppet to manage /etc/hosts • • •
19. Security EC2 Security Groups Can reference other SGs mongos, unsharded mongod: 27017 Shard mongod: 27018 Config mongod: 27019 • • • • •
20. Backup EBS provides point-in-time snapshots When using RAID, need to: fsync and lock, or snapshot journal last Can snapshot secondaries Save snapshots to S3 • • • • • •
21. All of the Above http://www.mongodb.org/display/DOCS/Amaz
22. In Retrospect... This is a lot to cover in ~30 minutes There is a lot to consider 10gen is here to help -- use us! http://groups.google.com/group/mongodb-user https://www.10gen.com/presentations • • • • •
23. Questions? Dan Crosta, 10gen dcrosta@10gen.com @lazlofruvous