MongoNYC 2012: MongoDB on Amazon EC2

Transcript

1. MongoDB In The Cloud with Amazon Web Services Dan Crosta,

   10gen [email protected] @lazlofruvous

2. EC2 EBS MongoDB

3. Agenda MongoDB & AWS Review MongoDB Components on AWS Administration

   of MongoDB in AWS • • •
4. None

5. Shard Server Disk Speed Disk Capacity RAM CPU • •

   • • High High High Moderate

6. Shard Server in EC2 MongoDB designed for OS defaults Don't

   tweak too much! • •

7. Shard Server in EC2 Use 64-bit instance Use standard virtual

   memory page size Raise "nofiles" ulimit Use RAID10 Use modern filesystem (ext4, XFS) Use "noatime" mount option • • • • • •

8. Shard Server in EC2 Readahead: how much more to read

   than what you asked for If set too high, can impact performance Set to 0 on EBS devices Set to desired value on RAID device • • • •

9. Config Server Disk Speed Disk Capacity RAM CPU • •

   • • Low Low Moderate Low

10. Config Server in EC2 Use RAID10 Use 64-bit instance Can

    run on shard servers • • •

11. Arbiter Disk Speed Disk Capacity RAM CPU • • •

    • Low Low Low Low

12. Arbiter in EC2 Can use Micro instance Might make elections

    slower Can use instance store Still want backups! • • • •

13. Mongos Disk Speed Disk Capacity RAM CPU • • •

    • None None Moderate Low

14. Mongos in EC2 Often run on application servers 32-bit mongos

    with 64-bit mongod OK • •

15. Administration Topics Deployment Strategy Networking Security Backup • • •

    •

16. High Availability Always use Replica Sets! EC2 Availability Zones •

    •

17. Disaster Recovery Always use Replica Sets! EC2 Regions • •

18. Networking Resist the urge to use IP addresses Instead, use

    DNS with Route53 or Chef/Puppet to manage /etc/hosts • • •

19. Security EC2 Security Groups Can reference other SGs mongos, unsharded

    mongod: 27017 Shard mongod: 27018 Config mongod: 27019 • • • • •

20. Backup EBS provides point-in-time snapshots When using RAID, need to:

    fsync and lock, or snapshot journal last Can snapshot secondaries Save snapshots to S3 • • • • • •

21. All of the Above http://www.mongodb.org/display/DOCS/Amaz

22. In Retrospect... This is a lot to cover in ~30

    minutes There is a lot to consider 10gen is here to help -- use us! http://groups.google.com/group/mongodb-user https://www.10gen.com/presentations • • • • •

23. Questions? Dan Crosta, 10gen [email protected] @lazlofruvous