Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Joy of Cooking: Deploying MongoDB with Che...

Nathen Harvey
November 13, 2012

The Joy of Cooking: Deploying MongoDB with Chef #mongochicago

A quick primer on Opscode Chef and an introduction to using it to deploy MongoDB.

Nathen Harvey

November 13, 2012

Transcript

68 slides
  1. Agenda • Overview of Chef • Building a project in

    Chef • Deploying MongoDB with Chef • Additional resources
  2. Collection of Resources • Nodes • Networking • Files •

    Directories • Symlinks • Mounts • Routes • Users • Groups • Tasks • Packages • Software • Services • Configurations • Stuff http://www.flickr.com/photos/stevekeys/3123167585/
  3. Golden Images are not the answer • Gold is heavy

    • Hard to transport • Hard to mold • Easy to lose configuration detail http://www.flickr.com/photos/garysoup/2977173063/
  4. Automation Happiness! • MongoDB makes developers happy • MongoDB makes

    operations happy • Chef makes developers & operations happy, too!
  5. • Generate configurations directly on nodes • Reduce management complexity

    • Version control the programs http://www.flickr.com/photos/ssoosay/5126146763/ Programs!
  6. Declarative Interface to Resources • Define policy • Say what,

    not how • Pull not Push http://www.flickr.com/photos/bixentro/2591838509/
  7. Chef is Infrastructure as Code http://www.flickr.com/photos/louisb/4555295187/ • Programmatically provision and

    configure • Treat like any other code base • Reconstruct business from code repository, data backup, and bare metal resources.
  8. Building a Project in Chef OK, so how do I

    build something with Chef?
  9. Building a Chef Project • First, come up with your

    policy / specification • Abstract the resources in your spec
  10. Building a Chef Project • First, come up with your

    policy / specification • Abstract the resources in your spec • Write recipes
  11. Building a Chef Project • First, come up with your

    policy / specification • Abstract the resources in your spec • Write recipes • Package recipes in cookbooks
  12. Recipes and Cookbooks • Recipes are collections of Resources •

    Cookbooks contain recipes, templates, files, custom resources, etc • Code re-use and modularity http://www.flickr.com/photos/shutterhacks/4474421855/
  13. Building a Chef Project • First, come up with your

    policy / specification • Abstract the resources in your spec • Write recipes • Package recipes in cookbooks • Apply recipes to nodes
  14. Nodes • Representation of a host • runs the Chef

    client • has attributes • has a list of recipes to be applied
  15. Building a Chef Project • First, come up with your

    policy / specification • Abstract the resources in your spec • Write recipes • Package recipes in cookbooks • Apply recipes to nodes • Group things into roles
  16. Roles • mechanism for easily composing sets of functionality •

    have attributes and a list of recipes to be applied
  17. Run Lists Server Server Server Server chef-server API chef-client “recipe[mongodb]”,

    “recipe[mongodb::replset]” node mongodb default.rb replset.rb
  18. Run Lists Server Server Server Server chef-server API chef-client “role[base]”,

    “role[mongodb-replset-member]” node ntp default.rb sudo default.rb mongodb default.rb replset.rb
  19. Server Server Server Server chef-server API chef-client “role[webserver]” node ntp

    client.rb openssh server.rb apache default.rb php default.rb Roles chef-client “role[database]” node ntp client.rb openssh server.rb mongodb server.rb
  20. Building a Chef Project • First, come up with your

    policy / specification • Abstract the resources in your spec • Write recipes • Package recipes in cookbooks • Apply recipes to nodes • Group things into roles
  21. Deploying MongoDB • Create Cookbook • Write our recipes •

    Upload Cookbook to Chef Server • Run chef-client on nodes
  22. "memory": { "swap": { "cached": "0kB", "total": "4128760kB", "free": "4128760kB"

    }, "total": "2055676kB", "free": "1646524kB", "buffers": "35032kB", "cached": "210276kB", "active": "125336kB", "inactive": "142884kB", "dirty": "8kB", "writeback": "0kB", "anon_pages": "22976kB", "mapped": "8416kB", "slab": "121512kB", "slab_reclaimable": "41148kB", "slab_unreclaim": "80364kB", "page_tables": "1784kB", "nfs_unstable": "0kB", "bounce": "0kB", "commit_limit": "5156596kB", "committed_as": "74980kB", "vmalloc_total": "34359738367kB", "vmalloc_used": "274512kB", "vmalloc_chunk": "34359449936kB" }, Ohai! "block_device": { "ram0": { "size": "32768", "removable": "0" }, "ram1": { "size": "32768", "removable": "0" }, "ram2": { "size": "32768", "removable": "0" }, "hostname": "server-1", "fqdn": "server-1.example.com", "domain": "example.com", "network": { "interfaces": { "eth0": { "type": "eth", "number": "0", "encapsulation": "Ethernet", "addresses": { "00:0C:29:43:26:C5": { "family": "lladdr" }, "192.168.177.138": { "family": "inet", "broadcast": "192.168.177.255", "netmask": "255.255.255.0" }, "fe80::20c:29ff:fe43:26c5": { "family": "inet6", "prefixlen": "64", "scope": "Link" } },
  23. Run Chef Client Server Server Server Server chef-server API chef-client

    “role[base]”, “role[mongodb-replset-member]” node ntp default.rb sudo default.rb mongodb default.rb replset.rb
  24. Running the Chef Client • Automatically • Using knife’s ssh

    command • knife ssh "roles:monogdb-replset-member" "sudo chef-client"
  25. Running the Chef Client • Automatically • Using knife’s ssh

    command • Or maybe you’re using Vagrant •vagrant provision
  26. Review • Programmatically provisioned and configured a MongoDB Replica Set

    • Treat like any other code base • Repeat as often as necessary • Use the same code on multiple providers
  27. But wait, there’s more! • Encrypted data bags • Environments

    • Lightweight Resources and Providers • Exception and Report Handlers

More Decks by Nathen Harvey

Other Decks in Technology