Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Who am I? What I do: • Software Engineer at Mashery • Co-organizer of the San Francisco PHP User Group • Community Evangelist Where I can be found: • Blog: http://jmather.com • Twitter: @thejmather
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 What is Vagrant? A tool that allows you to create and configure lightweight, reproducible, and portable development environments.
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Vagrant terms • Box, or base box, is the ‘initial image’ of a virtual machine. • Host, or your computer, the machine running the VMs • Guest, or vm, referring to an individual VM instance • Provider, an adapter to a VMS (like VirtualBox or VMWare) • Provisioner, provides post-boot configuration of guests
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 How to use Vagrant • Install Vagrant - http://vagrantup.com • Check out your repository • Run: vagrant up
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Basic Vagrantfile Vagrant.configure("2") do |config| config.vm.box = "base-box-name" config.vm.box_url = ”http://some/url.box" end
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Replicating production matters If you are writing code that will be deployed to a multiple-host environment, why aren’t you writing your code in a multiple- host environment?
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Basic Vagrantfile Vagrant.configure("2") do |config| config.vm.hostname = “box” config.vm.box = "base-box-name" config.vm.box_url = ”http://some/url.box" end
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Basic Vagrantfile (Multi-Guest ready) Vagrant.configure("2") do |config| config.vm.define “box” do |node| node.vm.hostname = “box” node.vm.box = "base-box-name" node.vm.box_url = ”http://some/url.box" end end
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Basic Vagrantfile (Multi-Guest) Vagrant.configure("2") do |config| config.vm.define “box” do |node| node.vm.hostname = “box” node.vm.box = "base-box-name" node.vm.box_url = ”http://some/url.box" end config.vm.define “other-box” do |node| node.vm.hostname = “other-box” node.vm.box = "base-box-name" node.vm.box_url = ”http://some/url.box" end end
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Basic Vagrantfile (Multi-Guest, useful, part 2) nodes = { … node configuration … } Vagrant.configure("2") do |config| nodes.each_pair do |name,options| config.vm.define name do |node| node.vm.box = "base-box-name" node.vm.box_url = "http://some/url.box" node.vm.hostname = options[:hostname] node.vm.network :private_network, ip: options[:ipaddress] end end end
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Vagrant Providers VirtualBox VMWare (WS or Fusion) Parallels Desktop Amazon AWS Digital Ocean Providers Vagrant
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Vagrant Providers (desktop) • VirtualBox is FREE! (sort of) • Some people have trouble with crashes • Some people have trouble with suspend/resume • Built in FS bridging is pretty slow • VMWare (Workstation or Fusion!) is PAID! • You have to buy both VMWare ($49) and provider ($79) • Supposed to be more stable and faster • Parallels Desktop is FREE! • Open source projects FOR THE WIN!
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Vagrant Provider Limits Spinning up guests is cool, but what do I do with a box once it’s up? How do I control it? How do I make it useful? Computing hardware without software is nearly useless.
Shell Scripts Puppet Chef Ansible Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Vagrant Provisioners Provisioners Vagrant
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 What is Puppet? Puppet is IT automation software that helps system administrators manage infrastructure throughout its lifecycle, from provisioning and configuration to patch management and compliance.
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 What is Puppet in simpler words? Puppet gives you an object oriented way to manage the configuration of your servers, either on your laptop, in the cloud, or in your favorite data center.
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Puppet is built... • to be simple • with it’s own declarative language
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Puppet terms • Manifests - This is “application” code • Modules - This is “library” code • Templates - Exactly as it sounds • Facter - Environment data • Hiera - Configuration data
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 How to use Puppet? Select a base box for Vagrant from Puppet Labs http://puppet-vagrant-boxes.puppetlabs.com/ I tend to use CentOS 6.4 for VirtualBox
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Basic Puppet Manifest (guest.pp) class guest { notify { “Look! My puppet code is working!”: } }
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Puppet Manifest (passing parameters) # manifests/guest.pp -- using defaults class guest { include server::writetestfiledefault } # manifests/guest.pp -- passing custom value class guest { class { “server::writetestfiledefault”: content => “test content”, } }
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Puppet Manifest (including classes) class guest { # the class below must be loaded BEFORE guest require server::writetestfiledefault # the class below must be loaded WITH guest include server::writetestfiledefault # the class below must be loaded AFTER guest class { “server::writetestfiledefault”: content => “test content”, } }
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 External Input in Puppet Remember there are three primary sources of where data that branches your logic will come from: • User Space Variables • $things = “you set yourself” • Facts • Specific details about your current environment, such as the name of the host, ip address, operating system, etc... • Hiera • Configuration you pass in to enable building for multiple configurations from the same shared codebase
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Puppet Manifest (facts, debugging) class guest { # what facts are there? Let’s find out! # this should be one line, but it is just too long to fit $template = "(String) && v.is_a?(String) ) }.to_yaml %>" # create a file... file { "/tmp/facts.yaml": content => inline_template($template), } }
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Tell Vagrant about them nodes = { … node configuration … } Vagrant.configure("2") do |config| nodes.each_pair do |name,options| config.vm.define name do |node| node.vm.box = "base-box-name" node.vm.box_url = "http://some/url.box" node.vm.hostname = options[:hostname] node.vm.network :private_network, ip: options[:ipaddress] end end end
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Tell Vagrant about Puppet nodes = { … node configuration … } Vagrant.configure("2") do |config| nodes.each_pair do |name,options| config.vm.define name do |node| node.vm... # omit general config node.vm.provision :puppet do |puppet| puppet.manifests_path = "puppet/manifests/" puppet.manifest_file = "guests.pp" puppet.module_path = "puppet/modules/" end end end end
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Tell Puppet about the guest nodes class guests { if ($::hostname == “web-server”) { # only run for web server } if ($::hostname == “db-server”) { # only run for db server } }
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Tell Puppet about the guest nodes (redux) class guests { if ($::hostname =~ /^web-/) { # only run for web servers } if ($::hostname =~ /^db-/) { # only run for db servers } }
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Development environments come in all shapes and sizes • Some develop in production – Yes, really. • Some develop on a non production server – Not a copy of production, not by a long shot • Some develop locally on a “non production server” – Home grown solutions that “work” until they don’t • Some develop on a development server – Actually tries to be like production – Not always like production – May have additional tuning to help with developmenty things • Some develop in a true development environment – Locally or remote, coming soon to a computer near you
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Why developing in production is really bad Assuming, of course, that you are testing your code before you make it live. Production should always move from one stable version of code to another stable version of code. When you edit code in production, you inherently introduce instability, and can no longer be assured that your code is running as tested.
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Why developing on a non production setup is also bad Debugging environmental issues is slow and painful. Developers should be solving problems with software, not debugging configuration issues. When you build your code in an environment that isn’t related to production in any tangible way, you will often discover just how different your development environment is from production.
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Where your development environment lives Remote • Easy for operations to set up • Easy to enforce a rigid structure • Limits developer’s choice of tool chain selection • Can get expensive and complicated to maintain • Developers must be online to do any development Local • Can require beefier hardware • Can take extra work to set up • Developers have the freedom to work how they work best • Developers can assist with infrastructural initiatives
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Bad development environments will sap the resources out of your team. In addition to the time spent developing and testing new code and fixing bugs, you will spend time: When development environments attack Debugging broken environments or settings Debugging broken behavior between dev and prod Debugging broken behavior between two dev systems Working in broken ways because “it works”
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Failure to specifically build an environment for development will directly impact developer productivity and product quality.
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Takeaways • Bad (or unstable) environments (be it dev, qa, staging, or prod) hurt developers. • Puppet lets you automate all of the configuration of your systems (dev, qa, staging, and prod), ensuring consistency between them. • Vagrant is easy to use, and will let you use your production puppet configs to build development environments. • You will manage server configuration, whether you decide to or not. If you choose not to do it formally it will come back to bite you when you forget something later.
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 If you’re still not sold... h"p://PuPHPet.com/ / PuPHPet/provides/a/ simple/config/tool/for/ those/who/don’t/want/ to/=nker/with/puppet/ and/need/a/LAMP/stack/ up/and/running/NOW./ V2 was released this morning!!!
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 And also look at... • Packer • http://packer.io • Take your Vagrant and Puppet usage to the next level by using Packer to pre-provision images for easy first spins • Build prebuilt systems for multiple VMS and cloud platforms • Docker • http://docker.io • A different idea of how to build multiple machine VM environments
Virtualize your environment with Vagrant and Puppet - Columbus Code Camp - October 12th, 2013 Thank you! More information about this talk can be found at: http://jmather.com/talks/2013-10-12
jmather
track3jyo
bastnic
leichteckig
chalasr
niftycorp
lemolatoon
gennei
miso
akase244
star_zero
kageshiron
shgishzk
maltzj
jcasabona
jponch
caitiem20
geoffreycrofte
marktimemedia
lara
frogandcode
bkeepers
destraynor
sachag
chriscoyier