Streamlined local development with Vagrant & Ansible - Devtalks 2015

Slides for my Vagrant & Ansible talk at Devtalks 2015 in Cluj Romania

3. Hi, I’m Thijs
4. I’m @ThijsFeryn on Twitter
5. I’m an at Evangelist
6. I’m a at board member
8. Create and configure lightweight, reproducible, and portable development environments.
11. Why? Why? Why?
12. •Environment per project •Dev ~= Test ~= Staging ~= Prod •Easy to define & transport •Easy to tear down •Provisionable: infrastructure as code •Versionable •Shared across the team
13. Vagrantfile Vagrant box vagrant up How Vagrant works Provisioning scripts VM’s on your computer
14. Generate a Vagrantfile $  vagrant  init  ubuntu/trusty64
15. •Select base box •Choose virtualization provider •Configure VM parameters •Configure networking •Tweak SSH settings •Mount local folders •Provision machine What does a Vagrantfile do?
16. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"      config.vm.synced_folder  "./www",  "/var/www"      config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "1024"          vb.cpus  =  "4"        end      config.vm.provision  "ansible"  do  |ansible|                  ansible.playbook  =  "ansible/playbook.yml"      end   end
17. Boxes
18. http://vagrantcloud.com Search for public boxes Official
19. http://www.packer.io Build your own boxes
20. https://docs.vagrantup.com/ v2/boxes/base.html Or do it manually
21. http://atlas.hashicorp.com Host your boxes in the Cloud
22. Manage boxes $  vagrant  box  add  hashicorp/precise64   $  vagrant  box  add  precise32  http:// files.vagrantup.com/precise32.box  -­‐-­‐provider   virtualbox   $  vagrant  box  list   $  vagrant  box  remove  hashicorp/precise64   $  vagrant  box  repackage  precise32  virtualbox  0   $  vagrant  box  outdated   $  vagrant  box  update   $  vagrant  package
23. Vagrant.configure("2")  do  |config|      config.vm.box  =  "ubuntu/trusty64"   end Vagrantfile can do this too Vagrant.configure("2")  do  |config|      config.vm.box  =  "precise32"      config.vm.box_url  =  "http:// files.vagrantup.com/precise32.box"       end URL for self-hosted boxes
24. Vagrant up & running
25. •vagrant up •vagrant suspend •vagrant halt •vagrant reload •vagrant destroy •vagrant status
26. Connect
27. vagrant ssh
28. •Passwordless login •SSH keys •Generated on vagrant up •Private key in .vagrant folder of your project •Public key in authorized_keys file for vagrant user
29. vagrant ssh-config Host  default      HostName  127.0.0.1      User  vagrant      Port  2202      UserKnownHostsFile  /dev/null      StrictHostKeyChecking  no      PasswordAuthentication  no      IdentityFile  /Users/thijs/Sites/ vagrantup/.vagrant/machines/default/ virtualbox/private_key      IdentitiesOnly  yes      LogLevel  FATAL
30. Networking
31. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"   end Networking
32. Synced folders
33. By default your project folder is mounted as /vagrant on the guest VM
34. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  “public_network"      config.vm.synced_folder  "./www",  "/var/www"   end Synced folders
35. VM properties
36. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"      config.vm.synced_folder  "./www",  "/var/www"      config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "1024"          vb.cpus  =  "4"        end   end VM properties
37. Portability
38. Who the hell cares about an empty Linux box?
39. Provisioning
40. •File •Shell •Ansible •Cfengine •Chef Solo •Chef Zero •Chef Client •Chef Apply •Docker •Puppet Apply •Puppet Agent •Salt Provisioning
42. •Configuration management •Simple/lightweight •Yaml •Config > code •Written in Python •Standalone/agentless •Pushes commands over SSH •Lots of modules •Lots of public “roles”
43. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"      config.vm.synced_folder  "./www",  "/var/www"      config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "1024"          vb.cpus  =  "4"        end      config.vm.provision  "ansible"  do  |ansible|                  ansible.playbook  =  "ansible/playbook.yml"      end   end Ansible provisioning in Vagrant
44. -­‐-­‐-­‐   -­‐  hosts:  all      vars:          docroot:  /vagrant/www          servername:  mysite.dev      sudo:  yes      tasks:      -­‐  name:  ensure  nginx  is  at  the  latest  version          apt:  pkg=nginx  state=latest      -­‐  name:  write  the  nginx  config  file          template:  src=mysite.conf.j2  dest=/etc/nginx/sites-­‐ enabled/mysite.conf          notify:          -­‐  restart  nginx      -­‐  name:  ensure  nginx  is  running  (and  enable  it  at  boot)          service:  name=nginx  state=started  enabled=yes      handlers:          -­‐  name:  restart  nginx              service:  name=nginx  state=restarted Simple playbook example
45. -­‐-­‐-­‐   -­‐  hosts:  all      vars:          docroot:  /vagrant/www          servername:  mysite.dev      sudo:  yes      tasks:      -­‐  name:  ensure  nginx  is  at  the  latest  version          apt:  pkg=nginx  state=latest      -­‐  name:  write  the  nginx  config  file          template:  src=mysite.conf.j2  dest=/etc/nginx/sites-­‐ enabled/mysite.conf          notify:          -­‐  restart  nginx      -­‐  name:  ensure  nginx  is  running  (and  enable  it  at  boot)          service:  name=nginx  state=started  enabled=yes      handlers:          -­‐  name:  restart  nginx              service:  name=nginx  state=restarted
46. •First “vagrant up” •Vagrant provision
47. Organizing playbooks
48. -­‐group_vars      all.yml      webservers.yml      databases.yml   -­‐host_vars      webserver001.yml      webserver002.yml      database001.yml      database002.yml   -­‐playbook.yml   -­‐common.yml   -­‐roles      nginx      mysql Directory layout Variables per group or for all groups Variables per host Main playbook Included playbook Modularized playbooks
49. -­‐-­‐-­‐   -­‐  hosts:  webservers      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  nginx      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  databases      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  mysql      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  all      tasks:          -­‐  include:  common.yml          -­‐  shell:  echo  'still  busy'   -­‐-­‐-­‐   -­‐  hosts:  webserver001      tasks:          -­‐  shell:  echo  'very  busy'  
50. Inventory
51. Inventory $  cat  .vagrant/provisioners/ansible/ inventory/vagrant_ansible_inventory #  Generated  by  Vagrant   default  ansible_ssh_host=127.0.0.1   ansible_ssh_port=2202
52. Create custom inventory files for other environments
53. Re-use your Ansible scripts on test/staging/ production
54. Standalone Ansible
55. Standalone Ansible $  ansible-­‐playbook  -­‐i  inventory-­‐staging   playbook.yml
56. Multi-machine setup
57. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.define  "webserver001",  primary:true  do  |ws001|              ws001.vm.hostname  =  "webserver001"              ws001.vm.network  :private_network,  ip:  "192.168.33.10"              ws001.vm.synced_folder  "./www",  "/var/www"                  end            config.vm.define  "webserver002"  do  |ws002|              ws002.vm.hostname  =  "webserver002"              ws002.vm.network  :private_network,  ip:  "192.168.33.11"              ws002.vm.synced_folder  "./www",  "/var/www"                  end                config.vm.define  "database001"  do  |db001|              db001.vm.hostname  =  "database001"              db001.vm.network  :private_network,  ip:  "192.168.33.12"      end            config.vm.define  "database002"  do  |db002|              db002.vm.hostname  =  "database002"              db002.vm.network  :private_network,  ip:  "192.168.33.13"      end            config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "512"          vb.cpus  =  "2"        end      config.vm.provision  "ansible"  do  |ansible|                  ansible.playbook  =  "ansible/playbook.yml"                  ansible.groups  =  {                          "webservers"    =>  ["webserver001",  "webserver002"],                          "databases"      =>  ["database001",  "database002"],                                                  "all_groups:children"  =>  ["webservers",  "databases"]                  }      end   end
58. Inventory $  cat  .vagrant/provisioners/ansible/ inventory/vagrant_ansible_inventory #  Generated  by  Vagrant   database001  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2204   database002  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2205   webserver001  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2202   webserver002  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2203   [webservers]   webserver001   webserver002   [databases]   database001   database002   [all_groups:children]   webservers   databases
59. -­‐-­‐-­‐   -­‐  hosts:  webservers      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  nginx      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  databases      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  mysql      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  all      tasks:          -­‐  include:  common.yml          -­‐  shell:  echo  'still  busy'   -­‐-­‐-­‐   -­‐  hosts:  webserver001      tasks:          -­‐  shell:  echo  'very  busy'  
60. Controlling the machines
61. vagrant  up   vagrant  ssh   vagrant  destroy   vagrant  up  webserver001   vagrant  ssh  webserver001   vagrant  destroy  webserver001   vagrant  up  database001   vagrant  ssh  database001   vagrant  destroy  database001 All VM’s Primary VM All VM’s
62. Vagrant up #FTW