Streamlined local development with Vagrant and Ansible - Drukwerkdeal

Slides for my Vagrant & Ansible talk at Drukwerkdeal.

Transcript

3. Hi, I’m Thijs
4. I’m @ThijsFeryn on Twitter
5. I’m an at Evangelist
6. I’m an at Evangelist
7. I’m an at Evangelist
8. I’m a at board member
10. Create and configure lightweight, reproducible, and portable development environments.
13. Why? Why? Why?
14. •Environment per project •Dev ~= Test ~= Staging ~= Prod •Easy to define & transport •Easy to tear down •Provisionable: infrastructure as code •Versionable •Shared across the team
15. Vagrantfile Vagrant box vagrant up How Vagrant works Provisioning scripts VM’s on your computer
16. Generate a Vagrantfile $  vagrant  init  ubuntu/trusty64
17. •Select base box •Choose virtualization provider •Configure VM parameters •Configure networking •Tweak SSH settings •Mount local folders •Provision machine What does a Vagrantfile do?
18. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"      config.vm.synced_folder  "./www",  "/var/www"      config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "1024"          vb.cpus  =  "4"        end      config.vm.provision  "ansible"  do  |ansible|                  ansible.playbook  =  "ansible/playbook.yml"      end   end
19. Boxes
20. http://vagrantcloud.com Search for public boxes Official
21. http://www.packer.io Build your own boxes
22. https://docs.vagrantup.com/ v2/boxes/base.html Or do it manually
23. http://atlas.hashicorp.com Host your boxes in the Cloud
24. Manage boxes $  vagrant  box  add  hashicorp/precise64   $  vagrant  box  add  precise32  http:// files.vagrantup.com/precise32.box  -­‐-­‐provider   virtualbox   $  vagrant  box  list   $  vagrant  box  remove  hashicorp/precise64   $  vagrant  box  repackage  precise32  virtualbox  0   $  vagrant  box  outdated   $  vagrant  box  update   $  vagrant  package
25. Vagrant.configure("2")  do  |config|      config.vm.box  =  "ubuntu/trusty64"   end Vagrantfile can do this too Vagrant.configure("2")  do  |config|      config.vm.box  =  "precise32"      config.vm.box_url  =  "http:// files.vagrantup.com/precise32.box"       end URL for self-hosted boxes
26. Vagrant up & running
27. •vagrant up •vagrant suspend •vagrant halt •vagrant reload •vagrant destroy •vagrant status
28. Connect
29. vagrant ssh
30. •Passwordless login •SSH keys •Generated on vagrant up •Private key in .vagrant folder of your project •Public key in authorized_keys file for vagrant user
31. vagrant ssh-config Host  default      HostName  127.0.0.1      User  vagrant      Port  2202      UserKnownHostsFile  /dev/null      StrictHostKeyChecking  no      PasswordAuthentication  no      IdentityFile  /Users/thijs/Sites/ vagrantup/.vagrant/machines/default/ virtualbox/private_key      IdentitiesOnly  yes      LogLevel  FATAL
32. Networking
33. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"   end Networking
34. Synced folders
35. By default your project folder is mounted as /vagrant on the guest VM
36. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  “public_network"      config.vm.synced_folder  "./www",  "/var/www"   end Synced folders
37. VM properties
38. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"      config.vm.synced_folder  "./www",  "/var/www"      config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "1024"          vb.cpus  =  "4"        end   end VM properties
39. Portability
40. Who the hell cares about an empty Linux box?
41. Provisioning
42. •File •Shell •Ansible •Cfengine •Chef Solo •Chef Zero •Chef Client •Chef Apply •Docker •Puppet Apply •Puppet Agent •Salt Provisioning
44. •Configuration management •Simple/lightweight •Yaml •Config > code •Written in Python •Standalone/agentless •Pushes commands over SSH •Lots of modules •Lots of public “roles”
45. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.network  "forwarded_port",  guest:  80,  host:  8080      config.vm.network  "private_network",  ip:  "192.168.33.10"      config.vm.network  "public_network"      config.vm.synced_folder  "./www",  "/var/www"      config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "1024"          vb.cpus  =  "4"        end      config.vm.provision  "ansible"  do  |ansible|                  ansible.playbook  =  "ansible/playbook.yml"      end   end Ansible provisioning in Vagrant
46. -­‐-­‐-­‐   -­‐  hosts:  all      vars:          docroot:  /vagrant/www          servername:  mysite.dev      sudo:  yes      tasks:      -­‐  name:  ensure  nginx  is  at  the  latest  version          apt:  pkg=nginx  state=latest      -­‐  name:  write  the  nginx  config  file          template:  src=mysite.conf.j2  dest=/etc/nginx/sites-­‐ enabled/mysite.conf          notify:          -­‐  restart  nginx      -­‐  name:  ensure  nginx  is  running  (and  enable  it  at  boot)          service:  name=nginx  state=started  enabled=yes      handlers:          -­‐  name:  restart  nginx              service:  name=nginx  state=restarted Simple playbook example
47. -­‐-­‐-­‐   -­‐  hosts:  all      vars:          docroot:  /vagrant/www          servername:  mysite.dev      sudo:  yes      tasks:      -­‐  name:  ensure  nginx  is  at  the  latest  version          apt:  pkg=nginx  state=latest      -­‐  name:  write  the  nginx  config  file          template:  src=mysite.conf.j2  dest=/etc/nginx/sites-­‐ enabled/mysite.conf          notify:          -­‐  restart  nginx      -­‐  name:  ensure  nginx  is  running  (and  enable  it  at  boot)          service:  name=nginx  state=started  enabled=yes      handlers:          -­‐  name:  restart  nginx              service:  name=nginx  state=restarted
48. •First “vagrant up” •Vagrant provision
49. Organizing playbooks
50. -­‐group_vars      all.yml      webservers.yml      databases.yml   -­‐host_vars      webserver001.yml      webserver002.yml      database001.yml      database002.yml   -­‐playbook.yml   -­‐common.yml   -­‐roles      nginx      mysql Directory layout Variables per group or for all groups Variables per host Main playbook Included playbook Modularized playbooks
51. -­‐-­‐-­‐   -­‐  hosts:  webservers      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  nginx      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  databases      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  mysql      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  all      tasks:          -­‐  include:  common.yml          -­‐  shell:  echo  'still  busy'   -­‐-­‐-­‐   -­‐  hosts:  webserver001      tasks:          -­‐  shell:  echo  'very  busy'  
52. Inventory
53. Inventory $  cat  .vagrant/provisioners/ansible/ inventory/vagrant_ansible_inventory #  Generated  by  Vagrant   default  ansible_ssh_host=127.0.0.1   ansible_ssh_port=2202
54. Create custom inventory files for other environments
55. Re-use your Ansible scripts on test/staging/ production
56. Standalone Ansible
57. Standalone Ansible $  ansible-­‐playbook  -­‐i  inventory-­‐staging   playbook.yml
58. Multi-machine setup
59. Vagrant.configure(2)  do  |config|            config.vm.box  =  "ubuntu/trusty64"            config.vm.define  "webserver001",  primary:true  do  |ws001|              ws001.vm.hostname  =  "webserver001"              ws001.vm.network  :private_network,  ip:  "192.168.33.10"              ws001.vm.synced_folder  "./www",  "/var/www"                  end            config.vm.define  "webserver002"  do  |ws002|              ws002.vm.hostname  =  "webserver002"              ws002.vm.network  :private_network,  ip:  "192.168.33.11"              ws002.vm.synced_folder  "./www",  "/var/www"                  end                config.vm.define  "database001"  do  |db001|              db001.vm.hostname  =  "database001"              db001.vm.network  :private_network,  ip:  "192.168.33.12"      end            config.vm.define  "database002"  do  |db002|              db002.vm.hostname  =  "database002"              db002.vm.network  :private_network,  ip:  "192.168.33.13"      end            config.vm.provider  "virtualbox"  do  |vb|          vb.memory  =  "512"          vb.cpus  =  "2"        end      config.vm.provision  "ansible"  do  |ansible|                  ansible.playbook  =  "ansible/playbook.yml"                  ansible.groups  =  {                          "webservers"    =>  ["webserver001",  "webserver002"],                          "databases"      =>  ["database001",  "database002"],                                                  "all_groups:children"  =>  ["webservers",  "databases"]                  }      end   end
60. Inventory $  cat  .vagrant/provisioners/ansible/ inventory/vagrant_ansible_inventory #  Generated  by  Vagrant   database001  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2204   database002  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2205   webserver001  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2202   webserver002  ansible_ssh_host=127.0.0.1  ansible_ssh_port=2203   [webservers]   webserver001   webserver002   [databases]   database001   database002   [all_groups:children]   webservers   databases
61. -­‐-­‐-­‐   -­‐  hosts:  webservers      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  nginx      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  databases      pre_tasks:          -­‐  shell:  echo  'hello'      roles:          -­‐  mysql      tasks:          -­‐  shell:  echo  'still  busy'      post_tasks:          -­‐  shell:  echo  'goodbye' -­‐-­‐-­‐   -­‐  hosts:  all      tasks:          -­‐  include:  common.yml          -­‐  shell:  echo  'still  busy'   -­‐-­‐-­‐   -­‐  hosts:  webserver001      tasks:          -­‐  shell:  echo  'very  busy'  
62. Controlling the machines
63. vagrant  up   vagrant  ssh   vagrant  destroy   vagrant  up  webserver001   vagrant  ssh  webserver001   vagrant  destroy  webserver001   vagrant  up  database001   vagrant  ssh  database001   vagrant  destroy  database001 All VM’s Primary VM All VM’s
64. Vagrant up #FTW
66. Hiring Cloud Systems Engineers in The Netherlands