Vagrant for real

Vagrant is a well-known tool for creating development environments in a simple and consistent way. Since we adopted in our organization we experienced several benefits: lower project setup times, better shared knowledge among team members, less wtf moments ;-)In this session we’d like to share our experience, including but not limited to:advanced vagrantfile configurationvm configuration tips for dev environment: performance, debug, tuningour wtf momentspuphet/phansilbe: hot or not?packaging a box

Transcript

1. Vagrant for Real
2. Michele Orselli CTO@Ideato _orso_ micheleorselli / ideatosrl mo@ideato.it Riccardo Franconi SW Engineer@Ideato ricfrank ricfrank / ideatosrl rf@ideato.it
4. http://mitchellh.com/the-tao-of-vagrant
5. 1) clone repo 2) vagrant up 3) there’s no #3
7. #tips
8. vagrantfile configs vm performance app config tips provision/packaging
9. Portable configuration tips
10. Don’t use local names for your boxes
11. c.vm.box = "hashicorp/precise64"
12. c.vm.box_url = "http://your_box"
13. Avoid absolute paths
14. c.vm.synced_folder “/myProj","/var/www/myProj"
15. config.vm.synced_folder "./", "/var/www/myProj"
16. Move host specific configuration outside Vagrantfile
17. ram: 2048 cpus: 2 ipaddress: 10.10.10.10 vagrantfile-local-config.yml
18. require ‘yaml' _config = YAML.load(File.open(File.join(File.dirname(__FILE__), “vagrantfile-local-config.yml”), File::RDONLY).read) CONF = _config config.vm.provider "virtualbox" do |vb| vb.customize["modifyvm",:id,“--memory", CONF["ram"]] vb.customize ["modifyvm",:id,"--cpus", CONF[“cpus"]] … end
19. As rule of thumb you could assign the half cpus and a quarter of the memory based on your host machine https://stefanwrobel.com/how-to-make-vagrant-performance-not-suck
20. Force a specific provider
21. ENV['VAGRANT_DEFAULT_PROVIDER'] = 'virtualbox'
22. Project’s folders organization
23. project_dir -- vagrant -- project -- Vagrantfile
24. project_dir -- vagrant -- Vagrantfile -- www -- project1 -- project2 -- project3
25. vagrant plugin install HostsUpdater
26. if Vagrant.has_plugin?("HostsUpdater") config.hostsupdater.aliases = ["host1.lo"] else puts "--- WARNING ---"
 puts “You should install HostsUpdater” end
27. VM Performance
28. run tests… still running…
29. mitchellh.com/comparing-filesystem-performance-in-virtual- machines Virtualbox vs VmWare
30. Virtualbox 22 min VmWare 15 min #tip: usevmware
31. Virtualbox 22 mi VmWare 15 min #tip: usevmware +30%
32. use VmWare if you can #tip: usevmware (it will cost you a few $)
33. use nfs if you can #tip: usenfs
34. vagrant plugin install vbguest #tip: vbguest keeps guest addition updated
35. On VM I/O is the bottleneck
36. loading webpages running testsuites are READ heavy
37. move I/O outside shared folders
38. Default provider: virtualbox 3 PHP test suites with unit, functional, integration mix small (sf1): build runs in ~25 sec medium (zf2): build runs in ~2 mins large (sf2): build runs ~ 20 mins
39. I/O: logs, cache #tip: moveiofromshared
40. class AppKernel extends Kernel { public function getCacheDir() { if (in_array($this->environment, array('dev', 'test'))) { return '/dev/shm/appname/cache/' . $this->environment; } return parent::getCacheDir(); } public function getLogDir() { if (in_array($this->environment, array('dev', ‘test'))) { return '/dev/shm/appname/logs'; } return parent::getLogDir(); } } #tip: moveiofromshared
41. class AppKernel extends Kernel { public function getCacheDir() { if (in_array($this->environment, array('dev', 'test'))) { return '/dev/shm/appname/cache/' . $this->environment; } return parent::getCacheDir(); } public function getLogDir() { if (in_array($this->environment, array('dev', ‘test'))) { return '/dev/shm/appname/logs'; } return parent::getLogDir(); } } #tip: moveiofromshared
42. class { public function { { } public function { { } } #tip: moveiofromshared +13-16%
43. I/O: increase realpath cache #tip: realpathcache
44. realpath_cache_size = 4096k realpath_cache_ttl = 7200 php.ini #tip: realpathcache
45. realpath_cache_size realpath_cache_ttl php.ini #tip: realpathcache +7%
46. I/O: move DB on RAM #tip: moveiofromshared if you use sqlite move it on /dev/shm
47. vagrant plugin install vagrantcachier #tip: vagrantcachier
48. if Vagrant.has_plugin?("vagrant-cachier") config.cache.scope = :box config.cache.synced_folder_opts = { type: :nfs, mount_options: ['rw','vers=3','tcp','nolock'] } end #tip: moveiofromshared Vagrantfile
49. if config.cache.synced_folder_opts type: mount_options: [ end #tip: moveiofromshared Vagrantfile +30% for reprovisioning a box with git, php apache, mysql
50. use cachefilesd for nfs #tip: cachefilesd
51. #tip: cachefilesd - name: Install cachefilesd apt: pkg=cachefilesd state=present - name: Enable cachefilesd lineinfile: dest=/etc/default/cachefilesd line=“RUN=yes” - name: Start cachefilesd service service: name=cachefilesd state=restarted
52. #tip: cachefilesd config.vm.synced_folder "../", "/var/www", id: “vagrant-root”, type: “nfs”, mount_options: ['rw','vers=3','tcp','fsc'] Vagrantfile
53. #tip: cachefilesd config.vm.synced_folder mount_options: [ Vagrantfile -15% +10%
54. Application Management
55. How to access mysql
56. - name: add mysql user mysql_user: name=ideato host='%' password=ideato priv=*.*:ALL,GRANT login_user=root login_password= - name: config bind address to allow remote remote connections lineinfile: dest=/etc/mysql/my.cnf state=present regexp='bind-address = 127\.0\.0\.1' line='bind-address = 0\.0\.0\.0' backup=yes - name: restart mysql service: name=mysql state=restarted
57. - name: Install phpmyadmin apt: pkg=phpmyadmin state=present - name: Include phpmyadmin in Apache config lineinfile: dest=/etc/apache2/apache2.conf line="Include /etc/phpmyadmin apache.conf" notify: restart apache
58. - name: adminer clone git: repo=https://github.com/vrana/adminer.git dest=/var/www/adminer version=v4.2.1 accept_hostkey=true - name: adminer compile command: php compile.php chdir=/var/www/adminer creates=/var/www/adminer/adminer-4.2.1.php
59. Permissions management in shared folders
60. config.vm.synced_folder "../", "/var/www", id: "vagrant-root", owner: "vagrant", group: "vagrant", mount_options: ["dmode=777,fmode=777"]
61. Use host ssh keys
62. config.ssh.forward_agent = true
63. ForwardAgent yes check ssh config file in your host machine
64. Provisioning
65. to phansible or not to phansible? #tip: provisioningtpls
66. • quick and easy way to start • they’re general • old platforms are not supported • a lot of a good ideas you can steal from • on the long run move to your own template #tip: provisioningtpls
67. #tip: provisioningtpls if which('ansible-playbook') config.vm.provision "ansible" do |ansible| ansible.playbook = "ansible/playbook.yml" ansible.inventory_path = "ansible/inventories/dev" ansible.limit = 'all' ansible.extra_vars = { private_interface: "192.168.33.99", hostname: "default" } end else config.vm.provision :shell, path: "ansible/windows.sh", args: ["default"] end
68. can you assume everyone in your team have the same version? #tip: provisioningtpls
69. #tip: provisioningtpls if which('ansible-playbook') config.vm.provision "ansible" do |ansible| ansible.playbook = "ansible/playbook.yml" ansible.inventory_path = "ansible/inventories/dev" ansible.limit = 'all' ansible.extra_vars = { private_interface: "192.168.33.99", hostname: "default" } end else config.vm.provision :shell, path: "ansible/windows.sh", args: ["default"] end
70. the provisioning tool is a moving part: wanna update? be careful #tip: provisioningtpls
71. create Vagrant indipendent provision scripts #tip: provisioningtpls
72. #tip: provisioningtpls config.vm.provision :shell, :path => "scripts/bootstrap.sh", :args => "/var/www" config.vm.provision :shell, :path => “scripts/provision.sh", :args => "/var/www"
73. you’re in control of provisioning command you can perform additional checks on host machine #tip: provisioningtpls
74. Distributing VMs
75. provisioning does not create immutable vm by default eg: package update on LTS #tip: packaging
76. live on the edge and fix provision script use stable package repositories #tip: packaging
77. https://speakerdeck.com/mitchellh/vagrant-usage-patterns Create and distribute your own VM #tip: goldenimage
79. Questions? https://joind.in/talk/view/14548