A beginner’s guide to deployments - PHPTour

Deploying an application means different things to different people. It may be as simple as running git pull on a server, or as complex as building RPMs and deploying to a canary set of servers. This talk covers both ends of the spectrum and the points in between. We’ll outline several tried and tested deployment methodologies that everyone can use, whether you’re working with a simple WordPress site or a dozen micro-services.

Transcript

1. @mheap at #phptour A beginners guide to deployments
2. @mheap Let’s talk deployment
3. @mheap Your deploys should be as boring, straightforward, and stress-free as possible. - Zach Holman (https://zachholman.com/posts/deploying-software)
4. @mheap Deployment for beginners
5. @mheap 1. What is a deployment? 2. Option A: External tools 3. Option B: Internal tools 4. Option C: System packages 5. Option D: Blue / Green deployments 6. Option E: Immutable infrastructure 7. Deployment techniques 8. Summary
6. @mheap What is a deployment?
7. @mheap Code
8. @mheap Dependencies
9. @mheap Configuration
10. @mheap Database Migrations
11. @mheap Other Migrations
12. @mheap Assets
13. @mheap Post Install Tasks
14. @mheap We’re aiming for…
15. @mheap Your deploys should be as boring, straightforward, and stress-free as possible. - Zach Holman (https://zachholman.com/posts/deploying-software)
16. @mheap Our Codebase
17. @mheap Simple to do list application
18. @mheap Composer Silex Doctrine Migrations
19. @mheap Time to deploy!
20. @mheap Option A: External tool
21. @mheap @mheap
22. @mheap @mheap
23. @mheap @mheap
24. @mheap @mheap
25. @mheap @mheap
26. @mheap @mheap
27. @mheap @mheap
28. @mheap @mheap
29. @mheap @mheap
30. @mheap @mheap
31. @mheap Useful tools Beanstalkapp DeployHQ Laravel Forge
32. @mheap 1. Easy setup 2. One-click deployments 3. Environment support 4. Can only deploy from repo 1. Files copied one by one 2. Composer run on server 3. No build steps 4. Their way, or the highway 5. Can’t deploy if provider is offline Pros Cons
33. @mheap Option B: Internal tool
34. @mheap @mheap
35. @mheap $ gem install capistrano
36. @mheap $ cap install => mkdir -p config/deploy => create config/deploy.rb => create config/deploy/staging.rb => create config/deploy/production.rb => mkdir -p lib/capistrano/tasks => create Capfile => Capified
37. @mheap $ cat config/deploy.rb lock '3.6.1' set :application, 'silex_todo' set :repo_url, 'git@github.com:mheap/fake-todo-app.git' set :deploy_to, '/var/www/todo'
38. @mheap $ cat config/deploy/production.rb server 'todo.example.com', user: 'deploy', roles: %w{app db}
39. @mheap $ cap production deploy 00:00 git:wrapper 01 mkdir -p /tmp 02 chmod 700 /tmp/git-ssh-silex_todo-production-michael.sh 00:07 git:check 01 git ls-remote --heads git@github.com:mheap/silex-todo-demo.git 00:08 deploy:check:directories 01 mkdir -p /var/www/todo/shared /var/www/todo/releases 00:08 git:clone 01 git clone --mirror git@github.com:mheap/silex-todo-demo.git /var/www/todo/repo 01 Cloning into bare repository '/var/www/todo/repo'... 00:10 git:update 01 git remote update --prune 01 Fetching origin 00:11 git:create_release 01 mkdir -p /var/www/todo/releases/20161106090926 02 git archive master | tar -x -f - -C /var/www/todo/releases/20161106090926 00:12 git:set_current_revision 01 echo "6cc1b6cbc827e205b24d0d599ea7b667a3ec5ca0" >> REVISION 00:12 deploy:symlink:release 01 ln -s /var/www/todo/releases/20161106090926 /var/www/todo/releases/current 02 mv /var/www/todo/releases/current /var/www/todo 00:12 deploy:log_revision 01 echo "Branch master (at 6cc1b6cbc827e205b24d0d599ea7b667a3ec5ca0) deployed as release 20161106090926 by michael" >> /var/www/todo/revisions.log
40. @mheap $ cap production deploy Generate and upload deployment script Clone repo Generate archive from repo Untar archive into releases folder Symlink current folder to the latest release
41. @mheap $ gem install capistrano-composer In Capfile: require 'capistrano/composer'
42. @mheap $ cap production deploy 00:18 composer:run 01 composer install --no-dev --prefer-dist --no-interaction -- quiet --optimize-autoloader ✔ 01 deploy@todo.example 1.023s
43. @mheap lib/capistrano/tasks/database_tasks.rake: namespace :database do desc 'migrate database' task :migrate do on roles(:db) do execute "cd #{release_path} && ./vendor/bin/ doctrine-migrations migrations:migrate --db-configuration config/db-config.php --configuration config/migrations.yml" end end end
44. @mheap lib/capistrano/tasks/database_tasks.rake: namespace :database do desc 'migrate database' task :migrate do on roles(:db) do execute "cd #{release_path} && ./vendor/bin/ doctrine-migrations migrations:migrate --db-configuration config/db-config.php --configuration config/migrations.yml" end end end
45. @mheap lib/capistrano/tasks/database_tasks.rake: namespace :database do desc 'migrate database' task :migrate do on roles(:db) do execute "cd #{release_path} && ./vendor/bin/ doctrine-migrations migrations:migrate --db-configuration config/db-config.php --configuration config/migrations.yml" end end end
46. @mheap lib/capistrano/tasks/database_tasks.rake: namespace :database do desc 'migrate database' task :migrate do on roles(:db) do execute "cd #{release_path} && ./vendor/bin/ doctrine-migrations migrations:migrate --db-configuration config/db-config.php --configuration config/migrations.yml" end end end
47. @mheap lib/capistrano/tasks/database_tasks.rake: namespace :database do desc 'migrate database' task :migrate do on roles(:db) do execute "cd #{release_path} && ./vendor/bin/ doctrine-migrations migrations:migrate --db-configuration config/db-config.php --configuration config/migrations.yml" end end end
48. @mheap Capfile: after "composer:install", "database:migrate"
49. @mheap $ cap production deploy 00:22 database:migrate 01 cd #{release_path} && ./vendor/bin/doctrine-migrations migrations:migrate —db-co… ✔ 01 deploy@todo.example 0.812s
50. @mheap @mheap
51. @mheap Useful tools Capistrano Webistrano Rocketeer Ansible
52. @mheap 1. One-click deployments 2. Environment support 3. Can only deploy from repo 4. Internal solution 5. Atomic deploys 6. Rollback support 1. Learning curve 2. Composer run on server 3. No build steps 4. Probably want to use Bundler to manage versions Pros Cons
53. @mheap Option C: System Packages
54. @mheap $ apt-get install todo $ yum install todo $ pacman -S todo
55. @mheap @mheap
56. @mheap @mheap
57. @mheap . !"" resources !"" src # !"" application # # !"" controller # # # $"" IndexController.php # # !"" model # # # $"" User.php # # $"" view # # $"" show-user.php # !"" composer.json # !"" composer.lock # !"" config # # !"" mappings.json # # $"" targets.json # $"" public # $"" index.php $"" test
58. @mheap . !"" resources !"" src # !"" application # # !"" controller # # # $"" IndexController.php # # !"" model # # # $"" User.php # # $"" view # # $"" show-user.php # !"" composer.json # !"" composer.lock # !"" config # # !"" mappings.json # # $"" targets.json # $"" public # $"" index.php $"" test $ fpm -s dir -t rpm -n todo
59. @mheap . !"" resources !"" src # !"" application # # !"" controller # # # $"" IndexController.php # # !"" model # # # $"" User.php # # $"" view # # $"" show-user.php # !"" composer.json # !"" composer.lock # !"" config # # !"" mappings.json # # $"" targets.json # $"" public # $"" index.php $"" test $ fpm -s dir -t rpm -n todo \ src/=/var/www/todo \ src/config/=/etc/todo
60. @mheap . !"" resources !"" src # !"" application # # !"" controller # # # $"" IndexController.php # # !"" model # # # $"" User.php # # $"" view # # $"" show-user.php # !"" composer.json # !"" composer.lock # !"" config # # !"" mappings.json # # $"" targets.json # $"" public # $"" index.php $"" test $ fpm -s dir -t rpm --config-files /etc \ -n todo \ src/=/var/www/todo \ src/config/=/etc/todo
61. @mheap . !"" resources !"" src # !"" application # # !"" controller # # # $"" IndexController.php # # !"" model # # # $"" User.php # # $"" view # # $"" show-user.php # !"" composer.json # !"" composer.lock # !"" config # # !"" mappings.json # # $"" targets.json # $"" public # $"" index.php $"" test $ fpm -s dir -t rpm --config-files /etc \ --exclude "var/www/todo/config*" \ -n todo \ src/=/var/www/todo \ src/config/=/etc/todo
62. @mheap $ fpm -s dir -t rpm --config-files /etc --exclude "var/www/todo/config*" -n todo src/=/var/ www/todo src/config/=/etc/todo => Created package {:path=>"todo-1.0-1.x86_64.rpm"}
63. @mheap Continous Integration
64. @mheap What is Continous Integration?
65. @mheap Use it to run tests
66. @mheap Use it to composer install
67. @mheap Use it to build on identical platforms
68. @mheap Use it to package your application
69. @mheap Use it to AUTOMATE THINGS
70. @mheap @mheap
71. @mheap Option C: System Packages
72. @mheap Almost
73. @mheap Database migrations
74. @mheap $ fpm -s dir -t rpm --config-files /etc --exclude "var/www/todo/config*" -n todo src/=/var/ www/todo src/config/=/etc/todo => Created package {:path=>"todo-1.0-1.x86_64.rpm"}
75. @mheap $ fpm -s dir -t rpm --config-files /etc --exclude "var/www/todo/config*" -n todo --after-install /path/to/script src/=/var/www/ todo src/config/=/etc/todo => Created package {:path=>"todo-1.0-1.x86_64.rpm"}
76. @mheap Useful tools FPM Jenkins RPM / Deb / Pkg
77. @mheap Releases are immutable
78. @mheap 1. Atomic releases 2. Build on system tools 3. Proper build toolchain 4. Signed builds 5. Easy upgrade/rollback 6. Immutable 1. Steep learning curve 2. Need to run package repo 3. Ideal to run CI system Pros Cons
79. @mheap Option D: Blue / Green
80. @mheap Load Balancer
81. @mheap Load Balancer
82. @mheap Load Balancer
83. @mheap Shared databases
84. @mheap Server maintenance
85. @mheap Shameless Plug
86. @mheap Infrastructure level
87. @mheap Useful tools Puppet Chef Ansible
88. @mheap 1. Low risk deployments 2. Test on production systems 3. Easy changeover 1. Can be expensive 2. Databases are hard 3. More moving parts to manage Pros Cons
89. @mheap Option E: Immutable
90. @mheap 1 0 0 1 0 1 Load Balancer
91. @mheap 1 0 1 Load Balancer
92. @mheap 1 0 1 Load Balancer 1 0 2 1 1 0
93. @mheap Load Balancer 1 0 1 1 0 2 1 1 0
94. @mheap Load Balancer 1 0 2 1 1 0
95. @mheap Why immutable?
96. @mheap Load Balancer 1 0 0 1 0 1
97. @mheap 1 0 0 1 0 1 Load Balancer
98. @mheap 1 0 0 Load Balancer
99. @mheap 1 0 0 Load Balancer 1 0 2
100. @mheap Useful tools Puppet / Chef / Ansible Packer Cloud providers
101. @mheap 1. Known environment 2. Test 2+ releases at once 3. Easy changeover 4. Truly atomic releases 1. Cost 2. Slow to build 3. Database sync Pros Cons
102. @mheap Deployment techniques
103. @mheap Build (at least) daily (even better if it’s automated)
104. @mheap Announce releases
105. @mheap Staggered Releases
106. @mheap Canary deploys
107. @mheap Go / No Go
108. @mheap Containers
109. @mheap Summary
110. @mheap Automate your deployment
111. @mheap Local builds
112. @mheap Immutable releases
113. @mheap Think about deployment before you write any code
114. @mheap The three strikes rule
115. @mheap Make it a single command
116. @mheap Your deploys should be as boring, straightforward, and stress-free as possible. - Zach Holman (https://zachholman.com/posts/deploying-software)
117. @mheap at #phptour https://joind.in/ 20636 Michael Heap @mheap m@michaelheap.com