Application deployment with Chef

Transcript

1. 1.

   Application deployment with Chef Igor Afonov

2. 2.

   ‣ Ruby developer ‣ I’m participating in Chef development Developers

   Sys Admins DevOps I’m here About Me
3. 3.

   Configuration Management Chef Quick Intro Application Deployment FAQ Q &

   A Agenda
4. 4.

   Configuration Management

5. 5.

   "Keep track of all the stuff you do to take

   a system from 'bare metal' to 'doing its job'." - Adam Jacob
6. 6.

   ๏ Remember everything ๏ Keep notes in notepad ๏ Maintain

   wiki ๏ Bash scripts ๏ Automation frameworks
7. 7.

   Opscode Chef

8. 8.

   ๏ Configuration management framework ๏ Open source ๏ Created by

   Adam Jacob ๏ Maintained by Opscode
9. 9.

   ๏ Client-server architecture ๏ Idempotence ๏ Declarative ๏ Ruby everywhere

10. 10.

    Crash course

11. 11.

    chef-server push pull VCS chef-client node chef-client node chef-client node

    server chef repository developer Workflow
12. 12.

    cookbook recipe chef-repository resource resource resource Code structure

13. 13.

    Resource

14. 14.

    package 'apache2' do action :install provider Chef::Provider::Package::Apt version '2.4' end

15. 15.

    Cookbook File Cron Deploy Directory Env Execute* File Git Group

    HTTP Request Ifconfig Link Log Mount Ohai Package PowerShell Script User Remote Directory Remote File Route Ruby Block SCM Script Service Subversion Template Bundled resources
16. 16.

    Provider

17. 17.

    package apt pacman macports Resource Providers Interface Implementation

18. 18.

    service "redis" do action :start end Method call Parameter1 Parameter2

    # lib/chef/platform.rb - Chef::Platform :macosx => { :default => { ... :package => Chef::Provider::Package::Macports, :service => Chef::Provider::Service::Macosx, ... } } # lib/chef/provider/service/macosx.rb class Chef::Provider::Service::Macosx < Chef::Provider::Service::Simple def start if @current_resource.running Chef::Log.debug("#{@new_resource} already running, not starting") else shell_out!("launchctl load -w '#{@plist}'") end end end
19. 19.

    Recipe

20. 20.

    package "postfix" do action :install end %w{main master}.each do |config|

    template "/etc/postfix/#{config}.cf" do source "#{config}.cf.erb" owner "root" group "root" mode 0644 end end
21. 21.

    Cookbook

22. 22.

    cookbook |-attributes |-files |-libraries |-recipes |-templates |---metadata.rb

23. 23.

    ๏ Cookbooks should be data-driven ๏ Do not hardcode anything

    ๏ Control behavior via: ๏ Attributes ๏ Databags ๏ Search
24. 24.

    Node

25. 25.

    ๏ Host that runs chef-client ๏ Has attributes ๏ Has

    run list
26. 26.

    Role

27. 27.

    name "mail-server" description "Installs and configures postfix MTA" default_attributes :postfix

    => { "mydomain" => "domain.com", "myorigin" => "domain.com" } run_list "recipe[postfix]"
28. 28.

    Chef repository

29. 29.

    chef-repo |-cookbooks |-data_bags |-roles |-environments |---Rakefile https://github.com/opscode/chef-repo

30. 30.

    chef-server push pull VCS chef-client node chef-client node chef-client node

    server chef repository developer The big picture
31. 31.

    ๏ Authenticate node ๏ Synchronize cookbooks ๏ Compile ๏ Converge

    chef-client run
32. 32.

    ๏ Resource is a unit of work ๏ Provider take

    real action ๏ Recipe is collection of resources ๏ Cookbook is reusable set of recipes ๏ Code is pushed to chef-server ๏ Node pulls code from chef-server and runs it Recap
33. 33.

    Deployment

34. 34.

    ๏ Get the code from VCS ๏ Put the code

    to the right place ๏ Do some rituals Three easy* steps * Not true
35. 35.

    Real-world example

36. 36.

    internet nginx unicorn unicorn unicorn Simple Rails deployment

37. 37.

    Get the code & put it to the right place

    application 'copycopter' do repository 'git@github.com:iafonov/copycopter-server.git' revision 'master' path '/var/www/apps/copycopter' end
38. 38.

    Pick the SCM strategy application 'copycopter' do repository 'git@github.com:iafonov/copycopter-server.git' revision

    'master' path '/var/www/apps/copycopter' strategy :deploy_revision # :deploy_timestamped end
39. 39.

    Set the code owner application 'copycopter' do repository 'git@github.com:iafonov/copycopter-server.git' revision

    'master' path '/var/www/apps/copycopter' strategy :deploy_revision owner 'deploy' group 'deploy' end
40. 40.

    Install library dependencies application 'copycopter' do repository 'git@github.com:iafonov/copycopter-server.git' revision 'master'

    path '/var/www/apps/copycopter' strategy :deploy_revision owner 'deploy' group 'deploy' packages ['libxml2-dev', 'libxslt-dev'] end
41. 41.

    Run migrations application 'copycopter' do repository 'git@github.com:iafonov/copycopter-server.git' revision 'master' path

    '/var/www/apps/copycopter' strategy :deploy_revision owner 'deploy' group 'deploy' packages ['libxml2-dev', 'libxslt-dev'] migrate true end
42. 42.

    Restart service application 'copycopter' do repository 'git@github.com:iafonov/copycopter-server.git' revision 'master' path

    '/var/www/apps/copycopter' strategy :deploy_revision owner 'deploy' group 'deploy' packages ['libxml2-dev', 'libxslt-dev'] migrate true restart_command 'service copycopter restart' end
43. 43.

    ๏ rails ๏ java_webapp ๏ tomcat ๏ django ๏ ...

    Sub-resources
44. 44.

    Rails application 'copycopter' do ... rails do gems ['bundler'] database

    do username node['mysql']['username'] password node['mysql']['password'] database 'copycopter_production' end end end
45. 45.

    Unicorn application 'copycopter' do ... rails do ... end unicorn

    do worker_processes 4 port 8080 end end
46. 46.

    nginx application 'copycopter' do ... rails do ... end unicorn

    do ... end nginx_load_balancer do static_files '/public' => 'public' application_server_role 'copycopter_app_server' end end
47. 47.

    ๏ before_deploy ๏ before_migrate ๏ before_symlink ๏ before_restart ๏ after_restart

    Callbacks
48. 48.

    Run backups application 'copycopter' do ... before_deploy do execute 'run_backups'

    do command 'rsync ....' end end end
49. 49.

    Notify monitoring system application 'copycopter' do ... before_deploy do execute

    'run_backups' do command 'rsync ....' end end after_restart do StatsD.gauge("#{node.name}.deploy") end end
50. 50.

    ๏ Chef allows declaratively describe deploy process ๏ A lot

    of technology stacks are supported via sub-resources ๏ You can precisely control each step of process Recap
51. 51.

    FAQ

52. 52.

    When you should automate your infrastructure?

53. 53.

    Which tool should you use?

54. 54.

    What are benefits of using automation tools?

55. 55.

    Q & A afonov@gmail.com http://iafonov.github.com @iafonov

56. 56.

    Thank You! afonov@gmail.com http://iafonov.github.com @iafonov