DevOps and Chef

DevOps as a buzzword has had a lot of attention recently. This presentation is my take on the origins and essence of the matter, as well as an introduction to how Chef, the open source configuration management software, can help to solve one of the problems an Operations team faces as it moves towards the DevOps goals.

Transcript

1. DevOps Chef & Friday 16 March 12
2. DevOps Friday 16 March 12
3. Devs Ops vs Friday 16 March 12
4. Devs Ops vs Friday 16 March 12
5. Devs Ops vs The Wall Of Confusion Friday 16 March 12
6. Change Stability vs Friday 16 March 12
7. A Meeting of Minds Follow code into the wild Accept change: become agile Friday 16 March 12
8. Buzzword: DevOps Friday 16 March 12
9. Buzzword Buzzword: DevOps Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Friday 16 March 12
10. Buzzword Buzzword: DevOps Buzzword Buzzword Buzz Lightyear Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Friday 16 March 12
11. Buzzword Buzzword: DevOps Buzzword Buzzword Buzz Lightyear Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzzword Buzz Aldrin Friday 16 March 12
12. What is DevOps? Friday 16 March 12
13. What is DevOps? What is DevOps NOT? Friday 16 March 12
14. What is DevOps? What is DevOps NOT? They are making a play for our jobs Friday 16 March 12
15. What is DevOps? What is DevOps NOT? They are making a play for our jobs Devs want root Friday 16 March 12
16. What is DevOps? What is DevOps NOT? DevOps is not a job title, it’s a philosophy They are making a play for our jobs Devs want root Friday 16 March 12
17. What is DevOps? What is DevOps NOT? DevOps is not a job title, it’s a philosophy They are making a play for our jobs Devs want root So many words Friday 16 March 12
18. DevOps, for me Friday 16 March 12
19. DevOps, for me: Testing Friday 16 March 12
20. DevOps, for me: Testing Monitoring Friday 16 March 12
21. DevOps, for me: Testing Automation Monitoring Friday 16 March 12
22. DevOps, for me: Testing Automation Monitoring Friday 16 March 12
23. DevOps, for me: Testing Automation Monitoring Don’t release broken things Know when things break Replace/fix broken things instantly Friday 16 March 12
24. ✔ ? Friday 16 March 12
25. SCCS: Source Code Control System Friday 16 March 12
26. SCCS: Source Code Control System 1972 40 Years Ago! Friday 16 March 12
27. Revision Control ✔ Friday 16 March 12
28. Revision Control Test Driven Development ✔ Friday 16 March 12
29. Revision Control Test Driven Development Feature Branches ✔ Friday 16 March 12
30. Revision Control Test Driven Development Continuous Integration Feature Branches ✔ Friday 16 March 12
31. Revision Control Test Driven Development Continuous Integration Feature Branches Staging Environments ✔ Friday 16 March 12
32. Revision Control Test Driven Development Continuous Integration Feature Branches Staging Environments AGILE ✔ Friday 16 March 12
33. AGILE Friday 16 March 12
34. AGILE OPS ? Friday 16 March 12
35. AGILE OPS Continuous Deployment Feature Flags Dark Launches Automated Recovery IMVU - 50+ Etsy - 25 Flickr - 10+ ? Friday 16 March 12
36. Instant Feedback Rollbacks Confidence No fear of change Friday 16 March 12
37. Code Infrastructure Friday 16 March 12
38. Code Infrastructure Friday 16 March 12
39. Code Infrastructure As Friday 16 March 12
40. $  ssh  root@web1 Last  login:  Tue  Mar  13 #  apt-­‐get  install  apache2 ... #  vim  /etc/apache2/sites-­‐enabled/default.conf ... #  /etc/init.d/apache2  restart ... #  scp  web2:/root/.ssh/authorized_keys  ~/.ssh Friday 16 March 12
41. Chef Friday 16 March 12
42. chef-client on node retrieves configuration from server use knife to push config to server use knife to query and ssh to clients SERVER CLIENT (workstation) CLIENT (server/node) Friday 16 March 12
43. Chef/nodes/web1.json Friday 16 March 12
44. { "access" : [ "developers", "designers" ], "name": "web1", "run_list": [ "role[base]", "role[web]", "recipe[splunk]" ] } Friday 16 March 12
45. { "access" : [ "developers", "designers" ], "name": "web1", "run_list": [ "role[base]", "role[web]", "recipe[splunk]" ] } Friday 16 March 12
46. Chef/nodes/web1.json Chef/roles/web.rb Friday 16 March 12
47. run_list("recipe[apache]", "role[monitoring]") Friday 16 March 12
48. run_list("recipe[apache]", "role[monitoring]") Friday 16 March 12
49. Chef/nodes/web1.json Chef/roles/web.rb Chef/cookbooks/apache/ recipes/default.rb Friday 16 March 12
50. package "apache2" do action :install end Friday 16 March 12
51. apache_modules = ['wsgi', 'ssl', 'auth_tkt', 'proxy_http', 'headers', 'rewrite', 'status'] apache_modules.each do |mod| apache_module mod do enable true notifies :restart, "service[apache2]" end end Friday 16 March 12
52. apache_modules = ['wsgi', 'ssl', 'auth_tkt', 'proxy_http', 'headers', 'rewrite', 'status'] apache_modules.each do |mod| apache_module mod do enable true notifies :restart, "service[apache2]" end end Friday 16 March 12
53. package "apache2" do case node[:platform] when "centos","redhat","fedora","suse" package_name "httpd" when "debian","ubuntu" package_name "apache2-mpm-prefork" end action :install end Friday 16 March 12
54. package "apache2" do case node[:platform] when "centos","redhat","fedora","suse" package_name "httpd" when "debian","ubuntu" package_name "apache2-mpm-prefork" end action :install end Friday 16 March 12
55. Chef/nodes/web1.json Chef/roles/web.rb Chef/cookbooks/apache/ recipes/default.rb attributes/default.rb Friday 16 March 12
56. default[:apache][:version] = "2.2" Friday 16 March 12
57. package "apache2" do action :install version "#{node[:apache][:version]}" end Friday 16 March 12
58. Chef/nodes/web1.json Chef/roles/web.rb Chef/cookbooks/apache/ recipes/default.rb attributes/default.rb templates/default/apache2.conf.erb Friday 16 March 12
59. template "#{node[:apache][:dir]}/apache2.conf" do source "apache2.conf.erb" owner "root" mode 0644 notifies :restart, resources(:service => "apache2") end Friday 16 March 12
60. It’s all Ruby Friday 16 March 12
61. It’s all Ruby http://wiki.opscode.com/display/chef/Just+Enough+Ruby+for+Chef “Just Enough Ruby for Chef” Friday 16 March 12
62. It’s all Ruby Let’s hack Friday 16 March 12
63. Chef/nodes/web1.json Chef/roles/web.rb Chef/cookbooks/apache/ recipes/default.rb attributes/default.rb templates/default/apache2.conf.erb libraries/default.rb Friday 16 March 12
64. class Chef class Recipe def apache_ports(&block) @node[:apache][:vhosts].each do |vh| vh[:ports].each do |p| block.call(p) end end end end end Friday 16 March 12
65. apache_ports do |p| firewall_port p do action :open end end Friday 16 March 12
66. apache_ports do |p| firewall_port p do action :open end end Friday 16 March 12
67. define :firewall_port, :action => :open do if not params.has_key?(:port) params[:port] = params[:name] end if params[:action] == :open execute "open #{params[:port]}" do command "iptables -A INPUT --destination-port #{params[:port]} -j ACCEPT" end else execute "close #{params[:port]}" do command "iptables -A INPUT --destination-port #{params[:port]} -j DROP" end end end Friday 16 March 12
68. Providers package "apache2" do action :install end node[:platform] apt-get install brew install yum install Friday 16 March 12
69. "#{File.expand_path( Chef::Config[:file_cache_path] )}/handlers/yola.rb" Friday 16 March 12
70. "#{File.expand_path( Chef::Config[:file_cache_path] )}/handlers/yola.rb" class YolaHandler < Chef::Handler def report() run_status.updated_resources.each do |r| campfire_speak(r.to_s) end end end Friday 16 March 12
71. "#{File.expand_path( Chef::Config[:file_cache_path] )}/handlers/yola.rb" class YolaHandler < Chef::Handler def report() run_status.updated_resources.each do |r| campfire_speak(r.to_s) end end end Friday 16 March 12
72. Chef/nodes/web1.json Chef/roles/web.rb Chef/cookbooks/apache/ recipes/default.rb attributes/default.rb templates/default/apache2.conf.erb libraries/default.rb Chef/environments/production.rb Friday 16 March 12
73. Chef/nodes/web1.json Chef/roles/web.rb Chef/cookbooks/apache/ recipes/default.rb attributes/default.rb templates/default/apache2.conf.erb libraries/default.rb Chef/environments/production.rb Chef/environments/testing.rb Friday 16 March 12
74. default_attributes({ "aws_region" => "usa-east" }) default_attributes({ "aws_region" => "usa-east", "logging" => { "debug" => true } }) Friday 16 March 12
75. Chef/nodes/web1.json Chef/roles/web.rb Chef/cookbooks/apache/ recipes/default.rb attributes/default.rb templates/default/apache2.conf.erb libraries/default.rb Chef/environments/production.rb Chef/environments/testing.rb Chef/data_bags/employees/jonathan.json Friday 16 March 12
76. { "name": "Jonathan Hitchcock", "id": "jonathan", "groups": ["developers", "operations"], "ssh_keys": [ { "key": "AAAB3NzC1yc2EAAAABIwAAAQEA3advEyDE0aEo==" } ] } Friday 16 March 12
77. Provisioning Friday 16 March 12
78. Provisioning $ knife ec2 server create -r 'role[webserver]' -I ami-7000f019 -f m1.small Friday 16 March 12
79. Provisioning $ knife ec2 server create -r 'role[webserver]' -I ami-7000f019 -f m1.small Amazon EC2 Rackspace Cloud Openstack Eucalyptus Kickstart libvirt XEN KVM Vagrant Friday 16 March 12
80. Integration configuration data vs configuration logic Friday 16 March 12
81. Integration configuration data vs configuration logic Friday 16 March 12
82. Integration vs configuration logic Ohai Collects infrastructure data Stored and indexed in NoSQL Search and use configuration data Friday 16 March 12
83. Attributes default normal override automatic (A side note on) Friday 16 March 12
84. Attributes default normal override automatic cookbooks, data bags node definitions for special cases ohai (A side note on) Friday 16 March 12
85. Integration search(:node, 'role:webbackend') do |wb| haproxy_backend "#{wb[:apache][:port]}" do action :create end end Systems auto-discover each other Configuration is responsive to changes (Back to) Friday 16 March 12
86. Integration search(:node, 'role:webbackend') do |wb| haproxy_backend "#{wb[:apache][:port]}" do action :create end end Systems auto-discover each other Configuration is responsive to changes So you don’t have to be! Friday 16 March 12
87. Jonathan Hitchcock @vhata github.com/vhata Friday 16 March 12