DevOps for the Rubyist Soul at Big Ruby Conf 2013

Transcript

1. DEVOPS FOR THE RUBYIST SOUL John Downey | @jtdowney
2. The authenticity of host 'apollo.local (10.0.2.56)' can't be established. RSA key fingerprint is 04:63:c1:ba:c7:31:04:12:14:ff:b6:c4:32:cf:44:ec. Are you sure you want to continue connecting (yes/no)?
3. John Downey | @jtdowney
5. http://www.flickr.com/photos/nexeus_fatale/3307584243/ Banking Integrations
6. http://www.flickr.com/photos/damiavos/4707651586/ Secure Storage
7. Developer Support
8. http://www.flickr.com/photos/jackol/3291891191/ Highly Available
11. Automated Repeatable Verifiable
13. BRAINTREE PATH TO DEVOPS
15. http://www.flickr.com/photos/binaryape/5975003753/ Agile Process
16. Pairing http://www.flickr.com/photos/damienpollet/5048830734/
18. http://www.flickr.com/photos/us-pacific-command/7072151539/ Guerilla DevOps
19. MY PATH TO DEVOPS
20. I <3 LINUX
22. Blue team!
23. You’re a DevOps engineer, Harry
24. cap qa puppet:noop
25. http://www.flickr.com/photos/sp3ccylad/462995220/ Puppet
26. console $ gem install puppet
27. http://www.flickr.com/photos/fortwainwright/7217500612/ Puppet Master
28. manifests/site.pp node "app01.qa" { package { "ruby": ensure => installed } $blah = "test" file { "/etc/foo/bar.conf": ensure => file, content => template("foo/bar.conf.erb"), owner => "root", group => "root", mode => "0644" } }
29. manifests/site.pp node "app01.qa" { package { "ruby": ensure => installed } $blah = "test" file { "/etc/foo/bar.conf": ensure => file, content => template("foo/bar.conf.erb"), owner => "root", group => "root", mode => "0644" } }
30. manifests/site.pp node "app01.qa" { package { "ruby": ensure => installed } $blah = "test" file { "/etc/foo/bar.conf": ensure => file, content => template("foo/bar.conf.erb"), owner => "root", group => "root", mode => "0644" } }
31. manifests/site.pp node "app01.qa" { package { "ruby": ensure => installed } $blah = "test" file { "/etc/foo/bar.conf": ensure => file, content => template("foo/bar.conf.erb"), owner => "root", group => "root", mode => "0644" } }
32. manifests/site.pp node "app01.qa" { package { "ruby": ensure => installed } $blah = "test" file { "/etc/foo/bar.conf": ensure => file, content => template("foo/bar.conf.erb"), owner => "root", group => "root", mode => "0644" } }
33. manifests/site.pp node "app01.qa" { package { "ruby": ensure => installed } $blah = "test" file { "/etc/foo/bar.conf": ensure => file, content => template("foo/bar.conf.erb"), owner => "root", group => "root", mode => "0644" } }
34. templates/foo/bar.conf.erb [test] blah = <%= blah %> <%- 1.upto(6) do |i| -%> foo<%= i %> = <%= i %> <%- end -%>
35. templates/foo/bar.conf.erb [test] blah = <%= blah %> <%- 1.upto(6) do |i| -%> foo<%= i %> = <%= i %> <%- end -%>
36. manifests/ruby.pp class ruby { package { "ruby": ensure => installed } }
37. manifests/ruby.pp class ruby { package { "ruby": ensure => installed } }
38. manifests/site.pp node "app1.qa" { include ruby $blah = "test" file { "/etc/foo/bar.conf": ensure => file, content => template("foo/bar.conf.erb"), owner => "root", group => "root", mode => "0644" } }
39. http://www.flickr.com/photos/wwarby/4782904694/ Abstraction
40. http://www.flickr.com/photos/chicagobart/3364948220/ Facter
41. console $ gem install facter $ facter architecture => x86_64 domain => local facterversion => 1.6.17 fqdn => apollo.local hardwareisa => i386 hardwaremodel => x86_64 hostname => apollo id => jtdowney is_virtual => false kernel => Darwin ...
42. console $ gem install facter $ facter architecture => x86_64 domain => local facterversion => 1.6.17 fqdn => apollo.local hardwareisa => i386 hardwaremodel => x86_64 hostname => apollo id => jtdowney is_virtual => false kernel => Darwin ...
43. manifests/blah.pp class blah { case $operatingsystem { "Ubuntu": { ... } "CentOS" { ... } } }
44. http://www.flickr.com/photos/evelynishere/2680853104/ Modules
45. my_module ├── files │ └── somefile ├── manifests │ ├── files.pp │ ├── init.pp │ ├── package.pp │ └── service.pp └── templates └── sometemplate.erb
46. my_module ├── files │ └── somefile ├── manifests │ ├── files.pp │ ├── init.pp │ ├── package.pp │ └── service.pp └── templates └── sometemplate.erb
47. my_module ├── files │ └── somefile ├── manifests │ ├── files.pp │ ├── init.pp │ ├── package.pp │ └── service.pp └── templates └── sometemplate.erb
48. my_module ├── files │ └── somefile ├── manifests │ ├── files.pp │ ├── init.pp │ ├── package.pp │ └── service.pp └── templates └── sometemplate.erb
49. my_module ├── files │ └── somefile ├── manifests │ ├── files.pp │ ├── init.pp │ ├── package.pp │ └── service.pp └── templates └── sometemplate.erb
50. my_module ├── files │ └── somefile ├── manifests │ ├── files.pp │ ├── init.pp │ ├── package.pp │ └── service.pp └── templates └── sometemplate.erb
51. Puppetforge
52. http://www.flickr.com/photos/baggis/3576064503/ Hiera
53. data ├── common.yaml ├── domains │ ├── chi.braintreepayments.com │ │ ├── db.yaml │ │ ├── db01.yaml │ │ ├── jenkins.yaml │ │ ├── xen01.yaml │ │ ├── xen02.yaml │ │ ├── xen03.yaml
54. data ├── common.yaml ├── domains │ ├── chi.braintreepayments.com │ │ ├── db.yaml │ │ ├── db01.yaml │ │ ├── jenkins.yaml │ │ ├── xen01.yaml │ │ ├── xen02.yaml │ │ ├── xen03.yaml
55. data ├── common.yaml ├── domains │ ├── chi.braintreepayments.com │ │ ├── db.yaml │ │ ├── db01.yaml │ │ ├── jenkins.yaml │ │ ├── xen01.yaml │ │ ├── xen02.yaml │ │ ├── xen03.yaml
56. data ├── common.yaml ├── domains │ ├── chi.braintreepayments.com │ │ ├── db.yaml │ │ ├── db01.yaml │ │ ├── jenkins.yaml │ │ ├── xen01.yaml │ │ ├── xen02.yaml │ │ ├── xen03.yaml
57. data/domains/chi.braintreepayments.com/xen02.yaml xen::guests: "app06.chi": cpus: 12 memory_mb: 30720 management_vlan_mac: "FF:FF:FF:FF:FF:FF" management_vlan_ip: "%{app06_mgmt_ip}" application_networks: - { vlan: "%{gateway_vlan}", mac: ... distribution: "ubuntu-lucid-amd64-100g" "mailman01.chi": cpus: 2
58. data/domains/prod.braintreegateway.com/xen03.yaml xen::guests: "app06.chi": cpus: 12 memory_mb: 30720 management_vlan_mac: "FF:FF:FF:FF:FF:FF" management_vlan_ip: "%{app06_mgmt_ip}" application_networks: - { vlan: "%{gateway_vlan}", mac: ... distribution: "ubuntu-lucid-amd64-100g" "mailman01.chi": cpus: 2
59. Puppet does not manage truth, puppet maps truth to complexity
60. http://www.flickr.com/photos/baggis/3576064503/ Puppet Model
62. MASTERLESS PUPPET
63. http://www.flickr.com/photos/usairforce/5977871446/ Supply drop
64. pitluga/supply_drop
65. console $ mkdir infrastructure $ cd infrastructure $ gem install supply_drop $ capify . $ vim Capfile
66. console $ mkdir infrastructure $ cd infrastructure $ gem install supply_drop $ capify . $ vim Capfile
67. console $ mkdir infrastructure $ cd infrastructure $ gem install supply_drop $ capify . $ vim Capfile
68. Capfile require "supply_drop" def datacenter_tasks(datacenter, servers) task datacenter do role :server, *servers end servers.each do |server| task server do role :server, server end end end
69. Capfile require "supply_drop" def datacenter_tasks(datacenter, servers) task datacenter do role :server, *servers end servers.each do |server| task server do role :server, server end end end
70. Capfile require "supply_drop" def datacenter_tasks(datacenter, servers) task datacenter do role :server, *servers end servers.each do |server| task server do role :server, server end end end
71. Capfile require "supply_drop" def datacenter_tasks(datacenter, servers) task datacenter do role :server, *servers end servers.each do |server| task server do role :server, server end end end
72. Capfile ... datacenter_tasks :qa, %w[ app01.qa db.qa ] datacenter_tasks :production, %w[ app01.prod db.prod ]
73. puppet.pp node "app01.qa" { package { "ruby": ensure => installed } }
74. puppet.pp node "app01.qa" { package { "ruby": ensure => installed } }
75. console $ cap app01.qa puppet:noop notice: /Stage[main]/Package[ruby]/ensure: current_value absent, should be present (noop) $ cap app01.qa puppet:apply $ cap qa puppet:noop $ git add -Av $ git commit -m “install ruby” $ git push
76. console $ cap app01.qa puppet:noop notice: /Stage[main]/Package[ruby]/ensure: current_value absent, should be present (noop) $ cap app01.qa puppet:apply $ cap qa puppet:noop $ git add -Av $ git commit -m “install ruby” $ git push Always read the diff!!
77. console $ cap app01.qa puppet:noop notice: /Stage[main]/Package[ruby]/ensure: current_value absent, should be present (noop) $ cap app01.qa puppet:apply $ cap qa puppet:noop $ git add -Av $ git commit -m “install ruby” $ git push
78. console $ cap app01.qa puppet:noop notice: /Stage[main]/Package[ruby]/ensure: current_value absent, should be present (noop) $ cap app01.qa puppet:apply $ cap qa puppet:noop $ git add -Av $ git commit -m “install ruby” $ git push
79. console $ cap app01.qa puppet:noop notice: /Stage[main]/Package[ruby]/ensure: current_value absent, should be present (noop) $ cap app01.qa puppet:apply $ cap qa puppet:noop $ git add -Av $ git commit -m “install ruby” $ git push
80. console $ cap db01.qa puppet:noop $ cap app{01..12}.qa puppet:noop $ cap qa puppet:noop $ cap qa invoke COMMAND=”ls”
81. console $ git branch * master # maps to qa production # maps to production staging # maps to staging
82. console $ git checkout staging $ git merge master $ cap staging puppet:noop $ cap staging puppet:apply $ git push
83. console $ git checkout staging $ git merge master $ cap staging puppet:noop $ cap staging puppet:apply $ git push
84. console $ git checkout staging $ git merge master $ cap staging puppet:noop $ cap staging puppet:apply $ git push
85. console $ git checkout staging $ git merge master $ cap staging puppet:noop $ cap staging puppet:apply $ git push
87. http://www.flickr.com/photos/michelleishere/4226094476/
88. Production Staging QA
89. Production Staging QA
91. LESSONS LEARNED • Stick to the puppet style guide • Use modules • Turn on puppet backup file bucket • Merge regularly
92. PUPPET STYLE GUIDE • http://docs.puppetlabs.com/guides/style_guide.html • Idiomatic puppet
93. USE MODULES • Composeable • Generic components • apache, elasticsearch, postgresql, etc • Check puppetforge first • Unique services • What makes your business run
94. PUPPET BACKUP • Keep every file version • Great if you screw up • Sucks for large files • Turn off per-file
95. MERGE REGULARLY • Same reason we deploy often • Don’t let changes linger
97. console $ gem install vagrant
98. console $ vagrant init precise64 $ vagrant up $ vagrant ssh
99. Vagrantfile Vagrant::Config.run do |config| config.vm.box = "precise64" config.vm.define :web do |web_config| web_config.vm.box = "web" web_config.vm.forward_port 80, 8080 end config.vm.define :db do |db_config| db_config.vm.box = "db" db_config.vm.forward_port 5432, 5432 end end
100. Vagrantfile Vagrant::Config.run do |config| config.vm.box = "precise64" config.vm.define :web do |web_config| web_config.vm.box = "web" web_config.vm.forward_port 80, 8080 end config.vm.define :db do |db_config| db_config.vm.box = "db" db_config.vm.forward_port 5432, 5432 end end
101. Vagrantfile Vagrant::Config.run do |config| config.vm.box = "precise64" config.vm.define :web do |web_config| web_config.vm.box = "web" web_config.vm.forward_port 80, 8080 end config.vm.define :db do |db_config| db_config.vm.box = "db" db_config.vm.forward_port 5432, 5432 end end
102. Vagrantfile config.vm.provision :puppet do |puppet| puppet.manifests_path = "manifests" puppet.manifest_file = "puppet.pp" end
103. http://www.flickr.com/photos/nickames/5307403412/ Rapid prototyping
104. http://www.flickr.com/photos/jrhode/4632887921/ Dev box
105. DEVOPS HUMOR
106. DEVOPS REACTIONS How STONITH works http://devopsreactions.tumblr.com
107. DEVOPS REACTIONS How STONITH works http://devopsreactions.tumblr.com
108. @DEVOPS_BORAT
109. John Downey | @jtdowney