Agile Deployments with Puppet

Presentation given at Camp Devops in Chicago ( http://www.campdevops.com )

Transcript

1. Agile Deployments with Puppet Gary Larizza Puppet Labs @glarizza Saturday, October 22, 2011
2. Agile Deployments with Puppet Gary Larizza Puppet Labs @glarizza http://bit.ly/garydevops Saturday, October 22, 2011
3. DevOps • Culture not tools? • Release Management? • http://slidesha.re/itweapon • http://bit.ly/toolsmatter • http://slidesha.re/devopstools Saturday, October 22, 2011
4. Example of ‘poor deployment’ Saturday, October 22, 2011
5. Saturday, October 22, 2011
6. Developer Operations Saturday, October 22, 2011
7. Developer Operations Saturday, October 22, 2011
8. Developer Production Operations Saturday, October 22, 2011
9. Developer Production Staging Operations Saturday, October 22, 2011
10. Developer Production Staging Operations Saturday, October 22, 2011
11. Developer Production Staging Operations Saturday, October 22, 2011
12. Developer Production Staging Operations Saturday, October 22, 2011
13. Developer Production Staging Build Time Operations Day(s) Saturday, October 22, 2011
14. Developer Production Staging QA Build Time Operations Day(s) Saturday, October 22, 2011
15. Developer Production Staging QA Build Time Operations Day(s) Saturday, October 22, 2011
16. Developer Production Staging QA Build Time Operations Day(s) Saturday, October 22, 2011
17. Developer Production Staging QA Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
18. Developer Production Staging QA Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
19. Developer Production Staging QA UK Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
20. Developer Production Staging QA UK Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
21. Developer Production Staging QA UK China Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
22. Developer Production Staging QA UK China Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
23. Developer Production Staging QA UK China Canada Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
24. Developer Production Staging QA UK China Canada Build Time Operations Day(s) Week(s) Saturday, October 22, 2011
25. Developer Production Staging QA UK China Canada Build Time Operations Day(s) Week(s) ??? Saturday, October 22, 2011
26. Rampination http://bit.ly/pconfkeynote Saturday, October 22, 2011
27. Example of ‘Agile’ Saturday, October 22, 2011
28. Saturday, October 22, 2011
29. Developer Operations Saturday, October 22, 2011
30. Developer Production Operations Saturday, October 22, 2011
31. Developer Production Operations Configuration Data Saturday, October 22, 2011
32. Developer Production Operations Configuration Data Saturday, October 22, 2011
33. Developer Production Operations Configuration Data Saturday, October 22, 2011
34. Developer Production Operations Configuration Data Saturday, October 22, 2011
35. Developer Production Staging Operations Configuration Data Saturday, October 22, 2011
36. Developer Production Staging Build Time Operations 10 Minutes Configuration Data Saturday, October 22, 2011
37. Developer Production Staging Build Time Operations 10 Minutes Configuration Data Saturday, October 22, 2011
38. Developer Production Staging Build Time Operations 10 Minutes Configuration Data Saturday, October 22, 2011
39. Developer Production Staging QA Build Time Operations 10 Minutes 1-2 Hours Configuration Data Saturday, October 22, 2011
40. Developer Production Staging QA Build Time Operations 10 Minutes 1-2 Hours Configuration Data Saturday, October 22, 2011
41. Developer Production Staging QA Build Time Operations 10 Minutes 1-2 Hours Configuration Data Saturday, October 22, 2011
42. Developer Production Staging QA Build Time Operations 10 Minutes 1-2 Hours 3 Hours Configuration Data Developer Reach Saturday, October 22, 2011
43. Developer Production Staging QA Build Time Operations 10 Minutes 1-2 Hours 3 Hours Configuration Data Developer Reach Saturday, October 22, 2011
44. What can Ops learn from Dev? • Do developers re-write their code at every step? • Version control • Testing frameworks • Expose ‘settings’ through configuration data Saturday, October 22, 2011
45. Infrastructure as Code with Puppet • Define what needs to be done • Model your ideal state with simple resources • Configured State vs. Running State • Choose your level of commitment Saturday, October 22, 2011
46. Resource Abstraction Layer Saturday, October 22, 2011
47. Resource Abstraction Layer Saturday, October 22, 2011
48. Resource Abstraction Layer Saturday, October 22, 2011
49. Resource Abstraction Layer /usr/bin/yum -y install httpd Saturday, October 22, 2011
50. Saturday, October 22, 2011
51. Bare Machine Provisioning Base Install Configure Assigned Role Maintenance Puppet’s Task Saturday, October 22, 2011
52. Puppet Resources service { 'httpd': ensure => running, enable => true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011
53. Type Puppet Resources service { 'httpd': ensure => running, enable => true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011
54. Type Title Puppet Resources service { 'httpd': ensure => running, enable => true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011
55. Type Title Attributes Puppet Resources service { 'httpd': ensure => running, enable => true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011
56. Facter • Describes aspects of your machine - “facts” • Facts written in Ruby • Nice library of existing facts • Custom facts are easy Saturday, October 22, 2011
57. garys-mbp:$ facter domain => puppetlabs.lan facterversion => 1.5.8 fqdn => garys-mbp.puppetlabs.lan hardwaremodel => x86_64 hostname => garys-mbp kernel => Darwin macosx_buildversion => 10K549 macosx_productname => Mac OS X macosx_productversion => 10.6.8 macosx_productversion_major => 10.6 macosx_productversion_minor => 8 <...> Facter Saturday, October 22, 2011
58. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end computername scutil --get ComputerName Custom Fact Saturday, October 22, 2011
59. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end computername scutil --get ComputerName Custom Fact Saturday, October 22, 2011
60. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end computername scutil --get ComputerName Fact name Custom Fact Saturday, October 22, 2011
61. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end computername scutil --get ComputerName Command to Execute Fact name Custom Fact Saturday, October 22, 2011
62. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end computername scutil --get ComputerName Command to Execute Fact name Custom Fact Saturday, October 22, 2011
63. Custom Fact ENV.each do |key,val| Facter.add("env_#{key}") do setcode do val end end end Saturday, October 22, 2011
64. Separate Data from Logic • Configuration Data adapts to environment • Easy deployment - Puppet modules do not change • Eliminate SSH access for deployment Saturday, October 22, 2011
65. Data Separation Examples Saturday, October 22, 2011
66. Node Inheritance node common { $dnsserver = '8.8.8.8' $searchdomain = 'puppetlabs.vm' } node devops inherits common { $dnsserver = '10.13.1.3' } node 'agent.puppetlabs.vm' inherits devops { file { '/etc/resolv.conf': content => "search ${searchdomain}\n nameserver ${dnsserver}\n", } } Saturday, October 22, 2011
67. Data Class in Module class dns::params { $dnsserver = '8.8.8.8' $searchdomain = 'puppetlabs.vm' } class dns( $dnsserver = $dns::params::dnsserver, $searchdomain = $dns::params::searchdomain ) inherits dns::params { file { '/etc/resolv.conf': content => "search ${searchdomain}\n nameserver ${dnsserver}\n", } } Saturday, October 22, 2011
68. Extlookup dnsserver, 8.8.8.8 searchdomain, puppetlabs.vm dnsserver, 10.13.1.2 common.csv devops.csv $extlookup_datadir = "/etc/puppetlabs/puppet/data" $extlookup_precedence = [$clientcert, $environment, $architecture, 'common'] node 'agent.puppetlabs.vm' { include dns } class dns { $dnsserver = extlookup('dnsserver') $searchdomain = extlookup('searchdomain') } Saturday, October 22, 2011
69. External Node Classifier --- classes: - dns parameters: searchdomain : ‘puppetlabs.vm’ dnsserver : ‘10.13.1.2’ Saturday, October 22, 2011
70. Hiera • Hierarchal data lookup system • Structured data backend • YAML, JSON, and current Puppet state • http://bit.ly/hieradata Saturday, October 22, 2011
71. Saturday, October 22, 2011
72. Global Defaults Saturday, October 22, 2011
73. Global Defaults Environment Saturday, October 22, 2011
74. Global Defaults Environment Role Saturday, October 22, 2011
75. Global Defaults Environment Role Saturday, October 22, 2011
76. Global Defaults Environment Role Saturday, October 22, 2011
77. Global Defaults Environment Role Resultant Data Configuration Saturday, October 22, 2011
78. Saturday, October 22, 2011
79. Global Defaults Saturday, October 22, 2011
80. Global Defaults --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production Saturday, October 22, 2011
81. Global Defaults --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production Saturday, October 22, 2011
82. Global Defaults Environment --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production Saturday, October 22, 2011
83. Global Defaults Environment --- stompserver: stomp-qa.puppetlabs.com puppetserver: puppet-qa.puppetlabs.com environment: qa --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production Saturday, October 22, 2011
84. Global Defaults Environment --- ntpserver: time.puppetlabs.com stompserver: stomp-qa.puppetlabs.com environment: qa puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011
85. Global Defaults Environment Role --- ntpserver: time.puppetlabs.com stompserver: stomp-qa.puppetlabs.com environment: qa puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011
86. Global Defaults Environment Role --- storeconfigs: true --- ntpserver: time.puppetlabs.com stompserver: stomp-qa.puppetlabs.com environment: qa puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011
87. Global Defaults Environment Role --- ntpserver: time.puppetlabs.com stompserver: stomp-qa.puppetlabs.com environment: qa storeconfigs: true puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011
88. DEMO TIME Saturday, October 22, 2011
89. Devops Survey • http://bit.ly/devopssurvey Saturday, October 22, 2011
90. Code is online https://github.com/glarizza/puppet-datademo Saturday, October 22, 2011
91. Gary Larizza • Twitter: @glarizza • Email: gary@puppetlabs.com • Web: http://www.puppetlabs.com Saturday, October 22, 2011