Building Data-Driven Infrastructure with Puppet

The road to Data Driven Infrastructure is a hard and long one, but a worthwhile endeavor in the lifecycle of Information Technology and Business Enablement. This talk is a snapshot of the voyage of one man's quest to have computers absolutely and completely take over his job, the patterns that have been uncovered, and the things we as an industry need to keep pushing on.

This talk can be viewed online at https://www.youtube.com/watch?v=vEpXJRPITN0&list=PLV86BgbREluU02Ytlz80seDSKAbkx5pRg

Transcript

1. Friday, August 23, 13
2. Data Driven Infrastructure Friday, August 23, 13
3. Friday, August 23, 13
4. ? Friday, August 23, 13
5. ? http://git.io/UmUdKA Friday, August 23, 13
6. Let me Tell you a story Friday, August 23, 13
7. What is a Cloud Friday, August 23, 13
8. I don’t have to think about IT With the Cloud... Friday, August 23, 13
9. Friday, August 23, 13
10. aaS Platform Software Infrastructure Friday, August 23, 13
11. Friday, August 23, 13
12. Friday, August 23, 13
13. Where is our cloud? Friday, August 23, 13
14. Friday, August 23, 13
15. Utopia Friday, August 23, 13
16. James Fryman Friday, August 23, 13
17. Friday, August 23, 13
18. Automations Junkie Friday, August 23, 13
19. Are you Crazy? Friday, August 23, 13
20. Goals? Data? What Friday, August 23, 13
21. Goals? Data? What Friday, August 23, 13
22. Goals? Data? What Friday, August 23, 13
23. Machine Parsable Friday, August 23, 13
24. There is System One Friday, August 23, 13
25. Feedback PuppetDB Provisioning Configuring Destroying gPanel Friday, August 23, 13
26. Parts of the System Friday, August 23, 13
27. provisioner Friday, August 23, 13
28. Home Grown Friday, August 23, 13
29. Home Grown Friday, August 23, 13
30. controller Friday, August 23, 13
31. Lots O’ Models Friday, August 23, 13
32. file { '/etc/facter/facts.d/quagga_manage_service': ensure => present, replace => false, } if $::quagga_manage_service { $service_state[ensure] = running $service_state[enable] = true } else { $service_state[ensure] = undef $service_state[enable] = undef } service { 'quagga': ensure => $service_state[ensure], enable => $service_state[enable], } Friday, August 23, 13
33. orchestrator Friday, August 23, 13
34. Chat Ops Friday, August 23, 13
35. Chat Ops Friday, August 23, 13
36. Feedback of the System Friday, August 23, 13
37. Metrics& Monitoring Friday, August 23, 13
38. begin JSON.parse(RestClient.get(url)).each do |cache| data["#{cache['target']}"] = 0 count = 0 cache["datapoints"].each do |point| unless (point[0].nil?) data["#{cache['target']}"] += point[0] count += 1 end end data["#{cache['target']}"] /= count data["total"] += data["#{cache['target']}"] end rescue ZeroDivisionError => e puts "UNKNOWN metric not in graphite!" exit EXIT_UNKNOWN rescue => e puts e.message exit EXIT_CRITICAL end Friday, August 23, 13
39. begin JSON.parse(RestClient.get(url)).each do |cache| data["#{cache['target']}"] = 0 count = 0 cache["datapoints"].each do |point| unless (point[0].nil?) data["#{cache['target']}"] += point[0] count += 1 end end data["#{cache['target']}"] /= count data["total"] += data["#{cache['target']}"] end rescue ZeroDivisionError => e puts "UNKNOWN metric not in graphite!" exit EXIT_UNKNOWN rescue => e puts e.message exit EXIT_CRITICAL end Friday, August 23, 13
40. event Friday, August 23, 13
41. event log Friday, August 23, 13
42. event alert log Friday, August 23, 13
43. event alert log error Friday, August 23, 13
44. Must self-correct Friday, August 23, 13
45. Feedback PuppetDB Provisioning Configuring Destroying gPanel Friday, August 23, 13
46. Friday, August 23, 13
47. Deployable using text files Friday, August 23, 13
48. Modularity Friday, August 23, 13
49. haproxy::proxy { $es_proxy_name: proxy => 'listen', mode => 'http', ip => $::ipaddress_lo, port => '9200', config => { balance => 'roundrobin', }, } Friday, August 23, 13
50. haproxy::proxy { $es_proxy_name: proxy => 'listen', mode => 'http', ip => $::ipaddress_lo, port => '9200', config => { balance => 'roundrobin', }, } Friday, August 23, 13
51. haproxy::proxy::member { $es_proxy_name: hostname => $::ec2_local_ipv4, port => '9200', param => [ 'weight 1', 'maxconn 1000', 'check', ], } Friday, August 23, 13
52. collectd::plugin { [ 'cpu', 'load', 'memory', 'swap', 'irq', 'exec', 'entropy', ]: } collectd::plugin { [ 'df', 'interface', 'protocols', 'disk', ]: config => true } Friday, August 23, 13
53. Level 4: Templates Level 5: Data Driven Friday, August 23, 13
54. Self Authoritative Friday, August 23, 13
55. def self.collect_resources(resource) query = [ "and", ["=", "type", "File"], ["=", "exported", true], ["=", "tag", "nagios::object::#{resource}"], ["=", ["node", "active"], true] ] self.search('/v2/resources', query.to_json) end Friday, August 23, 13
56. def self.collect_resources(resource) query = [ "and", ["=", "type", "File"], ["=", "exported", true], ["=", "tag", "nagios::object::#{resource}"], ["=", ["node", "active"], true] ] self.search('/v2/resources', query.to_json) end Friday, August 23, 13
57. # Seed the initial file with false, and enable # on next run with gh-nagios enable_pager <hostname> file { '/etc/facter/facts.d/enable_pager.txt': ensure => file, owner => 'root', group => 'root', mode => '0644', content => 'enable_pager=false', replace => false, } Friday, August 23, 13
58. @@file { "/etc/nagios/objects/${type}.d/${filename}.cfg": content => template('nagios/etc/nagios/object.erb'), mode => '0444', group => 'nagios', notify => Service['nagios'], } Friday, August 23, 13
59. Tips Friday, August 23, 13
60. Refactoring Friday, August 23, 13
61. Refactoring Friday, August 23, 13
62. least to most specific Friday, August 23, 13
63. frymanet.com mysql nginx rails ruby common admin package repos Friday, August 23, 13
64. graduate to params Friday, August 23, 13
65. class ntp::params { $defaults = { package => { version => ‘latest’, }, config => { servers => [‘pool.ntp.org’], }, } } Friday, August 23, 13
66. externalize Friday, August 23, 13
67. class ntp::params { $defaults = { package => { version => hiera(‘ntp_package_version’), }, config => { servers => hiera(‘ntp_servers’), }, } } Friday, August 23, 13
68. CloudFormation Friday, August 23, 13
69. CloudFormation Friday, August 23, 13
70. "Resources": { "RendererServerGroup": { "Type": "AWS::AutoScaling::AutoScalingGroup", "Properties": { "AvailabilityZones": { "Fn::GetAZs": "" }, "LaunchConfigurationName": { "Ref": "LaunchConfig" }, "MinSize": "2", "MaxSize": "16", "Tags": [ { "Key": "Environment", "Value": "Production", "PropagateAtLaunch": "true" }, { "Key": "Role", "Value": "renderer", "PropagateAtLaunch": "true" } ] } }, Friday, August 23, 13
71. Autoloading Friday, August 23, 13
72. # autoloader.pp class nagios::autoload_helpers { $helpers = get_nagios_helpers() case $::puppetversion { /^3/: { include $helpers } default: { nagios::autoload_helpers::import_shim { $helpers: } } } } Friday, August 23, 13
73. # autoloader.pp class nagios::autoload_helpers { $helpers = get_nagios_helpers() case $::puppetversion { /^3/: { include $helpers } default: { nagios::autoload_helpers::import_shim { $helpers: } } } } Friday, August 23, 13
74. module Puppet::Parser::Functions newfunction(:get_nagios_helpers, :type => :rvalue, :doc => "Grab all modules that have nagios helpers for import") do module_path = File.expand_path('..', Puppet::Module.find('nagios',compiler.environment.to_s).path) helpers = Dir["#{module_path}/**/nagios/helpers.pp"].map do |d| "#{d.split('/')[-4]}::nagios::helpers" done helpers end end Friday, August 23, 13
75. Modeling Friday, August 23, 13
76. Be Dynamic Friday, August 23, 13
77. Be Dynamic Friday, August 23, 13
78. <%- if @comment -%> ### <%= @comment %> <%- end -%> <%= @type %> <% if @label %><%= @label %><% end %> { <%- @config.sort.reverse.each do | key,value| -%> <%- if value.class == Array -%> <%- value.each do |element| - %> <%= key %>(<%= element %>); <%- end -%> <%- else -%> <%= key %>(<%= value %>); <%- end -%> <%- end -%> }; Friday, August 23, 13
79. Fencing Resources Friday, August 23, 13
80. # Seed the initial file with false, and enable # on next run with gh-nagios enable_pager <hostname> file { '/etc/facter/facts.d/enable_pager.txt': ensure => file, owner => 'root', group => 'root', mode => '0644', content => 'enable_pager=false', replace => false, } Friday, August 23, 13
81. if $::enable_pager { @@file { "/etc/nagios/objects/${type}.d/${filename}.cfg": content => template('nagios/etc/nagios/object.erb'), mode => '0444', group => 'nagios', notify => Service['nagios'], } } Friday, August 23, 13
82. Buy it? Friday, August 23, 13
83. Buy it? Friday, August 23, 13
84. It’s About Friday, August 23, 13
85. Missing? What’s Friday, August 23, 13
86. Language Friday, August 23, 13
87. Predictive Analysis Friday, August 23, 13
88. Coming Home Friday, August 23, 13
89. Goals? Data? What Friday, August 23, 13
90. Systems Thinking Recap Friday, August 23, 13
91. There is System One Machine Parsable Must be a Known Quantity Self Authoritative Must self-correct Friday, August 23, 13
92. Friday, August 23, 13
93. jfryman fryman@github.com Friday, August 23, 13
94. jfryman fryman@github.com Friday, August 23, 13
95. what’s next? Friday, August 23, 13
96. what’s next? Friday, August 23, 13