Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Agile Deployments with Puppet

Avatar for glarizza glarizza
October 22, 2011
Technology
830
3

Agile Deployments with Puppet

Presentation given at Camp Devops in Chicago ( http://www.campdevops.com )

Avatar for glarizza

glarizza

October 22, 2011

Other Decks in Technology

See All in Technology
JEP 522 Deep Dive - G1 GC同期コスト削減によるスループット向上を徹底検証&解説
Avatar for Daishi Tabata tabatad
1
570
形式手法特論：公平性制約の位相的特徴づけ #kernelvm / Kernel VM Study Kansai 12th
Avatar for y_taka_23 ytaka23
1
670
AI フレンドリーなエラー監視を TypeScript で実現する
Avatar for Shinobu Hayashi shinyaigeek
2
200
コードレビューを制するチームがソフトウェアデリバリーのフローを制す / Beyond Code Review: Distributing Its Responsibilities Across the SDLC
Avatar for mtx2s mtx2s
3
580
大規模災害時でも高い信頼性を維持するアプリケーション基盤の実現/nikkei-tech-talk46
Avatar for 日本経済新聞社 エンジニア採用事務局 nikkei_engineer_recruiting
0
130
ポスター発表&デモと総括 / Poster Presentations & Demonstrations and Summary
Avatar for Kenji Saito ks91
PRO
0
180
Ruby::Boxでできること、Refinementsでできること
Avatar for Tomohiro Hashidate joker1007
3
350
Gradle×GitHub_ActionsでCI時間を約50%短縮 ジョブ分割の設計と落とし穴 / Cutting CI Time by ~50% with Gradle and GitHub Actions: Job-Splitting Design and Pitfalls
Avatar for 冨澤宝斗 takatty
0
580
Oracle AI Database@Azure：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
6
1.8k
Databricks における 生成AIガバナンスの実践
Avatar for Takaaki Yayoi taka_aki
1
130
Java正規表現エンジン（NFA）の仕組みと パフォーマンスを維持するための最適化手法
Avatar for 竹内 雅和 takeuchi_132917
0
170
Chart.js が簡単に使えるようになっていたので OGP 画像生成に使った話
Avatar for すずとも kamekyame
0
110

Featured

See All Featured
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
200
Digital Ethics as a Driver of Design Innovation
Avatar for Per Axbom axbom
PRO
1
300
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
380
Money Talks: Using Revenue to Get Sh*t Done
Avatar for Nikki Halliwell nikkihalliwell
0
240
Discover your Explorer Soul
Avatar for Emna emna__ayadi
2
1.1k
Designing for Timeless Needs
Avatar for Cassini Nazir cassininazir
1
240
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
390
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
2
370
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
1
13k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
23k
Public Speaking Without Barfing On Your Shoes - THAT 2023
Avatar for David Neal reverentgeek
1
410
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.5k

Transcript

  1. Agile Deployments with Puppet Gary Larizza Puppet Labs @glarizza Saturday,

    October 22, 2011

  2. Agile Deployments with Puppet Gary Larizza Puppet Labs @glarizza http://bit.ly/garydevops

    Saturday, October 22, 2011

  3. DevOps • Culture not tools? • Release Management? • http://slidesha.re/itweapon

    • http://bit.ly/toolsmatter • http://slidesha.re/devopstools Saturday, October 22, 2011

  4. Example of ‘poor deployment’ Saturday, October 22, 2011

  5. Saturday, October 22, 2011

  6. Developer Operations Saturday, October 22, 2011

  7. Developer Operations Saturday, October 22, 2011

  8. Developer Production Operations Saturday, October 22, 2011

  9. Developer Production Staging Operations Saturday, October 22, 2011

  10. Developer Production Staging Operations Saturday, October 22, 2011

  11. Developer Production Staging Operations Saturday, October 22, 2011

  12. Developer Production Staging Operations Saturday, October 22, 2011

  13. Developer Production Staging Build Time Operations Day(s) Saturday, October 22,

    2011

  14. Developer Production Staging QA Build Time Operations Day(s) Saturday, October

    22, 2011

  15. Developer Production Staging QA Build Time Operations Day(s) Saturday, October

    22, 2011

  16. Developer Production Staging QA Build Time Operations Day(s) Saturday, October

    22, 2011

  17. Developer Production Staging QA Build Time Operations Day(s) Week(s) Saturday,

    October 22, 2011

  18. Developer Production Staging QA Build Time Operations Day(s) Week(s) Saturday,

    October 22, 2011

  19. Developer Production Staging QA UK Build Time Operations Day(s) Week(s)

    Saturday, October 22, 2011

  20. Developer Production Staging QA UK Build Time Operations Day(s) Week(s)

    Saturday, October 22, 2011

  21. Developer Production Staging QA UK China Build Time Operations Day(s)

    Week(s) Saturday, October 22, 2011

  22. Developer Production Staging QA UK China Build Time Operations Day(s)

    Week(s) Saturday, October 22, 2011

  23. Developer Production Staging QA UK China Canada Build Time Operations

    Day(s) Week(s) Saturday, October 22, 2011

  24. Developer Production Staging QA UK China Canada Build Time Operations

    Day(s) Week(s) Saturday, October 22, 2011

  25. Developer Production Staging QA UK China Canada Build Time Operations

    Day(s) Week(s) ??? Saturday, October 22, 2011

  26. Rampination http://bit.ly/pconfkeynote Saturday, October 22, 2011

  27. Example of ‘Agile’ Saturday, October 22, 2011

  28. Saturday, October 22, 2011

  29. Developer Operations Saturday, October 22, 2011

  30. Developer Production Operations Saturday, October 22, 2011

  31. Developer Production Operations Configuration Data Saturday, October 22, 2011

  32. Developer Production Operations Configuration Data Saturday, October 22, 2011

  33. Developer Production Operations Configuration Data Saturday, October 22, 2011

  34. Developer Production Operations Configuration Data Saturday, October 22, 2011

  35. Developer Production Staging Operations Configuration Data Saturday, October 22, 2011

  36. Developer Production Staging Build Time Operations 10 Minutes Configuration Data

    Saturday, October 22, 2011

  37. Developer Production Staging Build Time Operations 10 Minutes Configuration Data

    Saturday, October 22, 2011

  38. Developer Production Staging Build Time Operations 10 Minutes Configuration Data

    Saturday, October 22, 2011

  39. Developer Production Staging QA Build Time Operations 10 Minutes 1-2

    Hours Configuration Data Saturday, October 22, 2011

  40. Developer Production Staging QA Build Time Operations 10 Minutes 1-2

    Hours Configuration Data Saturday, October 22, 2011

  41. Developer Production Staging QA Build Time Operations 10 Minutes 1-2

    Hours Configuration Data Saturday, October 22, 2011

  42. Developer Production Staging QA Build Time Operations 10 Minutes 1-2

    Hours 3 Hours Configuration Data Developer Reach Saturday, October 22, 2011

  43. Developer Production Staging QA Build Time Operations 10 Minutes 1-2

    Hours 3 Hours Configuration Data Developer Reach Saturday, October 22, 2011

  44. What can Ops learn from Dev? • Do developers re-write

    their code at every step? • Version control • Testing frameworks • Expose ‘settings’ through configuration data Saturday, October 22, 2011

  45. Infrastructure as Code with Puppet • Define what needs to

    be done • Model your ideal state with simple resources • Configured State vs. Running State • Choose your level of commitment Saturday, October 22, 2011

  46. Resource Abstraction Layer Saturday, October 22, 2011

  47. Resource Abstraction Layer Saturday, October 22, 2011

  48. Resource Abstraction Layer Saturday, October 22, 2011

  49. Resource Abstraction Layer /usr/bin/yum -y install httpd Saturday, October 22,

    2011

  50. Saturday, October 22, 2011

  51. Bare Machine Provisioning Base Install Configure Assigned Role Maintenance Puppet’s

    Task Saturday, October 22, 2011

  52. Puppet Resources service { 'httpd': ensure => running, enable =>

    true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011

  53. Type Puppet Resources service { 'httpd': ensure => running, enable

    => true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011

  54. Type Title Puppet Resources service { 'httpd': ensure => running,

    enable => true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011

  55. Type Title Attributes Puppet Resources service { 'httpd': ensure =>

    running, enable => true, hasstatus => true, hasrestart => true, } Saturday, October 22, 2011

  56. Facter • Describes aspects of your machine - “facts” •

    Facts written in Ruby • Nice library of existing facts • Custom facts are easy Saturday, October 22, 2011

  57. garys-mbp:$ facter domain => puppetlabs.lan facterversion => 1.5.8 fqdn =>

    garys-mbp.puppetlabs.lan hardwaremodel => x86_64 hostname => garys-mbp kernel => Darwin macosx_buildversion => 10K549 macosx_productname => Mac OS X macosx_productversion => 10.6.8 macosx_productversion_major => 10.6 macosx_productversion_minor => 8 <...> Facter Saturday, October 22, 2011

  58. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end

    computername scutil --get ComputerName Custom Fact Saturday, October 22, 2011

  59. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end

    computername scutil --get ComputerName Custom Fact Saturday, October 22, 2011

  60. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end

    computername scutil --get ComputerName Fact name Custom Fact Saturday, October 22, 2011

  61. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end

    computername scutil --get ComputerName Command to Execute Fact name Custom Fact Saturday, October 22, 2011

  62. Facter.add("computername") do confine :kernel => :darwin setcode('scutil --get ComputerName'.chomp) end

    computername scutil --get ComputerName Command to Execute Fact name Custom Fact Saturday, October 22, 2011

  63. Custom Fact ENV.each do |key,val| Facter.add("env_#{key}") do setcode do val

    end end end Saturday, October 22, 2011

  64. Separate Data from Logic • Configuration Data adapts to environment

    • Easy deployment - Puppet modules do not change • Eliminate SSH access for deployment Saturday, October 22, 2011

  65. Data Separation Examples Saturday, October 22, 2011

  66. Node Inheritance node common { $dnsserver = '8.8.8.8' $searchdomain =

    'puppetlabs.vm' } node devops inherits common { $dnsserver = '10.13.1.3' } node 'agent.puppetlabs.vm' inherits devops { file { '/etc/resolv.conf': content => "search ${searchdomain}\n nameserver ${dnsserver}\n", } } Saturday, October 22, 2011

  67. Data Class in Module class dns::params { $dnsserver = '8.8.8.8'

    $searchdomain = 'puppetlabs.vm' } class dns( $dnsserver = $dns::params::dnsserver, $searchdomain = $dns::params::searchdomain ) inherits dns::params { file { '/etc/resolv.conf': content => "search ${searchdomain}\n nameserver ${dnsserver}\n", } } Saturday, October 22, 2011

  68. Extlookup dnsserver, 8.8.8.8 searchdomain, puppetlabs.vm dnsserver, 10.13.1.2 common.csv devops.csv $extlookup_datadir

    = "/etc/puppetlabs/puppet/data" $extlookup_precedence = [$clientcert, $environment, $architecture, 'common'] node 'agent.puppetlabs.vm' { include dns } class dns { $dnsserver = extlookup('dnsserver') $searchdomain = extlookup('searchdomain') } Saturday, October 22, 2011

  69. External Node Classifier --- classes: - dns parameters: searchdomain :

    ‘puppetlabs.vm’ dnsserver : ‘10.13.1.2’ Saturday, October 22, 2011

  70. Hiera • Hierarchal data lookup system • Structured data backend

    • YAML, JSON, and current Puppet state • http://bit.ly/hieradata Saturday, October 22, 2011

  71. Saturday, October 22, 2011

  72. Global Defaults Saturday, October 22, 2011

  73. Global Defaults Environment Saturday, October 22, 2011

  74. Global Defaults Environment Role Saturday, October 22, 2011

  75. Global Defaults Environment Role Saturday, October 22, 2011

  76. Global Defaults Environment Role Saturday, October 22, 2011

  77. Global Defaults Environment Role Resultant Data Configuration Saturday, October 22,

    2011

  78. Saturday, October 22, 2011

  79. Global Defaults Saturday, October 22, 2011

  80. Global Defaults --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production Saturday,

    October 22, 2011

  81. Global Defaults --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production Saturday,

    October 22, 2011

  82. Global Defaults Environment --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production

    Saturday, October 22, 2011

  83. Global Defaults Environment --- stompserver: stomp-qa.puppetlabs.com puppetserver: puppet-qa.puppetlabs.com environment: qa

    --- ntpserver: time.puppetlabs.com puppetserver: puppet.puppetlabs.com environment: production Saturday, October 22, 2011

  84. Global Defaults Environment --- ntpserver: time.puppetlabs.com stompserver: stomp-qa.puppetlabs.com environment: qa

    puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011

  85. Global Defaults Environment Role --- ntpserver: time.puppetlabs.com stompserver: stomp-qa.puppetlabs.com environment:

    qa puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011

  86. Global Defaults Environment Role --- storeconfigs: true --- ntpserver: time.puppetlabs.com

    stompserver: stomp-qa.puppetlabs.com environment: qa puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011

  87. Global Defaults Environment Role --- ntpserver: time.puppetlabs.com stompserver: stomp-qa.puppetlabs.com environment:

    qa storeconfigs: true puppetserver: puppet-qa.puppetlabs.com Saturday, October 22, 2011

  88. DEMO TIME Saturday, October 22, 2011

  89. Devops Survey • http://bit.ly/devopssurvey Saturday, October 22, 2011

  90. Code is online https://github.com/glarizza/puppet-datademo Saturday, October 22, 2011

  91. Gary Larizza • Twitter: @glarizza • Email: [email protected] • Web:

    http://www.puppetlabs.com Saturday, October 22, 2011