Automating Continuous Delivery using Puppet and Jenkins

Transcript

1. Automating Continuous Delivery with Puppet and Jenkins
2. What is Continuous Delivery ? • Two essential concepts: • - Continuous Integration (CI) • - Continuous Deployment • Popularized by Jez Humble / David Farley • - Continuous Delivery book • Software delivery best practises: • Deploy often: small increments vs big bang • Use VCS / SCM • Automate as much as possible
3. Continuous … Delivery… … Entails…. continuous… • Integration: CI Pipelines (Jenkins / Bamboo / GO)
 Automated testing => QA / UAT => (manual?) testing
 QA => deployment to STG / PRE-PROD / PROD
 Test on each commit/PR, release often
 • Deployment. CD tools
 Config Management: 
 - Puppet / Chef / SaltStack
 Orchestration/Deployment: 
 - MCollective / Capistrano / Packages
4. Jenkins CI • Extensible • Flexible • Open Source • Cloud-Bees Enterprise
5. • Java • Config in XML • Web console driven • Painful to automate Pain-points
6. Puppettize all the things!!
7. Automating Jenkins • Puppet modules: 
 rtyler/jenkins 
 puppet/jenkins_job_builder • Jenkins Job Builder YAML • Jenkins Job-DSL plugin
8. • rtyler/jenkins • blessed/canonical module • Moved to jenkins-ci github account • 87 Contributors
9. Jenkins Job-Builder • Openstack Infra-team • Config in YAML • Idempotent • Easy to puppetize/automate • Written in Python
10. puppet-jenkins_job_builder • Created by OpenTable infra team • Moved to puppet-community account • Suffers from stagnation
 • … but it does the trick

11. Jenkins job_dsl plugin • Programattically create jobs - i.e. rake/ruby/python/ whatevs .. even bash if you’”⁹re brave ;-)
 • Automation via Groovy DSL
 • Extricated from puppet, i.e. job creation is adhoc
 • Direct control over plugins where necessary
 • Build upon existing toolset
12. Gaps in the process • Where does it fall short? • Missing plugin support in JJB / Job-DSL • Sometimes, shell scripts • Depends on your position on the curve
13. Code examples: rtyler/jenkins puppet/jenkins_job_builder
14. rtyler/jenkins plugins:
15. puppet/jenkins_job_builder job definition in hiera
16. Job-DSL plugin instance, within JJB definition, in hiera
17. Demo!! (recorded, so as not to anger the demo gods) All resources available on Github @ https://github.com/madAndroid/ puppet_pipeline_demo
18. Questions? Twitter: @madAndroid Github: madAndroid www.scalefactory.com