Alon Aizenberg

Continuous Delivery at SAPIT

Gain insight into the CD processes and tools used by the web development unit at SAP IT. We will show how we use CD best practices like infrastructure as code, cloud automation, deployment pipelines, test automation and other techniques to power ongoing releases, and greatly simplify our software development and delivery capabilities.

Presented in the Continuous Delivery track at DevOps Con Israel 2013

Transcript

1. Continuous Delivery @ SAP IT Alon Aizenberg SAP Global IT / Social Collaboration Platform team January 2013
2. © 2013 SAP AG. All rights reserved. 2 Public About SAP  40 years old  Leader in enterprise applications  ~ 70K employees  ~ 183K customers  ~ 130 countries
3. © 2013 SAP AG. All rights reserved. 3 Public Social Collaboration Platform team We produce many platforms
4. © 2013 SAP AG. All rights reserved. 4 Public Search Consolidation Project  One stop when searching SAP related content  ~ 100 machines in all environments  ~ 40 in productive deployments  ~ 2 years in continuous delivery mode
5. © 2013 SAP AG. All rights reserved. 5 Public The Problems Physical hardware, manual setup Manual deployment Manual QA phases Big features, long development cycles ?
6. © 2013 SAP AG. All rights reserved. 6 Public Virtualization, Infrastructure Automation The Solutions Deployment Automation Test Automation Continuous Delivery !
7. © 2013 SAP AG. All rights reserved. 7 Public Virtualization, Infrastructure Automation The Tools Deployment Automation Test Automation Continuous Delivery
8. © 2013 SAP AG. All rights reserved. 8 Public Infrastructure Automation
9. © 2013 SAP AG. All rights reserved. 9 Public Infrastructure Automation  Start with manual VM operations  Command line wrapper allows automation  Evolve, full Infrastructure as code  Projects, environments, machine descriptors and automation scripts in source control Infrastructur e Automation
10. © 2013 SAP AG. All rights reserved. 10 Public Project Configuration Example - name: prod servers: - name: search01 runlist: - role[search-server] - name: search02 runlist: - role[search-server] - name: db template: SLES_11_64bit cpus: 8 memory: 16384mb runlist: - role[hanadb-server] - name: index01 runlist: - role[indexing-server] - name: index02 runlist: - role[indexing-server] - name: index03 runlist: - role[indexing-server] - name: ls5133 physical: true dnsname: search11111 ipaddress: 11.11.11.11 runlist: - role[trex-name-server] Infrastructur e Automation chefrepo: git@github.sap.corp:srch/chef-repo-int.git
11. © 2013 SAP AG. All rights reserved. 11 Public Chef usage  Each project has a chef repository in git  Shared automations have their own repositories in git  Use librarian-chef and git to create a full chef repository Before uploading the scripts to chef server Infrastructur e Automation
12. © 2013 SAP AG. All rights reserved. 12 Public Project A Chef repository Chef Server Production Project A production environment Shared cookbook repo / Cookbook shelf Chef Usage Infrastructur e Automation Combined chef repository
13. © 2013 SAP AG. All rights reserved. 13 Public Librarian-Chef Configuration Examples site "http://cookbooks.sap.corp:8080" cookbook 'monsoon’ # loads jvm cookbook because tomcat declares it’s dependent on jvm cookbook 'tomcat’ # use git repo to load a cookbook cookbook 'saml2', :git => 'git://github.sap.corp/srch/saml2’ Infrastructur e Automation
14. © 2013 SAP AG. All rights reserved. 14 Public Barkeeper  The glue  Manages projects and environments  Manages VMs  Manages chef servers  Handles permissions  UI, REST API and CLI Infrastructur e Automation Project configuration and chef repository Barkeeper VMware API
15. © 2013 SAP AG. All rights reserved. 15 Public Barkeeper Infrastructur e Automation
16. © 2013 SAP AG. All rights reserved. 16 Public Deployment Automation
17. © 2013 SAP AG. All rights reserved. 17 Public Deployment Automation Dedicated cookbooks automate application deployment and configuration Deployment Automation
18. © 2013 SAP AG. All rights reserved. 18 Public Test Automation
19. © 2013 SAP AG. All rights reserved. 19 Public Test Automation  End to end functional acceptance tests  80% of functional tests are automated  Manual QA  Integrations with other systems  Not everything is automated, yet Test Automation
20. © 2013 SAP AG. All rights reserved. 20 Public Continuous Delivery
21. © 2013 SAP AG. All rights reserved. 21 Public Continuous Delivery  Bamboo Continuous Integration server  Orchestrates the flow from code push to productive deployment  Build grid  Parallel execution Continuous Delivery
22. © 2013 SAP AG. All rights reserved. 22 Public Bamboo jobs Build, unit test Package, publish Deploy Test, functional tests Deploy QA, sanity tests Deploy Prod Artifact / Binary repository Source/Chef repositories Commit Test QA Prod Environments Pull deployment automation, binaries and artifacts
23. © 2013 SAP AG. All rights reserved. 23 Public Pipeline Interactions – Deploy Environment Bar Keeper GIT Project Repo Chef Server VM 1 VM 2 VM 3 VM 4 VM 5 VM 6 Create chef server Create VMs Continuous Delivery
24. © 2013 SAP AG. All rights reserved. 24 Public Pipeline Interactions - Install Environment Build Agents Bar Keeper Bamboo GIT Chef Repo Chef Server Chef Server VM 1 VM 2 VM 3 VM 4 VM 5 VM 6 Shared cookbooks shelf Sync Run chef clients Continuous Delivery
25. © 2013 SAP AG. All rights reserved. 25 Public Pipeline Interactions - Test Application Build Agents Bamboo Chef Server Chef Server VM 1 VM 2 VM 3 VM 4 VM 5 VM 6 REST API Tests Functional tests Git source repo with test automation Continuous Delivery
26. © 2013 SAP AG. All rights reserved. 26 Public How did we get there?  2 years  Evolution not revolution  Constantly rethink and improve  Tech talks, documentation, encourage hands on  Make the tools easy to use for everyone
27. © 2013 SAP AG. All rights reserved. 27 Public A change in the state of mind  Not only coding  Master always shippable  Feature toggles  Must be maintained  Be ready to handle production  If you build it… they will come
28. © 2013 SAP AG. All rights reserved. 28 Public Lessons learned  Management buy-in  Fast pipeline  Application adaptations  Testing automation is big investment  Tests should be easy to write and run  Automate everything – build infrastructure, load balancers, load tests, monitoring, analytics etc.
29. © 2013 SAP AG. All rights reserved. 29 Public ? Questions
30. © 2013 SAP AG. All rights reserved. 30 Public Thank you Twitter @alonaizenberg Email alon.aizenberg@sap.com