Orchestrating all the things!

This talk was given at Velocity Amsterdam, October 2015
Watch the video of the session at: http://electric-cloud.com/blog/2015/12/orchestrating-all-the-things-watch-the-video-of-my-talk-at-velocityconf/

Co-presented with Tanay Nagjee, Solutions Architect & Sales Engineers Manager, Electric Cloud

Software delivery pipelines are becoming more and more complex, and are integrating a myriad of open source tools, frameworks, and infrastructures. From project management and defect tracking (JIRA, Bugzilla, etc.), SCM and configuration management (GIT, Chef, Puppet), CI (Jenkins, Travis-CI), Testing (Selenium), to databases and infrastructure (Hadoop, MySQL, Docker), to cloud platforms (Open Stack) – modern application delivery today involves and depends on a wide range of open source tools.

To improve developer productivity and resource utilization – and to enable enterprise-scale, cross-project visibility and shorter time to market – many organizations are working to automate and orchestrate the entire tool chain across the end-to-end delivery pipeline. In this session, attendees will learn how a $40 billion company (Huawei) did just that. This case study will outline the prerequisites, best practices, and pitfalls to avoid when implementing an end-to-end orchestration strategy.

Transcript

1. © Electric Cloud | electric-cloud.com Orchestrate all the things! Anders Wallgren @anders_wallgren Tanay Nagjee @tanaynagjee
2. © Electric Cloud | electric-cloud.com
3. © Electric Cloud | electric-cloud.com The landscape is changing rapidly… Internet of Things Everything is connected Consumerization of IT Bad technology will not be tolerated Multi-channel consumption Seamless access on every device Cloud services Dynamically scalable backend services
4. © Electric Cloud | electric-cloud.com And the stakes are getting higher… “Ford recalls 433,000 cars: software bug breaks engine off-switch” The Register, 2015 “To keep a Boeing Dreamliner flying, reboot every 248 days” Engadget, 2015 Healthcare.gov: “hundreds of software bugs had to be found and fixed” Forbes, 2013 “One bad algorithm cost traders $440m” The Register, 2012 Software Bugs Cost Economy $312 Billion Per Year Cambridge University, 2013
5. © Electric Cloud | electric-cloud.com It is not the strongest of the species that survives, nor the most intelligent. It is the one that is most adaptable to change. Charles Darwin
6. © Electric Cloud | electric-cloud.com DevOps & Continuous Delivery LESS THAN 10% YOY Revenue Growth MORE THAN 10% YOY Revenue Growth “We do CD” 93% achieved 10%+ “We don’t” 7% achieved 10%+ Julie Craig, EMA, DevOps and Continuous Delivery: Ten Factors Shaping the Future of Application Delivery, 2014
7. © Electric Cloud | electric-cloud.com Who is Huawei? An Innovative Industry Contributor An ICT Industry Leader A privately-owned Global Company
8. © Electric Cloud | electric-cloud.com 16 R&D Centers 140+ Countries 14 Regional HQs 28 Joint Innovation Centers 150K Employees Worldwide 45 Training Centers 33.4% 14.5% 17% 35.1% Revenue by Geo China EMEA APAC Americas 70K R&D Employees (2012)
9. © Electric Cloud | electric-cloud.com Makin’ it real Huawei Phone 2012 Huawei Phone Today
10. © Electric Cloud | electric-cloud.com The implementation: CD-DevOps Solution 20 Rock Stars 3 Months to V1 >1000 Pipelines/Day
11. © Electric Cloud | electric-cloud.com Example pipeline Developer Eclipse Modify code launch preflight Subversion Check out sources overlay deltas Redmine Mark issue as ‘build & unit test’ Jenkins Launch build + test w/ sources Redmine Mark issue as ‘code review’ ReviewBoard Create review request Redmine Mark issue as ‘resolved’ Eclipse Success; auto- commit code Build + test success? Review success? ReviewBoard Review modified code Time Savings OpenStack Deploy integration environment OpenStack Teardown integration environment Testing success? Chef Configure integration environment Orchestration Engine Docker Deploy application to container Docker Publish container to artifact repository Selenium Run tests against integration environment
12. © Electric Cloud | electric-cloud.com Where are they on their journey? • Bridging the gap between Dev and Ops • Multi-layer / multi-platform infrastructure • Devs gaining control over production environment • Concise definition and automation of processes • Globally distributed R&D teams PROD BUILD 300min DEV BUILD 10min FULL TEST 1440min REGRESSION TEST 240min FEATURE DELIVERY TIME 30days PROD BUILD 10min (was 300) DEV BUILD 1min (was 10) FULL TEST 360min (was 1440) REGRESSION TEST 60min (was 240) FEATURE DELIVERY TIME 7days (was 30)
13. © Electric Cloud | electric-cloud.com
14. © Electric Cloud | electric-cloud.com
15. © Electric Cloud | electric-cloud.com The first rule of any technology used in a business is that automation applied to an efficient operation will magnify the efficiency. The second is that automation applied to an inefficient operation will magnify the inefficiency. - Bill Gates
16. © Electric Cloud | electric-cloud.com Lori MacVittie, DevOps.com, 2014
17. © Electric Cloud | electric-cloud.com DevNetwork.com, 2014
18. © Electric Cloud | electric-cloud.com
19. © Electric Cloud | electric-cloud.com
20. © Electric Cloud | electric-cloud.com Thank you! Anders Wallgren @anders_wallgren Tanay Nagjee @tanaynagjee