Cloud Native Pipelines

Keynote at the Pivotal Japan Summit 2015

Transcript

2. 2 © 2014 Pivotal Software, Inc. All rights reserved. “The primary purpose of any piece of software, is to exist. It is better to ship, than to not ship.” — Bob Parsley, Netscape
3. 3 © 2014 Pivotal Software, Inc. All rights reserved. 3 © 2014 Pivotal Software, Inc. All rights reserved. Cloud Native Pipelines Unshackling the Agile Workflow Joshua McKenty, Pivotal Co-founder, OpenStack Field CTO, Cloud Foundry Senior Director, Platform Engineering クラウドネイティブパイプライン: アジャイルワークフローを解放
4. In times of profound change, the learners inherit the earth, while the learned find themselves beautifully equipped to deal with a world that no longer exists. - Eric Hoffer
5. 5 © 2014 Pivotal Software, Inc. All rights reserved. Software is changing INDUSTRIES 5 $ 6BN Financial Services $ 26BN Hotel $ 50BN Transportation $ 53BN Entertainment $ 34BN Automotive $ 3.2BN Industrial Products
6. 6 © 2014 Pivotal Software, Inc. All rights reserved. Churn in the S&P 500
8. 8 © 2014 Pivotal Software, Inc. All rights reserved. Continuous Delivery Our highest priority is to satisfy the customer through early and continuous delivery of valuable software. - The Agile Manifesto
9. GOAL: Continuous Delivery 自働化 - Toyota Method, 1927 ⾃自動化 + ⼈人 = 自働化
10. GOAL: Continuous Delivery WHAT: 12 Factor Apps 12 Factor Apps: …separate code from configuration, stateful data from stateless processes, build steps from deployment; and Trust operations to the platform.
11. GOAL: Continuous Delivery WHAT: 12 Factor Apps HOW: Cloud Native Platform
12. GOAL: Continuous Delivery WHAT: 12 Factor Apps HOW: Cloud Native Platform THRU: Culture of Pivotal Way
13. Cloud Native DevOps Continuous Delivery Containers Microservices
14. Cloud Native DevOps Continuous Delivery Containers Microservices Architecture Process Technology Culture
15. Continuous Delivery Release early and often Higher Quality of Code DevOps Shared responsibility Common incentives, tools, process and culture Microservices Loosely coupled components Automated deploy without waiting on individual components Cloud Native Platform
16. 16 © 2014 Pivotal Software, Inc. All rights reserved. 16 © 2014 Pivotal Software, Inc. All rights reserved. Cloud Native Platform クラウドネイティブプラットフォーム
17. 17 © 2014 Pivotal Software, Inc. All rights reserved. Services (stateful): Run in virtual machines Applications (stateless): Run in containers A (narrow) Artificial Intelligence that manages transformations between existing and desired system states, using immutable infrastructure. Amend (Re)deploy (Re)configure (Re)connect Monitor Current State Desired State Platform
19. 19 © 2014 Pivotal Software, Inc. All rights reserved. Cloud Foundry is… The world’s leading open source Cloud Native Platform Ÿ  Supported by dozens of major organizations Ÿ  Language and framework agnostic Ÿ  Manages both VMs and containers Ÿ  Orchestrates both applications and data services
20. 20 © 2014 Pivotal Software, Inc. All rights reserved. An (Overly) Simple View of the World Applications Ÿ  Stateless Ÿ  Run in Containers Ÿ  Horizontally Scalable Ÿ  Disposable Ÿ  No permanent storage Data Services Ÿ  Stateful Ÿ  Run in Virtual Machines Ÿ  Multi-tenant Ÿ  Diagonally scalable Ÿ  Durable storage
21. Cloud Native Framework Contract: 12 Factor App Contract: BOSH Release Contract: Cloud Provider Interface Culture Dev Dev IT Ops Tools Spring Cloud Spring Boot Cloud Foundry BOSH AWS VMware OpenStack Application Framework Runtime Platform Infrastructure Automation Elastic Infrastructure IT Ops IT Ops
22. Why Cloud Foundry? “It’s definitely around speed to market, but it’s also about getting it right faster.” George Sherman, CIO of JPMC “100% uptime.” - Alex Curtis, Garmin “From 100 days to minutes. That’s what Pivotal CF gives us.” - Andy Zitney, SVP, Allstate
23. The Cloud Native Pipeline Deliver High Quality Software, Faster and Continuously From Idea to Production Solution: Distributed revision control and source code management. Collaborative software development Solution: Build and test software projects continuously and incrementally. Hundreds of compatible plugins Solution: Share binaries and manage distributions. Manage artifact lifecycle. Avoid license violations Develop, test, QA and production on the same platform. Simple, developer friendly commands and APIs. Operational benefits for every app. Built-in ecosystem services. Deploy, operate and scale on any IAAS AUTOMATION. Integrate tools and automate processes from testing to builds and deployment SPEED. Release more frequently with smaller bits will reduce complexity and improve time-to-market QUALITY. Reduce feedback loop using test- driven development to surface problems sooner and be responsive AGILITY. Push updates on regular basis with no downtime to improve customer experience and time to market Commit Code Change Automate Build & Test (Unit Test, Static Code Analysis) Store Binaries & Build Artifacts Automated Integration Testing Acceptance, Performance & Load Zero Downtime Upgrade to Production Build Pipeline Operations Tool Chain Gitlab Jenkins Development Test + UAT + Staging Production Problem: Customers want to use Git distributed source code control system, yet maintain on-premise control of it Problem: Current application delivery pipeline is manual and error-prone, and lacks automation, scale, speed, transparency, compliance and reliability. Problem: Development requires management of binary artifacts to incorporate 3rd party components and track application binary artifacts
24. Microservices: Scale Agile Teams Spring Cloud Designed for elastic infrastructure in partnership with Netflix n+1 Netflix deploys software into production thousands of times every day. How?
25. core boot Cloud Services Service Registry Config Server Circuit Breaker Ops + Platform Dev Spring Cloud: Cloud Native Application Framework Rich, production ready library based on Netflix OSS for cloud native components, security and management.
26. 26 © 2014 Pivotal Software, Inc. All rights reserved. 26 "Culture does not change because we desire to change it. Culture changes when the organization is transformed; the culture reflects the realities of people working together every day.” - Frances Hesselbein
27. Level 0 Level 1 Level 2 Level 3 JP Morgan Chase’s Cloud Native Maturity Model
28. 28 © 2014 Pivotal Software, Inc. All rights reserved. Culture: The Pivotal Way Pair Programming Test-Driven Development Lean Product
29. 29 © 2014 Pivotal Software, Inc. All rights reserved. The Cloud Native Pipeline 川柳 Run it in the Cloud for me, I do not care how Here is my source code,