Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Cloud Native Pipelines

Cloud Native Pipelines

Keynote at the Pivotal Japan Summit 2015

Joshua McKenty

December 03, 2015

More Decks by Joshua McKenty

Other Decks in Programming


  1. 2 © 2014 Pivotal Software, Inc. All rights reserved. “The

    primary purpose of any piece of software, is to exist. It is better to ship, than to not ship.” — Bob Parsley, Netscape
  2. 3 © 2014 Pivotal Software, Inc. All rights reserved. 3

    © 2014 Pivotal Software, Inc. All rights reserved. Cloud Native Pipelines Unshackling the Agile Workflow Joshua McKenty, Pivotal Co-founder, OpenStack Field CTO, Cloud Foundry Senior Director, Platform Engineering クラウドネイティブパイプライン: アジャイルワークフローを解放
  3. In times of profound change, the learners inherit the earth,

    while the learned find themselves beautifully equipped to deal with a world that no longer exists. - Eric Hoffer
  4. 5 © 2014 Pivotal Software, Inc. All rights reserved. Software

    is changing INDUSTRIES 5 $ 6BN Financial Services $ 26BN Hotel $ 50BN Transportation $ 53BN Entertainment $ 34BN Automotive $ 3.2BN Industrial Products
  5. 8 © 2014 Pivotal Software, Inc. All rights reserved. Continuous

    Delivery Our highest priority is to satisfy the customer through early and continuous delivery of valuable software. - The Agile Manifesto
  6. GOAL: Continuous Delivery WHAT: 12 Factor Apps 12 Factor Apps:

    …separate code from configuration, stateful data from stateless processes, build steps from deployment; and Trust operations to the platform.
  7. Continuous Delivery Release early and often Higher Quality of Code

    DevOps Shared responsibility Common incentives, tools, process and culture Microservices Loosely coupled components Automated deploy without waiting on individual components Cloud Native Platform
  8. 16 © 2014 Pivotal Software, Inc. All rights reserved. 16

    © 2014 Pivotal Software, Inc. All rights reserved. Cloud Native Platform クラウドネイティブプラットフォーム
  9. 17 © 2014 Pivotal Software, Inc. All rights reserved. Services

    (stateful): Run in virtual machines Applications (stateless): Run in containers A (narrow) Artificial Intelligence that manages transformations between existing and desired system states, using immutable infrastructure. Amend (Re)deploy (Re)configure (Re)connect Monitor Current State Desired State Platform
  10. 19 © 2014 Pivotal Software, Inc. All rights reserved. Cloud

    Foundry is… The world’s leading open source Cloud Native Platform Ÿ  Supported by dozens of major organizations Ÿ  Language and framework agnostic Ÿ  Manages both VMs and containers Ÿ  Orchestrates both applications and data services
  11. 20 © 2014 Pivotal Software, Inc. All rights reserved. An

    (Overly) Simple View of the World Applications Ÿ  Stateless Ÿ  Run in Containers Ÿ  Horizontally Scalable Ÿ  Disposable Ÿ  No permanent storage Data Services Ÿ  Stateful Ÿ  Run in Virtual Machines Ÿ  Multi-tenant Ÿ  Diagonally scalable Ÿ  Durable storage
  12. Cloud Native Framework Contract: 12 Factor App Contract: BOSH Release

    Contract: Cloud Provider Interface Culture Dev Dev IT Ops Tools Spring Cloud Spring Boot Cloud Foundry BOSH AWS VMware OpenStack Application Framework Runtime Platform Infrastructure Automation Elastic Infrastructure IT Ops IT Ops
  13. Why Cloud Foundry? “It’s definitely around speed to market, but

    it’s also about getting it right faster.” George Sherman, CIO of JPMC “100% uptime.” - Alex Curtis, Garmin “From 100 days to minutes. That’s what Pivotal CF gives us.” - Andy Zitney, SVP, Allstate
  14. The Cloud Native Pipeline Deliver High Quality Software, Faster and

    Continuously From Idea to Production Solution: Distributed revision control and source code management. Collaborative software development Solution: Build and test software projects continuously and incrementally. Hundreds of compatible plugins Solution: Share binaries and manage distributions. Manage artifact lifecycle. Avoid license violations Develop, test, QA and production on the same platform. Simple, developer friendly commands and APIs. Operational benefits for every app. Built-in ecosystem services. Deploy, operate and scale on any IAAS AUTOMATION. Integrate tools and automate processes from testing to builds and deployment SPEED. Release more frequently with smaller bits will reduce complexity and improve time-to-market QUALITY. Reduce feedback loop using test- driven development to surface problems sooner and be responsive AGILITY. Push updates on regular basis with no downtime to improve customer experience and time to market Commit Code Change Automate Build & Test (Unit Test, Static Code Analysis) Store Binaries & Build Artifacts Automated Integration Testing Acceptance, Performance & Load Zero Downtime Upgrade to Production Build Pipeline Operations Tool Chain Gitlab Jenkins Development Test + UAT + Staging Production Problem: Customers want to use Git distributed source code control system, yet maintain on-premise control of it Problem: Current application delivery pipeline is manual and error-prone, and lacks automation, scale, speed, transparency, compliance and reliability. Problem: Development requires management of binary artifacts to incorporate 3rd party components and track application binary artifacts
  15. Microservices: Scale Agile Teams Spring Cloud Designed for elastic infrastructure

    in partnership with Netflix n+1 Netflix deploys software into production thousands of times every day. How?
  16. core boot Cloud Services Service Registry Config Server Circuit Breaker

    Ops + Platform Dev Spring Cloud: Cloud Native Application Framework Rich, production ready library based on Netflix OSS for cloud native components, security and management.
  17. 26 © 2014 Pivotal Software, Inc. All rights reserved. 26

    "Culture does not change because we desire to change it. Culture changes when the organization is transformed; the culture reflects the realities of people working together every day.” - Frances Hesselbein
  18. Level 0 Level 1 Level 2 Level 3 JP Morgan

    Chase’s Cloud Native Maturity Model
  19. 28 © 2014 Pivotal Software, Inc. All rights reserved. Culture:

    The Pivotal Way Pair Programming Test-Driven Development Lean Product
  20. 29 © 2014 Pivotal Software, Inc. All rights reserved. The

    Cloud Native Pipeline 川柳 Run it in the Cloud for me, I do not care how Here is my source code,