$30 off During Our Annual Pro Sale. View Details »

Cloud Native Pipelines

Cloud Native Pipelines

Keynote at the Pivotal Japan Summit 2015

Joshua McKenty

December 03, 2015
Tweet

More Decks by Joshua McKenty

Other Decks in Programming

Transcript

  1. View Slide

  2. 2
    © 2014 Pivotal Software, Inc. All rights reserved.
    “The primary purpose of
    any piece of software,
    is to exist. It is better to
    ship, than to not ship.”
    — Bob Parsley, Netscape

    View Slide

  3. 3
    © 2014 Pivotal Software, Inc. All rights reserved. 3
    © 2014 Pivotal Software, Inc. All rights reserved.
    Cloud Native Pipelines
    Unshackling the Agile Workflow
    Joshua McKenty, Pivotal
    Co-founder, OpenStack
    Field CTO, Cloud Foundry
    Senior Director, Platform Engineering
    クラウドネイティブパイプライン:
    アジャイルワークフローを解放

    View Slide

  4. In times of profound change, the
    learners inherit the earth, while the
    learned find themselves beautifully
    equipped to deal with a world that
    no longer exists.
    - Eric Hoffer

    View Slide

  5. 5
    © 2014 Pivotal Software, Inc. All rights reserved.
    Software is changing INDUSTRIES
    5
    $
    6BN
    Financial Services
    $
    26BN
    Hotel
    $
    50BN
    Transportation
    $
    53BN
    Entertainment
    $
    34BN
    Automotive
    $
    3.2BN
    Industrial Products

    View Slide

  6. 6
    © 2014 Pivotal Software, Inc. All rights reserved.
    Churn in the S&P 500

    View Slide

  7. View Slide

  8. 8
    © 2014 Pivotal Software, Inc. All rights reserved.
    Continuous Delivery
    Our highest priority is to satisfy the
    customer through early and continuous
    delivery of valuable software.
    - The Agile Manifesto

    View Slide

  9. GOAL: Continuous Delivery
    自働化
    - Toyota Method, 1927
    ⾃自動化 + ⼈人 = 自働化

    View Slide

  10. GOAL: Continuous Delivery
    WHAT: 12 Factor Apps
    12 Factor Apps:
    …separate code from configuration,
    stateful data from stateless processes,
    build steps from deployment; and
    Trust operations to the platform.

    View Slide

  11. GOAL: Continuous Delivery
    WHAT: 12 Factor Apps
    HOW: Cloud Native Platform

    View Slide

  12. GOAL: Continuous Delivery
    WHAT: 12 Factor Apps
    HOW: Cloud Native Platform
    THRU: Culture of Pivotal Way

    View Slide

  13. Cloud Native
    DevOps Continuous
    Delivery
    Containers
    Microservices

    View Slide

  14. Cloud Native
    DevOps Continuous
    Delivery
    Containers
    Microservices
    Architecture
    Process
    Technology
    Culture

    View Slide

  15. Continuous Delivery
    Release early and often
    Higher Quality of Code
    DevOps
    Shared responsibility
    Common incentives, tools, process
    and culture
    Microservices
    Loosely coupled components
    Automated deploy without waiting on
    individual components
    Cloud Native Platform

    View Slide

  16. 16
    © 2014 Pivotal Software, Inc. All rights reserved. 16
    © 2014 Pivotal Software, Inc. All rights reserved.
    Cloud Native Platform
    クラウドネイティブプラットフォーム

    View Slide

  17. 17
    © 2014 Pivotal Software, Inc. All rights reserved.
    Services (stateful):
    Run in virtual machines
    Applications (stateless):
    Run in containers
    A (narrow) Artificial Intelligence that manages
    transformations between existing and desired
    system states, using immutable infrastructure.
    Amend
    (Re)deploy
    (Re)configure
    (Re)connect
    Monitor
    Current
    State Desired
    State
    Platform

    View Slide

  18. View Slide

  19. 19
    © 2014 Pivotal Software, Inc. All rights reserved.
    Cloud Foundry is…
    The world’s leading open source Cloud Native Platform
    Ÿ  Supported by dozens of major organizations
    Ÿ  Language and framework agnostic
    Ÿ  Manages both VMs and containers
    Ÿ  Orchestrates both applications and data services

    View Slide

  20. 20
    © 2014 Pivotal Software, Inc. All rights reserved.
    An (Overly) Simple View of the World
    Applications
    Ÿ  Stateless
    Ÿ  Run in Containers
    Ÿ  Horizontally Scalable
    Ÿ  Disposable
    Ÿ  No permanent storage
    Data Services
    Ÿ  Stateful
    Ÿ  Run in Virtual Machines
    Ÿ  Multi-tenant
    Ÿ  Diagonally scalable
    Ÿ  Durable storage

    View Slide

  21. Cloud Native Framework
    Contract: 12 Factor App
    Contract: BOSH Release
    Contract: Cloud Provider Interface
    Culture
    Dev
    Dev IT Ops
    Tools
    Spring Cloud Spring Boot
    Cloud Foundry
    BOSH
    AWS VMware OpenStack
    Application Framework
    Runtime Platform
    Infrastructure Automation
    Elastic Infrastructure
    IT Ops
    IT Ops

    View Slide

  22. Why Cloud Foundry?
    “It’s definitely around speed
    to market, but it’s also about
    getting it right faster.”
    George Sherman,
    CIO of JPMC
    “100% uptime.”
    - Alex Curtis, Garmin
    “From 100 days to minutes.
    That’s what Pivotal CF gives us.”
    - Andy Zitney, SVP, Allstate

    View Slide

  23. The Cloud Native Pipeline
    Deliver High Quality Software, Faster and Continuously From Idea to Production
    Solution: Distributed
    revision control and
    source code
    management.
    Collaborative software
    development
    Solution: Build and test
    software projects
    continuously and
    incrementally. Hundreds
    of compatible plugins
    Solution: Share
    binaries and manage
    distributions. Manage
    artifact lifecycle. Avoid
    license violations
    Develop, test, QA and production on the same platform. Simple, developer friendly
    commands and APIs. Operational benefits for every app. Built-in ecosystem
    services. Deploy, operate and scale on any IAAS
    AUTOMATION.
    Integrate tools and automate
    processes from testing to builds and
    deployment
    SPEED.
    Release more frequently with smaller
    bits will reduce complexity and
    improve time-to-market
    QUALITY.
    Reduce feedback loop using test-
    driven development to surface
    problems sooner and be responsive
    AGILITY.
    Push updates on regular basis with no
    downtime to improve customer
    experience and time to market
    Commit Code
    Change
    Automate
    Build & Test
    (Unit Test, Static Code
    Analysis)
    Store Binaries
    & Build
    Artifacts
    Automated
    Integration
    Testing
    Acceptance,
    Performance &
    Load
    Zero Downtime
    Upgrade to
    Production
    Build Pipeline
    Operations
    Tool Chain
    Gitlab Jenkins Development Test + UAT +
    Staging
    Production
    Problem: Customers
    want to use Git
    distributed source code
    control system, yet
    maintain on-premise
    control of it
    Problem: Current
    application delivery pipeline
    is manual and error-prone,
    and lacks automation, scale,
    speed, transparency,
    compliance and reliability.
    Problem: Development
    requires management of
    binary artifacts to
    incorporate 3rd party
    components and track
    application binary artifacts

    View Slide

  24. Microservices: Scale Agile Teams
    Spring Cloud
    Designed for elastic infrastructure
    in partnership with Netflix
    n+1 Netflix deploys software into
    production thousands of
    times every day. How?

    View Slide

  25. core boot
    Cloud
    Services
    Service
    Registry
    Config
    Server
    Circuit
    Breaker
    Ops + Platform
    Dev
    Spring Cloud: Cloud Native Application Framework
    Rich, production ready library based on Netflix OSS for cloud native components,
    security and management.

    View Slide

  26. 26
    © 2014 Pivotal Software, Inc. All rights reserved. 26
    "Culture does not change because we
    desire to change it. Culture changes
    when the organization is transformed;
    the culture reflects the realities of
    people working together every day.”
    - Frances Hesselbein

    View Slide

  27. Level 0
    Level 1
    Level 2
    Level 3
    JP Morgan Chase’s Cloud Native Maturity Model

    View Slide

  28. 28
    © 2014 Pivotal Software, Inc. All rights reserved.
    Culture: The Pivotal Way
    Pair Programming Test-Driven Development Lean Product

    View Slide

  29. 29
    © 2014 Pivotal Software, Inc. All rights reserved.
    The Cloud Native Pipeline 川柳
    Run it in the Cloud for me,
    I do not care how
    Here is my source code,

    View Slide

  30. View Slide