Using DevOps Data to Optimize Value Stream Flow and Realization

Helen Beal Helen Beal is a DevOps and Ways of Working coach, Chief Ambassador at DevOps Institute and an ambassador for the Continuous Delivery Foundation. She is the Chair of the Value Stream Management Consortium and provides strategic advisory services to DevOps industry leaders such as Plutora and Moogsoft. She is also an analyst at Accelerated Strategies Group. She hosts the Day-to-Day DevOps webinar series for BrightTalk, speaks regularly on DevOps topics, is a DevOps editor for InfoQ and also writes for a number of other online platforms. She regularly appears in TechBeacon’s DevOps Top100 lists and was recognized as the Top DevOps Evangelist 2020 in the DevOps Dozen awards. Herder of Humans @bealhelen 2 MISSION: Bringing Joy to Work

Flow: Talk Map DevOps Data Flow Realization DevOps Toolchains Measuring a DevOps Journey Value Streams Customer Business Team VSMPs 3

PAGE | DevOps Data 4 THROUGHPUT STABILITY

PAGE | Value Streams 5 Flow Idea Plan Build Validate Release Realize “In DevOps, we typically define our technology value stream as the process required to convert a business requirement into a technology-enabled service that delivers value to the customer.” “If you can’t describe what you are doing as a value stream, you don’t know what you’re doing.”

PAGE | Flow 6

PAGE | Realization 7 VSM Metrics Class Objective Key Results Customer Value realization, UX, delight Usage, feedback, NPS/referrals, reviews, conversions, bounce rate, session length, basket size Business Profitability, market share, segmentation, reach Income, % adoption, churn, conversion Flow Time to value/learning (cycle/lead time) Days/hours/minutes, efficiency, WIP, distribution Team P&L, total cost of ownership (TCO), product and platform performance WIP, outcome, system capacity, uptime, MTTD/R*, MTBF**

PAGE | Value Stream Management Processes 8 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The Value Cycle

PAGE | DevOps Toolchains 9 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 10 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 11 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 12 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 13 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 14 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 15 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 16 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 17 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 18 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 19 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 20 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 21 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 22 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 23 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain

PAGE | Value Stream Management Platform 24 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. Value Stream Management Connect planning to delivery Visibility into cross value stream changes Trace user stories as they travel Continuous compliance Manage dependencies while you break them Gain insights into waste; optimize flow Inspect real-time data and adapt

PAGE | 7% © 2021 DEVOPS INSTITUTE. 25 14th State of Agile Report No interest 19% 15% 15% Implementing not expanding Currently implementing Planning to implement in the next 12 months Interested but no near-terms plans to implement 7% Unsure 23% Value Stream Management Adoption “By 2023, 70% of organizations will use value stream management to improve flow in the DevOps pipeline, leading to faster delivery of customer value.” Gartner “Value Stream Management is a combination of people, process and technology that maps, optimizes, visualizes, measures, and governs business value flow through heterogeneous software delivery pipelines from idea through development and into production.” Forrester

PAGE | What the Analysts are Saying 26 ‘Predicts 2021: Value Streams Will Define the Future of DevOps’ by Daniel Betts, Chris Saunderson, Ron Blair, Manjunath Bhat, Jim Scheibmeir, Hassan Ennaciri. Published 5 October 2020 Vendor Selection MatrixTM Value Stream Management: Top Global Vendors 2020’ by Eveline Oehrlich, published July 2020 The Forrester WaveTM: Value Stream Management Solutions, Q3 2020’ by Chris Condo with Christopher Mines, Diego Lo Giudice, Andrew Dobak, and Kara Hartig, published July 15, 2020 ‘DevOps 2021: Evaluating High Growth Markets in the DevOps Pipeline’ by Stephen D. Hendrick, published April 2020 “To accelerate development and enable continuous delivery of customer value, organizations need to reach the next level in their agile and DevOps practices. I&O leaders and application leaders must focus on value stream management to maximize flow, improve delivery efficiency and drive innovation.” “Value Stream Management is a must-do not a nice-to-do. Enterprise organizations are realizing that increasing the velocity and quality of software delivery are not the only goals.Business teams and product owners are looking for what are the returns on investment and how they are delighting customers.” “When we published our first VSM evaluation in 2017, few AD&D leaders had heard of VSM; since then, the VSM tools market has evolved rapidly as have prospective buyers of VSM tools. AD&D planners, engineers, and release experts understand VSM and want it to help them plan, create, and deliver software experiences that align to both the business’ and customers’ needs.” “Value stream management is a market in which large enterprises had massive expectations back in 2018 Q2. Currently, vendors appear to be delivering against these expectations given the nearly 50% growth in penetration that is expected to occur in 2020 and 20+ percent growth in 2021.” Gartner Research in Action Forrester EMA

PAGE | Measuring a DevOps Journey 27 1 Imagine long term vision 2 Baseline current state 4 Experiment to improve 3 Identify next target state P D C A ● Baseline their current DevOps state ● Identify the next target state ● Plan experiments to move between states ● Gain insights into how to improve capabilities ● Measure and accelerate continuous improvement during their DevOps journey DevOps Institute’s Assessment for DevOps Capability (ADOC) is crowdsourced, vendor-neutral and designed for individuals, teams and organizations who want to:

PAGE | ADOC Dimensions 28 Human Aspects This dimension focuses on culture, psychological safety, dynamic learning, transformational leadership, The Three Ways, happiness at work and diversity and inclusion. Process and Frameworks This dimension focuses on agile, lean, ITSM, GRC, VSM, Project to Product, SRE, DevSecOps, Design and Systems thinking, Holacracy and Humanocracy. Functional Composition This dimension focuses on collaboration, portfolio and product management, change, architecture, build, test, release, operate and support. Intelligent Automation This dimension focuses on artifact and source control, CICD, environment management, continuous compliance, observability, AIOps and Value Stream Management. Technology Ecosystems This dimension focuses on elastic infrastructure, containers, microservices, APIs, serverless, DevOps toolchains, open and innersource and secrets management.

PAGE | Key Takeaways ● Cycle time to value outcomes is key to customer delight ● Think and work like value streams ● Monitor from ideation to realization Using DevOps Data to Optimize Value Stream Flow and Realization 29 ● Focus on customer outcomes ● Figure out what value means to you ● Write value hypotheses ● Check your experiments ● Journeys are measurable ● Progress brings joy ● DevOps means sustainable ways of working ● Human aspects are key to success Flow Realization Joy

THANK YOU