Interoperability: Solving the Data Challenge

Value Stream Management improves organizational performance by improving the efficiency and effectiveness of teams and their ability to create extraordinary customer experiences. So why isn’t everyone doing it? There are some challenges, not the least of which is to harness the telemetry emitted by the digital platforms involved (DevOps toolchains and much more) and turn it into actionable insights. The first step is to access the data and this is harder than you might think too. In this talk, Helen Beal, Co-Chair of the VSMI Interoperability Technical Committee and Chair of the VSM Consortium, will share how this challenge is being addressed and the tools and skills needed to continually inspect and adapt digital value streams.

Transcript

1. www.vsmconsortium.org TITLE Subtitle Interoperability: Solving the Data Challenge Helen Beal, Co-Chair of the VSM Interoperability Technical Committee, OASIS Open
2. www.vsmconsortium.org Helen Beal Helen Beal is the chair of the Value Stream Management Consortium and co-chair of the OASIS Value Stream Management Interoperability Technical Committee. She is chief ambassador at DevOps Institute and co-chair of the DevNetwork DevOps Advisory Board. She also provides strategic advisory services to DevOps industry leaders. Helen hosts the Day-to-Day DevOps webinar series for BrightTalk, speaks regularly on DevOps and value stream-related topics, is a DevOps editor for InfoQ, and also writes for a number of other online platforms. She is a co-author of the book about DevOps and governance, Investments Unlimited, published by IT Revolution. Herder of Humans @helenhappybee PURPOSE: Bringing Joy to Work
3. www.vsmconsortium.org Value Stream Delivery Platforms (VSDPs & CICD) are popular but Value Stream Management Platform (VSMP) adoption lags A 2022 report by Mulesoft and Deloitte revealed that enterprises spend an average $3.6 million a year on labor just to enable custom integrations; on average, though, they only manage to integrate 28% of their tools.
4. www.vsmconsortium.org • Limited workflow visibility in individual systems • Limited ability to attribute effort to outcome • Difficulty in adopting VSM platforms ◦ Data format/quality ◦ Data availability Current State
5. www.vsmconsortium.org Use Cases • Gather data from multiple tools in a value stream and present end-to-end value stream data ◦ Make workflow, bottlenecks and dependencies visible and traceable ◦ Provide teams data and visualizations to gain insights into potential improvements • Leaders can see aggregated views of teams’ WiP and OKRs to measure transformation journeys • See impact of effort on contributor & customer experience • Improve orchestration through a central source of data for workflow • Enable continuous compliance, adaptive governance, policy-as-code • Automatically generate insights into data via AI • Produce Declarative rather than Imperative events from VSDPs for consumption by VSMP systems 5
6. www.vsmconsortium.org CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. Value Stream Management Processes 6 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. The Value Cycle © Value Stream Management Consortium Module 4: Connecting DevOps Toolchains
7. www.vsmconsortium.org © Value Stream Management Consortium Portfolio Management 7 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
8. www.vsmconsortium.org © Value Stream Management Consortium Product Backlog 8 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
9. www.vsmconsortium.org © Value Stream Management Consortium Collaborative Wiki 9 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
10. www.vsmconsortium.org © Value Stream Management Consortium Artifact Repository 10 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
11. www.vsmconsortium.org © Value Stream Management Consortium Source/Version Control 11 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
12. www.vsmconsortium.org © Value Stream Management Consortium CI Server 12 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
13. www.vsmconsortium.org © Value Stream Management Consortium Unit Testing 13 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
14. www.vsmconsortium.org © Value Stream Management Consortium Integration Testing 14 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
15. www.vsmconsortium.org © Value Stream Management Consortium User Acceptance Testing 15 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
16. www.vsmconsortium.org © Value Stream Management Consortium Non-Functional Testing (e.g., security) 16 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
17. www.vsmconsortium.org © Value Stream Management Consortium Environment/Release Orchestration 17 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
18. www.vsmconsortium.org © Value Stream Management Consortium Service Desk 18 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
19. www.vsmconsortium.org © Value Stream Management Consortium Logging & Monitoring 19 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
20. www.vsmconsortium.org © Value Stream Management Consortium Observability and AIOps 20 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
21. www.vsmconsortium.org © Value Stream Management Consortium Analytics & Dashboards 21 PORTFOLIO AND BACKLOG Vision and goals are set and aligned to epics, features, PBIs and user stories. INSIGHTS AND ANALYSIS Monitoring and observability provide insights into customer reaction to changes and report on value realization. CONTINUOUS INTEGRATION Code is created, artifacts incorporated, versions controlled, code is built in a trunk based manner. CONTINUOUS DELIVERY The changes are approved, released and operated in the live environment. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or gate through route to live. The DevOps Toolchain Module 4: Connecting DevOps Toolchains
22. www.vsmconsortium.org 22 Your Organization
23. www.vsmconsortium.org 23
24. www.vsmconsortium.org 24 Your Organization
25. www.vsmconsortium.org 25 Your Organization
26. www.vsmconsortium.org 26 Your Organization
27. www.vsmconsortium.org © Value Stream Management Consortium Value Stream Management Platform 27 Value Stream Management Connect planning to delivery Visibility into cross value stream changes Trace user stories as they travel Continuous compliance Manage dependencies while you break them Gain insights into waste; optimize flow Inspect real-time data and adapt Example Toolchain scope
28. www.vsmconsortium.org Ii VSM Reference Architecture Portfolio Management Task Management Artifact Management Source Control Management Continuous Integration Continuous Delivery Security Testing Infrastructure Management Performance Testing Release Management Change Management Monitoring / Logging Incident Management Enterprise architecture Information Management Financial reporting GRC Quality Management IDEATION DEVELOPMENT VALIDATION OPERATION REALIZATION Functional Testing The VSMI Landscape 28
29. www.vsmconsortium.org 29 Events datastore (Warehouse, Prometheus etc) - Historical Message Broker (CDEvents etc) - Realtime Jira Gitlab ServiceNow Plan Design Develop Deliver / Deploy Enable / Release Test Operate Build Learn & Adapt Value Stream Management Platform VSMI Datastore VSMI Broker Custom Pull Services VSMI Topology Activity Layer Realtime Layer Historic Layer Interface Layer Storage Layer Observation Layer
30. www.vsmconsortium.org Thanks for listening and keep flowing flow-ers!