DevOps Topologies 10 years on: what have we learned about silos, collaboration, and flow? - ShipItCon 2024

In this talk, Matthew Skelton - founder at Conflux and co-author of the book Team Topologies - explores the key learnings from 10 years of Team Topologies and State of DevOps Reports and outlines key steps that organizations can take to improve IT delivery performance:

- Organize for flow
- Address team cognitive load
- Estimate the cost of “tangled software”
- Use the Accelerate metrics and community techniques to find good boundaries for flow
- Promote ‘active knowledge diffusion’ across organizational boundaries for alignment and staff engagement

By combining learnings from State of DevOps Reports and Team Topologies together with principles championed by the DevOps community and knowledge diffusion approaches like Adapt Together™️, organizations can navigate a route to business agility via a fast flow operating model.

---

From a keynote talk at ShipItCon 2024 - https://shipitcon.com/

Transcript

1. DevOps Topologies 10 years on: what have we learned about silos, collaboration, and flow? Matthew Skelton, Conflux - co-author of Team Topologies ShipItConf, Dublin | 30 August 2024 K26 Image CC BYNC Duncan Rawlinson https://duncan.co/land-of-plenty/
2. 2 Matthew Skelton holistic innovation Originator of Adapt Together™ by Conflux Co-author of Team Topologies matthewskelton.com
3. Team Topologies Organizing business and technology teams for fast flow Matthew Skelton & Manuel Pais IT Revolution Press, September 2019 Order via stores worldwide: teamtopologies.com/book 3
4. Ten years after SODOR and DevOps Topologies, what is holding back lower-performing organizations from improving their IT delivery performance? 4
5. 10 years on: DOTs and SODOR The cost of tangled software Accelerate metrics + TT for flow Success with fast flow 5
6. Decoupling of teams & technology for fast flow Diffusing of ideas for learning and alignment 7
7. [key point] 8
8. 10 years on: DevOps Topologies and State of DevOps Reports 9
9. 10 2013: Epic battles between Dev and Ops
10. 11 https://blog.matthewskelton.net/2013/10/22/what-team-s tructure-is-right-for-devops-to-flourish/
11. 12 https://web.devopstopologies.com/
12. 13 https://confluxhq.com/d evops-topologies
13. 14 https://web.devopstopologies.com/ Used by Netflix, Condé Nast, Accenture, etc. etc.
14. Thanks to Gene Kim and IT Revolution Press (and many other inspiring people) 15
16. 17 Image taken from devopstopologies.com - licensed under CC BY-SA Example: Anti-Type B (DevOps Team Silo)
17. 18 Image taken from devopstopologies.com - licensed under CC BY-SA Example: Anti-Type E (Rebranded SysAdmin)
18. 19 Image taken from devopstopologies.com - licensed under CC BY-SA Example: Anti-Type H (Fake SRE)
19. 20 Image taken from devopstopologies.com - licensed under CC BY-SA Example: Type 1 (Dev and Ops Collaboration)
20. 21 Image taken from devopstopologies.com - licensed under CC BY-SA Platform grouping Stream-aligned team Collaboration Flow of value DevOps Topologies (2013) Team Topologies (2019+)
21. 22 Image taken from devopstopologies.com - licensed under CC BY-SA Example: Type 3 (Ops as Infrastructure-as-a-Service (Platform))
22. Stream-aligned team 23 Image taken from devopstopologies.com - licensed under CC BY-SA Platform grouping Stream-aligned team Flow of value DevOps Topologies (2013) Team Topologies (2019+) XaaS XaaS
23. 24 Image taken from devopstopologies.com - licensed under CC BY-SA Example: Type 5 (DevOps Team with an Expiry Date)
24. 25 Image taken from devopstopologies.com - licensed under CC BY-SA Platform grouping Stream-aligned team Flow of value DevOps Topologies (2013) Team Topologies (2019+) Facilitating Enabling team
25. Platform grouping 26 Flow of change Stream-aligned team Stream-aligned team Complicated Subsystem team XaaS XaaS Collaboration Stream-aligned team xN 💡 Team Topologies diagrams are always just “snapshots in time”, never fixed designs
26. 27 0 - Address the dynamic interactions between teams and groups, not just static structure
27. 28 State of DevOps Reports (SODOR)
28. 29 State of DevOps reports 2013 2014 2015 2016 2017 2018 2019 Annual survey of 1000-5000 IT professionals worldwide using rigorous statistical methods 2020 2021 2022 2023 https://www.puppet.com/resources/history-of-devops-reports …
29. 30 State of DevOps 2019 “The use of cloud… is predictive of software delivery performance and availability.” “High performers favor strategies that create community structures at both low and high levels in the organization...”
30. 31 State of DevOps 2019 “Heavyweight change approval processes, such as change approval boards, negatively impact speed and stability. In contrast, having a clearly understood process for changes drives speed and stability, as well as reductions in burnout.”
31. 32 State of DevOps 2019 “We use a structural equation model (SEM), which is a predictive model used to test relationships” → Improvements in practices predict improved organizational performance
32. 34 Team Topologies practices are predictive of higher organizational performance - SODOR https://www.puppet.com/resources/state-of-devops-report “Highly evolved organizations tend to follow the Team Topologies model”
33. 35 Team Topologies ideas are now a key part of the AWS ‘Well-architected’ guidance https://docs.aws.amazon.com/wellarchitected/latest/devops-guida nce/oa.std.1-organize-teams-into-distinct-topology-types-to-optimiz e-the-value-stream.html “[OA.STD.1] Organize teams into distinct topology types to optimize the value stream”
34. 36 Team Topologies ideas are now a key part of the Azure ‘Cloud Adoption Framework’ https://learn.microsoft.com/en-us/azure/cloud-adoption-framew ork/ready/considerations/devops-teams-topologies “Consider establishing an enabling team that can … support applications and platforms … ”
35. 37 2013 2024+
36. 38 2013 2024+ Practitioner-led co-evolution
37. The cost of tangled software 40
38. 41 If each engineer in the organization is blocked for 1 hour per working day, how much does this cost?
39. 42 • Fully-loaded cost: €160k per year • 260 paid days per year • Total of 400 engineers
40. 43 Engineer fully weighted cost per year Engineer cost per day Hours blocked per 8-hour day Days blocked per 260-day year Cost of blockers per engineer per year Number of engineers Total cost of blockers per year €160,000.00 €615.38 1 32.5 €20,000.00 400 €8,000,000.00 €8 million per year 💥
41. Untangling ≃ Decoupling 44
42. Decoupling: separating things that do not need to be together 45
44. Decoupling enables shorter time-to-value 47
45. Decoupling enables multiple, independent flows of change, each with its own cadence 48
46. 49 Multiple, independent flows
47. 51 1 - Organizing for fast flow helps us to remove inter-team dependencies, improving financial efficiency and time-to-value
48. Accelerate metrics + TT for flow 52
49. 🔍 Use the 4 Key Metrics from Accelerate and add “blocker count” 53
50. Accelerate Building and Scaling High Performing Technology Organizations Nicole Forsgren, Jez Humble, Gene Kim IT Revolution Press, 2018 Order via stores worldwide: https://itrevolution.com/book/accelerate/ 54
51. 4 key metrics: ‘Accelerate’ lead time deployment frequency Mean Time To Restore change fail percentage
52. 4 key metrics: ‘Accelerate’ lead time deployment frequency Mean Time To Restore change fail percentage Encourage fast flow
53. 4 key metrics: ‘Accelerate’ lead time deployment frequency Mean Time To Restore change fail percentage Encourage operability
54. What % of lead time is actual work? Example: 120 hours / (120+630) x 100 = 16% Flow Efficiency 58
55. Measure ‘wait time’? https://www.isixsigma.com/methodology/lean-methodology/identify-constraints-and-reduce-wait-time-processes/ 59
56. Measuring ‘wait time’ is hard Count the number of blocking waits as a proxy ✨ 60
57. 4 key metrics & ‘blocker count’ lead time deployment frequency Mean Time To Restore change fail percentage ‘blocker count’ as a proxy for flow efficiency 61
58. Use 4 key metrics 📊 + “blocker count” to assess and find better service & team boundaries for flow 62
59. “If we adjusted the service & team boundary here, would it improve the 4 key metrics?” 💓 63
60. “If we adjusted the service & team boundary here, reduce the blocker count?” 📉 64
61. 65 TeamForm teamform.co
62. TeamOS 66 teamos.is Disclosure: Matthew Skelton has invested personally in the company behind TeamOS
63. Techniques from the Team Topologies community 67
64. 68 Independent Service Heuristics (ISH)
65. 69 “The Independent Service Heuristics (ISH) are rules-of-thumb (clues) for identifying candidate value streams and domain boundaries by seeing if they could be run as a separate SaaS/cloud product.” https://teamtopologies.com/ish
66. 70 User Needs Mapping (UNM)
67. 71 “User Needs Mapping attempts to capture the first 4 steps of the Wardley Mapping process … for identifying potential team [and service] boundary” https://teamtopologies.com/unm
68. 72 Team Interaction Modeling (TIM)
69. 73 “[Team Interaction Modeling helps] to describe how to re-organize … teams and their interactions to achieve better flow and deliver value faster.” https://teamtopologies.com/tim
70. 74 2 - Evolving at speed requires a set of core principles and practices, with people trained up and engaged
71. Success with fast flow 75
72. Case Study JP Morgan 76
73. Case Study “How JP Morgan Applied Team Topologies to Improve Flow in a Market Leading Enterprise Platform” 77 https://www.youtube.com/ watch?v=y3OL7dv2l48 Fast Flow Conf 💖 https://www.fastflowconf.com/
74. Case Study 78
75. Case Study “60% of dependencies reduced through better team design” 💥 79
76. 80 Engineer fully weighted cost per year Engineer cost per day Hours blocked per 8-hour day Days blocked per 260-day year Cost of blockers per engineer per year Number of engineers Total cost of blockers per year €160,000.00 €615.38 1 32.5 €20,000.00 400 €8,000,000.00 €8 million per year 💥 Remember this? [Note: these are not figures from JP Morgan]
77. Case Study GOV.UK Home Office 81
78. Case Study “How the Home Office’s Immigration Technology department reduced its cloud costs by 40%” 82 https://www.gov.uk/government/case-studies/how- the-home-offices-immigration-technology-departm ent-reduced-its-cloud-costs-by-40
79. 83 https://www.gov.uk/government/case-studies/how-the-home-offices-immigration-technology-department-reduced-its-cloud-costs-by-40
80. Case Study Making service owners accountable for the $ spend for their service helps to clarify service boundaries 💡 84
81. Use cost metrics as a “financial scalpel” 🔪 to split services apart for fast flow 85
82. 86 3 - Decouple, not coordinate.
83. Principles from Team Topologies that suggest certain architectures 93
84. 94 Multiple, independent flows, fractally
85. Respect Conway’s Law (aka ‘sociotechnical mirroring’) 95
86. Clear ongoing ownership of services and systems 96
87. Stream-aligned teams have end-to-end responsibility for a service (You Build It, You Run It) 97
88. Platforms improve flow and reduce extraneous cognitive load 98
89. Teams are small (~9), slowly changing, with ‘aligned autonomy’ 99
90. Teams are empowered to sense and adjust boundaries to improve flow on a frequent basis 100
91. 101 Architecture for fast flow resembles an ecosystem of loosely-coupled independently-viable services with clear boundaries and ownership aligned to the flow of business value.
92. 102 “With the explicit platform strategy [based on Team Topologies], we simplified upfront planning … for the whole organization. Defined interaction models between teams streamlined execution with just enough collaboration.” – Maksim Koutun, Director of Engineering @ Flo Health teamtopologies.com/flo
93. 103 “The work is delivered in many small changes that are uncoordinated to enable flow. … Management’s job is to provide context, prioritization and to coordinate across teams. Lending resources if needed across teams to unblock things. … It works well within a high trust culture.” Adrian Cockcroft https://mastodon.social/@adrianco/111174832280576410 Technology strategy advisor, Partner at OrionX.net (ex Amazon Sustainability, AWS, Battery Ventures, Netflix, eBay, Sun Microsystems, CCL)
94. 104 “The work is delivered in many small changes that are uncoordinated to enable flow. … Management’s job is to provide context, prioritization and to coordinate across teams. Lending resources if needed across teams to unblock things. … It works well within a high trust culture.” Adrian Cockcroft https://mastodon.social/@adrianco/111174832280576410 Technology strategy advisor, Partner at OrionX.net (ex Amazon Sustainability, AWS, Battery Ventures, Netflix, eBay, Sun Microsystems, CCL) It’s co pli ate !
95. 106 organize for fast flow of value We help product, technology and engineering leaders design high-impact team-of-teams organizations. teamtopologies.com
96. 107 4 - Multiple, loosely-coupled flows of value, with significant automation & helper tooling, aware of team cognitive load
97. 108 Multiple, independent flows, fractally
98. If we have clear boundaries for flow, with limited interactions, how do we create alignment? How do we learn from each other at pace? 109
99. 110 Multiple, independent flows, fractally
100. 111 Active diffusion of knowledge across team boundaries
101. 112 Alignment and engagement “High performers favor strategies that create community structures at both low and high levels in the organization...”
102. 113 internal conferences guilds Communities of Practice lunch & learn public blogs
103. 114 https://internaltechconf.com/ Internal Tech Conferences Victoria Morgan-Smith and Matthew Skelton
104. 115 “This initiative around internal conferences has been the single most effective thing to align business and technology that I have seen in this organization” – Murray Hennessey, CEO, (UK retail co)
105. 116 https://internaltechconf.com/ Internal Tech Conferences Victoria Morgan-Smith and Matthew Skelton It’s co pli ate !
106. 117 “The way that the Conflux crew used their active knowledge diffusion approach to seek out and champion good practices was a real revelation to us at TELUS and helped to shift thinking around how we innovate and share successes.” – Steven Tannock, Director, Architecture (Platform Technology & Tools) at TELUS Digital
107. 118 Thriving organizations, delivering at speed™ Create alignment, trust, and engagement across your organization whilst delivering at pace with fast flow. adapttogether.info
108. 119 5 - Fast flow organizations need active knowledge diffusion across flow boundaries to create trust, alignment, and learning
109. 10 years on: DOTs and SODOR The cost of tangled software Accelerate metrics + TT for flow Success with fast flow 148
110. Ten years after SODOR and DevOps Topologies, what is holding back lower-performing organizations from improving their IT delivery performance? 149
111. organizing for flow feels alien to many 👾 150
112. 151 limited mindset shifts
113. CxO concerns ignored 152
114. ‘silver bullet’ re-org 153
115. “structure” will fix it 154
116. hierarchy & ‘profession’ outweigh value flow 155
117. tight coupling in time 156
118. no knowledge diffusion 157
119. limited psych safety 158
120. 159 success factors
121. 160 0 - Address the dynamic interactions between teams and groups, not just static structure
122. 161 1 - Organizing for fast flow helps us to remove inter-team dependencies, improving financial efficiency and time-to-value
123. 162 2 - Evolving at speed requires a set of core principles and practices, with people trained up and engaged
124. 163 3 - Decouple, not coordinate.
125. 164 4 - Multiple, loosely-coupled flows of value, with significant automation & helper tooling, aware of team cognitive load
126. 165 5 - Fast flow organizations need active knowledge diffusion across flow boundaries to create trust, alignment, and learning
127. Decoupling of teams & technology for fast flow Diffusing of ideas for learning and alignment 166
128. Decoupling: teams, software, technology, deployments, data, business concepts, ... 167
129. Diffusing: principles, practices, learning, techniques, approaches, ... 168
130. 169 The Adapt Together™ approach from Conflux creates alignment, trust, and engagement across your organization whilst delivering at pace with fast flow. adapttogether.info Team Topologies is the leading approach to organizing business and technology teams for fast flow, providing a practical, step-by‑step, adaptive model for organizational design and team interaction. teamtopologies.com Copyright (c) 2017-2024 Conflux group of companies, Team Topologies Ltd, and Holistic Innovation Ltd. All Rights Reserved. The name “Conflux” and the filled C device are Registered Trademarks ® in multiple jurisdictions. The Team Topologies logo is a Registered Trademark ® in multiple jurisdictions.