© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 1 The Science Behind Building High Performing Teams Driving improvement with the DORA Assessment

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 2 Companies with high performing teams are twice as likely to exceed: ● profitability, productivity, market share ● effectiveness and efficiency ● customer satisfaction ratings ● achievement of mission goals Research shows that IT Performance—the ability to develop and deliver quality software with both speed and stability—drives transformation from Low to High Performance High performing teams make you competitive Source: State of DevOps Report 2013-2017 2x

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 3 Speed and Stability: You Can Have Both

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 4 Transformation initiatives often fail Teams struggle during transformation processes because they: ● get caught in implementation details ● waste time and money doing the wrong non-impactful work ● get trapped in subject debates defining “progress” ● lack objective views (without politics & opinions) ● fail to prioritize and limit the number of initiatives ● lack insights into what success means for their own setting ● fail to tie progress back to business initiatives

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 5 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. “Maturity models” fail because they are static one-size-fits-all views Impact performance with a metrics driven continuous improvement cycle customized for your organization Assess Key Outcomes that drive performance gains Benchmark Current Capabilities as a baseline Identify Priorities most impactful for capability improvement Measure Progress to find wins Focus on IT Performance

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 6 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. High-level measures indicate your software delivery performance and its sustainability across teams We help you measure and track your most important key outcomes Benchmark against industry, industry vertical, and/or company-wide Get individual team performance against different views Identify outcomes to maximize Identify outcomes to minimize (e.g. “burnout”) (Example) This outcomes chart shows us that we have room for improvement compared to the Industry High Performers. Our practitioners report burnout below industry averages, but significantly higher than average levels of deploy pain. Key Outcomes The DORA Assessment

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 7 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. Capabilities are levers that drive improvement: as these grow, so does your ability to deliver software quickly and reliably We show you which capabilities you have now: where you shine & where you need help Benchmark against industry, industry vertical, and/or company-wide Team performance indicated by shaded area fill Develop capabilities to deliver on outcomes (Example) High: Architecture, Security, Collaboration, Learning, Westrum culture, Visibility, WIP limits Low: Test data management, Test Automation, Trunk-based development, Deploy automation Current Capabilities Legend Metrics & monitoring Cultural Technical Process The DORA Platform

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 8 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. Customized analysis identifies your constraints, or bottlenecks, to achieving high performance We show you which capabilities to focus on first Leaders can plan allocations so investments have the highest impact Identify capabilities with lowest strength and highest impact on Software Delivery Performance (Example) DORA recommends focusing on introducing trunk-based development patterns, improving monitoring, and developing deployment automation Identify Priorities Legend Metrics & monitoring Cultural Technical Process The DORA method

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 9 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. “DORA gave us a way to measure things that we just couldn't measure before. Now we had visibility into what was happening in our software engineering lifecycle." Chivas Nambiar Director, Verizon “[DORA] focused our efforts on the right work which resulted in accelerated maturity. … The work with DORA gave us insights that now teams are better informed, which is resulting in a quicker path to Continuous Delivery.” Adam Auerbach Senior Director, Capital One Customer Quotes

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 10 The DORA method - How Progress works DORA Assessment and Transformation Acceleration Journey 1. Measure Company Performance Fifty or more people from various teams including operations, development, InfoSec, and testing, take our 20m survey. Because we gather data from practitioners, we get a thorough view of your current organizational capabilities. 2. Benchmark Against Others Understand your team performance. See how you benchmark against other company LOBs, across your org, the overall IT industry, or IT high performers. These different views help you clearly identify the priorities that matter most to your company. 3. Set Your Customized Priorities Discover how to make the biggest and most impactful investments that drive performance and IT transformation. Reveal precisely which bottlenecks hold back your organization with proprietary analysis to help you make tough prioritization decisions. 4. Develop Your Capabilities Curated and authored by industry experts, the exclusive DORA knowledge base can show you how to start developing capabilities across your teams. Or work in tandem with one of our certified partners to accelerate your transformation. 5. Track Your Progress Celebrate your wins, demonstrate ROI, and identify next steps methodically with a periodic reassessment of your organizational improvement. DORA recommends tracking in approximately six month intervals.

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 11 Recurring Assessments ● First: baseline performance ● Second: show progress (~6 months) ● Benchmarks across over 23,000 teams The DORA method - Years of research in weeks Week 1 Step 1: Decompose organizations Step 2: Prepare for assessment Step 3: Take DORA Survey Week 2 Week 3 Week 4 Step 5: Deliver Reports Week 5 Step 4: Close Data Collection DORA Knowledge Base ● Guidance & insights into developing capabilities ● Avoiding pitfalls, tips, and instrumentation ● Case studies deep-diving many capabilities Implement Continuous Improvement with a DORA subscription

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 12 Common DORA customer goals ● Improving technology & organizational performance ○ Assessment only focuses on capabilities that have been shown to improve performance ● Prioritizing improvement efforts ○ Customized guidance is geared toward targeting specific areas of improvement ● Attracting and retaining talent ○ Employees in high-performance teams are 2.2X more likely to recommend their organizations as a great place to work ● Establishing your brand as a high-performance organization ○ Top organizations rely on DORA’s research and assessments to improve their work

© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved. 14 About DORA The DORA Team Dr. Nicole Forsgren: PhD, sysadmin, scientist, named top 10 influencer and leader in DevOps Gene Kim: Founder of Tripwire Inc, author of The Phoenix Project, Visible Ops Handbook, and more Jez Humble: Author of Continuous Delivery, Lean Enterprise, and The DevOps Handbook Soo Choi: NASA, Anso Labs, OpenStack co-founder, Rackspace, Chef Software DORA’s founders are the lead researchers for the State of DevOps Reports, presented by DORA and Puppet