An overview of DORA's assessment product
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.1The Science Behind BuildingHigh Performing TeamsDriving improvement with the DORA Assessment
View Slide
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.2Companies with high performing teams are twiceas likely to exceed:● profitability, productivity, market share● effectiveness and efficiency● customer satisfaction ratings● achievement of mission goalsResearch shows that IT Performance—the ability todevelop and deliver quality software with both speed andstability—drives transformation from Low to HighPerformanceHigh performing teams make you competitiveSource: State of DevOps Report 2013-20172x
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.3Speed and Stability: You Can Have Both
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.4Transformation initiatives often failTeams struggle during transformation processes because they:● get caught in implementation details● waste time and money doing the wrong non-impactful work● get trapped in subject debates defining “progress”● lack objective views (without politics & opinions)● fail to prioritize and limit the number of initiatives● lack insights into what success means for their own setting● fail to tie progress back to business initiatives
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.5 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.“Maturity models” fail because theyare static one-size-fits-all viewsImpact performance with a metricsdriven continuous improvement cyclecustomized for your organizationAssess Key Outcomes that driveperformance gainsBenchmark Current Capabilitiesas a baselineIdentify Priorities mostimpactful for capabilityimprovementMeasure Progress to find winsFocus on IT Performance
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.6 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.High-level measures indicateyour software deliveryperformance and itssustainability across teamsWe help you measure and track yourmost important key outcomesBenchmark against industry, industryvertical, and/or company-wideGet individual team performanceagainst different viewsIdentify outcomes to maximizeIdentify outcomes to minimize (e.g.“burnout”)(Example)This outcomes chart shows us that we have room for improvement compared tothe Industry High Performers.Our practitioners report burnout below industry averages, but significantly higherthan average levels of deploy pain.Key OutcomesThe DORA Assessment
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.7 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.Capabilities are levers thatdrive improvement: as thesegrow, so does your ability todeliver software quickly andreliablyWe show you which capabilities youhave now: where you shine & whereyou need helpBenchmark against industry, industryvertical, and/or company-wideTeam performance indicated byshaded area fillDevelop capabilities to deliver onoutcomes(Example)High: Architecture, Security, Collaboration, Learning, Westrum culture, Visibility, WIP limitsLow: Test data management, Test Automation, Trunk-based development, Deploy automationCurrent CapabilitiesLegendMetrics & monitoringCulturalTechnicalProcessThe DORA Platform
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.8 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.Customized analysisidentifies your constraints, orbottlenecks, to achievinghigh performanceWe show you which capabilities tofocus on firstLeaders can plan allocations soinvestments have the highest impactIdentify capabilities with loweststrength and highest impact onSoftware Delivery Performance(Example)DORA recommends focusing on introducing trunk-based development patterns, improvingmonitoring, and developing deployment automationIdentify PrioritiesLegendMetrics & monitoringCulturalTechnicalProcessThe DORA method
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.9 © 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.“DORA gave us a way to measure thingsthat we just couldn't measure before.Now we had visibility into what washappening in our software engineeringlifecycle."Chivas NambiarDirector, Verizon“[DORA] focused our efforts on theright work which resulted inaccelerated maturity.… The work with DORA gave usinsights that now teams are betterinformed, which is resulting in aquicker path to Continuous Delivery.”Adam AuerbachSenior Director,Capital OneCustomer Quotes
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.10The DORA method - How Progress worksDORA Assessment and Transformation Acceleration Journey1. MeasureCompanyPerformanceFifty or more peoplefrom various teamsincluding operations,development, InfoSec,and testing, take our 20msurvey. Because wegather data frompractitioners, we get athorough view of yourcurrent organizationalcapabilities.2. BenchmarkAgainstOthersUnderstand your teamperformance. See howyou benchmark againstother company LOBs,across your org, theoverall IT industry, or IThigh performers. Thesedifferent views help youclearly identify thepriorities that matter mostto your company.3. Set YourCustomizedPrioritiesDiscover how to make thebiggest and mostimpactful investmentsthat drive performanceand IT transformation.Reveal precisely whichbottlenecks hold backyour organization withproprietary analysis tohelp you make toughprioritization decisions.4. Develop YourCapabilitiesCurated and authored byindustry experts, theexclusive DORAknowledge base canshow you how to startdeveloping capabilitiesacross your teams. Orwork in tandem with oneof our certified partnersto accelerate yourtransformation.5. TrackYourProgressCelebrate your wins,demonstrate ROI, andidentify next stepsmethodically with aperiodic reassessment ofyour organizationalimprovement. DORArecommends tracking inapproximately six monthintervals.
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.11Recurring Assessments● First: baseline performance● Second: show progress (~6 months)● Benchmarks across over 23,000 teamsThe DORA method - Years of research in weeksWeek 1Step 1:DecomposeorganizationsStep 2:Prepare forassessmentStep 3:Take DORA SurveyWeek 2 Week 3 Week 4Step 5:DeliverReportsWeek 5Step 4:Close DataCollectionDORA Knowledge Base● Guidance & insights into developing capabilities● Avoiding pitfalls, tips, and instrumentation● Case studies deep-diving many capabilitiesImplement Continuous Improvement with a DORA subscription
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.12Common DORA customer goals● Improving technology & organizational performance○ Assessment only focuses on capabilities that have been shown to improve performance● Prioritizing improvement efforts○ Customized guidance is geared toward targeting specific areas of improvement● Attracting and retaining talent○ Employees in high-performance teams are 2.2X more likely to recommend theirorganizations as a great place to work● Establishing your brand as a high-performance organization○ Top organizations rely on DORA’s research and assessments to improve their work
© 2016-2017, DevOps Research and Assessment, LLC. All Rights Reserved.14About DORAThe DORA TeamDr. Nicole Forsgren: PhD, sysadmin, scientist, named top 10 influencer and leader in DevOpsGene Kim: Founder of Tripwire Inc, author of The Phoenix Project, Visible Ops Handbook, and moreJez Humble: Author of Continuous Delivery, Lean Enterprise, and The DevOps HandbookSoo Choi: NASA, Anso Labs, OpenStack co-founder, Rackspace, Chef SoftwareDORA’s founders are the lead researchers for the State of DevOps Reports, presented by DORA and Puppet