Measuring DevOps Bukola Johnson DevOps Engineer at anynines GmbH Google WTM Ambassador PRACTITIONER

Key Metrics in Measuring DevOps Success PRACTITIONER

© 2021 All Rights Reserved. 3 Why Measure DevOps 4 key DevOps Metrics How do you compare? DevOps Metrics Dashboard Tools How to improve software delivery performance

© 2021 All Rights Reserved. 4 An organizational and cultural movement that aims to increase software delivery velocity, improve service reliability, and build shared ownership among software stakeholders. Source: cloud.google.com/devops What is DevOps ?

© 2021 All Rights Reserved. 5 “If you can’t measure it, you can’t improve it.” - Peter Drucker Why Measure DevOps?

© 2021 All Rights Reserved. 6 ● To get the effectiveness of DevOps practices. Why Measure DevOps? ● To measure software delivery throughout and stability to understand how teams can improve. ● Make data-based decisions rather than relying on gut instinct. ● To identify pain points and slowness in pipelines and processes.

© 2021 All Rights Reserved. 7 Four Key DevOps Metrics Deployment Frequency Lead Time For Changes Change Failure Rate Time to Restore Service

© 2021 All Rights Reserved. 8 How often does your organization deploy code to production or release it to end users? Deployment Frequency

© 2021 All Rights Reserved. 9 How long does it take to go from code committed to code successfully running in production Lead Time For Changes

© 2021 All Rights Reserved. 10 The percentage of deployments/changes that result in errors or poor application performance in production that require rolling an immediate fix Change Failure Rate

© 2021 All Rights Reserved. 11 When a failure occurs in production, how long does it take to restore service Time to Restore Service

© 2021 All Rights Reserved. 12 Benchmark : How do you compare? Deployment Frequency - Elite: On-demand (multiple deploys per day) - High: Once/day - Once/week - Medium: Once/week - Once/Month - Low: Once/month - Once/6 months Lead Time For Changes - Elite: Less than 1 day - High: 1 day - 1 week - Medium: 1 week - 1 month - Low: 1 month - 6 months Change Failure Rate - Elite, High and Medium : 0-15% - Low: 46-60% - Time To Restore Service - Elite: Less than 1 hour - High and Medium: : Less than 1 day - Low: 1 week - 1 month Source : State of DevOps 2019

DevOps Metrics Dashboard Tools

© 2021 All Rights Reserved. 14 ● Jenkins ● Concourse etc - Build/Deployment frequency: Number of jobs you run per day. CI/CD Tools

© 2021 All Rights Reserved. 15 ● Shows cycle time of product, version, or sprint. ● Maps time spent on issues over specified time - Lead Time for change: Can be derived by using the Control Chart https://www.atlassian.com/software JIRA - Control Chart

© 2021 All Rights Reserved. 16 JIRA - Control Chart Source: Atlassian

© 2021 All Rights Reserved. 17 ● Open source Project by Google ● Designed to collect data and convert it into a dashboard to display the four key metrics https://github.com/GoogleCloudPlatform/fourkeys Google Cloud Platform fourkeys

© 2021 All Rights Reserved. 18 Google Cloud Platform fourkeys Source: cloud.google.com

© 2021 All Rights Reserved. 19 ● Grafana is an open-source platform for monitoring and observability ● Highly Customisable Dashboard tool https://grafana.com/grafana/ Grafana Dashboard

© 2021 All Rights Reserved. 20 Grafana Dashboard Source: dzone

© 2021 All Rights Reserved. 21 ● Hygieia is a DevOps dashboard by CapitalOne ● Open-source ● Configurable view https://github.com/hygieia/hygieia Hygieia Dashboard

© 2021 All Rights Reserved. 22 Hygieia Dashboard Source: Capital One Hygieia

© 2021 All Rights Reserved. 23 ● A monitoring and security platform for cloud applications ● Monitor code deployments with Deployment Tracking in Datadog APM ● Customizable dashboards https://docs.datadoghq.com/tracing/deployment_tracking/ Datadog

© 2021 All Rights Reserved. 24 Datadog Source: Datadoghq.com

© 2021 All Rights Reserved. 25 ● Automate your deployment process - Continuous Integration / Continuous Delivery(deployment) - Version Control How to Improve Software Delivery Performance ● Leverage Cloud Services ● Change Approval Process ● Implement Test Automation ● Proactive Monitoring

© 2021 All Rights Reserved. 26 Metrics are how you know how well you are progressing towards your goals, The goal is to improve your performance not to improve your metrics !! source: www.sleuth.io

Bukola Johnson DevOps Engineer bukecious bukola-johnson Thank you!