“CRAWL” METRICS “RUN” METRICS “WALK” METRICS Deployment Frequency (DORA) P E D Flow Time C P E Team Health C P E D Customer NPS C P E D
What What What What
How often an organization successfully releases to production Time it takes a work item from customer request to production Distribution of work among team members Customer satisfaction with new products and features Measurement Measurement Measurement Measurement Deployments per Day Time in Days Work items distribution in terms of type and quantity Net Promoter Score Source Source Source Source Value Stream Delivery Platform Value Stream Delivery Platform + Agile Planning Agile Planning Tool Customer Success Management Platforms Impact potential Impact potential Impact potential Impact potential Increase customer value by reduced Time-to-Market Uncover process bottlenecks Create an even team workload distribution Delivery of the right features at the right time
Lead Time for Changes (DORA) P E D Flow Velocity C P E Return on Investment (ROI) C P Service Level Indicator (SLI) C P E
What What What What
The amount of time it takes a commit to get into production Completed work items over a given period of time Quantifiable business value produced by development efforts Performance against stated Service Level Objectives (SLO) and Agreements (SLA) Measurement Measurement Measurement Lead Time in Days Number of work items per time period Expenses vs Gains over time; Number of new customers Measurement Actual availability Source Source Source Value Stream Delivery Platform + Agile Planning Tool Value Stream Delivery Platform + Agile Planning Tool Business Process Software + CRM Source Application Monitoring Impact potential Impact potential Impact potential Increase developer efficiency Accelerate value delivery Improve planning; increase overall business value of spend Impact potential Increased customer satisfaction and retention
Change Failure Rate (DORA) P E D Flow Load C P E Number of Vulnerabilities C P E D
Cloud Costs C P E
What What What
The percentage of deployments leading to a degradation in service Number of work items in progress Software quality from the security standpoint What that must be addressed Cloud spend per product or service Measurement Measurement Measurement Number of active work items Number of vulnerabilities per product or service Measurement Number of incidents / number of deployments Costs in local currency Source Source Source Value Stream Delivery Platform + Agile Planning Tool Application Security Source Value Stream Delivery Platform + Incident Management System Cloud Provider Cost Management Impact potential Impact potential Impact potential Improve over and under-utilization Increase product or service security and limit work on Defects, Impact potential Increase customer satisfaction by decreased number of outages Risks and Debt Reduce run costs by increased visibility and accountability (FinOps)
Time to Restore Service (DORA) P E D Flow Efficiency C P E Team Satisfaction C E
D DevOps Teams C CTO / Product Operations
What What What P Product Manager E Engineering Leader
How long it takes an organization to recover from a failure in The distribution of work items in work and waiting states Employee satisfaction production Measurement Measurement Measurement Active work time / total time of flow Employee Net Promoter Score (eNPS) Restore Time in hours Source Source Source Value Stream Delivery Platform + Agile Planning Tool Employee engagement tools 5 Tips for using metrics sucessfully Value Stream Delivery Platform + Incident Management System Impact potential Impact potential Impact potential Identify waste Increase Developer engagement • Always define your own base and target levels for Increase customer satisfaction by decreased duration of outages metrics on product, team or company level
• Do not track metrics on a developer level
Monthly Active Users (MAU) P E D Flow Distribution C P E
• Do not compare apples and oranges. A mobile app
What What is not the same as a backend service Adoption rates for features, products or services Categorizing the types of work being done at any given time Measurement Measurement • Metrics should be used to measure the Monthly active users per feature, product or service Percentage distribution between Features, Defects, Risks and Debts work items improvement of DevOps teams, not to Source Source micromanage Application Monitoring Value Stream Delivery Platform + Agile Planning Tool Impact potential Impact potential • Learn from top-performing teams. You can even Alignment of features and user needs Improve the level of innovation and ensure you are covering security, tech debt and other issues gamify the improvement process between teams