Professional Documents
Culture Documents
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 1
Copyright
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 2
The Importance of Metrics Today
GRADE LEVEL COMPETENCY
1 Understand project metrics and key
performance indicators
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 4
Why Projects Get into Trouble
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 5
The Metrics Value Spectrum
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 6
Issues with Health Checks and Metrics
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 7
Timing of a Health Check
Health checks can be performed randomly when needed or
periodically throughout various life cycle stages.
However, there are specific circumstances that indicate that a
health check should be accomplished quickly. These include:
Significant scope creep
Escalating costs accompanied by a deterioration in value and
benefits
Schedule slippages that cannot be corrected
Missed deadlines
Poor morale accompanied by changes in key project
personnel
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 8
Misconceptions
The person doing the health check does not understand
the project or the corporate culture, thus wasting time.
The health check is too costly for the value we will get by
performing it.
The health check ties up critical resources in interviews.
By the time we get the results from the health check, it is
either too late to make changes or the nature of the
project may have changed.
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 9
New Developments in Project Management
New Success Criteria
Key Performance
Governance Indicators
Dashboard
Design
Measurement
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 10
Defining a Metric
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 11
Using Metrics
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 12
Benefits for Using Metrics
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 13
Metrics and Project Complexity
The larger and more complex the project, the greater
the difficulty in measuring and determining true
progress and success. Therefore, the larger and
more complex the project, the greater the need for
effective metrics.
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 14
Role of Metrics in Project Management
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 15
The Confusion over Metrics
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 16
The Selection of Metrics
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 17
The Metric Selection Process
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 18
Not All Metrics Can Be Used
Customers may desire real-time reporting rather than
periodic reporting, thus making some metrics
inappropriate.
The cost and complexity of the measurement may make a
metric inappropriate for use.
The metric does not fit well with the organizational process
assets available for an accurate measurement.
Project funding limits may restrict the number of metrics
that can be used.
Metrics must be periodically reviewed.
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 19
Defining and Selecting Metrics
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 20
Characteristics of a Metric
Has a need or a purpose
Provides useful information
Focuses toward a target
Can be measured with reasonable accuracy
Reflects the true status of the project
Supports proactive management
Assists in assessing the likelihood of success or failure
Is accepted by the stakeholders as a tool for informed decision-
making
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 21
Two General Categories of Metrics
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 22
Specific Types of Metrics
Quantitative metrics (planning dollars or hours as a percentage
of total labor)
Practical metrics (improved efficiencies)
Directional metrics (risk ratings getting better or worse)
Actionable metrics (affect change such as the number of
unstaffed hours)
Financial metrics (profit margins, ROI, etc.)
Milestone metrics (number of work packages on time)
End result or success metrics (customer satisfaction)
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 23
How Many Metrics are Needed?
Too many:
Metric management steals time from other work
Provides too much information such that
stakeholders cannot determine what information is
critical
Provides information that has limited or no value
Too few:
Fails to provide the right information
Inability to make informed decisions
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 24
Metrics Must Support Information Systems
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 25
Typical Questions Concerning Metrics
Collecting information and reporting:
Who will collect the information?
When will the information be collected?
When and how will the information be reported?
Measurements:
What should be measured?
When should it be measured?
How should it be measured?
Who will perform the measurement?
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 26
General Rule
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 27
Metric Measurements
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 28
The Metric/KPI Target Boundary Box
Performance
Characteristics
Favorably
Superior
Exceeding Target
Target + 10%
Performance Normal
Target
Target - 10%
Unfavorable
Caution
Expectation
Target - 20%
Risk of Project
Urgent Attention
Failure
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 29
Causes for Lack of Support with Metrics
Disagreements among the stakeholders
Mistrust among the stakeholders
Team members believe that metrics look like a spying
machine that allows management and stakeholders
to watch them closely
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 30
Metric Naysayers
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 31
Understanding the KPIs
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 32
Purpose of a KPI
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 33
The Need for Better KPIs
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 34
Dissecting the KPIs
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 35
Defining a KPI
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 36
Business vs. Project KPIs
Variable Business/Financial Project
Focus Financial measurement Project performance
Intent Meeting strategic goals Meeting project objectives,
milestones and deliverables
Reporting Monthly or quarterly Real-time data
Items to be looked at Profitability, market share, Adherence to competing
repeat business, number of constraints, validation and
new customers, etc… verification of performance
Length of use Decades of even longer Life of the project
Use of the data Information flow and Corrective action to maintain
changes to the strategy baselines
Target audience Executive management Stakeholders and working
levels
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 37
High-Level Purposes of a KPI
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 38
Categories of KPIs
Quantitative KPIs: numerical values
Practical KPIs: interfacing with company processes
Directional KPIs: getting better or worse
Actionable KPIs: effect change
Financial KPIs: performance measurements
Lagging KPIs: measure past performance
Leading KPIs: measure drivers for future
performance
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 39
Improper Selection of a KPI
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 40
Risks in the Number of KPIs
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 41
KPI Measurement
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 42
Typical KPI
Percent of work packages adhering to the schedule
Percent of work packages adhering to the budget
Number of assigned resources versus planned resources
Percent of actual versus planned baselines completed to date
Percent of actual versus planned best practices used
Project complexity factor
Customer satisfaction ratings
Number of critical assumptions made
Percent of critical assumptions that have changed
Number of cost revisions
Number of schedule revisions
Number of scope change review meetings
Number of critical constraints
Percent of work packages with a critical risk designation
Net operating margins
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 43
MahindraSatyam’s Customer Delight Index
(CDI)
SYMBOL MEANING
Data not entered
Dissatisfied
Satisfied
Delighted
(©2010 MahindraSatyam. All Rights Reserved.)
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 44
Complexities with Identifying KPI
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 46
Understanding Dashboards
Dashboards are communication tools to provide information at a glance
Dashboard design begins with an understanding of the user’s needs
Dashboard design can be done with simple displays
Dashboard design can be done with simple tools
Use the fewest metrics necessary
Determine the fewest metrics that can be retained in memory
Using too many colors or sophisticated, complex metaphors leads to
distractions
Limit metrics to a single screen
Perfection in design can never be achieved
Asking for assistance with the design effort is not an embarrassment
Monitor the health and user friendliness of the dashboard
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 47
Dashboard Design
Dashboard
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 48
Dashboard Design and Layout
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 50
Rules of Colors
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 51
Rules of Colors
Standard Colors Emphasis Colors
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 52
©2010 International Institute for Learning, Inc., All rights reserved. Intelligence, Integrity and Innovation | www.iil.com | 53