You are on page 1of 16

113R-

20

INTEGRATEDCOSTANDSCHEDULE
RISKANAL YSI
SANDCONTI
NGENCY
DETERMI NATI
ONUSI
NG
COMBI NEDPARAMETRI
CAND
EXPECTEDVALUE
AACE® International Recommended Practice No. 113R-20

INTEGRATED COST AND SCHEDULE RISK ANALYSIS AND


CONTINGENCY DETERMINATION USING COMBINED
PARAMETRIC AND EXPECTED VALUE
TCM Framework: 7.6 – Risk Management

Rev. May 27, 2021


Note: As AACE International Recommended Practices evolve over time, please refer to web.aacei.org for the latest
revisions.

Any terms found in AACE Recommended Practice 10S-90, Cost Engineering Terminology, supersede terms defined in
other AACE work products, including but not limited to, other recommended practices, the Total Cost Management
Framework, and Skills & Knowledge of Cost Engineering.

Contributors:
Disclaimer: The content provided by the contributors to this recommended practice is their own and does not necessarily
reflect that of their employers, unless otherwise stated.

John K. Hollmann, PE CCP CEP DRMP FAACE Hon. Life Francisco Cruz, PE
(Primary Contributor) Dr. David T. Hulett, FAACE
Colin H. Cropley Martin Snyman, DRMP

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.

This document is copyrighted by AACE International and may not be reproduced without permission. Organizations may obtain permission
to reproduce a limited number of copies by entering into a license agreement. For information please contact editor@aacei.org
AACE® International Recommended Practice No. 113R-20
INTEGRATED COST AND SCHEDULE RISK ANALYSIS
AND CONTINGENCY DETERMINATION USING
COMBINED PARAMETRIC AND EXPECTED VALUE
TCM Framework: 7.6 – Risk Management

May 27, 2021

TABLE OF CONTENTS

Table of Contents ..........................................................................................................................................................1


1. Introduction ...............................................................................................................................................................2
1.2. Purpose ...............................................................................................................................................................2
1.3. Background .........................................................................................................................................................2
2. Recommended Practice .............................................................................................................................................4
2.1. Hybrid Application Steps ....................................................................................................................................4
2.2. Hybrid Tool Example ...........................................................................................................................................7
2.2.1. Parametric Model ........................................................................................................................................7
2.2.2. P+EV Model .................................................................................................................................................9
3. Special Considerations for Hybrid Application ........................................................................................................11
3.1. Note on Joint Confidence Level (JCL) Determination .......................................................................................12
4. Comparison of the P+EV Hybrid Method to RP 40R-08 Principles ..........................................................................12
5. Summary ..................................................................................................................................................................14
References ...................................................................................................................................................................14
Contributors ................................................................................................................................................................14

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 2 of 14
Combined Parametric and Expected Value

May 27, 2021

1. INTRODUCTION

1.1. Scope

This recommended practice (RP) of AACE International (AACE) defines general practices and considerations for
integrated cost and schedule risk analysis and estimating contingency using a combination or hybrid of parametric
risk modeling and integrated cost and schedule expected value analysis with Monte Carlo Simulation methods. P+EV
is used as a shorthand designation for the combination. In this RP, EV always refers to expected value (not earned
value). The base methods are covered separately in RP 42R-08 (Risk Analysis and Contingency Determination Using
Parametric Estimating), RP 44R-08 (Risk Analysis and Contingency Determination Using Expected Value) and RP 65R-
11 (Integrated Cost and Schedule Risk Analysis and Contingency Determination using Expected Value) respectively
[1,2,3]. Those RPs should be reviewed for details of the respective methods; this RP is focused on how to use them
in combination. Descriptions of other recommended risk quantification practices can be found in AACE Professional
Guidance Document PGD-02, Guide to Quantitative Risk Analysis [4].

The P+EV method is a fit-for-use, practical, risk-driven method intended to support management’s need for
integrated distributions of potential project cost and schedule outcomes to support investment decision making and
from which contingency and reserves can be established. It is focused on the bottom-line cost and completion date.
This is not an ideal method for understanding risk at a more detailed level such as what the risk impact might be on
an intermediate schedule milestone, or an estimate WBS element. For such in-depth analysis and understanding,
the hybrid combination of the parametric method with the risk-driven critical path schedule method is
recommended (i.e., P+CPM) (117R-21 [5]).

1.2. Purpose

This RP is intended to provide guidelines, not a standard, for contingency estimating that most practitioners would
consider to be good practices that can be relied on and that they would recommend be considered for use where
applicable. There is a range of useful risk analysis and contingency estimating methodologies; this RP will help guide
practitioners in developing or selecting appropriate methods for their situation.

It is an AACE recommendation that whenever the term risk is used, that the term’s meaning be clearly defined for
the purpose of the practice. The parametric modeling method described herein quantifies the impact of systemic
risks (defined in this RP) which include both threats and opportunities, and, from a quantitative perspective, are
uncertainties; i.e., as measures of attributes of or facts about a project system, the probability of occurrence is 100%.
The expected value method is focused on critical project-specific risks that includes both threats and opportunities
and may either be uncertainties (as described above) or risk events (i.e., contingent risks) for which the probability
of occurrence is less than 100%.

1.3. Background

The integrated, hybrid cost and schedule risk quantification method covered by this RP combines parametric
modeling of systemic risks (parametric) and expected value with Monte-Carlo simulation (EV w/MCS) modeling of
project-specific risks. P+EV is used as a shorthand designation for the combination. The component methods are
addressed in RPs 42R-08, 44R-08 and 65R-11 respectively. Two methods are combined because no single method is
optimal for quantifying both systemic and project-specific risks. The parametric model offers empirically-based input
to risk quantification that is largely missing with pure MCS. MCS is required in this hybrid combination to model the
EV portion and to integrate the analyses results. Only the mean values of method outputs are additive (e.g., the
overall cost or duration at say p70 confidence level is not the sum of the separate analyses p70 values). Figure 1
illustrates the hybrid concept:

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 3 of 14
Combined Parametric and Expected Value

May 27, 2021

Figure 1 – Hybrid Parametric and EV w/MCS method (P+EV)

Systemic risks are those that have systematically predictable relationships to overall project cost and schedule
growth outcomes [6]. The term systemic implies that the risk is an artifact of the project system, i.e., culture,
capabilities, competencies, decision making, complexity, level of technology, and so on. This includes estimating and
scheduling process uncertainties as well (e.g., rates, quantity takeoff, productivities, production rates, etc.). Some
would call these inherent or background risk or general uncertainty. Systemic risks are dominant for poorly defined
projects and/or weak project systems; hence the parametric method is ideal for early phase estimates. Systemic risk
impacts are best modeled based on empirical research of past projects; i.e., multi-variable linear regression (MLR)
or similar analysis (e.g., machine learning) of historical data on risk drivers and their cost and schedule impacts (RP
42R-08 and by extension this RP only address MLR).

Project-specific (P-S) risks are those that do not have predictable, systematic relationships with outcomes, i.e., they
are specific to the project. These are most commonly risk events or conditions although they may also include project
specific uncertainties (e.g., weather variability). Project-Specific risk assessment is amenable to traditional
brainstorming workshops or interviews and can be realistically modeled using EV methods (i.e., probability times
impact with MCS). In the EV method, only critical project-specific risks are quantified, i.e., those with the potential
of material impact on project success. Most risks in a risk register will not meet this criterion. For these critical risks,
the quantitative analysis will first assure that the nature of the risk is well understood (e.g., is the cause understood,
has too much credit been taken for mitigation efficacy, etc.?), and the probability of occurrence and their impact
will be reviewed; i.e., the information in a risk register is never accepted or used verbatim.

It should be noted that a project system attribute (i.e., a systemic risk) can change, or be changed, after the risk
analysis. However, in the P+EV method, uncertain future states of the system are not rated or credited. Any planned
or anticipated change in the project system (i.e., a mitigation) is analyzed as a project-specific risk (an event) that
may or may not occur and may or may not be effective. For example, the project control system at the time of
analysis may be poor, but a new system is planned for implementation during the project. In this case, the systemic
risk is the rating of the current system state, and the new control system implementation is an opportunity with
some probability of it being implemented and being effective with some assumed improvement of cost and/or
schedule (however, such changes are unlikely to be critical).

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 4 of 14
Combined Parametric and Expected Value

May 27, 2021

2. RECOMMENDED PRACTICE

2.1. Hybrid Application Steps

As discussed, RPs 42R-08, 44R-08 and 65R-11 must be reviewed for background and details of each of the underlying
methods. This is not a stand-alone RP. The steps of applying these methods in a combined or P+EV hybrid approach
have been summarized in several AACE International papers, but also a comprehensive text on the method [7,8,9].

The steps of this process assume that tools are in place for 1) parametric analysis of systemic risks and 2) for expected
value analysis with MCS for project-specific risks. Most often, the parametric tool will be based upon either the
Hackney or Rand models that are documented (and provided in Excel® form) in RP 43R-08, Risk Analysis and
Contingency Determination Using Parametric Estimating – Example Models as Applied for the Process Industries [10].
The models in RP 43R-08 generate predicted mean cost growth and, for the Rand model, the schedule slip. RP 42R-
08 describes how to derive a probabilistic distribution from these mean outcomes. The EV tool with MCS is a fairly
basic spreadsheet (no complex or unusual math or functions or macros necessary) with MCS applied. The only
connection between the tools is the need to copy the parametric tool’s cost and schedule output distributions into
the EV tool as will be discussed.

With the tools in place, the steps in applying them as a hybrid application are as follows:

Step 1: Per RP 42R-08; Apply Parametric Model:


Assess and quantify the systemic risks and enter them in an empirically-based parametric cost and schedule
contingency estimating model. If the estimate and schedule are AACE® Class 5, the analysis is complete, determine
the cost and schedule contingency based on management’s risk tolerance and the parametric model’s probabilistic
output. If the estimate and schedule are AACE® Class 4 or better (i.e., critical project-specific risks can be identified),
continue to the EV w/MCS method in step 2.

Step 2: Per RP 44R-08; Screen the Risk Register and Identify Critical Risks:
Optimally, the risk register will already have categorized each risk by quantification method type to be applied (i.e.,
create a column in the risk register to identify if the risk is systemic, project-specific, escalation or currency). This
categorization can be a challenge because risks are often not well titled or described as to their nature and cause. In
general, the more ambiguous, or the more the risk is in the nature of a worry or an issue, the greater the likelihood
a risk is systemic.

Further screen the project-specific risks to develop a list of those that are critical and refine the descriptions of their
nature and cause. The definition of critical risks is included in RP 44R-08, but in general these are risks that have a
material impact on the project economics. Risks are selected based on their post treatment, residual status. Check
for any risks that were critical pre-treatment, but non-critical after mitigation; assure that the risk reduction credited
to the mitigation is realistic. Post treatment, there should typically be no more than 5 to 15 critical risks, keeping in
mind that by definition any one critical risk will put the project success at risk. Having too large a number of critical
risks implies that the project may not be viable. Note that escalation and currency risks are not covered in this RP
(see RP 68R-11, Escalation Estimating Using Indices and Monte Carlo Simulation [12].

Step 3: Per RP 44R-08; Quantify the Probabilities of Occurrence:


Capture the critical risk titles and clear description in the EV tool (do not link to the risk register: start fresh). Assess
and input the percent probability of occurrence for each critical risk (again, this is post-treatment residual risk).
Probability can be treated as a distribution depending on the team’s confidence in their assessment as discussed in
RP 44R-08. Establish any dependencies between the risks (or combine risks if they are similar in nature), again as
discussed in RP 44R-08 and/or 65R-11.

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 5 of 14
Combined Parametric and Expected Value

May 27, 2021

Step 4: Per RP 65R-11; Quantify the Burn Rates:


The burn rate is the approximate spending per month (or other period used) during the anticipated delay duration.
This typically includes direct field labor, labor indirects (e.g., temporary facilities), general services (e.g., camps), and
owner and contractor project management. Burn rate can be estimated on a case-by-case basis or pre-determined
for project contracts (e.g., site preparation) or phases. The estimates are Class 5 in quality realizing that cash flow
can vary widely, some portion of the labor may be productively employed on other activities, and so on. Optionally,
the burn rate(s) could be entered as a 3-point distribution in MCS.

Step 5: Per RP 65R-11; Plan the Risk Responses:


Determine and document the assumed or planned risk response (i.e., the contingency or contingent plan). Note that
this response is the action(s) the team will take if and when the risk occurs. It is not a treatment or mitigation (hence
the term treatment and response are separate and unique in this methodology). The response in large part defines
the scope of the impact estimates. For example, if the project is schedule-driven, money may be no object (within
reason) to the business to recover the schedule; so, a fast/costly risk response is defined. If management is unsure
as to the response, then the impact estimates in the next step will have a correspondingly wide range to cover the
various response possibilities.

Step 6: Per RP 65R-11; Quantify the Schedule and Cost Impacts:


Estimate and input the schedule and cost impacts of each critical risk. These are typically 3-point estimates with an
associated 3-point probability distribution function (PDF). The impact estimates reflect the risk response(s)
anticipated, i.e., the risk response largely defines the scope of the impact estimate.

For schedule, the duration impact, considering the risk response, is to the completion milestone. As described in RP
65R-11, team knowledge of what is on or near the critical path and the network’s general, dynamic behavior is
needed. If confidence is low in understanding of the impact to the completion date, this should be reflected in the
range of the 3-point delay estimate.

For cost, the impact is a combination of time-dependent costs for schedule delays plus the non-time driven cost
considering the risk response. The time-dependent cost is the schedule delay times the applicable burn rate from
Step 4. The non-time dependent cost is the range of potential expenditures considering the risk response.

The EV tool will be set up to perform the calculation of the EV of the cost and of the schedule duration impact of
each risk (probability times impact). In MCS, the simulation results for each risk, or subtotal of several risks, can be
captured independently if desired. This subtotal result can be used to assess the impact on intermediate milestones
if one or more of the risks drive that milestone (see RP 65R-11).

Step 7: This RP; Integrate the Parametric Model Outputs into the EV Model (this creates the hybrid):
To integrate the parametric and EV results, include the parametric model output distributions (re: Step 1) as the first
critical risk in the EV w/MCS tool. The probability of occurrence of the systemic risk is 100 percent (i.e., it is a fact or
attribute of the project system). Systemic risks are treated as independent of the project-specific risks for this
method. The cost and schedule outcome distributions are defined as custom PDFs; this can be as simple as using 3-
point trigen distributions for an 80 percent confidence interval and entering the parametric p10, p50 and p90 values.

Using the MCS software, a correlation coefficient should be established between the parametric model cost and
schedule PDFs. A coefficient of 0.5 is suggested as a reasonable rule of thumb1; systemic risks by nature are positively
correlated to a moderate extent (e.g., poor scope definition will always result in increased cost growth and schedule
slip). However, a project such as offshore drilling for which cost (i.e., based on day-rates) is highly schedule-driven

1
The Rand Corporation research referenced in RP 43R-11 found a correlation coefficient of 0.41 between cost growth and schedule slip
outcomes driven by systemic risks [11].

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 6 of 14
Combined Parametric and Expected Value

May 27, 2021

may have a higher coefficient, and a schedule-driven project for which money is no object (see risk response
discussion), may have somewhat less correlation. Excessive focus on this correlation is not value-adding.

Step 8: This RP; Run the MCS Simulation:


The P+EV tool will be set up to sum all of the schedule and cost impacts for the systemic and critical risks. Run the
MCS which will generate the overall cost and schedule distributions. Determine the overall cost and schedule
contingency (and reserves if appropriate) based on policy or management’s risk tolerance. Because there is
correlation between the systemic cost and schedule outcomes, and the project-specific risk impacts in the EV
method are based on assumed risk responses that consider cost/schedule trading, the cost and schedule results are
integrated.

Step 7 is highlighted in bold because that step ties the parametric and EV methods together into a single model for
MCS. The following summarizes the hybrid P+EV application in flow chart format. Note the input of parametric
modeling of systemic risks into the EV w/MCS model is shown in the last row. Escalation is not included in the P+EV
method but is shown here to illustrate that the cost and schedule distributions can be used as inputs to a probabilistic
escalation tool.

Figure 2 – Hybrid Parametric and EV w/MCS Method Flow Chart [9; with permission]

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 7 of 14
Combined Parametric and Expected Value

May 27, 2021

2.2. Hybrid Tool Example

This section provides an example of a P+EV toolset and illustrates the analysis steps applied in a tool. The toolset
shown in the example figures are simplified, but functional tools used in training on the P+EV method [9].

2.2.1. Parametric Model

Figure 3 is a snapshot of a parametric model worksheet in Excel®. In the upper part, the parameters for the project
are defined; the values are selected from picklists. In a fully developed tool, each question here would instead be a
set of questions to ensure an objective rating viewed from various perspectives. For example, the PLANNING rating
would be built up from ratings of the status of many deliverables (e.g., is a resource-loaded CPM schedule
complete?). Note that there is a schedule section at the bottom, but only a few more systemic attributes must be
defined (most attributes drive both cost and schedule).

Once the parameters are rated, this tool is complete (i.e., Step 1 in the step-by-step discussion). The distribution
(simplified to a 3-point basis for the exercise) for the impact of systemic risk is shown for the cost and for the
schedule. If this were a Class 5 estimate, this may be the complete analysis. However, in the example, the Class on
average is 3.3 (i.e., the planning is lagging the desired Class 3 status at full funds authorization). In the example, the
p50 cost growth and schedule slips are 9% and 13% respectively.

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 8 of 14
Combined Parametric and Expected Value

May 27, 2021

COST GROWTH
RISK DRIVER ENTER PARAMETER (a) COEFFICIENT (b) a*b
CONSTANT -30.5
SCOPE 3
PLANNING 4
ENGINEERING 3
SCOPE DEFINITION 3.3 9.8 32.7
NEW TECHNOLOGY 0% 0.12 0.0
PROCESS SEVERITY 1 1 1.0
COMPLEXITY 3 1.2 3.6
SUBTOTAL BASE (prior to adjustments) 6.8
ADJUSTMENTS Complex Exec Strategy? > No
Team Development Fair 0
Project Control Fair 0
Estimate Basis Fair 0
Equipment 0% 4
Fixed Price 10% 0
TOTAL BASE (prior to bias adjustment; rounded to whole number) 11
Bias Typical 0
SYSTEMIC COST CONTINGENCY (at shown chance of underrun)
MEAN 11%
10% -10%
50% 9%
70% < enter funding p-level (increments of 10%) 19%
90% 35%
EXECUTION SCHEDULE DURATION SLIP
RISK DRIVER ENTER PARAMETER (a) COEFFICIENT (b) a*b
CONSTANT -23.5
SCOPE DEFINITION 3.3 9.6 32
NEW TECHNOLOGY 0% 0.1 0
PROCESS SEVERITY 1 0.5 0.5
COMPLEXITY 3 0.5 1.5
SUBTOTAL BASE (prior to adjustments) 10.5
ADJUSTMENTS
Schedule Basis Fair 0
TOTAL BASE (prior to bias adjustment; rounded to whole number) 11
Bias Low 3
SYSTEMIC EXECUTION SCHEDULE DURATION CONTINGENCY
MEAN 14%
10% 1%
50% 13%
80% < enter funding p-level (increments of 10%) 22%
90% 28%
Figure 3 – Example Parametric Model for Systemic Risks [9; with permission]

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 9 of 14
Combined Parametric and Expected Value

May 27, 2021

2.2.2. P+EV Model

Figure 4 is a snapshot of a simplified P+EV tool model worksheet in Excel®. It has been set up to use PDFs and an
MCS add-on. In a fully developed tool, there would be more thorough entries, enhanced features such as 3-point
probabilities and burn rates, etc. The various user input sections are numbered and described as follows:

1) Enter the base cost estimate and schedule duration.


2) Enter the critical risks and probability of occurrence (e.g., in Figure 4 one risk is entered for Mudslide). This
could be enhanced to 3-point entry and PDF application. Note the systemic risk probability is 100%.
3) Enter the burn rates for respective contract/elements. This would usually be enhanced to contain multiple
possible burn rate elements/phase/contracts and so on, and the user could select, for each critical risk,
which burn rate applies. It could also be enhanced to 3-point entry and PDF application.
4) This section carries over the parametric model outcomes from Figure 3 (e.g., note the p50 cost growth and
schedule slips of 9% and 13% respectively as per Figure 3). A trigen PDF has been applied; this is risk #1 in
the P+EV tool with MCS.
5) Finally, the critical risk responses and schedule and cost impacts are entered (only one is shown). The mean
results of probability x impact are shown. In addition, the sum of the means of all the risks and the total
mean project schedule duration and cost are shown.

After running the MCS simulation, the outcome distribution tables at the bottom are populated from which
management may determine contingency and reserves values.

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 10 of 14
Combined Parametric and Expected Value

May 27, 2021

Figure 4 – Example P+EV Model Integrating Systemic and Project-Specific Risks [9; with permission]

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 11 of 14
Combined Parametric and Expected Value

May 27, 2021

3. SPECIAL CONSIDERATIONS FOR HYBRID APPLICATION

The following are considerations for assuring that all critical uncertainties and risks are covered by the combined
methods while also assuring there is no redundancy:

Extreme System Attributes:


Generally, there will not be an issue with redundancy between the systemic and project-specific risks. The former
are uncertainties (p=100%) and the latter are mostly risk events and condition discovery (e.g., discovering rock in
the soil upon excavation) (p<100%) except for project-specific uncertainties such as weather. However, the nature
of the parametric model’s regression analysis basis is such that the output will not reflect extraordinary system
attributes. For example, if team development is rated as poor in the parametric model, the resulting output will not
reflect the major impact of entirely missing areas of critical competency, their departure from the team, a strike, or
even sabotage. Extreme system attributes, if critical (i.e., have material impact on the economics), can and should
also be included in the EV analysis as project-specific risks.

Start-up and Commissioning:


The research behind the parametric method excludes the cost and schedule of the start-up and commissioning phase
(after mechanical completion). Identify and quantify risks during this phase as project-specific risks. Example risks
include rework to correct quality process and/or product problems, major modifications to achieve planned
operability, etc.. Keep in mind the completion milestone for this phase may not be consistently defined (e.g., projects
are sometimes declared complete, and the books closed, prior to achieving planned capacity). Research on this
phase is available. [9,11]

Uncertainties That are Project-Specific:


There are two risks commonly found in risk registers that are uncertainties (p=100%) but may not be covered by the
parametric tool. These are weather variability and labor productivity variability that are not caused by an event (e.g.,
not a hurricane, or a strike). The nominal uncertainty from these risk drivers is covered by the historical distribution
of the parametric model; however, extreme conditions are not. For example, if the estimate assumed an average of
3 lost days per month due to weather, one would not add a critical risk to the EV tool for a few days more or less
than this. However, if the project site was subject to extreme variability such as monsoons or snow seasons that may
extend months longer than the norm with significant impact, that may be added as risk in the EV tool. Note that
extreme variation in weather is not an event; there is 100% probability the weather lost days will not be exactly 3
days every month. Enter this risk as an uncertainty with a probability of 100%, but a most likely impact of 0 (the base
plan) but a low and high reflecting the extreme variability applicable to that site.

Impacts to Intermediate Milestones:


While the EV method cannot examine the impact of risk to the internals of a CPM model, it is capable of assessing
impacts to major intermediate milestones. Perhaps the most common example are projects with seasonality where
a harsh winter, monsoons or other condition change puts a premium on completing part of the work prior to the
onset of the adverse season. How to model this in EV is described in RP 65R-11. However, in summary, it involves
creating a subtotal of the schedule impacts for risk events that occur prior to the seasonal deadline. This subtotal is
made an MCS output that one can review independently. After running the MCS, a review of this subtotal will provide
the distribution of the pre-milestone delay. From that a decision could be made whether to revise the schedule to
include an appropriate schedule contingency buffer prior to the intermediate milestone. The EV method is quite
flexible for addressing various risk analysis situations like this that may arise.

Non-linearity:
Another consideration for the hybrid method regards the assumption in Step 7 of the application that systemic and
project-specific risks are independent (i.e., no correlation). For most projects, that is a reasonable assumption.
However, research suggests that when a project system is weak and/or complexity is high and the project is impacted

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 12 of 14
Combined Parametric and Expected Value

May 27, 2021

by extreme and/or multiple risk events, risk responses are less likely to be effective. If there is high systemic risk, the
analyst can address this by increasing the high impact value of the critical project specific risks. Correlation could be
added to the EV MCS model; however, correlation may only apply at the extremes. More explicit methods that
address non-linear risk-to-impact relationships resulting from complexity and/or compounding of risk are excluded
from this RP.

3.1. Note on Joint Confidence Level (JCL) Determination

In 2009, the National Aeronautics and Space Administration (NASA) instituted a policy that certain project budgets
were to be based on a “joint cost and schedule probabilistic analysis” with budgets to reflect a “percent probability
that the project will be completed at or lower than the estimated amount AND at or before the projected
schedule.”[13] NASA calls this the joint confidence level or JCL. In NASA practice, the JCL is based on the cost-loaded
CPM-based risk analysis method. However, CPM modeling is not required for JCL; the hybrid P+EV method integrates
cost and schedule and supports JCL determination. Figure 5 is an example cost and schedule MCS output scatterplot
(in this case using Palisade @Risk® software) from the P+EV hybrid method. Note that RP 65R-11 also has an example
JCL plot; in that case resulting solely from the project-specific risks.

Figure 5 – Example JCL Graph from a P+EV Hybrid Model [using Palisade @Risk® software]

4. COMPARISON OF THE P+EV HYBRID METHOD TO RP 40R-08 PRINCIPLES

RP 40R-08, Contingency Estimating – General Principles, provides objective principles against which one can assess
the suitability of a contingency estimating method [14]. The following are the RP’s general principles that any
methodology developed or selected for quantifying risk impact should address:

• Meet client objectives, expectations and requirements.


• Part of and facilitates an effective decision or risk management process (e.g., TCM).
• Fit-for-use.
• Starts with identifying the risk drivers with input from all appropriate parties.
• Methods clearly link risk drivers and cost/schedule outcomes.
• Avoids iatrogenic (self-inflicted) risks.
• Employs empiricism.
• Employs experience/competency.

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 13 of 14
Combined Parametric and Expected Value

May 27, 2021

• Provides probabilistic estimating results in a way the supports effective decision making and risk
management.

Table 1 summarizes how the P+EV hybrid method performs in respect to the principles.

First Principles Hybrid P+EV Method Characteristics


Realistic and practical for estimates and schedules of any quality, project
Meets client objectives and
phase, and size. It is highly customizable and can be calibrated. Empirical
requirements
research basis adds credibility.
Explicitly aligns with industry phase-gate scope development and decision-
making processes (and AACE Estimate Classification practice). Identifies and
Part of a risk and decision
models deficiencies in the project system process itself (i.e., in part, a quality
management process
assurance method). The EV method is an elaboration of the risk matrix (no
conceptual discontinuity between qualitative and quantitative assessment).
Can be used on any estimate or schedule of any quality and can be applied
Fit-for-use using common software (i.e., spreadsheets with MCS add-on) that can be
customized.
Starts with identifying risk Systemic risk drivers are explicitly identified and rated (including bias), and
drivers critical project-specific risks are individually assessed.
Links risk drivers and Driver-to-outcome linkages are explicit for all risk types. The EV method
cost/schedule outcomes focuses on risk response planning incl. cost/schedule trading. Supports JCL.
The parametric model incorporates only those systemic risks found to be
Avoids iatrogenic (self-
statistically significant by empirical research. The EV method only quantifies
inflicted) risks
critical project-specific risks which minimizes MCS correlation challenges.
Parametric, MLR-based modeling is explicitly based on historical experience
Employs empiricism
and is readily calibrated to the user’s experience.
Employs experience As with all methods, requires experienced risk analysis facilitation. Not using
/competency CPM, the EV method requires experienced planner/scheduler input.
Provides probabilistic All integrated methods covered by AACE RPs produce probabilistic outcomes.
estimating results Supports JCL evaluations.
Table 1 – P+EV Hybrid Method versus RP 40R-08 General Principles

Table 2 provides a strength/weakness evaluation of the P+EV hybrid method.

Strengths Weaknesses
• Explicit risk-impact linkage • Fewer users than CPM-based methods
• Inherently empirically based • Not being CPM model based, requires more
• Universal applicability (any quality of input, estimate skilled/intuitive scheduling assessment
class, project size or type) • Does not readily support evaluation of the risks to
• Parametric method supports project system quality intermediate schedule milestones.
assurance/improvement • The EV method does not encourage the use of quality
• Parametric method addresses bias directly planning and schedule methods (but the parametric
• Addresses risk response (cost/schedule trading) method does)
• Allows changes to schedule logic due to risks to be
included without the complexity of branching in CPM
Table 2 – P+EV Hybrid Method Strength and Weaknesses

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.
113R-20: Integrated Cost and Schedule Risk Analysis and Contingency Determination Using 14 of 14
Combined Parametric and Expected Value

May 27, 2021

5. SUMMARY

This RP provides guidance to practitioners in developing or selecting appropriate methods for their situation with
the understanding that no one method is best for quantifying all types of risk. This RP integrates cost and schedule
risk analysis (and supports JCL) using a hybrid approach; and documents the steps to combine the parametric and
expected value methods covered by other RPs in detail. It provides an example using a demonstration toolset. It also
documents situations where a hybrid approach requires or may benefit from special considerations.

REFERENCES

1. AACE International Recommended Practice No. 42R-08, Risk Analysis and Contingency Determination Using
Parametric Estimating, AACE International, Morgantown, WV, (latest revision).
2. AACE International Recommended Practice No. 44R-08, Risk Analysis and Contingency Determination Using
Expected Value, AACE International, Morgantown, WV, (latest revision).
3. AACE International Recommended Practice No. 65R-11, Integrated Cost and Schedule Risk Analysis and
Contingency Determination using Expected Value, AACE International, Morgantown, WV, (latest revision).
4. AACE International, Professional Guidance Document PGD-02, Guide to Quantitative Risk Analysis, online
reference at www.aacei.org.
5. AACE International, Recommended Practice No. 117R-21, Integrated Cost and Schedule Risk Analysis and
Contingency Determination Using a Hybrid Parametric and CPM Method, AACE International, Morgantown,
WV (latest revision).
6. AACE International Recommended Practice No. 10S-90, Cost Engineering Terminology, AACE International,
Morgantown, WV, (latest revision).
7. Hollmann, John K., Alternate Methods for Integrated Cost and Schedule Contingency Estimating, 2010 AACE
International Transactions, AACE International, Morgantown WV, 2010.
8. Hollmann, John K., Realistic and Practical Project Risk Quantification (without CPM), 2017 AACE International
Transactions, AACE International, Morgantown WV, 2017.
9. Hollmann, John, K., Project Risk Quantification, Probabilistic Publishing, Sugarland TX, 2016.
10. AACE International Recommended Practice No. 43R-08, Risk Analysis and Contingency Determination Using
Parametric Estimating – Example Models as Applied for the Process Industries, AACE International,
Morgantown, WV, (latest revision)
11. Myers, Christopher W., and Ralph F. Shangraw, Understanding Process Plant Schedule Slippage and Startup
Costs, (R‐3215‐PSSP/RC), RAND Corporation, 1986.
12. AACE International, Recommended Practice No. 68R-11, Escalation Estimating Using Indices and Monte Carlo
Simulation, AACE International, Morgantown, WV (latest revision).
13. NASA, NPD 1000.5A; “Policy for NASA Acquisition”, National Aeronautics and Space Administration,
Washington, DC, 2010.
14. AACE International Recommended Practice No. 40R-08, Contingency Estimating – General Principles, AACE
International, Morgantown, WV, (latest revision).

CONTRIBUTORS

John K. Hollmann, PE CCP CEP DRMP FAACE Hon. Life (Primary Contributor)
Colin H. Cropley
Francisco Cruz, PE
Dr. David T. Hulett, FAACE
Martin Snyman, DRMP

Copyright © AACE® International AACE® International Recommended Practices


Single user license only. Copying and networking prohibited.

You might also like