Professional Documents
Culture Documents
Determining The Probability of Project Cost Overruns: Case Study
Determining The Probability of Project Cost Overruns: Case Study
Abstract: The statistical characteristics of cost overruns experienced from contract award in 276 Australian construction and engineering
projects were analyzed. The skewness and kurtosis values of the cost overruns are computed to determine if the empirical distribution of the
data follows a normal distribution. The Kolmogorov-Smirnov, Anderson-Darling, and chi-squared nonparametric tests are used to determine
Downloaded from ascelibrary.org by UNIV OF OKLA LIBRARIES on 03/27/13. Copyright ASCE. For personal use only; all rights reserved.
the goodness of fit of the selected probability distributions. A three-parameter Frechet probability function is found to describe the behavior of
cost overruns and provide the best overall distribution fit. The Frechet distribution is then used to calculate the probability of a cost overrun
being experienced. The statistical characteristics of contract size and cost overruns were also analyzed. The Cauchy (< A$1 million), Wakeby
(A$1 to 10 million, < A$101 million) and four-parameter Burr (A$11 to 50 million) tests were found to provide the best distribution fits and
used to calculate cost overrun probabilities by contract size. Ascertaining the best fit probability distribution from an empirical distribution at
contract award can produce realistic probabilities of cost overruns, which should then be incorporated into a construction cost contingency.
DOI: 10.1061/(ASCE)CO.1943-7862.0000575. © 2013 American Society of Civil Engineers.
CE Database subject headings: Australia; Construction costs; Probability; Project management.
Author keywords: Australia; Cost overrun; Distribution fitting; Probability; Probability distribution.
Introduction To assume that the aforementioned factors are the primary con-
tributors to cost overruns neglects the underlying complexity asso-
The ability to make accurate cost predictions is critical to successful ciated with the design and construction process (Love et al. 2012).
project delivery. In an attempt to assess the likelihood of cost As more information about a project’s requirements, specifically
overruns and put in place mechanisms to reduce their impact, those of a client, becomes available during the design process,
several techniques have been espoused (Jahren and Ashe 1990; the budget that is established during feasibility is modified.
Birnie and Yates 1991; Attala and Hegazy 2003; Flyvbjerg At the contract award, the expected cost to a client can be affirmed
2008; Bhargava et al. 2010). Despite the application of such and a reliable reference point can be established for determining a
techniques as well as the adoption of innovative organizational project cost’s overrun. From this point, factors contributing to
and managerial practices, cost overruns in projects remain a cost overruns include material and labor shortages, price inflation,
pervasive problem (Hester et al. 1991; Ibbs and Allen 1995; Love rework, change orders, site access, unexpected site conditions,
2002; Bhargava et al. 2010). Cost overruns have been attributed and unforeseen events (Arditi et al. 1985; Semple et al. 1994;
to the occurrence of optimism bias or strategic misrepresentation Chang 2002; Knight and Fayak 2002; Gkritza and Labi 2008;
during the formation of a project’s budget (Flyvbjerg 2007a, b). Love et al. 2011). Such causes may not have been considered
Optimism bias is the demonstrated systematic tendency for at the award of contract and typically arise during construction.
people to be overly optimistic about the outcome of planned With a sufficient data set of projects, however, the probability
actions (Kahneman et al. 1982; Lovallo and Kahneman 2003). of a cost overrun from a contract’s award can be determined
This includes overestimating the likelihood of positive events and (Jahren and Ashe 1990; Birnie and Yates 1991; Gkritza and
underestimating the likelihood of negative events. Alternatively, Labi 2008).
strategic misrepresentation is the planned, systematic distortion A cost overrun can be classified as a “random continuous var-
or misstatement of fact; it is essentially lying (Jones and iable” because it can take an infinite range of values (Jahren and
Euske 1991). Ashe 1990). Typically, the probability density function (PDF) of a
normal (otherwise known as Gaussian) distribution has been used
1
to determine project cost overruns (e.g., Flyvbjerg 2007b). A nor-
John Curtin Distinguished Professor, School of Built Environment,
mal distribution is symmetric about its mean value and therefore
Curtin Univ., GPO Box U1987, Perth, WA 6845, Australia (corresponding
author). E-mail: p.love@curtin.edu.au cannot be used to accurately model left- or right-skewed data.
2
Professor, School of Built Environment, Curtin Univ., GPO Box Even if cost overrun data are symmetric by nature, it is possible
U1987, Perth, WA 6845, Australia. E-mail: x.wang@curtin.edu.au that they are best described using heavy tailed distribution models
3 such as a Cauchy. Fitting an empirical distribution to data can
Senior Lecturer, School of Built Environment, Curtin Univ., GPO Box
U1987, Perth, WA 6845, Australia. E-mail: chunpong.sing@curtin.edu.au be a difficult task considering the array of statistical distribution
4
Associate Profesor, School of Civil and Environmental Engineering, choices that are available. The selection of an inappropriate statis-
Nangyang Technological Univ., Singapore. E-mail: CLKTIONG@ntu tical distribution can produce incorrect probabilities, which can
.edu.sg adversely affect decision making and therefore lead to negative
Note. This manuscript was submitted on August 11, 2011; approved on
January 31, 2012; published online on April 28, 2012. Discussion period
outcomes. In addressing this shortcoming, this paper uses data
open until August 1, 2013; separate discussions must be submitted for in- derived from 276 completed Australian construction and engineer-
dividual papers. This paper is part of the Journal of Construction Engi- ing projects to determine the “best fit” distribution so that a realistic
neering and Management, Vol. 139, No. 3, March 1, 2013. © ASCE, probability of project cost overruns from contract award can be
ISSN 0733-9364/2013/3-321-330/$25.00. determined.
incurred (Fig. 1). Actual construction costs (Acv ) are defined as Flyvbjerg et al. (2002) revealed that there was a significant differ-
accounted construction costs at the time of project completion. ence between the mean cost overruns for different project types
An alternative definition and reference point for determining a cost but not for geographical location. Conversely, however, Odeck
overrun have been provided by Rowland (1981), Hinze et al. (2004) observed that project type did not influence the level of cost
(1992), and Zeitoun and Oberlander (1993), who suggested that overrun incurred.
it is the difference between the original contract value (Ocv )
(i.e., contract award) and Acv at practical completion. The discrep-
ancy between definitions presented has contributed to significant Cost Overrun Determination
variability in the cost overrun percentages that have been reported In Fig. 1 the project development process is identified along with
in the normative literature. the reference points that are used to determine a cost overrun. As
Table 1 provides a summary of studies that have examined cost noted previously, between the budget to contract award (between
overruns in construction and engineering projects. The Auditor Activities A and H), which is denoted as the Ocv , estimating
General of Sweden (1994), for example, revealed that the average accuracy can be affected by an array of factors such as process char-
cost overrun for eight road projects was 86%, with a range of −2 to acteristics and knowledge, the degree of project definition, incen-
182%. In contrast, Odeck and Skjeseth (1995) examined 12 toll tives for accurate estimation, and human judgment and bias. Project
projects and found the average cost overrun to be 5%, with a range costs, however, increase either by changing their character or
of −10 to 170%. In a further study undertaken by Odeck (2004), a changing the economic and institutional environment in which
mean cost overrun of 7.9% and a range of −59 to 183% was re- they develop. Distinguishing between the factors that increase
ported for 420 road construction projects. For bridges and tunnels, project costs and those that affect the accuracy of estimates is
Skamris and Flyvbjerg (1996, 1997) found the cost estimates from pivotal to determining an accurate cost overrun probability. The
the decision to build to actual completion experienced a cost percentage increase from the estimate when the decision to build
overrun of 50 to 100% (Table 1). is made to contract award needs to be determined and separated
Issues relating to project types and their influence on cost from a cost overrun analysis. When this is done, an appropriate
overruns have been examined and are subject to ongoing debate. contingency at the decision to build can be determined and used
tion, in Perth, Western Australia (WA), is the state’s largest social operation (þA$42 million), and an underground car parking
infrastructure project ever. In 2004 it was originally budgeted at facility (þA$34 million). Clearly, without a defined scope, any
A$420 million, and after 4 years of planning and design a revised budget that is formulated at the decision to build would be inaccu-
budget of A$1.76 billion was established. Before construction had rate and subject to changes. Consequently, using the initial budget
even commenced the project had overrun its original budget by as a reference point to determine a cost overrun is misleading and
320%. In 2010 the WA auditor general concluded (WA Auditor will naturally lead to an overinflated value that does reflect a
General 2010a, p. 5): project’s new characteristics and changed scope. With this in mind,
the use of the contract award can provide an ameliorated point
: : : the opening date is between three and a half and four of reference for determining cost overruns and therefore can allow
years later than originally planned. In common with other for apples-to-apples comparisons.
capital projects, the original estimates were unrealistic and
were not based on a good understanding of what this major
Costs and Project Size
project would involve. Better definition of the requirements
of the hospital has resulted in scope changes which have Research has suggested that the likelihood of a cost overrun in-
increased forecast costs, and delayed the opening. creases with contract size and complexity as well as the number
of change orders (Rowland 1981; Hinze et al. 1992). Specifically
The revised budget did not include the essential fit-out needed to change orders. The change-order rate is defined as the “ratio
run a working hospital. However, construction and building works between the dollar amount change of change orders and award
accounted for only A$755 million of the revised 2008 budget. amount” (Jahren and Ashe 1991, p. 548). Rowland (1981) found
Other major budgeted items included escalation due to inflation that as the change-order rate increased, contract size increased,
(A$431 million), professional fees (A$186 million), and a contin- whereas Randolph et al. (1987) revealed that as the change-order
gency (A$110 m). rate decreased, contract size increased. Jahren and Ashe’s (1990)
The Perth Arena project currently being constructed has been examination of 1,576 construction projects found that a cost over-
subjected to a significant cost overrun. With an original bud- run rate of 1 to 11% is more likely to occur on larger projects than
get of A$160 million established in 2005, it was expected to be smaller projects as managers typically have longer periods of time
fully operational by 2009. Poor governance and significant to rectify cost-related issues and therefore keep cost overrun rates
changes in scope have resulted in significant cost and schedule low. Likewise, Odeck’s (2004) research showed that larger over-
blowouts, and when completed the total estimated cost is expect- runs were experienced in smaller projects. This suggests that larger
ed to exceed A$500 million (i.e., more than a 200% increase). projects may be better managed and that longer completion times
In 2010 the WA auditor general concluded (WA Auditor General provide an opportunity to make adjustments to facilitate cost con-
2010b, p. 5): trol (Jahren and Ashe 1991; Vidalis and Najafi 2002; Odeck 2004).
To improve cost control, there is a need to put in place strategies to
On current estimates, it will cost $483 million, more than prevent those factors that cause cost overruns from occurring. It
three times the original estimate of $160 million. The Arena is beyond the scope of this paper to examine the causes of cost
is scheduled to open almost three years later than originally overruns. A detailed review of the subject matter can be found in
planned, in November 2011 rather than January 2009. Insuf- Frimpong et al. (2003), Ashan and Gunawan (2010), Bhargava
ficient scoping and planning meant that both the original cost et al. (2010), Jergeas and Runwanpura (2010), and Love et al.
estimate and opening date were unrealistic. Key decisions on (2011, 2012).
the project during contract negotiations have altered the
planned allocation of risks between the state and contractor,
increased the risks to the state, and led to project delays and Research Approach
cost increases. These decisions were made without systematic
or sufficient analysis of their impact, consideration of alterna- The data set presented in Love et al. (2009) for Australian con-
tives, external scrutiny or legal advice. struction and engineering projects is used to develop “best-fit”
statistical distributions so that probabilities for cost overruns at
According to Flyvbjerg and Cowi (2004), inaccurate budgets contract award can be determined. For the purpose of clarity,
of this nature are a result of optimism bias. As a result, reference the method of data collection and dataset characteristics will be
class forecasting was developed to mitigate the risk of optimism presented again.
bias that may arise during the formulation of a budget (Flyvbjerg
and Cowi 2004; Flyvbjerg 2007a, 2008). This approach does not
Questionnaire Survey
try to forecast specific uncertain events that will affect a particular
project but instead places a project in a statistical distribution of The questionnaire survey developed for the study reported in Love
outcomes from the class of reference points. Essentially, Flyvbjerg et al. (2010) was used to extract cost overrun information as well as
Data reliability relates to the data source and the identification of ð5Þ
the position held by the respondent completing the questionnaire • Chi-squared statistic (χ2 ): determines if a sample comes from a
(Oppenheim 1992). Therefore, it was critically important that only population with a specific distribution. The chi-squared statistic
selected senior personnel who had sufficient knowledge and expe- is defined as
rience about the procurement processes associated with a project
answered the questionnaire. From the total responses gathered, X
k
ðOi − Ei Þ2
χ2 ¼ ð6Þ
133 respondents provided information relating to their individual Ei
i¼1
job position and title, and it was revealed that most respondents
held senior positions within their organizations. Based upon this where Oi is the observed frequency for bin i and Ei is the
finding the direct mailing to individuals in organizations seemed expected frequency of bin i calculated by
to have achieved its objective of reaching senior staff that plays
a significant role in construction project management. In addition, Ei ¼ Fðx2 Þ − Fðx1 Þ ð7Þ
because, in accordance with the study design, questionnaires were
mailed to organizations in different states in Australia, the risk of Here F is the CDF of the probability distribution being
duplicating projects was minimized. tested, and x1 and x2 are the limits for bin i.
the CDF. Then, to simulate the sample’s randomness and derive et al. 2009, 2010). Therefore, generic probabilities for determining
cost overrun probabilities, a Mersenne twister, which is a pseudor- the occurrence of project cost overruns based upon the best-fit
andom number generating algorithm, was used to generate a probability distribution were calculated.
sequence of numbers that approximated the sample to 1,000
(Matsumoto and Nishimura 1998).
Distribution Fitting: Probability of Cost Overruns
The construction and engineering data sets were combined, and the
Results best-fit probability distribution was examined using the goodness-
of-fit tests Kolmogorov-Smirnov and Anderson-Darling. The re-
Data from a total of 276 construction (n ¼ 161) and civil engi- sults of the goodness-of-fit tests revealed that a three-parameter
neering (n ¼ 115) projects were obtained. In the case of con- (3P) Frechet distribution provided the best fit for the data sets
struction projects, these ranged from banks to hospitals and hotels. (Table 3).
For the civil engineering sample, these ranged from tunneling to A Frechet is a form of generalized extreme value distribution
road construction and sewer treatment plants. The summary statis- (GEV) that is used as an approximation to model the maxima
tics reveal that the mean Ocv was A$23,142,486 (SD ¼ A$41;171; of long (finite) sequences of random variables (Coles 2001).
772; minimum ¼ A$132;347; maximum ¼ A$390 million), and the The parameter α is a continuous shape parameter α > 0, β > 0,
mean Acv was A$25,455,372 (SD ¼ A$45;090;928; minimum ¼ and γ is a continuous location parameter, where γ ≡ 0 yields
A$136;671; maximum ¼ A$420 million). the two-parameter Frechet distribution. The domain for the 3P
To better understand the makeup of the sample, an examination Frechet distribution is γ < x < þ∞. The PDF is expressed as
of respondent stratification, geographical dispersion, and company αþ1 α
α β β
turnover was completed for the civil engineering sample. In terms fðxÞ ¼ exp − ð8Þ
of respondent stratification, 45% were design consultants (archi- β x−γ x−γ
tects, quantity surveyors, and structural, mechanical, and electrical
The CDF is expressed as
engineers), 31% were contractors, and 24% comprised project
α
managers. With regards to geographical dispersion, organizations β
were situated across the states of Victoria (45%), New South Wales fðxÞ ¼ exp − ð9Þ
x−γ
(17%), Queensland (27%), South Australia (9%), and WA (2%).
In Table 2 the descriptive statistics for the cost overruns that The parameters for the Frechet (3P) were found to be
were incurred in the sampled projects are presented. The mean α ¼ 10.158, β ¼ 90.215, and γ ¼ −84.29. Figs. 3 and 4 present
overall project cost overrun for the sample was 12.22% the PDF and CDF based upon the calculated distribution parame-
(SD ¼ 20.65) of Ocv . Means were also determined for the two ters. The calculated probabilities of a cost overrun are presented in
groupings of project type, construction and civil engineering, Table 4. The probability of a cost overrun of greater than 10% is
and were found to be 12.22% (SD ¼ 24.22%) and 11.76% 47%. Delimiters were also used to provide probabilities of cost
(SD ¼ 13.76%), respectively. For construction projects the maxi- overruns within ranges. The probability of a project experiencing
mum cost overrun was 244% and the minimum was −84%
(i.e., cost underrun), which results in a range of 328%. For the civil
engineering projects sampled the maximum cost overrun was 109% 0.56 % Cost Overrun Frechet (3P)
0.48
0.4
Table 2. Percentiles for Project Cost Overrun
0.32
Percentile Value 0.24
Minimum −84.29 0.16
5% 0
10% 1.02 0.08
25% (Q1) 2.96 0
50% (median) 8.16
75% (Q3) 15.14 -0.08
90% 30.54 -40 -20 0 20 40 60 80 100 120
95% 40 Percentage of Cost Overrun
Maximum 244.06
Fig. 2. Frechet 3P: PDF for cost overruns
Note: Q1 = first quarter; Q3 = third quarter.
1 a cost overrun of between 1 and 5%, for example, is 16% (Fig. 3).
0.9 Cost Frechet 3P The likelihood that a project will exceed a mean cost overrun of
0.8
Overrun
12.22% is 60% [Pðx < x1Þ ¼ 0.60].
Probability of Cost Overrun
0.7
0.6
Project Size
0.5
0.4
An ANOVA was also used to determine if the cost overruns varied
0.3
with different Ocv ðp ¼ 0.05Þ. The homogeneity of variance as-
sumptions was violated for cost overrun comparisons; hence the
0.2
results of a t-test with equal variances not assumed are reported
0.1
(p ¼ 0.05). There were no significant differences for Ocv and
0
project cost overruns tð272Þ ¼ −1.21, p ¼ 0.289. Fig. 4 shows
-80 -40 0 40 80 120 160 200 240
a scatterplot of Ocv and the percentage of cost overrun that occurred
Cost Overrun
on each project. It can be seen that as Ocv increases, the cost over-
Fig. 3. Frechet 3P: CDF function for cost overruns run decreases. Table 5 indicates that construction projects greater
than A$1 million saw a mean cost overrun of 24.90%. For civil
engineering projects, the largest cost overrun of 14.01% occurred
in the smallest contract range, A$1 to A$10 million.
1
% Cost Overrun Cauchy While the data set was comparable in size to those of other stud-
Probability of Cost Overrun
0.8 ies that have examined cost overruns (e.g., Flyvbjerg et al. 2002),
the number of projects within established Ocv ranges is small for
0.6
0.4
Table 4. Generic Discrete Probabilities for Project Cost Overruns
0.2 Probability of cost overrun (%) PðX < X1Þ PðX > X1Þ
0 5 0.32 0.67
10 0.53 0.47
-0.2
0 100 200 300 15 0.69 0.31
Percentage of Cost Overrun 20 0.8 0.2
25 0.87 0.13
Fig. 4. Cauchy: PDF for construction projects less than A$1 million 30 0.91 0.09
For the contract ranges A$1 to A$10 million (Table 7) and less
each of the project classification types. Construction and engineer- than A$101 million the best-fitting distribution was a Wakeby
ing projects were combined to create a large data set to determine (Table 7). This form of distribution is also a GEV. The parameters
of a Wakeby, α, β, γ, δ, and ξ, are all continuous. The domain for
Downloaded from ascelibrary.org by UNIV OF OKLA LIBRARIES on 03/27/13. Copyright ASCE. For personal use only; all rights reserved.
0.48
% Cost Overrun Wakeby 0.64 % Cost Overrun Burr (4P)
0.4
Probability of Cost Overrun
0.56
Probability of Cost Overrun
0.32 0.48
0.24 0.4
0.16 0.32
0.08 0.24
0.16
0
0.08
-0.08 0
-0.16 -0.08
Fig. 7. Wakeby: PDF for construction and engineering projects less Fig. 8. (4P) Burr: PDF for construction and engineering projects less
than A$101 million than A$11–$50 million
contingency.
Using the contract award as the reference point, cost overruns
from 276 construction and engineering projects were calculated.
The research revealed a mean cost overrun of 12.22%. No signifi-
Cost Contingency cant differences for cost overruns were found among procurement
method, project type, and contract size. The empirical distributions
A contingency can be defined as “the amount of funds, budget or
for the cost overruns were found to be non-Gaussian. Nonparamet-
time needed above the estimate to reduce the risk of overruns of
ric goodness-of-fit tests were used to select the best-fit probability
project objectives to a level acceptable to the organization” (Project
distribution. A three-parameter Frechet probability function was
Management Institute 2008). Most projects will experience cost
found to provide the best overall distribution fit to calculate the
increases between the decision to build and the contract award.
probability of cost overruns. As a line of inquiry, the statistical
A design contingency is typically allocated for changes during de-
characteristics of contract size and cost overruns were also
sign for factors such as incomplete scope definition and estimating
analyzed. The Cauchy (<A$1 million), Wakeby (A$1 to 10 million,
inaccuracy (e.g., Clark and Lorenzoni 1985). As a project becomes
<A$101 million), and four-parameter Burr (A$11 to $50 million)
more defined, the design contingency is absorbed into the budget
were found to provide the best distribution fits and were therefore
for specific cost elements (Gunhan and Arditi 2007). Any unre-
used to calculate cost overrun probabilities by contract size. It is
solved design issues at the time of contract award should be incor-
suggested that distribution fitting of empirical distributions is nec-
porated into the construction contingency (Gunhan and Arditi
essary to produce reliable and realistic cost overrun probabilities
2007). At the initial budget stage, a contingency of 30 to 50%
and, as a result, improve decision making.
should be allowed for incomplete scope and 5 to 10% for estimat-
ing inaccuracies (Clark and Lorenzoni 1985). Thus, as a rule of
thumb, a 35 to 60% design contingency should be added to the References
initial budget estimate figure. In the case of FSH and Perth Arena,
for example, the cost increase prior to contract award far outweighs Alreck, P. L., and Settle, R. B. (1985). The survey research handbook,
the suggested design contingency. Predicting the cost overrun from Richard D. Irwin, Homewood, IL.
the decision to build to contract award relies exclusively on a large Arditi, D., Tarim, G., and Gurdamar, S. (1985). “Cost overruns in public
data set, so the empirical distribution of cost overruns can be used projects.” Int. J. Project Manage., 3(4), 218–224.
Ashan, K., and Gunawan, I. (2010). “Analysis of cost and schedule perfor-
to determine the best-fit statistical distribution for probabilistic
mance of international development projects.” Int. J. Project Manag.,
analysis. 28(1), 68–78.
A construction contingency is used for changes that may occur Attala, M., and Hegazy, T. (2003). “Predicting cost deviation in
during the construction process. Under a traditional lump sum con- reconstruction projects: Artificial neural networks versus regression.”
tract based on bills of quantities (BoQs), scope and design are sup- J. Constr. Eng. Manage., 129(4), 405–411.
posed to be fully defined and developed. As a result, Clark and Auditor General Sweden (1994). Riksrevisionsverket. Infrastrukturinves-
Lorenzoni (1985) suggest using a contingency value of 3 to 5% teringar: En kostnadsjämörelse mellan plan og utyfall i 15 storre
(Clark and Lorenzoni 1985). In practice, complete drawings and prosjekt innöm Vägverket og Banverket, RVV, 23, Stockholm, Sweden.
BoQs are generally not available when a project goes to tender Bhargava, A., Anastasopoulos, P., Labi, S., Sinha, K. C., and
(Rowlinson 1999). A similar situation arises when nontraditional Mannering, F. L. (2010). “Three-stage least squares analysis of time
and cost overruns in construction contracts.” J. Constr. Eng. Manage.,
methods are used to deliver projects. The present analysis revealed
136(11), 1207–1218.
that there was no statistical difference between the extent of cost Birnie, J., and Yates, A. (1991). “Cost prediction using decision/risk
overrun experienced and procurement method used. From the fore- analysis methodologies.” Constr. Manage. Econ., 9(2), 171–186.
going analysis, it is suggested that a construction contingency value Chang, A. S.-T. (2002). “Reasons for cost and schedule increase for
in excess of the average cost overrun of 12.22% be used to deter- engineering design projects.” J. Manage. Eng., 18(1), 29–36.
mine known unknowns (i.e., identifiable risks). For example, de- Clark, F. D., and Lorenzoni, A. B. (1985). Applied cost engineering, Marcel
sign errors and omissions contained within contract documents Dekker, New York.
have been found to contribute as much as 50% of a project’s cost Coles, S. (2001). An introduction to statistical modeling of extreme values,
overrun (Love et al. 2009). From a client’s perspective, design er- Springer, Berlin.
rors and omissions are identifiable risks and should be accommo- Flyvbjerg, B. (2007a). “Policy and planning for large scale-infrastructure
projects: Problems, causes, and cures.” Environ. Plann. B Plann. Des.,
dated within a contingency. The probabilities derived from the
34(1), 578–597.
statistical distributions provide the basis to monitor and reassess Flyvbjerg, B. (2007b). “Cost overruns and demand shortfalls in urban rail
project costs. Identifying the key factors contributing cost overruns and other infrastructure.” Transp. Plann. Technol., 30(1), 9–30.
from contract award and assessing their likelihood of occurrence Flyvbjerg, B. (2008). “Curbing optimism bias and strategic misrepresenta-
can enable clients and contractors to implement appropriate risk tion in planning: Reference class forecasting in practice.” Eur. Plann.
management strategies. Stud., 16(1), 3–21.