You are on page 1of 12

Available online at www.sciencedirect.

com

ScienceDirect
International Journal of Project Management 33 (2015) 467 478
www.elsevier.com/locate/ijproman

Conceptualising uncertainty in safety-critical projects:


A practitioner perspective
Fiona C. Saunders , Andrew W. Gale, Andrew H. Sherry
The University of Manchester, UK

Received 27 January 2014; received in revised form 1 September 2014; accepted 9 September 2014
Available online 26 September 2014

Abstract

In safety-critical organisations such as civil-nuclear and aerospace, managing uncertainty is of particular importance as the consequences of
failure can be potentially catastrophic. The challenge facing project managers in these complex, socio-technical environments is how to better
understand the sources of project uncertainty and how to navigate a path through them in pursuit of successful project outcomes.
This exploratory study analyses the literature on the management of uncertainty in projects using Sderlund's (2011) seven schools of thought
on project management. Additionally it draws on interviews with project management practitioners from several large-scale projects in civil-
nuclear and aerospace companies in the United Kingdom to posit the uncertainty kaleidoscope as a means of understanding the sources of
uncertainty in safety-critical projects and identies four conceptual approaches that may be adopted by project managers to attenuate the impact of
uncertainty on the delivery of successful project outcomes.
2014 Elsevier Ltd. APM and IPMA. All rights reserved.

Keywords: Project uncertainty; Safety-critical; Managing uncertainty

1. Introduction managers might adopt to navigate their way through project


uncertainties (Chapman and Ward, 2000; Hillson, 2004; Pich
Uncertainty is a multi-faceted concept: one that has been et al., 2002; Thiry, 2004).
debated across a broad range of intellectual disciplines including The context of this study is that of safety-critical industries;
economics, engineering and psychology (cf. Kahneman and where safety is of paramount importance and the consequences
Tversky, 1982; Keynes, 1937; Osman, 2010; Smithson, 1989). of failure or malfunction may be loss of life or serious injury,
The management of uncertainty has also become an increasingly significant environmental damage, or harm to plant or property
popular topic for discussion in the project management literature (Falla, 1997; Wears, 2012). In archetypal safety-critical
(see for instance Atkinson et al., 2006; Cleden, 2009; Hillson, industries, such as civil-nuclear or aerospace, the need to
2002; Perminova et al., 2008). This scholarship provides several manage uncertainty is of particular import as errors or failure
definitions of uncertainty (Hillson, 2002; Sanderson, 2012; Ward can result in extensive loss of life and serious environmental
and Chapman, 2003), identifies the main sources of uncertainty damage. To study these safety-critical industries is to enter a world
in projects and outlines a variety of approaches that project dominated by massive machines, extraordinary engineering
and procedural complexities (La Porte, 2006), where project
managers are charged with delivering the next generation nuclear
Corresponding author at: School of Mechanical, Aerospace and Civil
plants, or building ever lighter and more fuel-efficient gas-turbine
Engineering, The University of Manchester, Pariser Building, Sackville Street, aircraft engines. These are long-term, large-scale projects that
Manchester M13 9PL, UK. Tel.: +44 161 3063738. must satisfy myriad internal and external stakeholders and where
E-mail address: ona.saunders@manchester.ac.uk (F.C. Saunders). the uncertainties at play are legion and non-trivial in nature. For

http://dx.doi.org/10.1016/j.ijproman.2014.09.002
0263-7863/00/ 2014 Elsevier Ltd. APM and IPMA. All rights reserved.
468 F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478

example: what values can we assign to the costs of a nuclear cannot be attached to different outcomes (Keynes, 1937).
new-build programme, when the design has yet to be approved by Smithson (1989) posits a taxonomy of ignorance and
the Office of the UK Nuclear Regulator? Or how do we determine uncertainty as well as exploring sociological, philosophical
the development timescales of a nuclear submarine propulsion and mathematical conceptualisations of uncertainty. Rich
system when the UK-based supply chain is fragile and skilled seams of ideas on uncertainty can also be found in the field of
resources are limited in number. Understanding and addressing psychology, most notably Kahneman and Tversky's (1982)
project uncertainty is of great importance to the project managers subdivision of uncertainty into that attributed to the external
involved in these complex project scenarios. world and that which is attributed to our own internal state of
The study reported here is an exploratory one; based on knowledge.
in-depth interviews with senior project management practitioners1 A fourth lens through which to view uncertainty emerges
on a number of large-scale projects in civil-nuclear and aerospace from the study of complexity a growing sense that the
companies in the United Kingdom. The paper addresses three key environment (both natural and social) is not entirely within our
research questions: control and that the mathematically based predictive models we
use to understand it are limited, if not flawed (Milly et al.,
RQ1. How does the academic literature conceptualise the 2008). Scholars distinguish between descriptive complexity
determinants of project uncertainty and the approaches taken (that which is based on technology, structures and organisa-
to manage these uncertainties? tions) and perceived complexity (complexity that is subjective
RQ2. What are the determinants of project uncertainty as and is ascribed by people on the basis of their own experience
articulated by project management practitioners in two and understanding of a specific situation) (Crawford, 2013).
safety-critical industries? The notion of deep uncertainty also arises from the study of
RQ3. What conceptual approaches to the management of complexity where decision makers either do not know or
project uncertainty are adopted by these project management cannot agree on input parameters, appropriate models of
practitioners? analysis or even the desirability of particular decision outcomes
(Lempert et al., 2003). The literature on strategy has long
wrestled with this challenge of making rational (March and
The first section of the paper reviews the extant literature on
Simon, 1958) and effective strategic decisions in the absence of
the management of uncertainty. The second describes the
perfect or complete information (see for instance: Courtney et
design of the empirical study. The discussion section summa-
al., 1997; Harrison, 1992; Porter, 1980; Sutcliffe and Zaheer,
rises the empirical findings, and synthesises theory and practice
1998).
to present the uncertainty kaleidoscope as a means of
There is broad coverage of uncertainty in the domain of
understanding the sources of uncertainty in safety-critical
project management (see for instance: Loch et al., 2006;
projects. It also identifies four conceptual approaches that are
Perminova et al., 2008; Cleden, 2009; Meredith and Mantel,
adopted by project managers to navigate a way through these
2010) and various approaches to the management of project
uncertainties before concluding with limitations in the study
uncertainty have been presented (De Meyer et al., 2002; Ward
and avenues for future research.
and Chapman, 2003; Olsson, 2006; Harris and Woolley, 2009).
Uncertainty management in the context of projects is closely
2. Literature review
related to the management of risk and there is considerable
discussion in the literature as to the difference between risk and
The Oxford English Dictionary defines uncertain as not
uncertainty (see for instance: Hillson, 2004; Loosemore et al.,
able to be relied upon; not known or definite, implying that
2006; Perminova et al., 2008; Sanderson, 2012).
uncertainty is a state of unknowing where the individual
lacks full and complete knowledge of a situation. These are
2.1. Determinants of project uncertainty
circumstances in which we constantly find ourselves. This
centrality of uncertainty to the human condition has fostered a
An important theme in the literature relates to the sources of
richness and depth of research across several disciplines and
uncertainty in projects. Table 1 categorises these into five
theoretical approaches to uncertainty are not the preserve of
different perspectives.
scholars in the field of project management. Perminova et al.
From an environmental perspective uncertainty arises due to
(2008) highlight three other academic domains that encompass
factors in the external environment, for example, as a
uncertainty (mathematical probability, economics and psychol-
consequence of institutional decision making processes, or the
ogy) and that may have relevance for the management of
competing and conflicting demands of project stakeholders, or
uncertainty in projects. Giants of economics such as John
perhaps from external industry and market risks (Aaltonen,
Maynard Keynes have wrestled with notions of uncertainty;
2011; Jensen et al., 2006; Winch, 2010). In contrast indi-
defining it as a state in which reasonably definite probabilities
vidually based determinants of uncertainty centre on two
concepts. Bounded rationality that our attempts to act
1
A term which may be interpreted as including project team members, entirely rationally are constrained; for example, by incomplete
project team leaders, project managers and project directors p. 723 Crawford et information, by limits in our cognitive capacity, or the time
al., 2006; 2). available to make a decision (March and Simon, 1958); and the
F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478 469

Table 1 in individuals with different psychological profiles identifying


Determinants of uncertainty from the literature. and interpreting uncertainty in quite different ways (Madsen and
Perspective Determinants (or sources) Studies Pries-Heje, 2009).
of uncertainty The complexity perspective on the determinants of uncer-
Environmental Turbulence in the Lawrence and Lorsch (1967); tainty in a project asserts that complexity may arise from the
environment Duncan (1972); Collins and functional requirements of the product, the choices of
Hansen (2011)
technology or the diversity of actors involved in the project
Competing and conflicting Ward and Chapman (2008);
stakeholder demands Jensen et al. (2006); (Danilovic and Sandkull, 2005). To complexity, Weick (1995)
Aaltonen (2011) adds a further two sources of uncertainty in projects: that of
Competitor threats, external Winch (2010); Colarelli information load (the volume of ambiguous information that
industry and market risks O'Connor and Rice (2013) must be processed) and turbulence (the rate at which project
Institutional norms and Chapman and Ward (2002);
facts change and the randomness of their timing and direction
decision making processes Jensen et al. (2006)
Individual Internal state of knowledge Kahneman and Tversky of change). These are categorised as the information perspec-
or understanding (1982) tive and the temporal perspective respectively. In the informa-
Uncertain state of mind in Milliken (1987) tion perspective missing information (Harrison, 1992; March
response to triggers in the and Simon, 1958), a lack of understanding of what the salient
external environment
issues are in the project (Smithson, 1989) and an inability to
Uncertainty exists in the Head (1967)
mind of the person who grasp the cause and effect relationships in the project (Milliken,
doubts 1987) may increase project uncertainty. Viewed temporally,
Bounded rationality and March and Simon (1958); uncertainty changes as the project progresses, (Cleden, 2009),
Fallacy of rational decision Kahneman and Tversky with uncertainty manifesting itself most forcefully at the project
making (1982)
definition phase. At this stage in a project, the scope may be
Different psychological Madsen and Pries-Heje
profiles perceive (2009) very fluid; costs and timescales little more than unsubstantiated
uncertainty in estimates, and the required trade-offs between competing
different ways project objectives only just emerging (Atkinson et al., 2006;
Complexity Functional requirements of Danilovic and Sandkull Ward and Chapman, 2003). In addition the relationships between
the product (2005); Madsen and
parties involved in the project may still be inchoate with the
Pries-Heje (2009)
Technology choice Danilovic and Sandkull potential for misunderstandings and conflict high (Hong et al.,
(2005) 2004).
Diversity of actors and Ward and Chapman (2003);
stakeholders Atkinson et al. (2006); 2.2. Approaches to the management of uncertainty
Jensen et al. (2006);
Reymen et al. (2008)
Inherent project complexity Cleden (2009); Osman The academic literature also proffers a number of different
(including Feedback loops, (2010); Winch (2010) approaches to the management of project uncertainty. Table 2
instability and emergent classifies these according to the seven schools of thought
system properties) (optimisation, factor, contingency, behaviour, governance,
Information Incomplete and imperfect March and Simon (1958);
relationship and decision) in project management (Sderlund,
information Harrison (1992)
Lack of knowledge or Kahneman and Tversky 2011). Collectively these schools of thought provide an
understanding (1982); Smithson (1989); account of the present state of theorising in project
Cleden (2009); Bedford management (Sderlund, 2011, p. 154).
(2009) Research in the optimisation school contends that project
Incomplete understanding Milliken (1987)
uncertainty can be managed by extending the project risk
of cause and effect
relationships management process to incorporate uncertainty. Here the
Inability to estimate Ward and Chapman (2003) traditional risk management process is augmented by the use
accurately of SWOT analyses and double probability impact matrices,
Temporal Stage of project lifecycle Ward and Chapman (2003); enabling positive opportunities as well as negative threats to the
Kolltveit and Gronhaug
project to be identified, analysed and, where practicable,
(2004); Atkinson et al.
(2006) mitigated. Another theme emerging from this school of thought
Project tempo and timescale Cleden (2009) is a quantitative one that by improving the accuracy of the
Project turbulence (rate of Weick (1995) planning, estimating and resource allocation processes uncer-
change on project, timing of tainties can somehow be tamed.
changes and direction of
The factor school seeks to extend the reach of the
changes)
optimisation school in the search for common factors that
improve the ability of the project to manage uncertainty. There
fallacy of rational decision making (Kahneman and Tversky, are relatively few studies in this school, perhaps due to the
1982). Here uncertainty is viewed as a perceptive phenomenon multi-faceted nature of project uncertainty; its many sources
existing in the mind of the one who doubts (Head, 1967), resulting and forms (Ward and Chapman, 2003) and the subsequent
470 F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478

Table 2
Seven schools of thought on approaches to managing project uncertainty.
School of Description of school Key contributions
thought (Sderlund, 2011)
Optimisation Optimising the implementation of projects using predominantly Extending and optimising the risk management process (Ghaffari et
school quantitative, prescriptive and management science based approaches. al., 2014; Hillson, 2002; Jaafari, 2001; Olsson, 2007)
Improved estimation of project costs and durations (Chapman, 2006;
Chapman and Ward, 2000; Khamooshi and Cioffi, 2013; Lippman et
al., 2013)
Improved project planning techniques (Danilovic and Sandkull,
2005; Dawson and Dawson, 1998; Hajiagha et al., 2014; Wagner et
al., 2014)
Improving the measurement of uncertainty (Brauers, 1986; Chapman,
2006; Frank, 1999)
Improving resource allocations in projects (Laslo and Goldberg, 2008)
Factor Establishing criteria for project success and failure. Use of structural equation modelling to assess impact of variables
school associated with uncertainty on project outcomes (Hong et al., 2004;
Wang and Liu, 2006)
Qualitative assessment of aspects of project uncertainty on outcomes.
o Complexity (Giezen, 2012),
o Reliability (Denyer et al., 2011)
Case study based investigations into factors of success in managing
project uncertainty
o 8 company study of offshore, power, transportation and technol-
ogy companies (Olsson, 2007)
o 6 companies in computer industry (Brown and Eisenhardt, 1997)
Contingency Draws on aspects of organisational theory including organisational design, Project type specific case studies on approaches to managing
school structure, technical uncertainty and complexity. Often uses case studies to uncertainty
highlight differences between various types of project. o Construction projects (Gosling et al., 2013; Reymen et al., 2008)
o Product development projects (Colarelli O'Connor and Rice,
2013; Howell et al., 2010; Leon et al., 2013)
o Firefighting and other emergency projects (Bigley and Roberts, 2001)
o IT projects (Brown and Eisenhardt, 1997; Madsen and Pries-Heje,
2009)
o Historical projects (Lenfle, 2011)
o Cross industry comparisons Construction vs IT
(Zika-Viktorsson et al., 2003)
Variety of approaches to managing project uncertainty
o Flexibility (Olsson, 2006)
o Use of pilot studies (Turner, 2005)
o Instructionist, learning and selectionist approaches (De Meyer et
al., 2002; Loch et al., 2008; Pich et al., 2002)
Strategic approaches agility or absorption or agile absorption
(Sull, 2009), postures and moves (Courtney et al., 1997)
Behaviour Both interpretive and descriptive research into facets of organisational Case studies into managing project uncertainty
school behaviour o Mega projects (Sanderson, 2012)
o Serial entrepreneurs (Schlesinger et al., 2012)
Individual practices to contend with uncertainty
o Adoption of reflective practices (Perminova et al., 2008)
o Sensemaking (Weick, 1995)
o Deliberate ignorance (Kutsch and Hall, 2010)
o Other cognitive processes (Harris and Woolley, 2009; Winch and
Maytorena, 2011)
Managing stakeholder relationships (Aaltonen, 2011; Bourne and
Walker, 2005)
Dealing with project complexity (Thomas and Mengel, 2008)
Project lifecycle based approaches (Thiry, 2004)
Governance Concerned with project governance and contractual matters such as the Governance mechanisms in mega projects (Sanderson, 2012)
school role of contracts and different forms of project structure Governance in nuclear projects (Ruuska et al., 2011)
(Alliances, Joint Ventures etc.) Governance in large scale road and rail (Bjelland and Aven, 2013;
Guo et al., 2014)
Relationship Similar to governance but more focus on project networks, stakeholder Relationships between actors and stakeholders as a source of
school interactions and relationships between project parties. uncertainty (Aaltonen, 2011; Jensen et al., 2006; Kolltveit and
Gronhaug, 2004; Thomas and Mengel, 2008)
Importance of the early phase in managing uncertainty (Atkinson et
al., 2006; Erkoyuncu et al., 2013; Kolltveit and Gronhaug, 2004;
Samset, 2009)
F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478 471

Table 2 (continued)
School of Description of school Key contributions
thought (Sderlund, 2011)
Decision Incorporates how decisions are made (both to initiate and continue or abort Decision making in specific project types
school projects) and explores the limits in rationality of decision making and the Mega projects (Ansar et al., 2014; Flyvbjerg et al., 2003; Van
role of political processes in project decision making Marrewijk et al., 2008; Winch, 2013)
Technology projects (Jugend and da Silva, 2014; Van Riel et al.,
2011)
Treatment of uncertainty in investment decisions (Beisler et al.,
2013; Harrison, 1992; Jovanovic, 1999; Mikaelian et al., 2011;
Mohamed and McCowan, 2001)
Cognitive processes in decision making under uncertainty (Tversky
& Kahneman, 1982; Smithson, 2009)
Decision making techniques (Chapman and Ward, 2002; Cleden,
2009; Einhorn and Hogarth, 1987)

challenge of identifying the key factors that influence it. projects. This is a notable gap in the literature, particularly in
However, the few tentative conclusions that can be drawn from the context of safety-critical industries where the influence of
this school are that soft skills such as competence, team spirit the regulator is strong and one of the key tensions present in
and communications can influence how successful project projects is that which exists between the licensee and
managers are in managing uncertainty (Brown and Eisenhardt, regulator's divergent views on new technology. This can lead
1997; Hong et al., 2004; Olsson, 2007). to the conservative use of tried and tested technology, and
Both the contingency and behavioural schools contain a preventing licensees benefiting from technological advances
wider array of research into different approaches to the and good industry practices developed elsewhere (Kettunun et
management of project uncertainty. A number of industry al., 2007). Extending recent work in the field of adaptive
specific case studies investigate how uncertainty is managed in governance (cf. Folke et al., 2005) where governance has
specific organisational contexts (see for instance Bigley and evolved from rigid top-down controlled structures to looser
Roberts, 2001; Howell et al., 2010; Reymen et al., 2008). partnership and collaborative arrangements to the domain of
Sweeping changes to the mindset and methods of the project project management may be a fruitful avenue for future
manager in managing uncertainty are also demanded by a research.
number of scholars in these schools (notably Loch et al., 2006; Literature in the relationship school of thought focuses on
Olsson, 2006; Pich et al., 2002 in the contingency school and the importance of identifying, acknowledging and responding
Weick and Sutcliffe, 2007; Perminova et al., 2008 in the to the needs of an often complex and diverse group of
behavioural school). Pich et al. (2002) propose two methods of stakeholders, particularly in the early phase of the project
managing highly uncertain projects that of learning and (Aaltonen, 2011; Kolltveit and Gronhaug, 2004; Williams,
selectionism. Learning involves scanning the environment to 2009). There is broad agreement within this school that
search for unknownunknowns coupled with continuous stakeholders are major source of uncertainty in projects and
problem solving and changes in direction to the project as the articulation of methods for managing stakeholders (Ward
new information emerges. Selectionism entails undertaking and Chapman, 2008).
multiple explorations to achieve the same outcome and making Lastly, the decision making school of thought incorporates
a decision on which is best during or after the process. Olsson scholarship on the cognitive processes involved in the decision
(2006) contends that uncertainty can be managed by maintain- making under uncertainty (Smithson, 2009; Tversky and
ing flexibility in the project. This is achieved through the use of Kahneman, 1982) proffering new perspectives on how we
late locking, staged development gates and the rigorous use of make decisions together with descriptions of different decision
project contingencies. Managing uncertainty can also be making techniques (Chapman and Ward, 2002; Cleden, 2009;
approached by means of the project manager maintaining a Einhorn and Hogarth, 1987). There is also a seam of literature
sense of mindfulness and vigilance (Weick and Sutcliffe, 2007) exploring on how uncertainty is treated in the particular context
throughout the project delivery, or by managing by assump- of investment decisions, and the exemplification of decision
tions rather than the traditional deterministic view of project making on specific project environments, from mega projects
planning. Here the project manager can start work in an (Flyvbjerg et al., 2003) to technology projects (Van Riel et al.,
environment of high uncertainty, learning from the outcomes of 2011).
early work to inform the future direction of the project, Whilst the extant literature is rich, with both complementary
gradually allowing assumptions to be converted into knowl- and competing approaches to the management of uncertainty
edge (McGrath and MacMillan, 2000). there are scarcely any studies that investigate how project
There are only four studies of project uncertainty directly management practitioners perceive the determinants of uncer-
related to the governance school (Bjelland and Aven, 2013; tainty. Furthermore, only one study of project uncertainty has
Guo et al., 2014; Ruuska et al., 2011; Sanderson, 2012) all of been identified in a safety-critical industry and that is a
which are based on case studies of large scale infrastructure historical review of the 1940's Manhattan Project (Lenfle,
472 F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478

Table 3 Table 4
Study participants by industry, role and project. Summary of respondents' views on the determinants of project uncertainty.
Organisation Project type Respondent role Perspective Determinants of uncertainty
Multi-national power Nuclear new build Programme manager Environmental Political, Economic, Social, Technological, Legal and
generation company Environmental (PESTLE) influences (for example government
Multi-national power Nuclear new build Programme manager energy policy, oil and energy prices etc.)
generation company Regulatory framework number and role of regulators
Multi-national power Nuclear ongoing operations Portfolio manager Organisational propensity for uncertainty
generation company Decision-making ability of organisation
Multi-national engineering Nuclear new build Project manager Individual Different psychological profiles perceive uncertainty in
company different ways
Nuclear technology Nuclear decommissioning Project manager Complexity Size of project
company Perceived project complexity
Multi-national engineering Civil aerospace new Project manager Number of stakeholders and project parties
company product development Length and complexity of supply chain
Multi-national engineering Civil aerospace new Project manager Information Level of knowledge about project and the proposed technical
company product development solution
Multi-national engineering Civil aerospace Project manager Clarity of scope and objectives
company ongoing operations Temporal Project timescales and tempo
Lifecycle stage
Organisational priority of the project
2011). In response to this, the empirical focus of this study is on Capability Experience and skills of project team
how an exploratory group of practising project managers in two Maturity of project management processes
safety-critical industries understands the determinants of Resource management and resource constraints
Industry skills base and supply chain capability
project uncertainty, and identifying the strategies adopted by
project managers to navigate a way through the uncertainties
with which they are confronted. Two main limitations to the study should be noted here.
Firstly the lack of data triangulation as only one method of data
3. Research design collection was utilised, and secondly the relatively small
number of interviews carried out. However, given that the
The study uses a cross-sectional, qualitative exploratory nature of the study was exploratory, that data saturation was
research design, based on eight semi-structured in-depth seen to occur and that the study aim was to posit only
interviews of practising project managers involved in seven preliminary models this should not detract materially from the
projects in nuclear power generation, nuclear decommissioning reliability of the findings.
and civil aerospace industries in the United Kingdom. The
respondents were selected through a combination of purposive 4. Findings and discussion
and convenience sampling, using industrial contacts to identify
experienced project management practitioners currently involved 4.1. Uncertainty as a kaleidoscope of influences on the project
on large-scale nuclear and civil aerospace projects. Due to
commercial restrictions, the projects studied cannot be named, Respondents were asked: What are the determinants of
but an anonymised list of respondents and projects is provided in uncertainty facing project managers in civil-nuclear and
Table 3. aerospace projects? The responses to this question are
The interviews were carried out during 2012. All interviews summarised in Table 4 and are organised around the themes
were audio recorded, transcribed and the five step process of identified earlier in Table 1.
analysis described in McCracken (1988) followed. This Important determinants of uncertainty that emerged under
involved textual analysis of the interview transcripts; relating the environmental perspective were external political influences
observations made by respondents to develop themes and and geopolitical forces (e.g. oil prices and Governments'
patterns, and then developing the interrelationships between aviation policies will impact projects in the civil aerospace
them into more general themes, drawing on the extant academic sector). The regulatory landscape also contributes significantly
literature to make sense of the findings. A content analysis of to environmental uncertainty in projects, with civil-nuclear
the data on the determinants of project uncertainty was also projects finding themselves in a position where the preparation
undertaken, deriving the categories from the perspectives of the safety-case, or overcoming the required regulatory
identified from the literature (see Table 1). Where new themes hurdles defines the critical path of the project, and yet the
emerged in the interviews these were added to the analytical resources capable of preparing the required paperwork often
categories and the data collection and analysis process sit outside the project team. Other aspects of the environment
continued. When no new substantive themes emerged after that influenced the level of project uncertainty were the
the eighth interview, data saturation was seen to occur (Guest et organisational culture and decision making ability of the
al., 2006). Analysis of the data was undertaken by the lead project (e.g. how decisions are made, who is involved and
author and verified by the second author to minimise any the level of accountability for decisions) (Chapman and
individual bias in interpreting the data collected. Ward, 2002).
F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478 473

The level of knowledge about the project was also seen as a


key determinant of project uncertainty (Ward and Chapman,
2003), with project managers needing to understand how
well-defined the project scope is, how clear the project outcome
is, ex-ante, and the level of knowledge within the project team
regarding the proposed solution.
Consistent with the temporal and complexity perspectives
(Cleden, 2009; Winch, 2010), the size of the project, its
perceived complexity and timescale were also viewed by
respondents as central to the level of uncertainty present in a
given project with one nuclear project manager stating: as
soon as you go beyond a five-year horizon then you are much
more likely to experience some kind of change that will cause a
perturbation in the project.
In theory, as a well-defined project progresses, the uncertainty
should gradually reduce (Winch, 2010); but there may still be
spikes in uncertainty as a consequence of unforeseen events.
Respondents suggested that the phase of a project has a stronger
influence on the level of uncertainty than the type of project
(e.g. new build or ongoing operations).
Fig. 1. The Uncertainty Kaleidoscope (determinants in italics emerged during
Other elements of complexity that determined the level of the empirical study; those in non-italics were identified in the literature).
uncertainty were the number of stakeholders and parties
involved (Ward and Chapman, 2008).
Interestingly, little evidence of uncertainty as a perceptive bargaining power limited and strategic alliances complex. For
phenomenon (Perminova et al., 2008) existing subjectively in long-term projects, the presence of an ageing workforce and the
the head of the project manager emerged from the interviews. difficulty in retaining key skills were a major source of
Echoing Madsen and Pries-Heje (2009) two respondents uncertainty. This is particularly true for nuclear projects, where
argued that particular individuals coped better with uncertainty almost 60% of the workforce is due to retire between 2020 and
than others, but no consistent view of uncertainty as being 2025 (Cogent, 2009) and where the privatisation and contrac-
determined subjectively was posited. Instead respondents were tion of the industry towards the end of the last century have led
pragmatic, and action oriented articulating uncertainties that to a fragmented workforce in some key areas.
manifested themselves to the whole project team rather than to The empirical observations described above are largely
them as individuals. consistent with the literature on the determinants of project
Conversely, one determinant of project uncertainty not uncertainty with the exception of two areas of dissonance.
articulated in the literature but raised repeatedly by Theory is rich with respect to the environmental, individual,
respondents was the capability to deliver the project, both at a complexity, information and temporal determinants of uncer-
project and at an industry level. At the project-organisation tainty (see Table 1). However, the capability (of both project
level the major influences on uncertainty were the level of team, and the wider organisation and industry), and the
maturity of project processes. Securing project resources was a regulatory environment against which the project is delivered
recurring source of uncertainty across projects in both civil are less well addressed. Yet, constraints in capability and the
nuclear and aerospace sectors, with respondents questioning close scrutiny of all aspects of the project by industry regulators
whether their organisation had the people and facilities to meet emerged in this study as an important factor in determining
project resource demands. project uncertainty.
The skills and experience of project team members also Synthesising theory and observation, we posit a model for
contributed to the level of uncertainty in the project; with understanding the determinants of project uncertainty as a
projects that were able to mobilise a highly-experienced project kaleidoscope of influences on the project the uncertainty
team better placed to manage uncertainty than those that were kaleidoscope (shown in Fig. 1). This uncertainty kaleidoscope
not. The nuclear industry has attempted to address this issue by is based on the five determinants of uncertainty found in the
introducing the concept of Suitably Qualified and Experienced literature (and presented in Table 1), validated and extended in
Personnel (HSE, 2007), but this formal requirement for this study to six (from Table 4) with the inclusion of capability
appropriately approved individuals can have the unintended (the importance of the regulatory environment was not
consequence of increasing further the resource constraints categorised as a seventh determinant but rather as an additional
under which the project must be delivered. component of the environmental perspective). At the centre of
At the industry level, uncertainty in project delivery arises the kaleidoscope are located the project objectives, surrounded
due to the nature of the industry supply chain and its skill base. by the six determinants (environmental, individual, complexity,
Respondents described a fragmented and fragile supply information, temporal and capability) that influence the level of
chain, in which contractual frameworks were inadequate, uncertainty in the project.
474 F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478

Table 5
The four conceptual approaches to managing project uncertainty, illustrative interview quotations and practical steps for project managers.
Conceptual approaches Illustrative interview quotations Practical approaches for project managers
to managing project
uncertainty
Structural It is really important to determine where you have certainty and where Uncertainty navigated by enacting the available project
you don't, as where you do make that distinction, you'll move ahead on processes particularly the risk management process, scope
firm ground with the things you believe you have certainty on. definition, gated review process.
The way in which we manage it like most other large organisations like Acknowledging where the project is in its lifecycle when
ours is to use gated review processes to step through that sort of assessing uncertainty documenting assumptions and
lifecycle approach and ultimately that is our approach to dealing with converting assumptions to knowledge.
uncertainty. Maintaining sufficient contingency in schedule and budget.
underpinned with good project processes to help decision making Managing projects at portfolio level to minimise resource
(e.g. design reviews, risk workshops) constraints.
So when we build our programmes we have to build in there quite a lot Creating platforms of certainty to help address pools of
of hold points, review points so that we can take stock. uncertainty.
It's about requirements management, configuration management,
interface management.
If you don't set yourself up well in the first place it just makes life
harder as you go through. You just make a bed that is more and more
uncertain as people embed themselves in different positions in the pool
of uncertainty and that becomes their reality and as you move on
without a solid platform it gets tougher.
Behavioural it's about being conscious and deliberate Use of soft skills important influencing, facilitation, conflict
I suppose individually I am always looking to keep options open where management.
I can, and in itself, that can sometimes introduce more uncertainty to Experienced based project manager's own or knowing the
what you are dealing with, but it is sometimes a necessity on a project right person to ask.
like this. Combination of mechanistic analysis and intuition and
So it's a mixture of intuition and judgement calling on the right people judgement: asking the right questions.
to brainstorm and discuss when necessary, and the risk review Being prepared for surprises.
mechanism is the main feeder for that. Managing uncertainty is a mind-set and attitude (the ability to live
What I am saying is that you cannot be prescriptive, as experience tells in the grey).
me that things will change, so it is a mind-set for me. It's an attitude, a Acknowledging uncertainty cannot be eliminated only reduced.
soft skill.
PMs need innate optimism, to keep going and moving forward, but not
overconfident.
It's about pulling everyone together to manage what you do in a world
that is grey or ambiguous. This involves being flexible in your approach
and able to adapt and move things forward when needed.
I follow my nose, talk to right people and ask what do you think .
This place works on who you know as we have 1000s years of
experience.
Relational I think that if the project team are aware or bought in to the fact that Increase collaboration and dialogue with stakeholders, manage
things can go wrong, apart from the risk register and at that point we've key project relationships.
got to act quickly, we have to do something differently, we've got to Make uncertainty visible can be hard when sponsors want
involve key stakeholders. predictability and certainty.
It's really about getting the buy in from our customers that these are Get buy in to the project's real level of uncertainty.
unpredictable projects and we are not always going to get the answers
we expect in them. They have to buy into that strategy as well. They
have to be prepared to stop and change direction fairly quickly.
It is also about a level of ambiguity and bringing stakeholders on a
journey with me
one of the things that I have suffered from in projects would be to give
people a number, so when you had gone through preliminary design and
were ready to start things have changed but that number is still in
people's heads, and if uncertainty had been articulated a little bit better
then projects wouldn't be so quickly dismissed as failures. This is not
always easy to do as people don't want to hear it, because they can't
deal with it either.
Orientating set moments along the way where we collect together everything and Use of structured techniques such as horizon scanning, sensitivity
then almost make a declaration, whether that be in an interim business analysis, brainstorming and Delphi technique.
case or whatever the document needs to be, so that we have a marker in Keeping options open as long as possible even if this increases
the sand uncertainty in short-term.
We can all see where we are now and look in rear view mirror, much Use of small scale trials to drive out larger uncertainties.
harder to look out front window when travelling at speed and with a fog
of uncertainty and see where you are trying to get to.
F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478 475

Table 5 (continued)
Conceptual approaches Illustrative interview quotations Practical approaches for project managers
to managing project
uncertainty
Orientating A mature project manager backed up with processes needs to have the
ability to look ahead, as these are the ones that will side swipe you. So
its trending, like sometimes you come away from a risk workshop and
it's not set out in front of you, there may be 3040 risks but there is a
general trend there that is telling you, join the dots, and that leads to
something else that is out there one bigger factor.
Managing uncertainty is about looking ahead and thinking what might
happen there.
We'll do an active trial on a small scale basis but it will give us a
wealth of information to remove the bigger risks and uncertainty

These sources of project uncertainty may be broadly similar Secondly, respondents conceptualised their approach to
across safety-critical projects but, rather like the eponymous managing uncertainty in behavioural terms; as an attitude
children's toy, the kaleidoscope can create a myriad of different encompassing flexibility, optimism, conscious decision making
landscapes of project uncertainty from these same six determinants. and being constantly attuned to the presence of uncertainty.
The likelihood of achieving the project objectives can also be Respondents that thrived in this environment acknowledged
affected by sudden changes, often small but sometimes significant, that uncertainty could not be eliminated; only reduced through
caused by the emergence or realignment of different areas of pro-active questioning of assumptions and pragmatic decision-
uncertainty in the project, whether due to the awareness of new making (Olsson, 2006). Several respondents stressed the
project data, new regulatory requirements on the project, or the importance of being able to remain flexible; maintaining focus
non-availability of the requisite number of skilled project resources on the project outcomes whilst operating amid high levels of
at a given time. The utility of the kaleidoscope lies not in its uncertainty. It may simply not be possible to finalise project
predictive power, but as a tool to enable project professionals in schedules, or provide accurate estimates if timescales are long
safety-critical environments better anticipate where uncertainty and scopes vague. Managing projects in this way can stress the
may reside in projects. prevailing organisational culture, particularly if it is risk adverse,
with project managers finding themselves at the nexus of two of
4.2. Conceptual and practical approaches to managing project the key tensions in safety-critical industries: firstly, the tension
uncertainty between an organisational culture of command and control and a
project management need for a culture more akin to doubt and
Respondents were also asked Thinking about a specific discovery (Perin, 2005) and secondly, between regulator and
project that you are working on, how do you approach licensee views on safety requirements (Kettunun et al., 2007).
uncertainty in this project? Through a textual analysis of the Balancing these competing tensions is likely to require tough,
responses, four conceptual approaches were identified (Table 5) politically adept project managers with excellent soft skills
together with practical steps that can be taken by project (Crawford et al., 2006; Sderlund and Maylor, 2012).
management practitioners to manage project uncertainty. Thirdly, respondents viewed uncertainty as a relational
The first conceptual approach was a structural one: construct stressing the importance of communicating
respondents spoke in terms of platforms of certainty and uncertainty to sponsors and other key stakeholders such as
pools of uncertainty, underpinning processes, stakes in the clients, regulators, or members of the project team. Frequent
ground and boundaries. Respondents navigated uncertainty by dialogue with industry regulators was important to ensure that
enacting the various project processes, in particular, risk the emerging project design would not spring any surprises on
management, scope definition and gated review processes. the regulator. Several respondents reported the need to make
These processes provided a structure to identify uncertainties uncertainty visible, constantly communicating it, rather than
and a means of managing them. Steering reviews and gated hiding or ignoring it. Obtaining buy-in for the real level of
decision points especially were seen as essential in documenting uncertainty on a particular project was seen as essential to
uncertainties, and converting assumptions to knowledge to managing the impact of uncertainty in safety-critical projects,
ensure the project could be delivered. As argued by Atkinson although achieving this was not without challenge and required
et al. (2006), Hillson (2002) and Ward and Chapman (2003) excellent communication and influencing skills to maintain
the risk management process was a key process in managing senior management confidence in the project and its inherent
uncertainty. In the presence of high levels of uncertainty and uncertainties.
the imperative to deliver safety-critical projects, the familiar The fourth and final conceptual approach was an orientating
processes and routines of project management were mobilised as one: respondents used navigational metaphors such as markers
bridges to connect the platforms of certainty gradually shrink the in the sand, the fog of uncertainty, rear view mirror and
remaining pools of uncertainty. looking ahead to conceptualise uncertainty. Project managers
476 F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478

used markers in the sand, akin to discovery driven planning were the environment, the inherent project complexity, the
(McGrath and MacMillan, 2000) rather than fixed project capability of both project team and industry wide supply chain
milestones. Respondents orientated themselves within the to deliver the project and the temporal challenge of projects
project uncertainty through the use of a range of structured exhibiting both long delivery timescales (up to 10 years for a new
techniques such as brainstorming, horizon scanning and nuclear plant) and extended plant lifetimes (60 years for a nuclear
sensitivity analysis. Brainstorming was carried out both power plant). The four conceptual approaches structural,
informally through ad-hoc conversations and formally by behavioural, relational and orientating also provide important
assembling relevant multidisciplinary experts. Heuristics from insights into project managers' internal conceptualisations of
past projects were used by both individual respondents and uncertainty and the external actions they take to manage it in the
project teams to help conceptualise new projects at the scoping context of safety-critical projects. Managing project uncertainty
phase, although interviewees acknowledged that in safety- involves much more than implementing a new project process, or
critical industries where individuals generally hold a surfeit of broadening the scope of the risk management process to
tacit knowledge, both these techniques can lead to bias and incorporate uncertainty. Rather, managing uncertainty is a
complacency, and an inability to spot those black swan events mindset which permeates all aspects of the project, requiring
(Taleb, 2007), or bolts from the blue (Cleden, 2009) that have the ability to remain flexible, to maintain focus on the project
the potential to derail a project. Conversely lessons-learnt logs outcomes whilst operating in the midst of high levels of
were perceived as an ineffective source of knowledge on uncertainty, and dwell amongst questions and assumptions rather
project uncertainty, primarily due to problems on indexing and than answers and knowledge. These are difficult skills to learn
accessing the relevant information. Respondents were more and confidently deploy particularly in environments which are
likely to seek their colleagues' opinions and knowledge about inherently conservative and risk-adverse.
past projects, viewing this as a more efficient and contextually There are a number of limitations to this study: it was
rich means of orientating themselves. situated entirely within the United Kingdom, and only a small
Other techniques used by respondents were the use of small number of project managers from a limited number of
scale trials, akin to the learning and selectionist approach organisations were interviewed. The findings may not therefore
articulated by Pich et al. (2002), to drive out larger uncertainties be generalisable across other geographic regions. Future work
in projects (Turner, 2005). Here the trials were used to reduce is required to broaden the scope of the study to a larger sample
knowledge gaps, allowing the project team to learn and of project managers in a number of different regions of the
subsequently adapt their approach to project delivery. world. Secondly, the linking of specific approaches to
Project contingency (on cost, time and project scope) was managing uncertainty to particular determinants of uncertainty
viewed by several as an essential tool in confronting lay outside the scope of this study, and this may also be a
uncertainty (Olsson, 2006), as it provides the project manager fruitful avenue for future research. However, the uncertainty
with the flexibility to adapt to the emergence of new kaleidoscope in its current form could be utilised as a
information without necessarily putting the project delivery at framework for comparative inquiry into the determinants of
risk. project uncertainty across a wider range of industries and types
The boundaries between the four approaches structural, of projects. Additional research studies addressing project
behavioural, relational and orientating are not fixed but uncertainty from a governance perspective would also make a
overlap, with many statements made by respondents embracing valuable contribution to knowledge in the domain of project
more than one approach to the management of uncertainty. uncertainty.
Nevertheless, the way in which respondents articulated their
approach to the management of project uncertainty gives an
important insight into their internal mental models of uncertainty Conict of interest
and a window into the connection between these internal
conceptualisations of uncertainty and external actions taken to There are no conflicts of interest in this research.
deal with it.
Acknowledgements
5. Conclusions
The authors would like to thank the two anonymous
This paper describes the results of an exploratory qualitative reviewers for their insightful and constructive comments on
investigation into what managing uncertainty means to experi- the originally submitted manuscript.
enced project managers in safety-critical industries in the UK.
Drawing on the emerging body of literature in project uncertainty
and the experiences of practising project managers it posits that References
project uncertainty can be understood as a kaleidoscope of
influences on safety-critical projects and articulates four concep- Aaltonen, K., 2011. Project stakeholder analysis as an environmental
interpretation process. Int. J. Proj. Manag. 29, 165183.
tual approaches adopted by project managers to manage it more Ansar, A., Flyvbjerg, B., Budzier, A., Lunn, D., 2014. Should we build more
effectively. In the context of safety-critical industries the major large dams? The actual costs of hydropower megaproject development.
determinants of project uncertainty that emerged from the study Energy Policy 69, 4356.
F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478 477

Atkinson, R., Crawford, L., Ward, S., 2006. Fundamental uncertainties in Folke, C., Hahn, T., Olsson, P., Norberg, J., 2005. Adaptive governance of
projects and the scope of project management. Int. J. Proj. Manag. 24, socialecological systems. Annu. Rev. Environ. Resour. 30 (1), 441473.
687698. Frank, M.V., 1999. Treatment of uncertainties in space nuclear risk assessment
Bedford, T., 2009. Exploratory quantitative analysis of emergent problems with examples from Cassini mission applications. Reliab. Eng. Syst. Saf. 66
with scant information. In: Williams, T.M., Samset, K., Sunnevag, K.J. (3), 203221.
(Eds.), Making Essential Choices with Scant Information; Front End Ghaffari, M., Sheikhahmadi, F., Safakish, G., 2014. Modelling and risk analysis
Decision Making in Projects. Palgrave Macmillan, Basingstoke, UK, pp. of a virtual project team through project lifecycle with fuzzy approach.
279299. Comput. Ind. Eng. 72, 98105.
Beisler, M., Klapperich, H., Jacob, D., Schweiger, H., 2013. Modelling of input Giezen, M., 2012. Keeping it simple? A case study into the advantages and
data uncertainty for the financial evaluation of complex infrastructure disadvantages of reducing complexity in mega project planning. Int. J. Proj.
projects. Bauingenieur 88, 7888. Manag. 30, 781790.
Bigley, G.A., Roberts, K.H., 2001. The incident command system: high Gosling, J., Naim, M., Towill, D., 2013. Identifying and categorising the
reliability organising for complex and demanding task environments. Acad. sources of uncertainty in construction supply chains. J. Constr. Eng. Manag.
Manag. J. 44 (6), 12811299. 139 (1), 102110.
Bjelland, H., Aven, T., 2013. Treatment of uncertainty in risk assessments in the Guest, G., Bunce, A., Johnson, L., 2006. How many interviews are enough? An
Rogfast road tunnel project. Saf. Sci. 55, 3444. experiment with data saturation and variability. Field Methods 18 (1),
Bourne, L., Walker, D.H.T., 2005. The paradox of project control. Team 5982.
Perform. Manag. 11 (5/6), 157178. Guo, F., Chang-Richards, Y., Wilkinson, S., Cun Li, T., 2014. Effects of project
Brauers, W.K., 1986. Essay review article: risk, uncertainty and risk analysis. governance structures on the management of risks in infrastructure projects:
Long Range Plan. 19 (6), 139143. a comparative analysis. Int. J. Proj. Manag. 32 (5), 815826.
Brown, S.L., Eisenhardt, K.M., 1997. The art of continuous change: linking Hajiagha, S.H.R., Mahdiraji, H.A., Hashemi, S.S., 2014. A hybrid model of
complexity theory and time pace evolution in relentlessly shifting fuzzy goal programming and grey numbers in project time, cost and quality.
organizations. Adm. Sci. Q. 42, 134. Int. J. Adv. Manuf. Technol. 71, 117126.
Chapman, C., 2006. Key points of contention in framing assumptions for risk Harris, E., Woolley, E., 2009. Facilitating innovation through cognitive
and uncertainty management. Int. J. Proj. Manag. 24, 303313. mapping of uncertainty. Int. Stud. Manag. Organ. 39 (1), 70100.
Chapman, C., Ward, S., 2000. Estimation and evaluation of uncertainty: Harrison, E.F., 1992. Perspectives on uncertainty in successful strategic choice
a minimalist first pass approach. Int. J. Proj. Manag. 18, 369383. at the CEO level. OMEGA Int. J. Manag. Sci. 20 (1), 105116.
Chapman, C.B., Ward, S., 2002. Managing Project Risk and Uncertainty: Head, G.L., 1967. An alternative to defining risk as uncertainty. J. Risk Insur. 2
A Constructively Simple Approach to Decision Making. John Wiley and (34), 205214.
Sons, Chichester, UK. Health and Safety Executive, 2007. Managing competence for safety-related
Cleden, D., 2009. Managing Project Uncertainty. Gower Publishing Limited, systems: Part 1 key guidanceAccessed on 21st October 2012 from http://
Farnham, UK. www.hse.gov.uk/humanfactors/topics/mancomppt1.pdf.
Cogent, 2009. Power People: The Civil Nuclear Workforce 20092025. Renaissance Hillson, D., 2002. Extending the risk process to manage opportunities. Int. J.
Nuclear Skills Series 1, 2009, (Accessed on 21st October 2012 from http://www. Proj. Manag. 20, 235240.
cogent-ssc.com/research/Publications/NuclearReportPowerPeople.pdf). Hillson, D., 2004. Effective Opportunity Management for ProjectsExploiting
Colarelli O'Connor, G., Rice, M.P., 2013. A comprehensive model of Positive Risk. Marcel Dekker, New York.
uncertainty associated with radical innovation. J. Prod. Innov. Manag. 30 Hong, P., Nahm, A.Y., Doll, W.J., 2004. The role of project target clarity in an
(S1), 218. uncertain project environment. Int. J. Oper. Prod. Manag. 24 (12),
Collins, J., Hansen, M.T., 2011. Great by Choice. HarperCollins, New York. 12691291.
Courtney, H., Kirkland, J., Viguerie, P., 1997. Strategy under uncertainty. Harv. Howell, D., Windahl, C., Seidel, R., 2010. A project contingency framework
Bus. Rev. 75 (6), 6679. based on uncertainty and its consequences. Int. J. Proj. Manag. 28,
Crawford, L., 2013. Dancing in the kaleidoscope: the challenge of leading 256264.
complex projects. PMI Global Congress, Istanbul April 2225th, 2013. Jaafari, A., 2001. Management of risks, uncertainties and opportunities on
Crawford, L., Morris, P., Thomas, J., Winter, M., 2006. Practitioner projects: time for a fundamental shift. Int. J. Proj. Manag. 19, 89101.
development: from trained technicians to reflective practitioners. Int. J. Jensen, C., Johansson, S., Lofstrom, M., 2006. Project relationships a model
Proj. Manag. 24, 722733. for analysing interactional uncertainty. Int. J. Proj. Manag. 24, 412.
Danilovic, M., Sandkull, B., 2005. The use of dependence structure matrix and Jovanovic, P., 1999. Application of sensitivity analysis in investment
domain mapping in managing uncertainty in multiple project situations. Int. project evaluation under uncertainty and risk. Int. J. Proj. Manag. 17 (4),
J. Proj. Manag. 23, 193203. 217222.
Dawson, R.J., Dawson, C.J., 1998. Practical proposals for managing uncertainty Jugend, D., da Silva, S.L., 2014. Product portfolio management: a framework
and risk in project planning. Int. J. Proj. Manag. 16 (5), 299310. based on methods, organisation and strategy. Concurr. Eng. Res. Appl. 22
De Meyer, A., Loch, C.H., Pich, M.T., 2002. Managing project uncertainty: (1), 1728.
from variation to chaos. MIT Sloan Manag. Rev. 6067 (Winter). Kahneman, D., Tversky, A., 1982. Variants of uncertainty. In: Kahneman, D.,
Denyer, D., Kutsch, E., Lee-Kelley, E., Hall, M., 2011. Exploring Slovic, P., Tversky, A. (Eds.), Judgement Under Uncertainty: Heuristics and
reliability in information systems programming. Int. J. Proj. Manag. Biases. Cambridge University Press, Cambridge, pp. 509520.
29, 442454. Kettunun, J., Reiman, T., Wahlstrom, B., 2007. Safety management challenges
Duncan, R., 1972. Characteristics of organisational environments and perceived and tensions in the European nuclear power industry. Scand. J. Manag. 23,
environmental uncertainty. Adm. Sci. Q. 17, 313327. 424444.
Einhorn, H.J., Hogarth, R.M., 1987. Decision making: going forward in Keynes, J.M., 1937. The general theory of unemployment. Q. J. Econ. 51,
reverse. Harv. Bus. Rev. 6671 (JanFeb). 209223.
Erkoyuncu, J.A., Durugbo, C., Roy, R., 2013. Identifying uncertainties for Khamooshi, H., Cioffi, D.F., 2013. Uncertainty in task duration and cost
industrial service delivery: a systems approach. Int. J. Prod. Res. 51 (21), estimates: fusion of probabilistic forecasts and deterministic schedules. J.
62956315. Constr. Eng. Manag. 139 (5), 488497.
Falla, M., 1997. Advances in Safety Critical Systems Results and Achievements Kolltveit, B.J., Gronhaug, K., 2004. The importance of the early phase:
from the DTI/EPSRC R&D ProgrammeAccessed on 21st October 2012 from the case of construction and building projects. Int. J. Proj. Manag. 22,
http://www.comp.lancs.ac.uk/computing/resources/scs/. 545551.
Flyvbjerg, B., Bruzelius, N., Rothengatter, W., 2003. Megaprojects and Risk: Kutsch, E., Hall, M., 2010. Deliberate ignorance in project risk management.
An Anatomy of Ambition. Cambridge University Press, UK. Int. J. Proj. Manag. 28, 245255.
478 F.C. Saunders et al. / International Journal of Project Management 33 (2015) 467478

La Porte, T.R., 2006. A review of shouldering risks. Adm. Sci. Q. 155158 Essential Choices with Scant Information; Front End Decision Making in
(March). Projects. Palgrave Macmillan, Basingstoke, UK, pp. 1835.
Laslo, Z., Goldberg, A.I., 2008. Resource allocation under uncertainty in a Sanderson, J., 2012. Risk, uncertainty and governance in mega projects. Int. J.
multi project matrix environment: is organisational conflict inevitable? Int. Proj. Manag. 30, 432443.
J. Proj. Manag. 26, 773788. Schlesinger, L.A., Kiefer, C.F., Brown, P.B., 2012. New project: don't analyse
Lawrence, P.R., Lorsch, J.W., 1967. Organisation and Environment. Harvard act. Harv. Bus. Rev. 154158 (March).
Business School Press, Boston. Smithson, M., 1989. Ignorance and Uncertainty: Emerging Paradigms. Springer
Lempert, R.J., Popper, S.W., Bankes, S.C., 2003. Shaping the Next One Verlag, New York.
Hundred Years: New Methods for Quantitative Long Term Strategy Smithson, M., 2009. The many faces and masks of uncertainty. In: Bammer, G.,
Analysis, MR-1626-RPC. The RAND Pardee Centre, Santa Monica, Smithson, M. (Eds.), Uncertainty and Risk: Multidisciplinary Perspectives.
California. Earthscan, London, UK, pp. 1325.
Lenfle, S., 2011. The strategy of parallel approaches in projects with Sderlund, J., 2011. Pluralism in project management: navigating the cross
unforeseeable uncertainty: the Manhattan case in retrospect. Int. J. Proj. roads of specialisation and fragmentation. Int. J. Manag. Rev. 13, 153176.
Manag. 29, 359373. Sderlund, J., Maylor, H., 2012. Project management scholarship: relevance,
Leon, H.C.M., Farris, J.A., Letens, G., 2013. Improving product development impact and five integrative challenges for business and management
performance through iterative front loading. IEEE Trans. Eng. Manag. 60 schools. Int. J. Proj. Manag. 30, 686696.
(2), 552565. Sull, D., 2009. How to thrive in turbulent markets. Harv. Bus. Rev. 7888 (Feb).
Lippman, S.A., McCardle, K.E., Tang, C.S., 2013. Using Nash bargaining to Sutcliffe, K.M., Zaheer, A., 1998. Uncertainty in the transaction environment:
design project management contracts under cost uncertainty. Int. J. Prod. an empirical test. Strateg. Manag. J. 19, 123.
Econ. 145 (1), 199207. Taleb, N.N., 2007. The Black Swan: The Impact of the Highly Improbable.
Loch, C.H., De Meyer, A., Pich, M.T., 2006. Managing the Unknown: A New Penguin Books, London, UK.
Approach to Managing High Uncertainty and Risk in Projects. John Wiley Thiry, M., 2004. For DAD: a programme management lifecycle process. Int. J.
and Sons, Hoboken, New Jersey. Proj. Manag. 22, 245252.
Loch, C.H., Solt, M.E., Bailey, E.M., 2008. Diagnosing unforeseeable Thomas, J., Mengel, T., 2008. Preparing PMs to deal with complexity
uncertainty in a new venture. J. Prod. Innov. Manag. 25, 2846. advanced PM education. Int. J. Proj. Manag. 26, 304315.
Loosemore, M., Raftery, J., Reilly, C., Higgon, D., 2006. Risk Management in Turner, J.R., 2005. The role of pilot studies in reducing risk on projects and
Projects, second ed. Taylor and Francis, Abingdon, UK. programmes. Int. J. Proj. Manag. 23, 16.
Madsen, S., Pries-Heje, J., 2009. Taking a closer look at uncertainty in IS Tversky, A., Kahneman, D., 1982. Judgement under uncertainty; heuristics and
projects. AMCIS 2009 Proceedings (Accessed on 12th October 2012 from biases. In: Kahneman, D., Slovic, P., Tversky, A. (Eds.), Judgement Under
http://aisel.aisnet.org/amcis2009/119). Uncertainty: Heuristics and Biases. Cambridge University Press, Cam-
March, J.G., Simon, H.A., 1958. Organisations. John Wiley and Sons, New York. bridge, pp. 320.
McCracken, G., 1988. T. Sage University Paper on Qualitative Research Van Marrewijk, A., Clegg, S.R., Pitsis, T.S., Veenswijk, M., 2008. Managing
Methods vol. 13. Sage, Beverley Hills, CA. publicprivate mega projects: paradoxes, complexity and project design.
McGrath, R.G., MacMillan, I., 2000. The Entrepreneurial Mindset: Strategies Int. J. Proj. Manag. 26, 591600.
for Continuously Creating Opportunity in an Age of Uncertainty. Harvard Van Riel, A.C.R., Semeijn, J., Hammedi, W., Henseler, J., 2011. Technology
Business School Press, Boston, MA. based service proposal screening and decision making effectiveness.
Meredith, J.R., Mantel, S.J., 2010. Project Management: A Managerial Manag. Decis. 49, 5,7625,783.
Approach, seventh ed. John Wiley and Sons, Hoboken, New Jersey. Wagner, S.M., Padhi, S.S., Zanger, I., 2014. A real option based supply chain
Mikaelian, T., Nightingale, D.J., Rhodes, D.H., Hastings, D.E., 2011. Real project evaluation and scheduling method. 52 (12), 37253743.
options in enterprise architecture: a holistic mapping of mechanisms and types Wang, Q.Z., Liu, J., 2006. Project uncertainty, management practice and project
for uncertainty management. IEEE Trans. Eng. Manag. 58 (3), 457470. performance: an empirical analysis on customised information systems
Milliken, F., 1987. Three types of perceived uncertainty about the environment: development projects. IEEE 2006, 341345.
state, effect and response. Acad. Manag. Rev. 12 (1), 133143. Ward, S., Chapman, C., 2003. Transforming project risk management into
Milly, P.C.D., Betancourt, J., Falkenmark, M., Hirsch, R.M., Kundzewicz, Z. project uncertainty management. Int. J. Proj. Manag. 21, 97105.
W., Lettenmaier, D.P., Stouffer, R.J., 2008. Stationarity is dead: whither Ward, S., Chapman, C., 2008. Stakeholder and uncertainty management in
water management? Science 319, 573574. projects. Constr. Manag. Econ. 26, 563577.
Mohamed, S., McCowan, A., 2001. Modelling project investment decisions Wears, R.L., 2012. Rethinking healthcare as a safety-critical industry. Work 41,
under uncertainty using possibility theory. Int. J. Proj. Manag. 19, 231241. 45604563.
Olsson, N.O.E., 2006. Management of flexibility in projects. Int. J. Proj. Weick, K.E., 1995. Sensemaking in Organizations. Sage, Thousand Oaks, CA.
Manag. 24, 6674. Weick, K., Sutcliffe, K., 2007. Managing the Unexpected. John Wiley and
Olsson, R., 2007. In search of opportunity management: is the risk management Sons, San Francisco, CA.
process enough? Int. J. Proj. Manag. 25, 745752. Williams, T., 2009. Decisions made on scant information. In: Williams, T.M.,
Osman, M., 2010. Controlling Uncertainty: Decision Making and Learning in Samset, K., Sunnevag, K.J. (Eds.), Making Essential Choices with Scant
Complex Worlds. Wiley Blackwell, Chichester, UK. Information; Front End Decision making in projects. Palgrave Macmillan,
Perin, C., 2005. Shouldering Risks: The Culture of Control in the Nuclear Basingstoke, UK, pp. 317.
Power Industry. Princeton University Press, New Jersey, USA. Winch, G.M., 2010. Managing Construction Projects: An Information
Perminova, O., Gustafsson, M., Wikstrom, K., 2008. Defining uncertainty in Processing Approach, second ed. Wiley-Blackwell, Chichester, UK.
projects: a new perspective. Int. J. Proj. Manag. 26, 7379. Winch, G., 2013. Escalation in major projects: lessons from the Channel fixed
Pich, M.T., Loch, C.H., De Meyer, A., 2002. On uncertainty, ambiguity, and link. Int. J. Proj. Manag. 31 (5), 724734.
complexity in project management. Manag. Sci. 48, 8,10088,1020. Winch, G.M., Maytorena, E., 2011. Managing risk and uncertainty on projects:
Porter, M.E., 1980. Competitive Strategy. Free Press, New York. a cognitive approach. In: Morris, P.W.G., Pinto, J.K., Sderlund, J. (Eds.),
Reymen, I.M.M.J., Dewulf, G.P.M.R., Blokpoel, S.B., 2008. Framework for The Oxford Handbook of Project Management. Oxford University Press,
managing uncertainty in property projects. Build. Res. Inf. 36 (6), 580592. Oxford, pp. 345364.
Ruuska, I., Ahola, T., Artto, K., Locatelli, G., Mancini, M., 2011. A new Zika-Viktorsson, A., Hovmark, S., Nordqvist, S., 2003. Psychosocial aspects of
governance approach for multi firm projects: lessons from Olkiluoto 3 and project work: a comparison between product development and construction
Flamanville 3 nuclear power plants. Int. J. Proj. Manag. 29, 647660. projects. Int. J. Proj. Manag. 21, 563569.
Samset, K., 2009. Projects, their quality at entry and challenges in the front end
phase. In: Williams, T.M., Samset, K., Sunnevag, K.J. (Eds.), Making

You might also like