You are on page 1of 13

This article has been accepted for inclusion in a future issue of this journal.

Content is final as presented, with the exception of pagination.

IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT 1

Evaluating the Success of a Project and the


Performance of Its Leaders
Ofer Zwikael and Jack Meredith

Abstract—Although organizations regularly execute projects to For example, a project manager may perform well but
improve their performance, there is still no agreement in the liter- events beyond their control cause the project to fail, or
ature on how to evaluate their eventual success. As a result, schol- vice versa;
ars end up using different scales to measure the same outcome
variable of project success, thereby causing inconsistency in re- 2) are frequently limited to certain types of projects and hence
search results. Existing project success evaluation models suffer not generic enough to enable their use across all project
from their inability to apply to all project types and lack of sep- types; and
aration of project success measurement from that of project indi- 3) typically mix or combine the different perspectives of key
viduals’ performance (for e.g., of the project manager). Through stakeholders (for e.g., the client and the contractor) into
two longitudinal studies based on the satisficing theory, this paper
develops, validates, and illustrates generic scales to measure the one global but meaningless score that provides an overall
success of any project, as well as the performance of its two key (but misrepresentative) view of project success.
leaders. This results in three distinct project success dimensions: Using one overall project success score is in conflict with the
1) Project management success—evaluates the performance of the consensus in the literature on the multidimensional nature of
project manager in achieving the project plan; 2) Project ownership project success [20], [36], [50]. Pinto was the first to develop
success—evaluates the performance of the project owner in realiz-
ing the business case; and 3) Project investment success—evaluates distinct success dimensions [37] and an overall success measure
the investment performance of the project for its funder. This pa- (an average of all the success dimensions) called the project
per contributes to the literature by offering a theoretically robust, implementation profile (PIP). However, rather than using the
multidimensional evaluation model that will enhance performance dimensions as separate constructs that evaluate a project from
evaluation of both projects and their leaders. different perspectives, many scholars wrongly use the PIP or
Index Terms—Operations and management, performance eval- other similar aggregate scales (for e.g., [13], [19], [30], [42],
uation, product development, project management, software devel- and [44]).
opment management. These limitations with the leading models result in the lack
of an agreed-upon project success evaluation model in the lit-
I. INTRODUCTION erature. Consequently, scholars use dissimilar project success
scales to measure the same outcome variable (project success),
UCCESSFUL projects have a substantial positive impact on
S organizational performance; hence, understanding project
success correctly is of importance for both practice and research
which results in misleading and inconsistent research findings.
Given this research gap, we investigate the following research
question: How should project success and the performance of
(for e.g., [14], [20], and [28]). However, “there is still no con- its key leaders be measured? The objective of this paper is to
sensus as to what success really means” ([51], p. 33). To explain develop, validate, and illustrate multiple generic success and
why, after decades of research into this area, scholars still use performance scales that can be applied to any project.
different scales to measure project success (for e.g., [34], [41], To do so, it was necessary to separate the success measure
and [55]), we analyze the theoretical and methodological faults of the project itself from that of the individual performance of
with the leading project success evaluation models (i.e., those its key leaders (for e.g., the project manager). To recognize how
developed by Pinto, Shenhar, and DeLone and McLean). managers decide whether an initiative was a successful invest-
Later in this paper we discuss these faults in detail, which ment, we use Simon’s [53] theory of satisficing managerial be-
suggest that existing models havior. This theory notes that managers aim at satisficing their
1) fail to separate project success measures from individual objectives, rather than maximizing or optimizing them. Over the
performance measures (for e.g., of the project manager). years since the introduction of this Nobel Prize winning theory,
Manuscript received January 24, 2019; revised May 8, 2019 and June 8, 2019; others (for e.g., [7], [21], [23], [33]) have employed and extended
accepted June 22, 2019. Review of this manuscript was arranged by Department the satisficing concept in various contexts. One particular appli-
Editor P. ED Love. (Corresponding author: Ofer Zwikael.) cation in the area of project performance is that of Zwikael and
O. Zwikael is with the Australian National University, Canberra, ACT 0200,
Australia (e-mail: ofer.zwikael@anu.edu.au). Smyrk [62] who pointed out that projects not achieving their for-
J. Meredith is with the Wake Forest University, Winston-Salem, NC 27109 mal goals stated in the business case may not necessarily imply
USA (e-mail: meredijr@wfu.edu). a failure, since senior management may still be satisfied with
Color versions of one or more of the figures in this paper are available online
at http://ieeexplore.ieee.org. the outcome. Thus, the crucial success measure of the project
Digital Object Identifier 10.1109/TEM.2019.2925057 should be based on the acceptability of the outcome in the eyes

0018-9391 © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

2 IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT

of its funding entity. Accordingly, the satisficing theory is used with the term “project management success” (PMS) [12], de-
here to develop a new project evaluation model that addresses fined as the extent to which the project plan was realized [21], in
the limitations and weaknesses of existing models. particular in achieving its time, cost, and scope targets. PMS
The proposed model is superior to the vast range of models is the first agreed-upon success dimension, which has been
proposed in the literature in recent decades because it is: widely accepted in business and research to measure the project
1) the first to distinguish between two important evaluation implementation process [37].
perspectives—that of project success (one measure) ver- However, “PMS” represents only an internal, short-term per-
sus the performance of its key leaders (two measures); spective of a project, but ignores the strategic and long-term
2) generic and can be used for any type of project; considerations [43], [52]. Basten et al. argue that “the tradi-
3) theory based, relying on the satisficing theory [53]; tional way of assessing project success is inadequate to as-
4) methodologically robust, developed and validated in a sess the overall success” ([3], p. 12). By considering only
five-step study, and then illustrated in a longitudinal study. PMS, project managers may make poor decisions when aiming
This paper contributes to the engineering management liter- to achieve local optimization rather than global optimization
ature by offering a multidimensional evaluation model that will for the good of the project—for example, a project manager
enhance the performance evaluation of both projects and their may conduct less consultation with stakeholders to reduce the
leaders. The following section analyzes existing project success duration of the project and enhance PMS, but by doing this
models and their limitations in more detail. damaging, the project’s chance to achieve a sustainable, agreed-
upon, and validated solution that will add long-term value to the
II. UNDERSTANDING PROJECT SUCCESS organization.
To deal with the limitations of the PMS scale, project evalua-
A. Multidimensional Nature of Project Success tion models were “reformulated to include longer-term success
Senior executives use the general term “project success” to criteria such as newly acquired skills and capabilities resulting
both subjectively describe and objectively evaluate the achieve- from team learning and growth” ([15], p. 972) and the utiliza-
ments of their projects at their completion. Similarly, scholars tion of a project’s outputs by its users [16]. Other researchers
use the same term as an outcome variable when conducting re- extended the PMS scale by considering additional dimensions,
search on projects. However, there are different points of view for such as client satisfaction Pinto and Mantel (1990), commercial
evaluating success following project completion. Shenhar et al. success and future potential [50], satisfaction of other stake-
argue that project success is a multidimensional construct, sug- holders [9], impact on the project team [48], as well as safety,
gesting that “different people … assess the success of projects in effectiveness, and reduced conflicts [54].
different ways, and at different times” ([47], p. 5). Indeed, each The three key project success evaluation models (based on
of the multiple project stakeholders (such as the organizational their use in practice and extensive research impact) and their
executives, the project manager, the project team, and end users) related dimensions are summarized in Table I.
has their own perspective of a project due to nationality, cul-
ture, vested interests, fears, hopes, incentives, and motivations C. Limitations of Existing Project Success Evaluation Models
[20], [27].
Moreover, reflection on project success can also change as These key project evaluation models, although extensively
time progresses, conditions change, and the project is viewed used in project-related research, suffer from multiple method-
in longer retrospect. Therefore, time horizons also play a role ological and theoretical limitations. First, these models include
because some stakeholders (for e.g., the project manager) have generic items that can be used in all projects (for e.g., comple-
a short-term interest, whereas others, such as the project funder tion on time and customer satisfaction), and they also include
(the senior executive who commits funds to the project, such as items that are relevant only to certain types of projects but are
the CEO or the president of the client organization), have longer inappropriate for measuring the success of others. For exam-
term concerns [61]. Shenhar et al. conclude that “comprehen- ple, Shenhar et al.’s model [52] includes success items, such as
sive success criteria must therefore reflect different interests and “developing a new technology” and “creating a new market.”
views—leading to a multidimensional, multicriteria approach” Such items may be irrelevant for many projects that instead aim
([50], p. 113). Therefore, project success should have “distinct at enhancing knowledge, developing capabilities, or reducing
but related dimensions” ([36], p. 8). operations costs. Similarly, DeLone and McLean’s model [16]
measures “system quality,” an item that may not be relevant for
projects, such as a new service, and Pinto and Mantel’s model
B. Key Project Success Dimensions
[39] assesses whether the project “solved a problem,” which may
Acknowledging that project success is a multidimensional not be relevant for projects that explore new opportunities. As a
construct, scholars have identified its key dimensions. At the op- result, existing project evaluation models are not generic enough
erational level, projects are expected to be completed on time, to enable their use across all project types. This limitation has
cost, and according to the intended scope. These three oper- created a situation where scholars remove unrelated items from
ational objectives were referred to by Martin Barnes in 1969 key scales and replace them with ad-hoc adjustments (for e.g.,
as the “iron triangle” [56]. The iron triangle was later replaced [34], [41], and [55]), which in turn results in research measuring
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZWIKAEL AND MEREDITH: EVALUATING THE SUCCESS OF A PROJECT AND THE PERFORMANCE OF ITS LEADERS 3

TABLE I
KEY PROJECT EVALUATION MODELS

the same outcome variable in an inconsistent manner over the funder who approved the project. Such a distinction is especially
years and across studies. important in cases where the project leaders perform well but
Second, although the consensus in the literature is that project are unlucky due to external factors, so the project fails, or vice
success is multidimensional and each dimension should capture versa. A formalized approach for such distinct project evaluation
a different type of information that is relevant for a particular dimensions is discussed next.
stakeholder, scholars commonly aggregate various dimensions
into one overarching score that provides an encompassing (but
III. DISTINCT PROJECT EVALUATION DIMENSIONS
possibly misleading) view of project success [13], [19], [30],
[42], [44]. For example, the Los Angeles Red Line metro project The discussion above highlights the need to evaluate project
was successful in terms of efficient delivery (opened to the pub- performance separately from various distinct perspectives.
lic eight months ahead of schedule, with no budget overruns) but Accordingly, Zwikael and Smyrk [62] proposed a triple-test
a failure in terms of long-term effectiveness (60 000 passengers conceptual framework to measure project success from three
in the first year instead of the expected one million), so an distinct dimensions. The first two dimensions evaluate the
aggregate score of “moderate success” will not capture the true individual performance of the two key project leaders (the
story correctly [49]. This type of aggregation can misrepresent project manager and the project owner) in realizing their
accurate performance because it does not allow capturing the relevant baseline documents (the project plan and the business
different views of its key stakeholders, who often represent dif- case, respectively). For this purpose, a project owner is defined
ferent entities and organizations. For comparison, in the strategy as “the senior manager who is held accountable by the funder
discipline, only 1% of research uses an aggregate performance for realizing the business case” [61]. The third dimension
construct, with the majority of research using a set of separate [project investment success (PIS)] is unique as it evaluates the
constructs, which thereby allows the researcher to study a effectiveness of the investment in the project for its funder by
unique outcome variable that best fits the perspective of their assessing the success of the project overall. In other words, PIS
research [32]. does not evaluate individual performance, but instead takes a
Third, project success can be different from the successful long-term perspective of the actual value from the investment
performance of its leaders. In other words, a failed project in the project for its funder, that is, project success. For this
does not necessarily indicate poor performance of its project purpose, the funder is the key project stakeholder because they
manager, or vice versa. For example, in the Los Angeles metro invest in the project and expect to get some value for their key
project mentioned above, the construction project manager stakeholders in return for this investment.
achieved their goals by delivering the outputs ahead of time and The triple-test project evaluation framework is used in this
on budget, but the project failed because it did not reduce traffic paper for its following strengths.
problems, and eventually the remaining phases of the project 1) It is generic and can be implemented in any project.
were dropped [49]. 2) It proposes distinct scales that capture the different per-
Given the different (often even contradictory) perspectives of spectives of the key project stakeholders, such as the
success from various project stakeholders, evaluation models funder and project manager.
should be more comprehensive to represent such differences in 3) It evaluates the success of the project separately from the
objectives. Based on the separate constructs approach principle performance of its key leaders.
[32], we develop a model of distinct but related success dimen- 4) Other evaluation models focus on various internal and ex-
sions that distinguishes between the achievement of the goals ternal stakeholders, whereas this one focuses on the most
of the project’s leaders and the realization of net value for the important ones (i.e., the project funder, project owner,
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

4 IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT

TABLE II
TRIPLE-TEST PROJECT EVALUATION DIMENSIONS

and project manager) that represent the needs of all other IV. RESEARCH OVERVIEW
project stakeholders. Because the Zwikael and Smyrk [62] project evaluation
The three conceptual success dimensions of the triple-test
framework we adopted is conceptual and did not offer mea-
conceptual framework are summarized in Table II. surement scales, this paper develops, tests, and validates such
PMS evaluates the achievement of the project plan (i.e., sched-
scales using two research methodologies (see Table III). We use
ule, cost, and scope/quality targets) by the project manager,
longitudinal studies to capture the time it takes project benefits
whereas both project ownership success (POS) and PIS cap- to be realized after project completion. We also use a structured
ture the value generated from the project. It should be noted that
scale development process [11] to develop and validate the new
this value, detailed in the project’s business case, does not need
scales. These scales will then be used to enhance practice and
to necessarily improve the current situation but simply provide develop theory through hypothesis testing.
a positive benefit to the project funder in comparison to the al-
First, to ensure the proposed project evaluation model is valid
ternative future situation had the project not been undertaken.
and comprehensively captures the distinct, but related dimen-
The value can be measured in both monetary terms, such as sions of project success, we conducted the following five steps
return on investment (ROI) and net present value (NPV) [24],
[11]. In Step 1, to confirm the need for a multidimensional
as well as nonmonetary returns such as increased organizational project evaluation model [36], [50], we conducted a content va-
capabilities or new knowledge generated from the project. How- lidity study, which involved a group of 20 international experts
ever, POS is relative (to realizing the business case’s goals—see
from academia and industry. In Step 2, for item generation and
[29]), whereas PIS is a measure for the absolute contribution of refinement we interviewed 13 senior executives (9 CEOs and
the project to its funder regardless of the project’s stated goals. 4 CFOs) and conducted a supplementary literature analysis. In
The use of PIS as the missing piece in project evaluation allows
Step 3, we conducted an initial item reduction by following an
us to distinguish between the success of a manager in achieving exploratory factor analysis (EFA) based on survey data collected
their nominal goals set in its business case (POS) from the actual from 146 global managers. In Step 4, we validated the scales by
success which results in a net gain (project worth) to the organi-
conducting a confirmatory factor analysis (CFA), and tested con-
zation (PIS). The actual worth of the project is calculated based vergent validity and internal consistency, based on survey data
on the monetary and nonmonetary benefits realized, disbenefits
of 200 U.S. projects. To capture the long-term effect of projects
realized, and project cost [63].
on their organizations, this step involved longitudinal data col-
By distinguishing between the two project success dimen- lection. In Step 5, we reconfirmed the scales by replicating the
sions, we argue that projects can still be considered a success
survey with a different group of participants in a large survey of
even when the business case is not achieved. For example, in the
267 additional projects in various cultures. In Study 2, we an-
NASA’s Hubble Telescope project [17], [51], because the tele- alyzed 20 projects in Europe and Australia by comparing their
scope was produced and delivered to space with a faulty mirror,
ex ante with ex post NPV values to test the hypothesis using a
the target benefits from the project were delivered late (POS different research methodology.
failure). By way of contrast, the general view of the astronomy
community (including NASA itself) is that the images gener-
ated by the now-repaired instrument have been of inestimable
V. STUDY 1—THE DEVELOPMENT OF THE PROJECT
scientific value (PIS success). In other words, a project can fail
EVALUATION MODEL
to achieve its business case targets (POS) but still be a success-
ful investment for its funder (PIS), although not the other way This study describes five steps to develop and validate success
around. If a project achieved its business case targets (POS), scales for the project evaluation model.
then it implies that the funder is satisfied with the project’s re-
sults, otherwise they would have never approved the project. We
therefore hypothesize that PIS scores will be higher than those A. Step 1—The Multidimensional Nature of Project Success
of POS:
The objective of Step 1 was to confirm the multidimensional
H1 : Project investment success scores are higher than project own- structure of a project success scale by conducting a content
ership success scores (PIS>POS) validity study with subject experts.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZWIKAEL AND MEREDITH: EVALUATING THE SUCCESS OF A PROJECT AND THE PERFORMANCE OF ITS LEADERS 5

TABLE III
RESEARCH OVERVIEW OF TWO LONGITUDINAL STUDIES

1) Participants and Procedure: We sent requests for partic- approved) baseline documents (i.e., the business case and project
ipation to 30 international experts from both academia and in- plan). These three items were complemented by a new item
dustry. Twenty experts (67%) returned complete questionnaires, (PMS4), i.e., “the project manager did not cause unanticipated
consisting of 13 senior academics with a PhD in project man- negative impact to the project’s results” [62]. This item was
agement and related areas from leading universities, and seven added to ensure the project manager (or any of the project team
senior project management practitioners with global business members) has not caused negative results that are not directly
experience. Among these responses, eight were received from related to time, cost, and scope, such as higher than expected
Australia, five from the United States, three from Israel, two levels of pollution and noise during a construction project.
from New Zealand, and one from the U.K. and China each. For project success, the following three items were developed
We asked participants to sort each of the seven questionnaire from core theories in adjacent disciplines.
items (discussed below and presented in random order) into one 1) “The project realized its target benefits—as set by the
of the two traditional success dimensions (derived from the lit- project’s funder.” This item relies on the expectation that a
erature analysis mentioned above) where they best fit: PMS and project should realize its target benefits - strategic project
project success [12]. We provided a definition for each dimen- goals that, following project completion, will enhance or
sion, but did not indicate which dimension the items should fall maintain organizational performance, as specified in the
in. As suggested by Churchill [11], we also asked participants business case [6], [61].
to provide feedback on the clarity and readability of each item. 2) “The investment in this project generated satisfactory re-
2) Measures: The four PMS items were based on the three sults for the project’s funder.” This item is based on
iron triangle items—the project was completed on time, within Simon’s [53] satisficing theory, as described earlier.
budget, and within the agreed scope. Because we do not evaluate 3) “The project’s funder would have invested in this project
the quality of the decision to approve the project (but instead the again had they known its actual final results.” Regret the-
performance during the project given the changing requirements ory [4], [5] posits that people care not only about what
and conditions), we refer to the modified (i.e., most recently they get, but also about what might have been obtained
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

6 IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT

had they chosen differently. Pinto and Mantel (1990) use months” (CFO #1), and “the two targets we give them is keeping
the regret theory in their first project success item: “Know- the project within the allocated cost and timelines” (CFO #6).
ing what you know now about the status of the project, we Moreover, the interviewees suggested an overall question to be
would have developed the project” (p. 275). Therefore, added for evaluating the project management process holisti-
a successful project for a funder is one they would have cally.
invested in again. b) Project Success: Interviewees in the private sector em-
3) Data Analysis: We used the following two criteria [1] to phasized the importance of achieving financial success. For ex-
test the experts’ level of agreement with the proposed dimen- ample, CEO #3 said that project success is judged in terms of
sions: 1) substantive agreement, measuring the proportion of “revenue retention perspective,” because “we need to get value
respondents who assign an item to its intended dimension (a to shareholders …give a commercial benefit to the company.”
threshold value of 0.7); and 2) substantive validity coefficient, Furthermore, interviewees stated that a successful project also
measuring the extent to which respondents assign an item to its realizes the nonmonetary target benefits that were approved be-
posited dimension rather than another dimension (a threshold fore its commencement: “achieve the benefits of the project as
value of 0.5). in the business case” (CEO #3). In particular, CFO #1 refers to a
4) Results: Six of the seven proposed items received val- target benefit of “knowledge sharing and resource capabilities,”
ues higher than the thresholds required for both measures, with stating that the project “will enhance the [country’s] economic
values for the substantive agreement index ranging from 0.78 activity.” In the telecom company, CEO #3 refers to “qualitative
to 0.94 and substantive validity coefficient from 0.56 to 0.88. benefits, such as enhancement in customer service and reduction
Therefore, these items were confirmed in their proposed di- in fault rate to the customer.” CEO #7 mentioned the target ben-
mensions. Item PMS3 was the only one not to meet the thresh- efits of increased “customer satisfaction” and reduced “number
old requirements. Following comments made by the experts, its of accidents.”
wording was changed to “The project was completed within the 4) Discussion and Further Literature Review: Interviewees
agreed scope” for testing in the next step. It was expected that the confirmed PMS as an important dimension to evaluate the per-
revised wording sufficiently clarified the meaning of the item, formance of project managers, while also emphasizing the im-
being one of the three dimensions of the iron triangle. Minor portance of benefit realization for overall project success. To
word changes have also been made to the other items as per the learn more about the relationship between target benefits and
suggestions received from the experts. For example, PMS4 was project success we conducted an additional literature review to
simplified to “the project was completed without undesirable identify examples of target benefits in various project types,
benefits caused by the project manager.” such strategic, operational, compliance, and external projects
[46]. We concluded that there is a large variety of target benefits
(for e.g., increased public health, increased knowledge, reduced
B. Step 2—Item Generation and Refinement manufacturing cost, and increased service quality), and thus, a
Following the confirmation of the multidimensional structure limited number of success items in a scale cannot accommo-
of a project success scale in Step 1, the objective of this step was date all project types. Therefore, the proposed model includes a
to identify potential project success dimensions and items and generic item regarding target benefits (“the project has realized
then refine them for empirical testing in future steps. all target benefits”), where each project can define its unique
1) Participants and Procedure: We interviewed 13 senior target benefits.
global executives (nine CEOs and four CFOs) of large organiza- Based on the items that had received support in the first two
tions who approve and evaluate project success. To obtain suffi- steps, complemented by an additional literature review, we pro-
cient diversity, we included organizations that were both private posed an initial set of items (see Table IV) for the three project
(for e.g., banks and telecom firms) and governmental (for e.g., a success dimensions adopted earlier.
transportation hub and a government department). Although all
these organizations were based in Fiji, the interviewees gener-
ally had global business experience and worked in collaboration C. Step 3—Initial Item Reduction
with their international companies’ headquarters overseas (for The objective of this step was to refine the initial items
e.g., Germany, Australia, and the U.K.) and used diverse project identified in Step 2 using an empirical study, which includes
management methodologies. The interviews lasted 50 min on convergent validity tests and an EFA.
average and were semistructured so the participants could elab- 1) Participants and Procedure: We conducted a survey of
orate on how their organizations evaluate project success. 146 senior managers who supervise projects in Papua New
2) Data Analysis: The interview transcripts were coded and Guinea. This country was selected because it is one of the world’s
analyzed with reference to the two success dimensions tested in fastest-growing economies and accommodates a large number
Step 1: PMS and project success. This was achieved through an of infrastructure, gas, oil, and mineral mega projects executed
iterative process of data analysis from different perspectives at by foreign companies using project management methodologies
different times [31]. commonly used in the United States and the U.K. [57], and of-
3) Results: fers a different culture to test the robustness of our scales. Most
a) Project Management Success: The interviewees empha- organizations included in the sample were government (28.1%),
sized the importance of completing projects on time and budget, services (15.8%), engineering (13.7%), NGO (12.3%), and con-
for example, “We had to fast-track internet banking within three struction (11.0%). Most common project types in the sample
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZWIKAEL AND MEREDITH: EVALUATING THE SUCCESS OF A PROJECT AND THE PERFORMANCE OF ITS LEADERS 7

TABLE IV
INITIAL ITEMS FOR THE THREE PROJECT SUCCESS DIMENSIONS (STEP 2)

were construction (32.9%), services (28.1%), and engineering 3) Data analysis: To test convergent validity, we calculated
(15.1%). The average project lasted 19.1 months, involved a the significance of the correlation between the proposed similar
team of 69.1 members and cost US$14M. Questionnaires were constructs. We then conducted an EFA to confirm the dimen-
administrated in English, which is an official language and spo- sions of the success construct and to conduct item reduction. To
ken by professionals. We selected senior managers rather than examine whether the items load onto the specified dimensions,
project managers as survey participants, to avoid self-evaluation we performed a rotated Varimax factor analysis with Kaiser
of project success. Managers were asked to rate the success of Normalization and calculated alpha Cronbach (α), composite
the last project they supervised using the measures described reliability (CR) and average variance extracted (AVE) for each
below. factor.
2) Measures: We used the ten success items derived from 4) Results: Significant correlations were found for the fol-
Step 2 and presented in Table IV (rated on a seven-point Likert lowing four expected relationships analyzed for convergent
scale) to conduct an EFA. Because convergent validity measures validity:
the extent to which the proposed scale relates to similar estab- 1) schedule overrun—PMS1 (r = −0.466; p < 0.001);
lished constructs [59], we also asked the participants to report 2) cost overrun—PMS2 (r = −0.315; p < 0.001);
on the following three common success items. 3) customer satisfaction—PIS (r = 0.660; p < 0.001);
1) Schedule overrun, measured as time overrun at the end of 4) customer satisfaction—POS (r = 0.207; p = 0.012).
the project in comparison with the most recently approved These results support convergent and nomological validity for
schedule (in percentage). We expect the actual value of the the proposed scale.
schedule overrun will be negatively correlated with item Then, an EFA was conducted for item reduction. An initial
PMS1 (“the project was completed on time”). EFA suggested that item POS3 had a poor alignment with all
2) Cost overrun, measured as budget overrun at the end of other items. The reason might have been that participants did not
the project in comparison with the most recently approved fully comprehend the complex nature of the new term “worth”
budget (in percentage). We expect the actual value of the in the context of project success. Similar comments had been
cost overrun will be negatively correlated with item PMS2 received verbally from the participants during data collection.
(“the project was completed within budget”). Because of the confusion caused by this item, we removed it
3) Customer satisfaction, measured on a Likert-type scale from further analysis.
ranging from one (low) to ten (high) to capture the diver- Table V presents the EFA results (only loadings of 0.4 and
sity of clients’ satisfaction from project results. We expect above shown) for all remaining nine items included in the ques-
this measure will be positively correlated with both POS tionnaire. Results confirm the assumed dimensions of the items
and PIS, as both represent the perceived success of the among the three proposed dimensions. These three dimensions
project by the funder. explained 78% of the variance. Eight of the nine items fell into
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

8 IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT

TABLE V
EXPLORATORY FACTOR ANALYSIS (STEP 3)


Loadings less than 0.4 are not presented.

the same dimensions confirmed at the end of Step 2 (with cross wave of this survey, managers were asked to report on three
loadings for items PMS5 and POS1). Item PMS4 fell into the project management constructs (discussed below) in the most
POS dimension, probably due to the confusing term used “unde- recent project they supervised. Two months later, participants
sirable benefits.” Table V also shows that alpha Cronbach, CR, reported on project success for the same projects if already com-
and AVE levels were found to be satisfactory in most cases. pleted. Two hundred respondents working in project related jobs
5) Discussion: Results confirmed the three success dimen- in various organizations and industries filled in both question-
sions with acceptable factor loadings, though changes were re- naires. 83% of the respondents work in private companies, 11%
quired to some items: in government, and 6% in other organizations. The average par-
1) PMS5 was removed due to a high cross loading with PIS, ticipant had 14.1 years of work experience, including 8.1 years
2) POS2 was removed due to the confusing term “undesirable in projects. The average organization size was 1538 employees.
benefits,” 53% of respondents were male.
3) POS3 was removed earlier due to poor alignment with all 2) Measures: In the first wave, participants rated the fol-
other items and the confusing term “worth,” lowing project management constructs, which are expected to
4) following the omission of two of the three POS items and be related to project success [10]. All items were rated on a
to ensure this dimension maintained multiple items, a new seven-point Likert scale.
item was added: “the project business case was realized” Senior Executive Support (SES): The extent to which top man-
[61], agement allocates sufficient resources and provides assistance to
5) PMS4 was rephrased to include the more understandable the implementation of a project. It was measured using a tailored
term “undesirable impact,” eight-item scale [26]. An example item was “The senior exec-
6) following comments from participants that PIS1 was too utive strongly considered the goals and values of the project.”
broad, it was replaced with two more specific items that The scale’s alpha coefficient was 0.94.
rely on relevant theories: “The investment in this project Senior Executive Leadership (SEL): It measures the lead-
generated satisfactory results (even if the business case ers’ ability to present and communicate an organization’s trans-
was not realized),” based on Simon’s [53] satisficing the- formational vision to the project team using a five-item scale
ory, and “I would have invested in this project had I known [58]. An example item was “The manager clearly articulated
everything that has happened since,” based on the concept his/her vision of the future.” The scale’s alpha coefficient
of regret [4]. The revised scale was then tested in Step 4. was 0.92.
Effective Target Benefits (ETB): It measures senior managers’
ability to define effective strategic project goals that are set in a
D. Step 4—Scale Validation
manner that will allow their successful measurement, manage-
The objective of this study was to validate the revised scale ment, and realization using a fifteen-item scale [60]. An example
by conducting a CFA, and testing reliability based on a large item was “Project goals were assigned a specific target value.”
survey conducted in the United States. To capture the long-term The scale’s alpha coefficient was 0.96.
effect of POS and PIS, and to deal with potential same source In the second wave, participants rated project success using
bias issues, this step involved longitudinal data collection. We the three dimensions derived from Step 3: PMS (four items),
also repeated the convergent validity analysis, though this time POS (two items), and PIS (three items).
using different constructs than the ones used in Step 3. 3) Data analysis: Our CFA compared the following three
1) Participants and Procedure: We first conducted a pilot models for the structure of the success scale:
study with 18 senior managers in Australia, followed by col- 1) a one-factor model, comprised of all nine items;
lecting data in the United States through a two-wave survey, 2) a two-factor model, with PIS and POS combined into one
designed to minimize common method bias [22]. In the first factor;
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZWIKAEL AND MEREDITH: EVALUATING THE SUCCESS OF A PROJECT AND THE PERFORMANCE OF ITS LEADERS 9

TABLE VI project types in the sample were services (39.8%) and construc-
PROJECT EVALUATION MODEL
tion (32.7%). The average project lasted 25.1 months, involved
a team of 36.8 members, and cost US$14.7M.
2) Results: We first repeated the CFA analysis conducted in
Step 4. The analysis confirms a good fit of the data (CFI = 0.88,
GFI = 0.97, RMSEA = 0.06). However, because these are non-
inferential tests [22], we also repeated the convergent validity
tests conducted in Step 3. Results show again statistically sig-
nificant correlations between the new and old success measures:
1) schedule overrun—PMS1 (r = −0.142; p = 0.023);
2) cost overrun—PMS2 (r = −0.073; p = 0.244);
3) customer satisfaction—PIS (r = 0.308; p < 0.001);
4) customer satisfaction—POS (r = 0.249; p < 0.001).
These results are similar to those obtained in previous steps
and support the final dimensions and items of the project success
evaluation model presented in Table VI.
Next, we calculated the correlations among the three success
dimensions. All correlations among the pairs were found to be
positive but low (PMS–POS: 0.11; PMS–PIS: 0.11; POS–PIS:
3) a three-factor model, which maintains the three success
0.20). These results suggest that PMS, POS, and PIS are related
dimensions: PMS, POS, and PIS.
but distinct constructs and as discussed earlier, a project can
We compared the models using the comparative fit index
succeed in one but fail in another.
(CFI), goodness of fit index (GFI), and root mean square error
Last, following the validation of the evaluation model, its three
of approximation (RMSEA) with threshold acceptance levels of
dimensions, and the nine items, we used the data of the 267
0.9, 0.9, and 0.08 accordingly [8]. Because these values are only
projects to test our hypothesis. We conducted a paired-sample
“rules of thumbs” [22], we also conducted inferential conver-
mean comparison t-test. Results in Table VII show that both
gent validity tests by calculating the correlations between the
POS and PIS scores are significantly higher than PMS. Further-
proposed success scale dimensions (PMS, POS, and PIS) and
more, PIS scores are significantly higher than POS (t = –2.198;
the related constructs ETB, SEL, and SES.
p = 0.04), and hence support our hypothesis.
4) Results: The CFA suggests that all three models resulted
in the same good fit of the data (CFI = 0.97, GFI = 0.94, RMSEA
= 0.09), yet the three-factor model also suggested high reliabil- VI. STUDY 2—THE DIFFERENCES BETWEEN POS AND PIS
ity levels: PMS (α = 0.84; CR = 0.87; AVE = 0.62), POS A. Methodology
(α = 0.81; CR = 0.81; AVE = 0.68), and PIS (α = 0.89;
CR = 0.90; AVE = 0.74). Significant and positive correlations In order to test our hypothesis from a different perspective
were found among all nine combinations of the three project using another research methodology, and to illustrate the differ-
management constructs and three project success dimensions: ence between the two new project evaluation dimensions (POS
ETB (α = 0.96; CR = 0.97; AVE = 0.66); SEL (α = 0.92; and PIS), we analyzed 20 major road and rail projects reported
CR = 0.92; AVE = 0.69), and SES (α = 0.94; CR = 0.95; in the literature using the well-quantified financial measure of
AVE = 0.68). Correlation values ranged from 0.22 to 0.67 with NPV. An ex ante NPV analysis (as set in the project business
significance levels all below p-value of 0.01. These moderate case) is common for project appraisal, whereas an ex post NPV
values suggest the constructs are related but not overlapped. analysis (which uses actual values measured years after project
completion) is expensive and hence has limited value in practice.
Therefore, an ex post NPV analysis is conduced rarely and only
E. Step 5—Replication for a limited number of major public projects where the mon-
etary benefits can be inferred from public usage, such as with
The objective of this step was to replicate the results of previ- roads, tunnels, bridges, and railways. We compared ex ante with
ous steps and confirm their robustness in a different international ex post NPV data from two sources—ten road and rail projects
and multicultural sample. executed in Europe [25], and ten road projects from Australia
1) Participants and Procedure: Similar to previous steps, [2]. All monetary values were discounted in the original analyses
managers were asked to rate the success of their last project and converted to $US for the purpose of this paper.
completed using the nine-items presented in Table VI. Data were
collected using an additional survey of 267 senior managers in
a convenience sample in a diverse set of countries and cultures, B. Results
which included India (N = 204), Singapore (N = 41), and Cook Fig. 1 presents the NPV values of these 20 projects (each
Islands (N = 22). The primary organizations included in the is represented as a dot in the figure), based on their ex ante
sample were the traditional project management industries of and ex post evaluations. The diagonal line in the figure splits
software (56.4%) and construction (36.1%). The most common the projects between those above the line achieving higher ex
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

10 IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT

TABLE VII
MEAN COMPARISON AMONG PROJECT SUCCESS DIMENSIONS

∗p < 0.05.
∗∗p < 0.01.
∗∗∗p < 0.001.

Fig. 1. Ex ante versus ex post project NPV analysis.

post NPV than their ex ante targets from their business case horizontal x-axis (PIS). Thus, our hypothesis gains additional
and those below the line that were unable to achieve their ex support. Furthermore, these results also support the extension
ante targets. When measured against their original goals, this of the satisficing theory to the project evaluation context, as
analysis confirms the findings in the literature that most projects Fig. 1 shows that most projects still provide positive (and in
fail to achieve the goals set in their business cases, i.e., project many cases satisficing) results for their funders, even if they fail
ownership failure. For example, this particular small sample of to achieve their official goals.
highly complex mega-projects shows that 85% of the projects
do not achieve their goals, compared with 61% in Information
Technology projects [18]. VII. DISCUSSION
Whereas the diagonal line in Fig. 1 allows the evaluation of
POS, we can now also consider the horizontal x-axis line in the A. Theoretical Contributions
figure, which provides an additional and missing perspective This paper developed, validated, and illustrated a project suc-
about PIS. The x-axis splits projects between those achieving cess evaluation model consisting of three dimensions (PMS,
positive ex post NPV (investment success, i.e., benefits exceed POS, and PIS) and their related items. To develop the evalu-
costs) and those generating negative ex post NPV (investment ation model, we relied on existing scales where appropriate. For
failure, i.e., costs exceed benefits). Although the illustration of example, PMS is heavily based on the project manager achiev-
the horizontal line in this analysis lies on the x-axis itself, or- ing the goals set in the project plan document (for e.g., cost
ganizations should consider alternative positive NPV thresholds and schedule), and POS is based on the project owner realizing
for their investments before a project can be considered an in- the goals set in the business case (for e.g., benefits). However,
vestment success. Results show that most projects, although not the proposed project evaluation model also addresses the weak-
achieving their ex ante targets (POS), are still located above the nesses with existing models discussed earlier and is supported
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZWIKAEL AND MEREDITH: EVALUATING THE SUCCESS OF A PROJECT AND THE PERFORMANCE OF ITS LEADERS 11

by the satisficing theory [53] for managerial decision making, and POS and PIS to evaluate the value of projects (for e.g.,
and hence contributes to the literature, as is discussed next. research on the effectiveness of project selection, and strategy
First, the proposed model is generic (rather than project-type implementation).
dependent) and thus allows implementation in any project type,
for example by accommodating the unique goals expected from
each project into the target benefits and business case. Second, B. Practical Contributions
it has distinct dimensions and hence allows various stakeholders In addition to the theoretical contribution, this paper also of-
to focus on different goals for the same project. For example, a fers practical contributions by enhancing our knowledge about
marketing manager may propose the target benefit of “increased the conceptual meaning and measurement of project success.
sales” for a new R&D project, the finance manager may require First, results from longitudinal empirical studies confirm that
that the company’s cash flow does not decrease by more than the question about whether the investment in a project was wor-
5%, and the R&D manager may set a softer target benefit such thy (PIS) is distinct from the question of whether the project
as “increased organizational knowledge,” whereas the project leaders were successful in realizing its business case (POS) and
manager will be measured on completing the project on time. the project plan (PMS). Furthermore, we conclude that projects
Third, the proposed model separates the evaluation of project can be successful investments for their organizations (PIS) even
success (i.e., PIS) from the performance of its two key project when their leaders fail to achieve their business case goals (and
leaders—the project manager, who is accountable to deliver the vice versa). For example, a company that sets a 70% ROI target
project plan, and the project owner, to deliver the business case for a project may still be satisfied with a 50% ROI result, despite
(PMS and POS, respectively). For this purpose, the new PIS di- the project failing to achieve the goals specified in the business
mension evaluates a successful investment rather than success- case (POS failure, but PIS success), especially when goals are
ful managerial performance. PIS is a unique dimension, as it set unrealistically or too optimistically.
does not rely on any existing project baseline document. Rather Second, by adding a dimension measuring the performance
than evaluating whether specific goals have been achieved by a of the project owner (POS) to the traditional one measuring the
particular project leader, this dimension captures the long-term performance of the project manager (PMS), we offer clarity to
impact of a project on its funder, regardless of its stated goals. the role of the project manager. Shenhar et al. ([52], p. 699)
PIS is the first success measure that reflects the narrow interests state “project managers are the new strategic leaders, who must
of the most important entity of any project—the funder, as they take on total responsibility for project business results.” How-
are the only entity that can approve a project as well as extend a ever, this paper supports the most recent literature that argues
successful project with a follow-on project. that although the leadership role of project managers in real-
As a new theoretical dimension, we developed the PIS di- izing the strategic goals of projects is valuable, the account-
mension based on the satisficing theory [53], which argues that ability for business results should lie with the project funding
managers aim at satisficing their objectives, rather than maxi- entity (a.k.a. client) in general, and the project owner in par-
mizing or optimizing them. Accordingly, the project funder may ticular (for e.g., [6], [35], and [45]). As a result, we conclude
consider a project successful if the results were satisfactory, even that project managers should not be held accountable for over-
if it did not achieve all formal objectives. We also relied on the all project performance metrics that are beyond their control,
concept of regret [4], which postulates that in addition to what nor should their responsibilities be enlarged beyond their nor-
they get, people also care about what might have been obtained mal levels of competence and familiarity. That is, they should
had they chosen differently. Accordingly, we claim that for a be accountable for delivering the project outputs according to
funder, a successful investment in a project is one they would the project plan, which will in turn support the project owner
have invested in again had they known everything that has hap- achieving the project’s long-term goals as specified in the busi-
pened since. In summary, PIS is a holistic evaluation of project ness case.
success by the senior executive who approved the project, for Third, each success dimension is distinct and used for dif-
e.g., the CEO. It indicates that investment success is achieved ferent purposes and at particular times. For example, PMS can
when a project generates satisfactory results for the project’s be evaluated immediately (or soon) after project completion,
funder. whereas POS evaluation can only occur after the benefits have
We therefore contribute to the performance and project man- been “secured,” i.e., when they have either been fully achieved,
agement literatures by integrating the satisficing theory into the surely failed, or when we expect no major changes in their values
project evaluation context. We further contribute to the literature [63]. Furthermore, managers may want to reassess the relative
by clarifying 1) the difference between evaluating the results of a weighting of each success dimension’s individual items in each
managerial initiative and the performance of the managers who project. For example, within the PMS dimension, meeting sched-
executed the initiative, and 2) whether an initiative was a suc- ule goals may be more important than cost goals in one project
cess or failure relative to its stated goals as opposed to whether but vice versa in another. Similarly, each project will have a
it was an absolute worthwhile investment for the organization. unique set of target benefits, such as those mentioned earlier:
Accordingly, scholars can now use the most appropriate scale to team growth and learning, preparing for the future, improved
measure project success to address their focus, i.e., using PMS safety, customer satisfaction, reduced conflicts, developing new
to evaluate the project management process (for e.g., research skills, and so on. Setting the weightings of items within a success
on project team management, leadership, planning, and control) dimension could be a useful strategic exercise at the start of the
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

12 IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT

project, as well as for future evaluation and benchmarking, both in Europe and Australia (Study 2). We conclude that the separa-
immediately after the project has been completed as well as at tion between the performance of project leaders achieving their
specific points in the more remote future. Such a benchmarking goals and the performance of the project itself to generate orga-
exercise would not only provide an excellent forum for executive nizational value is an important distinction for the evaluation of
discussions concerning what project goals are most important to projects.
the organization, but also provide guidance for project managers, A research limitation of this study may relate to data collec-
steering committees, and proposers of future projects. tion in limited contexts. Future research should test the proposed
Using a mixed-method analysis, we confirmed that projects evaluation model in different nations and cultures, various kinds
that fail to achieve their goals are not necessarily unworthy in- of organizations, different types of projects, multiple points in
vestments for their funder. Although retrospectively, the orga- time, different economic cycles (booms, busts), and for mul-
nization could have invested in other projects instead, it is not tiple types of stakeholders. Next, whereas in our studies we
clear if they would have gained their promised returns either. allowed a lag of two months to evaluate project success, we
Therefore, failures to achieve project goals (set in the project accept that this duration might be insufficient in other cases.
plan and business case) primarily tell us about the performance Future research can study how long after its completion project
of the project manager and project owner (respectively). Yet, the success should be evaluated and how the quality of the origi-
actual organizational performance following project completion nal funding decision impacts project success (for e.g., can an
may still be enhanced (PIS), even if the goals were not realized incorrectly selected project become a success?). Last, future re-
(POS and PMS). search could also focus on the value and applicability of the
evaluation model in practice, investigating the receptiveness of
executives and project stakeholders to the dimensions and items
VIII. CONCLUSION in the scales. In particular, the employment of a rigorous and
Existing evaluation models for project success suffer from agreed-upon framework to evaluate project success in practice
theoretical and methodological limitations, such as their lack of can substantially improve our record of success for the complex
separation of project success measurement from that of project projects we are struggling with today, as well as better support
individuals’ performance and their inability to apply to all high quality research.
project types. Moreover, there is no agreement in either research
or practice on how project success should be evaluated, which
results in scholars employing dissimilar scales to measure the REFERENCES
same research phenomenon and practitioners developing ad-hoc [1] J. C. Anderson and D. W. Gerbing, “Predicting the performance of mea-
solutions for this problem. sures in a confirmatory factor analysis with a pretest assessment of their
substantive validities,” J. Appl. Psychol., vol. 76, no. 5, pp. 732–740, 1991.
Based on the satisficing theory [53], this paper developed, [2] Ex post economic evaluation of national road investment projects, vol. 1,
validated, and illustrated generic scales to measure the success Australian Government—Department of Infrastructure, Regional Devel-
of any project, as well as the performance of its two key leaders, opment and Cities, Canberra, ACT, Australia, Rep. 145, 2018.
[3] D. Basten, D. Joosten, and W. Mellis, “Managers’ perceptions of informa-
through the following three distinct success dimensions: tion system project success,” J. Comput. Inf. Syst., vol. 52, no. 2, pp. 12–21,
1) PMS—to evaluate the performance of the project manager 2011.
in achieving the project plan, [4] D. E. Bell, “Regret in decision making under uncertainty,” Oper. Res., vol.
30, pp. 961–981, 1982.
2) POS—to evaluate the performance of the project owner in [5] H. Bleichrodt, A. Cillo, and E. Diecidue, “A quantitative measurement of
realizing the business case, and regret theory,” Manage. Sci., vol. 56, no. 1, pp. 161–175, 2010.
3) PIS—to evaluate the performance of the project as an in- [6] R. Breese, S. Jenner, C. E. M. Serra, and J. Thorp, “Benefits manage-
ment: Lost or found in translation,” Int. J. Project Manage., vol. 33, no. 7,
vestment for its funder. pp. 1438–1451, 2015.
Not only the purpose and subject of each success dimension [7] D. B. Brown and M. Sim, “Satisficing measures for analysis of risky po-
are different, but also the time of their evaluation also varies. sitions,” Manage. Sci., vol. 55, no. 1, pp. 71–84, 2009.
[8] M. W. Browne and R. Cudeck, “Alternative ways of assessing model fit,”
For example, PMS can be evaluated soon after outputs have in Testing Structural Equation Models, K. A. Bollen, J.S. Long, Eds. New-
been delivered, whereas POS evaluation can only occur after the bury Park, CA, USA: Sage, 1993.
benefits have been secured [63]. The distinct dimensions of the [9] D. J. Bryde and D. Brown, “The influence of a project performance mea-
surement system on the success of a contract for maintaining motorways
proposed project evaluation model clearly distinguish between and trunk roads,” Project Manage. J., vol. 35, no. 4, pp. 57–65, 2005.
the short- and long-term results, as well as between the success [10] Y. Chih and O. Zwikael, “Project benefit management: A conceptual
of a project and the performance of its leaders (project manager framework of target benefit formulation,” Int. J. Project Manage., vol.
33, no. 1, pp. 352–362, 2015.
and project owner). Finally, the model is generic and hence can [11] G. A. Churchill, “A paradigm for developing better measures of marketing
be used for any project type. scales,” J. Mark. Res., vol. 16, pp. 64–73, 1979.
This paper offers a theoretical contribution to the performance [12] T. Cooke-Davies, “The ‘real’ success factors on projects,” Int. J. Project
Manage., vol. 20, no. 3, pp. 185–190, 2002.
and project management literatures by arguing that projects, al- [13] F. Costantino, G. Di Gravio, and F. Nonino, “Project selection in project
though frequently not achieving their goals, can still deliver pos- portfolio management: An artificial neural network model based on critical
itive net value for their funders. Following four steps to develop success factors,” Int. J. Project Manage., vol. 33, no. 8, pp. 1744–1754,
2015
the model, we tested this claim and received support in two lon- [14] P. Crosetto and T. Regner, “It’s never too late: Funding dynamics and
gitudinal studies: 1) a survey of 267 projects in the U.S. (Study self pledges in reward-based crowdfunding,” Res. Policy, vol. 47, no. 8,
1—step 5), and 2) an ex ante versus ex post analysis of 20 projects pp. 1463–1477, 2018.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.

ZWIKAEL AND MEREDITH: EVALUATING THE SUCCESS OF A PROJECT AND THE PERFORMANCE OF ITS LEADERS 13

[15] A. Davies, S. Manning, and J. Soderlund, “When neighboring dis- [39] J. K. Pinto and S. J. Mantel, “The causes of project failure,” IEEE Trans.
ciplines fail to learn from each other: The case of innovation and Eng. Manage., vol. 37, no. 4, pp. 269–276, Nov. 1990.
project management research,” Res. Policy, vol. 47, no. 5, pp. 965–979, [40] J. K. Pinto and J. E. Prescott, “Planning and tactical factors in the project
2018. implementation process,” J. Manage. Stud., vol. 27, no. 3, pp. 305–327,
[16] W. DeLone and E. McLean, “The DeLone and McLean model of infor- 1990.
mation systems success: A ten-year update,” J. Manage. Inf. Syst., vol. 19, [41] A. Rezvani, P. Khosravi, and N. M. Ashkanasy, “Examining the interde-
no. 4, pp. 9–30, 2003. pendencies among emotional intelligence, trust, and performance in in-
[17] A. J. Dunar and S. P. Waring, “The Hubble space telescope,” in Power to frastructure projects: A multilevel study,” Int. J. Project Manage., vol. 36,
Explore—History of Marshall Space Flight Center 1960–1990. Washing- no. 8, pp. 1034–1046, 2018.
ton, DC, USA: US Government Printing Office, ch. 12, 1999. [42] M. Rusare and C. I. Jay, “The project implementation profile: A tool for
[18] M. Feris, O. Zwikael, and S. Gregor, “QPLAN: Decision support for eval- enhancing management of NGO projects,” Progress Develop. Stud., vol.
uating planning quality in software development projects,” Decis. Support 15, no. 3, pp. 240–252, 2015.
Syst., vol. 96, pp. 92–102, 2017. [43] K. Samset and G. H. Volden, “Front-end definition of projects: ten para-
[19] P. Finch, “Applying the Slevin-Pinto project implementation profile to an doxes and some reflections regarding project management and project
information systems project,” Project Manage. J., vol. 34, no. 3, pp. 32–39, governance,” Int. J. Project Manage., vol. 34, no. 2, pp. 297–313, 2016.
2003. [44] C. Scott-Young and D. Samson, “Project success and project team man-
[20] N. Gil and J. K. Pinto, “Polycentric organizing and performance: A con- agement: Evidence from capital projects in the process industries,” J. Oper.
tingency model and evidence from megaproject planning in the UK,” Res. Manage., vol. 26, pp. 749–766, 2008.
Policy, vol. 47, pp. 717–734, 2018. [45] C. E. M. Serra and M. Kunc, “Benefits realisation management and its
[21] J. Goh and N. G. Hall, “Total cost control in project management via influence on project success and on the execution of business strategies,”
satisficing,” Manage. Sci., vol. 59, no. 6, pp. 1354–1372, 2013. Int. J. Project Manage., vol. 33, no. 1, pp. 53–66, 2015.
[22] V. D. R. Guide and M. Ketokivi, “Editorial: Notes from the Editors: Re- [46] C. E. M. Serra, “Benefits realization management and strategic project
defining some methodological criteria for the journal,” J. Oper. Manage., success analysis of UK, USA, and Brazil,” paper presented at PMI Global
vol. 37, pp. v–viii, 2015. Congr. 2015—EMEA, London, U.K., 2015.
[23] D. Kahneman, Thinking, Fast and Slow, 1st ed. New York, NY, USA: [47] A. J. Shenhar, O. Levy, and D. Dvir, “Mapping the dimensions of project
Farrar, Straus and Giroux, 2011. success,” Project Manage. J., vol. 28, no. 2, pp. 5–13, 1997.
[24] L. Kauppinen, A. S. Siddiqui, and A. Salo, “Investing in time-to-build [48] A. J. Shenhar and D. Dvir, “Reinventing Project Management: The Di-
projects with uncertain revenues and: A real options approach,” IEEE amond Approach to Successful Growth and Innovation. Brighton, MA,
Trans. Eng. Manage., vol. 65, no. 3, pp. 448–459, Aug. 2018. USA: Harvard Bus. School Press, 2007.
[25] C. Kelly, J. Laird, S. Costantini, P. Richards, J. Carbajo, and J. Nellthorp, [49] A. J. Shenhar, V. Holzmann, B. Melamed, and Y. Zhao, “The challenge of
“Ex post appraisal: What lessons can be learnt from EU cohesion funded innovation in highly complex projects: What can we learn from Boeing’s
transport projects?,” Transport Policy, vol. 37, pp. 83–91, 2015. Dreamliner experience?,” Project Manage. J., vol. 47, no. 2, pp. 62–78,
[26] B. Kuvaas and A. Dysvik, “Exploring alternative relationships between 2016.
perceived investment in employee development, perceived supervisor sup- [50] A. J. Shenhar, A. Tishler, D. Dvir, S. Lipovetsky, and T. Lechler, “Re-
port and employee outcomes,” Human Resour. Manage. J., vol. 20, no. 2, fining the search for project success factors: A multivariate, typological
pp. 138–156, 2010. approach,” R & D Manage., vol. 32, no. 2, pp. 111–126, 2002.
[27] Y. H. Kwak, J. Park, B. Y. Chung, and S. Ghosh, “Understanding end-users’ [51] A. Shenhar and V. Holzmann, “The three secrets of megaproject success:
acceptance of enterprise resource planning (ERP) system in project-based Clear strategic vision, total alignment, and adapting to complexity,” Project
sectors,” IEEE Trans. Eng. Manage., vol. 59, no. 2, pp. 266–277, May Manage. J., vol. 48, no. 6, pp. 29–46, 2017.
2012. [52] A. J. Shenhar, D. Dvir, O. Levy, and A. C. Maltz, “Project success: A mul-
[28] P. E. D. Love, D. J. Edwards, and Z. Irani, “Moving beyond optimism bias tidimensional strategic concept,” Long Range Planning, vol. 34, pp. 699–
and strategic misrepresentation: An explanation for social infrastructure 725, 2001.
project cost overruns,” IEEE Trans. Eng. Manage., vol. 59, no. 4, pp. 560– [53] H. A. Simon, “Theories of decision-making in economics and behavioral
571, Nov. 2012. science,” Amer. Econ. Rev., vol. 49, no. 3, pp. 253–283, 1959.
[29] M. Martinsuo, O. J. Klakegg, and A. H. van Marrewijk, “Introduction: [54] S. Toor and S. Ogunlana, “Beyond the ‘iron triangle’: Stakeholder per-
delivering value in projects and project-based business business,” Int. J. ception of key performance indicators (KPIs) for large-scale public sector
Project Manage., vol. 37, no. 5, pp. 631–635. development projects,” Int. J. Project Manage., vol. 28, no. 3, pp. 228–236,
[30] A. Mazur, A. Pisarski, A. Chang, and N. M. Ashkanasy, “Rating de- 2010.
fence major project success: The role of personal attributes and stake- [55] F. Ullah, M. J. Thaheem, S. Q. Siddiqui, and M. B. Khurshid, “Influence
holder relationships,” Int. J. Project Manage., vol. 32, no. 6, pp. 944–957, of six sigma on project success in construction industry of Pakistan,” TQM
2014. J., vol. 29, no. 2, pp. 276–309, 2017.
[31] M. B. Miles and M. A. Huberman, “Qualitative Data Analysis: An Ex- [56] P. Weaver, “A brief history of project management,” APM Project, vol. 19,
panded Sourcebook, 2nd ed. Newbury Park, CA, USA: Sage Publ., 1994. no. 11, pp. 1–4, 2006.
[32] C. C. Miller, N. T. Washburn, and W. H. Glick, “The myth of firm perfor- [57] World Bank, (2019). Accessed: May 7, 2019. [Online]. Available:
mance,” Org. Sci., vol. 24, no. 3, pp. 948–964, 2013. https://data.worldbank.org/country/papua-new-guinea
[33] B. Moritz, E. Siemsen, and M. Kremer, “Judgmental forecasting: Cogni- [58] B. E. Wright and S. K. Pandey, “Transformational leadership in the public
tive reflection and decision speed,” Prod. Oper. Manage., vol. 23, no. 7, sector: Does structure matter?,” J. Public Admin. Res. Theory, vol. 20,
pp. 1146–1160, 2014. no. 1, pp. 75–90, 2010.
[34] R. Müller and M. Martinsuo, “The impact of relational norms on informa- [59] W. G. Zikmund, B. J. Babin, J. C. Carr, and M. Griffin, Business Research
tion technology project success and its moderation through project gover- Methods, 8th ed. Independence, KY, USA: South-Western Cengage Learn-
nance,” Int. J. Manag. Projects Bus., vol. 8, no. 1, pp. 154–176, 2015. ing, 2010.
[35] A. Musawir, C. E. M. Serra, O. Zwikael, and I. Ali, “Project governance, [60] O. Zwikael, Y. Chih, and J. Meredith, “Project benefit management: Setting
benefit management, and project success: Towards a framework for sup- effective target benefits,” Int. J. Project Manage., vol. 36, pp. 650–658,
porting organizational strategy implementation,” Int. J. Project Manage., 2018.
vol. 35, no. 8, pp. 1658–1672, 2017. [61] O. Zwikael and J. Meredith, “Who’s who in the project zoo? The ten core
[36] S. Petter, W. D. DeLone, and E. R. McLean, “Information systems success: project roles,” Int. J. Oper. Prod. Manage., vol. 38, no. 2, pp. 474–492,
The quest for the independent variables,” J. Manage. Inf. Syst., vol. 29, 2018.
no. 4, pp. 7–62, 2013. [62] O. Zwikael and J. Smyrk, “A general framework for gauging the perfor-
[37] J. K. Pinto and D. P. Slevin, “Critical factors in successful project im- mance of initiatives to enhance organizational value,” Brit. J. Manage.,
plementation,” IEEE Trans. Eng. Manage., vol. EM-34, no. 1, pp. 22–27, vol. 23, pp. S6–S22, 2012.
Feb. 1987. [63] O. Zwikael and J. R. Smyrk, Project Management: A Benefit Realisation
[38] J. K. Pinto and D. P. Slevin, “Critical Success Factors Across the Project Approach. London, U.K.: Springer-Verlag, 2019.
Life Cycle. Drexel Hill, PA,USA: Project Manage. Inst., 1988.

You might also like