The Relationship Between Project Success

You might also like

You are on page 1of 10

PAPERS The Relationship Between Project

Success and Project Efficiency


Pedro Serrador, Serrador Project Management, Toronto, Canada
Rodney Turner, SKEMA Business School, Lille, France

ABSTRACT ■ INTRODUCTION ■

P
Many researchers have suggested that meet- roject success criteria have been measured in a variety of ways.
ing time, scope, and budget goals, some- Although the conventional measurement of project success has
times called ‘project efficiency,’ is not the focused on tangibles, the current thinking is that, ultimately, project
comprehensive measure of project success. success is best judged by the stakeholders, especially the primary
Broader measures of success have been sponsor (Turner & Zolin, 2012). As Shenhar, Levy, and Dvir (1997) and Turner
recommended; however, to date, nobody and Zolin (2012) note, assessing success is time-dependent: “As time goes
has determined empirically the relationship by, it matters less whether the project has met its resource constraints; in
between efficiency and overall success or most cases, after about one year it is completely irrelevant. In contrast, after
indeed shown whether efficiency is impor- project completion, the second dimension, impact on the customer and
tant at all to overall project success. Our customer satisfaction, becomes more relevant.” (Shenhar et al., 1997, p. 12)
aim in this article is to correct that omission. Building on that work, Shenhar and Dvir (2007) suggested a model of success
Through a survey of 1,386 projects we have based on five dimensions (Table 1). In a similar vein, Cooke-Davies (2002)
shown that project efficiency correlates mod- differentiated between project success and project management success.
erately strongly to overall project success Project management success is the traditional measure of project success,
(correlation of 0.6 and R2 of 0.36). Efficiency measured at project completion, and is primarily based on whether the
is shown through analysis to be neither the output is delivered to time, cost, and functionality (Atkinson, 1999). Following
only aspect of project success nor an aspect Shenhar and Dvir (2007), we call this ‘project efficiency.’ Project success is
of project success that can be ignored. based on whether the project outcome meets the strategic objectives of the
investing organization. In this article we focus on overall project success,
KEYWORDS: project; success; efficiency; which is measured by how satisfied key stakeholders are about how well the
project success; project and industries project achieves its strategic objectives.
Munns and Bjeirmi (1996) noted that much of the project management
literature considers “projects end when they are delivered to the customer”
(p. 83). They continued: “That is the point at which project management ends.
They do not consider the wider criteria, which will affect the project once
in use” (p. 83, our italics); this focus on the end date of the project is under-
standable from a project and project manager’s standpoint. The definitions
of a project imply an end date; at that time the project manager is likely to be
released or move on to another project. Also, the reward structure in many
organizations encourages the project manager to finish the project on cost
and time and little else (Turner, 2014). Gareis (2005) and Gareis, Huemann,
and Martinuzzi (2013) are very specific that project closing occurs with the
delivery of the new asset (the project output) to the client, and that the proj-
ect process is only part of the overall investment process. Thus the success
of the project itself is measured by project efficiency, but the success of the
investment is measured by the wider measures, as suggested by Turner and
Zolin (2012).
The literature has also examined the wider impact of projects on the
Project Management Journal, Vol. 46, No. 1, 30–39 business. Customer satisfaction has long been a part of the project manage-
© 2015 by the Project Management Institute ment literature (Kerzner, 1979, 2009) but it has not usually been included in
Published online in Wiley Online Library the formal measures of success. Shenhar et al. (1997) note that of the three
(wileyonlinelibrary.com). DOI: 10.1002/pmj.21468 traditional dimensions of project efficiency—time, budget, and scope—scope

30 February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj


of success: technical performance and
Success Dimension Measures
customer satisfaction with an R2 of 0.37
Project efficiency Meeting schedule goal
(p < 0.001). This result showed a strong
Meeting budget goal
relationship between the two compo-
Team satisfaction Team morale nents, though this was not generalized
Skill development to overall success.
Team member growth
The importance of broader success
Team member retention
measures for projects is now the norm.
Impact on the customer Meeting functional performance A Guide to the Project Management Body
Meeting technical specifications
of Knowledge (PMBOK ® Guide) – Fifth
Fulfilling customer’s needs
Edition, as an example, no longer just
Solving a customer’s problem
The customer is using the product mentions the triple constraint (Proj-
Customer satisfaction ect Management Institute, 2013) and
now includes project constraints such
Business success Commercial success
as scope, quality, schedule, budget,
Creating a large market share
resources, and risks. It also refers to
Preparing for the future Creating a new market
stakeholder satisfaction as well as other
Creating a new product line
constraints that are not mentioned but
Developing a new technology
may impact project success. Now that
Table 1: The five dimensions of project success after Shenhar and Dvir (2007).
the most recent edition of the PMBOK ®
Guide (Project Management Institute,
has the largest role, because it also has goals, end-user benefits, contractor 2013) recognizes stakeholder satisfac-
an impact on the customer and his or benefits, and overall project success) tion as an additional measure of project
her satisfaction. They note: “Similarly, are highly inter-correlated, implying success, it is timely to ask what the
project managers must be mindful to that projects perceived to be successful correlation is between that and project
the business aspects of their company. are successful for all their stakeholders” efficiency.
They can no longer avoid looking at (p. 94). Thomas, Jacques, Adams, and Thus we see there are two compet-
the big picture and just concentrate on Kihneman-Woote (2008) state that mea- ing measures of success on projects,
getting the job done. They must under- suring project success in not straight- what Cooke-Davies (2002) calls ‘project
stand the business environment and forward. “Examples abound where the management success’ and ‘project suc-
view their project as part of the compa- original objectives of the project are not cess.’ We adopt more current termi-
ny’s struggle for competitive advantage, met, but the client was highly satisfied. nology, which uses ‘project efficiency’
revenues, and profit” (p. 10). This view There are other examples where the instead of ‘project management suc-
was reiterated by Jugdev and Müller initial project objectives were met, but cess’ (Shenhar et al., 1997; Shenhar &
(2005), who reviewed the project suc- the client was quite unhappy with the Dvir, 2007) and define the two compet-
cess literature over the past 40 years and results” (p. 106). Collyer and Warren ing measures as:
found that a more holistic approach to (2009) cite the movie Titanic, which was
Project efficiency: meeting cost, time,
measuring success was becoming more touted as a late, over-budget flop but
and scope goals; and
evident. went on to be the first film to generate
Project success: meeting wider busi-
Researchers increasingly measure more than US$1 billion. Munns and
ness and enterprise goals as defined by
success by impact on the organiza- Bjeirmi (1996) also note that a project
key stakeholders
tion rather than just meeting the tri- can be a success despite poor project
ple constraint. Dvir, Raz, and Shenhar management performance. Apart from the work of Zwikael
(2003) state that “there are many cases Zwikael and Globerson (2006), using and Globerson (2006), few people have
where projects are executed as planned, data collected from 280 project man- investigated to what extent these two
on time, on budget and achieve the agers showed that aspects of success measures of success are correlated.
planned performance goals, but turn show a similar frequency distribution. Turner and Zolin (2012) suggest proj-
out to be complete failures because Figure 1 shows a highly similar distribu- ect efficiency is important to success,
they failed to produce actual benefits to tion between technical performance (a because if the project is completed late
the customer or adequate revenue and partial though not full measure of proj- and over budget it will be more difficult
profit for the performing organization.” ect efficiency) and stakeholder satisfac- for it to be a business success. Prabhakar
(p. 89). They also found that “all four tion. In addition, they reported a linear (2008) notes: “There is also a general
success-measures (meeting planning correlation between two components agreement that although schedule

February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj 31


The Relationship Between Project Success and Project Efficiency
PAPERS

Percentage of Questionnaires 50%


45%
40%
35%
30%
25%
20%
15%
10%
5%
0%
0 2 4 6 8 10
Levels of Performance
Customer Satisfaction Technical Performance

Figure 1: Frequency distribution of technical performance and customer satisfaction, after Zwikael and Globerson (2006).

and budget performance alone are where a completely objective solution Data collection ran for 12 weeks.
considered inadequate as measures of can be found and phenomenology, where A total of 865 people started the sur-
project success, they are still important all experience is subjective (Trochim, vey, with 859 completing at least the
components of the overall construct. 2006). Because perception and observa- first portion, which requested infor-
Quality is intertwined with issues of tion are based on subjective opinion, our mation on one more successful proj-
technical performance, specifications, results cannot be fully objective. Some ect. The sources of participants were
and achievement of functional objec- concepts such as project success are not PMI’s community of practice organiza-
tives and it is achievement against these fully quantifiable and are impacted by tions (638), LinkedIn groups focusing
criteria that will be most subject to vari- subjective judgment. Post-positivism on project management (197), the PMI
ation in perception by multiple project understands that although positivism Survey Links site (18), and personal
stakeholders” (p. 7). As we saw above, cannot tell the whole truth in business networks (12). Participants reported fill-
however, the components of project research, its insights are still useful. ing a variety of roles on projects: project
efficiency are neither necessary nor suf- manager (304), senior project manager
Survey
ficient conditions of success (Dvir et al., (141), program manager (72), project
2003; Thomas et al., 2008; Turner & To gather the data we conducted a sur- coordinator (66), project team mem-
Zolin, 2012; Xue, Turner, Lecoeuvre, & vey. The questions are shown in Table 2. ber (58), senior manager (36), senior
Anbari, 2013). Many projects are fin- We asked the respondents to judge suc- program/portfolio manager (22), and C
ished on time and cost but are abject cess in three categories: level management (14); 146 chose not to
failures, and many finish late and over • Overall project success rating; answer. Responses were received from
spent but are considered successful. • Project success as perceived by four 60 countries. The largest percentage
So what, if anything, is the relationship groups of stakeholders: the sponsor, of respondents were from the United
between project efficiency and project the project team, the client, and the States (36%), followed by Canada and
success? To date there is little empirical end users; and India. More than 10 responses were
work to investigate this relationship. An • Performance against the three compo- received from Australia, Spain, Brazil,
exploratory study is warranted and this nents of project efficiency: time, cost, Singapore, and Germany; 183 respon-
leads to our research question: and scope. dents chose not to answer the question.
To what extent is project efficiency Each participant was asked to provide
We also asked demographic ques-
correlated with overall project success? data on two projects, one more success-
tions about the nature of the project:
ful and another less successful. How-
Research Methodology • Which industry does it come from? ever, not all participants entered data for
We adopted a post-positivist approach. • In which country was it performed? two projects; therefore, the total num-
Post-positivism falls between positivism, • Was it a national or international project? ber of projects available for study was

32 February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj


Question Response Ranges Reference
Project success: meeting timeline goals 7-point scale: Dvir et al. (2003)
> 60% over time Zwikael and Globerson (2006)
How successful was the project in meeting project 45%–59% over time
time goals? 30%–44% over time
15%–29% over time
1%–14% over time
on time
ahead of schedule
Project success: meeting budget goals 7-point scale: Dvir et al. (2003)
> 60% over budget Zwikael and Globerson (2006)
How successful was the project in meeting project 45%–59% over budget
budget goals? 30%–44% over budget
15%–29% over budget
1%–14% over budget
on budget
under budget
Project success: meeting scope/ requirements goals 7-point scale: Dvir et al. (2003)
> 60% requirements missed
How successful was the project in meeting scope and 45%–59% requirements missed
requirements goals? 30%–44% requirements missed
15%–29% requirements missed
1%–14% requirements missed
requirements met
requirements exceeded
Project success rating: sponsor assessment 5-point scale: Müller and Turner (2007a); Shenhar and
failure Dvir (2007)
How did the project sponsors rate the success of the not fully successful
project? mixed
successful
very successful
Project success rating: project team assessment 5-point scale: Müller and Turner (2007a)
failure
How do you rate the project team’s satisfaction with not fully successful
the project? mixed
successful
very successful
Project success rating: client assessment 5-point scale: Müller and Turner (2007a)
failure
How do you rate the client’s satisfaction with the not fully successful
project’s results? mixed
successful
very successful
Project success rating–end user assessment 5-point scale: Müller and Turner (2007a)
failure
How do you rate the end users’ satisfaction with the not fully successful
project’s results? mixed
successful
very successful
Overall project success rating: 5-point scale: Shenhar and Dvir (2007a)
failure
How do you rate the overall success of the project? not fully successful
mixed
successful
very successful
Table 2: Questions in the survey.

February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj 33


The Relationship Between Project Success and Project Efficiency
PAPERS

1,539. After removal of outliers and bad time had passed to have a reasonable performance measures, as discussed by
data, the usable total was 1,386 projects. assessment of overall project success. Podsakoff, MacKenzie, Lee, and Pod-
Outlier removal included the removal With most studies of project suc- sakoff (2003) and Conway and Lance
of projects that were cancelled or not cess using questionnaires or interviews, (2010). By targeting project managers,
completed. The breakdown of projects the results rely on participants stating we intended to receive information
by success rating is shown in Table 3. how successful a project was, which from the individual who would have a
If we create a histogram (Figure 2), is subjective by nature. There may be chance to provide the best overall view
we can see that the methodology has ways to measure success in objective of the project.
resulted in an acceptable range of proj- ways, but this may only apply to proj- Questions also used varied scales,
ects. When the projects were consoli- ect efficiency; therefore, this article is as recommended by Podsakoff et al.
dated, we confirmed there was a range mainly concerned with perceived proj- (2003). In addition, factor analysis and
of projects available in a usable distri- ect success as reported by participants. Cronbach’s alpha analysis were com-
bution. Results were similar for the two To measure this factor, questions in the pleted where appropriate. To avoid
success measures. survey were based on a combination social desirability issues related to proj-
Although there are aspects of project of the success dimensions defined by ect success, respondents were asked to
success that are temporal (Shenhar & Müller and Turner (2007b) and Shenhar provide data for both a more success-
Dvir, 2007; Turner & Zolin, 2012), this and Dvir (2007). ful and less successful project. Finally,
research did not specifically measure the It is the nature of an anonymous, the use of PMI’s community of practice
impact of time on judgments of project open global survey that there may be groups, LinkedIn, and personal contacts
success. Data were selected for com- single respondent bias. Each project is ensured there were no convenience
pleted projects to ensure that enough described by one respondent and for the sample issues; hence, mono-source
sake of privacy the names of the projects bias was assumed not to be an issue
or organizations were not sought. It is for this research. Survey questions, in
Valid N
not possible to completely remove the general used a 5- or 7-point Likert-like
Failure 98 single respondent bias, but to minimize numerical scale (Cooper & Schindler,
Not Fully Successful 259 the impact, each respondent was asked 2008). Pure Likert scales were not used
Mixed 345 to provide information on one more suc- because there were several questions
Successful 451 cessful and one less successful project. where numerical responses were appro-
This was intended to ensure respon- priate. The varying scale was partially
Very Successful 233
dents did not just provide information due to following the scales from the
All Groups 1,386 on their most successful project. existing literature, using 7-point scales
Table 3: Project success rating for all Mono-source bias and other to allow optimum ordinal value for
projects. response biases can occur in self-rated numerical ranges and 5-point scales
for subjective ratings. Since a variety of
scales were used this ensured that item
context effects as per Podsakoff et al.
Histogram: Project Success Rating
500 (2003) were not an issue.
450 Expected Normal
Results and Analysis
400
Analysis
No. of observations

350
To facilitate further analysis, the suc-
300 cess measures were grouped into
250 three measures of success. These were
the measures of project success used
200
throughout the analysis:
150 Efficiency measure = mean of the
100 following three responses as a sum-
50
mated scale:

0 1. Project success: meeting timeline goals


0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0 2. Project success: meeting budget goals
3. Project success: meeting scope and
Figure 2: Histogram of project success rating compared with normal distribution.
requirements goals

34 February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj


As project success is best judged by be sufficient for research purposes (Nun- than 0.90. In practical terms, this meant
the stakeholders, especially the primary nally, 1978). Three items measured proj- there was a high degree of confidence
sponsor (Turner & Zolin, 2012), we will ect efficiency and four measured overall in the reliability of the data collected
use the following project success mea- project success. All measures showed a and it is accurate and meaningful for the
sure: high Cronbach alpha score, which shows purposes of this research. This indicates
Project Success measure = mean of that they are correlated (Table 5). that all of the factors are interrelated to
the following four responses as a sum- The results of the Cronbach’s some extent.
mated scale: alpha analysis supported the initial The results for the efficiency mea-
assumptions that the elements identi- sure (Table 6) were lower than those
1. Project success rating: sponsor assess- fied for measuring success (Dvir et al., for the success measure; however, they
ment 2003; Zwikael & Globerson, 2006; Müller are still adequate for research purposes
2. Project success rating: project team & Turner, 2007) were valid measures for (Nunnally, 1978). The factor would
assessment this survey and accurately measured the have been marginally improved by
3. Project success rating: client assess- judgments of respondents. Each vari- removing scope; however, as scope is
ment able achieved an alpha score greater defined as part of the triple constraint
4. Project success rating: end-user assess-
ment

In addition, we will compare these Factor 1 Factor 2


measures to the single overall project Project sponsors and stakeholders success rating 0.893* 0.267
success rating given by respondents. Project budget goals 0.162 0.877*
Although these measures were based Project time goals 0.288 0.845*
on the findings of previous researchers,
Scope and requirements goals 0.522 0.524
a confirmatory factor analysis was also
completed (Table 4). Project team’s satisfaction 0.836* 0.299
Factor 1 clearly corresponds to Client’s satisfaction 0.916* 0.256
project success; factor 2 corresponds End users’ satisfaction 0.897* 0.202
to project efficiency. This factor analy- Factor Loadings (Varimax normalized).
sis confirms our selection of measures, *Marked loadings are > 0.700000.
with the exception of the scope ques-
Table 4: Confirmatory factor analysis of success measures.
tion. This question could fit with either
the efficiency or success measure. This
is in keeping with Shenhar et al. (1997)
Mean if Var. if Std. Dv. if Itm-Totl Alpha if
who stated that scope was the most
deleted deleted deleted -Correl. deleted
important of the triple constraint for
overall success. Since the result for Sponsors success rating 10.112 9.651 3.107 0.886 0.921
scope is somewhat higher for factor 2 Project team’s satisfaction 10.151 10.490 3.239 0.818 0.942
(efficiency), we will continue to use it as Client’s satisfaction 10.081 9.671 3.110 0.915 0.912
part of the efficiency measure. End users’ satisfaction 10.126 10.227 3.198 0.849 0.933
Summary for scale: Mean = 13.495; Std. Dv. = 4.18; Valid N:1378.
Reliability Cronbach alpha: 0.945; Standardized alpha: 0.944; Average inter-item corr.: 0.815.
A Cronbach alpha analysis was per- Table 5: Cronbach alpha analysis of success measure.
formed on the success measures. The
Cronbach alpha coefficient is a number
that ranges from 0 to 1; a value of 1 Mean if Var. if Std. Dv. if Itm-Totl Alpha if
indicates that the measure has perfect deleted deleted deleted - Correl. deleted
reliability, whereas a value of 0 indicates Project time goals 9.214 8.484 2.913 0.605 0.686
that the measure is not reliable and vari- Project budget goals 9.667 7.477 2.734 0.690 0.584
ations are due to random error. Ideally
Scope and requirements goals 9.001 9.733 3.120 0.521 0.774
the alpha value should approach 1. In
Summary for scale: Mean = 13.941; Std. Dv. = 4.158; Valid N:1386.
general, an alpha value of 0.9 is required
Cronbach alpha: 0.769; Standardized alpha: 0.767; Average inter-item corr.: 0.529.
for practical decision-making situations,
whereas a value of 0.7 is considered to Table 6: Cronbach alpha analysis of efficiency measure.

February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj 35


The Relationship Between Project Success and Project Efficiency
PAPERS

in the literature (Atkinson, 1999; project success measure and 0.58 with success rating and the project suc-
Cooke-Davies, 2002; Shenhar & Dvir, the respondents’ self-reported overall cess measure is between 0.4 and 0.6.
2007), there is adequate justification to success rating. The highest correlation is with meet-
keep it part of the efficiency measure Table 9 shows the correlation of ing scope goals, as we would expect
as defined. the individual measures of project (Shenhar et al., 1997).
efficiency, time, cost, and scope with We can also look at how this rela-
Subgroup Analysis the measures of project success. The tionship varies by industry (Table 10).
The means of these measures were correlation with the overall project It is interesting to note that efficiency
reviewed using subgroup analysis.
First, the measures were compared
Efficiency Project Success Overall Project
by industry (Table 7). In addition, to Measure Measure Rating Valid N
the three calculated measures of suc-
Construction 4.630 3.660 3.528 41
cess, the respondents’ response to the
single question: “Overall project suc- Financial services 4.618 3.354 3.355 257
cess rating” was examined. We see that Utilities 4.535 3.553 3.455 42
construction has the highest project Government 4.731 3.438 3.423 152
success measure. This is in agreement
Education 5.080 3.530 3.480 42
with the literature in general that con-
Other 4.455 3.233 3.231 157
struction has better perceived rates of
success than other industries (Zwikael High technology 4.784 3.538 3.477 223
& Globerson, 2006). However, other Telecommunications 4.805 3.458 3.393 133
trends are more difficult to see, and Manufacturing 4.298 3.295 3.286 122
ANOVA analysis does not indicate that
Healthcare 4.895 3.408 3.303 113
any of the measures are significantly
related to industry. Professional services 4.685 3.292 3.352 69
Next, subgroup analysis was com- Retail 4.367 3.000 2.933 35
pleted by geographic region, which All groups 4.656 3.397 3.361 1386
showed similar results, supporting the p(F) 0.397 0.496 0.882
overall results.
Table 7: Descriptives by industry with ANOVA results.
Next, we examined the correlation
between the respondents’ project suc-
cess ratings and the success measures
(Table 8). The analysis shows close to Std Overall Project Efficiency Project Success
90% correlation between this one ques-
Means Dev Success Rating Measure Measure
tion and the project success measure Overall project 3.333 1.165 1.000
and 0.58 to the efficiency measure, success rating
which indicates a very close correlation Efficiency 4.647 1.386 0.584* 1.000
between the respondents’ overall rating measure
of project success and measures com- Project success 3.376 1.044 0.870* 0.602* 1.000
bining the wider success components. measure
However, the efficiency measure only *p < 0.05.
shows a 0.58 correlation with the man- Table 8: Correlations between project success measures.
ager’s assessment; this appears to indi-
cate that project managers also believe
the overall success of their projects is
most closely correlated with the stake-
Overall Project Efficiency Project Success
Success Rating Measure Measure
holder’s views.
Project time goals 0.508* 0.880* 0.506*
Project Efficiency versus Project Success Project budget goals 0.408* 0.830* 0.417*
The success measure that had the low- Scope and requirements goals 0.537* 0.768* 0.578*
est correlation with the other success
*p < 0.05.
measures was the efficiency measure,
Table 9: Correlation of individual efficiency measures to project success measures.
which had a correlation of 0.60 with the

36 February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj


is most highly correlated to project suc- ing only time and budget. It has been Zolin, 2012; Shenhar et al., 1997). In this
cess in utilities, healthcare, and profes- suggested by a number of authors case, the correlation was 0.512, whereas
sional services and is the least correlated that scope is more closely related to R2  =  0.262. Therefore, even with scope
for government and high technology. project success measures (Turner & removed, there is a clear correlation
This result for high technology may sur-
prise some people, although the result
for government might not surprise Overall Project Project Success
many. Again, this is perceived success Success Rating Measure Valid N
and perceptions may differ by industry Construction 0.530 0.635 41
(Müller & Turner, 2007b). Financial services 0.635 0.680 257
We can compare which components Utilities 0.744 0.706 42
of efficiency were most important by
Government 0.465 0.410 152
industry (Table 10). Kerzner (2009,
p.  736) suggests which industries are Education 0.592 0.627 42
most likely to sacrifice time, cost, or Other 0.507 0.579 157
scope (performance) when trade-offs High technology 0.498 0.515 223
are required. Table 11 suggests budget Telecommunications 0.664 0.651 133
goals and project success were most
Manufacturing 0.692 0.687 122
correlated for utilities, financial ser-
vices, and healthcare, which is in agree- Healthcare 0.606 0.694 113
ment with Kerzner (2009) for utilities Professional services 0.658 0.673 69
and healthcare, though not for financial Retail 0.598 0.616 35
services and were the least important for All results above were significant at p < 0.001.
government and retail. The finding for
Table 10: Correlation of efficiency versus other success measures by industry.
government is also in agreement with
Kerzner (2009). Time goals were most
correlated for construction and health- Budget Goals Time Goals Scope Goals Valid N
care and least correlated with govern-
Construction 0.465 0.714 0.442 41
ment and high technology. Scope goals
were most correlated for education and Financial services 0.496 0.566 0.660 257
utilities and least correlated with gov- Utilities 0.552 0.552 0.697 42
ernment and construction. Government 0.304 0.300 0.424 152
Finally, we completed a regres-
Education 0.094* 0.572 0.701 42
sion analysis of the efficiency measure
versus the project success measure Other 0.405 0.473 0.568 157
(Table  12). This analysis indicates with High technology 0.387 0.431 0.461 223
a quite low p value that the two are Telecommunications 0.396 0.557 0.684 133
related with an R2 of 0.362. The coef- Manufacturing 0.492 0.673 0.563 122
ficient of determination R2 provides a
Healthcare 0.463 0.566 0.607 113
measure of how well future outcomes
are likely to be predicted by a model. Professional services 0.450 0.564 0.662 69
This could indicate that 36% of the Retail 0.349 0.474 0.702 35
variation in project success can be *Marked result was not significant at p < 0.05. All others were significant.
explained by meeting a project’s time, Table 11: Project success measures versus efficiency components by industry.
budget, and scope goals. This is concor-
dance with and further generalizes the
result of R2  =  0.37 reported by Zwikael Beta B Std.Err. of B t(1384) p-level
and Globerson (2006) who studied the Intercept 1.267 0.078 16.159 0.000
relationship solely between technical
Efficiency Measure 0.602 0.454 0.016 28.068 0.000
goals and customer satisfaction.
Regression Summary for Dependent Variable: Success Measure.
A similar analysis was completed
R = 0.602; R² = 0.362; Adjusted R² = 0.362 F(1,1384) = 787.82 p < .001.
for a modified efficiency measure
where  scope had been removed, leav- Table 12: Regression analysis for efficiency measure versus project success.

February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj 37


The Relationship Between Project Success and Project Efficiency
PAPERS

between measures of time and budget Practical Implications Journal of Project Management, 27(4),
success and project success. Whether we will ever be able to wean 355–364.
project practitioners off their beloved Conway, J., & Lance, C. (2010). What
Conclusions iron triangle we cannot know. This reviewers should expect from authors
supports the work of Turner and Zolin regarding common method bias in orga-
As suggested by many authors (Collyer
(2012) that project managers need proj- nizational research. Journal of Business
& Warren, 2009; Cooke-Davies, 2002;
ect control parameters that look beyond and Psychology, 25(3), 325–334.
Jugdev & Müller, 2005; Shenhar et al.,
completing the scope of the project on Cooke-Davies, T. J. (2002). The real
1997; Shenhar & Dvir, 2007; Thomas
time and within budget. Practitioners success factors in projects. International
et al., 2008; Turner & Zolin, 2012), over-
should be aware that when they plan Journal of Project Management, 20(3),
all project success is a much wider con-
and control the project broader suc- 185–190.
cept than the traditional so called ‘iron
cess measures need to be taken into Cooper, D., & Schindler, P. (2001).
triangle’ of project efficiency (Atkinson,
account and made parts of the planning Business research methods. New York, NY:
1999). In this article we have investi-
and control process. This will improve Irwin/McGraw-Hill.
gated to what extent project efficiency is
project and project manager perceived
correlated with overall project success. Dvir, D., Raz T., & Shenhar, A. (2003).
success, especially over the long term.
Through a survey of 1,386 projects we An empirical analysis of the relationship
These results also demonstrate that
found that project efficiency is 60% cor- between project planning and project
practitioners cannot ignore project effi-
related with project success; this falls to success. International Journal of Project
ciency goals if they want to maximize
51% if efficiency is defined as time and Management, 21(2), 89–95.
overall success.
budget only. This supports the asser- Gareis, R. (2005). Happy projects!
tion that project efficiency is an impor- Future Research Vienna, Austria: Manz.
tant contributor to project success, but There are aspects of the relationship Gareis, R., Huemann, M., & Martinuzzi,
shows quite clearly that other factors between efficiency and success that A. (2013). Project management
contribute significantly as well. We can could be further explored: and sustainable development prin-
postulate that these other factors might ciples. Newtown Square, PA: Project
include: • How do timeframes impact project suc- Management Institute.
cess? Do the sponsor’s views of project
• Performance of the project’s output Jugdev, K., & Müller, R. (2005). A ret-
success change over time and how long
post implementation and achievement rospective look at our evolving under-
before that does the view crystallize or
of the project’s output and impact standing of project success. Project
become the final view?
(Turner et al., 2010; Turner & Zolin, Management Journal, 36(4), 19–31.
• Are there any moderators or con-
2012; Xue et al., 2013) Kerzner, H. (1979). Project management:
tingency factors in the relationship
• Whether the project’s output was what A systems approach to planning, schedul-
between efficiency and success? This
the stakeholders were actually expect- ing, and controlling. New York, NY: Van
could also become a topic for future
ing, or whether there was an omis- Nostrand Reinhold.
research.
sion in or misinterpretation of the • A similar study could be undertaken Kerzner, H. (2009). Project management:
specification with a wider array of project partici- A systems approach to planning,
• Risks that were not considered or pants. This would require more of a scheduling, and controlling. Hoboken,
changes to the environment that were case study approach but would give a NJ: Wiley.
not anticipated (Munns & Bjeirmi, broader view of how project success is Müller, R., & Turner, J. R. (2007a).
1996; Thomas et al., 2008; Collyer & perceived. Matching the project manager’s leadership
Warren, 2009) style to project type. International Journal
• Acts of God beyond the project team’s References of Project Management, 25(1), 21–32.
control. Atkinson, R. (1999). Project manage- Müller, R., & Turner, J. R. (2007b). The
ment: Cost, time and quality, two influence of projects managers on project
Academic Implication best guesses and a phenomenon, it’s success criteria and project success by
It has long been postulated that project time to accept other success crite- type of project. European Management
success is more than the achievement ria, International Journal of Project Journal, 25(4), 298–309.
of project efficiency measures, but we Management, 17(6), 337–342. Munns, A., & Bjeirmi, B. (1996). The
believe this is the first time the relation- Collyer, S., & Warren, C. M. (2009). role of project management in achieving
ship has actually been measured and Project management approaches for project success. International Journal of
analyzed using a large dataset. dynamic environments. International Project Management, 14(2), 81–87.

38 February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj


Nunnally, J. (1978). Psychometric theory. Turner, R., & Zolin, R. (2012). in Toronto. He was the recipient of the
New York, NY: McGraw-Hill. Forecasting success on large projects: PMI 2012 James R. Snyder International
Podsakoff, P., MacKenzie, S., Lee, J., & Developing reliable scales to predict Student Paper of the Year Award and
Podsakoff, N. (2003). Common method multiple perspectives by multiple the Major de Promotion Award for best
biases in behavioral research: A criti- stakeholders over multiple time frames. PhD Thesis 2012–2013 from SKEMA
cal review of the literature and recom- Project Management Journal, 43(5), Business School. He holds an Hons. BSc
mended remedies. Journal of Applied 87–99. in Physics and Computer Science from the
Psychology 88(5), 879–903. Xue, Y., Turner, J. R., Lecoeuvre, L., & University of Waterloo, Canada; an MBA
Anbari, F. (2013). Using results-based from Heriot-Watt University, Edinburgh,
Prabhakar, G. (2008). What is project
monitoring and evaluation to deliver Scotland; and a PhD in Strategy,
success: A literature review. International
results on key infrastructure projects in Programme & Project Management
Journal of Business and Management,
China. Global Business Perspectives, 1, from SKEMA Business School (Ecole
3(8), 3–10.
85–105. Supérieure de Commerce de Lille). He can
Project Management Institute. (2013). be contacted at pedro@serrador.net
A guide to the project management body Zwikael, O., & Globerson, S. (2006).
of knowledge (PMBOK ® guide) – Fifth Benchmarking of project planning
Rodney Turner is Professor of Project
edition. Newtown Square, PA: Author. and success in selected industries.
Management SKEMA Business School,
Benchmarking: An International Journal,
Shenhar, A., & Dvir, D. (2007). in Lille, France, where he is Scientific
13(6), 688–700.
Reinventing project management: The Director for the PhD in Project and
diamond approach to successful growth Programme Management and is the
and innovation. Boston, MA: Harvard Pedro Serrador, PMP, P.Eng., MBA, PhD, SAIPEM Professor of Project Management
Business Press. is a writer and researcher on project at the Politecnico di Milano. He is also
Shenhar, A. J., Levy, O., & Dvir, D. management topics and owner of Serrador Adjunct Professor at the University of
(1997). Mapping the dimensions of Project Management, a consultancy in Technology Sydney. Rodney is the author
project success. Project Management Toronto, Canada. He specializes in techni- or editor of eighteen books, and editor
Journal, 28(2), 5–9. cally complex and high-risk projects, of The International Journal of Project
vendor management engagements, and Management. His research areas cover
Thomas, M., Jacques, P. H., Adams,
tailoring and implementing project man- project management in small to medium
J. R., & Kihneman-Woote, J. (2008).
agement methodologies; he has worked enterprises; the management of com-
Developing an effective project:
on projects in the financial, telecommu- plex projects; the governance of project
Planning and team building combined.
nications, utility, medical imaging, and management, including ethics and trust;
Project Management Journal, 39(4),
simulations sectors for some of Canada’s project leadership; and human resource
105–113.
largest companies. His areas of research management in the project-oriented firm.
Trochim, W. (2006). Positivism and post-
interest are project success, planning, and Rodney is Vice President, Honorary Fellow
positivism. Research Methods Knowledge
agile and he has presented a number of of the United Kingdom’s Association for
Base.
peer-reviewed papers on these topics at Project Management, and Honorary Fellow
Turner, J. R. (2014). The handbook of academic conferences. He is an author and former President and Chairman of
project-based management (4th ed.). of books and articles on project man- the International Project Management
New York, NY: McGraw-Hill. agement and is also a regular speaker Association. He received a life-time
Turner, J. R., Huemann, M., Anbari, F. T., at PMI global congresses. He currently research achievement award from PMI in
& Bredillet, C. N. (2010). Perspectives on teaches project management as a part- 2004 and from IPMA in 2012. He can be
projects. New York, NY: Routledge. time faculty member at Humber College contacted at Rodney.turner@skema.edu

February/March 2015 ■ Project Management Journal ■ DOI: 10.1002/pmj 39

You might also like