Professional Documents
Culture Documents
AUBRY - A Fresh Look at The Contribution
AUBRY - A Fresh Look at The Contribution
ABSTRACT ■ INTRODUCTION ■
A better understanding of organizational per- he aim of this article is to enrich the current discussion on the value
formance and the contribution that project
management can make is the aim. The article
adopts the “Competing Values Framework,” a
rich framework that is well established both
theoretically and empirically but is not well
T of project management by presenting empirical results from a
research on the performance of project management offices (PMOs).
It proposes a novel approach to performance inspired by the
Competing Values Framework (Quinn & Rohrbaugh, 1983).
Performance is often identified as the ultimate dependent variable in the
known in the field of project management. The literature on organizations. It is currently the focus of much attention in
framework is summarized and applied in an the project management literature (Thomas & Mullaly, 2008). The current
empirical investigation of the contribution of focus on the topic seems to be driven by the belief that organizations will
project management in general and project adopt project management only if it can be shown to generate value. After
management offices (PMOs) in particular to more than a half-century of history in the management of projects, its con-
organizational performance. The examination of tribution to performance is still not acknowledged outside the group of
11 case studies revealed multiple concurrent professionals who believe in project management. The community of pro-
and sometimes paradoxical perspectives. The fessionals and academics within project management associations are
criteria proposed by the framework have been mostly preaching to the converted. However, outside of this community, the
further developed through the identification of a value of project management is not generally recognized, particularly at sen-
preliminary set of empirically grounded per- ior levels (Thomas, Delisle, Jugdev, & Buckle, 2002).
formance indicators. The empirical results con- A major piece of research on the value of project management led by
tribute to a better understanding of the role of Thomas and Mullaly has recently been completed (Thomas & Mullaly, 2008).
project management generally and PMOs They propose a framework where project management implementation and the
specifically. They also demonstrate the useful- value of project management are aligned within the organizational context
ness of this framework for the study of project through the notion of “fit.” The notion of value has been used to focus on
management’s contribution to organizational what project management is worth to different stakeholders. The level of
performance. analysis is the organization in both Thomas and Mullaly (2008) and the pres-
ent article. A major part of the research presented in this article was realized
KEYWORDS: organizational performance; prior to the publication of papers and the monograph by Thomas and
competing values framework; PMO; value of Mullaly (2008). However, efforts have been made to acknowledge their
project management results.
The empirical work reported in the present article centers around PMOs.
Centering the investigation on the PMO facilitates the empirical study of dif-
ferent means of contributing to organizational performance and different
perceptions of the value of these contributions. In brief, it increases the like-
lihood of producing good results for several reasons. First, organizations that
have PMOs have chosen to centralize several aspects of project management in
and around these organizational entities, making project management more
visible in the organization and easier to study. Studying the role of PMOs is,
Project Management Journal, Vol. 42, No. 1, 3–16 therefore, a practical means for studying project management as it is prac-
© 2010 by the Project Management Institute ticed in these organizations. Second, PMOs are small units that are often
Published online in Wiley Online Library located outside the major organizational units. They are thus in a position to be
(wileyonlinelibrary.com). DOI: 10.1002/pmj.20213 appraised by stakeholders in many other units. This improves the likelihood of
capturing multiple conceptions of their performance by the PMO seems to take significant (Thomas & Mullaly, 2008).
contribution to the performance of the different forms. And it should be distin- The clear demonstration of the direct
organization. Third, research by Hobbs guished from the contribution of proj- influence of project management on
and Aubry (2007) has shown that the ects. The PMO’s contribution is, at least return on investment (ROI) is not easily
legitimacy of PMOs is being challenged potentially, behind the performance of accomplished, as explained by Thomas
in approximately 50% of organizations. each individual project. and Mullaly (2008). In addition, the
The discourse that surrounds PMOs is The context of diversity supports reduction of project management value
thus often charged with tensions that the definition proposed here for organi- exclusively to financial indicators
make differing points of view more vis- zational performance based upon the underestimates major contributions
ible and more easily captured in empir- competing values framework. There are that project management brings to
ical studies. Fourth, Hobbs and Aubry two problems: the first one is to establish organizational success—for example,
(2007) have shown that PMOs fill many a clear definition as to what constitutes innovation (Turner & Keegan, 2004),
different organizational roles. In doing organizational performance, and the process (Winch, 2004), and people
so, they potentially contribute to the second is to propose a realistic and reli- (Thamhain, 2004). Furthermore, the
organization in many different ways, able approach to its measurement. This multifaceted concept of project per-
making the diverse contributions more leads to the research questions: What is formance is acknowledged by several
visible and easier to study. In addition organizational performance in the con- authors (Dietrich & Lehtonen, 2004;
to facilitating the study of the contribu- text of project management and how Shenhar, Dvir, Levy, & Maltz, 2001). The
tion of project management to organi- can it be assessed? balanced scorecard is based on the eco-
zational performance generally, the The next section of the article nomic conception. The balanced score-
PMO is a legitimate object of study in explores the literature on performance. card approach has been proposed to
its own right. This is followed by a presentation of the assess project management perfor-
Organizational performance is a sub- competing values framework, an inte- mance (Norrie & Walker, 2004; Stewart,
jective construct. This construct is subjec- grative model that has the ability to 2001). It has the advantage over the
tive because it exists in the minds of capture the diversity of conceptualiza- traditional economic vision of project
those who are evaluating. The organi- tions of organizational performance performance in encompassing four
zational performance of PMOs will vary found within organizations. Empirical complementary perspectives. However,
depending on who the evaluator is. results will then be presented, which the foundation of this approach rests
Most of these stakeholders belong to illustrate the usefulness of this frame- on ROI. It structures the creation of
different units that have different cul- work. The empirical portion of the arti- value hierarchically with financial value
tures and different values. cle concludes with the presentation of a at the top (Kaplan & Norton, 1996;
A construct is not directly observ- set of practical indicators that provides Savoie & Morin, 2002).
able. In order to evaluate it, the vari- a more concrete representation of orga- The second conception of perfor-
ables that form it must be identified and nizational performance and facilitates mance in the literature on project per-
examined. Justification of the PMO the construction of metrics. Finally, a formance is pragmatic. Several authors
remains a recurring problem in organi- conclusion closes the article. have encompassed the problem of per-
zations, with almost 50% reporting that formance in an approach that seeks to
the existence of their PMO has been Organizational Performance in identify success factors ( Jugdev &
recently questioned (Hobbs & Aubry, the Project Management Müller, 2005). A clarification should be
2007). A PMO would be legitimate if it Literature made here to distinguish between suc-
could convincingly demonstrate its Two conceptions of performance dom- cess factors and success criteria.
contribution to organizational perform- inate the project management litera- Success factors refer to a priori condi-
ance. However, the evaluation of its ture: economic and pragmatic. In the tions that contribute to positive results,
contribution to organizational perform- former, researchers try to demonstrate while success criteria are used to assess
ance is a complex question that may the direct economic contribution of a concrete and measurable result a pos-
have as many variations as the PMO project management to the bottom line teriori (Cooke-Davies, 2002). Cooke-
itself. This highlights the subjective side (Dai & Wells, 2004; Ibbs, Reginato, & Davies (2000, 2004) has examined
of organizational performance. Kwak, 2004). Interestingly, none of the empirical evidence supporting the
PMOs are performing many differ- these researchers have been able to many best practices and success factors
ent functions (Hobbs & Aubry, 2007). Are convincingly demonstrate the econom- found in the literature. He concludes
these different functions regarded with ic value of investment in project man- that most of the contributions have
the same value by different stakehold- agement. The results of the research been based on the opinion of members
ers? The contribution to organizational by Ibbs et al. (2004) are not statistically of the project management community
This definition offers significant poten- (Thompson, McGrath, & Whorton, on the values of those who are evaluat-
tial for adaptation to organizational sit- 1981). Rather than imagine a new ing (Cameron, 1986).
uations and offers the possibility of model, Quinn and Rohrbaugh The third dimension (orientation
acknowledging that a variety of per- approached the problem in a highly and purpose) was not often used in
formance evaluation models may exist original way by undertaking research empirical research based on the com-
simultaneously. This construct is also based on criteria already identified by peting values approach, including
coherent with the constructivist per- Campbell (1976, cited in Quinn & research by Cameron and Quinn
spective, which recognizes the exis- Rohrbaugh, 1983). They treated these (1999). In a fashion consistent with this
tence of several competing logics. criteria using a combination of the stream of research, only the structure
In this perspective, organizational Delphi approach and statistical model- dimension (paradox between flexibility
performance is anchored in the values ing with the participation of a group of and control) and the focus dimension
and preferences of the stakeholders. In very reputable researchers on two pan- (paradox between internal and external)
the context of project management in els. The research led to a set of 17 unique have been employed in the present
general and PMOs in particular, stake- criteria grouped into three significant research (see Figure 1).
holders are individuals and groups who dimensions: the structure dimension The research of Quinn and
have a substantial interest in the man- (paradox between flexibility and con- Rohrbaugh (1983) thus led to the for-
agement of the projects of the organiza- trol), the focus dimension (paradox mulation of a framework that presents
tion. The stakeholders could include between internal and external), and the 17 criteria and their dimensions in four
the project governance board, the busi- dimension of purpose and orientation. quadrants, each associated with a spe-
ness unit managers, the customers of These dimensions formed three sets cific preexisting model of organizational
the projects, the users, the PMO man- of values that explicitly expressed the performance: the open system model,
ager, the project portfolio managers, dilemmas or paradoxes present in the human relations model, the internal
the functional managers, project man- organizations. These values are in con- process model, and the rational goals
agers, project controllers, and so on. stant competition in organizations, and model. Sixteen of the seventeen criteria
to succeed, organizations must reach are associated with one of the four
The Competing Values good overall results, without necessari- models, each representing a different
Framework ly seeking a balance. In this context, conception of organizational perfor-
Origin and Development of the organizational performance depends mance. The 17th criterion, output quality,
Competing Values Framework
Organizational performance was the
object of a worldwide study for a nucle- Flexibility
nonexistent and the complexity found is proposed that can capture these per- into the four conceptions (Quinn &
in the reality cannot be explained using spectives and tensions. Rohrbaugh, 1983) adapted for use with
existing simple models and a positivist This research is part of a mixed- PMOs (see Figure 1). Respondents were
approach (Hobbs & Aubry, 2007). Just method program of research built for chosen to represent different roles,
as organizations are complex social robustness (Brown & Eisenhardt, 1997). potentially leading to different concep-
entities, so too are the specific organi- In this specific research project, a case- tions of the PMO’s contribution to orga-
zational project management struc- study approach has been used to nizational performance (see Table 1).
tures that encompass PMOs. The explore and better understand the con- In addition to interviews, a ques-
methodological strategy is designed to tribution of PMOs to organizational tionnaire was built with the objective
understand such complexity. performance (Yin, 1989). Four organi- of capturing the different conceptions of
Drawing on Van de Ven’s (2007) zations participated in this research. A the PMO’s contribution and their under-
engaged scholarship brings together retrospective historical approach cov- lying values. The questionnaire contains
different points of view of key people ering the period since before the imple- the same 17 criteria. Respondents were
involved with PMOs, using a combina- mentation of the first PMO was adopt- asked to assess the importance of each
tion of qualitative and quantitative ed. The periods covered ranged from 2 of the criteria in their current context
instruments. PMOs represent a com- to 13 years, with an average of 7.24 using a 5-point Likert scale, where 1 was
plex phenomenon not only by the vari- years. As is common among PMOs not important at all and 5 was very
ety of their expressions, but also by the globally, the PMOs in these organiza- important. Criteria with a score of 4 or 5
number of entities they relate to in a tions were restructured every few years were considered important.
single organization. In matrix organiza- (Hobbs & Aubry, 2007). A total of 11 dif-
tions, projects naturally form networks, ferent PMOs were analyzed, each con-
Empirical Results
which converge in one or more PMOs. stituting a case study. A Typology of PMOs Based on
Yet, within a single organization there Two types of data were collected: Organizational Performance Criteria
are multiple managers and profession- interviews and a questionnaire. The As mentioned previously, the compet-
als in relationships with the PMO. How most important data came from inter- ing values framework takes into
do they value the PMO’s contribution to views where open-ended questions were account the values within organiza-
organizational performance? It asked specifically on the performance of tions, and it provides an instrument
depends on the perspective of each of the PMO. Interviews were codified and that helps highlight paradoxes between
these stakeholders. In the quest for a analyzed in a grounded theory approach values. The diagram shown in Figure 1
better understanding of the PMO’s con- (Strauss & Corbin, 1998). Transcripts forms a typology based upon the four
tribution to organizational perfor- were coded using the 17 criteria from the different conceptions of organizational
mance, a global methodological strategy competing values framework grouped performance. Each PMO from the case
jurisdiction over human resource each of the four models and the 17 cri- according to employee wishes. It is
issues. The human resource managers teria. The sets of indicators create value unusual that an organization structured
do recognize the PMO within the inter- in two ways. First, they enrich the by project (which is the case here)
nal processes and rational goals crite- understanding of the PMO’s contribu- stresses the contribution that personnel
ria. PMO employees are of particular tion to organizational performance make to projects and intensifies the
interest; they attribute significant by providing detail that is meaningful role of the PMO in human resources
importance to human resource and in this context. Second, they provide management. But management of
open system criteria but not that much the basis for instruments to measure the human resources, in this organizational
to internal process and rational goal presence of the models in real organiza- context, is a particularly critical func-
criteria. tional settings. tion. The personnel are exceedingly
These results also show some of the The goal here is to be more specific young: the average age is less than 30
paradoxes in the expectations relative and to identify relevant concrete indica- years old. This fact accounts for the
to the PMO’s contribution to perfor- tors in the context of PMOs. Transcripts strength of the company at the same
mance. For example, the financial man- of the interviews have first been coded time as it produces its own nightmares.
ager considers the internal processes using the 17 criteria. Then, excerpts These “teenagers” require a consider-
criteria to be the PMO’s most important have been scrutinized for their meaning able amount of supervision in order to
contribution to organizational per- in order to group multiple variations respect the project constraints and the
formance. However, project managers under a common indicator. From this never-ending challenges. There is an
consider these to be the least impor- second step, a list of 79 unique indica- important shortage in qualified person-
tant. When it comes time for the PMO tors was produced. nel in this high-technology sector. This
manager to discuss the contribution of Indicators inform us about the vari- company has invested extensively in
his/her unit with the financial manager, ety of possible ways the models mani- training in conjunction with local gov-
arguments concerning internal fest themselves and the different ways ernments. It has also implemented an
processes will probably be important, that measurements can be made in the internal school to provide skilled work-
but the same arguments are not as like- different PMOs. An advantage of this ers for its own development needs.
ly to convince the project managers. It exercise is to render explicit and opera- Furthermore, personnel turnover is sig-
is easy to see how these differences in tional notions about the contribution of nificant. In summary, the management
perceptions and appreciations can lead the PMO to organizational perfor- of human resources is an important
to tensions and even to conflicts. mance that until now may have function in which the PMO plays an
Results from the competing values remained abstract. See Appendix A for active role.
framework may also offer the opportu- the complete list of indicators. The significant number of indica-
nity to open up discussion between dif- tors identified within the human rela-
ferent and sometimes opposite ways of Indicators Within the Human tion conception shows that underlying
understanding the PMO’s contribution Resources Conception values exist in organizations to assess the
to organizational performance. The indicators related to human re- contribution of the PMO to organiza-
sources foster a clearer understanding tional performance regarding the human
The Development of Indicators of the role that the PMO can play in this resources. A PMO manager confirms the
Specific to the Evaluation of the area. Indicators vary greatly from one impact of his entity on the degree of sat-
PMO’s Contribution to Organi- organization to the next. It appears that isfaction of project managers:
zational Performance each of the four organizations has a dif-
Well, we took it all [multiple PMOs]
The four conceptions and the 17 gener- ferent flavor in the way the human
and centralized it; it [the degree of
ic criteria initially proposed within the resource contribution of the PMO is
satisfaction of the employee] went
competing values framework (Quinn & valued. For example, the organization from 0 to 24 in 12 months. The ener-
Rohrbaugh, 1983) can be applied in dif- in the multimedia industry stands out gy, the empowerment—there was a
ferent contexts. For this reason they are with the largest number of indicators in huge improvement.
at a more abstract level. Cameron and human resources. The scope of these
Quinn (1999) recognize that the four indicators often covers all of the It is also notable that the PMO plays
models and the 17 criteria are quite resources working on projects rather a social role and that it has an influence
abstract and recommend that sets of than only PMO employees or project on the work-family balance. Analysis
criteria be developed that are specific managers. In this case, the PMO plays a also revealed that the capacity for nego-
to a particular use. In a manner consis- direct role in the development of com- tiation is a competence essential to the
tent with this recommendation, specific petencies for personnel, according to resolution of conflicts surrounding
sets of indicators were developed for the needs of upcoming projects, and the state of advancement of projects.
information. People working on proj- justify the number of staff working in it. formance. Research on organizational
ects repeat the same information in The criterion of responsiveness includ- performance in project management
several different meetings, resulting in ed two indicators that were mentioned does not produce entirely satisfactory
inefficiency and frustration. At the quite often by respondents: (1) the results. Each piece of research brings
same time, the role of the PMO in nego- PMO should be able to respond quickly important contributions—but consid-
tiation when it comes time to decide on in order to make projects succeed and ered all together, a global vision of proj-
the status report color is recognized. (2) the PMO should be able to adapt to ect management performance at the
The second indicator mentioned is different situations. organizational level is still lacking.
project success and, more specifically, Indicators in this open system con- The competing values framework
the role of the PMO in fostering project ception contrast with the ones included has the advantage of integrating the
success. in the internal processes conception. financial perspective of performance
This confirms that paradoxes exist. There with the other conceptions in order to
Indicators Within the Open System are individuals that value the respect of form a multidimensional perspective.
Conception project management processes, while at Indeed, the four conceptions of the
Indicators within the open systems or the same time in the same organization, framework give us a multifaceted repre-
effectiveness conception are the fewest others value exactly the opposite and sentation of the performance of organi-
in number. These mostly deal with flex- encourage delinquency. The competing zational project management. The
ibility, adaptation, and innovation in values framework offers an opportunity rational goals and efficiency conception
project management. The first criteri- to acknowledge these paradoxes and, integrates the economic values of prof-
on, growth of the organization, refers from there, to open up a dialogue to itability, project management efficiency,
directly to the business side of the develop a common basis and under- and return on investment. The open sys-
organization, taking into account sales, standing of organizational performance. tems and effectiveness conception
qualitative results, and effectiveness. This work supports the recognition of the includes variables that measure growth
These elements relate to the benefits diversity of the contributions a PMO can and take into consideration innovation
from projects. It emphasizes that the make to an organization. And also it and project effectiveness. The human
PMO could be involved in a wider proj- should help to develop the awareness of relations conception emphasizes the
ect life cycle, covering the benefits from PMO managers and their employees of development of human resources, cohe-
projects. This stretches project man- the paradoxes that are at work in their sion, and personnel morale. All of these
agement toward the product life cycle organizations regarding their perform- elements are often absent from the eval-
(Jugdev & Müller, 2005). ance. This approach can be a valuable uation of organizational performance.
The criterion of flexibility, adapta- instrument to initiate a dialogue and The internal processes conception
tion, and innovation show numerous come to a common understanding of captures measurements related to cor-
indicators, few of which are shared what is valued. PMO actions could then porate processes tied to project manage-
from one case to another, except for be aligned on this common understand- ment such as project delivery method-
delinquency, with respect to project ing of organizational performance. ologies, communication processes, and
methodology. One respondent stated: knowledge management processes.
Indicators of Output Quality
“A lot of flexibility, what matters to me is Overall, the competing values model
The quality criteria include three indi-
the result; I couldn’t care less if we used bears directly on performance (objective
cators. First, the quality of the product
a saw or a screwdriver to get there.” This variable) instead of bearing on success
has been included here, as many inter-
highlights the fact that the contribution factors (explanatory variables).
viewees mentioned this element in
of the PMO to organizational perfor- Organizational performance must
relation with the PMO’s contribution to
mance is not limited to the establishment be examined from different viewpoints
the overall quality performance. The
of a methodology in project manage- and be scrutinized at several loci of
second and third are indicators of satis-
ment (from the internal processes con- analysis. PMOs are positioned at the
faction of the PMO sponsor and clients
ception), but also the flexibility with interface of several entities, some of
of the PMO. These indicators are quite
which the PMO encourages its use. which belong to project networks and
common when assessing quality.
While no indicators were mentioned in others to operational organizations
the evaluation by the external entities Conclusion (Lampel & Jha, 2004). They are in touch
criterion, respondents mentioned some The aim of this study is to understand with the projects, programs, project port-
for the criteria of having links with the the contribution of the PMO to organi- folios, corporate strategy, and functional
external environment. Benchmarking zational performance with a view to and business units. The PMO is there-
was mentioned often in a context of jus- understanding project management’s fore at the center of numerous perspec-
tification of the PMO, particularly to contribution to organizational per- tives on organizational performance. ■
service. Public Productivity Review, Lessons for team leadership. organisations as information pro-
5(2), 141–159. International Journal of Project cessing systems? Paper presented
Savoie, A., & Morin, E. M. (2002). Les Management, 22, 533–544. at the PMI Research Conference,
représentations de l’efficacité organisa- Thomas, J. L., Delisle, C., Jugdev, K., & London.
tionnelle: Développements récents Buckle, P. (2002). Selling project man- Yin, R. K. (1989). Case study research:
[Representations of the organizational agement to senior executives: Framing Design and methods. Newbury Park,
effectiveness: Recent developments]. In the moves that matter. Newtown Square, CA: Sage.
R. Jacob, A. Rondeau, & D. Luc (Eds.), PA: Project Management Institute.
Transformer l’organisation: La gestion Thomas, J. L., & Mullaly, M. E. (Eds.).
stratégique du changement [Transfor- (2008). Researching the value of
ming the organization: The strategic project management. Newtown Monique Aubry, PhD, is a professor in the grad-
management of change] (pp. 206–231). Square, PA: Project Management uate programs in project management at the
Montréal, Québec: Revue Gestion. Institute. School of Business and Management at the
Shenhar, A. J., Dvir, D., Levy, O., & Thompson, M. P., McGrath, M. R., & Université du Québec à Montréal. She is an
Maltz, A. C. (2001). Project success: Whorton, J. (1981). The competing active researcher within the Project
A multidimensional strategic concept. values approach: Its application and Management Research Chair under the aegis of
Long Range Planning, 34, 699–725. utility. Public Productivity Review, 5(2), project governance. Before her academic
Stewart, W. E. (2001). Balanced score- 188–200. career, she worked for more than 20 years in
card for projects. Project Management the management of major projects in the finan-
Turner, R. J., & Keegan, A. E. (2004).
Journal, 32(1), 38–53. cial sector. She is a member of the Project
Managing technology: Innovation,
Management Institute’s Standards Member
Stinglhamber, F., Bentein, K., & learning, and maturity. In P. W. G.
Advisory Group.
Vandenberghe, C. (2004). Congruence Morris & J. K. Pinto (Eds.), The Wiley
de valeurs et engagement envers l’or- guide to managing projects (pp.
ganisation et le groupe de travail 567–590). Hoboken, NJ: Wiley.
[Values congruence and engagement Tushman, M. L., & O’Reilly, C. A., III. Brian Hobbs, PhD, PMP, Project Management
towards the organization and working (1996). Ambidextrous organizations: Research Chair (www.pmchair.uqam.ca), has
group]. Psychologie du Travail Managing evolutionary and revolu- been a professor at the Université du Québec à
et des Organisations, 10(2), tionary change. California Manage- Montréal in the Master’s Program in Project
165–187. ment Review, 38(4), 8–30. Management for 25 years, a program accredited
Strauss, A., & Corbin, J. (1998). Basics of Van de Ven, A. H. (2007). Engaged by the Project Management Institute’s Global
qualitative research: Techniques and scholarship: Creating knowledge for Accreditation Center. He has been a member of
procedures for developing grounded the- science and practice. Oxford, UK: PMI’s Standards and Research Member Advisory
ory (2nd ed.). Thousand Oaks, CA: Sage. Oxford University Press. Groups. He has presented many papers at both
Thamhain, H. J. (2004). Linkages of Winch, G. M. (2004, July). Rethinking research and professional conferences world-
project environment to performance: project management: Project wide.
12. Efficiency 13. Efficiency in the relations between 16. Links with 11. Link with the local PMI (some-
PMO and functional or business units— external times too much!)
negotiation on projects environment 12. Benchmarking
14. Project success (PMO impacts on
projects) 17. Readiness 13. Being agile
14. Responsiveness in appointment
when urgent need
Table A2: List of indicators within conceptions: Rational goals and open system.