You are on page 1of 13

Available online at www.sciencedirect.

com

ScienceDirect
International Journal of Project Management 33 (2015) 784 – 796
www.elsevier.com/locate/ijproman

Competency mapping in project management: An action


research study in an engineering company
Sílvia Mayumi Takey, Marly Monteiro de Carvalho ⁎
Production Engineering Department, Polytechnic School University of São Paulo, São Paulo, Brazil

Received 4 February 2014; received in revised form 30 June 2014; accepted 29 October 2014
Available online 21 November 2014

Abstract

The present study proposes a seven-step method for the project management competency map. Additionally, the method helps to evaluate
and design evolution trajectories based on organisational experience and challenges. This methodological approach merges literature
reviews with qualitative and quantitative research methods. Data were collected in a large Brazilian engineering company through the
analysis of documentation, behavioural event interviews, self-assessment surveys and statistical analyses. The proposed method is simple,
replicable and insightful for managers across all industries and consists of the following: a description of competence and performance
criteria, an assessment process, a diagnosis of the current proficiency level, the identification of competence levels that differentiate
professional categories, the establishment of expected profiles, a gap analysis and the association between experience and competency
development.
© 2014 Elsevier Ltd. APM and IPMA. All rights reserved.

Keywords: Project management; Individual competence; Competency management; Project manager

1. Introduction Recently, with the increase in professional project manage-


ment certifications, the level of interest in the competencies of
To assure effectiveness in project management, it is strategic to project management professionals has increased
manage individual competence and to map competence-building (Starkwheather and Stevenson, 2011). However, for Bredin
trajectories for the project manager and team members. Chipulu et and Soderlund (2013) little attention has been paid to the
al. (2013) suggest that project manager competencies are important careers and career models of project managers.
in project success. Project management associations and institutes have imple-
The resource-based view (RBV) literature (Barney, 1991; mented competency frameworks for project managers (AIPM,
Prahalad and Hamel, 1990) highlights the singular and strategic 2008; IPMA, 2006; PMI, 2007). These frameworks recommend
characteristic for each element of the VRIO framework (value, competency mapping in both hard and soft skills, but focus on
rarity, imitability and organisation), which reinforces the impor- hard skills. However, the number of studies with a focus on soft
tance of managing these processes in a strategic manner within an skills is increasing, as demonstrated by Skulmoski et al. (2010),
organisation that seeks the mapping and construction of compe- Clarke (2010a, 2010b), Stevenson and Starkweather (2010),
tence trajectories. Muller and Turner (2010) and Dainty et al. (2005). Moreover,
Ahsan et al. (2013) show that job listings for project managers
emphasise soft skills and competencies in a different manner than
⁎ Corresponding author at: Av. Prof. Almeida Prado, trav 2, n 128, ZIP code that in the literature, whereas Chipulu et al. (2013) find that
05508-900-São Paulo/SP, Brazil. industry puts more weight on generic skills than on project
E-mail address: marlymc@usp.br (M.M. Carvalho). management knowledge.

http://dx.doi.org/10.1016/j.ijproman.2014.10.013
0263-7863/00/© 2014 Elsevier Ltd. APM and IPMA. All rights reserved.
S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796 785

Given the importance attributed to these certifications within elements of competence. For example, the unit “Planning the
the business environment and the still emerging state of this project” contains the element “Approved project schedule”.
debate, we proposes here mapping, evaluation and development Each element begins with a verb in the past tense, implying
processes for the competence of project managers and practi- delivery of value, which makes this framework the most
tioners in an organisational context. The present paper aims at compatible with the definition of competence adopted in the
closing this gap by answering the following two research present work.
questions: (RQ1) How to tailor organisation-specific project The Australian Institute of Project Management (AIPM,
management competencies from standardized competency frame- 2008) model defines performance competencies in eight
works; (RQ2) How to systematically assess project management units according to knowledge areas, differentiating them into
competence in an organisation, including which competencies three professional levels: project practitioner, manager and
differentiate each level in project management career models and director.
which professional experiences relate to competence development A comparative analysis of these frameworks shows that there
in order to guide human resources development programmes. We are similarities between these frameworks in their consideration of
investigate these RQs through a structured approach driven by project management processes and personal competencies. The
action research in a large Brazilian engineering company, merging methodological approach for framework construction was also
qualitative and quantitative methods. similar (crowdsourced from practitioners). On the other hand, the
The present work is divided into five sections. The discussion of IPMA (2006) does not define a performance category, as did the
academic literature on competencies is presented in Section 2. The PMI (2007) and AIPM (2008), while being the only one to define
methodological strategy that governed the present study is contextual competencies. The AIPM (2008) is the only of these
presented in Section 3, detailing the primary and secondary data organisations to differentiate competencies throughout the project
collection instruments. The results and their respective analyses are management career. Therefore, instead of adopting only one
presented in Section 4. Finally, Section 5 presents recommenda- method, it seems more appropriate to merge them.
tions for researchers and others interested in competence in project Rose et al. (2007) collected project management competen-
management, considering the points of view of both organisations cies in a specific company using semi-structured interviews
and academia. with project managers to investigate the required competencies
in project situations. The study resulted in the identification of
2. Literature review seven competencies: technical, process, time, client, business,
personal and uncertainty management.
2.1. Concept of individual competence Dainty et al. (2005) studied project management competen-
cies in the construction sector, defining nine performance criteria,
The concept of competence (Le Boterf, 1995) is widely used such as team building, leadership and decision-making. A panel
today; however, competence has different meanings to different of experts separated the managers into two groups (superior and
people (Crawford, 1998), and no universally accepted defini- average performance) and evaluated all participants using the
tion currently exists (Seppänen, 2002). defined criteria. Variance analyses were performed, revealing 12
The definition of individual competence employed in the competencies related to superior performance. This study sheds
present work is the “ability to mobilise, integrate and transfer light on the establishment of proficiency levels and differentiating
knowledge, skills and resources to reach or surpass the configured competencies in project management careers.
performance in work assignments, adding economic and social Grant, Baumgardner and Shane (1997) studied the impor-
value to the organisation and the individual”, which was adapted tance of technical competencies for project managers of
from Ruas et al. (2005) and Fleury and Fleury (2001). In other procurement projects for the Department of Defense. Using
words, it is not enough to have a stock of knowledge and skills the characterisations of respondents and projects, a contingency
associated with higher performance (Boyatzis, 1992; Mccleland, analysis was performed. They concluded that technical
1973; Mirable, 1997; Spencer and Spencer, 1993); their application competencies are essential, especially in the initial phases of a
in valuable deliveries also matters (Le Boterf, 1995; Zarifian, project and when the team has a technical level that is either
1996). very high or very low.
The International Project Management Association's Com- For Ahsan et al. (2013), project manager competencies
petence Baseline — ICB (IPMA, 2006) describes the technical, could be deployed into knowledge, skills, and abilities. Bredin
behavioural and contextual competencies of project manage- and Soderlund (2013) outline two archetypes of project
ment. Varajao and Cruz-Cunha (2013) propose a tool for the manager career models: the competence strategy model and
process of selecting project managers based on the 46 ICB the talent management model.
competence elements as model criteria. It is important to highlight the contingent effect of industries
The Project Manager Competency Development (PMCD) and countries on key competencies, as indicated by Ahsan et al.
Framework from the Project Management Institute (PMI, (2013). Similarly, Chipulu et al. (2013) identified differences
2007) describes knowledge, performance and personal compe- across countries (the U.K., the U.S., Canada, China, India,
tencies. Knowledge competencies are described in the Project Hong Kong, Malaysia, and Singapore) and industry sectors,
Management Body of Knowledge (PMI, 2004), and perfor- which place significantly different levels of salience on the six
mance and personal competencies are formed by units and dimensions of project manager competencies.
786 S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796

2.2. Evaluation and development of project management formal training and work experience, with a greater emphasis on
competencies the work experience.

The IPMA (2006) defines four certification levels differentiated 2.3. Summary of the project manager competencies
by the project's degree of complexity in which the professional
performs the competencies. The complexity of the assessment also A content analysis of the literature was performed, including
increases proportionally to the certification level and the stage of competency encoding, frequency counts, cross-tabulations and
the process. interpretation of results, as suggested by Duriau et al. (2007). A
In the PMI (2007) framework, each element of competence has diagram of affinities was used to create the competency clusters,
performance criteria (behaviour indicators that specify how com- resulting in four categories of competencies: project manage-
petence is demonstrated in practice) and evidence (artefacts, in ment, personal, technical, context and business processes. This
particular documents, that prove the existence of the performance terminology is not consolidated; for instance, the personal (PMI,
criterion). The assessment method of this framework was the most 2007) and behavioural competency categories (IPMA, 2006) are
compatible with the competence definition adopted, as previously deployed in similar cluster of competencies; thus, in the present
stated. The methods suitable for the desired levels of accuracy paper, we used “personal competencies”, which is more often
follow: employed in the studies we analysed. Table 1 presents a summary
of the project management competencies by category.
In the project management process category, the competencies
• Low rigour: self or informal assessment.
relate mainly to the Project Management Body of Knowledge®
• Medium rigour: evidence review, 360° feedback, interviews.
(PMI, 2008) knowledge areas. In the construction industry in
• High rigour: independent evaluator, workshops and simulations.
particular, it was found that environmental, safety and health
management were of high importance (PMI, 2007).
Campion et al. (2011) indicate that proficiency levels can take Competencies in the personal category were the most
several forms, including progressive levels of development, disaggregated in the literature. Some personal competencies may
performance levels and detailed descriptions, depending on the seem contradictory, such as holistic view and attention to details.
desired purpose. Bredin and Soderlund (2013) corroborate this and Exploring deeper, the former is related to senior project managers,
suggest critical factors for the design of project management career while the latter is related to practitioners (AIPM, 2008). This
models; the number of levels, the complexity of assignments and reinforces the need to identify key competencies throughout the
the degree of formal requirements. project management career and not to consider the project manager
The PMI (2007) model indicates several forms of competency a super hero, proficient in all competencies simultaneously.
development: mentoring, coaching, peer-to-peer, role-playing, Context and business competencies were highlighted mainly
on-the-job training, group training, in-house training, computer- in IPMA (2006) and seem to relate to experienced project
based training, formal training and conferences. Edum-Fotwe and managers. The technical competency category is the only one that
McCaffer (2000) studied the mechanisms for developing project cannot be found in standardized frameworks of international
management competencies and observed that, from the point of institutions, but are frequent in case studies with empirical data.
view of professionals, the most important are academic courses, Since the industries in such studies are close to the organisation in

Table 1
Project management competences.
Category Competences References
Project management Integration management; scope management; time management; costs management; quality IPMA (2006), PMI (2007), and AIPM (2008)
processes management; human resource management; communication management; risk management;
contract management; environmental management; safety and health management
Personal Leadership; communication; opening; relationships; team building; teamwork; development of Edum-Fotwe and McCaffer (2000), Dainty et al.
others; conflict resolution; holistic view; systemic view; assertiveness; problem-solving; ethics (2005), IPMA (2006), Brill et al. (2006), PMI
and integrity; commitment; self-control/work under pressure; relaxation; uncertainty; (2007), Rose et al. (2007), AIPM (2008),
creativity; negotiation; emotional intelligence; commitment to the organisation; reliability; Clarke (2010a, 2010b), Muller and Turner
attention to detail; delegation; search for information; analytical thinking; conceptual thinking; (2010), Skulmoski and Hartman (2010),
flexibility Akogbe et al.(2013), Ahsan et al. (2013), and
Jaafar and Othman (2013)
Technical General technical overview; technical vocabulary; technical challenges; search for innovative Thamhain and Wilemon (1978), Cleland and
technical solutions; technical solution assessment; technical risk assessment; technical trade-off King (1983), Bloom (1989), Grant et al.
decisions; relationship between technologies; design (project); technical drawing (1997), Edum-Fotwe and McCaffer (2000),
and Rose et al. (2007)
Context and business Organisation's profitability; strategic alignment; customer relationships; customer satisfaction; Rose et al. (2007), IPMA (2006), Dainty et al.
forces of industry (organisation, customer and suppliers); legislation; finance; continuous (2005), and Brill et al. (2006)
management improvement
S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796 787

the present work (e.g. defense equipment procurement, software Panel of experts, Step 3. Relationships between experiences and
engineering), we decided to keep them as a separate category, at competencies, Step 4. Self-assessment method definition, Step 5.
the same level of personal, process and contextual competencies. Self-assessment questionnaire, Step 6. Assessment process and
Step 7. Training path.
3. Research methods
Step 1 Selection and analysis of the organisation
To investigate the RQs, we developed a structured approach The selected organisation, a Brazilian engineering and
driven by action research in a large Brazilian engineering construction company active in infrastructure sectors such
company. as energy, mining, oil and gas, was founded in 1960 and
The starting point was to develop the conceptual framework, has around 800 employees. The selection criteria were the
presented in the previous section, with a grounding in related maturity of the Project Management Office (PMO) and
literature, as suggested by several authors (Voss et al., 2002; project management practices: the organisation has been
Eisenhardt and Graebner, 2007; Carvalho, 2014). This phase Top of Mind for three consecutive years in PMI's bench-
helped to demonstrate the exploratory stage of this research marking (2009, 2010 and 2011), was nominated PMO of
field, so action research is a suitable research method for our the year in 2012 by MundoPM magazine and 10% of all
RQs. work force are certified Project Management Professionals
Action research, a term coined by Lewin (1946), is relevant (PMPs®). The project management staff is divided into
and valid in its ability to address the operational realities disciplines according to knowledge areas. For the present
experienced by practicing managers while simultaneously study the departments selected were scheduling planning
contributing to knowledge (Coughlan and Coghlan, 2002: (SP) and financial planning (FP), due to the representative
p.220). Its lack of generalizability is compensated for by the number of practitioners.
incomparable benefits of deep insight and potential of developing The preexisting behavioural competencies and descriptions
new knowledge (Karlsson, 2002) due to its reflexive, collabora- of project management posts were consulted. The ease of
tive and interventionist nature (Coghlan, 2007). access for the researchers to documents and key stake-
During the action research cycles, we introduced multi-method holders was important to the choice of this company.
combinations to achieve the proposed objectives, merging Eighty-three employees participated in the research during
qualitative and quantitative approaches, as shown in Table 2. the seven steps, including top management, PMO mem-
There is an increasing trend in operations management of bers and employees from the SP and FP departments.
applying multi-method research as suggested by Singhal and Step 2 Content analysis and panel of experts
Singhal (2012a,b). Thus, methods were combined in order to As mentioned in Section 2.3, a content analysis of the
achieve triangulation and mitigate the methods' weaknesses. surveyed literature was performed (see Table 1) that led to
For each objective, a bibliographic survey was performed encoding and clustering of competencies into four
combined with field research; Table 2 details the research and categories. This preliminary theoretical competence frame-
data collection methods selected, as suggested by Flynn et al. work was then compared with the company's competency
(1990). Several sources of evidences were gathered, including guidelines and stakeholders' perspectives.
documentary analysis of the organisation, semi-structured The panel of experts method was selected to understand the
interviews and focus groups with key stakeholders. subjective reasons for tailoring the standardized project
Action research was developed through a cycle of steps, each management competencies to a specific organisation, as
composed of a cycle of planning, action, and fact finding (Lewin, performed by Dainty et al. (2005) and Rose et al. (2007).
1946), in which repeated cycles of data gathering, data feedback, After obtaining qualitative data, it was possible to
data analysis, action planning, implementation and evaluation formulate more precise constructs.
occur (Karlsson, 2002). A meta-step of overall organisation and The interview approach was situational (behavioural event
analysis is the focus of research (Coughlan and Coghlan, 2002). interviews), as proposed by Rose et al. (2007) and Dainty
This action research results in seven steps arising from the repeated et al. (2005). In each area, two types of respondents were
cycles: Step 1. Selection and analysis of the organisation, Step 2. selected: (1) analyst/engineer and (2) coordinator/manager.

Table 2
Structured approach.
Objective Main references Research method Data collection method
Competence definition Rose et al. (2007), Dainty et al. (2005), and Panel of experts Documentary analysis of the organisation; semi-structured
Campion et al. (2011) interviews; focus groups with key stakeholders
Competence assessment IPMA (2006), PMI (2007) and AIPM (2008) Panel of experts Documentary analysis of the organisation; semi-structured
methods interviews; focus groups with key stakeholders
Proficiency levels Dainty et al. (2005), Campion et al. (2011) Survey Self-assessment questionnaire
Competence development PMI (2007), Edum-Fotwe and McCaffer (2000), Panel of experts Causal map between experiences and competences;
Grant, Baumgardner and Shane (1997), and Rose self-assessment questionnaire (characterisation)
et al. (2007)
788 S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796

PMO indicated professionals that had experience in the less pressure on respondents (hopefully inducing more
whole spectrum of project typologies in the organisation, honest responses) and quickly providing research data.
resulting in eight interviews (10% of the population). From the literature and focus groups consisting of those
Although limited in number of interviewees, the interviews designated responsible by the PMO, including special-
explored the entire career of each participant. The sample ists and area coordinators, the self-assessment method
was thus able to cover all project types and conditions was defined for the questionnaire utilized in step 5.
present in the organisation (engineering projects; technical The core population for the self-assessment was defined
and economic feasibility studies; engineering and manage- as the employees directly involved in project activities
ment of procurement and construction projects; consortium from SP and FP departments. The sample size was 75
projects; commercial proposals; executive projects; and respondents, representing 87% of SP employees (44
on-site construction and assembly projects), which can be professionals) and 94% of FP employees (31
verified in Table 3. professionals).
A computer-aided approach to content analysis was per- Step 5 Self-assessment questionnaire
formed using the software NVivo9. An initial tree of com- In the process of designing the research instrument, the
petence codes was established from the theoretical advantages and disadvantages of both self-administered
framework (see Table 1), and new codes were included and interviewer-administered questionnaires were ex-
throughout the analysis. The coding process was checked plored (Saunders et al., 2007, Bryman and Bell, 2011).
carefully, as the reliability of the content analysis was A self-administered assessment questionnaire with a
primarily addressed using multiple coders (Duriau et al., mix of open- and closed-ended questions was selected.
2007). Through the Dictionary of Competencies and the
The frequency of each code enabled a primary selection of self-assessment method, an online questionnaire was
competencies and the coded excerpts provided subsidies established. Each competence was represented by one
for the performance criteria. The preliminary results were or more performance criteria. These criteria were
reviewed by two focus groups — one with the inter- presented to respondents in a random order, and each
viewees and the other with two senior members of the included the use of a past participle. By means of a
PMO that were not in the initial sample. This review was semantic scale, respondents evaluated the degree of
performed as a means of minimising reliability problems autonomy with which they had displayed each compe-
due to the limited number of interviewees, resulting in the tence in the previous five years.
final version of the Dictionary of Competencies. Characterisations of the professionals (e.g., function,
Step 3 Relationships between experiences and competencies seniority, certifications) and their experiences (e.g.,
To understand the competence-building trajectories for project type and phases in which they had worked) were
the project manager according to professional experience collected to identify correlations between competencies
and challenges, a relational map was designed based on and the professionals' experience. Four pilot studies
top management trajectories and PMO members' trajec- were performed prior to the formal application.
tories, linking competencies and project experience. A pilot test of the questionnaire was performed
Maps were drawn with the software C-map® relating the with scholars and organisation stakeholders and was
interviewees' experiences and the project management based on the face and content validity of the research
competencies developed. These hypotheses were further instrument (Saunders et al., 2007; Bryman and Bell,
compared with the statistically significant relationships 2011). After a pilot test of the instrument, the semantic
found through the analysis of the self-assessment ques- scale was transformed into a metric as follows: I have
tionnaire (see Step 5). not done this (0); I have done this under guidance (30 =
Step 4 Self-assessment method definition 1); I have done this autonomously (31 = 3); and I have
The self-assessment questionnaire was selected because coordinated the execution of this (32 = 9). This scale
it is a low rigour method (PMI, 2007); therefore placing was adopted because of the interviewees' descriptions

Table 3
Panel of experts: interviewees' profiles.
Characteristics FP1 FP2 FP3 SP1 SP2 SP3 SP4 SP5
Function Engineer Manager Manager Coordinator Coordinator Engineer Engineer Manager
Seniority Junior Senior Senior Full Full Junior Junior Senior
Type A X X X
Type B X X
Type C X X X X X X
Type D X X X X X X
Consortium X X X X X
Proposal X X X X X
Engineering X X X X X X X X
Construction X X X X X X
S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796 789

of the career trajectories: the progression from junior to 4. Results


full professional was much faster than the progression
from full to senior or management/leadership levels. 4.1. Panel of experts
Cronbach's alpha test was applied to verify whether the The profile of the panel of experts is presented in Table 3,
performance criteria characterised the same competen- where it was found that all relevant experiences were covered.
cies. The encoding resulted in 372 references in FP and 466 in
Using MINITAB® software, descriptive statistics and SP. Competencies that complemented the theoretical frame-
Mood's median test were used to (1) identify the work were identified, such as constructability (sequencing of
differentiating competencies between functions and construction activities during the engineering phase for the
seniority degrees and to (2) study the differences shown early identification of obstacles in the field).
by professionals' experience in competence performance. When analysing the reference distribution (see Fig. 1), a
This technique was chosen because the variables in this relatively higher participation in the category of context and
study are non-parametric and do not have a normal business was observed for managers. These are areas more
distribution, conditions that would violate premises of relevant to FP than to SP, whereas technical competencies
other variance tests, such as ANOVA. (understanding of the engineering activities) have a greater
With the aid of coordinators from each of the areas, the importance in SP.
expected proficiency standard was established for each The competencies identified as being the most important by
career level according to functions and seniorities, and an more than half of the respondents from each area are presented
analysis of development gaps was performed. in Table 4.
Step 6 Assessment process Time management was relevant to FP due to the interface
The competency assessment process and the perfor- with cash flow. Among personal competencies, flexibility stood
mance criteria were proposed based on the literature and out, especially in consortia and less professionalised markets.
field research. The proposal includes auxiliary methods Among the technical competencies, only a technical vocabulary
and evidence for benchmarking competence perfor- stood out. In the context and business category, emphasis was
mance, process periodicity and responsibilities. given to continuous improvement, strategic alignment, risk
Step 7 Training path identification in tax legislation and customer relationships. For
As a result of the previous steps, a training activity path the junior level, the professional added value by integrating
was suggested for each function and for each level of financial information to support decision-making, and for the
seniority in the SP and FS areas, based on the training senior level, he added value by analysing trends and acting
categories cited by the PMI (2007). preventatively.

Engineer Manager

3% 4%
15%
Financial Planning

19%

26% 27%
Contexto e Negócios Contexto e Negócios
Pessoais Pessoais
Processos Processos
Técnicas Técnicas

56% 50%

9% 8% 8%
Scheduling Planning

13%

Contexto e Negócios Contexto e Negócios


Pessoais Pessoais
Processos 36% Processos
39%
44% Técnicas Técnicas
43%

Fig. 1. Competences by category: financial planning and scheduling planning areas.


790 S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796

Table 4
Most important competences for respondents of financial planning and scheduling planning.
Category Financial planning Scheduling planning
Project management processes Cost; term Scope; term
Personal Flexibility Communication
Technical Technical vocabulary General technical overview; technical drawing
Context and business Continuous management improvement; Customer relationships; continuous
strategic alignment; customer relationships; legislation improvement; strategic alignment

By performing a triangulation of the theoretical framework, junior analyst (12), analyst (7), senior analyst (6) and manager (4).
interviews and documentary analysis, the definitions of compe- The obtained response rate was 94%.
tencies were collected using a model adapted from PMI (2007)
and AIPM (2008) that employs verbs in the description and one 4.3.2. Reliability tests and descriptive statistics
or more performance criteria. For each criterion, at least one For competencies with more than one performance criterion,
excerpt from the interviews was registered that substantiated its Cronbach's alpha test was performed, and two cases with alpha
elaboration. values of less than 0.7 were identified: 1.4. Applies and adapts
There was no personal competence identified in SP that had techniques and tools for time management in SP and 4.1.
not been considered in FP; therefore, the Dictionaries of Promotes continuous management improvement for both areas;
Competencies remained equal in this category. therefore, their criteria were analysed as separate competencies.
A feedback meeting following the development of the first In the descriptive analysis, the calculation of the average per
version of the Dictionary of Competencies was held with the competence per category resulted in the current proficiency
interviewees, and then a final validation with the responsible framework (see an excerpt in Fig. 3).
PMO occurred, resulting in the final version.
The list of competencies in Table 5 summarizes the results
obtained in this step. 4.3.3. Differentiating competencies
To identify competencies that differentiate between categories,
4.2. Relationships between experiences and competencies Mood's median test was applied to the categories in pairs (e.g.
intern vs. junior analyst) for each competence, thus obtaining the
From the answers provided in the situational interviews, chart shown as in Fig. 4 (for SP). The competencies with p-values
experiences and developed competencies were related using the less than 0.05 are indicated, demonstrating significant differences.
software C-map to construct conceptual maps (see the excerpt In the transition from a junior analyst in SP to a full analyst,
in Fig. 2). there is an evolution in interpretation of deviations and trends;
In both areas, participation in commercial proposals lead to holistic and systemic views; leadership; critical analysis and
agility and the capacity to address uncertainty, as activities had to customer relationship competencies, which is consistent with
be performed in a short time and with scarce data. Operations that an increased role on the front line and accumulated experience.
included the whole life cycle (engineering, procurement, con- In the transition to the senior level, context and business
struction) contributed to the development of flexibility, emotional competencies differ from other groups (consistent with the
intelligence, risk management and adaptation strategies in the case panel of experts), in addition to a better understanding of the
of a diversity of practices associated with the higher complexity of interdependencies between technical areas, working in scope
this type of project, particularly in the presence of partners from changes, autonomy in the analysis of trends and responsibility
different organisational cultures. for time management.
For junior professionals, acquiring greater autonomy is a
critical experience that can occur in low-complexity projects or 4.3.4. Differentiating experiences
specific parts of the scope. In SP, working on the construction site Mood's median test was applied to determine if a group that
is an essential experience for the development of competencies, had undergone certain experiences was significantly more
whereas there is no such association in FP. proficient in each competence when compared to others.
It was found, for instance, that in SP, PMPs® were not more
4.3. Results of the self-assessment questionnaire proficient in the process competencies, in contrast to what was
observed in FP. More developed competencies were consis-
4.3.1. Sample characterisation tently observed for those who had participated in proposals,
The SP area has 44 professionals, 32% with PMP certification because they are required to negotiate with the client, develop
and 5% with Certified Associate in Project Management (CAPM) the first schedule with a high degree of uncertainty in a short
certification. The professionals were divided into six categories: time, use political competencies and customise to the practices
intern (4), assistant (7), junior analyst/engineer (8), analyst/ of partners and customers. The importance of experience on
engineer (12), senior analyst/engineer (7) and manager (6). A construction sites was confirmed. There was no relationship
response rate of 87% was obtained. The FP population (31 observed between acting as an engineering, procurement and
professionals) was divided into 5 categories: intern/assistant (5), construction (EPC) project executor and delegation, scope
Table 5
The list of competences.
Group Financial planning competences Scheduling planning competences
Project management 1.1. Contributes to budget review and control, resource plan and cash flow 1.1. Contributes to the development of the EAP
processes 1.2. Interprets and provides deviations and trends of costs and funding and acts to prevent or 1.2. Develops the project schedule
reduce financial impacts on the project 1.3. Contributes to the control of physical progress and the project schedule
1.3. Supports the scope control of the project 1.4. Applies and adapts techniques and tools for time management

S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796
1.4. Plans and implements the financial and tax management process 1.5. Interprets and foresees term deviations and trends and acts to avoid or reduce impacts
1.5. Selects and communicates the financial status of the project to stakeholders on the project schedule
1.6. Contributes to the identification, analysis, quantification and planning of the project risks 1.6. Supports the scope control of the project
and opportunities response 1.7. Manages information and communicates the project status to stakeholders
1.7. Contributes to the development and consolidation of the project budgeting 1.8. Contributes to the risk and opportunity management in the project schedule
1.8. Adapts the cost management in consortium situations 1.9. Guides the team integration for the project scope delivery
1.9. Performs the processes of operation closure 1.10. Plans and makes deliveries of the FEL® methodology viable
1.10. Assumes responsibility for the project cost management 1.11. Performs critical analyses/audits of the project time management
1.12. Assumes responsibility for the project time management
Technical 3.1. Achieves a general technical view of the project and makes interactions with technical staff 3.1. Achieves a general technical view of the project and makes interaction with technical
easier staff easier
3.2. Understands technical subjects for project term management
Personal 2.1. Holistic view Same as financial planning
2.2. Interpersonal relationships and teamwork
2.3. Conceptual thinking
2.4. Analytical thinking
2.5. Negotiation and conflict resolution
2.6. Leadership
2.7. Emotional intelligence
2.8. Creativity and entrepreneurship
2.9. Team building and management
2.10. Ease with technology
2.11. Delegation
2.12. Knowledge and learning
2.13. Communication
2.14. Systemic view
2.15. Ability to address uncertainty
2.16. Attention to details
2.17. Critical analysis
2.18. Agility
2.19. Flexibility and adaptability
2.20. Resiliency
2.21. Political
Context and business 4.1. Promotes continuous management improvement 4.1. Promotes continuous management improvement
4.2. Ensures the alignment between the project objectives and the organisation's strategy 4.2. Ensures the alignment between the project objectives and the organisation's strategy
4.3. Establishes mutual trust relationships with the customers and helps to promote their fidelity 4.3. Establishes mutual trust relationships with the customers and helps to promote their
4.4. Understands the legislation related to the project, protecting it from legal exposures and fidelity
taking advantage of tax benefits 4.4. Establishes appropriate management strategies in situations of diversity of stakeholders
4.5. Establishes appropriate management strategies in situations of diversity of stakeholders

791
792 S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796

Fig. 2. Relationships between experiences and competences: scheduling planning. Legend:

1.1 EAP development 2.2 Interpersonal relationships 2.15 Ability to address uncertainty F.S.: Feasibility Study
1.2 Schedule development 2.3 Conceptual thinking 2.16 Attention to detail EPC exec.: Engineering
1.3 Progress control 2.4 Analytical thinking 2.17 Critical analysis Procurement and
1.4 Application 2.5 Negotiation and 2.18 Agility Construction as main
techniques and tools conflict resolution 2.19 Flexibility and adaptability executor
1.5 Trend analysis 2.6 Leadership 2.20 Resiliency PM: Project Manager
1.6 Scope control 2.7 Emotional intelligence 2.21 Political Improve.: Improvement
1.7 Information management 2.8 Creativity and 3.1 General technical view Commerc.: Commercial
1.8 Risk management entrepreneurship 3.2 Technical interdependences Consorti.: Consortium
1.9 Team guidance 2.9 Team building and 4.1 Continuous management improvement
1.10 FEL deliveries management 4.2 Strategic alignment
1.11 Critical analysis 2.10 Ease with 4.3 Customer relationships
of projects technology 4.4 Practice adaptation strategies in the
1.12 Time management 2.11 Delegation case of diversity of stakeholders
responsibility 2.12 Knowledge and
2.1 Holistic view learning
2.13 Communication
. 2.14 Systemic view

control and resiliency competencies, which are associated with compare the assessment of a professional with the expected
the high degree of complexity and the scope. profile for both the professional's current category and the next
level up.
4.3.5. Expected profile and gap analysis Note that the intern in Fig. 5 already has all the competencies
With the current profile of the employees and the aid of area for his category, but in relation to what is expected from a junior
coordinators, the expected profile for each category was defined, engineer, he needs training to develop the project schedule under
and using this profile, graphical gap analyses were performed. guidance (1.2), control progress and schedule (1.3), manage and
Fig. 5 illustrates both the expected profile and gap analysis by communicate status information (1.7) with autonomy, improve
subtracting the minimum expected grade obtained for each interpersonal relationships (2.2) and agility (2.18) competencies.
observation and summing this value. An interesting practice is to Following the analysis of the relationships between experiences
S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796 793

Fig. 3. Average of competences per category: scheduling planning (excerpt).

and competencies, it would be recommended allocate the intern project is suggested (performed by another senior professional
responsible for the control of a specific area of the project, such as from the same area). In this case, the evaluator did not spend a
procurement (competencies 1.2, 1.3, 1.7), and to involve him in long time with the assessed member, and auxiliary evidence
the planning processes (1.2, 2.18) under guidance. (primarily documents) was proposed for validation, as suggested
by PMI (2007) and AIPM (2008). For the personal competencies,
4.4. Evaluation process and training paths benchmarking should be based on examples and feedbacks. It is
suggested that the evaluations be performed at the end of each
A medium rigour assessment, which was inspired by the project phase to strengthen the relationships between experiences
IPMA (2006), is proposed in two stages. To the senior members, and competencies.
who in general answer to the project manager (who is not from By relating the Dictionary of Competencies, the relation-
the SP/FP area), validation during the critical analysis of the ships between experiences and competencies and the expected

Fig. 4. Differentiating competences (scheduling planning). Legend:

1.1 WBS development 2.23 Interpersonal relationships 2.36 Ability to address uncertainty
1.2 Schedule development 2.24 Conceptual thinking 2.37 Attention to detail
1.3 Progress control 2.25 Analytical thinking 2.38 Critical analysis
1.4 Application techniques and tools 2.26 Negotiation and conflict resolution 2.39 Agility
1.5 Trend analysis 2.27 Leadership 2.40 Flexibility and adaptability
1.6 Scope control 2.28 Emotional intelligence 2.41 Resiliency
1.7 Information management 2.29 Creativity and entrepreneurship 2.42 Political
1.8 Risk management 2.30 Team building and management 3.3 General technical view
1.9 Team guidance 2.31 Ease with technology 3.4 Technical interdependences
1.10 FEL deliveries 2.32 Delegation 4.5 Continuous management improvement
1.11 Critical analysis of projects 2.33 Knowledge and learning 4.6 Strategic alignment
1.12 Time management responsibility 2.34 Communication 4.7 Customer relationships
2.22 Holistic view 2.35 Systemic view 4.8 Practice adaptation strategies in the case of diversity of stakeholders.
794 S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796

profile, a training activity path was prepared for each category The complement of the field research methods, inspired by
in SP (Fig. 6). For the process competencies, the following the work of Dainty et al. (2005), Rose et al. (2007) and Grant,
logic was applied: Baumgardner and Shane (1997), was important for capturing
the specificities of the organisation, which were reflected in the
proposed competence map and provided the coordinators and
• Competence performed under guidance: e-learning and man-
professionals of the area with a sense of ownership of the
ager support (coaching), on-the-job training under guidance.
results, in addition to maintaining strategic alignment. The
• Competence performed with autonomy: simulation/role-
iterative validation process with those responsible for the areas
playing and on-the-job training with autonomy.
was also crucial for the involvement of the interested parties
• Competence performed by coordinating its execution: prep-
and the acceptance of the proposed competence framework.
aration of the simulations, offering coaching and on-the-job
Because competence is a highly sensitive subject related to the
training leading the team.
career development of professionals, allocation in projects,
post-assignment and seniority degree, and the development of the
5 . Conclusions competency framework from academic-scientific references and
methods proved very positive for the maintenance of impartiality
It was observed that the adopted concept of individual com- and for enhancing confidence in the results. Another positive point
petence received wide acceptance among the people involved and of this methodology is its reproducibility in other project
enabled clarification regarding the subject, which was poorly management knowledge areas.
understood by the organisation's project management profes- The primary issue that deserves further exploration is the
sionals. The literature content analysis and the frameworks from relationship between competencies and the specific contexts in
international institutions on project management (AIPM, 2008; which they are performed, considering complexity as a multi-
IPMA, 2006 and PMI, 2007) have provided a conceptual and plicative factor in the performance assessment. A competence
structural basis. A diagram of affinities was used to create the performed by a junior professional in a less complex context
competency clusters, resulting in four categories of competencies: (for example, a small-size project) may not be performed with
project management, personal, technical, context and business the same proficiency in more complex scenarios. The very
processes. process of the proposed competence assessment can provide

Fig. 5. Template for expected profile and gap analysis.


S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796 795

Fig. 6. Training path (scheduling planning — excerpt). Legend:

1.1 WBS development 2.2 Interpersonal 2.15 Ability to address uncertainty EPC: Engineering Procurement and Construction
1.2 Schedule development relationships 2.16 Attention to details PMP: Project Management Professional®
1.3 Progress control 2.3 Conceptual thinking 2.17 Critical analysis WBS: Work Breakdown Structure
1.4 Technique and tool 2.4 Analytical thinking 2.18 Agility
application 2.5 Negotiation and conflict 2.19 Flexibility and adaptability
1.5 Trend analysis resolution 2.20 Resiliency
1.6 Scope control 2.6 Leadership 2.21 Political
1.7 Information 2.7 Emotional intelligence 3.1 General technical view
management 2.8 Creativity and 3.2 Technical interdependencies
1.8 Risk management entrepreneurship 4.1 Continuous management
1.9 Team guidance 2.9 Team building and improvement
1.10 FEL deliveries management 4.2 Strategic alignment
1.11 Critical analysis of 2.10 Ease with technology 4.3 Customer relationships
projects 2.11 Delegation 4.4 Practice adaptation strategies in case
1.12 Time management 2.12 Knowledge and learning of diversity of stakeholders
responsibility 2.13 Communication
. 2.1 Holistic view 2.14 Systemic view

subsidies for this development, because it suggests that Scientific and Technological Development — 306734/2010-9)
performance assessments are tied to the end of each project and FAPESP (São Paulo Research Foundation — 2014/07590-0)
phase, which can be classified in terms of complexity.
Some aspects of the research design limit the generalisation
of the findings. First, it involved an engineering and References
construction project, and new studies should be conducted
for other types of projects and sectors. Second, the focus is on a Ahsan, K., Ho, M., Khan, S., 2013. Recruiting project managers: a comparative
specific organisation, and its characteristics also conditioned analysis of competencies and recruitment signals from job advertisements.
Proj. Manag. J. 44 (5), 36–54.
the findings. However, as suggested by Karlsson (2002), the AIPM. Australian Institute of Project Management, 2008. Professional Compe-
deep insight on the field is rather unique in action research, tency Standards for Project Management. AIPM, Sidney.
which can compensate for a lack of generalizability. Akogbe, R.K.T., Feng, X., Zhou, J., 2013. Importance and ranking evaluation
of delay factors for development construction projects in Benin. KSCE J.
Civ. Eng. 17 (6), 1213–1222.
Conflict of interest Barney, J., 1991. Firm resources and sustained competitive advantage. J.
Manag. 17 (1), 99–120.
Bloom, N.L., 1989. Select The Right Manager For Success. Pers. J. 68 (8),
None.
77–80.
Boyatzis, R.E., 1992. The Competent Manager. Wiley, New York.
Acknowledgements Bredin, K., Soderlund, J., 2013. Project managers and career models: an exploratory
comparative study. Int. J. Proj. Manag. 31 (6), 889–902.
Brill, J.M., Bishop, M.J., Walker, A.E., 2006. The competencies and characteristics
The authors gratefully acknowledge the financial support of the required of an effective project manager: a web-based Delphi study. Educ.
Brazilian research funding agencies CNPq (National Council for Technol. Res. Dev. 54 (2), 115–140.
796 S.M. Takey, M.M. Carvalho / International Journal of Project Management 33 (2015) 784–796

Bryman, B., Bell, E., 2011. Business Research Methods, 3rd ed. Oxford Le Boterf, G., 1995. De la compétence — essai sur un attracteur étrange. Les
University Press, Oxford. éditions d'organisations. Quatrième Tirage, Paris.
Campion, M.A., Fink, A.A., Ruggenberg, B.J., Carr, L., Phillips, G., Odman, R. Lewin, K., 1946. Action Research and Minority Problems. J. Soc. Issues 2 (4),
B., 2011. Doing competencies well: best practices in competency modeling. 34–46.
Pers. Psychol. 64 (1), 225–262. Mcclelland, D.C., 1973. Testing for competence rather than for “intelligence”.
Carvalho, M.M., 2014. An investigation of the role of communication in IT Am. Psychol. 28, 1–14 (January).
projects. Int. J. Oper. Prod. Manag. 34 (1), 36–64. Mirabile, R., 1997. Everything you wanted to know about competency
Chipulu, M., Neoh, J.G., Ojiako, U., Williams, T., 2013. A multidimensional modeling. Train. Dev. 51 (8), 73–77.
analysis of project manager competences. IEEE Trans. Eng. Manag. 60 (3), Müller, R., Turner, J.R., 2010. Attitudes and leadership competences for project
506–517. success. Balt. J. Manag. 5 (3), 307–329.
Clarke, N., 2010a. Emotional intelligence and its relationship to transforma- Prahalad, C.K., Hamel, G., 1990. The core competence of the corporation.
tional leadership and key project manager competences. Proj. Manag. J. 41 Harv. Bus. Rev. 66 (May–June), 79–90.
(2), 5–20. Project Management Institute, 2004. Project Management Body of Knowledge,
Clarke, N., 2010b. The impact of a training programme designed to target the 3rd ed. Project Management Institute, Newton Square.
emotional intelligence abilities of project managers. Int. J. Proj. Manag. 28 Project Management Institute, 2007. Project Manager Competency Develop-
(5), 461–468. ment (PMCD) Framework, 2nd ed. Project Management Institute, Newton
Cleland, D.I., King, W.R., 1983. Systems analysis and project management. Mc Square.
Graw Hill, New York. Project Management Institute, 2008. Project Management Body of Knowledge,
Coghlan, D., 2007. Insider action research: opportunities and challenges. 4th ed. Project Management Institute, Newton Square.
Manag. Res. News 30 (5), 335–343. Rose, J., Pedersen, K., Hosbond, J., Krammergaard, P., 2007. Management
Coughlan, P., Coghlan, D., 2002. Action research for operations management. competences, not tools and techniques: a grounded examination of software
Int. J. Oper. Prod. Manag. 22 (2), 220–240. project management at WM-data. Inf. Softw. Technol. 49 (6), 605–624.
Crawford, L., 1998. Project management for strategy realisation. In: Hauc, A., Ruas, R.L., et al., 2005. Aprendizagem Organizacional e Competências.
Kovac, R., Rozman, B., Semolic, A., Skarabot, A. (Eds.), Proceedings 14th Bookman, Porto Alegre.
World Congress on Project Management. International Project Management Saunders, M., Lewis, P., Thornill, A., 2007. Research Methods for Business
Association and Slovenian Project Management Association, Ljubljana, Students, 4th ed. Pearson Education Limited, Harlow, Essex.
Slovenia, pp. 10–21. Seppänen, V., 2002. Evolution of competence in software contracting projects.
Dainty, A.R.J., Asce, M., Cheng, M.-I., Moore, D.R., 2005. Competency-based Int. J. Proj. Manag. 20 (2), 155–164.
model for predicting construction project managers' performance. J. Manag. Singhal, K., Singhal, J., 2012a. Imperatives of the science of operations and
21 (2), 2–9. supply-chain management. J. Oper. Manag. 30 (3), 237–244.
Duriau, V.J., Reger, R.K., Pfarrer, M.D., 2007. A content analysis of the Singhal, K., Singhal, J., 2012b. Opportunities for developing the science of
content analysis literature in organization studies: research themes, data operations and supply chain management. J. Oper. Manag. 30 (3), 245–252.
sources, and methodological refinements. Organ. Res. Methods 10 (1), Skulmoski, G.J., Hartman, F.T., 2010. Information systems project manager
5–34. soft competencies: a project-phase investigation. Proj. Manag. J. 41 (1),
Edum-Fotwe, F., Mccaffer, R., 2000. Developing project management 61–77.
competency: perspectives from the construction industry. Int. J. Proj. Spencer, L.M., Spencer, S.M., 1993. Competence at Work: Models for Superior
Manag. 18 (2), 111–124. Performance. John Wiley & Sons, New York.
Eisenhardt, K.M., Graebner, M.E., 2007. Theory building from cases: Starkwheather, A., Stevenson, D.H., 2011. PMP® certification as a core
opportunities and challenges. Acad. Manag. J. 50 (1), 25–32. competency: Necessary but not sufficient. Proj. Manag. J. 42 (1), 31–41.
Fleury, M.T., Fleury, A., 2001. Construindo o conceito de competência. Revista Stevenson, D.H., Starkweather, J.A., 2010. PM critical competency index: IT
de Administração Contemporânea 5 (spe), 183–196. execs prefer soft skills. Int. J. Proj. Manag. 28 (7), 663–671.
Flynn, B.B., Sakakibara, S., Schroeder, R.G., Bates, K.A., Flynn, E.J., 1990. Thamhain, H.J., Wilemon, D.L., 1978. Skill requirements of engineering program
Empirical research methods in operations management. J. Oper. Manag. 9 managers. In: Convention Record, 26th Joint Engineering Management
(2), 250–284. Conference.
Grant, K.P., Baumgardner, C.R., Shane, G.S., 1997. The perceived importance Varajao, J., Cruz-Cunha, M.M., 2013. Using AHP and the IPMA competence
of technical competence to project managers in the defense acquisition baseline in the project managers selection process. Int. J. Prod. Res. 51 (11),
community. IEEE Trans. Eng. Manag. 44 (1), 12–19. 3342–3354.
IPMA, International Project Management Association, 2006. ICB — IPMA Voss, C., et al., 2002. Case Research in Operations Management. Int. J. Oper.
Competence Baseline. International Project Management Association, Prod. Manag. 22 (2), 195–219.
Nijkerk (Third version). Zarifian, P., 1996. A gestão da e pela Competência. Seminário Internacional
Jaafar, M., Othman, N.L., 2013. Personal competency of selected women Educação Profissional, Trabalho e Competências. CIET — Centro
construction project managers in Malaysia. J. Eng. Des. Technol. 11 (3), 3. Internacional para a Educação. Trabalho e Transferência de Tecnologia,
Karlsson, C., 2002. Guest editorial of IJOPM special issue on research Rio de Janeiro.
methodology in operations management. Int. J. Oper. Prod. Manag. 22 (2),
141–147.

You might also like