You are on page 1of 12

International Journal of Public Administration

ISSN: 0190-0692 (Print) 1532-4265 (Online) Journal homepage: http://www.tandfonline.com/loi/lpad20

Linking Organizational Climate to Work


Engagement: A Study in the Healthcare Sector

Alessandro Ancarani, Carmela Di Mauro & Maria Daniela Giammanco

To cite this article: Alessandro Ancarani, Carmela Di Mauro & Maria Daniela Giammanco
(2018): Linking Organizational Climate to Work Engagement: A Study in the Healthcare Sector,
International Journal of Public Administration, DOI: 10.1080/01900692.2018.1491595

To link to this article: https://doi.org/10.1080/01900692.2018.1491595

Published online: 10 Jul 2018.

Submit your article to this journal

Article views: 8

View Crossmark data

Full Terms & Conditions of access and use can be found at


http://www.tandfonline.com/action/journalInformation?journalCode=lpad20
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION
https://doi.org/10.1080/01900692.2018.1491595

Linking Organizational Climate to Work Engagement: A Study in the Healthcare


Sector
Alessandro Ancarania, Carmela Di Mauro a
, and Maria Daniela Giammanco b

a
D.I.C.A.R., Università di Catania, Catania, Italy; bDipartimento di Scienze Politiche e Sociali, Università di Catania, Catania, Italy

ABSTRACT KEYWORDS
Using a two-level structural equation approach, this article investigates the links between orga- Healthcare; public sector;
nizational climate and work engagement in a sample of public hospitals in Italy. Drawing from the work engagement;
Job Demands-Resources model, the model posits a positive association between work engage- organizational climate;
human resources
ment and a climate promoting worker’s autonomy, empowerment, and well-being, whereas it
suggests that a climate based on efficiency and goal attainment is not favorable for engagement.
Results support the hypotheses and suggest that performance based models implemented in
recent years as part of public sector reforms are not conducive to engaged workers. Implications
for research on work engagement in the public sector and for public management are drawn.

Introduction
Bakker, 2003), such as energy and mental resilience, strong
In the last decade, the growing interest in the link involvement matched with feelings of significance, and
people-performance in public administration has put great concentration and happy interest at work. Empirical
the quality of the work environment and human research shows that engaged workers improve both their
resource management at the top of the research agenda in-role and extra-role behavior (Salanova, Lorente,
(Lowe, 2012; West & Dawson, 2012). Organization Chambel, & Martinez, 2011). Further, work engagement
members’ happiness and well-being are at the core of enhances revenues (Xanthopoulou, Bakker, Demerouti, &
Positive Organizational Behavior, which explores the Schaufeli, 2009), the quality of governmental services
mechanisms through which organizational perfor- (MacLeod & Clarke, 2011), safety outcomes (Nahrgang,
mance can flourish (Luthans, 2002). The adoption of Morgeson, & Hofmann, 2011), customer satisfaction
a positive perspective has driven the attention to the (Salanova, Agut, & Peirò, 2005), and creativity (Michel,
linkages between workers’ positive states (engagement, Wayne, & Liao, 2015).
satisfaction, motivation, happiness, among others) and The healthcare sector represents an interesting arena
measures of organizational performance (growth, cus- for the study of workers’ engagement and its organiza-
tomer satisfaction and loyalty, productivity, and so tional antecedents, as hospitals are paradigmatic exam-
forth). From this perspective, the identification of the ples of high-contact services in which the interaction
organizational drivers (e.g. culture, climate, relations patient-medical personnel is at the heart of the delivery
with supervisors’, and co-workers) that make employ- process. Because of the span and intensity of patients’
ees thrive (Cameron & Caza, 2004) is extremely encounter with nurses and physicians, it is likely that
relevant. workers’ engagement not only positively affects perfor-
One of the positive constructs that has received high mance measures, such as productivity or profitability,
consideration by academics and managers alike is work but also on patients’ perceived quality and satisfaction
engagement (Schaufeli, Salanova, Gonzalez-Roma, & (Goldstein, 2003). Consequently, it is of crucial interest
Bakker, 2002), a positive psychological state characterized for hospital management to understand how to activate
by Vigor, Dedication, and Absorption at work. Though and sustain high levels of employees’ engagement, by
work engagement might recall the constructs of involve- identifying context specific drivers of engagement. In
ment and commitment, it additionally entails enduring this direction, “job resources” have been identified as
and pervading emotional-cognitive states (Schaufeli & key drivers of work engagement in both the private and

CONTACT Alessandro Ancarani alessandro.ancarani@unict.it; cdmauro@unict.it Università di Catania, DICAR, Viale A. Doria, 6 -, Cittadella Building
10, Catania, 95125 Italy.
Color versions of one or more of the figures in the article can be found online at www.tandfonline.com/lpad.
© 2018 Taylor & Francis Group, LLC
2 A. ANCARANI ET AL.

public sector (Bakker, 2015). The definition of job and protocols across hospital specialties, and in accor-
resources encompasses any job feature promoting indi- dance with previous literature (Ancarani, Di Mauro, &
vidual progress and job competences, and meeting the Giammanco, 2011; Marinova, Ye, & Singh, 2008), this
employees’ demand for self-determination and compe- study measures the engagement of physicians and
tence, as well as their need to feel part of the organiza- nurses by aggregating individual perceptions at ward
tion (Bakker & Demerouti, 2007; Schaufeli & Bakker, level.
2004). For illustration, job resources include the avail- Results show that the HR model is positively related
ability of information, leader’s recognition, opportu- to work engagement, while the effect of RG is insignif-
nities of training, professional growth, and shared icant. These results are of interest from both a theore-
decision making (Tuckey, Bakker, & Dollard, 2012). tical and an organizational perspective. Theory-wise,
In contrast to job resources, “job demands” refer to the article contributes by furthering the understanding
characteristics of the job calling for continuous strain of the role of job resources in public sector organiza-
or ability, and entailing physical and mental exertion. tions. In particular, it clarifies whether a climate
Organizational climate, intended as the shared per- oriented to workers’ growth and well-being can be
ception of policies, procedures, and practices that are considered a job resource within public organizations.
acceptable at work (Denison, 1996), has been recog- From a managerial perspective, since climate is gener-
nized as one of the job resources that may support ally considered actionable and potentially steered by
engagement. In particular, organizational climates that management, results highlight the role that hospital
satisfy workers’ need for advancement, self-fulfilment, managers can play in fostering work engagement. In
and job realization are expected to foster work engage- addition, while an RG model may be beneficial to
ment (Bakker & Demerouti, 2007). In spite of the public organizations in terms of improved efficiency
posited link between a climate model that promotes and productivity in service provision, it may need to
workers’ well-being, growth, and empowerment within be complemented with other aspects promoting human
the organization and work engagement, the empirical resource motivation and growth.
exploration of this relation is still a missing gap in the An additional managerial implication stems from
literature. In fact, although the impact of specific facets the analysis of the hospital ward as the locus of orga-
of workplace climate that may support work engage- nizational climate. Heads of ward/specialty can leverage
ment (social climate, innovative climate, supporting on climate to promote engagement at the work group
climate) have been documented (Bakker, Demerouti, level. This “communal” engagement might assist the
& Verbeke, 2004; Bakker, Hakanen, Demerouti, & creation of a mutual intention and cohesiveness, and
Xanthopoulou, 2007; Hakanen, Bakker, & Schaufeli, involve team members in a sort of “group mind” that
2006; Nahrgang et al., 2011), what is missing is the might be activated in order to pursue and achieve
study of the relation between work engagement and a organizational objectives (Ashforth & Humphrey,
theory-grounded and well-validated model of climate 1995).
oriented to human resource growth and empowerment. The article is organized in five sections. The following
In order to fill this gap, drawing from a well-known section sets the theoretical background of the investiga-
taxonomy of organizational climate models, the tion: it explores the concept of work engagement, and
Competing Value Framework (CVF) (Patterson et al., discusses its organizational antecedents, giving emphasis
2005; Quinn & Rohrbaugh, 1983), this article empiri- to organizational climate as a source of job resources and
cally investigates the links between work engagement job demands. The next section presents the organizational
and two models of organizational climate, namely the context at study and the hypotheses tested. Then, the
Human Relations (HR henceforth) and its polar oppo- paper describes the sample characteristics, the measures
site, the Rational Goals (RG henceforth). The former employed to assess work engagements and organizational
model emphasizes worker’s empowerment, growth, and climate, and the Multilevel methodology adopted. The
training and can be posited to engender higher worker final section is devoted to the presentation of the results,
engagement. The RG model contrasts with HR, as it the discussion, and the limitations of the study.
focuses on productivity and goal-achievement. In this
latter model, job demands are expected to predominate
over the provision of job resources. Therefore, the RG Theoretical background
model of climate is not expected to support employees’
Work engagement
engagement.
The organizational context of the study is the Italian Schaufeli et al. (2002) define work engagement as a
public hospital care. Given the diversity of procedures positive, rewarding psychological state that might recall
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 3

the constructs of involvement and commitment, but each organization, namely, job demands and job
which is additionally characterized by high activity resources. Job demands are tangible, psychological,
and endurance, great concentration and happy interest social, and organizational features of the job that
at work. Work engagement is associated with feelings involve permanent, physical and mental stress, and
of significance, keenness, passion, motivation, and grat- cause physical, cognitive and emotional effort (work-
ification, and it indicates an enduring emotional- load, difficult and mentally taxing work, tension and
inspirational state, rather than a momentary and spe- difficulties stemming from re-organizations). Job
cific emotional condition (Bakker, 2015). resources are job features that promote individual pro-
While Maslach and Leiter (1997) purported the idea gress and increase job competence and – by offering
of engagement as being the antipode of burnout, con- decision space and facilitating cooperation – meet the
versely, Shaufeli et al. (2002) assert that the worker who employees’ demand for self-determination and compe-
goes through low burnout must not be necessarily tence, as well as their need to feel part of the organiza-
highly engaged, and vice versa. Therefore, they advo- tion (Bakker & Demerouti, 2007; Schaufeli & Bakker,
cate the uniqueness and independence of the two con- 2004).
structs of burnout and engagement and, consequently, Job resources stimulate positive organizational
develop, and test a new scale, the Utrecht Work achievements either by fostering employees’ personal
Engagement Scale (UWES), including three compo- development, competence, and proficiency or by favor-
nents: vigor, dedication, and absorption at work ing the achievement of job tasks. When job resources
(Schaufeli & Bakker, 2003; Schaufeli, Bakker, & contribute to employees’ individual progress, they
Salanova, 2006). The UWES encompasses and unifies satisfy workers’ quest for self-determination, signifi-
diverse positive psychological states relevant for human cance, and adequacy, as suggested by self-determina-
resource management: vigor entails dynamism, dedica- tion theory (Ryan & Deci, 2000). When job resources
tion recalls commitment, and absorption evokes invol- are instrumental to the accomplishment of job tasks,
vement. However, work engagement is a broader their function can be interpreted in the perspective of
construct including a holistic investment of the worker the effort-recovery theory (Meijman & Mulder, 1998),
identity in the work-role, concerning her/his intellec- according to which a workplace characterized by high
tive, affective, and physical sphere (Maslach, Schaufeli, resources promotes workers’ motivation. Hence, peer
& Leiter, 2001). Conversely, commitment is character- and manager support, acknowledgement and advice
ized by an emotive connection to the principles, prac- concerning the job task, autonomy, and professional
tices, and behavioral codes of the organization growth opportunities act as job resources (Demerouti,
(Mowday, 1999), while involvement focuses on work- Bakker, Nachreiner, & Schaufeli, 2001). In fact, con-
ers’ mental effort to preserve their job identities (Rich, structive criticism and advice encourage discernment
Lepine, & Crawford, 2010), and on facets of the job and enhance job capability, whereas autonomous deci-
related to the satisfaction of the workers’ personal sion and social support satisfy, respectively, the needs
needs (Christian, Garza, & Slaughter, 2011). for autonomy and the need to belong.
The work of Shaufeli and colleagues has stimulated a The positive relationship between job resources and
flourishing stream of literature pivoting around the work engagement is supported by the empirical litera-
work engagement construct. Its antecedents and con- ture (Bakker, 2015; Crawford, LePine, & Rich, 2010).
sequences have been explored, showing that the orga- Schaufeli and Bakker (2004) suggest a positive correla-
nizational predictors of work engagement overshadow tion among three job resources, namely, performance
individual factors and personal characteristics, because feedback, supportive work environment, supervisor’s
work engagement is contingent to the job experience counseling, and all the dimensions of engagement.
(Bakker, Schaufeli, Leiter, & Taris, 2008). Koyuncu, Burke, and Fiksenbaum (2006) show that
autonomy, incentives and acknowledgement predict
all the three dimensions of work engagement. Llorens,
Organizational antecedents of work engagement:
Bakker, Schaufeli, and Salanova (2006) illustrate that
the role of job resources
job resources (autonomy, peer support, and perfor-
The theoretical and empirical support for the relation mance feedback) positively affect work engagement.
job resources – work engagement (Bakker, Demerouti, Noesgaard and Hansen (2017) point that engagement
& Sanz-Vergel, 2014; Schaufeli & Bakker, 2004) is is influenced by work features, such as support from
rooted in the JD-R model. JD-R argues that burnout others.
and work engagement may be the response to two A causal effect of job resources on work engagement
particular categories of job features that characterize is also endorsed by some longitudinal studies that
4 A. ANCARANI ET AL.

investigate job resources such as autonomy and orga- them to support subordinates to accomplish personal,
nization-based self-esteem (Mauno, Kinnunen, & group, and eventually organizational goals (Perryer &
Ruokolainen, 2007), co-worker support, autonomy, Jordan, 2005).
performance feedback, and opportunity for personal The extant literature has posited and provided
growth (Hakanen, Perhoniemi, & Toppinen-Tanner, empirical evidence that some domain-specific climates
2008; Schaufeli, Bakker, & Van Rhenen, 2009). are linked with work engagement. For instance, a social
Meta-analyses by Halbesleben (2010) and Christian climate (comfortable and relaxed workplace), an inno-
et al. (2011) confirm that job resources are the major vative climate (supporting continuous improvement)
antecedents of engagement, and that job demands are (Hakanen et al., 2006), a supporting climate (encoura-
usually negatively linked to engagement. Nevertheless, ging and supporting new ideas) (Bakker et al., 2007), a
as far as the effect of job demands on engagement is “team” climate (Bakker et al., 2004), and a safety cli-
concerned, Bakker et al. (2014) stress the need for mate (Nahrgang et al., 2011) are positively related to
differentiating between job demands that are perceived work engagement, and therefore can ex post be ratio-
by workers as hurdles and job demands considered as nalized as job resources. Although the above findings
challenges. While the former are expected to unam- strengthen the idea that specific facets of climate may
biguously hinder work engagement, the latter (e.g., predict work engagement, this knowledge has devel-
workload and work time pressure) may positively affect oped unsystematically. This is partly due to the use of
engagement, if coupled with adequate job resources approaches for the measurement of climate that are not
(Bakker et al., 2007). grounded in a well-established theory.
An influential contribution providing a taxonomy of
organizational climate models is the Competing Values
Organizational climate as job resource
Framework (CVF), developed by Quinn and Rohrbaugh
Organizational climate encompasses the collective view (1983). The CVF embodies diverse managerial theories
of what behaviors are considered acceptable and hence and identifies competing values matching paradigmatic
rewarded within an organization. It is the expression of dilemmas within organizations. The first dilemma con-
embedded cultural aspects (principles, views, and con- cerns the focus on internal environment and inner pro-
victions), and the manifestation of combined individual cesses versus external environment and external
mind-sets and actions within an organization (Denison, stakeholders relationships (e.g. suppliers, customers).
1996). The second one relates to the pre-eminence of control,
A tenet of the JD-R model is that an organizational over resources and processes, versus flexibility. Four dif-
climate that satisfies workers’ need for advancement, ferent organizational models stem from the intersection
self-fulfilment, and job realization fosters work engage- of the value dimensions external/internal focus with con-
ment (Bakker & Demerouti, 2007). In the JD-R frame- trol/flexibility: HR, Open Systems, RG and Internal
work, job resources may be not only valued as such, but Process. Each model, being rooted in a specific set of
also because they are instrumental for obtaining or competing values, has a polar opposite model with dia-
protecting other valuable resources (Bakker et al., metrical emphases (Quinn & Rohrbaugh, 1983). The
2007). From this, it follows that an organizational cli- Human Resource model is the one that best fits the idea
mate based on worker’s empowerment, welfare, and of job resource, as it bestows or protects resources that
professional growth opportunities may be considered have been proved to lead to work engagement (Bakker
as a sort of “second order” resource concerning the et al., 2007). HR encompasses the values of flexibility and
relational sphere, as it generates further resources, internal focus and uses cohesion and morale to achieve
such as leader and co-worker support, exchange of human resources development. Both its means (cohesion
information, and so forth. and moral) and ends (human resource development) can
In this light, the role of the leader as climate builder is be considered resources enhancing work engagement
paramount. As suggested by the Social Exchange Theory (Schaufeli & Bakker, 2004). The RG model represents
(SET) (Blau, 1964), on which JD-R largely builds, a the polar opposite of HR since it builds on external
leader who provides subordinates with specific valuable focus and control, and uses goal setting, planning, and
assets that potentially generate high-quality relation- performance evaluation as means to attain productivity
ships, informs them of desired role behaviors and of and efficiency (Quinn & Rohrbaugh, 1983).
the priority assigned to certain organizational behaviors. While HR bestows a specific set of organizational
In this process, the leader contributes to generating a resources that are expected to be beneficial to engage-
particular organizational climate (Stajkovic & Luthans, ment, the RG climate may or may not be conducive to
1997). Outstanding leaders favor a climate enabling work engagement. On the one hand, RG undeniably
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 5

emphasizes job demands, which are generally nega- care hinges on teamwork delivered by highly profes-
tively related with engagement (Christian et al., 2011; sional personnel (Borrill, West, Carter, & Dawson,
Halbesleben, 2010). On the other hand, it focuses on 2003; Shortell et al., 2001). The existence of strong
goal setting and performance evaluation that may be professional cultures (Gifford, Zammuto, & Goodman,
perceived as “challenging” demands and may therefore 2002; Hofstede, 1980) suggests that a “clan” HR model
enhance engagement, if adequate job resources are (Quinn & Rohrbaugh, 1983) may well represent the
simultaneously provided (Bakker et al., 2014). climate within wards.
At the same time, in the last 20 years, the Italian
National Health Service has undergone a deep reform,
The relation between climate and engagement aimed at improving quality and efficiency. Since the
in public hospitals reform, Italian public hospitals must be run according
to managerial criteria, and are required to break even.
The organizational context: Italian public hospitals
Further, the heads of ward annually bargain with the
The type of organization analyzed and the institutional hospital general management over the targets to be
pressures it is subject to affect the values, norms and achieved (Ancarani et al., 2011; Ancarani, Di Mauro,
behaviors considered acceptable within each workplace. Giammanco, & Giammanco, 2018). The clinical and
This leads to question which organizational climate the financial performance of wards is subject to close
models are expected to apply to the organizational scrutiny and periodic performance evaluation by inter-
context under study, namely Italian public hospitals. nal and external bodies. Hence, legislative reforms have
As part of the Italian National Health Service, public pushed toward the development of an organizational
hospitals represent the main pillar of hospital care in climate that resembles RG, characterized by emphasis
Italy, providing about 75% of the inpatient care. Each on goal setting, productivity, performance improve-
public hospital is made up of Operating Units (OUs) or ment, performance evaluation, and feedback.
wards, mostly overlapping with specialties (e.g. To summarize, HR and RG may plausibly be con-
Cardiology, Orthopedics). Each OU is endowed with sidered the most frequently encountered climate mod-
fully integrated resident medical and nursing personnel els within the Italian public hospital system. The
who, once recruited, forms the permanent staff of the former, because of the predominance of strong profes-
OU. The head of the OU is a physician appointed by sional bureaucracies (physicians and nurses). The latter,
the hospital’s manager for a period of five years. She/he because of the compelling incentive and performance
has managerial responsibilities and enjoys discretionary appraisal mechanisms implemented in the Italian pub-
powers on medical and nursing personnel, beds, and lic health sector since the reform.
equipment (e.g., computerized axial tomography), and
facilities (e.g., operating theatres) (Cabiedes & Guillen,
Hypotheses tested
2001).
Wards provide diversified and specialized health In this section, drawing from the J-DR model, and from
assistance addressing a large variety of patients’ needs. the engagement and climate literatures, two hypotheses
Since co-ordination is a crucial requisite of the health- are put forward. They concern the relation between
care delivery process, an essential part of the ward work engagement and, respectively, the HR and the
manager role is that of co-ordinating the subordinates’ RG climate models. As argued in the preceding sec-
activities in order to fully achieve the ward goals and tions, the adoption of the ward as unit of analysis is
objectives. The ward manager, acting as a leader, is justified by the highly specialized nature of hospitals’
responsible for delivering organizational resources to production processes and, in the Italian context, by the
the ward personnel. In this process, she/he informs ample autonomy of the ward manager.
the latter of the desired organizational behaviors and According to the CVF theory, HR and RG represent
contributes to the development, at the ward level, of competing climate models. HR is focused on inner stake-
mutual ideas and assessments concerning “the way holders’ satisfaction and control, while RG on external
things work here”, and to the promotion of a particular stakeholders’ satisfaction and flexibility in reaching organi-
organizational climate, entailing specific policies, pro- zational goals. Therefore, they reflect opposing means and
cedures, and practices. ends and are likely to affect engagement in different direc-
These features lead to consider wards as loci of stable tions. More central to the focus of the present research, HR
relations, thus supporting the hospital OU as the and RG may be associated with different job resources and
groundwork of organizational climate (Ancarani et al., demands directed to the ward personnel. In particular, the
2011). Further, unlike other public services, hospital constituent features of HR are worker’s welfare and
6 A. ANCARANI ET AL.

autonomy, relevance of training and personal growth, and Methodology


worker’s empowerment through participation in decision-
Sample characteristics
making (Patterson et al., 2005). These may all be unam-
biguously interpreted as job resources (Bakker & Data for model estimation were collected through a
Demerouti, 2007; Schaufeli & Bakker, 2004). Therefore, cross-sectional study. A questionnaire previously
the following hypothesis is formulated: agreed with the hospital management was directly
administered to 494 personnel units (91 physicians
H1: At the hospital ward level, the Human Resources and 403 nurses) in 29 wards belonging to three public
climate is positively associated with work engagement. hospitals in Italy. The three hospitals were chosen so as
to represent organizations of different size, where size
The RG climate emphasizes effort exertion, productiv-
was defined according to the number of hospital beds
ity, and efficiency at work, quality, pressure to produce
(Table 1). The wards involved in the study were
or deliver, goal setting, and performance based apprai-
selected by the research team in collaboration with
sal. Most of the above can be considered as job
the hospital management, with the aim to build a
demands, as they require effort and in certain instances
sample representing a significant variety of specialties.
may give rise to strain and stress at work. In public
Wards with fewer than five staff units, and wards with
organizations, the focus on efficiency may be an impor-
no managerial autonomy (denominated “simple OUs”
tant source of strain. In fact, the quest for more effi-
in the public hospital sector nomenclature) were
ciency is often the result of public sector reforms that
excluded from the study. The average response rate
lead to an increased amount of tasks perceived to be
was around 60%. Ethical approval was granted through
unproductive (e.g. reporting) (Yaya, 2017), while pay-
ad hoc agreements between the University of Catania
ing insufficient attention to cultural change and staff
and each of the three hospitals participating in the
issues (Coram & Burnes, 2001).
research project.
On the other hand, some of the job demands
imposed by RG can be interpreted as “challenges”,
because they are framed as targets to be achieved within Measures
a performance based organizational model (Bakker
et al., 2014). According to Bakker and colleagues, Work engagement
these demands/challenges may promote engagement if Work engagement was assessed through the 9-item
they are coupled with adequate supporting job UWES engagement scale (Schaufeli & Bakker, 2003)
resources (Llorens et al., 2006). encompassing three sub-scales: Vigour (At my work, I
Within the constituent dimensions of RG, the fea- feel bursting with energy; At my job, I feel strong and
tures interpretable as resources are clarity of goals and vigorous; When I get up in the morning, I feel like going
performance feedback. However, this may not be suffi- to work); Dedication (I am enthusiastic about my job; My
cient to back the efforts required by this climate model job inspires me; I am proud of the work that I do);
(Christian et al., 2011), especially if not backed by other Absorption (I feel happy when I am working intensely; I
supportive resources (e.g. financial). Therefore, the fol- am immersed in my work; I get carried away when I am
lowing hypothesis concerning RG is posited: working). Following Schaufeli et al. (2006), the three sub-
scales were graded on a 7-point Likert scale, and showed
H2: At the hospital ward level, the Rational Goal climate satisfactory internal consistency: Vigor (α = 0.885),
is negatively associated with work engagement. Dedication (α = 0.882), and Absorption (α = 0.841).

Table 1. Sample characteristics (3 Hospitals; 29 wards; 494 respondents).


Age
Beds Wards Wards involved in the study Respondents (36–55 years) Physicians
Hospital 1 921 47 15 258 166 52
(large size)
Hospital 2 367 20 10 204 132 35
(medium size)
Hospital 3 139 12 4 32 20 4
(small size)
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 7

Organizational climate: HR and RG 2011) (Figure 1). The rationale of the two-level approach
Both HR and RG were made operational as second order lies in the fact that engagement is exhibited by physi-
constructs. Both the HR and RG scales assessed were cians and nurses (first level units), who are nested into
drawn from the CVF as made operational by Patterson hospital wards (second level units). While engagement
et al. (2005). The six HR scales used were: Autonomy; (the dependent variable) is an individual characteristic,
Integration with other wards; Involvement in decision- climate is measured at the ward’s level. The within-ward
making; Supervisory support; Training; Welfare. The six (or first level) model controls for the effects on engage-
RG scales used were: Clarity of organizational goals; ment of personal characteristics, i.e. medical role
Efficiency and productivity at work; Effort toward (nurse = 1, physician = 0), and age (measured in
achieving goals; Pressure to produce; Performance feed- years), whereas the between-ward (or second level)
back; Quality. For both climate models, the scales model estimates the effects on work engagement of the
adopted in the study had previously been validated in ward’s climate models, HR and RG. The multi-level
the healthcare context by Ancarani et al. (2011). In order design estimates random intercepts, taking into account
to avoid common method bias (Podsakoff, MacKenzie, the unobservable heterogeneity across wards stemming
Lee, & Podsakoff, 2003), which could arise if engagement from the correlations among the measures of engage-
and climate were assesses by the same respondents, and ment provided by the members of the same ward.
in analogy with other studies on culture/climate in
healthcare (McFadden, Henagan, & Gowen, 2009), cli-
mate inside each ward was assessed by the ward manager Findings
who was asked to state on a 7 point Likert scale the
Model results
relevance of the dimensions of HR (α = 0.766) and of
RG (α = 0.866) in his/her U.O. Table 2 shows the results of the multilevel analysis and
reports factor loadings for the three constructs.
Multilevel SEM methodology Goodness of fit indices are satisfactory (CFI = 0.848;
The hypotheses of the study have been tested via a two- RMSEA = 0.051). The within-ward analysis shows that
level structural equation analysis (Mathieu & Chen, the dichotomous variable for the medical role is

Age Medical Role

Engagement
Within Model

Autonomy Clarity of goals


Integration
Manager’s Manager’s Efficiency
value value
Involvement Effort
orientation orientation
Supervisory Support Performance Feedb.
HR RG
Training Pressure to Produce
Welfare Quality

Engagement

Vigor Dedication Absorption

V1 V2 V3 D1 D2 D3 A1 A2 A3

Between Model
Figure 1. Two-level structural equation model.
8 A. ANCARANI ET AL.

Table 2. SEM model estimation. expected to be negatively related with engagement


PATH ST. COEFF ST.DEV P (Christian et al., 2011; Halbesleben, 2010) when they
WITHIN WARD ANALYSIS are not matched by offsetting resources.
AGE → ENGAGEMENT −0.244 0.138 0.077
MEDICAL ROLE → ENGAGEMENT 0.194 0.097 0.045 As argued above, one can plausibly argue that HR and
BETWEEN WARD ANALYSIS RG are the most frequently encountered climate models
HR CLIMATE → ENGAGEMENT 0.657 0.142 0.000
MANAGER’S RG → ENGAGEMENT 0.191 0.153 0.211 within the Italian public hospital system. In fact, strong
FACTOR LOADINGS professional bureaucracies, such as nurses and physicians
VIGOUR → ENGAGEMENT 0.974 0.034 0.000
DEDICATION → ENGAGEMENT 0.983 0.023 0.000 tend to generate a “clan” climate that is inward oriented to
ABSORPTION → ENGAGEMENT 0.974 0.034 0.000 professional development. On the other hand, since the
AUTONOMY → HR 0.580 0.069 0.000
INTEGRATION → HR 0.775 0.067 0.000 public healthcare reforms of the early nineties, Italian
INVOLVEMENT → HR 0.716 0.073 0.000 public hospitals have undergone a dramatic shift toward
SUPERV. SUPPORT → HR 0.467 0.097 0.000
TRAINING → HR 0.518 0.144 0.000 managerial models characterized by patient oriented goals
WELFARE → HR 0.580 0.069 0.000 and performance appraisal mechanisms. Since this process
CLARITY OF GOALS → RG 0.616 0.120 0.000
EFFICIENCY→ RG 0.767 0.086 0.000 has often been carried out without counterbalancing the
EFFORT → RG 0.733 0.138 0.000
PERF. FEEDBACK→ RG 0.787 0.077 0.000 new demands with additional resources, it is likely that it
PRESS. PRODUCE → RG 0.759 0.145 0.000 may have not generated higher worker engagement.
QUALITY → RG 0.648 0.150 0.000
The empirical analysis reveals that a climate oriented
to human resource management enhances the work
engagement of employees, while a climate oriented to
positive and significant, signaling that nurses are more efficiency and productivity is not significantly related to
engaged than physicians are (Coeff. = 0.194; St. work engagement.
dev. = 0.097; p < 0.05). The age variable has a negative The positive relation between HR and engagement
coefficient but is only weakly significant. The between confirms that autonomy, integration, involvement in
ward analysis shows that the HR ward climate is sig- decision making, support and attention to workers’
nificantly and positively related to work engagement welfare all contribute to increase work engagement,
(Coeff. = 0.657; St.dev. = 0.142; p < 0.01), therefore since they are perceived as valuable resources that can
confirming hypothesis H1. Hypotheses H2 is not sup- motivate workers to go the extra mile.
ported, as RG has an insignificant effect on work The finding of an insignificant relation with engage-
engagement. ment suggests that indeed the job resources offered by
RG might be too scarce to address the high challenging
job demands this climate model entails, and to ignite a
Discussion
positive interaction leading to engagement (Bakker et al.,
This article hypothesizes that work engagement is 2014). Therefore, the insignificant impact of RG may be
influenced by organizational climate, considered a tied to a resource-demand imbalance. In case of overload
resource in itself and instrumental for obtaining or of demands, even when the accompanying reward system
protecting other valuable resources (Bakker et al., tied to RG models is working well, employees feel they
2007). Unlike previous studies that have focused on get rewarded for “getting their work done” and not for
specific facets of workplace climate (Bakker et al., “going the extra-mile”. Alternatively, rewards may lack
2004, 2007; Hakanen et al., 2006; Nahrgang et al., credibility, thus diminishing the perceived resources pro-
2011), this contribution is the first to investigate the vided to handle the additional demands posed.
relation between two theory-grounded organizational To sum up, the comparison of results concerning HR
climate models and work engagement within health- and RG suggests that the paths to improve organizational
care organizations. The two climates are grounded in performance are manifold. Notwithstanding public sec-
the CVF, and can be regarded as polar opposites, the tor reforms usually focus on measures to improve effi-
Human Resource model focusing toward internal sta- ciency and productivity through monitoring and
keholders and flexibility, and the RG model focusing performance based systems, our results suggest that man-
on external stakeholders and on strict control. The agers should also focus on subordinates’ empowerment
relevance of these two climate models for public orga- and participation, thus supporting work engagement and
nizations lies in the fact that the HR model is the one extra role behavior. In healthcare, engaged physicians
that best fits the idea of job resources (Bakker et al., and nurses may foster clinical and process quality, thus
2007), while RG emphasizes job demands, which are improving patient outcomes. In this perspective, ward
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 9

managers should adapt their priorities when facing low References


levels of ward personnel’s engagement. This recommen-
Ancarani, A., Di Mauro, C., & Giammanco, M. D. (2011).
dation is consonant with Howard (1998)’s analysis sug- Patient satisfaction, managers’ climate orientation and
gesting that, in the hospital setting, the simultaneous organizational climate. International Journal of
enhancement of both efficiency and HR is attainable. Operations & Production Management, 31(3), 224–250.
As purported by Gifford et al. (2002), a control-oriented doi:10.1108/01443571111111900
management choice is likely to be highly demanding in Ancarani, A., Di Mauro, C., Giammanco, M. D., &
Giammanco, G. (2018). Work engagement in public hos-
terms of time, costs, and medical personnel strain.
pitals: A social exchange approach. International Review of
Hence, the managerial effort might be better directed Public Administration, 23(1), 1–19. doi:10.1080/
toward the realization of a less autocratic organizational 12294659.2017.1412046.
setting (Wijewardena, Samaratunge, & Härtel, 2014); Ashforth, B. E., & Humphrey, R. H. (1995). Emotion in the
this, in turn, would increase employees’ well-being at workplace: A reappraisal. Human Relations, 48(2), 97–125.
work. As suggested by O’Reilly (1989), organizational doi:10.1177/001872679504800201
Bakker, A. B. (2015). A job demands–Resources approach to
values directed to the development and the maintenance public service motivation. Public Administration Review,
of high levels of intensity and dedication among person- 75(5), 723–732. doi:10.1111/puar.12388
nel usually distinguish prosperous organizations. Bakker, A. B., & Demerouti, E. (2007). The job demands-
Finally, the hypotheses tested build on the assump- resources model: State of the art. Journal of Managerial
tion that the locus of organizational climate within Psychology, 22, 309–328. doi:10.1108/02683940710733115
Bakker, A. B., Demerouti, E., & Sanz-Vergel, A. I. (2014). Burnout
hospitals is the hospital ward due to the head of
and work engagement: The JD-R approach. Annual Review of
ward’s high discretionary powers on personnel and Organizational Psychology and Organizational Behavior, 1,
resource management (Cabiedes & Guillen, 2001). 389–411. doi:10.1146/annurev-orgpsych-031413-091235
This arrangement favors the creation of a climate at Bakker, A. B., Demerouti, E., & Verbeke, W. (2004). Using
the unit level rather than at the hospital level (Callen, the job demands-resources model to predict burnout and
Braithwaite, & Westbrook, 2007; Gosling, Westbrook, performance. Human Resource Management, 43, 83–104.
doi:10.1002/(ISSN)1099-050X
& Braithwaite, 2003). In turn, this unit climate affects Bakker, A. B., Hakanen, J. J., Demerouti, E., & Xanthopoulou,
the subordinates’ work engagement. In this light, D. (2007). Job resources boost work engagement, particu-
results supplement the literature emphasizing the rele- larly when job demands are high. Journal of Educational
vance of middle managers in the management of Psychology, 99(2), 274–284. doi:10.1037/0022-0663.99.2.274
human resources in the public sector (Mostafa & Bakker, A. B., Schaufeli, W. B., Leiter, M. P., & Taris, T. W.
(2008). Work engagement: An emerging concept in occu-
Andrews, 2017; Op De Beeck & Wynen, 2017).
pational health psychology. Work & Stress, 22(3), 187–200.
doi:10.1080/02678370802393649
Blau, P. M. (1964). Exchange and power in social life. New
Limitations and future agenda York, NY: Wiley.
Borrill, C., West, M., Carter, M., & Dawson, J. (2003). The
Several limitations of the present research must be acknowl- relationship between staff satisfaction and patient satisfac-
edged. First, while the study has thrown light on the lin- tion: Results from wolverhampton hospitals NHS trust.
kages between two general organizational climate models Birmingham, UK: Aston business school.
and work engagement, lack of longitudinal data has pre- Cabiedes, L., & Guillen, A. (2001). Adopting and adapting
managed competition: Health care reform in Southern
vented drawing unambiguous inference on the causality Europe. Social Science and Medicine, 52, 1205–1217.
nexus. Second, as the focus on engagement stems from its Callen, J. L., Braithwaite, J., & Westbrook, J. I. (2007). Cultures in
expected impacts on organizational outcomes (Schaufeli & hospitals and their influence on attitudes to, and satisfaction
Bakker, 2004), the inclusion in the analysis of measures of with, the use of clinical information systems. Social Science &
such outcomes (e.g. patient satisfaction, lower readmission Medicine, 65(3), 635–639. doi:10.1016/j.socscimed.2007.03.053
Cameron, K. S., & Caza, A. (2004). Contributions to the discipline
rates, lower mortality rates) could shed light on the climate-
of positive organizational scholarship. American Behavioral
engagement-performance relations. Finally, cross-country Scientist, 47, 731–739. doi:10.1177/0002764203260207
investigations may help evaluating country-dependency Christian, M. S., Garza, A. S., & Slaughter, J. E. (2011). Work
due to diverse health care institutional backgrounds. engagement: A quantitative review and test of its relations
with task and contextual performance. Personnel Psychology,
64(1), 89–136. doi:10.1111/peps.2011.64.issue-1
Coram, R., & Burnes, B. (2001). Managing organisational
ORCID change in the public sector-Lessons from the privatisation
Carmela Di Mauro http://orcid.org/0000-0001-7317-945X of the property service agency. International Journal of
Maria Daniela Giammanco http://orcid.org/0000-0001- Public Sector Management, 14(2), 94–110. doi:10.1108/
8677-5314 09513550110387381
10 A. ANCARANI ET AL.

Crawford, E. R., LePine, J. A., & Rich, B. L. (2010). Linking Retrieved from http://dera.ioe.ac.uk/1810/1/file52215.pdf
job demands and resources to employee engagement and Accessed on 3 December 2017.
burnout: A theoretical extension and meta-analytic test. Marinova, D., Ye, J., & Singh, J. (2008). Do frontline mechan-
TheJournal of Applied Psychology, 95(5), 834–848. isms matter? Impact of quality and productivity orientations
doi:10.1037/a0019364 on unit revenue, efficiency, and customer satisfaction.
Demerouti, E., Bakker, A. B., Nachreiner, F., & Schaufeli, W. Journal of Marketing, 72(2), 28–45. doi:10.1509/jmkg.72.2.28
B. (2001). The job demands-resources model of burnout. Maslach, C., & Leiter, M. P. (1997). The truth about burnout.
Journal of Applied Psychology, 86(3), 499. San Francisco, CA: Jossey-Bass.
Denison, D. R. (1996). What is the difference between organiza- Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001). Job burnout.
tional culture and organizational climate? A native’s point of Annual Review of Psychology, 52(1), 397–422. doi:10.1146/
view on a decade of paradigm wars. Academy of Management annurev.psych.52.1.397
Review, 21(3), 619–654. doi:10.5465/amr.1996.9702100310 Mathieu, J. E., & Chen, G. (2011). The etiology of the multilevel
Gifford, B. D., Zammuto, R. F., & Goodman, E. A. (2002). paradigm in management research. Journal of Management,
The relationship between hospital unit culture and nurses’ 37(2), 610–641. doi:10.1177/0149206310364663
quality of work life. Journal of Healthcare Management / Mauno, S., Kinnunen, U., & Ruokolainen, M. (2007). Job
American College of Healthcare Executives, 47(1), 13–24. demands and resources as antecedents of work engage-
Goldstein, S. M. (2003). Employee development: An exam- ment: A longitudinal study. Journal of Vocational
ination of service strategy in a high-contact service envir- Behavior, 70(1), 149–171. doi:10.1016/j.jvb.2006.09.002
onment. Production and Operations Management, 12(2), McFadden, K. L., Henagan, S. C., & Gowen, I. I. I., . C. R.
186–203. doi:10.1111/j.1937-5956.2003.tb00500.x (2009). The patient safety chain: Transformational leader-
Gosling, A. S., Westbrook, J. I., & Braithwaite, J. (2003). ship’s effect on patient safety culture, initiatives, and out-
Clinical team functioning and IT innovation: A study of comes. Journal of Operations Management, 27(5), 390–404.
the diffusion of a point-of-care online evidence system. doi:10.1016/j.jom.2009.01.001
Journal of the American Medical Informatics Association : Meijman, T. F., & Mulder, G. (1998). Psychological aspects of
JAMIA, 10(3), 244–251. doi:10.1197/jamia.M1285 workload. In C. J., de Wolff, J. D., Pieter & H. Thierry
Hakanen, J. J., Bakker, A. B., & Schaufeli, W. B. (2006). Burnout (Eds.), Handbook of work and organizational psychology
and work engagement among teachers. Journal of School (pp. 5–33). Hove: Psychology Press.
Psychology, 43(6), 495–513. doi:10.1016/j.jsp.2005.11.001 Michel, E. J., Wayne, S. J., & Liao, C. (2015). Beyond Performance:
Hakanen, J. J., Perhoniemi, R., & Toppinen-Tanner, S. (2008). Examining the role of work engagement on employee voice
Positive gain spirals at work: From job resources to work and success. Academy of Management Proceedings, 1, 177–186.
engagement, personal initiative and work-unit innovativeness. Mostafa, M. A. S., & Andrews, R. (2017). Senior Public
Journal of Vocational Behavior, 73(1), 78–91. doi:10.1016/j. Managers’ Engagement: A person–situation-interactionist
jvb.2008.01.003 perspective. International Journal of Public Administration,
Halbesleben, J. R. B. (2010). A meta-analysis of work engagement: 1–11. 2017. doi:10.1080/01900692.2017.1387141
Relationships with burnout, demands, resources, and conse- Mowday, R. T. (1999). Reflections on the study and relevance of
quences. In A. B. Bakker & M. P. Leiter (Eds.), Work engage- organizational commitment. Human Resource Management
ment: A handbook of essential theory and research (pp. 102– Review, 8(4), 387–401. doi:10.1016/S1053-4822(99)00006-6
117). New York, NY: Psychology. Nahrgang, J. D., Morgeson, F. P., & Hofmann, D. A. (2011).
Hofstede, G. (1980). Culture and organizations. International Safety at work: A meta-analytic investigation of the link
Studies of Management & Organization, 10(4), 15–41. between job demands, job resources, burnout, engagement,
doi:10.1080/00208825.1980.11656300 and safety outcomes. Journal of Applied Psychology, 96(1),
Howard, L. W. (1998). Validating the competing values model as 71–94. doi:10.1037/a0021484
a representation of organizational cultures. TheInternational Noesgaard, M. S., & Hansen, J. R. (2017). Work engagement in
Journal of Organizational Analysis, 6(3), 231–250. doi:10.1108/ the public service context: The dual perceptions of job char-
eb028886 acteristics. International Journal of Public Administration, 1–
Koyuncu, M., Burke, R. J., & Fiksenbaum, L. (2006). Work 14. doi:10.1080/01900692.2017.1318401
engagement among women managers and professionals O’Reilly, C. (1989). Corporations, culture and commitment:
in a Turkish bank: Potential antecedents and conse- Motivation and social control in organizations. California
quences. Equal Opportunities International, 25, 299–310. Management Review, 31(4), 9–25. doi:10.2307/41166580
doi:10.1108/02610150610706276 Op De Beeck, S., & Wynen, J. (2017). Effective HRM imple-
Llorens, S., Bakker, A. B., Schaufeli, W., & Salanova, M. (2006). mentation by line managers: Relying on various sources of
Testing the robustness of the job demands-resources model. support. International Journal of Public Administration, 40
International Journal of Stress Management, 13(3), 378–391. (2), 192–204. doi:10.1080/01900692.2015.1075553
doi:10.1037/1072-5245.13.3.378 Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J. F.,
Lowe, G. (2012). How employee engagement matters for hospi- Lawthom, R., Maitlis, S., & Robinson, D. L. (2005). Validating
tal performance. Healthcare Quarterly (Toronto, Ont.), 15(2), the organizational climate measure: Links to managerial prac-
29–39. tices, productivity and innovation. Journal of Organizational
Luthans, F. (2002). Positive organizational behavior: Developing Behavior, 26(4), 379–408. doi:10.1002/job.312
and managing psychological strengths. Academy of Perryer, C., & Jordan, C. (2005). The influence of leader behaviors
Management Executive, 16, 57–72. on organizational commitment: A study in the australian pub-
MacLeod, D., & Clarke, N. (2011). Engaging for success: lic sector. International Journal of Public Administration, 28(5–
Enhancing performance through employee engagement 6), 379–396. doi:10.1081/PAD-200055193
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 11

Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. Schaufeli, W. B., Bakker, A. B., & Van Rhenen, V. (2009).
(2003). Common method biases in behavioral research: A How changes in job demands and resources predict burn-
critical review of the literature and recommended remedies. out, work engagement, and sickness absenteeism. Journal
Journal of Applied Psychology, 88(5), 879–903. doi:10.1037/ of Organizational Behavior, 30, 893–917. doi:10.1002/
0021-9010.88.5.879 job.595
Quinn, R. E., & Rohrbaugh, J. (1983). A spatial model of Schaufeli, W. B., Salanova, M., Gonzalez-Roma, V., & Bakker,
effectiveness criteria: Towards a competing values A. B. (2002). The measurement of engagement and burn-
approach to organizational analysis. Management Science, out: A two sample confirmatory factor analytic approach.
29(3), 363–377. doi:10.1287/mnsc.29.3.363 Journal of Happiness Studies, 3, 71–92. doi:10.1023/
Rich, B. R., Lepine, J. A., & Crawford, E. R. (2010). Job A:1015630930326
engagement: Antecedents and effects on job perfor- Shortell, S. M., Zazzali, J. L., Burns, L. R., Alexander, J.
mance. Academy of Management Journal, 53(3), 617– A., Gillies, R. R., Budetti, P. P., Waters, T.M., &
635. doi:10.5465/amj.2010.51468988 Zuckerman, H.S. (2001). Implementing evidence-based
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory medicine: The role of market pressures, compensation
and the facilitation of intrinsic motivation, social develop- incentives, and culture in physician organizations.
ment, and well-being. The American Psychologist, 55(1), Medical Care, 39(7), 62–78. doi:10.1097/00005650-
68–78.10.1037110003066X.55.1.68 200107001-00005
Salanova, M., Agut, S., & Peirò, J. M. (2005). Linking orga- Stajkovic, A. D., & Luthans, F. (1997). A meta-analysis of the
nizational resources and work engagement to employee effects of organizational behavior modification on task
performance and customer loyalty: The mediation of ser- performance, 1975–95. Academy of Management Journal,
vice climate. Journal of Applied Psychology, 90, 1217–1227. 40(5), 1122–1149.
doi:10.1037/0021-9010.90.6.1217 Tuckey, M. R., Bakker, A. B., & Dollard, M. F. (2012).
Salanova, M., Lorente, M. L., Chambel, M. J., & Martinez, I. Empowering leaders optimize working conditions for
M. (2011). Linking transformational leadership to nurses’ engagement: A multilevel study. Journal of Occupational
extra-role performance: The mediating role of self-efficacy Health Psychology, 17(1), 15–27. doi:10.1037/a0025942
and work engagement. Journal of Advanced Nursing, 67 West, M., & Dawson, J. (2012). Employee engagement and
(10), 2256–2266. doi:10.1111/j.1365-2648.2011.05652.x NHS performance. The King’s Fund, 1, 23.
Schaufeli, W. B., & Bakker, A. B. (2003). UWES utrecht work Wijewardena, N., Samaratunge, R., & Härtel, C. (2014). Creating
engagement scale: Test manual. The Netherlands: Utrecht better employees through positive leadership behavior in the
University: Unpublished manuscript, Department of public sector. International Journal of Public Administration,
Psychology. 37(5), 288–298. doi:10.1080/01900692.2013.835320
Schaufeli, W. B., & Bakker, A. B. (2004). Job demands, job Xanthopoulou, D., Bakker, A. B., Demerouti, E., & Schaufeli,
resources, and their relationship with burnout and engage- W. B. (2009). Work engagement and financial returns: A
ment: A multi-sample study. Journal of Organizational diary study on the role of job and personal resources.
Behavior, 25, 293–315. doi:10.1002/job.248 Journal of Occupational and Organizational Psychology,
Schaufeli, W. B., Bakker, A. B., & Salanova, M. (2006). The 82, 183–200. doi:10.1348/096317908X285633
measurement of work engagement with a short questionnaire: Yaya, R. (2017). Twelve years of Scottish school public pri-
A cross-national study. Education and Psychological vate partnerships: Are they better value for money? Journal
Measurement, 66(4), 701–716. doi:10.1177/0013164405282471 of Public Procurement, 17(2), 187–228.

You might also like