You are on page 1of 13

Machine Translated by Google

Organizational Citizenship Behavior of Contingent Workers in Singapore


Author(s): Linn Van Dyne and Soon Ang
Source: The Academy of Management Journal , Dec., 1998, Vol. 41, No. 6 (Dec., 1998), pp.
692-703

Published by: Academy of Management

Stable URL: https://www.jstor.org/stable/256965

JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in
a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For
more information about JSTOR, please contact support@jstor.org.

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at https://
about.jstor.org/terms

Academy of Management is collaborating with JSTOR to digitize, preserve and extend access to
The Academy of Management Journal

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

? Academy of Management Journal


1998, Vol. 41, No. 6, 692-703.

ORGANIZATIONAL CITIZENSHIP BEHAVIOR OF CONTINGENT


WORKERS IN SINGAPORE

LINN VAN DYNE

Michigan State University

SOON ANG

Nanyang Technological University

This study, conducted in Singapore, where there are ongoing labor shortages, supports social exchange theory predictions
that contingent workers engage in less organizational citizenship, expect less of their employers in their psychological contracts,
and have lower affective commitment than regular employees. Contrary to expectations, the relationship between two attitudes-
commitment and psychological contracts- and organizational citizenship was stronger for contingent workers than for regular
employees, indicating that when contingent workers have positive attitudes about their relationship with an organization, they
engage in organizational citizenship behavior.

We discuss the implications of these unexpected results for theory and practice.

Although organizations have hired an increasing Despite the strong theoretical rationale for less number of contingent workers1
(Howe, 1986; Nol- positive outcomes with contingent work status, len & Axel,
provides no1996;
such Pfeffer
evidence.& Baron, 1988),
In a study littlerelatively
is knownpast research
about how
work status (contingent of contingent and regular engineers and technical work versus
an aerospace regular(1993)
firm, Pearce employment)
found noinfluences
tudes andatti -cians in
behavior at
work (Beard & Edwards, differences in supervisor-rated cooperativeness or commitment.
affective 1995). SocialInexchange theory
fact, contrary to(Blau,
expecta-1964) and norms
procity reciprocal
(Gouldner, 1960) suggest that con- tions, she found significantly higher levelsreported
exchange of self- contingent workers will
extra-role behavior have less workers
in contingent positive
relationships than regular employees because the than in regular employees. Other recent
from organizations research
(Rousseau, two Sherer,
1997; receive 1996).
different inducements
Contingent
workers are temporary or on-call, and they receive reports of organizational commitment,
routinely considered for amount of fewofif communication,
work, quality any benefits, areand notquality
of promotions, and cannot expect a steady work care between contingent and
(Cappelli, regular
1995; employees
nursing in schedule
departments; Tansky, or long-term
Gallagher,employment
and Wet-
Chew & Chew, 1996; Mangum, Mayall, & Nelson, zel (1995) reported and no differences
regular in theinaffective
employees nursing 1985). commitment
and hospital supportofstaff
contingent
positions; and Kidder (1995) found no differences in the self-reported extra-role behavior of contingent and reg-
has also failed to show differences based on work
status. Porter (1995) found no differences in self-

We thank two anonymous reviewers for their helpful


ular nurses.
suggestions during the review process. We thank T.
Begley, D. Kidder, RD Lansbury, KY Ng, G. Porter, Given the consistently nonsignificant findings of this past
and R. Saavedra for their useful comments on an earlier research, we suspected that forces such as external
version; we also thank L. Gan, SK Quek, and K. Tan for labor market conditions might have been exerting
their assistance with data collection.
important and overriding influences on 1 We define
contingent workers as did Polivka and the attitudes and behaviorwho
individuals of contingent workers
"[do not have] in Nardone,
an explicit as
or these
studies. In the next section, we contrast two implicit contracts
market for long-term
contexts, theemployment
United States orand
[have] one in
Singa- labor
which the minimum hours of work can vary in a pore, that may
way" influence
(1989: the extent
11). This to which
definition con-contingent
excludes nonsystematic
work that tends to be involuntary or voluntary. permanent part-time employees and independent con- We
speculate
(who set their own hours, are paid by the job, and US labor that
market mayspecific characteristics
have eliminated of the tractors
differences perform
their work off-site). We use the term "regular
and contingent workers' attitudes and employees" to denote people in traditional, ongoing, and open-ended in regular
Second, we develop hypotheses to ad- employment relationships (Rousseau, 1995). behavior.

692

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

1998 Van Dyne and Ang 693

dress two basic research questions. Under construction 1996). When contingent workers prefer regular
market conditions in which the choice of work jobs, they may be motivated to display positive
status (regular employment versus contingent attitudestends as well
to as
be high
voluntary,
levels(1)of performance
Do contingentand work)
cooperation (despite receiving fewer inducements workers fromhave
their less
firms)positive attitudes
in the hope and behavior
of obtaining regular
than regular employees? and (2) Does work status employment.organiza- The interact with type
second attitudes in influencing
of labor market
situation is typ- tional citizenship behavior? Third, we describe
where work-
a ifiedstudy
by the
conducted
conditions in in
Singapore
Singapore, and
discuss implica- ers enter into contingent work on a morerelatively
voluntarysmallthan population,
involuntary declining
basis. Givenbirthits
rates,
and rapidly aging population, Singapore has an extremely tight labor market,
unemployment rates ofpersistently low and severe
1.6-2.6 percent,
labor shortages in all sectors and at all skill levels (BianLansbury,
& Ang, 1997; 1995).
Goh, 1994; Verma, Kochan, &
tions of our results.

LABOR MARKET CONTEXTS AND THE


CONTINGENT WORKFORCE

In their critique of organizational behavior, Cappelli and Sherer


(1991) emphasized the importance
of the labor market outside a worker's current sit- Those who want to work as regular employees
have uation and argued that workers' "external mobil- no num- difficulty
ity" and finding
abilityemployment
to choose alternative
because the
employment ber of jobs exceeds the supply of workers.and In re- can significantly
response influence
to this shortage, their attitudes
organizations in
Singapore behave. Similarly, Smith, Kendall, and Hulin's order
emphasize
(1969) modelthe flexibility
of job satisfaction
of contingent suggested
jobs in
that perceived job opportunities have a direct effect on is
attitudes
low andabout manyajobs current
are job. When the
available, unemployment
high
opportunity costs of staying in the same job lead to lower satisfaction.
to attract In contrast,
additional workers who are not high unemployment
interested
and few job alternatives enhance job satisfaction ( Hulin, Roznowski,
in regular & Hachiya,
employment 1985).
(Thong, In support
1996). Contingentof this
work
idea, Pfeffer and Lawler (1980) demonstrated that overallallowsunemployment
individuals tolevels
balanceand job mobility
personal influenced
and non-work
worker job satisfaction. Similarly, Krausz, Brandwein, and Fox (1995)
objectives such demonstrated
as educational differences
goals, familyinandjob
satisfaction between voluntarily and involuntarily contingent workers.
household responsibilities, freedom to travel, and a
preference for seasonal hours.
Voluntarily contingent work should be espe-
cially attractive to individuals with family responsibilities
(frequently and traditionally, women) who require
flexible work hours that will allow, for instance, their being
home during school holidays or staying home unexpectedly
and irregularly to care for a sick child or parent. Contingent
work should also be attractive to professionals who are
attending school (typically, younger individuals) to
Although we realize that contingent work is not improve their skills or to obtain advanced degrees.
exclusively voluntary or involuntary, the contrast
between two diametrically opposed sets of external The key characteristics of conditions promoting voluntarily
labor market conditions illustrates their importance . contingent work status are a shortage of workers, the
In the first situation, typified by conditions in the United availability of regular employee jobs, and the consequent
States, many workers have been forced into contingent ability of workers to choose regular rather than contingent
jobs involuntarily because downsizing and restructuring work status. In contrast, the key characteristics of conditions
have eliminated regular jobs (Nollen & Axel, 1996; promoting involuntarily contingent work status are a shortage
Rousseau, 1997). of jobs, the availability of workers, and the preference of
Kalleberg and Schmidt (1997) reported that a many contingent workers to work as regular employees.
substantial proportion of contingent workers in the We note that when individuals are committed to family
United States are underemployed people who responsibilities and educational goals, they may not feel a
would prefer regular jobs. From an organization's sense of true choice regarding work status. Nevertheless,
point of view, contingent workers offer flexibility when regular jobs are available, if their goals or their
and a chance to vary the size of the workforce personal situations change, they can easily find regular
without the psychological burden of laying off employment.
employees. When occupying a contingent work
status is involuntary, however, and the supply of
individuals who desire regular employment exceeds Because of the labor market conditions in Singapore ,
the demand, workers possess poor bargaining individuals work in contingent jobs only when they prefer
power vis-a-vis firms (Mangum et al., 1985; Nollen & Axel,
the flexibility of contingent status

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

694 December
Academy of Management Journal

(Chew & Chew, 1996). This assessment is because they are one of the most fundamental
supported by the results of a recent study of 51 aspects of employment relationships (Rousseau,
professionals in a large Singapore organization by 1997), and they represent workers' views of their
Bin, Liew, and Kang (1996) that showed that 77 relationships with firms. We included affective
percent of the contingent workers preferred commitment because it is a key indicator of worker-
contingent work over regular employment. Thus, in firm relations and its use provides continuity with past
Singapore a higher proportion of contingent workers research examining the effects of work status on
occupy that status voluntarily (Chew, 1996; Chew individual attachment to an organization (cf.
& Chew, 1995; Verma et al., 1995) than in the Pearce, 1993).
United States, where downsizing has often (but not
always) forced individuals involuntarily into contingent work.
Organizational Citizenship Behavior
EFFECTS OF WORK STATUS ON BEHAVIOR Organ (1988) emphasized the discretionary nature of
AND ATTITUDES organizational citizenship when he defined
it as constructive behavior not included in an em-
From a social exchange perspective, we would expect thatployee's formal job description, such as assisting co-
contingent workers will adopt more workers with their work, helping peers learn a new
transactional view of worker-firm relations in con-
task, volunteering to do things that benefit texts with
severe labor shortages, where status their work groups, and exchange
Social orienting newis a workers.
pattern Sincetendsthese
to bebehaviors
voluntary.
are not required by the job, of mutually contingent tangible and intangible ex- there are no
for failing to engage in changes in which "the formal sanctions
precise
services the em- them. Thus, organizational citizenship can be ployee or professional will be
perform viewed as a behavioral indicator of workers' obliged to
re- are not specified in detail in advance" (Blau, 1964:In
sponses to their employment relationships.
contexts of severe labor shortage, contingent an Whe 93).
organization offers contingent workers fewer in workers thanareregular
less dependent
employees, oncontingent
any one firm employment,
for ducements and
they can find regular employ- workers can reciprocateofwithout negative
their status, cons ment
quences if they prefer
by withholding it . By virtue
citizenship
behavior contingent workers receive fewer tangible and in- Work by Konovsky and Pugh
Dyne, tangible benefits from their employing (1994) and Van
organiza-
Graham, and Dienesch (1994) has supported thi tionsexpectation,
than do regular employees. Since they
demonstrating the positive influence chose
contingent work knowing they would receive fewer of social exchange
inducements, werelationships
expected these on organizationa
voluntarily con-
citizenship behavior. When individuals feel the tingentwell
workers
by their organizations, theytheir
to be less attached to recip-firms
andare treated
to have less
positive attitudes and behavior rocate and exceed theexpectations
minimum requirements
have their jobs by helping others andThese
than regular employees. the
organizations. consistent with the norm of reciprocity, work
a central In contrast,
concept in socialwhen individuals
exchange theory, like contingent
which "imposes
ers feel that organizations view them as short-term, obligations only contingently, that is, in response
temporary, or dispensable , they reciprocate by per to
the benefits conferred by others" (Gouldner, forming only required duties
Accordingly, workers'and minimizing
attitudes and citi-
be- 1960:
zenship 171).
behaviors. Accordingly, behavior can be viewed as a contingent response to the tangible and intangible
benefits they receive on the basis of their work status.

Hypothesis 1. Contingent workers will engage in less


organizational citizenship behavior than regular employees.
Worker-firm relations can be examined from two
different perspectives (self and observer) and through
different manifestations (attitudes and behavior). We
Psychological Contracts and Affective
designed our research to include one behavior, Commitment
organizational citizenship, and two attitudes: perceptions
of the psychological contract and affective commitment. In view of social exchange theory and the norm of
We chose organizational citizenship as our behavioral reciprocity, we expected contingent workers' attitudes
outcome because organizations cannot specify all desired towards their firms (psychological contracts and affective
behaviors and are increasing their emphasis on proactive commitment) to be less positive than those of regular
employee behavior such as citizenship (Organ, 1988). We employees. Psychological contracts are "individual beliefs,
chose psychological contracts shaped by the organization, regarding terms of an
exchange agreement between

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

1998 Van Dyne and Ang 695

individuals and their organizations" (Rousseau, ary behavior. When psychological contracts contain
1995: 9). Work status is a major determinant of a large number of inducements from an organization ,
this exchange agreement because it influences individuals have positive relationships with the
perceptions of obligations such as pay, benefits, organization, and they reciprocate by contributing
access to training, and opportunities for to it. These contributions include obedience , loyalty,
advancement. For regular employees, employment and cooperative behavior. In contrast, when
provides repeated cycles of reciprocal exchange psychological contracts are less positive, workers
with an organization that expand the scope of their reciprocate by engaging in less organizational
connection to the organization. Consequently, citizenship behavior. Robinson, Kraatz, and
their psychological contracts include a broad range Rousseau (1994) provided empirical support for this
of perceived employer obligations. In contrast, relationship by demonstrating a link between
contingent workers do not experience repeated, psychological contracts and self-reported
long-term exchange relationships with an organizational citizenship behavior. Drawing on
organization. Their interactions are short-term and social exchange theory, Organ (1990) theorized
bounded. Consequently, they expect fewer that affective commitment, conceptualized as a
inducements from the employer in their psychological contracts.sense of psychosocial attachment, is an antecedent
Affective commitment describes the strength of of organizational citizenship behavior. Thus,
an individual's attachment to an organization (Meyer engaging in voluntary behaviors such as
& Allen, 1984). Attachment typically develops out of organizational citizenship is a behavioral response
frequent and repeated exchanges that make an ongoing to the inducements received from an organization.
relationship possible. A growing body of research This idea was supported by Shore and Wayne's
demonstrates that affective commitment to organizations (1993) research, which demonstrated a relationship
is based on workers' perceptions of the support they between affective commitment and supervisor
receive from their organizations (cf. Settoon, Bennett, &
ratings of organizational citizenship. In summary,
Liden, 1996). the literature provides theoretical and empirical
By definition, contingent workers receive less from
justification for expecting psychological contracts
organizations and have no reason to expect continuous ,
and commitment to be related to organizational citizens
long-term employment. Their worker-firm relationship is
More directly relevant to the main focus of our study,
short-term and uncertain. Thus, we would expect
which was the comparison of contingent workers and
contingent workers to have weaker feelings of
attachment to organizations. In sum-
regular employees, we hypothesized that the above
relationships would be moderated by work status. As
Mary
Figure 1 illustrates, we suggest regular employee work
Hypothesis 2. Contingent workers will have fewer status will enhance the relationship between attitudes
expectations of their employers in their psychological and citizenship behavior and that the relationship
contracts than regular employees. between attitudes and behavior will be weaker for
Hypothesis 3. Contingent workers will have lower contingent workers than for regular employees. We base
affective commitment than regular employees. our hypothesis on the salience and importance of work
status in general and more specifically, on the special
importance that work status has when labor shortages
allow individuals to choose whether to take jobs as
Work Status as a Moderator of the Relationship regular employees or as contingent workers. Choosing
between Attitudes and Behavior
contingent work status indicates a personal preference
In the preceding section, we discussed differences in for less work involvement. This preference could be
based
organizational citizenship behavior, psychological contracts, and on family responsibilities, educational goals, and/
affective commitment. or lifestyle choices that emphasize flexibility. In other
We now propose that work status moderates the relationship words, we expected
between these attitudes and organizational citizenship. First, we
that nonwork interests would be salient to contin-
discuss the link between the two attitudes (psychological contracts
gent workers and that these other demands would prevent
and affective commitment) and organizational citizenship. Then,
we discuss the moderating role of them from engaging in organizational citizenship at work.
Other responsibilities consume the energy and attention of
work status. contingent workers, leaving fewer attentional and time
Rousseau (1995) theorized that psychological resources available for organizational citizenship behavior.
contracts are a key influence on behavior at work and Lower
that they are especially relevant to discretion- involvement reduces the salience of attitudes about

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

696 Academy of Management Journal December

FIGURES 1 day, Porter, & Steers, 1982). Their jobs typically involve
Hypothesized Interactions large amounts of customer contact, a relationship between
worker and organization
Regular have a direct effect on customer satisfaction. Both
Employee
of the organizations in our study had a long history of using

//
Organizational contingent workers in professional jobs because of ongoing
Citizenship labor shortages that prevented them from hiring adequate
Behavior
numbers of profession- als as regular employees.
Contingent
Worker
We collected self-report and peer-report questionnaire
data from 45 contingent workers (29 percent of the
Psychological Contract sample) and 110 regular employees from 41 work groups
Affective Commitment
(42 groups had been asked to participate ) evenly divided
between the two organizations . The average group size
work and this, in turn, weakens the link between was four members, and the range was three to six. These
attitudes and behavior. numbers represent a 93 percent individual response rate.
In contrast, we would expect a stronger link be-
between attitudes about work and behavior at work All respondents were ethnically Chinese, and all were
Singaporeans. Our questionnaires were in English for
exist for regular employees because they can expect
three reasons. First, English is the language of business
steady work schedules and/or long-term employment . If
a regular employee has high organizational commitment
and the common language of daily parlance in
Singapore. Second, the professional training of bankers
or views the psychological contract in positive terms, we
and nurses in Singapore is conducted in English. Third,
would expect high levels of organizational citizenship. If,
organizations in Singapore frequently conduct attitude
on the other hand, a regular employee has negative
surveys, and these are always in English and are
attitudes about an organization, we would expect low levels
typically instruments developed in Western contexts (cf.
of organizational citizenship. In summary, since
Cheng, 1989). Furthermore, we conducted focus groups
organizational citizenship is optional behavior, we expected
that work status would interact with attitudes about an
and a pilot study in each organization to make sure
organization to predict organizational citizenship behavior. that individuals understood the words used in our
Accordingly,
instruments, that the questions had face validity, and that
they were interpreted in a manner consistent with their
Hypothesis 4a. The relationship between psychological intended meaning. We made minor changes in the
contracts and organizational citizenship behavior will spelling of specific words (for instance, changing
be moderated by work status in such a way that the "behavior" to "behaviour") to match local usage.
relationship will be stronger for regular employees
than for contingent workers. All surveys were completed during normal working hours and
were returned to us by mail, and all respondents were assured
confidentiality and told they could withdraw from the study at any
Hypothesis 4b. The relationship between affective
time.
commitment and organizational citizenship behavior
Seventy-six percent of the contingent workers were
will be moderated by work status in such a way that
women; their average age was 27 years, their average
the relationship will be stronger for regular employees
educational level was college, and they had an average
than for contingent workers.
of 1.5 years of organizational tenure and 4 years of total
work experience. Comparable information for the regular
employees was 59 percent women, 31 years old, college
METHODS
educated, 5 years organizational tenure, and 8 years total
work experience. Overall, compared to the regular
Setting, Jobs, and Respondents
employees, a larger percentage of the contingent workers
were women, young, and less experienced. This
We tested our hypotheses on a convenience sample of 155 professional
distribution
workers from two large service organizations, a bank and a hospital, in was consistent with our assumptions that
contingent work would be especially attractive to those
Singapore . We chose to survey professional workers in service firms
(typically, women) with family responsibilities and those
because the relationship between individual and organization is especially
important and salient for professionals in service firms (Mow- (typically, young people with little work experience) with
educational commitments.

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

1998 Van Dyne and Ang 697

Contingent workers received higher hourly pay and a Post-it to each peer-rating questionnaire to cross
significantly fewer benefits than regular employees reference the code with the name of the peer. Afte
in both organizations. These demographic and respondents had completed their ratings of organizationa
compensation differences are typical of the contrast citizenship behavior, they removed th Post-its to protect
between contingent and regular employees the confidentiality of their rat ings. Group size ranged
(Kalleberg & Schmidt, 1997; Nollen & Axel, 1996). from three to six, and pee were rated by two to four co-
Regular employees and contingent workers in workers. Overall, we obtained 420 peer ratings; 24
both organizations routinely filled the same percent were completed by contingent workers and 76
professional jobs and worked side-by-side in the percent were completed by regular employees, and 27
same work groups. In the bank, these jobs include percent rated contingent workers and 73 percent, regular
bank officer and credit analyst. In the hospital, the employees. The results of t-tests revealed no signif
jobs included staff nurse and senior staff nurse. Date indicated the comparability of the jobs held by icant
differences in ratings of organizational cit zenship basedindividuals:
on the source of the rating
38 percent of 0.87,(t413p >contingent
.05). Thus,and we regular
percent of the contingent workers held jobs with group leader
concluded respon-
thatprovided
the ratenby thecontingent
regular employees
workers and and 32
regular e sibilities, and a series of t-tests
no ployees were not systematically biased upward differences based on work status in (1) job level downward. demonstrated
Interrater agreement (rwG(j)) average .84 (range = .75-.90). (staff
a 4-item versus group
self-report measureleader, t153
of job = 0.60, p(a
autonomy >=.05, (2)
.86)
based on Kalleberg and Reve (1992; t153 = 1.40, p > . 05),(ac =or.84)Pearce andinterdependence
of task Gregersen's (1991) (t1535-item
= 1.08,measure
p > .05).
Furthermore, as we expected in view of our assumptiont-teststhat contingent
demonstrated workno tends to be voluntary
differences based on in Singapore,
work status
job satisfaction (t52 = 0.69, p > .05). in Kunin's (1995) 11-item (a = .91) measure of "facet"
We used the seven obligations Robinson and col
leagues (1994) identified to assess workers' perceptions
of what their employer was obliged to provide them as
part of their psychological contracts.
Items included the following: "To what extent you
believe your employer is obliged to provide you with
the following items: rapid advancement , high pay,
training, and career development." Responses were
on a Likert scale (1 = not at all, 7 very high). We
measured commitment with si items from Meyer and
Allen's (1984) affective commitment scale. A sample
item is "I would be very happy to spend the rest of my
Measures and Analyses
career with this organization." Responses were also
We assessed organizational citizenship behavior on a Likert scale (1 = strongly disagree, 7 = strongly
as the average peer response to the Van Dyne agree Finally, we obtained work status from
and LePine (1998) seven-item "helping" organizational records (0 = contingent worker; 1 =
organizational citizenship scale. Items included regular employee).
these: "This particular co-worker volunteers to do
things for this work group," "This particular co- Past research has demonstrated that attitudes and
worker assists others in this group with their work behavior at work can be influenced by
for the benefit of the group," and "This particular demographic and situational characteristics
co-worker worker helps others in this group with (Mowday et al., 1982) and by aspects of group
their work responsibilities ." We used peer ratings composition such as the percentage of contingent
of organizational citizenship because peers have a large amount
workers in aofwork
dailygroup (Pearce, 1993).
contact with each other and are able to observe a Accordingly, we included five control variables in
our statistical analyzes to wide range of behaviors under spurious
varying relationships
circum- reduce based theon possibility
unmeasured of
therefore should be better rep- 1 = male ), tenure (numbervariables: sex (0 education
of months), = female, stances.
resentments Peerofratings
actual
behavior than self-ratings,
two years technical school, which may be subject to self-presentation bias, or 3 =(1college,
= high 4 school, 2 = ),
= master's
which may be influenced by workers in work group (computedpercentage from ofrecords);
contingent impression
supervisormanagement
ratings,
behavior.
bank, 1 = hospital). the organizational citizenship behavior Peers assessed
of contingent workers and and organization
regular employees(0 =
hierarchical re- members of their work groups. We preparedwho were peerWe tested
rating our in
forms hypotheses
advance and withrandomly
work status over to four peers for each group memberselectedto rate using
up we a were
and above
interested
the effects
in the effect
of the of
controls, interactions in
regression analysis, entering controls in step 1,
work status (contingent or regular) in step 2 and, since
confidential identification code. We then attached

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

698 Academy of Management Journal December

step 3. We assessed the change in F (AF) and Hypothesis 4 predicted that work status and attitudes would
interpreted the significance of individual parameters interact in influencing organizational citizenship. Table 3
using t-values. summarizes these results and shows significant interactions
for both psychological contracts and affective commitment.
RESULTS
The control variables explained 23 percent of the variance
Descriptive statistics and correlations for contingent workers
in peer-rated organizational citizenship behavior. In model
and regular employees are summarized in Table 1. The2, the main effects produced a 15 percent increase in R2
variables' Cronbach's alphas were acceptable (.81-.95). for psychological contracts and an 11 percent increase for
affective commitment. Finally, and consistent with our
hypotheses , the interactions in model 3 were significant
Hypotheses 1-3 were supported by hierarchical regression results
that are summarized in Table 2. (AF = 3.37, p < .05 for psychological contracts and AF =
After sex, tenure, education, percentage of contingent workers
2.74, p < .05 for affective commitment). Overall , these
equations
in a work group, and organization were controlled, the addition of explain 39 and 36 percent of the variance in
work status at step 2 of the regression for organizational organizational citizenship behavior.
citizenship behavior demonstrated significance (AF = 20.42, p <
.001) . Contingent workers exhibited less organizational citizenship
The plots of the interactions, however, which are illustrated in
than regular employees. Figure 2, indicate that the form of the interactions is different
from what we had predicted. We hypothesized that the attitude
-behavior link would be stronger for regular employees than for
Supporting Hypothesis 2, work status significantly increased explained
variance in psychological contract expectations (AF = 18.47, pcontingent
< .001), workers. The results, however , demonstrate no
demonstrating that contingent workers expected less from theirrelationship for regular employees and a positive relationship
employers. Hypothesis 3 was also supported (AF = 6.74, p < .001).
for contingent
Contingent workers had lower affective commitment than regular
workers.
employees. Results explained 33 percent of the variance in organizational
citizenship, 21 percent of the variance in psychological contracts, and 15
percent of DISCUSSION

As we hypothesized, applying social theory to a context in


the variance in affective commitment. which labor sho

TABLE 1
Means, Standard Deviations, and Correlations

Regular quota

Variable Mean sd Mean sd 1 2 3 4 5 6 7 8

1. Organizational 4.43 1.15 5.01 0.92 (.95) .59*** .48*** -.14 .20 -.07 .14 .75*** citizenship 2. Psychological 3.93 1.39 4.93 1.26
.09 (.92) .45*** .00 .17 -.04 .11 .54***

contract

3. Affective 4.17 1.42 4.71 1.01 .06 .31*** (.81) -.16 .39*** -.09 .00 .61**
commitment

4. Sexb 0.24 0.43 0.40 0.49 -.21* .36*** -.10 -.08 .02 -.18 -.30*
5. Tenure 21.20 11.60 58.32 50.30 -.21* -.07 -.03 -.02 -.19 .08 .33*
6. Education 2.42 0.92 2.23 1.00 -.16 .19* .07 .38*** -.38*** .58*** -.30*

7. Percentage of 0.47 0.18 0.22 0.21 .23** .21* .16 .09 -.19* .14 .09
contingent workers in group

8. Organizationc 0.53 0.50 0.49 0.50 .34*** -.26** .07 -.55*** .07 -.62*** .06

a Correlations above the diagonal are for contingent workers, and correlations below the
coefficients are in parentheses.
b Coding: 0 = female, 1 = male. c Coding: 0 = bank, 1
= hospital.
*p < .05
** p < .01
***p < .001

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

1998
Van Dyne and Ang 699

TABLE 2

Results of Hierarchical Regression Analysis for Effects of Work Status

Organizational Citizenship Psychological Contract Affective Commitment

Variable Model 1 Model 2 Model 1 Model 2 Model 1 Model 2

Sexb .14t .06 .33*** .28*** .03 .00 Tenure -.08 -.17* .08 -.01 .13t .07

Education .12 .07 .16t .09 .26*** .22**


Percentage of contingent workers in group -.07 .10 -.04 .14t -.05 .05 OrganizationC .59*** .52*** .20* .15t .39*** .36***

Work statusd .39*** .39*** .24***


F 8.52*** 11.50*** 3.70*** 6.53*** 3.57*** 4.21***
AF 8.52*** 20.42*** 3.70*** 18.47*** 3.57*** 6.74***
R2 .23 .33 .11 .21 .11 .15
AR2 .10 .10 .04
Adjusted R2 .21 .30 .08 .18 .08 .11

a Model statistics has betas.

b Coding: 0 = female, 1 = male. c


Coding: 0 = bank, 1 = hospital. d Coding:
0 = contingent workers, 1 = regular employee.
p < .10
* p < .05
* pp << .01
.001
** one-tailed
All tests.

TABLE 3

Results of Hierarchical Regression Analysis for Interaction Effects Predicting Organization


Psychological Contract and Work Status Affective Commitment and Wor

Variable Model 1 Model 2 Model 3 Model 1 Model 2 Model 3

Sexb .14' .00 .00 .14t .07 .06


Tenure -.08 -.17* -.18** -.08 -.18** -.19**
Education .12 .05 .03 .12 .05 .02
Percentage of contingent workers in group -.07 .06 .08 -.07 .09 .11t Organizationc .59*** .48*** .42*** .59*** .48*** .44** *

Work statusd .30*** .73*** .35*** 77***


Psychological contract .24*** .44***
Affective commitment .ll .27**
Work status x psychological contract -.54*
Work status x affective commitment -.49*

F 8.52*** 11.87*** 10.98*** 8.52*** 10.28*** 9.45***


AF 8.52*** 15.71*** 3.37* 8.52*** 11.48*** 2.74*
R2 .23 .38 .39 .23 .34 .36
AR2 .15 .01 .11 .02
Adjusted R2 .21 .35 .36 .21 .31 .32

a Model statistics has betas.

b Coding: 0 = female, 1 = male. c


Coding: 0 = bank, 1 = hospital. d Coding:
0 = contingent worker, 1 = regular employee.
p < .10
* p < .05
* p < .01
** p < .001
All one-tailed tests.

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

700 Academy of Management Journal December

FIGURES 2 with a direct effect of its own. More specifically, the


Interaction Results interaction demonstrates three key points: First, regular
employees engaged in more organizational citizenship
Regular
Employee behavior than contingent workers. Second , there was
no relationship between attitudes and behavior for
Organizational regular employees. Third, the relationship between
Citizenship workplace attitudes and organizational citizenship
Behavior Contingent behaviors was positive for contingent workers. We find
Worker
these results intriguing . One possible explanation is
that regular employees in professional jobs perform
Psychological Contract organizational citizenship behaviors out of professionalism
Affective Commitment rather than on the basis of attitudes. Contingent workers,
in contrast, withhold organizational citizenship behaviors
if they do not feel committed or if they do not have
lowed individuals to choose their work status, positive views of their psychological contracts . When
contingent workers exhibited less organizational citizenship contingent workers view their rela- tionships with
behavior, perceived fewer employer obligations to be part organizations positively, they go be- yond what is
of their psychological contracts , and had lower affective required of them. Thus, the behavior of contingent
commitment. We workers is contingent on their attitudes , but the behavior
speculate that the voluntariness of contingent worker of regular employees is independent of their attitudes.
status may be one key reason for the contrast between An alternative explanation focuses on equity theory. The
our results, which support the hypothesized differences affective commitment of contingent workers is lower
in attitudes and behavior, and the results of prior research than that of regular employees. Perhaps their lower
conducted in the commitment is based on feelings of inequity because
United States, where downsizing has forced many to their employers do not invest in them and do not provide
convert involuntarily from regular to contingent them with training, benefits, or job security . Alternatively,
work status. Under conditions of severe labor short- work may be a less central life interest to those who
ages, contingent workers in a given company have external choose contingent work. We recommend that future
mobility and can choose alternative employment. When research on contingent workers includes measures of
people voluntarily select contingent work status, it seems job involvement and professional identification so that
reasonable that they will be less involved in their jobs than these interactions can be examined in more detail.
regular employees and will exhibit less positive attitudes and
be-
I have to work.

Our results also demonstrated significant inter- Overall, our findings have important theoretical active effects of work
status and attitudes (percep- implications because they debunk arethe sweeping
uncom- mentsas-ofsumption that all contingent
the psychological workers
contract and affective
view their work relationships negatively just because they have commitment) explaining
other, non-work variancecitizenship
organizational in peer-rated or- mitted
behavior. and
However,
the nature of the interaction was different from what interests us.
positive
Some social
contingent
exchangeworkers,
relations
in some
with organizations
the organizations.
, have
They
levels of affective commitment, and they engage in high levelshave positive viewscitizenship.
of organizational of their psychological
These workers contracts and the
may view high
flexibility of contingent work and their consequent ability to balance a professional
important inducementcareer and by
provided other lifeorganizations.
their interests as an
expected. Our prediction described work status as an
"enhancer" interaction (Podsakoff, MacKenzie, & Fetter,
1993) that would strengthen the relationship between
attitudes and behavior for regular employees (see Figure
1). We made this prediction because we assumed regular
employees would place more emphasis on work than
contingent workers, who would emphasize nonwork
aspects of life (such as family and studies) and would be
more likely to vary their organizational citizenship behavior
as their attitudes about their relationships with their varied In addition, as discussed above, we suspect that
organizations. some professional contingent workers identify
strongly with their professions and do not perceive
Contrary to expectations, Figure 2 shows a substitute themselves as peripheral, but rather, as core workers
rather than an enhancer type of interaction. working side-by-side with regular professional
As a substitute, work status weakens the effect of employees (cf. Hall, 1969). Future research should
attitudes on behavior while replacing that effect examine organizational culture, type of contingent

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

1998 701
Van Dyne and Ang

worker job, group norms, and individual personality ing organization may offer them regular employment because
characteristics as possible predictors of these positive of their exemplary behavior at work.
outcomes. Although our study demonstrated differences in the
Our results also have practical implications. attitudes and behavior of contingent workers and regular
When organizations treat contingent workers with employees and explained a relatively high amount of the
respect and do not view them as peripheral, some variance in organizational citizenship (23-39 percent), it is
contingent workers will have high commitment to the important to note the boundary conditions of the study. First,
organizations and positive views of their psychological results are based on a sample from Singapore. Second, the
contracts, and they will engage in organizational sample focused specifically on individuals in professional
citizenship-just like regular employees. jobs. Third, we inferred voluntariness from contextual factors
Thus, organizations that are especially concerned and thus could not verify our assumption that taking contingent
about organizational citizenship behavior should pay work was voluntary for our respondents. We recommend that
particular attention to the attitudes of contingent future research measures labor market conditions
workers. Alternatively, they may want to screen the
attitudes of contingent workers and restrict those
with less positive attitudes to areas and jobs in which and actual job alternatives, perceived job opportunities,
discretionary behavior such as organizational perceptions of the extent to which gent work status is voluntary,
citizenship is less critical for customer satisfaction. and perceptions o the extent to which voluntary work status is a
When we turn our attention to regular employees,
they appear less likely to withhold organizational forced choice based on non-work commitments
citizenship behaviors even when they do not possess such as family and school. Whether the findings of our study
high levels of commitment or positive psychological apply to workers in other settings or other types of workers, such
contracts. This too is an interesting finding, and it is, as managers, parapr fessionals, and support or production staff
in fact, consistent with the previous empirical research members, must be examined by future research.
of Williams and Anderson (1991), which showed no
relationship between commitment and organizational Although contingent work in the United States initially focused
citizenship in a sample of professional workers. For on nonprofessional jobs that were often filled by individuals who
regular employees in professional jobs, the willingness could not obtain real employment, there is a growing shortage of
to contribute to an organization beyond what is professionals in the United States, and an increasing number of
required may be determined by professional and professionals are voluntarily choosing contingent work because
organizational norms rather than by personal attitudes. of other commitments , such as family, education, or travel, and/
This may be especially true for those who are or because of a preference for seasonal work or over quality-of-
concerned about their professional reputations life concerns (Mirvis & Hall, 1994; N len & Axel, 1996). Thus,
(Freidson, 1984). reduced supply and increased demand may create labor
shortages in the United States, with a larger number of
We believe that our selection of Singapore, with professionals choosing contingent work because of their personal
its severe labor shortages, as a context for studying preferences. When workers' contingent status is voluntary, we
the differences between contingent workers and would expect their attitudes and behavior to be less positive
regular employees provides unique insights that overall than those regular employees. At the same time, in view
have potential relevance to other contexts where of in which workers have other job options and enter data, we
shortages of professional workers are becoming would also expect some contingent wo into contingent work
more acute (Larkin, 1991 ; McLaughlin, 1988). Se- arrangements more voluntar- ers to view the flexibility of
true labor market conditions create an environment contingent work stat ily than involuntarily. With greater bargaining
as an inducement and expect that these contingent power, contingent workers
reciprocate may contribute
by performing or with-
or holding professionals
discretionary would at
behaviors
work, depending on organizational citizenship behaviors. We suggest that future
their attitudes research
towards should assessInwhen
the organization. (under what
con- conditions on
and
for what types of workers) attitudes change, we do not expect workers
because who enter
of are contingent
related work arrangements
to organizational involuntarily,
citizenship and when
downsizing, to experience the same level of discre- there is no relationship. tion regarding their attitudes and behavior at work.

In conclusion, the current results demonstrate that,


In fact, we speculate that involuntarily contingent workers where severe labor shortages allow individuals to choose
will exhibit positive attitudes and organizational citizenship regular or contingent work status voluntarily, contingent
with the hope that the employ- workers engaged in less orga-

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

702 Academy of Management Journal December

nizational citizenship behavior, expected less of control. In RH Turner & JF Short, Jr. (Eds.),
their employers in their psychological contracts, and Annual review of sociology, vol. 10: 1-20. Palo Alto, CA:
Annual Reviews.
had lower affective commitment. More importantly ,
results also demonstrated the significant effect that Goh, K. 1994. Report on the labor force survey of Singapore.
attitudes have on the behavior of contingent workers. Singapore: Ministry of Labour.
When contingent workers have high commitment to Gouldner, AW 1960. The norm of reciprocity. American
their organizations and when they have positive Sociological Review, 25: 165-167.
attitudes about their psychological contracts with Hall, RH 1969. Occupations and the social structure.
the organizations, they exhibit high levels of Englewood Cliffs, NJ: Prentice-Hall.
organizational citizenship. This observation suggests
Howe, WJ 1986. Temporary help workers: Who they are, what
that when professional contingent workers feel they
jobs they hold. Monthly Labor Review, 109 (November):
are treated well by an organization, they are good 45-47.
citizens and reciprocate by contributing organizational
Hulin, CL, Roznowski, M., & Hachiya, D. 1985. Alternative
citizenship behaviors to it.
opportunities and withdrawal decisions: Empirical and
theoretical discrepancies and an integration . Psychological
REFERENCES Bulletin, 97: 233-250.
Kalleberg,
KM, & Edwards, JR 1995. Employees at risk: ment: Economic and sociological AL,
Relations, 45: & Reve, T.on1992.
perspectives
1103- Contracts
employment and commit-
relations. Beard,
Human
Contingent work and the psychological experience of contingent work.
In CL Cooper & DM Rousseau
(Eds.), Trends in organizational behavior, vol. 2: 109-126. 1132.
New York: Wiley. Kalleberg, AL, & Schmidt, K. 1997. Contingent em ment in
1997. Guanxi networks and job mo- P. Marsden, & J. Spaeth (Eds.),organizations.
Forces, In AL
Organizations
75: America: Kalleberg,
bility in ChinaD.
Analyzing Kno
their
and Bian, Y.,and
Singapore.
structures & Ang,
Social S.
human
resource practices: 253-275. New York: Sage.
981-1005.

Bin, HJ, Liew, I., & Kang, AB 1996. The organiza- Kidder, DL 1995. On call or
answering
workforce in information systems, MBA thesis, Nanyang Technological a calling?Singapore.
University, national psychology of contingent
Temporary nurses and extra-role behaviors. Paper
presented at the annual meeting of the Academy of
Management, Vancouver.
Blau, P. 1964. Exchange and power in social life. New Konovsky, MA, & Pugh, SD 1994.
Citizenship behav- York: Wiley.
ior and social exchange. Academy of Management Journal,
Cappelli, P. 1995. Rethinking employment. British Journal of Industrial Relations,
37: 33:
656-669.
563-602.
Krausz, M., Brandwein, T., & Fox, S. 1995. Work atti-
Cappelli, P., & Sherer, PD 1991. The missing role of context in OB: The need
attitudes and emotional responses of permanent,
for a meso-level approach.
voluntary, and involuntary temporary-help employees: An
In LL Cummings & BM Staw (Eds.), Research in organizational behavior, vol. 13:
exploratory study. In M. Freese (Ed.), Applied psychology:
55-110. Greenwich , CT: JAI Press.
An international review, vol. 44: 217-232.
London: Erlbaum.
Cheng, SM 1989. Worker participation in private companies in Singapore:
Kunin, T. 1955. The construction of a new type of attitude measure.
Corporate and individual orientations. In A. Nedd, GR Ferris, & KM Rowland
(Eds.), Research in personnel and human resources management, Personnel
suppl. Psychology, 8: 65-78.
1: 97-120. Greenwich, Larkin, JM 1991. Seeing the light: Recruiting accounting
professionals in the 90's. Pennsylvania CPA Journal, 61(3):
CT: JAI Press. 7-10.
Chew, SB 1996. Labor flexibility in Singapore. In GTS Mangum, G., Mayall, D., & Nelson, K. 1985. The temporary
Thong (Ed.), Human resource issues in Singapore: help industry: A response to the dual internal
31-50. Singapore: Addison-Wesley. labor market. Industrial and Labor Relations Re-
view, 38: 599-611.
Chew, SB, & Chew, R. 1995. The development of industrial
relations strategy in Singapore. In A. Verma, TA Kochan, McLaughlin, M. 1988. As the nursing shortage worsens,
& RD Lansbury (Eds.), Employment relations in the temporary agency's revenues keep climbing. New England
growing Asian economies: 62-87. Business, 10(9): 55-56.
London: Routledge. Meyer, JP, & Allen, NJ 1984. Testing the "side-bet"
Chew, SB, & Chew, R. 1996. Industrial relations in theory of organizational commitment: Some methodological
Singapore industry. Singapore: Singapore University . considerations. Journal of Applied Psychology , 69: 372-378.

Freidson, E. 1984. The changing nature of professional Mirvis, PH, & Hall, DT 1994. Psychological success

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms
Machine Translated by Google

1998
Van Dyne and Ang 703

and the boundaryless career. Journal of Organizational Sherer, PD 1996. Toward an understanding riety in work arrangements:
Behavior, 15: 365-380. The organized labor relations framework. In CL
Mowday, RT, Porter, LW, & Steers, RM 1982. Em-
employee-organizational linkages: The psychology of DM Rousseau (Eds.), Trends in organizational behavior,
commitment, absenteeism, and turnover. New vol. 3: 99-122. New York: Wiley
York: Academic Press.
Shore, LM, & Wayne, SJ 1993. Commit employee behavior:
Comparison
contingent work- ment and continuance commitment with ers. New York: American of affective Nollen, S., & Axel, H. 1996. Managing
Management.

organizational
Organizational citizenship behavior, 78: 774-780. ior: The good soldier syndrome. support.
Lexington, MA:Journal of Applied
Lexington Books. Organ, DW 1988.

Smith, PC, Kendall, LM, & Hulin, CL 1969. The


measurement of satisfaction in work and retire- Organ, DW
1990. The motivational basis of organization . Chicago: Rand McNally. national citizenship behavior. In BM Staw & LL

Cummings (Eds.), Research in organizational be- Tansky, JW, Gallagher, DG, & Wetzel, KW 1995. The behavior, vol. 12: 43-72.
Greenwich, CT: JAI Press. changing nature of the employment contract: The impact of part-time workers on the health care
contract laborers: Their psychological involvement industry.
Pearce, JL 1993. Toward an organizational behavior of Paper presented at the annual meeting of and effects on
employee co-workers. Academy of the Academy of Management, Vancouver.

Management Journal, 36: 1082-1096.


Thong, G. 1996. Human resource issues in Singapore.
Pfeffer, J., & Baron, JN 1988. Taking the workers back Singapore: Addison-Wesley. out: Recent trends in the
structuring of employment.
Van Dyne, L., Graham, JW, & Dienesch, RM 1994.
In BM Staw & LL Cummings (Eds.), Research in organizational
Organizational citizenship behavior: Construct re -definition,
behavior, vol. 10: 257-303. Greenwich , CT: JAI Press.
operationalization, and validation. Academy of Management
Journal, 37: 765-802 .
Pfeffer, J., & Lawler, J. 1980. Effects of job alternatives, extrinsic rewards, and
behavioral commitment on Van Dyne, L., & LePine, JA 1998. Helping and voice extra-role
attitude towards the organization: A field test of the behaviors: Evidence of construct and predictive validity.
insufficient justification paradigm. Administrative Science Academy of Management Journal,
41: 108-119.
Quarterly, 25: 38-56.
Podsakoff, PM, MacKenzie, SB, & Fetter, R. 1993. Verma, A., Kochan, TA, & Lansbury, RD 19 sons from the Asian
Substitutes for leadership and the management of experience: A summary Verma, TA Kochan, & YRD Lansbury
professionals. Leadership Quarterly, 4: 1-44. Employment relations in the growing Asian omies: 336-357.
Polivka, AE, & Nardone, T. 1989. The definition of con- London: Routledge.
tingent work. Monthly Labor Review, 112: 9-16.
Williams, LJ, & Anderson, SE 1991. Job satisfaction
Porter, G. 1995. Attitude differences between regular and contract
employees of nursing departments. and organizational commitment as predictors organizational
Paper presented at the annual meeting of the Academy of citizenship and in-role behaviors. Journal of Management, 17:
Management, Vancouver. 601-617.
Robinson, SL, Kraatz, MS, & Rousseau, DM 1994.
Changing obligations and the psychological contract: A
Linn Van Dyne is an assistant professor at Michigan University. She received her
longitudinal study. Academy of Management Journal, 37:
137-152. Ph.D. from the University of Minnesota with a concentration in strategic managemen
and organization. Her major research interest is p employee behaviors involving
Rousseau, DM 1995. Psychological contracts in initiative, such as a tive and challenging extra-role behavior and
organizations : Understanding written and unwritten
agreements. Thousand Oaks, CA: Sage.
influence.
Rousseau, DM 1997. Organizational behavior in the
new organizational era. In JT Spence, JM Darley, & DJ
Foss (Eds.), Annual review of psychology, vol. 48: Soon Ang is head of the Division of Human Resource and
515-546. Palo Alto, CA: Annual Reviews.
Quality Management at the Nanyang Business School, Nanyang
Settoon, RP, Bennett, N., & Liden, RC 1996. Social Technological University, Singapore. She received her Ph.D.
exchange in organizations: Perceived organizational from the University of Minnesota. Her major fields of interests
support, leader-member exchange, and employee are outsourcing and contracting, managing information technology
reciprocity. Journal of Applied Psychology, 81: professionals, and cross-cultural competencies.
219-227.

This content downloaded from


86.120.131.165 on Fri, 02 Dec 2022 19:17:27 UTC
All use subject to https://about.jstor.org/terms

You might also like