Professional Documents
Culture Documents
Parker 2011
Parker 2011
394 www.jonmd.com The Journal of Nervous and Mental Disease & Volume 199, Number 6, June 2011
Copyright © 2011 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
The Journal of Nervous and Mental Disease & Volume 199, Number 6, June 2011 Validation of the WWQ
29.2 days (SD, 29.2 days) and with their depression severity at each titled ‘‘Work Satisfaction,’’ with the highest loading items capturing
test occasion quantified using the Depression in the Medically Ill the respondents’ judgments of the extent to which they viewed their
(DMI-10) measure [17] on each occasion. work as fulfilling and whether their work increased their sense of
Finally, a calibration study was undertaken. To derive the self-worth, provided life with some purpose and meaning, and ad-
scale norms for representative population groups differing on socio- vanced their skills. This factor accounted for 18.8% of the variance.
demographic and work level variables, a large sample was derived The second factor, ‘‘Organizational Respect for the Employee’’
by seeking volunteers via our website (blackdoginstitute.org.au) to (13.5% of the variance), was characterized by items indicating that
complete the measure in relation to their current or, if unemployed, the respondent judged senior organization representatives as trust-
most recent job. In addition to the online completion of the 31-item worthy, as having ethical values, and as valuing staff and treating
questionnaire, all participants completed six additional questions them well. The third factor, named ‘‘Employer Care’’ (10.9% of the
providing information on their occupational level (i.e., professional, variance), had items weighted to the individual ‘‘boss’’ (rather than
managerial, sales worker, technical/trade worker, laborer, machinery to the organization, as in the previous factor). These items encap-
operator/driver, clerical/administrative, and community/personal ser- sulated judgments of the boss: whether he or she was caring, willing
vice worker), job type, length of employment, age, gender, and to lend an ear, and understanding about work concerns and treated
earning status (e.g., salaried, paid by the hour, contract). the employees as they sought. The fourth factor, ‘‘Intrusion of Work
into Private Life’’ (9.3% of the variance) was a negative factor, with
RESULTS high loading items capturing whether the individual felt stressed and
pressured at work to meet the targets, found it hard to ‘‘wind down’’
Refinement of the Measure after work, and judged that work ate into their private life and
A principal component analysis was undertaken using a Scree whether the work impacted on their self-esteem. We then derived the
plot indicating that four factors were sufficient, and with those four final measure by deleting items that had content and factor loadings
factors accounting for 52.5% of the variance. The first factor was indicating overlap and others that had low factor loadings.
TABLE 1. Varimax-Rotated Component Matrix Item Correlations of the Four-Factor Model of Workplace Well-Being
Item Factor 1 Factor 2 Factor 3 Factor 4
Is your work fulfilling? 0.83
Do your daily work activities give you a sense of direction and meaning? 0.82
Does your work bring a sense of satisfaction? 0.82
Does your work increase your sense of self-worth? 0.78
Does your job allow you to recraft your job to suit your strengths? 0.64
Does your work make you feel that, as a person, you are flourishing? 0.62
Do you feel capable and effective in your work on a day-to-day basis? 0.57
Does your work offer challenges to advance your skills? 0.56
Do you feel you have some level of independence at work? 0.56
Do you feel personally connected to your organization’s values? 0.52
In general terms, do you trust the senior people in your organization? 0.79
Do you believe in the principles by which your organization operates? 0.75
Do you feel content with the way your organization treats its employees? 0.75
Do you feel that your organization respects the staff? 0.70
How satisfied are you with your organization’s value system? 0.66
Compared with your organization’s ‘‘ideal values,’’ to what degree are actual work values positive? 0.61
Do people at your work believe in the worth of the organization? 0.56
At a difficult time, would your boss be willing to lend an ear? 0.83
Is your boss caring? 0.81
Do you feel that your boss is empathic and understanding about your work concerns? 0.77
Does your boss treat you as you would like to be treated? 0.74
Does your boss shoulder some of your worries about work? 0.73
Do you feel your transactions with your boss are, in general, positive? 0.71
Do you believe that your employer cares about his or her staff’s well-being? 0.48
Does your work eat into your private life? 0.77
Do you feel stressed in organizing your work time to meet demands? 0.77
Do you feel excessively pressured at work to meet targets? 0.76
After work, do you find it hard to wind down? 0.75
Do you find yourself thinking negatively about work outside of work hours? 0.60
Do you feel that you can separate yourself easily from your work when you leave for the day?a j0.55
Does your work impact negatively on your self-esteem? 0.54
The completion instructions were ‘‘Please answer the following questions by checking the appropriate box. Choose the option that best represents your current and most relevant
work situation (i.e., the work role where you spend most of your time and with who you have most contact).’’ The scoring for each factor involved summing the scores from each item
(Note: reverse scoring of one item for the ‘‘Intrusion of Work into Private Life’’ factor).
a
Denotes reverse scored item.
Copyright © 2011 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
Parker and Hyett The Journal of Nervous and Mental Disease & Volume 199, Number 6, June 2011
Table 1 reports the highest loading items on each of the four nonprofessional/nonsupervisory/nonmanagerial group (mean, 15.1;
derived factors, containing 10 items from the first factor and seven SD, 8.6; F = 34.9, df = 1, p G 0.0001). There was greater per-
from each of the three other factors. The mean (SD) scores were 20.9 ceived Intrusion of Work into Private Life in the professional/
(8.7), 14.5 (6.5), 14.6 (7.2), and 10.9 (5.0), respectively. Intercorre- supervisory/managerial group (mean, 15.2; SD, 6.4) compared with
lation of the factor scores indicated that factors 1 and 2 were mod- the nonprofessional/nonsupervisory/nonmanagerial group (mean, 14.4;
erately correlated (r = 0.64, p G 0.001), as were factors 1 and 3 SD, 6.5; F = 4.3, df = 1, p = 0.038). We categorized the length of time
(r = 0.45, p G 0.001), whereas factors 2 and 3 were more highly in any current position as a) 0 to 2 years, b) 2.1 to 5 years, c) 5.1 to
correlated (r = 0.72, p G 0.001). Factor 4 scores were negatively 10 years, d) 10.1 to 20 years, and e) 20.1 years or more. A linear
correlated with factors 1, 2, and 3 (r = j0.19, p = 0.024; r = j0.39, regression analysis indicated no impact on Work Satisfaction scores.
p G 0.001; r = j0.42, p G 0.001), respectively. However, with longer employment came decreased scores on Organi-
zational Respect for the Employee (A = j0.57, df = 1, p G 0.0001),
Test-Retest Reliability and Impact of Depressed decreased scores on Employer Care (A = j0.55, df = 1, p = 0.001)
Mood on Scale Scores and increased scores on Intrusion of Work into Private Life (A = 0.54,
The contribution of depression severity to questionnaire scores df = 1, p G 0.0001).
was partitioned out by regressing each individual factor score on the Gender effects were found for two of the four scales, with the
DMI-10 (Parker et al., 2002) depression severity scores at both test women rating Work Satisfaction higher than the men (17.5 vs. 16.1;
and retest occasions and then saving the unstandardized residuals as F = 6.5, df = 1, p = 0.01) and also scoring higher on Organizational
variables. These residuals were then correlated to quantify test-retest Respect for the Employee (11.5 vs. 10.5; F = 5.6, df = 1, p = 0.02).
reliability. The Pearson correlations (all significant at P G 0.001) were As previous research has identified differential work satisfaction for
quantified as r = 0.85 for Work Satisfaction with scale means of test, those engaged in full-time work (and employed by an organization)
25.0 (SD, 7.9) and retest, 23.8 (SD, 7.5); r = 0.83 for Organizational versus those who charge by the hour or who are self-employed (Benz
Respect for the Employee with scale means of test, 17.1 (SD, 7.8) and Frey, 2008), the latter two categories were collapsed into one cat-
and retest, 16.17 (SD, 6.7); r = 0.81 for Employer Care with scale egory (‘‘contractor’’) and were compared against ‘‘salaried’’ workers
means of test, 17.9 (SD, 8.0) and retest, 16.8 (SD, 7.4); and r = 0.78 on each of the scales. No scale score differences were identified.
for Intrusion of Work into Private Life with scale means of test,
12.4 (SD, 5.8) and retest, 13.3 (SD, 5.9). For the overall scale, the DISCUSSION
correlation for the residuals was r = 0.83 with total scale means of We believe that this is the first measure of workplace satisfac-
test, 72.5 (SD, 20.0) and retest, 69.9 (SD, 19.8). When not considering tion to be developedVwith the measurement of multiple constructs
any impact of state depression, standard test-retest correlations revealed in a single questionnaire being a primary objectiveVwhile adhering
a similar pattern of results using Pearson r values of 0.91, 0.95, 0.87, to the concepts already established in the well-being and positive
and 0.71 for factors 1 to 4, respectively (all p G 0.0001), and r = 0.91 psychology literature. Four factors accounted for 53% of the variance,
( p = 0.0001) for the overall scale. and the identification of the first factor as capturing Work Satisfaction
Calibration Study is encouraging in suggesting the face validity of the measure. The next
two scales capture bidirectional work contributions, thus assessing the
We ceased recruitment when we had 1218 fully completed
degree to which the employee respects the employer and, second, the
questionnaires. Because this was an online questionnaire, we were
extent to which the employer cares for the employee. The final scale
able to collect the Internet provider addresses of the participants and
captures an important componentVthe extent to which work intrudes
cross-check against age and employment category data to narrow the
into private life. Therefore, the derived scales appear salient. We dem-
possibility that the questionnaires might have been completed more
onstrated high test-retest reliability for individual and total scale scores
than once by the same person. This resulted in only 12 likely such
and found no distinct impact of depressed mood state on scale com-
duplicates being identified, and for these 12, only the first completed
pletion. We did find several gender and socioeconomic effects on scale
questionnaire data were used. The subsequent analyses report on the
scores, but these were not as distinctive as we had presupposed.
remaining 1206 participants, consisting of 823 females and 383
As an experiential subjective measure, it should be antici-
males.
pated that there would be major personality effects on the scoresVas
We recoded the job level by first collapsing the forced-choice
for any subjective measure. We respect a tenet of psychiatry and
response of nine levels to two, so that ‘‘managerial’’ and ‘‘professional’’
psychologyVthat people are disturbed less by things and more by
became a ‘‘professional/supervisory/managerial’’ group (n = 741) and
their perception of things. If it is accepted that it is perception
the remaining categories of employment became a ‘‘nonprofessional/
that mattersVand this seems to be valid for subjective well-beingV
nonsupervisory/nonmanagerial’’ group (n = 465). These two catego-
then personality becomes peripheral. Nevertheless, weVand other
ries have been used in previous meta-analyses of job satisfaction
researchersVmay well wish to examine the impact of a range of
(Petty et al., 1984). So that no individual case was misrepresented
personality factors on measure scores in later studies. Furthermore,
we next identified open-ended responses to the employment position
contextual biases could compromise self-report scores. For example,
where participants described their work role in more detail (e.g., a
an aggrieved worker might give harshly critical responses. Con-
counselor who coded themselves as a community services worker
versely, an employee that was too dependent on the organization
was recoded as a professional, assuming that some degree of tertiary
(or who judged that their scores might be identifiable) might return
study is required for the differential coding). Each case was checked
overly positive responses. Such biases need to be recognized in con-
against the two broad categories, and 47 changes were made to reflect
sidering applications of the measure.
the nonprofessionals who should have otherwise been coded as pro-
fessionals, resulting in a group of 785, whereas there were only three
instances of professionals being recoded as nonprofessionals, resulting CONCLUSIONS
in a group of 421. How might the current measure be used? An individual might
The derived scale scores were compared for the two compari- wish to compare their scores against the scale scores derived in our
son groups. An analysis of variance showed higher Work Satisfac- studies. Alternatively, an organization might wish to obtain a profile
tion scores being returned by those in the professional/supervisory/ of its impact on the well-being (or workplace ‘‘stress’’) of its staff
managerial group (mean, 18.1; SD, 8.2) compared with those in the and have the form returned anonymously by representative staff
Copyright © 2011 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
The Journal of Nervous and Mental Disease & Volume 199, Number 6, June 2011 Validation of the WWQ
members, as a general assessment or as a ‘‘before and after’’ measure Huppert FA, Baylis N, Keverne B (2005) The science of well being. Oxford, UK:
quantifying any organizational structural change. However, an organi- Oxford University Press.
zation considering the use of the instrument would need to recognize Iaffaldano MT, Muchinsky PM (1985) Job satisfaction and job performance: A
meta-analysis. Psychol Bull. 97:251Y273.
that any findings would reflect more on their employees than on the
workplace itself. In relation to the latter, we plan to derive a database Ironson GH, Smith PC, Brannick MT, Gibson WM, Paul KB (1989) Construction
of a Job in General Scale: A comparison of global, composite, and specific
of scores across differing workplaces so that the reference will reflect measures. J Appl Psychol. 74:193Y200.
some identified sex and sociodemographic influences. The measure Judge TA, Thoresen CJ, Bono JE, Patton GK (2001) The job satisfaction-job
may be used currently as a ‘‘paper’’ test, although we anticipate im- performance relationship: A qualitative and quantitative review. Psychol Bull.
plementing a Web-based version for anonymous completion and for 127:376Y407.
rapid generation of scores. Klein S (2006) The science of happiness. Carlton, Australia: Scribe.
Kunin T (1955) The construction of a new type of attitude measure. Pers Psychol.
8:65Y78.
ACKNOWLEDGMENTS
Marmot MG, Davey Smith G, Stansfeld S, Patel C, North F, Head J, White I,
We thank Dusan Hadzi-Pavlovic for statistical advice, Kerrie Brunner E, Feeney A (1991) Health inequalities among British civil servants:
Eyers for editorial assistance, and the subjects and staff for contrib- The Whitehall II study. Lancet. 337:1387Y1393.
uting to the data collection. Parker G, Hilton T, Bains J, Hadzi-Pavlovic D (2002) Cognitive-based measures
screening for depression in the medically ill: The DMI-10 and DMI-18. Acta
REFERENCES Psychiatr Scand. 105:419Y426.
Benz M, Frey BS (2008) Being independent is a great thing: Subjective evaluations Peterson C, Park N, Seligman MEP (2005) Assessment of character strengths. In GP
of self-employment and hierarchy. Economica. 75:362Y383. Koocher, JC Norcross, SS Hill III (Eds) Psychologists’ Desk Reference (2nd ed,
pp 95Y98). New York: Oxford University Press.
Cloninger CR (Ed) (2004) Feeling good: The science of well-being. Oxford, UK:
Oxford University Press. Petty MM, McGee GW, Cavender JW (1984) A meta-analysis of the relationships
between individual job satisfaction and individual performance. Acad Manage
Danna K, Griffin RW (1999) Health and well-being in the workplace: A review and Rev. 9:712Y721.
synthesis of the literature. J Manage. 25:357Y384.
Putnam RD (2000) Bowling alone. Sydney, Australia: Simon & Schuster.
Diener E (2000) Subjective well-being: The science of happiness and a proposal Ryan RM, Deci EL (2001). On happiness and human potentials: A review of
for a national index. Am Psychol. 5:34Y43. research on hedonic and eudaimonic well-being. Annu Rev Psychol. 52:
Diener E, Emmons RA, Larsen RJ, Griffin S (1985) The satisfaction with life scale. 141Y166.
J Pers Assess. 49:71Y75. Smith PC, Kendall LM, Hulin LL (1969) The measurement of satisfaction in work
Folland S (2007) Does ‘community social capital’ contribute to population health? and retirement. Skokie, IL: Rand McNally.
Soc Sci Med. 64:2342Y2354. Weiss DJ, Dawis RV, England GW, Lofquist LH (1967) Manual for the Minnesota
Harter JK, Schmidt FL, Keyes CL (2002) Well-being in the workplace and its Satisfaction Questionnaire. Minneapolis, MN: University Minnesota, Industrial
relationship to business outcomes: A review of the Gallup studies. In CL Keyes, of Relations Center.
J Haidt (Eds) Flourishing: The positive person and the good life (pp 205Y224). Wrzesniewski A, McCauley CR, Rozin P, Schwartz B (1997) Jobs, careers, and
Washington, DC: American Psychological Association. callings: People’s relations to their work. J Res Pers. 31:21Y33.
Copyright © 2011 Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.