Professional Documents
Culture Documents
Measurement of Job Characteristics Comparison of T
Measurement of Job Characteristics Comparison of T
Paul H. Langner
Animal Health Services, Wyeth Laboratories
Philadelphia, Pennsylvania
This study contrasted the original version of the Job Diagnostic Survey (JDS; Hackman & Oldham,
1975) with the revised version recently proposed by Idaszak and Drasgow (1987). A total of 224
dairy workers completed both versions of the JDS. Results of a confirmatory factor analysis showed
that the revised JDS job characteristics items conformed more closely to the hypothesized five-factor
structure than did the original JDS items. However, results of LISREL analyses indicated that the
revised items did not improve the usefulness of the JDS in predicting several outcomes (e.g., satisfac-
tion, internal motivation, and productivity).
In its most general form, job characteristics theory (Hack- dimensions plus one or two method factors (factors for the re-
man & Oldham, 1980) posits that five job characteristics (au- verse-scored items and the three-anchor scale items).
tonomy, task identity, task significance, skill variety, and task In response to these criticisms, Idaszak and Drasgow (1987)
feedback) prompt a number of personal and organizational out- revised the JDS by rewriting the reverse-scored job characteris-
comes. Nearly all of the research that has tested the theory has tics items. The factor structure of the revised JDS was then
used the Job Diagnostic Survey (JDS; Hackman & Oldham, investigated for a sample of printing plant employees. The re-
1975), an instrument designed to measure incumbents' percep- sulting factor structure conformed very closely to the a priori
tions of the job characteristics, their satisfaction, and internal five-dimension structure. As a result, Idaszak and Drasgow con-
motivation. cluded that the new scales should be used in future research
Much of the research regarding the JDS has focused on the concerned with job characteristics.
dimensionality of the job characteristics measures (cf. Dun- Two limitations of the research on the revised instrument
ham, 1976; Dunham, Aldag, & Brief, 1977). Although a few lead us to believe that this recommendation may be premature.
studies have confirmed the five hypothesized job dimensions First, the Idaszak and Drasgow (1987) study did not involve a
(e.g., Katz, 1978; Lee & Klein, 1982), most have reported solu- comparison of the original JDS with its revised counterpart
tions inconsistent with the a priori five-factor structure (e.g., within the same sample. As demonstrated by Dunham et al.
Dunham, 1976; Pierce & Dunham, 1978). (1977), some samples display a five-factor structure when the
Recent research has examined the possibility that the JDS original JDS is used. Thus, it is possible that the five-factor
itself might be responsible for these factor structure inconsis- structure observed by Idaszak and Drasgow is a function of the
characteristics of the sample they used to assess the instrument.
tencies. Idaszak and Drasgow (1987) conducted factor analyses
Second, it is unknown what impact the JDS revisions might
of two samples of employees. Results revealed six-factor solu-
have on the criterion-related validity of the JDS. If the JDS revi-
tions for both samples—five factors corresponding to the hy-
sions result in "purer" measures of the job characteristics, there
pothesized factor structure and the sixth representing the nega-
should be stronger associations between the revised measures
tively worded, reverse-scored JDS items. Harvey, Billings, and
and the personal and organizational outcomes than between the
Nilan (1985) used confirmatory factor analysis to evaluate the
original measures and the outcomes.
factor structures suggested in past research. Their results sug-
The present research uses confirmatory factor analysis to ex-
gested that the best fitting solution included the five a priori
amine whether the revised JDS items conform more closely to
the a priori factor structure than do the original JDS items
within the same sample. We also use LISREL analyses to assess
the relative effectiveness of the two instruments in predicting
The authors thank Fritz Drasgow, Doug May, and Motohiro Mori-
several outcomes. LISREL is useful in examining the psychomet-
shima for their help with the data analyses. Robert Billings, Jeanne
Brett, Fritz Drasgow, and Motohiro Morishima provided helpful com- ric properties of the original and revised JDS because it allows
ments on earlier drafts of this article. us to separate the measurement model from the structural
Correspondence concerning this article should be addressed to Carol model. Specifically, we expect that the structural model would
T. Kulik, Graduate School of Industrial Administration, Carnegie Mel- not differ across the two versions of the JDS, but there should
lon University, Schenley Park, Pittsburgh, Pennsylvania 15213. be improvements in the measurement model.
462
JOB CHARACTERISTICS 463
Correlational Analysis
Results
We next examined relations between the job characteristics
Confirmatory Factor Analysis
and outcomes. The original three items from the JDS were aver-
A reduced correlation matrix, using squared multiple corre- aged to obtain a summary score for each of the five job charac-
lations as communality estimates, was obtained for all 20 (15 teristics. A second set of summary scores for each of the five
original and 5 revised) JDS items. This matrix was then submit- characteristics was next obtained by replacing the negatively
ted to a six-factor confirmatory factor analysis. In this analysis, worded item in each scale with the revised item. To obtain a
only the parameters consistent with Job Characteristics Theory summary measure of the job characteristics, a motivating po-
were set free. For example, the three positively worded auton- tential score was formed for both the original and revised JDS
omy items were allowed to load on the autonomy factor but using the formula suggested by Hackman and Oldham (1975).
fixed to load zero on all other factors. The negatively worded Summary scores for the growth satisfaction, internal motiva-
items were allowed to load on their respective content factor tion, and intention to quit measures were obtained by averaging
and on the sixth factor, but constrained to zero on all others. the items tapping these variables.
This analysis yielded x2( 150, N = 224) = 313.24, p < .001, indi- Correlations between the job characteristics measures and
cating a significant discrepancy between the factor model and outcome measures are shown in Table 2. The pattern of corre-
the observed data. An alternative indication of fit can be ob- lations for the original and revised version of the JDS is very
tained by examining the ratio of the chi-square to its degrees of similar. Contrasts between corresponding elements of the corre-
freedom. If the ratio is less than 2.0, a reasonably good fit is lation matrices for the original and revised JDS were performed
indicated. In our analysis, a ratio of 2.09 was obtained, once using Hotelling's t test of the significance of the difference be-
again indicating a statistically poor fit. tween correlations for correlated samples. Of the 30 possible
The modification indexes (Joreskog & Sorbom, 1985) associ- contrasts, only 2 were significant. Growth satisfaction was more
ated with this factor analysis were then examined. A modifica- strongly related to the revised task identity measure than to the
tion index estimates how much the fit of the model can be im- original, Z(221) = 3.86, p < .01; internal motivation was more
proved by setting the corresponding parameters free. All of the strongly related to the original autonomy measure, ((221) =
parameters that were already free in the model have modifica- 1.99,/x.OS.
464 C. KULIK, G. OLDHAM, AND P. LANGNER
Table 1
Six-Factor Maximum Likelihood Solution for the Original and Revised Job Diagnostic Survey Items
Factor/Item 1 2 3 4 5 6
Skill variety
1 .66 (.07)
2 .45 (.09) .52 (.15) -.18(.15)
3" .44 (.08) .15 (.09)
4" .79 (.06)
Task significance
5 .80 (.06)
6 .48 (.07)
7* .38 (.10) .40 (.10)
8" .67 (.07)
Task identity
9 -.16 (.16) .31 (.11) .09(.ll) .60(.19)
10 .75 (.06)
11" .61 (.08) .30 (.09)
12" .79 (.06)
Autonomy
13 .54 (.10) .27 (.12)
14 -.26 (.18) .98 (.17) -.11 (.24)
IS" .49 (.10) .40 (.10)
16» .59 (.07)
Feedback
17 .57 (.07)
18 .53 (.07)
19" .52 (.09) .31 (.10)
20b .46 (.07)
LISREL Analyses The 15 JDS items were used as observed measures of the in-
dependent latent constructs. A 5 X 5 submatrix, corresponding
The computer program LISREL (Version 5, Joreskog & Sor-
to the correlations among the JDS construct factors, was ex-
bom, 1985) was used to obtain maximum likelihood estimates.
tracted from the factor correlation matrix shown in Table 1.
It also provides a chi-square statistic and other goodness-of-fit
The correlation matrix of the JDS latent variables was set equal
measures that represent the overall adequacy of the model. We
to this 5 X 5 matrix and was held fixed at these values to reduce
investigated two structural models. In both, the 15 JDS items
the standard errors of elements in the gamma matrix.
were taken as manifest indicators of a set oflatent independent
Because only single measures of milk production and fresh-
variables (the a priori job dimensions). The remaining items
ening interval were available, the two productivity measures
were taken as manifest indicators oflatent dependent variables.
were assumed to have perfect reliabilities, and the parameter
Two parallel LISREL analyses were performed. In both analy-
values for the paths from the measures to the productivity con-
ses, a 28 X 28 matrix of correlations was input to LISREL (the structs were set equal to one. Because the other dependent vari-
15 JDS items and the 13 dependent variable items). In the first ables had multiple measures, paths from the first items of each
LISREL analysis, the specifications for the factor loading matrix construct to the construct factor were fixed at one. This sets the
for the original JDS items were identical to the ones from the scales of the latent factors equal to the scales of the first items
previous confirmatory factor analysis. That is, any factor load- measuring the constructs (Pedhazur, 1982).
ings corresponding to original JDS items that were free parame- The factor loadings of the individual items on the JDS con-
ters in the confirmatory factor analysis were free parameters in structs obtained in the LISREL analyses were examined and
the LISREL analysis. In the second analysis, specifications for the found to be virtually identical to those obtained in the confir-
factor loading matrix for the revised JDS items were identical matory factor analysis. Thus, the factor loadings are not re-
to those in the previous confirmatory factor analysis. ported here, and are available on request from the authors. The
JOB CHARACTERISTICS 465
Table 2
Correlations Between the Original and Revised Job Diagnostic Survey (JDS) Dimensions and the Outcomes
Outcome
Original version
Skill variety
(a = .58) .39** .26** -.27** -.04 .08
Task significance
(« = .53) .35** .35** -.18** -.12* .03
Task identity
(« = .73) .32** .19** -.19** .05 .17*
Autonomy
(a = .68) .53** .30** -.35** .05 .11
Feedback
(« = .60) .38** .32** -.22** .05 .10
Motivating potential score .53** .36** -.34** .05 .12*
Revised version
Skill variety
(a - .74) .42** .26** -.25** -.05 .08
Task significance
(a = .65) .39** .33** -.19** -.13* .06
Task identity
(a = .78) .43** .22** -.22** .04 .16*
Autonomy
(a = .70) .51** .24** -.30** .01 .12
Feedback
(a = .56) .43** .30** -.20** .02 .05
Motivating potential score .57** .33** -.29** .00 .12*
Note. N = 224.
*p<.05.**p<.01.
Table 4
Maximum Likelihood Estimates of Gamma Elements
Revised version
Skill variety -.42 (.10)** -.21 (.10)* .30 (.11)* -.41 (.14)** -.25 (.14)
Task significance .29 (.12)* .17(.13) -.28 (.15) .06 (.18) .09 (.18)
Task identity -.22 (.09)* -.20(.ll)* .20 (.09) -.08 (.13) .15 (.13)
Autonomy .85 (.13)** .45 (.12)** -.71 (.14)** .27 (.16) .32 (.16)*
Feedback -,06(.15) .16(.15) .21 (.18) .05 (.20) -.16 (.20)
Note. N= 189. Standard errors of parameter estimates are in parentheses.
*p<.05. **;><.01.
five-factor structure proposed by Job Characteristics Theory Dunham, R. B. (1976). The measurement and dimensionality of job
than did the original JDS items. However, results of LISREL characteristics. Journal of Applied Psychology, 61, 404—409.
analyses demonstrated that the revised items did not generally Dunham, R. B., Aldag, R. J., & Brief, A. P. (1977). Dimensionality of
improve the JDS's usefulness in predicting several outcomes. task design as measured by the Job Diagnostic Survey. Academy of
Management Journal, 20,209-223.
Although Idaszak and Drasgow (1987) suggested that future
Hackman, J. R., & Oldham, G. R. (1975). Development of the Job Di-
research substitute their items for the original JDS items, our
agnostic Survey. Journal of Applied Psychology, 60, 159-170.
results suggest that such a substitution may be premature. Not
Hackman, J. R., & Oldham, G. R. (1980). Work redesign. Reading,
only are the revised items likely to have little impact on the MA: Addison-Wesley.
overall criterion-related validity of the job characteristics mea- Harvey, R., Billings, R., & Milan, K. (1985). Confirmatory factor analy-
sures, but the revisions make difficult comparisons with earlier sis of the Job Diagnostic Survey: Good news and bad news. Journal
research efforts using the original JDS. of Applied Psychology, 70,461-468.
Therefore, rather than using the revised items, it may be best Idaszak, J. R., & Drasgow, F. (1987). A revision of the Job Diagnostic
to continue using the original JDS until items can be developed Survey: Elimination of a measurement artifact. Journal of Applied
that improve the JDS factor structure and the effectiveness of Psychology, 72, 69-74.
Joreskog, K., & Sorbom, D. (1985). LISREL: Analysis of linear struc-
the job characteristics in predicting personal and organizational
tural relationships by the method of maximum likelihood. Chicago:
outcomes. Although the revisions improved the measures of
National Educational Resources.
skill variety, task significance, and task identity, the revised
Katz, R. (1978). The influence of job longevity on employee reactions
items did not substantially improve the measurement of auton- to task characteristics. Human Relations, 8,703-726.
omy and feedback. Future research should focus on developing Lee, R., & Klein, A. R. (1982). Structure of the Job Diagnostic Survey
alternative autonomy and feedback items and examining their for public health occupations. Journal of Applied Psychology, 67,
impact on the factor structure of the JDS and its criterion-re- 515-519.
lated validity. In addition, future research might examine the Pedhazur, E. J. (1982). Multiple regression in behavioral research (2nd
possibility that the JDS outcome measures are subject to the ed.). New York: Holt, Rinehart & Winston.
Pierce, J. L., & Dunham, R. B. (1978). The measurement of perceived
same impurities as the measures of job characteristics. For ex-
job characteristics: The Job Diagnostic Survey versus the Job Char-
ample, one of the four JDS internal motivation items is reverse
acteristics Inventory. Academy of Management Journal, 21,123-128.
scored, potentially "muddying" the measurement of the con-
Seabrook, M. F. (19 72). A study to determine the influence of the herds-
struct. Two reviewers suggested that improvements in the criter- man's personality on milk yield. Agriculture Labour Science, 1, 45-
ion-related validity of the JDS may be observed only when both 49.
the job characteristics and outcomes measures are "pure" indi- Seabrook, M. F. (1975). The relationship of livestock to human beings
cators of their respective constructs. on the farm. Agricultural Engineer, 30,115-119.
Seabrook, M. F. (1978). Managing and motivating the dairy worker.
Journal of the Irish Grasslands Animal Production Association, 13,
References 77-88.
Colarelli, S. M. (1984). Methods of communication and mediating pro- Received March 25, 1987
cesses in Realistic Job Previews. Journal of Applied Psychology, 69, Revision received February 18, 1988
633-642. Accepted February 2, 1988 •