You are on page 1of 4

Psychology and Aging Copyright 2004 by the American Psychological Association, Inc.

2004, Vol. 19, No. 1, 211–214 0882-7974/04/$12.00 DOI: 10.1037/0882-7974.19.1.211

Adult Age and Digit Symbol Substitution Performance: A Meta-Analysis


William J. Hoyer, Robert S. Stawski, Christina Wasylyshyn, and Paul Verhaeghen
Syracuse University

This article reports the results of a meta-analysis of the effects of age, education, and estimated year of
measurement on scores from the Wechsler Adult Intelligence Scale and the Wechsler Adult Intelligence
Scale—Revised Digit Symbol Substitution Test. Analysis of effect sizes for age reported in 141 studies
published between 1986 and 2002 indicated a mean standardized difference of –2.07. Age accounted for
86% of the variance in a regression model using age, education, and year submitted as predictors of Digit
Symbol scores. There was no association between years of education or year submitted and Digit Symbol
scores for younger adults or older adults.

One of the most widely used instruments for describing the provide an ideal base for a comprehensive meta-analysis of the
performance of younger and older adults in cognitive aging studies relations between age and DSST scores and for exploring possible
is the Digit Symbol Substitution Test (DSST) from the Wechsler relations between DSST scores and years of education and years of
Adult Intelligence Scale (WAIS; Wechsler, 1955) and the Wech- measurement (estimated using year submitted for published
sler Adult Intelligence Scale—Revised (WAIS–R; Wechsler, manuscripts).
1981). The DSST has two properties that make it a valuable tool In regard to possible relations between DSST scores and edu-
for aging research. First, the DSST seems to serve as a robust cational level, the available data, all from nonaggregated data sets,
marker for describing sample characteristics in studies of age suggest no relationship (Birren & Morrison, 1961; Salthouse,
differences. Age–DSST correlations of between –.46 and –.77 are 1992). It would be useful to show that age–DSST relations are
typically reported (e.g., Birren, 1965; Birren & Morrison, 1961; independent of years of formal education across a broad range of
Doppelt & Wallace, 1955; Kaufman, Reynolds, & McLean, 1989; study samples. Although there are no reports directly examining
Royer, Gilmore, & Gruhn, 1981; Salthouse, 1992). Second, scores the relationship between age-related declines in DSST scores and
on the DSST have been shown to exhibit strong correlations with years of measurement, Schaie (1994) reported relatively stable
measures that in some way involve perceptual speed (Laux & performance for measures of perceptual speed for cohorts born
Lane, 1985; Lindenberger & Baltes, 1997; Salthouse, 2000; Sli- between 1907 and 1966 and tested between 1956 and 1991. How-
winski & Buschke, 1999), and perceptual speed or processing ever, this finding stands somewhat in contrast to analyses by Flynn
speed is known to be a large source of the variance in many (1987) and Raven (2000) indicating secular increases in intelli-
age–performance relations (e.g., Birren, 1965; Cerella, 1990; Mad-
gence test scores. Flynn reported gains of between 5 and 25 points
den, 2001; Salthouse, 1996).
in IQ scores during the past 50 years in secondary analyses of large
The DSST consists of a look-up table showing pairs of digits
data sets taken from different countries. Raven described substan-
and hieroglyphic-like symbols and rows of boxes with a digit in
tial secular increases in scores on the Raven’s Progressive Matri-
the top section and an empty space in the bottom section of each
ces (RPM) during the past 20 years, although RPM scores taken
box. A participant’s score is the number of empty boxes completed
prior to 1979 were found to be stable across testing occasions. In
in 90 s. The DSST is easily administered, and the procedures for
light of the generally strong relations between intelligence and
administration and scoring of the test leave relatively little room
for variation. Because the format and test materials for the DSST perceptual speed reported in the literature (e.g., Postuma, de Geus,
have remained unchanged (Wechsler, 1955, 1981), the DSST data & Boomsma, 2001; Salthouse, 1996; Sliwinski & Buschke, 1999;
already available in studies published during the past 16 years Verhaeghen & Salthouse, 1997; Zimprich & Martin, 2002), it
would be useful to know whether there have been secular increases
in DSST scores in recent years.
William J. Hoyer, Robert S. Stawski, Christina Wasylyshyn, and Paul
In this study, we report the results of a meta-analysis of the
Verhaeghen, Department of Psychology and Center for Health and Behav- effects of age, education, and year of measurement (estimated
ior, Syracuse University. from year submitted for published manuscripts) on DSST perfor-
This research was supported by National Institute on Aging Grant mance using all pertinent data published in Psychology and Aging
AG-11451. We thank Serge Onyper and Silvie Semenec for assistance with and the Journals of Gerontology (all subsections) between 1986
a preliminary data collection and Ulman Lindenberger for comments on an and 2002. That there is a large number of studies reporting DSST
earlier draft. scores for younger and older adults and that the format of the
An Excel spreadsheet listing the studies providing data for the meta-
WAIS and WAIS–R versions of the DSST has remained un-
analysis and the effect sizes for each of the samples is available from
William J. Hoyer. changed (until recently; see Wechsler, 1997) makes it an ideal
Correspondence concerning this article should be addressed to William dependent variable for assessing age–performance relations as a
J. Hoyer, Department of Psychology, 430 Huntington Hall, Syracuse function of educational characteristics of the samples and year
University, Syracuse, NY 13244-2340. E-mail: wjhoyer@syr.edu submitted.

211
212 BRIEF REPORTS

Table 1
Means and Ranges for Measures of the Characteristics of the Research Participants

Younger adults Older adults

Measure No. of studies M Range M Range

Age (years, unweighted) 139 21.4 18.1–30.7 69.5 60.7–78.9


Age (years, weighted by n) 139 21.6 69.8
Education (unweighted) 117 13.9 12.0–16.7 15.2 11.7–17.9
Education (weighted by n) 117 14.1 15.3
Digit symbol (unweighted) 138 69.3 51.2–82.7 48.2 38.8–66.8
Digit symbol (weighted by n) 138 69.8 48.6

Note. The age groups consisted of 3,731 younger adults and 3,876 older adults. Education ⫽ number of years
of formal education. Digit symbol ⫽ score on Wechsler Adult Intelligence Scale or Wechsler Adult Intelligence
Scale—Revised Digit Symbol Substitution subtest.

Method possible moderators of the heterogeneity. In the first step (Model


1), age, years of education, and year submitted for the study were
Sample of Studies entered simultaneously as predictors of DSST scores (k ⫽ 242). In
All volumes of Psychology and Aging and the Journals of Gerontology the second step (Model 2), we explored whether the slopes for age,
(all subsections)1 published between 1986 and 2002 were hand searched for years of education, and for year submitted differed as a func-
for articles reporting mean raw scores for the WAIS or WAIS–R DSST tion of age group. In Model 2, the three two-way interaction terms
(the standard paper-and-pencil version). Articles reporting at least one for these factors were added as predictors of DSST scores. The
sample of younger adults (with a mean age below 30 years) and one sample
unstandardized B, standardized beta, and the t values for each of
of “healthy” older adults (with a mean age above 60 years) were included.
Scores derived from samples with participants reported to have dementia the predictors in the two regression models are reported in Table 2.
were excluded. For longitudinal studies and for studies reporting multiple The overall effect of Model 1, the three-parameter model, on
administrations of the DSST to the same participants, only scores from the DSST scores was significant, F(3, 238) ⫽ 446.37, MSE ⫽ 20.93,
first administration of the test were included. A total of 141 studies R2 ⫽ 0.85. The coefficients were significant for age ( p ⬍ .001)
reporting data from 3,731 younger adults and 3,876 older adults satisfied and years of education ( p ⫽ .019), and the coefficient for year
these inclusion– exclusion criteria; 99 of the studies were in Psychology submitted was not significant (t ⬍ 1). The overall effect of Model
and Aging, 40 were in Journal of Gerontology: Psychological and Social
2, the six-parameter model, on DSST scores was also significant,
Sciences, and 2 were in Journal of Gerontology: Medical Sciences. Mean
DSST scores and means and ranges for age and education for the younger F(6, 235) ⫽ 224.72, MSE ⫽ 20.85, R2 ⫽ 0.85. The fit for Model
and older samples are reported in Table 1. 2 was no better than the fit for Model 1, ⌬R2 ⫽ 0.002, F(3, 235) ⫽
1.31. In Model 2, only the coefficient for age ( p ⫽ .002) was
Statistical Analysis Procedures significant. The absence of interaction terms suggested that the
slopes for age and years of education for the two age groups were
A standard effect size analysis was performed to determine the age effect not different. It is important to note that the Nonsignificant Age
on DSST scores (Hedges & Olkin, 1983). For each combination of scores
(within groups) ⫻ Age Groups interaction (t ⫽ 1.70) suggests that
for younger adults and older adults, the mean standardized difference for
the size of the age effect was determined. The mean standardized differ- the slopes of the age–DSST relation were not different between the
ence was calculated as the mean score for older adults minus the mean two age groups and that the age–DSST relation is not an artifact or
score for younger adults, divided by the pooled standard deviation. If distortion associated with using extreme groups. The regression
means and standard deviations were not reported, inferential statistics were slope, – 0.46 items per year (Model 1), was consistent with the
used to calculate the mean standardized difference, if possible; 46 of the value of the slope of – 0.47 reported by Salthouse (1992) and the
141 effect sizes were extracted from t or F tests. To test whether the mean slope of – 0.43 reported by Emmerson, Dustman, Shearer, and
standardized difference for the size of the age effect can be represented as
Turner (1989) using a symbol digit test.
a single value (the overall effect size), we calculated a homogeneity
statistic, Qt (Hedges & Olkin, 1983, pp. 154 –156). If Qt, which is a Figure 2 shows the relation between DSST scores and educa-
chi-square statistic distributed with k ⫺ 1 degrees of freedom (where k tion, and Figure 3 shows the relation between DSST scores and
equals the number of effect sizes), exceeds the critical value, further year submitted. The plots show the data from the 242 samples that
analysis of possible moderator variables is indicated. were used in the regressions. The differences in the distributions of
years of education between the samples of younger adults and
Results older adults were quite striking and are shown in histogram form
in Figure 4. As reported in Table 2, there was no relationship
Figure 1 shows mean DSST scores by age. The averaged effect
size (d) for age was –2.07, the lower bound of the 95% confidence
interval was –2.12, and the upper bound of the 95% confidence 1
This journal was called Journal of Gerontology prior to and including
interval was –2.03. The overall effect size was heterogeneous, Volume 41 (1986). The subsections of the Journals of Gerontology in-
Qt(141) ⫽ 511.18. A hierarchical regression analysis (weighted by cluded in the search were Biological Sciences, Medical Sciences, Psycho-
sample size) was performed on raw DSST scores, to examine logical Sciences, and Social Sciences.
BRIEF REPORTS 213

Figure 1. Digit symbol scores as a function of age. Triangles indicate Figure 2. Digit symbol scores as a function of number of years of
younger adults, and circles indicate older adults. DSST ⫽ Digit Symbol education. Triangles indicate younger adults, and circles indicate older
Substitution Test. adults. The solid line indicates the regression line for younger adults, and
the broken line indicates the regression line for older adults. DSST ⫽ Digit
Symbol Substitution Test.
between DSST scores and years of education when differences
between age groups were taken into account (Model 2).
Another weighted least squares regression analysis was per- data reported in age-comparative studies published in Psychology
formed to determine whether the effect sizes for DSST scores were and Aging and the Journals of Gerontology during the past 16
predicted by the size of the difference in age or education between years. The magnitude of the effect of age on DSST scores obtained
age groups. The overall effect of the regression model on DSST from 141 age comparisons was substantial (d ⫽ –2.07). This
scores was significant, F(2, 117) ⫽ 5.23, MSE ⫽ 15,845, R2 ⫽ finding confirms the high correlations between age and DSST
0.08. The coefficient for the age difference was significant (t ⫽ scores reported in standardization studies (e.g., Birren & Morrison,
–3.18, p ⫽ .002), indicating that the strength of the age–DSST 1961; Kaufman et al., 1989; Wechsler, 1997) and in large nonag-
relation was related to the size of the chronological age differences gregated data sets with digit symbol and symbol digit measures
for the groups. The coefficient for difference in years of education (e.g., Royer et al., 1981; Salthouse, 1992, 2000).
was not significant (t ⬍ 1). Although the biobehavioral processes underlying age effects on
DSST scores are not well understood (e.g., Laux & Lane, 1985;
Discussion Piccinin & Rabbitt, 1999; Salthouse, 1992, 2000), the results of the
present study indicate unequivocally that the speed of carrying out
The aim of this study was to assess the magnitude of the age
effect in DSST scores by applying meta-analytic methods to the

Table 2
Summary Statistics for Two Regression Models

Predictor B ␤ t

Model 1 (R2 ⫽ .85)

Age ⫺0.46 ⫺0.95 ⫺33.09*


Education 0.62 0.07 2.37*
Year submitted ⫺0.01 ⫺0.00 ⫺0.61

Model 2 (R2 ⫽ .85)

Age ⫺0.65 ⫺1.34 ⫺3.14*


Education 0.82 0.09 1.79
Year submitted ⫺0.01 ⫺0.01 ⫺0.18
Age ⫻ Education ⫺0.15 ⫺0.10 ⫺0.27
Age ⫻ Year Submitted 0.01 ⫺0.73 ⫺1.47
Age ⫻ Age Groups (within groups) 0.40 1.20 1.70

Note. Models were least squares regressions weighted by n. Model 1 used Figure 3. Digit symbol scores by year submitted. Triangles indicate
three predictors, and Model 2 used six predictors. Data for year submitted younger adults, and circles indicate older adults. The solid line indicates
were the years indicated in the date of submission for the manuscripts. the regression line for younger adults, and the broken line indicates the
* p ⬍ .05. regression line for older adults. DSST ⫽ Digit Symbol Substitution Test.
214 BRIEF REPORTS

WAIS-R intelligence in a national sample of adults in the 20- to 74-year


age range: A cross-sectional analysis with educational level controlled.
Intelligence, 13, 235–253.
Laux, L. F., & Lane, D. M. (1985). Information processing components of
substitution test performance. Intelligence, 9, 111–136.
Lindenberger, U., & Baltes, P. B. (1997). Intellectual functioning in old
and very old age: Cross-sectional results from the Berlin Aging Study.
Psychology and Aging, 12, 410 – 432.
Madden, D. J. (2001). Speed and timing of behavioral processes. In J. E.
Birren & K. W. Schaie (Eds.), Handbook of the psychology of aging (5th
ed., pp. 288 –312). San Diego, CA: Academic Press.
Piccinin, A. M., & Rabbitt, P. M. A. (1999). Contribution of cognitive
abilities to performance and improvement on a substitution coding task.
Psychology and Aging, 14, 539 –551.
Postuma, D., de Geus, E. J. C., & Boomsma, D. I. (2001). Perceptual speed
Figure 4. Frequency distribution of education scores for samples of and IQ are associated through common genetic factors. Behavior Ge-
younger adults (unfilled bars) and older adults (hatched bars). netics, 31, 593– 602.
Raven, J. (2000). The Raven’s Progressive Matrices: Change and stability
over culture and time. Cognitive Psychology, 41, 1– 48.
the combination of coding and substitution processes that comprise Royer, F. L., Gilmore, G. C., & Gruhn, J. J. (1981). Normative data for the
DSST performance is slower for older adults than for younger symbol digit substitution test. Journal of Clinical Psychology, 37, 608 –
adults. Furthermore, the age–DSST relation, derived here from a 614.
large and wide-ranging set of descriptive data, was independent of Salthouse, T. A. (1992). What do adult age differences in the Digit Symbol
years of education and was invariant across years of measurement Substitution test reflect? Journal of Gerontology: Psychological Sci-
ences, 47, 121–128.
(estimated by year of submission). One implication of the robust-
Salthouse, T. A. (1996). The processing speed theory of adult age differ-
ness of the age–DSST relationship is to suggest that the DSST be
ences in cognition. Psychological Review, 103, 403– 428.
used routinely as a general marker in age-comparative studies. Salthouse, T. A. (2000). Aging and measures of processing speed. Biolog-
ical Psychology, 54, 35–54.
References Schaie, K. W. (1994). The course of adult intellectual development. Amer-
ican Psychologist, 49, 304 –313.
Birren, J. E. (1965). Age changes in speed of behavior: Its central nature Sliwinski, M., & Buschke, H. (1999). Cross-sectional and longitudinal
and physiological correlates. In A. T. Welford & J. E. Birren (Eds.), relationships among age, cognition, and processing speed. Psychology
Behavior, aging and the nervous system (pp. 191–216). Springfield, IL: and Aging, 14, 18 –33.
Thomas. Verhaeghen, P., & Salthouse, T. A. (1997). Meta-analyses of age–
Birren, J. E., & Morrison, D. F. (1961). Analysis of the WAIS subtests in cognition relations in adulthood: Estimates of linear and nonlinear age
relation to age and education. Journal of Gerontology, 16, 363–369. effects and structural models. Psychological Bulletin, 122, 231–249.
Cerella, J. (1990). Aging and information-processing rate. In J. E. Birren & Wechsler, D. (1955). Manual for the Wechsler Adult Intelligence Scale.
K. W. Schaie (Eds.), Handbook of the psychology of aging (3rd ed., pp. New York: Psychological Corporation.
201–221). New York: Academic Press. Wechsler, D. (1981). Manual for the Wechsler Adult Intelligence Scale—
Doppelt, J. E., & Wallace, W. L. (1955). Standardization of the Wechsler Revised. New York: Psychological Corporation.
Adult Intelligence Scale for older persons. Journal of Abnormal and Wechsler, D. (1997). Administration and scoring manual for the WAIS–III.
Social Psychology, 51, 312–330. San Antonio, TX: Psychological Corporation.
Emmerson, R. Y., Dustman, R. E., Shearer, D. E., & Turner, C. W. (1989). Zimprich, D., & Martin, M. (2002). Can longitudinal changes in processing
P3 latency and symbol digit performance correlations in aging. Exper- speed explain longitudinal age changes in fluid intelligence? Psychology
imental Aging Research, 15, 151–159. and Aging, 17, 690 – 695.
Flynn, J. R. (1987). Massive IQ gains in 14 nations: What IQ tests really
measure. Psychological Bulletin, 101, 171–191.
Hedges, L. V., & Olkin, I. (1983). Statistical methods for meta-analysis. Received January 8, 2003
Orlando, FL: Academic Press. Revision received March 31, 2003
Kaufman, A. S., Reynolds, C. R., & McLean, J. E. (1989). Age and Accepted April 7, 2003 䡲

You might also like