Professional Documents
Culture Documents
www.elsevier.com/locate/jad
Research report
Psychometric properties of the Depression Anxiety and Stress
Scale-21 in older primary care patients ☆
Andrew T. Gloster a,⁎, Howard M. Rhoades b , Diane Novy c , Jens Klotsche a ,
Ashley Senior d,e , Mark Kunik d,e,f , Nancy Wilson e,g , Melinda A. Stanley d,e
a
Institute of Clinical Psychology and Psychotherapy, Technical University of Dresden, Germany
b
Department of Psychiatry and Behavioral Sciences, University of Texas Health Science Center at Houston, United States
c
Department of Anesthesiology and Pain Medicine, University of Texas M. D. Anderson Cancer Center, United States
d
Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, United States
e
Houston Center for Quality of Care and Utilization Studies, and Michael E. DeBakey Veterans Affairs Medical Center, Houston, United States
f
Department of Medicine, Baylor College of Medicine, United States
g
Department of Medicine—Geriatrics, Baylor College of Medicine, United States
Received 29 October 2007; received in revised form 28 January 2008; accepted 28 January 2008
Available online 4 March 2008
Abstract
The Depression Anxiety Stress Scale (DASS) was designed to efficiently measure the core symptoms of anxiety and depression
and has demonstrated positive psychometric properties in adult samples of anxiety and depression patients and student samples.
Despite these findings, the psychometric properties of the DASS remain untested in older adults, for whom the identification of
efficient measures of these constructs is especially important.
To determine the psychometric properties of the DASS 21-item version in older adults, we analyzed data from 222 medical
patients seeking treatment to manage worry. Consistent with younger samples, a three-factor structure best fit the data. Results also
indicated good internal consistency, excellent convergent validity, and good discriminative validity, especially for the Depression
scale. Receiver operating curve analyses indicated that the DASS-21 predicted the diagnostic presence of generalized anxiety
disorder and depression as well as other commonly used measures.
These data suggest that the DASS may be used with older adults in lieu of multiple scales designed to measure similar
constructs, thereby reducing participant burden and facilitating assessment in settings with limited assessment resources.
© 2008 Elsevier B.V. All rights reserved.
Keywords: Depression Anxiety Stress Scale; Older adults; GAD; Anxiety; Assessment
☆
Portions of this work were presented at the 2006 convention for 1. Introduction
the Association for Behavioral and Cognitive Therapies, November,
Chicago.
⁎ Corresponding author. Technical University of Dresden, Institute of
Lovibond and Lovibond (1995a) developed a single
Clinical Psychology and Psychotherapy, Chemnitzer Str. 46, D-01187, measure to assess the core symptoms of depression and
Dresden, Germany. Tel.: +49 351 463 36895; fax: +49 351 463 36984. anxiety while maximizing discriminant validity between
E-mail address: gloster@psychologie.tu-dresden.de (A.T. Gloster). these constructs. Using an empirically-driven iterative
0165-0327/$ - see front matter © 2008 Elsevier B.V. All rights reserved.
doi:10.1016/j.jad.2008.01.023
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 249
process, they identified a third factor, which they labeled care samples (Blazer et al., 1991; Beekman et al., 1998;
stress. Their research resulted in the Depression Anxiety Wittchen et al., 2001; Tolin et al., 2005) but probably
Stress Scales (DASS), which consists of 42 items com- one of the most difficult to diagnose. Depression is
prising three scales of 14 items. Items refer to the past also highly prevalent in older adults and frequently co-
week; and scores range from 0, “Did not apply to me at occurs with GAD (Beekman et al., 2000). Differentiat-
all”, to 4, “Applied to me very much, or most of the ing GAD and depression is particularly difficult in
time”. The Depression scale measures hopelessness, low older adults given that the relationship between
self-esteem, and low positive affect. The Anxiety scale depression and anxiety is further obfuscated by loss
assesses autonomic arousal, physiological hyperarousal, of function and increased somatic presentation (Lenze
and the subjective feeling of fear. The Stress scale items et al., 2001; Lenze et al., 2005). Some researchers refer
measure tension, agitation, and negative affect. The to this state as “depletion” as opposed to pure
scales are considered to approximate facets of diagnostic “depression” (Schoevers et al., 2005). A better under-
categories, as follows: Depression scale for mood dis- standing of these issues is clearly needed in the as-
orders, Anxiety scale for panic disorder, and Stress scale sessment of older adults. With respect to the DASS, the
for generalized anxiety disorder (GAD; Brown et al., Anxiety scale contains some somatic items that could
1997). With the exception of GAD and obsessive– be experienced by older adults for reasons unrelated to
compulsive disorder, the Anxiety scale also corresponds emotion (e.g., breathing difficulty in the absence of
reasonably closely to the symptomatology of other exertion). In contrast, the DASS-D does not contain
anxiety disorders. Subsequent research established a 21- somatic items, thus limiting the likelihood of artificial
item version of the DASS (DASS-21) with seven items score inflation observed in other measures of depres-
per scale (Antony et al., 1998). sion (Taylor et al., 2005). Given these considerations of
Numerous studies have found favorable psycho- developmental changes, psychometric results from
metric properties of the DASS in adults with anxiety younger adults cannot automatically be generalized to
and/or mood disorders (Antony et al., 1998; Brown the measurement of anxiety and depression in later life
et al., 1997, Clara et al., 2001), Spanish-speaking (Beck and Stanley, 2001).
patients (Daza et al., 2002), and community-dwelling For this population, a measure that efficiently as-
adults (Crawford and Henry, 2003). All studies have sesses and differentiates anxiety and depression would
demonstrated excellent internal consistency of the be most useful, given the need to reduce patient burden.
DASS scales in both the 42- and 21-item (DASS-21) Furthermore, older adults usually present to primary
versions: Depression (range = .91 to .97); Anxiety care settings, where few resources are available to
(range = .81 to .92); and Stress (range = .88 to .95). A support intensive, clinician-administered differential
three-factor solution reflecting the three scales has diagnostic procedures. As such, the DASS may be
been found consistently across samples and factor- particularly useful for older adults, although its psy-
analytic techniques with only minor variations. Inter- chometric properties need to be examined in this
scale correlations range as follows: Depression– population.
Anxiety (.45–.71; .50 or below in all English-speaking
samples (Antony et al., 1998; Brown et al., 1997; Clara 1.2. Purpose and hypotheses
et al., 2001), Anxiety–Stress (.65–.73), and Depres-
sion–Stress (.57–.79). This study examined the psychometric properties of
the DASS-21 in a population of older adults seeking
1.1. Older adults help for worry in a primary care setting. Investigation
of the psychometric properties included factor struc-
Despite encouraging psychometric data with the ture, internal consistency, and convergent and discri-
DASS in younger adults, the measure remains untested minative validity. We hypothesized that: a) a three-
in older adults. Given the high prevalence of anxiety, factor solution would better fit the data than other
depression, and comorbid anxiety–depression in older solutions; b) the DASS would demonstrate good in-
adults and the need for briefer instruments that ef- ternal consistency across all scales; c) the DASS would
ficiently evaluate these symptoms in older patients, the demonstrate good convergent validity in this sample;
DASS may be a particularly useful measure in this d) the DASS scales would differentiate different diag-
population. nostic groups; and e) the DASS scales would predict
GAD is the most prevalent of the pervasive anxiety the presence vs. absence of GAD and mood disorders
disorders in later life in both community and primary as well as other symptom-specific scales.
250 A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259
fairly consistently suggest the existence of somatic and arate dimensions of mood using items rated on a 1-to-5-
subjective/cognitive factors in older adults (Kabacoff point Likert-type scale. Positive affect is defined as the
et al., 1997; Morin et al., 1999; Wetherell and Arean, degree to which an individual is enthusiastic, active,
1997). Internal consistency is adequate in community- and alert. In contrast, negative affect measures the
dwelling older adults (Morin et al., 1999; alpha = .89), degree to which an individual experiences subjective
older psychiatric patients (Kabacoff et al., 1997; distress and aversive feelings. When administered with
alpha = .90), and older medical patients (Steer et al., instructions to recall the previous week, as in the
1994; Wetherell and Arean, 1997; alpha = .86 to .92). The current study, internal consistency (α) was .87 for both
BAI demonstrated good convergent validity in older the positive affect scale (PA) and negative affect scale
adults with GAD, but, consistent with most measures of (NA) (Watson et al., 1988). Among depressed and
anxiety and depression, had poor discriminate validity anxious patients, the PANAS demonstrated good dis-
(Wetherell and Gatz, 2005). criminative (Waikar and Craske, 1997) and predictive
validity (Watson and Walker, 1996). Among older
2.3.2. Depression adults, support has been found for the original two-
The BDI-II (Beck et al., 1996), a widely used self- factor structure (Mackinnon et al., 1999; Kercher,
report scale to assess depressive symptoms, consists of 1992), a revised two-factor structure (Shapiro et al.,
21 items, each of which is rated on a 4-point scale. One 1999), and a three-factor structure dividing negative
week test–retest reliability for the BDI-II is 0.93, and affect into two factors (Beck et al., 2003).
internal consistency was 0.92 among younger adult out-
patients (Beck et al., 1996). Although considerable evi- 2.3.5. Functional status
dence exists for reliability and validity of the BDI-II in The QOLI (Frisch, 1994, 1999) is a 16-item,
younger adults and for the original BDI in older adults, empirically derived, self-report measure that provides
only one study specifically examined the psychometric a global measure of life satisfaction based on the
properties of the BDI-II (Steer et al., 2000). In a sample average of satisfaction ratings across a range of life
of depressed geriatric inpatients, Steer et al. reported functions. Each rating is weighted according to im-
internal consistency of α = .89 and a two-factor structure portance of that life area assigned by the participant.
consisting of cognitive and non-cognitive items. Despite Only dimensions of life function with non-zero
the paucity of psychometric research on the BDI-II in importance ratings are included in the total score. The
older adults, it has been widely used for research in this scale probes satisfaction with a wide array of life
population and demonstrated its clinical utility with functions, only one of which involves work. As such,
respect to its sensitivity to treatment change (Stanley the QOLI is particularly relevant to assess life sat-
et al., 2003). isfaction in older adults who may be retired. Internal
consistency (α) was .86 in an inpatient population and
2.3.3. Worry .83 in a counseling center population (Frisch et al.,
The PSWQ (Meyer et al., 1990) is a 16-item, self- 1992). Convergent and divergent validity was demon-
report scale that assesses tendency to worry independent strated in clinical and non-clinical populations (Frisch
of worry content. Each item is rated on a 1-to-5-point et al., 1992). Discriminant validity of the QOLI was
Likert-type scale. The internal consistency of the PSWQ also demonstrated in a sample of older adults (Bourland
has been excellent in populations of college students et al., 2000).
(α = .90; Fresco et al., 2002; α = .93; Meyer et al., 1990),
and patients with anxiety disorders (α = .93; Brown 2.4. Data analysis
et al., 1992), and good in populations of older adults
(α = .83 to .85) (Stanley et al., 2001; Hopko et al., 2003). Using the total sample (n = 222), we used con-
Among older adults, the PSWQ demonstrated adequate firmatory factor analysis (CFA) to test whether
convergent validity in patients with and without GAD DASS factor structures reported in previous stud-
(Beck et al., 1995; Stanley et al., 2001) and unlike with ies, previous adequately fit data collected from older
younger adults, correlated weakly with the BDI (Hopko adults. A small Monte Carlo study was conducted
et al., 2003). to evaluate the power and precision of the derived
CFA parameters. Parameter and standard error biases
2.3.4. Affect did not exceed 2.5% for any parameter and coverage
The PANAS (Watson et al., 1998), a 20-item self- rates were above 93% in all stimulated scenarios,
report instrument, was designed to measure two sep- thus indicating that the sample size of n = 222 was
252 A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259
sufficient to obtain power of 0.8 (Muthen and Muthen, used to establish the ability of the DASS to identify
2002). patients with a diagnosis of GAD and mood disorders
Internal consistency was calculated applying the ap- (MDD, dysthymia). ROC analyses allowed comparisons
proach for uncorrelated errors in which the reliability of the psychometric utility between scales and other
coefficient is calculated using the factor loadings and measures, as well as the establishment of cut-off scores
error variances estimated in the CFA (Raykov, 2004). for identifying diagnostic groups. Cuf-off scores were
This method results in reliable estimates of internal estimated using the Youden-Index (i.e., maximum of
consistency when the tau-equivalence assumption (i.e., equally weighted sensitivity and specificity). Differences
all items of a factor load equally) is violated as in this between two or more ROC curves were conducted for
sample (Raykov, 2004). correlated diagnostic tests within the same sample using
To examine convergent validity, patterns of correla- STATA 9.2 (De Long et al., 1988; Stata Corp., 2006). For
tions were examined between the DASS and instru- the first set of ROC analyses, patients were grouped into
ments known to measure related constructs, again using those with a diagnosis of GAD (n = 134) and those without
the total sample (n = 222). Differences between correla- and those with a mood-disorder diagnosis (either MDD or
tions within a sample (i.e., correlated correlations) were dysthymia) (n = 94) and those without.
tested using the Fisher z transformation (Meng et al.,
1992). 3. Results
To test the discriminative validity of the DASS
scales with respect to differentiation between diagnostic 3.1. Sample characteristics and descriptive statistics of
categories, a subsample of patients (n = 200) was as- measures
signed to four mutually exclusive diagnostic groups:
GAD (n = 73), mood disorder (MDD, dysthymia, or Sample characteristics, means, and standard deviations
depressive disorder NOS) (n = 33), comorbid GAD and for all measures used in this study are depicted in Table 1.
mood disorder (n = 61), and no diagnosis (n = 33). The Consistent with convention, all DASS-21 raw scores were
other 22 individuals were not diagnosed with GAD or doubled to facilitate comparison with previous research
mood disorder but did have another diagnosis. Con- and norms established using the DASS-42. Principal
sistent with previous research (Brown et al., 1997) diagnoses were GAD (n = 134, 60.4%), MDD (n = 24,
comorbid diagnoses other than GAD and mood disorders 10.8%), social phobia (n = 5, 2.3%), anxiety NOS (n = 5,
were not accounted for to promote the external validity 2.3%), adjustment disorder (n = 4, 1.8%), pain disorder
of the findings. Group differences across DASS scales (n = 4, 1.8%), panic/agoraphobia (n = 3, 1.4%), dysthymia
were tested within the CFA framework. Binary diag- (n = 2, 0.9%), post-traumatic stress disorder (n = 2, 0.9%),
nostic group variables were regressed onto the DASS depression NOS (n = 3, 1.4%), somatization disorder (n =
factors such that the β slope quantified the difference in 1, 0.5%), specific phobia (n = 2, 0.9%), and no diagnosis
the strength of association between the latent factor and (n = 33, 14.9%).
diagnostic groups (Brown, 2006). A priori hypotheses for
each scale were as follows. With respect to the DASS-D, 3.2. Factor structure
we predicted that patients with a mood disorder would
score higher than those without. Because the DASS-A Five structural models were tested: (a) a one-factor
assesses imminent fear and autonomic arousal, patients model in which all items were fixed to load on a single
with panic disorder often score highest on this scale factor labeled negative affect; (b) a two-factor model
(Brown et al., 1997), Given that the present sample of collapsing the Anxiety and Stress scales consistent
older adults did not contain enough participants with with the 1997 investigation by Brown et al. of the
panic disorder to constitute a separate diagnostic category, DASS; (c) a two-factor model collapsing anxiety and
we predicted that all three psychiatric diagnostic cate- depression consistent with claims that GAD and
gories would score significantly higher than the non- depression are not independent constructs in older
psychiatric group. Finally, because the DASS-S assesses adults (Schoevers et al., 2003; Schoevers et al., 2005)
tension, we also predicted that the GAD and comorbid and assuming that GAD symptomatology is best cap-
GAD/mood diagnostic groups would be significantly tured by the Anxiety scale; (d) a two-factor model col-
different from the mood and no diagnosis groups. lapsing depression and stress also consistent with claims
We also examined the diagnostic utility with respect to that GAD and depression are not independent constructs
statistical prediction of diagnostic categories. Specifically, but that GAD symptomatology is best captured by the
two sets of receiver operating curve (ROC) analyses were Stress scale, as suggested in the literature (Brown et al.,
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 253
Table 3
Correlations between DASS-21 and other measures
DASS-D DASS-A DASS-S BDI-II BAI PSWQ PANAS-P PANAS-N QOLI
DASS total .84*** .75*** .90*** .75*** .71*** .59*** −.37*** .77*** −.45***
DASS depression .44*** .63*** .76*** .51*** .52*** −.49*** .60*** −.58***
DASS anxiety .54*** .47*** .73*** .34*** −.19* .57*** −.19*
DASS stress .62*** .59*** .57*** −.24** .74*** −.33***
Note: *p b .01; **p b .001; ***p b .0001; DASS = Depression Anxiety Stress Scale (D = depression, A = anxiety, S = stress); BDI-II = Beck
Depression Inventory-II; BAI = Beck Anxiety Inventory; PSWQ = Penn State Worry Questionnaire; PANAS-P = Positive Affect Negative Affect
Scale-Positive; PANAS-N = Positive Affect Negative Affect Scale-Negative; QOLI = Quality of Life Index.
DASS-S, and DASS-A (p b .05 for all), although the differences between the three diagnostic groups were not
DASS-S did not correlate as strongly with the PSWQ as significant.
expected. With respect to the DASS-S, our hypothesis (that
DASS scales correlated highest with measures of like the GAD and comorbid GAD/mood diagnostic groups
constructs and lowest with measures of unlike con- would be significantly different from the mood and no
structs. For instance, the DASS-D was more positively diagnosis groups) was once again partially supported.
correlated with the BDI-II (r = .76) than with any other Participants without a psychiatric diagnosis scored
measure: BAI (r = .51, z = 5.73, p b .001); PSWQ (r = .52, significantly lower on the DASS-S than all other groups
z = 5.25, p b .001); PANAS-PA (r = − .49, z = 12.85, (GAD: β = − 1.23, p b .001; comorbid GAD/mood: β =
p b .001); PANAS-NA (r = .60, z = 4.07, p b .05); and − 1.51, p b .001; Mood: β = − 1.14, p b .001). Further, the
QOLI (r = − .58, z = 13.68, p b .001). Likewise, the Mood alone group scored significantly lower than the
DASS-A was more positively correlated with the BAI GAD/mood group (β = − .36, p b .05).
(r = .74) than other measures: BDI-II (r = .47, z = 5.73,
p b .001); PSWQ (r = .34, z = 7.22, p b .001); PANAS- 3.6. Diagnostic utility
PA (r = − .19, z = 10.27, p b .001); PANAS-NA (r = .57,
z = 4.20, p b .001); and QOLI (r = − .19, z = 10.18, Given that results from the CFAs suggested that the
p b .001). The DASS-S was more positively correlat- DASS does not represent a unitary construct, ROC
ed with the PANAS-NA (r = .74), than other measures: analyses were conducted for each diagnostic group using
BDI-II (r = .62, z =2.94, p b .005); BAI (r = .59, z = 2.82, the DASS scales. The first ROC analysis evaluated the
p b .05); PSWQ (r = .57, z = 3.07, p b .05); PANAS-PA ability of the DASS to identify GAD. The area under the
(r = − .24, z = 12.34, p b .001); and QOLI (r = − .33, curve (AUC), a statistic that varies between .5 (chance
z = 13.26, p b .001). classification) and 1.0 (perfect diagnostic accuracy), for
the three scales, was: (a) DASS-D, Az = .63, p b .001;
3.5. Discriminative validity (b) DASS-A, Az = .60, p b .05; and (c) DASS-S, Az = .70,
disordered patients (Antony et al., 1998), adult Spanish The three DASS-21 scales were tested for their ability
patients (Daza et al., 2002), and adult mood-disordered to detect group mean differences between participants
patients (Clara et al., 2001). Consistent with research diagnosed with primary GAD, mood disorders, comor-
on the DASS-42 (Brown et al., 1997), the three-factor bid GAD/mood disorders, and no diagnosis. Partici-
solution of the DASS-21 was superior to a two-factor pants diagnosed with GAD, mood, and comorbid
solution that collapsed the Anxiety and Stress scales. The GAD/mood scored significantly higher on each of the
three-factor solution also produced a better fit than the scales than participants without a DSM-IV diagnosis.
two-factor solutions that collapsed the Anxiety and De- Further, scores on the DASS-D were higher for both the
pression or Stress and Depression scales. This result is in pure and comorbid depression groups than the pure
contrast to suggestions that GAD and depression are not GAD group. Likewise, scores on the DASS-S were
independent constructs in older adults (Schoevers et al., higher in the comorbid GAD/mood group than in the
2003, Schoevers et al., 2005). This suggests that a pure mood group. In contrast, no significant differences
constructural distinction between depression and anxiety/ emerged across the three diagnostic groups on the
stress is necessary in this sample of older adults with DASS-A. It should be noted, however, that the patterns
predominately GAD and depression. Thus, despite sig- of means were consistent with all a priori hypotheses
nificant zero-order inter-scale correlations, the present and may reflect Type II error. In summary, it appears as
results suggest the presence of three distinct factors in if all three DASS-21 scales are able to differentiate
older adult primary care patients. pathological and non-pathological samples. Moreover,
Consistent with examinations in younger adults, the DASS-D appears to be especially adept at dif-
the DASS-21 total score demonstrated excellent ferentiating patients with and without depression even
internal consistency. At the scale level, the DASS-D in the presence of comorbidity. The DASS-S, in con-
and DASS-S had good internal consistency; whereas trast, seemed to differentiate the comorbid group from
the DASS-A had poor internal consistency. Although a the mood only group. The performance of the DASS-A
previous investigation of the DASS-21 also reported should be interpreted with caution due to characteristics
the lowest scale internal consistency for the DASS-A of the current sample.
(α = .87) (Antony et al., 1998), the lower-than-expected Using ROC analyses, we examined the diagnostic
value in this population may represent chance or a utility of the DASS-21 scales with respect to the pre-
systematic difference between younger and older adults diction of GAD and mood disorders. These analyses
with respect to these items. Older patients present with indicated that the DASS-S differentiates positive vs.
more somatic complaints which may result in less negative GAD status equally as well as the PSWQ and
variability in their responses than younger patients. PANAS-NA. Analyses also indicated that the DASS-D
Indeed, post-hoc exploratory factor analyses of the scale better differentiates positive vs. negative mood
DASS-21 in this sample revealed that the 7 items of the status than the other two scales and equally as well
DASS-A loaded onto two separate factors. Unfortu- as the BDI-II. Overall the AUC was relatively low for
nately the loadings were inconsistent across subsequent both scales, and especially so for the DASS-S. In
sample divisions and rotations. Regardless, caution in comparison, the 14-item Hospital Anxiety and Depres-
the interpretation of the DASS-A – and other measures sion Scale (HADS) demonstrated a larger AUC (.80)
of anxiety that utilize items with somatic content – is when predicting GAD in geriatric primary care
necessary in older patients, unless such effects can be patients (Wetherell et al., 2007). Nevertheless, these
ruled out. Future studies are clearly needed to examine results are noteworthy in that the 7 item scales of the
this hypothesis. DASS-21 predict the diagnostic status of GAD and
Results strongly supported the convergent validity mood disorders equally as well as two separate mea-
of the DASS-21 in older adults. The pattern of correla- sures (e.g., PSWQ =16 items and BDI-II = 21 items)
tions between the DASS-21 total score and scale scores and therefore have the potential to reduce patient
with associated measures was consistent with a priori fatigue. Although short forms of the BDI and BAI
predictions. Correlations between DASS scales and exist (e.g., Mori et al., 2003; Scheinthal et al., 2001),
measures of similar constructs (i.e., BDI, BAI, and most researchers use the full scales. The relative ad-
PSWQ/PANAS-NA) were consistently significantly re- vantages of using the DASS-21 or the HADS are
lated and nearly unanimously superior to comparison related to the additional information yielded by the
measures. three integrated scales of the DASS. If further research
Results also provide qualified evidence for the dis- using different samples replicates these findings and
criminative validity of the DASS-21 in older adults. extends the results to the DASS-A scale, the DASS-21
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 257
Crawford, J.R., Henry, J.D., 2003. The Depression Anxiety Stress Meyer, T.J., Miller, M.L., Metzger, R.L., Borkovec, T.D., 1990.
Scales (DASS): normative data and latent structure in a large non- Development and validation of the Penn State Worry Question-
clinical sample. British Journal of Clinical Psychology 42, 11–131. naire. Behaviour Research and Therapy 28, 487–495.
Daza, P., Novy, D.M., Stanley, M.A., Averill, P., 2002. The Depression Mori, D.L., Lambert, J.F., Niles, B.L., Orlander, J.D., Grace, M.,
Anxiety Stress Scale-21: Spanish translation and validation with a LoCastro, J.S., 2003. The BAI-PC as a screen for anxiety, depression,
Hispanic sample. Journal of Psychopathology and Behavioral and PTSD in primary care. Journal of Clinical Psychology in Medical
Assessment 24, 195–205. Settings 10, 187–192.
Delong, E.R., Delong, D.M., Clarkepearson, D.I., 1988. Comparing the Morin, C.M., Landreville, P., Colecchi, C., McDonald, K., Stone, J., Ling,
areas under 2 or more correlated receiver operating characteristic W., 1999. The Beck Anxiety Inventory: psychometric properties
curves: a nonparametric approach. Biometrics 44 (3), 837–845. with older adults. Journal of Clinical Geropsychology 5, 19–29.
Folstein, M.F., Folstein, S.E., McHugh, P.R., 1975. Mini-mental state. Muthen, L.K., Muthen, B.O., 2002. How to use a Monte Carlo study to
A practical method for grading the cognitive state of patients for the decide on sample size and determine power. Structural Equation
clinician. Journal of Psychiatric Research 12, 189–198. Modeling 9 (4), 599–620.
Fresco, D.M., Heimberg, R.G., Mennin, D.S., Turk, C.L., 2002. Raykov, T., 2004. Behavioral scale reliability and measurement
Confirmatory factor analysis of the Penn State Worry Question- invariance evaluation using latent variable modeling. Behavior
naire. Behaviour Research and Therapy 40, 313–323. Therapy 35 (2), 299–331.
Frisch, M.B., Cornell, J., Villanueva, M., 1992. Clinical validation of Scheinthal, S.M., Steer, R.A., Giffin, L., Beck, A.T., 2001. Evaluating
the Quality of Life Inventory: a measure of life satisfaction for use geriatric medical outpatients with the Beck Depression Inven-
in treatment planning and outcome assessment. Psychological tory-FastScreen for medical patients. Aging & Mental Health 5,
Assessment 4, 92–101. 143–148.
Frisch, M.B., 1994. Manual and Treatment Guide for the Quality of Schoevers, R.A., Beekman, A.T.F., Deeg, D.J.H., Jonker, C., van
Life Inventory. National Computer Systems, Inc., Minneapolis. Tilburg, W., 2003. Comorbidity and risk-patterns of depression,
Frisch, M.B., 1999. Quality of life assessment/intervention and the generalized anxiety disorder and mixed anxiety-depression in later
Quality of Life Inventory, In: Maruish, M.E. (Ed.), The use of life: Results from the AMSTEL study. International Journal of
Psychological Testing for Treatment Planning and Outcomes Geriatric Psychiatry 18, 994–1001.
Assessment, (2nd ed.). Lawrence Erlbaum, Mahwah N.J. Schoevers, R.A., van Tilburg, W., Beekman, A.T.F., Deeg, D.J.H.,
Hopko, D.R., Stanley, M.A., Reas, D.L., Wetherell, J.L., Beck, J.G., 2005. Depression and generalized anxiety disorder: co-occurrence
Novy, D.M., Averill, P.M., 2003. Assessing worry in older adults: and longitudinal patterns in elderly patients. American Journal of
confirmatory factor analysis of the Penn State Worry Questionnaire Geriatric Psychiatry 13, 31–39.
and psychometric properties of an abbreviated model. Psycholo- Segal, D.L., Hersen, M., Van Hasselt, V.B., Kabacoff, R.I., Roth, L.,
gical Assessment 15, 173–183. 1993. Reliability of diagnosis in older psychiatric patients using
Hu, L.T., Bentler, P.M., 1998. Fit indices in covariance structure the Structured Clinical Interview for DSM-III-R. Journal of
modeling: sensitivity to underparameterized model misspecifica- Psychopathology and Behavioral Assessment 15, 347–356.
tion. Psychological Methods 3 (4), 424–453. Senior, A.C., Kunik, M.E.K., Rhoades, H.M., Novy, D.M., Wilson, N.L.,
Kabacoff, R.I., Segal, D.L., Hersen, M., Van Hassellt, V.B., 1997. Stanley, M.A., 2007. Utility of telephone assessments in an older
Psychometric properties and diagnostic utility of the Beck Anxiety adult population. Psychology and Aging 22, 392–397.
Inventory and the State-Trait Anxiety Inventory with older adult Shapiro, A.M., Roberts, J.E., Beck, J.G., 1999. Differentiating
psychiatric outpatients. Journal of Anxiety Disorders 11, 33–47. symptoms of anxiety and depression in older adults: distinct
Kercher, K., 1992. Assessing subjective well-being in the old–old: the cognitive and affective profiles? Cognitive Therapy and Research
PANAS as a measure of orthogonal dimensions of positive and 23, 53–74.
negative affect. Research on Aging 42, 131–168. Spitzer, R.L., Williams, J.B., Gibbon, M., First, M.B., 1992. The Structured
Lenze, E.J., Karp, J.F., Mulsant, B.H., Blank, S., Shear, M.K., Houck, Clinical Interview for DSM-III-R (SCID).I. History, rationale, and
P.R., et al., 2005. Somatic symptoms in late-life anxiety: treatment description. Archives of General Psychiatry 49, 624–629.
issues. Journal of GeriatricPsychiatry and Neurology 18, 89–96. Spitzer, R.L., Williams, J.B., Kroenke, K., Linser, M., de Gruy, F.V.,
Lenze, E.J., Rogers, J.C., Martire, L.M., Mulsant, B.H., Rollman, B.L., Hahn, S.R., et al., 1994. Utility of a new procedure for diagnosing
Dew, M.A., et al., 2001. The association of late-life depression and mental disorders in primary care. The PRIME-MD 1000 study.
anxiety with physical disability: a review of the literature and Journal of the American Medical Association 272, 1749–1756.
prospectus for future research. American Journal of Geriatric Stanley, M.A., Beck, J.G., Novy, D.M., Averill, P.M., Swann, A.C.,
Psychiatry 9, 113–135. Diefenbach, G.J., Hopko, D.R., 2003. Cognitive-behavioral
Lovibond, S.H., Lovibond, P.F., 1995a. Manual for the Depression treatment of late-life generalized anxiety disorder. Journal of
Anxiety Stress Scales. Psychology Foundation, Sydney. Counseling and Clinical Psychology 71, 309–319.
Lovibond, P.F., Lovibond, S.H., 1995b. The structure of negative Stanley, M.A., Novy, D.M., Bourland, S.L., Beck, J.G., Averill, P.M.,
emotional states: comparison of the Depression Anxiety Stress 2001. Assessing older adults with generalized anxiety: a replica-
Scales (DASS) with the Beck Depression and Anxiety Inventories. tion and extension. Behaviour Research and Therapy 39, 221–235.
Behaviour Research and Therapy 33, 335–343. Stata Corp, 2006. Stata Statistical Software. Release 9.2. Stata
Mackinnon, A., Jorm, A.F., Christensen, H., Korten, A.E., Jacomb, Corporation, College Station, TX.
P.A., Rodgers, B., 1999. A short form of the Positive and Negative Steer, R.A., Rissmiller, D.J., Beck, A.T., 2000. Use of the Beck
Affect Schedule: evaluation of factorial validity and invariance Depression Inventory-II with depressed geriatric inpatients.
across demographic variables in a community sample. Personality Behaviour Research and Therapy 38, 311–318.
and Individual Differences 27 (3), 405–416. Steer, R.A., Willman, M., Kay, P.A.J., Beck, A.T., 1994. Differentiat-
Meng, X.L., Rosenthal, R., Rubin, D.B., 1992. Comparing correlated ing elderly medical and psychiatric outpatients with the Beck
correlation-coefficients. Psychological Bulletin 111 (1), 172–175. Anxiety Inventory. Assessment 4, 345–351.
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 259
Taylor, R., Lovibond, P.F., Nicholas, M.K., Cayley, C., Wilson, P.H., PANAS scales. Journal of Personality and Social Psychology 54,
2005. The utility of somatic items in the assessment of depression 1063–1070.
in patients with chronic pain: a comparison of the Zung Self-Rating Webb, S.A., Diefenbach, G., Wagener, P., Novy, D.M., Kunik, M.,
Depression Scale and the Depression Anxiety Stress Scales in Rhoades, H.M., Stanley, M.A., in press. Comparison of self-report
chronic pain and clinical and community samples. The Clinical measures for identifying late-life generalized anxiety in primary
Journal of Pain 25, 91–100. care. Journal of Geriatric Psychiatry and Neurology.
Tolin, D.F., Robison, J.T., Gaztambide, S., Blank, K., 2005. Anxiety Wetherell, J.L., Gatz, M., 2005. The Beck Anxiety Inventory in older
disorders in older Puerto Rican primary care patients. American adults with generalized anxiety disorder. Journal of Psychopathol-
Journal of Geriatric Psychiatry 13, 150–156. ogy and Behavioral Assessment 27, 17–24.
Waikar, S.V., Craske, M.G., 1997. Cognitive correlates of anxious and Wetherell, J.L., Arean, P.A., 1997. Psychometric evaluation of the
depressive symptomatology: an examination of the helplessness/ Beck Anxiety Inventory with older medical patients. Psychological
hopelessness model. Journal of Anxiety Disorders 11, 1–16. Assessment 9, 135–144.
Watson, D., Clark, L.A., Tellegen, A., 1988. Development and validation Wetherell, J.L., Birchler, G.D., Ramsdell, J., Unützer, J., 2007.
of brief measures of positive and negative affect: the PANAS scales. Screening for generalized anxiety disorder in geriatric primary care
Journal of Personality and Social Psychology 5, 1063–1070. patients. International Journal of Geriatric Psychiatry 22, 115–123.
Watson, D., Walker, L.M., 1996. The long-term stability and predictive Wittchen, H.U., Schuster, P., Lieb, R., 2001. Comorbidity and mixed
validity of trait measures of affect. Journal of Personality and Social anxiety-depressive disorder: clinical curiosity or pathophysiologi-
Psychology 70, 567–577. cal need? Human Psychopharmacology 16, S21–S30.
Watson, D., Clark, L.A., Tellegen, A., 1998. Development and
validation of brief measures of positive and negative affect: the