You are on page 1of 12

Journal of Affective Disorders 110 (2008) 248 – 259

www.elsevier.com/locate/jad

Research report
Psychometric properties of the Depression Anxiety and Stress
Scale-21 in older primary care patients ☆
Andrew T. Gloster a,⁎, Howard M. Rhoades b , Diane Novy c , Jens Klotsche a ,
Ashley Senior d,e , Mark Kunik d,e,f , Nancy Wilson e,g , Melinda A. Stanley d,e
a
Institute of Clinical Psychology and Psychotherapy, Technical University of Dresden, Germany
b
Department of Psychiatry and Behavioral Sciences, University of Texas Health Science Center at Houston, United States
c
Department of Anesthesiology and Pain Medicine, University of Texas M. D. Anderson Cancer Center, United States
d
Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, United States
e
Houston Center for Quality of Care and Utilization Studies, and Michael E. DeBakey Veterans Affairs Medical Center, Houston, United States
f
Department of Medicine, Baylor College of Medicine, United States
g
Department of Medicine—Geriatrics, Baylor College of Medicine, United States
Received 29 October 2007; received in revised form 28 January 2008; accepted 28 January 2008
Available online 4 March 2008

Abstract

The Depression Anxiety Stress Scale (DASS) was designed to efficiently measure the core symptoms of anxiety and depression
and has demonstrated positive psychometric properties in adult samples of anxiety and depression patients and student samples.
Despite these findings, the psychometric properties of the DASS remain untested in older adults, for whom the identification of
efficient measures of these constructs is especially important.
To determine the psychometric properties of the DASS 21-item version in older adults, we analyzed data from 222 medical
patients seeking treatment to manage worry. Consistent with younger samples, a three-factor structure best fit the data. Results also
indicated good internal consistency, excellent convergent validity, and good discriminative validity, especially for the Depression
scale. Receiver operating curve analyses indicated that the DASS-21 predicted the diagnostic presence of generalized anxiety
disorder and depression as well as other commonly used measures.
These data suggest that the DASS may be used with older adults in lieu of multiple scales designed to measure similar
constructs, thereby reducing participant burden and facilitating assessment in settings with limited assessment resources.
© 2008 Elsevier B.V. All rights reserved.

Keywords: Depression Anxiety Stress Scale; Older adults; GAD; Anxiety; Assessment


Portions of this work were presented at the 2006 convention for 1. Introduction
the Association for Behavioral and Cognitive Therapies, November,
Chicago.
⁎ Corresponding author. Technical University of Dresden, Institute of
Lovibond and Lovibond (1995a) developed a single
Clinical Psychology and Psychotherapy, Chemnitzer Str. 46, D-01187, measure to assess the core symptoms of depression and
Dresden, Germany. Tel.: +49 351 463 36895; fax: +49 351 463 36984. anxiety while maximizing discriminant validity between
E-mail address: gloster@psychologie.tu-dresden.de (A.T. Gloster). these constructs. Using an empirically-driven iterative
0165-0327/$ - see front matter © 2008 Elsevier B.V. All rights reserved.
doi:10.1016/j.jad.2008.01.023
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 249

process, they identified a third factor, which they labeled care samples (Blazer et al., 1991; Beekman et al., 1998;
stress. Their research resulted in the Depression Anxiety Wittchen et al., 2001; Tolin et al., 2005) but probably
Stress Scales (DASS), which consists of 42 items com- one of the most difficult to diagnose. Depression is
prising three scales of 14 items. Items refer to the past also highly prevalent in older adults and frequently co-
week; and scores range from 0, “Did not apply to me at occurs with GAD (Beekman et al., 2000). Differentiat-
all”, to 4, “Applied to me very much, or most of the ing GAD and depression is particularly difficult in
time”. The Depression scale measures hopelessness, low older adults given that the relationship between
self-esteem, and low positive affect. The Anxiety scale depression and anxiety is further obfuscated by loss
assesses autonomic arousal, physiological hyperarousal, of function and increased somatic presentation (Lenze
and the subjective feeling of fear. The Stress scale items et al., 2001; Lenze et al., 2005). Some researchers refer
measure tension, agitation, and negative affect. The to this state as “depletion” as opposed to pure
scales are considered to approximate facets of diagnostic “depression” (Schoevers et al., 2005). A better under-
categories, as follows: Depression scale for mood dis- standing of these issues is clearly needed in the as-
orders, Anxiety scale for panic disorder, and Stress scale sessment of older adults. With respect to the DASS, the
for generalized anxiety disorder (GAD; Brown et al., Anxiety scale contains some somatic items that could
1997). With the exception of GAD and obsessive– be experienced by older adults for reasons unrelated to
compulsive disorder, the Anxiety scale also corresponds emotion (e.g., breathing difficulty in the absence of
reasonably closely to the symptomatology of other exertion). In contrast, the DASS-D does not contain
anxiety disorders. Subsequent research established a 21- somatic items, thus limiting the likelihood of artificial
item version of the DASS (DASS-21) with seven items score inflation observed in other measures of depres-
per scale (Antony et al., 1998). sion (Taylor et al., 2005). Given these considerations of
Numerous studies have found favorable psycho- developmental changes, psychometric results from
metric properties of the DASS in adults with anxiety younger adults cannot automatically be generalized to
and/or mood disorders (Antony et al., 1998; Brown the measurement of anxiety and depression in later life
et al., 1997, Clara et al., 2001), Spanish-speaking (Beck and Stanley, 2001).
patients (Daza et al., 2002), and community-dwelling For this population, a measure that efficiently as-
adults (Crawford and Henry, 2003). All studies have sesses and differentiates anxiety and depression would
demonstrated excellent internal consistency of the be most useful, given the need to reduce patient burden.
DASS scales in both the 42- and 21-item (DASS-21) Furthermore, older adults usually present to primary
versions: Depression (range = .91 to .97); Anxiety care settings, where few resources are available to
(range = .81 to .92); and Stress (range = .88 to .95). A support intensive, clinician-administered differential
three-factor solution reflecting the three scales has diagnostic procedures. As such, the DASS may be
been found consistently across samples and factor- particularly useful for older adults, although its psy-
analytic techniques with only minor variations. Inter- chometric properties need to be examined in this
scale correlations range as follows: Depression– population.
Anxiety (.45–.71; .50 or below in all English-speaking
samples (Antony et al., 1998; Brown et al., 1997; Clara 1.2. Purpose and hypotheses
et al., 2001), Anxiety–Stress (.65–.73), and Depres-
sion–Stress (.57–.79). This study examined the psychometric properties of
the DASS-21 in a population of older adults seeking
1.1. Older adults help for worry in a primary care setting. Investigation
of the psychometric properties included factor struc-
Despite encouraging psychometric data with the ture, internal consistency, and convergent and discri-
DASS in younger adults, the measure remains untested minative validity. We hypothesized that: a) a three-
in older adults. Given the high prevalence of anxiety, factor solution would better fit the data than other
depression, and comorbid anxiety–depression in older solutions; b) the DASS would demonstrate good in-
adults and the need for briefer instruments that ef- ternal consistency across all scales; c) the DASS would
ficiently evaluate these symptoms in older patients, the demonstrate good convergent validity in this sample;
DASS may be a particularly useful measure in this d) the DASS scales would differentiate different diag-
population. nostic groups; and e) the DASS scales would predict
GAD is the most prevalent of the pervasive anxiety the presence vs. absence of GAD and mood disorders
disorders in later life in both community and primary as well as other symptom-specific scales.
250 A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259

2. Methods estimates (kappa coefficient) were good: GAD = .64;


depression (including MDD, dysthmia, and not other-
2.1. Participants wise specified [NOS]) = .75; and anxiety diagnoses other
than GAD = .73).
Participants were 222 primary care patients 60 years Individuals were excluded from the study because of
of age or older referred for evaluation in the context of (a) cognitive impairment (defined as MMSE b 24;
an ongoing randomized clinical trial of cognitive n = 23), (b) current psychosis or bipolar disorder
behavioral therapy for late-life worry and GAD in (n = 1), or (c) active substance abuse within the past
Houston, Texas. Potential participants were identified month (n = 9). Participants diagnosed with either a
via primary care physician referrals, advertisements/ principal or co-principal GAD diagnosis were eligible
educational brochures in primary care clinics, and/or for inclusion in the treatment outcome study. In the
letters sent to random samples of clinic patients 60 years presence of comorbid diagnoses principal diagnosis
or older. Of 968 primary care patients referred to the referred to the diagnosis with the highest severity level.
study, 858 were contacted; and 381 signed consent to The sample used in this study consisted of both patients
participate after an in-person meeting1 . Of those who were (n = 134) and were not (n = 88) ultimately
participants who signed consent, 68 individuals volun- included in the ongoing treatment study. All data were
tarily withdrew from the study before the in-person collected before treatment began.
diagnostic session; 58 withdrew after the in-person
diagnostic, but before the follow-up telephone assess- 2.2. Procedure
ment; and 33 patients were excluded due to low MMSE
(n = 23), substance abuse (n = 9), and bipolar disorder Approximately 3 weeks following diagnostic assess-
(n = 1). ment (M = 23.19 days, SD = 15.29), the self-report
Patients were screened for anxiety using two GAD questionnaires were administered as part of a larger
screening questions from the Patient Questionnaire assessment battery by an independent evaluator who
portion of the Primary Care Evaluation of Mental had no other contact with study participants. All
Disorders (Spitzer et al., 1994) (“During the past month, assessments were administered over the telephone.
have you often been bothered by “nerves” or feeling Participants were provided with blank copies of the
anxious or on edge?” and “During the past month, have self-report measures with which to follow along during
you often been bothered by worrying about a lot of the telephone assessment and received a $20 gift card
different things?”). Those who screened positive were upon completion. Data from an overlapping sample
further evaluated with the Mini Mental State Exam suggest comparable psychometric properties for tele-
(MMSE; Folstein et al., 1975) and the Structured phone-administered and in-person instruments (Senior
Clinical Interview for Diagnosis (SCID; Spitzer et al., et al., 2007).
1992). The SCID was used to diagnose DSM-IV-TR
(American Psychiatric Association, 2000) Axis I 2.3. Measures
disorders. Diagnoses were assigned when overall
severity was rated 4 or higher on a 0-to-8 scale. The To examine convergent validity of the DASS, we
SCID has been used in numerous studies of older adults used self-report measures of constructs believed to
(e.g., Stanley et al., 2003), and comparable psycho- parallel the three scales: anxiety (BAI), depression
metric properties for younger adults have been estab- (BDI-II), and worry (Penn State Worry Questionnaire
lished (Segal et al., 1993). [PSWQ]). The Positive and Negative Affect Schedule
SCID interviews were conducted by psychology (PANAS) and the Quality of Life Inventory (QOLI)
staff, advanced graduate students, predoctoral psychol- provided a test of convergent validity for general dis-
ogy interns, or postdoctoral fellows, all of whom tress, as captured by the DASS-21 total score. Dis-
received extensive training with the instrument before criminative validity was examined using diagnoses
engaging in study-related assessments. Twenty-five obtained via standardized interviews.
percent of diagnostic interviews were reviewed by a
second clinician or project investigator to estimate 2.3.1. Anxiety
reliability of diagnostic categories. Diagnostic reliability The BAI (Beck and Steer, 1990) is a 21-item, self-
report measure of anxiety severity experienced over the
1
Information on demographics and reasons for refusal was not previous week. Respondents report their symptoms
collected from patients who refused to participate. based on a 4-point Likert-type scale. Factor analyses
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 251

fairly consistently suggest the existence of somatic and arate dimensions of mood using items rated on a 1-to-5-
subjective/cognitive factors in older adults (Kabacoff point Likert-type scale. Positive affect is defined as the
et al., 1997; Morin et al., 1999; Wetherell and Arean, degree to which an individual is enthusiastic, active,
1997). Internal consistency is adequate in community- and alert. In contrast, negative affect measures the
dwelling older adults (Morin et al., 1999; alpha = .89), degree to which an individual experiences subjective
older psychiatric patients (Kabacoff et al., 1997; distress and aversive feelings. When administered with
alpha = .90), and older medical patients (Steer et al., instructions to recall the previous week, as in the
1994; Wetherell and Arean, 1997; alpha = .86 to .92). The current study, internal consistency (α) was .87 for both
BAI demonstrated good convergent validity in older the positive affect scale (PA) and negative affect scale
adults with GAD, but, consistent with most measures of (NA) (Watson et al., 1988). Among depressed and
anxiety and depression, had poor discriminate validity anxious patients, the PANAS demonstrated good dis-
(Wetherell and Gatz, 2005). criminative (Waikar and Craske, 1997) and predictive
validity (Watson and Walker, 1996). Among older
2.3.2. Depression adults, support has been found for the original two-
The BDI-II (Beck et al., 1996), a widely used self- factor structure (Mackinnon et al., 1999; Kercher,
report scale to assess depressive symptoms, consists of 1992), a revised two-factor structure (Shapiro et al.,
21 items, each of which is rated on a 4-point scale. One 1999), and a three-factor structure dividing negative
week test–retest reliability for the BDI-II is 0.93, and affect into two factors (Beck et al., 2003).
internal consistency was 0.92 among younger adult out-
patients (Beck et al., 1996). Although considerable evi- 2.3.5. Functional status
dence exists for reliability and validity of the BDI-II in The QOLI (Frisch, 1994, 1999) is a 16-item,
younger adults and for the original BDI in older adults, empirically derived, self-report measure that provides
only one study specifically examined the psychometric a global measure of life satisfaction based on the
properties of the BDI-II (Steer et al., 2000). In a sample average of satisfaction ratings across a range of life
of depressed geriatric inpatients, Steer et al. reported functions. Each rating is weighted according to im-
internal consistency of α = .89 and a two-factor structure portance of that life area assigned by the participant.
consisting of cognitive and non-cognitive items. Despite Only dimensions of life function with non-zero
the paucity of psychometric research on the BDI-II in importance ratings are included in the total score. The
older adults, it has been widely used for research in this scale probes satisfaction with a wide array of life
population and demonstrated its clinical utility with functions, only one of which involves work. As such,
respect to its sensitivity to treatment change (Stanley the QOLI is particularly relevant to assess life sat-
et al., 2003). isfaction in older adults who may be retired. Internal
consistency (α) was .86 in an inpatient population and
2.3.3. Worry .83 in a counseling center population (Frisch et al.,
The PSWQ (Meyer et al., 1990) is a 16-item, self- 1992). Convergent and divergent validity was demon-
report scale that assesses tendency to worry independent strated in clinical and non-clinical populations (Frisch
of worry content. Each item is rated on a 1-to-5-point et al., 1992). Discriminant validity of the QOLI was
Likert-type scale. The internal consistency of the PSWQ also demonstrated in a sample of older adults (Bourland
has been excellent in populations of college students et al., 2000).
(α = .90; Fresco et al., 2002; α = .93; Meyer et al., 1990),
and patients with anxiety disorders (α = .93; Brown 2.4. Data analysis
et al., 1992), and good in populations of older adults
(α = .83 to .85) (Stanley et al., 2001; Hopko et al., 2003). Using the total sample (n = 222), we used con-
Among older adults, the PSWQ demonstrated adequate firmatory factor analysis (CFA) to test whether
convergent validity in patients with and without GAD DASS factor structures reported in previous stud-
(Beck et al., 1995; Stanley et al., 2001) and unlike with ies, previous adequately fit data collected from older
younger adults, correlated weakly with the BDI (Hopko adults. A small Monte Carlo study was conducted
et al., 2003). to evaluate the power and precision of the derived
CFA parameters. Parameter and standard error biases
2.3.4. Affect did not exceed 2.5% for any parameter and coverage
The PANAS (Watson et al., 1998), a 20-item self- rates were above 93% in all stimulated scenarios,
report instrument, was designed to measure two sep- thus indicating that the sample size of n = 222 was
252 A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259

sufficient to obtain power of 0.8 (Muthen and Muthen, used to establish the ability of the DASS to identify
2002). patients with a diagnosis of GAD and mood disorders
Internal consistency was calculated applying the ap- (MDD, dysthymia). ROC analyses allowed comparisons
proach for uncorrelated errors in which the reliability of the psychometric utility between scales and other
coefficient is calculated using the factor loadings and measures, as well as the establishment of cut-off scores
error variances estimated in the CFA (Raykov, 2004). for identifying diagnostic groups. Cuf-off scores were
This method results in reliable estimates of internal estimated using the Youden-Index (i.e., maximum of
consistency when the tau-equivalence assumption (i.e., equally weighted sensitivity and specificity). Differences
all items of a factor load equally) is violated as in this between two or more ROC curves were conducted for
sample (Raykov, 2004). correlated diagnostic tests within the same sample using
To examine convergent validity, patterns of correla- STATA 9.2 (De Long et al., 1988; Stata Corp., 2006). For
tions were examined between the DASS and instru- the first set of ROC analyses, patients were grouped into
ments known to measure related constructs, again using those with a diagnosis of GAD (n = 134) and those without
the total sample (n = 222). Differences between correla- and those with a mood-disorder diagnosis (either MDD or
tions within a sample (i.e., correlated correlations) were dysthymia) (n = 94) and those without.
tested using the Fisher z transformation (Meng et al.,
1992). 3. Results
To test the discriminative validity of the DASS
scales with respect to differentiation between diagnostic 3.1. Sample characteristics and descriptive statistics of
categories, a subsample of patients (n = 200) was as- measures
signed to four mutually exclusive diagnostic groups:
GAD (n = 73), mood disorder (MDD, dysthymia, or Sample characteristics, means, and standard deviations
depressive disorder NOS) (n = 33), comorbid GAD and for all measures used in this study are depicted in Table 1.
mood disorder (n = 61), and no diagnosis (n = 33). The Consistent with convention, all DASS-21 raw scores were
other 22 individuals were not diagnosed with GAD or doubled to facilitate comparison with previous research
mood disorder but did have another diagnosis. Con- and norms established using the DASS-42. Principal
sistent with previous research (Brown et al., 1997) diagnoses were GAD (n = 134, 60.4%), MDD (n = 24,
comorbid diagnoses other than GAD and mood disorders 10.8%), social phobia (n = 5, 2.3%), anxiety NOS (n = 5,
were not accounted for to promote the external validity 2.3%), adjustment disorder (n = 4, 1.8%), pain disorder
of the findings. Group differences across DASS scales (n = 4, 1.8%), panic/agoraphobia (n = 3, 1.4%), dysthymia
were tested within the CFA framework. Binary diag- (n = 2, 0.9%), post-traumatic stress disorder (n = 2, 0.9%),
nostic group variables were regressed onto the DASS depression NOS (n = 3, 1.4%), somatization disorder (n =
factors such that the β slope quantified the difference in 1, 0.5%), specific phobia (n = 2, 0.9%), and no diagnosis
the strength of association between the latent factor and (n = 33, 14.9%).
diagnostic groups (Brown, 2006). A priori hypotheses for
each scale were as follows. With respect to the DASS-D, 3.2. Factor structure
we predicted that patients with a mood disorder would
score higher than those without. Because the DASS-A Five structural models were tested: (a) a one-factor
assesses imminent fear and autonomic arousal, patients model in which all items were fixed to load on a single
with panic disorder often score highest on this scale factor labeled negative affect; (b) a two-factor model
(Brown et al., 1997), Given that the present sample of collapsing the Anxiety and Stress scales consistent
older adults did not contain enough participants with with the 1997 investigation by Brown et al. of the
panic disorder to constitute a separate diagnostic category, DASS; (c) a two-factor model collapsing anxiety and
we predicted that all three psychiatric diagnostic cate- depression consistent with claims that GAD and
gories would score significantly higher than the non- depression are not independent constructs in older
psychiatric group. Finally, because the DASS-S assesses adults (Schoevers et al., 2003; Schoevers et al., 2005)
tension, we also predicted that the GAD and comorbid and assuming that GAD symptomatology is best cap-
GAD/mood diagnostic groups would be significantly tured by the Anxiety scale; (d) a two-factor model col-
different from the mood and no diagnosis groups. lapsing depression and stress also consistent with claims
We also examined the diagnostic utility with respect to that GAD and depression are not independent constructs
statistical prediction of diagnostic categories. Specifically, but that GAD symptomatology is best captured by the
two sets of receiver operating curve (ROC) analyses were Stress scale, as suggested in the literature (Brown et al.,
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 253

1997); and (e) a three-factor model consistent with Table 2


structures reported in Lovibond and Lovibond's (1995b) Fit indices for tested models
original scale and in the1998 examination of the DASS- Model SRMR RMSEA CFI TLI BIC
21 by Antony et al. a) One factor 0.08 0.11 .76 .73 16,571.48
CFA was performed using maximum-likelihood b) Two factor — 0.07 0.08 .86 .85 16,370.42
estimation with standard errors robust to non-normality collapsing anxiety
and stress
with Mplus version 5 (Muthén & Muthén, Los Angeles,
c) Two factor — collapsing 0.08 0.09 .84 .82 16,413.54
CA). Fit indices for the separate models are listed anxiety and depression
in Table 2. Due to limitations of chi-square tests, the d) Two factor — 0.08 0.10 .79 .76 16,516.53
Bayesian information criterion (BIC) was used to com- collapsing depression
and stress
e) Three factor 0.07 0.06 .90 .90 16,317.08
Table 1 Note: SRMR = standardized root-mean-square residual; RMSEA =
Sample characteristics root-mean-square error of approximation; CFI = comparative fit index;
Variable n % M SD TLI = Tucker–Lewis index; BIC = Bayesian information criterion.
Sex
Female 164 73.87
pare whether successive models resulted in improved
Male 58 26.13
Race/ethnicity overall fit (Hu and Bentler, 1998). Smaller BIC values
Caucasian 164 73.87 indicate a better model fit, although the absolute value
Black/African American 48 21.62 is not interpretable. The three-factor model (Model E)
Other 9 04.51 resulted in the best fit among the tested models and
Age 67.51 6,09
yielded an acceptable descriptive fit based on Hu and
60–64 86 38.74
65–74 108 48.65 Bentler's recommended cut-offs (SRMR ≤ 0.08;
75–84 25 11.26 RMSEA ≤ 0.06; CFI/TLI ≥ 0.9).
85–88 3 01.35
Years of education 15.81 2,89 3.3. Internal consistency
0–8 2 0.90
9–12 33 14.87
13–16 95 42.79 Internal consistency was calculated using the entire
17+ 92 41.44 sample. Reliability for the DASS-21 total score was ρ =
Native language .94. Consistent with psychometric theory, scale reliabil-
English 214 96.40 ities were slightly lower for DASS-D (ρ = .87) and
Spanish 3 01.35
DASS-S (ρ = .89) but less than expected for DASS-A
Other 5 02.25
Work status (ρ = .69). Cronbach's alpha was also calculated for each
Retired 122 54.95 of the other measures used in this study and ranged
Employed full time 49 22.07 between .86 and .90.
Employed part time 32 14.41
Homemakers 9 04.05
3.4. Convergent validity
Not employed 9 04.05
DASS:
Total score 29.76 20.64 Pearson correlation coefficients were calculated be-
Depression scale 8.92 8.34 tween the DASS and other measures used in this study
Anxiety scale 6.61 6.48 (see Table 32). As expected, significant positive correla-
Stress scale 14.30 9.80
tions emerged for DASS-21 total scores with measures
BDI-II 15.00 8.80
BAI 11.55 8.13 assumed to represent similar constructs (BAI, BDI,
PSWQ 51.77 12.13 PSWQ, and PANAS-N) and significant negative correla-
PANAS: tions with measures assumed to represent dissimilar
Positive affect 30.30 7.58 constructs (PANAS-P and QOLI). At the scale level,
Negative affect 20.40 7.06
significant correlations were observed in the predicted
QOLI 2.22 1.75
direction with all other instruments for the DASS-D,
Note: M = mean; SD = standard deviation; DASS = Depression
Anxiety Stress Scale; BDI-II = Beck Depression Inventory-II; BAI =
Beck Anxiety Inventory; PSWQ = Penn State Worry Questionnaire;
2
PANAS = Positive Affect Negative Affect Scale; QOLI = Quality of A full correlation matrix of all measures used in this study is
Life Inventory. available upon request.
254 A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259

Table 3
Correlations between DASS-21 and other measures
DASS-D DASS-A DASS-S BDI-II BAI PSWQ PANAS-P PANAS-N QOLI
DASS total .84*** .75*** .90*** .75*** .71*** .59*** −.37*** .77*** −.45***
DASS depression .44*** .63*** .76*** .51*** .52*** −.49*** .60*** −.58***
DASS anxiety .54*** .47*** .73*** .34*** −.19* .57*** −.19*
DASS stress .62*** .59*** .57*** −.24** .74*** −.33***
Note: *p b .01; **p b .001; ***p b .0001; DASS = Depression Anxiety Stress Scale (D = depression, A = anxiety, S = stress); BDI-II = Beck
Depression Inventory-II; BAI = Beck Anxiety Inventory; PSWQ = Penn State Worry Questionnaire; PANAS-P = Positive Affect Negative Affect
Scale-Positive; PANAS-N = Positive Affect Negative Affect Scale-Negative; QOLI = Quality of Life Index.

DASS-S, and DASS-A (p b .05 for all), although the differences between the three diagnostic groups were not
DASS-S did not correlate as strongly with the PSWQ as significant.
expected. With respect to the DASS-S, our hypothesis (that
DASS scales correlated highest with measures of like the GAD and comorbid GAD/mood diagnostic groups
constructs and lowest with measures of unlike con- would be significantly different from the mood and no
structs. For instance, the DASS-D was more positively diagnosis groups) was once again partially supported.
correlated with the BDI-II (r = .76) than with any other Participants without a psychiatric diagnosis scored
measure: BAI (r = .51, z = 5.73, p b .001); PSWQ (r = .52, significantly lower on the DASS-S than all other groups
z = 5.25, p b .001); PANAS-PA (r = − .49, z = 12.85, (GAD: β = − 1.23, p b .001; comorbid GAD/mood: β =
p b .001); PANAS-NA (r = .60, z = 4.07, p b .05); and − 1.51, p b .001; Mood: β = − 1.14, p b .001). Further, the
QOLI (r = − .58, z = 13.68, p b .001). Likewise, the Mood alone group scored significantly lower than the
DASS-A was more positively correlated with the BAI GAD/mood group (β = − .36, p b .05).
(r = .74) than other measures: BDI-II (r = .47, z = 5.73,
p b .001); PSWQ (r = .34, z = 7.22, p b .001); PANAS- 3.6. Diagnostic utility
PA (r = − .19, z = 10.27, p b .001); PANAS-NA (r = .57,
z = 4.20, p b .001); and QOLI (r = − .19, z = 10.18, Given that results from the CFAs suggested that the
p b .001). The DASS-S was more positively correlat- DASS does not represent a unitary construct, ROC
ed with the PANAS-NA (r = .74), than other measures: analyses were conducted for each diagnostic group using
BDI-II (r = .62, z =2.94, p b .005); BAI (r = .59, z = 2.82, the DASS scales. The first ROC analysis evaluated the
p b .05); PSWQ (r = .57, z = 3.07, p b .05); PANAS-PA ability of the DASS to identify GAD. The area under the
(r = − .24, z = 12.34, p b .001); and QOLI (r = − .33, curve (AUC), a statistic that varies between .5 (chance
z = 13.26, p b .001). classification) and 1.0 (perfect diagnostic accuracy), for
the three scales, was: (a) DASS-D, Az = .63, p b .001;
3.5. Discriminative validity (b) DASS-A, Az = .60, p b .05; and (c) DASS-S, Az = .70,

Participants with a mood disorder scored signifi-


Table 4
cantly higher on the DASS-D relative to other diagnostic
Comparisons of diagnostic groups on the DASS
groups (see Table 4). Both depressive groups scored
DASS scale GAD Mood GAD/ No dx Significant
significantly higher than the GAD-only group (Mood
mood group
Disorder Alone: β = .69, p b .001; GAD/Mood: β = .54, comparisons
p b .05) and no diagnosis group (Mood Alone: β = 1.52, n = 73 n = 33 n = 61 n = 33
p b .001; GAD/Mood: β = 1.37, p b .001). Likewise, the (1) (2) (3) (4)
group without a psychiatric diagnosis scored signifi- Depression M 8.20 13.76 12.13 2.73 2,3 N 1; 1,2,3 N 4
cantly lower on the DASS-D than all other groups. The SD 8.11 9.46 7.83 4.07
two depressive groups did not significantly differ from Anxiety M 6.66 6.12 9.08 3.52 1,2,3 N 4
SD 6.82 5.10 7.90 3.28
one another.
Stress M 16.11 14.91 17.60 5.58 3 N 2; 1,2,3 N 4
Our prediction that all three diagnostic categories SD 9.79 10.81 9.04 5.21
would score significantly higher on the DASS-A than
Note: GAD = primary diagnosis of GAD without a mood disorder;
the non-psychiatric group was supported: GAD (β = .51, Mood = primary diagnosis of a mood disorder (i.e., major depression
p b .001); Comorbid GAD/mood disorder (β = .76, or dysthymia); GAD/mood = comorbid diagnoses of GAD and a mood
p b .001); Mood Disorder Alone (β = .48, p b .05). The disorder; No dx = no diagnosable psychiatric disorder.
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 255

p b .001. Pairwise comparisons of ROCs indicated that Table 6


the AUC for DASS-S was greater than that for DASS-D, Diagnostic accuracy values for the DASS-D when predicting mood
disorders
χ2(1) = 9.9, p b .01 and DASS-A, χ2(1) = 5.6, p b .05. To
provide a comparison, these analyses were repeated for Scale Sensitivity Specificity Positive Negative
score mood mood predictive power predictive power
scales associated with GAD: PSWQ (Az = .71, p b .001, mood mood
and PANAS-NA (Az = .67, p b .001). The AUC for the
≥0 100.00 0.00 41.9
DASS-S, PSWQ, and PANAS-NA was not significantly
≥2 97.85 20.93 47.2 93.1
different from each other (p N .05 for all), suggesting that ≥4 95.70 44.96 55.6 93.5
the DASS-S predicts the diagnostic presence of GAD as ≥6 a 82.80 62.02 61.1 83.3
well as the PSWQ or PANAS-NA. The PSWQ did obtain ≥8 68.82 68.99 61.5 75.4
higher AUC values in an earlier analysis with a subset of ≥10 62.37 75.97 65.2 73.7
≥12 47.31 81.40 64.7 68.2
the sample included here, however (Webb et al., in
≥14 38.71 86.82 67.9 66.3
press). Diagnostic accuracy calculations with respect to ≥16 34.41 89.15 69.6 65.3
GAD are listed for the DASS-S in Table 5. Based on ≥18 25.81 89.92 64.9 62.7
these calculations, a raw DASS-S scale score ≥ 14 ≥20 21.51 91.47 64.5 61.8
represents the optimal cut-off score to best balance ≥22 16.13 94.57 68.2 61.0
≥24 16.13 95.35 71.4 61.2
specificity and sensitivity when attempting to classify
≥26 8.60 96.12 61.5 59.3
older adults in a primary care setting into diagnostic ≥28 8.60 98.45 80.0 59.9
categories of GAD vs. non-GAD. ≥30 5.38 98.45 71.4 59.1
The second set of ROC analyses evaluated the ≥32 3.23 98.45 60.0 58.5
ability of the DASS to identify mood disorders (MDD ≥34 1.08 100.00 100.0 58.4
≥36 0.00 100.00 58.1
and dysthymia). The AUC for the three scales was (a)
DASS-D, Az = .77, p b .001; (b) DASS-A, Az = .60, Note: DASS-D = Depression scale of the DASS-21.
a
Represents optimal balance between sensitivity and specificity.
p b .05; and (c) DASS-S, Az = .62, p b .05. The AUC

was Az = .76, p b .001 for the BDI-II. Pairwise compar-


Table 5
Diagnostic accuracy values for the DASS-S when predicting GAD
isons of ROCs suggested greater AUC for the DASS-D
than the DASS-A, χ2(1) = 12.6, p b .001, and DASS-S,
Scale Sensitivity Specificity Positive Negative
χ2(1) = 15.0, p b .001, but not for the BDI-II, p. N 05.
Score GAD GAD predictive power predictive power
GAD GAD This suggests that the DASS-D and BDI-II are equally
able to predict the diagnostic presence of depression.
≥0 100.00 0.00 60.2
≥2 99.25 10.23 62.6 90.0 Diagnostic accuracy calculations for the DASS-D are
≥4 92.48 23.86 64.7 67.7 displayed in Table 6. Based on these calculations, a raw
≥6 89.47 36.36 68.0 69.6 DASS-D score ≥ 6 represents the optimal cut-off score
≥8 87.22 43.18 69.9 69.1 derived to maximize sensitivity and specificity when
≥10 81.20 52.27 72.0 64.8
attempting to classify older adults in a primary care
≥12 74.44 59.09 73.3 60.5
≥14 a 65.41 68.18 75.7 56.6 setting into diagnostic categories of mood vs. non-mood
≥16 55.64 73.86 76.3 52.4 categories. Higher cut scores on the DASS-D may be
≥18 40.60 77.27 73.0 46.3 needed, however, depending on the purpose of the as-
≥20 30.83 81.82 71.9 43.9 sessment and consequences of false-positives vs. false-
≥22 24.81 86.36 73.3 43.2
negatives.
≥24 21.05 90.91 77.8 43.2
≥26 16.54 92.05 75.9 42.2
≥28 14.29 93.18 76.0 41.8 4. Discussion
≥30 12.03 95.45 80.0 41.8
≥32 10.53 95.45 77.8 41.4 This study is the first to investigate the psychometric
≥34 8.27 97.73 84.6 41.3
properties of the DASS-21 in older adults. Analyses
≥36 5.26 98.86 87.5 40.8
≥38 2.26 98.86 75.0 40.1 examined the factor structure, internal consistency,
≥4 0.00 100.00 39.8 convergent and discriminative validity, and diagnostic
Note: DASS-S = stress scale of the DASS-21 GAD = generalized
utility of the DASS-21. CFA of the DASS-21 indicated
anxiety disorder. that a three-factor solution best fit the data. This is con-
a
Represents optimal balance between sensitivity and specificity. sistent with findings from populations of adult anxiety-
256 A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259

disordered patients (Antony et al., 1998), adult Spanish The three DASS-21 scales were tested for their ability
patients (Daza et al., 2002), and adult mood-disordered to detect group mean differences between participants
patients (Clara et al., 2001). Consistent with research diagnosed with primary GAD, mood disorders, comor-
on the DASS-42 (Brown et al., 1997), the three-factor bid GAD/mood disorders, and no diagnosis. Partici-
solution of the DASS-21 was superior to a two-factor pants diagnosed with GAD, mood, and comorbid
solution that collapsed the Anxiety and Stress scales. The GAD/mood scored significantly higher on each of the
three-factor solution also produced a better fit than the scales than participants without a DSM-IV diagnosis.
two-factor solutions that collapsed the Anxiety and De- Further, scores on the DASS-D were higher for both the
pression or Stress and Depression scales. This result is in pure and comorbid depression groups than the pure
contrast to suggestions that GAD and depression are not GAD group. Likewise, scores on the DASS-S were
independent constructs in older adults (Schoevers et al., higher in the comorbid GAD/mood group than in the
2003, Schoevers et al., 2005). This suggests that a pure mood group. In contrast, no significant differences
constructural distinction between depression and anxiety/ emerged across the three diagnostic groups on the
stress is necessary in this sample of older adults with DASS-A. It should be noted, however, that the patterns
predominately GAD and depression. Thus, despite sig- of means were consistent with all a priori hypotheses
nificant zero-order inter-scale correlations, the present and may reflect Type II error. In summary, it appears as
results suggest the presence of three distinct factors in if all three DASS-21 scales are able to differentiate
older adult primary care patients. pathological and non-pathological samples. Moreover,
Consistent with examinations in younger adults, the DASS-D appears to be especially adept at dif-
the DASS-21 total score demonstrated excellent ferentiating patients with and without depression even
internal consistency. At the scale level, the DASS-D in the presence of comorbidity. The DASS-S, in con-
and DASS-S had good internal consistency; whereas trast, seemed to differentiate the comorbid group from
the DASS-A had poor internal consistency. Although a the mood only group. The performance of the DASS-A
previous investigation of the DASS-21 also reported should be interpreted with caution due to characteristics
the lowest scale internal consistency for the DASS-A of the current sample.
(α = .87) (Antony et al., 1998), the lower-than-expected Using ROC analyses, we examined the diagnostic
value in this population may represent chance or a utility of the DASS-21 scales with respect to the pre-
systematic difference between younger and older adults diction of GAD and mood disorders. These analyses
with respect to these items. Older patients present with indicated that the DASS-S differentiates positive vs.
more somatic complaints which may result in less negative GAD status equally as well as the PSWQ and
variability in their responses than younger patients. PANAS-NA. Analyses also indicated that the DASS-D
Indeed, post-hoc exploratory factor analyses of the scale better differentiates positive vs. negative mood
DASS-21 in this sample revealed that the 7 items of the status than the other two scales and equally as well
DASS-A loaded onto two separate factors. Unfortu- as the BDI-II. Overall the AUC was relatively low for
nately the loadings were inconsistent across subsequent both scales, and especially so for the DASS-S. In
sample divisions and rotations. Regardless, caution in comparison, the 14-item Hospital Anxiety and Depres-
the interpretation of the DASS-A – and other measures sion Scale (HADS) demonstrated a larger AUC (.80)
of anxiety that utilize items with somatic content – is when predicting GAD in geriatric primary care
necessary in older patients, unless such effects can be patients (Wetherell et al., 2007). Nevertheless, these
ruled out. Future studies are clearly needed to examine results are noteworthy in that the 7 item scales of the
this hypothesis. DASS-21 predict the diagnostic status of GAD and
Results strongly supported the convergent validity mood disorders equally as well as two separate mea-
of the DASS-21 in older adults. The pattern of correla- sures (e.g., PSWQ =16 items and BDI-II = 21 items)
tions between the DASS-21 total score and scale scores and therefore have the potential to reduce patient
with associated measures was consistent with a priori fatigue. Although short forms of the BDI and BAI
predictions. Correlations between DASS scales and exist (e.g., Mori et al., 2003; Scheinthal et al., 2001),
measures of similar constructs (i.e., BDI, BAI, and most researchers use the full scales. The relative ad-
PSWQ/PANAS-NA) were consistently significantly re- vantages of using the DASS-21 or the HADS are
lated and nearly unanimously superior to comparison related to the additional information yielded by the
measures. three integrated scales of the DASS. If further research
Results also provide qualified evidence for the dis- using different samples replicates these findings and
criminative validity of the DASS-21 in older adults. extends the results to the DASS-A scale, the DASS-21
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 257

is one candidate for an economical screening ques- Acknowledgments


tionnaire in older adults.
Several limitations must be considered when inter- The authors wish to express their appreciation to
preting these results. First, all instruments examined in Paula Wagner, Jessica Calleo, Antje Dietel, and Sonora
this study are self-report measures and are subject to Hudson for their help in preparing this manuscript.
similar sources of method error. Future studies using
a multi-trait, multi-method approach might reveal dif- References
ferent sources of variance and suggest whether the
observed weaknesses in group-level discriminative valid-
American Psychiatric Association, 2000. Diagnostic and Statistical
ity result from construct definition, rater source, or both. A Manual of Mental Disorders, (4th ed.). Author, Washington, D.C.
second limitation surrounds the relatively homogeneous Antony, M., Bieling, P.J., Cox, B.J., Enns, M.W., Swinson, R.P., 1998.
diagnostic constellation of this convenience sample. Psychometric properties of the 42-item and 21-item versions of the
Whereas the sample reflects both the goals of the Depression Anxiety Stress Scales in clinical groups and commu-
nity a sample. Psychological Assessment 10, 176–181.
overarching treatment study and the prevalence of mental
Beck, J.G., Stanley, M.A., 2001. Assessment of anxiety disorder in
disorders in older adults, a greater sampling of other older adults: current concerns, future prospects. In: Antony, M.M.,
anxiety diagnoses is needed to fully explore the Orsillo, S.M., Roemer, L. (Eds.), Practitioner's Guide to Empiri-
psychometric properties in older adults and allow cally Based Measures of Anxiety. Kluwer Academic Publishers,
comparison with younger adults. Likewise, participants Dordrecht, pp. 43–48.
Beck, A.T., Steer, R.A., 1990. Beck Anxiety Inventory: Manual. The
were self-referred and screened positive to the two
Psychological Corporation, San Antonio, TX.
PRIME-MD questions. It is possible that some of the Beck, A.T., Steer, R.A., Brown, G.K., 1996. Beck Depression
results would have been stronger in the larger population Inventory Manual, (2nd Edition). Psychological Corporation,
of standard clinical care patients who did not answer San Antonio, TX.
positive to screening questions. Further, the recom- Beck, J.G., Novy, D.M., Diefenbach, G.J., Stanley, M.A., Averill, P.M.,
Swann, A.C., 2003. Differentiating anxiety and depression
mended cut-off scores are dependent on diagnostic aims
in older adults with generalized anxiety disorder. Psychological
and may need to be lowered in clinical care where a false- Assessment 15, 184–192.
negative has worse consequences than a false-positive. Beck, J.G., Stanley, M.A., Zebb, B.J., 1995. Psychometric properties
Finally, the cross-sectional nature of these data does not of the Penn State Worry Questionnaire in older adults. Journal of
allow interpretation of psychometric stability over time. Clinical Geropsychology 1, 33–42.
Beekman, A.T., Bremmer, M.A., Deeg, D.J.H., van Baldom, A.J.L.M.,
Longitudinal designs across the life-span and following
Smit, J.H., de Beurs, E., van Dyck, R., van Tilburg, W.V., 1998.
therapy are encouraged in future studies. Anxiety disorders in later life: a report from the Longitudinal
In conclusion, the DASS-21 demonstrated positive Aging Study Amsterdam. International Journal of Geriatric
psychometric properties in a population of older primary Psychiatry 13, 717–726.
care patients. Results indicate that the DASS-21 has Beekman, A.T.F., de Beurs, E., Balkom, A.J.L.M., Deeg, D.J.H., van
Dyck, R., van Tilburgh, W., 2000. Anxiety and depression in later
overall good-to-excellent internal consistency, a three-
life: co-occurrence and communality of risk factors. American
factor structure consistent with younger samples, very Journal of psychiatry 157, 89–95.
good convergent validity, and acceptable discriminative Blazer, D., George, L.K., Hughes, D., 1991. The epidemiology of
validity — especially with respect the Depression scale. anxiety disorders: an age comparison. In: Salzman, C., Lebowitz,
The difficulties surrounding group-level discriminative B.D. (Eds.), Anxiety in the Elderly: Treatment and Research.
Springer, New York, pp. 17–30.
validity are common to all measures of anxiety and de-
Bourland, S.L., Stanley, M.A., Snyder, A.G., Novy, D.M., Beck, J.G.,
pression and, based on inter-scale correlations, the DASS- Averill, P.M., Swann, A.C., 2000. Quality of life in older adults with
21 may be better than most. These results indicate that the generalized anxiety disorder. Aging & Mental Health 4, 315–323.
DASS-21 should be further examined and potentially Brown, T.A., 2006. Confirmatory Factor Analysis for Applied Research.
used as a routine screening device in older adults in Guilford, New York.
Brown, T.A., Antony, M.M., Barlow, D.H., 1992. Psychometric
primary care settings.
properties of the Penn State Worry Questionnaire in a clinical
disorders sample. Behavior and Research Therapy 30, 33–37.
Role of funding source Brown, T.A., Chorpita, B.F., Korotitsch, W., Barlow, D.H., 1997.
This research was supported by Grant 53932 from the National Psychometric properties of the Depression Anxiety Stress Scales
Institute of Mental Health to the last author. The NIMH had no further (DASS) in clinical samples. Behaviour Research and Therapy 35,
role in study design, data collection, data analysis, interpretation, writing 79–89.
of the manuscript, or in the decision to submit the paper for publication. Clara, I.P., Cox, B.J., Enns, M.W., 2001. Confirmatory factor analysis of
the Depression Anxiety Stress Scales in depressed and anxious
Conflict of interest patients. Journal of Psychopathology and Behavioral Assessment 23,
None of the author's have conflicts of interest. 61–67.
258 A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259

Crawford, J.R., Henry, J.D., 2003. The Depression Anxiety Stress Meyer, T.J., Miller, M.L., Metzger, R.L., Borkovec, T.D., 1990.
Scales (DASS): normative data and latent structure in a large non- Development and validation of the Penn State Worry Question-
clinical sample. British Journal of Clinical Psychology 42, 11–131. naire. Behaviour Research and Therapy 28, 487–495.
Daza, P., Novy, D.M., Stanley, M.A., Averill, P., 2002. The Depression Mori, D.L., Lambert, J.F., Niles, B.L., Orlander, J.D., Grace, M.,
Anxiety Stress Scale-21: Spanish translation and validation with a LoCastro, J.S., 2003. The BAI-PC as a screen for anxiety, depression,
Hispanic sample. Journal of Psychopathology and Behavioral and PTSD in primary care. Journal of Clinical Psychology in Medical
Assessment 24, 195–205. Settings 10, 187–192.
Delong, E.R., Delong, D.M., Clarkepearson, D.I., 1988. Comparing the Morin, C.M., Landreville, P., Colecchi, C., McDonald, K., Stone, J., Ling,
areas under 2 or more correlated receiver operating characteristic W., 1999. The Beck Anxiety Inventory: psychometric properties
curves: a nonparametric approach. Biometrics 44 (3), 837–845. with older adults. Journal of Clinical Geropsychology 5, 19–29.
Folstein, M.F., Folstein, S.E., McHugh, P.R., 1975. Mini-mental state. Muthen, L.K., Muthen, B.O., 2002. How to use a Monte Carlo study to
A practical method for grading the cognitive state of patients for the decide on sample size and determine power. Structural Equation
clinician. Journal of Psychiatric Research 12, 189–198. Modeling 9 (4), 599–620.
Fresco, D.M., Heimberg, R.G., Mennin, D.S., Turk, C.L., 2002. Raykov, T., 2004. Behavioral scale reliability and measurement
Confirmatory factor analysis of the Penn State Worry Question- invariance evaluation using latent variable modeling. Behavior
naire. Behaviour Research and Therapy 40, 313–323. Therapy 35 (2), 299–331.
Frisch, M.B., Cornell, J., Villanueva, M., 1992. Clinical validation of Scheinthal, S.M., Steer, R.A., Giffin, L., Beck, A.T., 2001. Evaluating
the Quality of Life Inventory: a measure of life satisfaction for use geriatric medical outpatients with the Beck Depression Inven-
in treatment planning and outcome assessment. Psychological tory-FastScreen for medical patients. Aging & Mental Health 5,
Assessment 4, 92–101. 143–148.
Frisch, M.B., 1994. Manual and Treatment Guide for the Quality of Schoevers, R.A., Beekman, A.T.F., Deeg, D.J.H., Jonker, C., van
Life Inventory. National Computer Systems, Inc., Minneapolis. Tilburg, W., 2003. Comorbidity and risk-patterns of depression,
Frisch, M.B., 1999. Quality of life assessment/intervention and the generalized anxiety disorder and mixed anxiety-depression in later
Quality of Life Inventory, In: Maruish, M.E. (Ed.), The use of life: Results from the AMSTEL study. International Journal of
Psychological Testing for Treatment Planning and Outcomes Geriatric Psychiatry 18, 994–1001.
Assessment, (2nd ed.). Lawrence Erlbaum, Mahwah N.J. Schoevers, R.A., van Tilburg, W., Beekman, A.T.F., Deeg, D.J.H.,
Hopko, D.R., Stanley, M.A., Reas, D.L., Wetherell, J.L., Beck, J.G., 2005. Depression and generalized anxiety disorder: co-occurrence
Novy, D.M., Averill, P.M., 2003. Assessing worry in older adults: and longitudinal patterns in elderly patients. American Journal of
confirmatory factor analysis of the Penn State Worry Questionnaire Geriatric Psychiatry 13, 31–39.
and psychometric properties of an abbreviated model. Psycholo- Segal, D.L., Hersen, M., Van Hasselt, V.B., Kabacoff, R.I., Roth, L.,
gical Assessment 15, 173–183. 1993. Reliability of diagnosis in older psychiatric patients using
Hu, L.T., Bentler, P.M., 1998. Fit indices in covariance structure the Structured Clinical Interview for DSM-III-R. Journal of
modeling: sensitivity to underparameterized model misspecifica- Psychopathology and Behavioral Assessment 15, 347–356.
tion. Psychological Methods 3 (4), 424–453. Senior, A.C., Kunik, M.E.K., Rhoades, H.M., Novy, D.M., Wilson, N.L.,
Kabacoff, R.I., Segal, D.L., Hersen, M., Van Hassellt, V.B., 1997. Stanley, M.A., 2007. Utility of telephone assessments in an older
Psychometric properties and diagnostic utility of the Beck Anxiety adult population. Psychology and Aging 22, 392–397.
Inventory and the State-Trait Anxiety Inventory with older adult Shapiro, A.M., Roberts, J.E., Beck, J.G., 1999. Differentiating
psychiatric outpatients. Journal of Anxiety Disorders 11, 33–47. symptoms of anxiety and depression in older adults: distinct
Kercher, K., 1992. Assessing subjective well-being in the old–old: the cognitive and affective profiles? Cognitive Therapy and Research
PANAS as a measure of orthogonal dimensions of positive and 23, 53–74.
negative affect. Research on Aging 42, 131–168. Spitzer, R.L., Williams, J.B., Gibbon, M., First, M.B., 1992. The Structured
Lenze, E.J., Karp, J.F., Mulsant, B.H., Blank, S., Shear, M.K., Houck, Clinical Interview for DSM-III-R (SCID).I. History, rationale, and
P.R., et al., 2005. Somatic symptoms in late-life anxiety: treatment description. Archives of General Psychiatry 49, 624–629.
issues. Journal of GeriatricPsychiatry and Neurology 18, 89–96. Spitzer, R.L., Williams, J.B., Kroenke, K., Linser, M., de Gruy, F.V.,
Lenze, E.J., Rogers, J.C., Martire, L.M., Mulsant, B.H., Rollman, B.L., Hahn, S.R., et al., 1994. Utility of a new procedure for diagnosing
Dew, M.A., et al., 2001. The association of late-life depression and mental disorders in primary care. The PRIME-MD 1000 study.
anxiety with physical disability: a review of the literature and Journal of the American Medical Association 272, 1749–1756.
prospectus for future research. American Journal of Geriatric Stanley, M.A., Beck, J.G., Novy, D.M., Averill, P.M., Swann, A.C.,
Psychiatry 9, 113–135. Diefenbach, G.J., Hopko, D.R., 2003. Cognitive-behavioral
Lovibond, S.H., Lovibond, P.F., 1995a. Manual for the Depression treatment of late-life generalized anxiety disorder. Journal of
Anxiety Stress Scales. Psychology Foundation, Sydney. Counseling and Clinical Psychology 71, 309–319.
Lovibond, P.F., Lovibond, S.H., 1995b. The structure of negative Stanley, M.A., Novy, D.M., Bourland, S.L., Beck, J.G., Averill, P.M.,
emotional states: comparison of the Depression Anxiety Stress 2001. Assessing older adults with generalized anxiety: a replica-
Scales (DASS) with the Beck Depression and Anxiety Inventories. tion and extension. Behaviour Research and Therapy 39, 221–235.
Behaviour Research and Therapy 33, 335–343. Stata Corp, 2006. Stata Statistical Software. Release 9.2. Stata
Mackinnon, A., Jorm, A.F., Christensen, H., Korten, A.E., Jacomb, Corporation, College Station, TX.
P.A., Rodgers, B., 1999. A short form of the Positive and Negative Steer, R.A., Rissmiller, D.J., Beck, A.T., 2000. Use of the Beck
Affect Schedule: evaluation of factorial validity and invariance Depression Inventory-II with depressed geriatric inpatients.
across demographic variables in a community sample. Personality Behaviour Research and Therapy 38, 311–318.
and Individual Differences 27 (3), 405–416. Steer, R.A., Willman, M., Kay, P.A.J., Beck, A.T., 1994. Differentiat-
Meng, X.L., Rosenthal, R., Rubin, D.B., 1992. Comparing correlated ing elderly medical and psychiatric outpatients with the Beck
correlation-coefficients. Psychological Bulletin 111 (1), 172–175. Anxiety Inventory. Assessment 4, 345–351.
A.T. Gloster et al. / Journal of Affective Disorders 110 (2008) 248–259 259

Taylor, R., Lovibond, P.F., Nicholas, M.K., Cayley, C., Wilson, P.H., PANAS scales. Journal of Personality and Social Psychology 54,
2005. The utility of somatic items in the assessment of depression 1063–1070.
in patients with chronic pain: a comparison of the Zung Self-Rating Webb, S.A., Diefenbach, G., Wagener, P., Novy, D.M., Kunik, M.,
Depression Scale and the Depression Anxiety Stress Scales in Rhoades, H.M., Stanley, M.A., in press. Comparison of self-report
chronic pain and clinical and community samples. The Clinical measures for identifying late-life generalized anxiety in primary
Journal of Pain 25, 91–100. care. Journal of Geriatric Psychiatry and Neurology.
Tolin, D.F., Robison, J.T., Gaztambide, S., Blank, K., 2005. Anxiety Wetherell, J.L., Gatz, M., 2005. The Beck Anxiety Inventory in older
disorders in older Puerto Rican primary care patients. American adults with generalized anxiety disorder. Journal of Psychopathol-
Journal of Geriatric Psychiatry 13, 150–156. ogy and Behavioral Assessment 27, 17–24.
Waikar, S.V., Craske, M.G., 1997. Cognitive correlates of anxious and Wetherell, J.L., Arean, P.A., 1997. Psychometric evaluation of the
depressive symptomatology: an examination of the helplessness/ Beck Anxiety Inventory with older medical patients. Psychological
hopelessness model. Journal of Anxiety Disorders 11, 1–16. Assessment 9, 135–144.
Watson, D., Clark, L.A., Tellegen, A., 1988. Development and validation Wetherell, J.L., Birchler, G.D., Ramsdell, J., Unützer, J., 2007.
of brief measures of positive and negative affect: the PANAS scales. Screening for generalized anxiety disorder in geriatric primary care
Journal of Personality and Social Psychology 5, 1063–1070. patients. International Journal of Geriatric Psychiatry 22, 115–123.
Watson, D., Walker, L.M., 1996. The long-term stability and predictive Wittchen, H.U., Schuster, P., Lieb, R., 2001. Comorbidity and mixed
validity of trait measures of affect. Journal of Personality and Social anxiety-depressive disorder: clinical curiosity or pathophysiologi-
Psychology 70, 567–577. cal need? Human Psychopharmacology 16, S21–S30.
Watson, D., Clark, L.A., Tellegen, A., 1998. Development and
validation of brief measures of positive and negative affect: the

You might also like