Professional Documents
Culture Documents
17-24
Received November 18, 1997; revision received May 12, 1998; accepted September 3, 1998
The Strengths and Difficulties Questionnaire (SDQ) is a brief behavioral screening ques-
tionnaire that can be completed in 5 minutes by the parents or teachers of children aged 4
to 16; there is a self-report version for 11- to 16-year-olds. In this study, mothers completed
the SDQ and the Child Behavior Checklist (CBCL) on 132 children aged 4 through 7 and
drawn from psychiatric and dental clinics. Scores from the SDQ and CBCL were highly
correlated and equally able to discriminate psychiatric from dental cases. As judged against
a semistructured interview, the SDQ was significantly better than the CBCL at detecting
inattention and hyperactivity, and at least as good at detecting internalizing and externalizing
problems. Mothers of low-risk children were twice as likely to prefer the SDQ.
KEY WORDS: Child psychopathology; prosocial behavior; questionnaires; validity; acceptability.
17
0091-0627/99/0200-OOnS16.00/0 © 1999 Plenum Publishing Corporation
18 Goodman and Scott
basis of nosological concepts as well as factor analy- the first direct test of how the SDQ and CBCL com-
ses. The relevant concepts are those that underpin pare.
the Diagnostic and Statistical Manual of Mental Dis-
orders (4th ed.) (DSM-IV; American Psychiatric As-
sociation, 1994) and ICD-10 (World H e a l t h METHOD
Organization, 1993) classifications of childhood psy-
chopathology. For example, the five items on the Overview
SDQ's Inattention-Hyperactivity scale were deliber-
ately selected to tap inattention (two items), hyper- SDQ and CBCL questionnaires were completed
activity (two items), and impulsivity (one item) by the mothers of 132 children aged 4 through 7
because these are the key symptom domains for a years. One part of the sample was from a low-psy-
DSM-IV diagnosis of attention-deficit/hyperactivity chiatric-risk population, being recruited from a chil-
disorder (ADHD; APA, 1994) or for an ICD-10 di- dren's dental clinic. The other part came from a
agnosis of hyperkinesis (World Health Organization, high-psychiatric-risk population, being recruited from
1993). By contrast, the CBCLs Attention Problems three child psychiatric clinics. The predictive validity
scale includes several items that have no conceptual of the two questionnaires was examined by estab-
link with the current diagnostic criteria for ADHD lishing how well each questionnaire was able to dis-
or hyperkinesis, e.g., "Nervous, highstrung, or tense." tinguish between the low- and high-risk samples, as
The fact that the SDQ was designed on the basis of indexed by the area under receiver operating char-
theory as well as previous factor analyses does not acteristic (ROC) curves. Parental preference was
seem to have undermined its factor structure; factor only established for the dental sample. Detailed in-
analyses on an independent community sample have terviews with parents about their children's psycho-
confirmed that each of the five scales corresponds to pathology were only carried out for the psychiatric
a distinct factor (Smedje, Broman, Hetta & von sample.
Knorring, in press). Does the SDQ's reliance on di-
agnostic concepts as well as factor analyses influence
Low-Risk Sample
its validity?
A further difference between the SDQ and
The mothers of children attending a children's
CBCL is that, whereas the CBCL's psychopathology
department of a London dental hospital were asked
scales are based entirely on parental endorsements
to complete the two questionnaires while awaiting
of negative items (e.g., "Can't concentrate, can't pay
their clinic appointments if their children were aged
attention for long"), some of the comparable items
from 4 years, 0 months, to 7 years, 11 months. Most
contributing to the SDQ's psychopathology scales are
of the mothers approached did agree to take part,
phrased positively (e.g. "Sees tasks through to the
though the proportion of refusals was not systemati-
end, good attention span"). The SDQ's greater em-
cally recorded since, as explained subsequently, the
phasis on positive attributes was designed to increase
statistical analyses did not require the sample to be
the questionnaire's acceptability to respondents. Was representative. Completed questionnaires were ob-
this successful? tained on 71 children.
Though there have not previously been any di-
rect comparisons of the SDQ and the CBCL, indirect
evidence suggests that they are probably roughly High-Risk Sample
equivalent. Scores derived from the CBCL and the
Rutter parent questionnaire (Rutter, Tizard, & Whit- As part of an ongoing study evaluating the ef-
more, 1970) correlate highly with one another and fectiveness of parent management training, parents
are of comparable predictive validity (Berg, Lucas, from three child psychiatric clinics in and around
& McGuire, 1992; Fombonne, 1989). Since scores London were recruited if they had children aged be-
from the SDQ and Rutter questionnaires are also tween 3 and 8 years referred with externalizing prob-
highly correlated and of comparable predictive valid- lems in the absence of severe language problems or
ity (Goodman, 1997), it seems reasonable to infer known mental retardation. The high-risk sample for
that the SDQ and the CBCL are themselves highly the present study consists of the first 61 children
correlated and of comparable validity. This study was aged from 4 years, 0 months, to 7 years, 11 months,
Comparison of SDQ and CBCL 19
the two questionnaires does not depend on the rep- tion, the area under the curve would be 1.0 for a
resentativeness of the two samples; it assumes only measure that discriminated perfectly, and .5 for a
that psychiatric disorder is commoner in the high-risk measure that discriminated with no better than
than the low-risk group. Since the ROC curves for chance accuracy. Both questionnaires discriminated
the SDQ and CBCL were derived from the same set well, with an area under the curve of around .95 for
of patients, the statistical comparison of the areas un- Total and Externalizing scales. In no instance did the
der these ROC curves allowed for the paired nature area under the curve for the equivalent SDQ and
of the data (Hanley & McNeil, 1983). Comparisons CBCL scales differ significantly.
of correlations also allowed for the paired nature of
the data, using structural equation modeling (EQS;
Bentler, 1989) to examine whether constraining the SDQ-CBCL Correlations
correlations to be the same resulted in a significantly
poorer fit. For example, when an SDQ-interview cor-
relation differed from the corresponding CBCL-in- Table II shows the correlations between the
terview correlation, the significance of this difference equivalent SDQ and CBCL scales. All correlations
was examined by comparing two different structural were statistically significant (p < .001). Though the
equation models: one allowing the correlations to be Prosocial scale of the SDQ and the competence scale
different and the other constraining the correlations of the CBCL share a focus on positive attributes,
to be equal. The difference in correlations was sig- they were not considered to be equivalent scales
nificant if the goodness of fit of the constrained since they differ so markedly in item content.
model was significantly poorer than that of the un-
constrained model (Dunn, Everitt, & Pickles, 1993).
Correlation with Interview Scores
Table II. Correlations of Equivalent SDQ and CBCL Scales" Table IV. Intercorrelations of Different Scales from the
Problem scales SDQ-CBCL correlations Same Questionnairea
greater criterion validity than the corresponding 11- of psychiatric disorders. It will obviously be impor-
item CBCL scale? One possible explanation is that tant to attempt to replicate these findings on a
the SDQ scale has greater content validity since item broader age range, using larger samples, including
selection was guided by DSM-IV and ICD-10 diag- community samples and diverse clinical samples.
nostic criteria for ADHD (APA, 1994) and hyperki- Such studies could also compare the informant-rated
nesis (World Health Organization, 1993). Drawing on SDQ completed by teachers with the Teacher Report
a large body of empirical studies, both classifications Form (TRF; Achenbach, 1991b), and the self-report
emphasize that the core symptoms domains are in- SDQ (Goodman et al., 1998) with the Youth Self-
attention, hyperactivity, and impulsiveness. All five Report (YSR; Achenbach, 1991c).
SDQ items are drawn from these three domains, Pending such larger-scale studies, the current
whereas many of the CBCL items tap different symp- findings suggest that the SDQ and CBCL are com-
tom domains: immaturity, confusion, nervousness, parable in many ways. Consequently, either question-
twitching, poor school work, and clumsiness. Increas- naire would be suitable for many purposes. In some
ing scale length by including items that are concep- respects, however, the two questionnaires have differ-
tually marginal may only serve to undermine validity. ent strengths. The SDQ's brevity and its acceptability
The correlation between the Internalizing and to the parents of low-risk children may make it a par-
Externalizing scales was significantly lower for the ticularly suitable screening measure for community
SDQ than for the CBCL. This was not because all studies where response rates are liable to be under-
interscale correlations were attenuated for the mined by long or negatively slanted questionnaires.
shorter questionnaire: The externalizing-inattention The SDQ may also provide a more useful measure
correlation was almost equally high for the SDQ and of inattention and hyperactivity. On the other hand,
CBCL. Two alternative explanations are plausible. the CBCL covers a broader range of problems, par-
On the one hand, the lower SDQ internalizing-ex- ticularly suiting it for studies or clinical assessments
ternalizing correlation may reflect the SDQ scales that require coverage of rare as well as common
being less contaminated by one another than the forms of childhood psychopathology. Both question-
comparable scales from the CBCL. Alternatively, the naires have their value but serve somewhat different
higher CBCL internalizing-externalizing correlation purposes.
may be a more accurate reflection of real comorbid-
ity. While there is no doubt that comorbidity exists
(Caron & Rutter, 1991), the question is whether this ACKNOWLEDGMENTS
comorbidity is underestimated by the SDQ or over-
estimated by the CBCL. The present findings are We are very grateful to all participating parents;
more suggestive of the latter since, when interview- to Hilary Richards, Quentin Spender, Pippa Hoad,
based correlations were low, SDQ correlations were Julia Featherstone, Jenny Price, Rosemarie Berry,
also low, whereas CBCL correlations remained high. Moira Doolan, and Deborah Fulford for their assis-
These findings require confirmation on larger and tance in data collection and coding; and to all the
more representative samples, but they do support the staff of the clinics that took part in the study: the
notion that the CBCLs Internalizing and Externaliz- Department of Paediatric Dentistry of King's Dental
ing scales are indeed more contaminated by one an- Institute; the Children's Department of the Maudsley
other than are the comparable SDQ scales. Hospital; the Child and Family Psychiatry Clinic,
Parents of the low-risk sample were significantly Croydon; and the Child and Family Service for Men-
more likely to prefer the SDQ to the CBCL, perhaps tal Health, Chichester. Data on the psychiatric sam-
because of the SDQ's brevity and greater emphasis ple were obtained in the course of a study funded
on strengths. The preference of parents whose chil- by the National Health Service Research and Devel-
dren are at high psychiatric risk has yet to be estab- opment Executive.
lished; perhaps they welcome the opportunity
provided by the CBCL to report on a broader range
of psychopathology. REFERENCES
The results of this study are necessarily prelimi- Achenbach, T M. (1991a). Manual for the Child Behavior Check-
nary, being based on a comparison of two relatively list!4-J8 and 1991 profile. Burlington: University of Vermont,
small samples of young children at high and low risk Department of Psychiatry.
24 Goodman and Scott
Achenbach, T M. (1991b). Manual for the Teacher's Report Form Goodman, R. (in press). The extended version of the Strengths
and 1991 profile. Burlington: University of Vermont, Depart- and Difficulties Questionnaire as a guide to child psychiatric
ment of Psychiatry. caseness and consequent burden. Journal of Child Psychology
Achenbach, T M. (1991c). Manual for the Youth Self-Report. and Psychiatry.
Burlington: University of Vermont, Department of Psychiatry. Goodman, R., Meltzer, H., & Bailey V (1998). The Strengths and
American Psychiatric Association. (1994). Diagnostic and statistical Difficulties Questionnaire: A pilot study of the validity of the
manual of mental disorders (4th ed). Washington, DC: Author. self-report version. European Child and Adolescent Psychiatry,
Bentler, R M. (1989) EQS: Structural equations mannual. Los An- 7, 125-130.
geles: BMPP Statistical Software, Inc. Hanley, J. A., & McNeil, B. J. (1983). A method of comparing
Berg, I., Lucas, C, & McGuire, R. (1992). Measurement of be- the areas under receiver operating characteristic curves de-
haviour difficulties in children using standard scales adminis- rived from the same cases. Radiology, 148, 839-843.
tered to mothers by computer: Reliability and validity. Rutter, M., Tizard, J., & Whitmore, K. (1970). Education, health
European Child and Adolescent Psychiatry, 1, 14-23. and behaviour. London, England: Longman.
Smedje, H., Broman, J.-E., Hetta, J. & von Knorring, A.-L. (in
Caron, C., & Rutter, M. (1991). Comorbidity in child psychopa-
press). Psychometric properties of a Swedish version of the
thology: Concepts, issues and research strategies. Journal of
"Strengths and Difficulties Questionnaire." European Child
Child Psychology and Psychiatry, 32, 1063-1080. and Adolescent Psychiatry.
Dunn, G, Everitt, B., & Pickles, A. (1993). Modelling covariances Streiner, D. L., & Norman, G. R. (1989). Health measurement
and latent variables using EQS. London, England: Chapman scales. Oxford, England: Oxford University Press
& Hall. Taylor, E., Sandberg, S., Thorley, G., & Giles, S. (1991). The
Elander, J., & Rutter, M. (1996). Use and development of the epidemiology of childhood hyperactivity. Oxford, England: Ox-
Rutter parents' and teachers' scales. International Journal of ford University Press.
Methods in Psychiatric Research, 6, 63-78. Taylor, E., Schacher, R., Thorley, G., & Wieselberg, M. (1986).
Fombonne, E. (1989). The Child Behavior Checklist and the Rut- Conduct disorder and hyperactivity: I. Separation of hyperac-
ter Parental Questionnaire: A comparison between two tivity and antisocial conduct in British child psychiatric pa-
screening instruments. Psychological Medicine, 19, 777-785. tients. British Journal of Psychiatry, 149, 760-767.
Goodman, R. (1997). The Strengths and Difficulties Question- World Health Organization. (1994). The ICD-10 classification of
naire: A research note. Journal of Child Psychology and Psy- mental and behavioural disorders: Diagnostic criteria for re-
chiatry, 38, 581-586. search. Geneva, Switzerland: Author.