Professional Documents
Culture Documents
1459-1473, 1995
Elsevier Science Ltd. Printed in Great Britain
0021-9630(95)00069-4)
Introduction
It is well known that Attention Deficit Hyperactivity Disorder (ADHD) has
neuropsychological consequences that affect academic functioning and adaptation
to the demands of the social environment (Barkley, 1990). For example, it
1459
1460 L. J. Seidman et al.
While the above research findings are mixed, it is important to consider the
divergent methodologies employed in these studies. For example, only two of
the studies (McGee et al., 1989; Moffitt 8c Silva, 1988) used both copy and recall
conditions, and only one ofthe studies (Barr et al., 1990) comes close to using
the full complement of available scoring options. Three ofthe studies (Douglas
& Benezra, 1990; McGee et al, 1989; Moffitt 8c Silva, 1988) fail to specify which
dependent measure and scoring system were utilized. Thus, variables of primary
theoretical interest in the study of the ROCF, such as organization, encoding
style, and retention, have been frequently overlooked. The importance of
analyzing ROCF data from a process-oriented standpoint has been emphasized
in the adult neuropsychological literature, where copy strategies have been shown
to predict the quality of recall productions (Bennett-Levy, 1984; Shorr, Delis 8c
Massman, 1992). Absence of group difference tends to be found in studies with
small sample sizes, raising concerns regarding statistical power (Barkley et al.,
1992; Moffitt & Silva, 1988). Only two ofthe studies examined the issue of psychiatric
comorbidity, one in terms of additional psychiatric conditions (Moffitt 8c Silva,
1988), the second from the standpoint of other cognitive (i.e. learning disabled)
disorders (McGee, Williams &: Silva, 1987), and, furthermore, none has addressed
both psychiatric and cognitive comorbidity simultaneously. Because commonly
observed comorbid conditions such as language-based learning disabilities are
also presumed to have a distinct neurocognitive basis, research must demonstrate
that the cognitive effects associated with ADHD are not simply an artifact ofthe
other neurological condition. This need is underscored by recent research
indicating that learning disabled children receive lower organization scores on
the ROCF (Klicpera, 1983; Waber 8c Bernstein, 1994).
The present study was designed to address some ofthe limitations associated
with previous research on ROCF production in children with ADHD. First, the
sample of ADHD children is relatively large (A^=65). Second, family history,
comorbid psychiatric conditions and comorbid learning disabilities were taken
into consideration. Third, the Waber-Holmes developmental scoring system was
used so that accuracy, organization, and style variables could be analyzed for
both copy and recall conditions. Fourth, age and Full Scale IQ were controlled
for; age is bound to have a large impact on cognitive test performance and IQ
discrepancies are often found between ADHD and control children (Barkley,
1990; Faraone et al., 1993b). Finally, a larger range of ages was studied so we
could assess developmental trends within and between groups. The importance
of examining developmental trends in ROCF performance, one ofthe guiding
principles ofthe Waber and Holmes system, has been highlighted in recent research
where differences between groups vary as a function of age in studies of ADHD
(Grodzinsky 8c Diamond, 1992), LD (Waber 8c Bernstein, 1994), and normal
children (Waber, Bernstein 8c Merola, 1989).
Twoapriori hypotheses were tested in this pilot phase of ROCF data collection.
First, it was predicted that children with ADHD would perform less well than
control children on ROCF variables pertaining to organization and planning of
production, presumably because ADHD is a neurocognitive disorder that disrupts
these functions. Second, we expected that the observed differences between ADHD
Rey-Osterrieth Complex Figure in ADHD 1463
Method
Detailed study methodology is reported elsewhere (Biederman et al., 1992). Briefly, subjects
were 65 individuals with ADHD and 45 normal controls from a larger study examining the intellectual
and academic performance of ADHD children and their siblings. The original study included
140 referred probands with ADHD and 120 normal controls and their 822 first-degree biological
relatives (Faraone et al, 1993b). This subsample was a consecutive series of probands and normal
comparisons seen in the fourth year of a longitudinal study of ADHD. The subjects were ascertained
from two sources; one pediatric, one psychiatric. All probands were Caucasian, non Hispanic
males originally sampled between the ages of 6 and 17. Children who presented with major
sensorimotor handicaps (e.g. paralysis, deafness, blindness), psychosis, autism, or an estimated
IQ less than 80 were excluded. To minimize the potential confounds of severe poverty, subjects
from the lowest HoUingshead-Redlich socioeconomic class (Hollingshead, 1975) were also excluded.
Each ofthe ADHD probands met diagnostic criteria for current ADHD at the time ofthe clinical
referral (i.e. each had at least eight ADHD symptoms active at that time); at the time of recruitment
each had active symptoms of the disorder.
Psychiatric assessments of probands relied on the Kiddie SADS-E (epidemiologic version) (Orvaschel
& Puig-Antich, 1987). Diagnoses were based on independent interviews with the mothers and
direct interviews of probands, except for children younger than 12 years of age, who were not
directly interviewed. The assessment personnel were unaware of proband diagnosis and
ascertainment site (Faraone ^^a/., 1993b). We used the same methods for interviewing and making
diagnoses as in previous studies, which achieved high reliability (Biederman et al., 1990). The
definition of a group of subjects with ADHD-I-psychiatric comorbidity was operationally defined
by presence of either anxiety, depressive or conduct disorders. Subjects with at least one first-
degree relative diagnosed with ADHD were considered to have familial ADHD.
The interviewers assessed academic achievement with the Arithmetic Subtest ofthe Wide Range
Achievement Test—Revised (WRAT-R; Jastak &: Jastak, 1985) and the Gilmore Oral Reading test
(Gilmore & Gilmore, 1968). They assessed intellectual functioning with the Vocabulary, Block
Design, Arithmetic, Digit Span, and Coding subtests of the Wechsler Intelligence Scales for
Children-Revised (WISC-R) (Wechsler, 1974). Using the methods of Sattler (1988), Full Scale IQ
was estimated from the Vocabulary and Block Design subtests.
Reynolds (1984) provides a thorough review of measurement issues involved in the definition
of learning disabilities. A procedure recommended by him and others (Frick et al, 1991) was
selected for use in this study. First, Full Scale IQ and achievement scores are converted to the
Z-scores ZIQ and ZA. Expected achievement score, ZEA, is then estimated by the regression equation:
ZEA=''IQA X ZiQ
where riQA is the correlation between the IQ and achievement tests. Values from the control
sample were utilized; these were .53 and -.07 for arithmetic and reading, respectively. Then, h the
discrepancy score is ZEA-ZA and its standard deviation is (1 -^^IQA) ^'^- We defined as learning disabled
any subject who had a value greater than 1.65 on the standardized discrepancy score:
The ROCF was administered individually to subjects by the interviewers described above according
to the methods described by Waber and Holmes (1985; 1986). The figure was reproduced such
that the base rectangle measured 8.0 cm X 5.5 cm. The figure was photocopied and centered onto
a white piece of paper measuring 8.5" X 11". Subjects were first asked to copy the figure onto
another 8.5" X 11" piece of white paper placed horizontally. They were encouraged to copy the
figure as neatly and accurately as possible. The subjects were given a sequence of colored pencils
1464 L. J. Seidman et al.
with which to draw the figure so that their approach to construction could be more easily discerned
for scoring purposes. Pencils were changed every 45 seconds for children under 9 years of age,
every 30 seconds for children older than 9, and every 20 seconds for subjects older than 16.
Interviewers also kept a record of the order in which lines were drawn, again as an aid to later
scoring efforts. A separate scoring sheet was designed for this purpose and was kept out of sight
during the administration.
After copying the ROCF the interviewers administered the WISC-R Vocabulary and Digit Span
tests. Following a 20-25 min delay the subjects were instructed to draw the ROCF again on a
similar piece of paper, without use ofthe original or previously constructed figure. Subjects were
given only one colored pencil to complete this task. As in the copy condition, the examiner kept
a record ofthe order in which lines were drawn.
Scoring ofthe ROCF was done by two Ph.D level clinical psychologists who were unaware of
all characteristics ofthe subjects including diagnosis. They used the Waber-Holmes scoring system
(Waber 8c Holmes, 1985; 1986). They were trained and supervised in this method by one of this
system's originators Qane Holmes Bernstein, Ph.D), scoring all copy and recall productions in
terms of Accuracy, Organization, and Style of production. Accuracy scores range anywhere from
1 to 65; organization scores (copy, recall) range from 1 to 13. Style categories are coded 1 (part-
oriented) to 4 (configurational) in the copy condition, and from part 1 (part-oriented) to 3
(configurational) in the recall condition. Interrater reliability was determined by having JHB
score 20 proband and control protocols on the same variables. A high level of agreement was
achieved for all six variables ranging from 94 to 100% agreement.
Accuracy and Organization data were analyzed using multiple linear regression techniques.
Style was converted into a dichotomous variable for ease of interpretation; Copy Style categories
of less than four were coded as nonconfigurational while Copy Style categories of four were considered
to be configurational. Recall Style ratings of less than three were grouped together as
nonconfigurational while Recall Style ratings of 3 were coded as configurational. Data were analyzed
using multiple logistic regression. Each regression model was assessed with a variety of diagnostic
techniques to determine whether its assumptions were met. All variables met the necessary
assumptions with the exception of Copy Accuracy which was subjected to a rank normal scores
transformation. Models included age, estimated IQ, family history of ADHD (having at least one
first-degree relative diagnosed with ADHD), presence of learning disability, and presence of psychiatric
comorbidity. This latter grouping was a comparison of those ADHD subjects with (A'^=36) and
without (A''=29) anxiety, depressive or conduct disorders. Because the sample size was relatively
small, we chose not to stratify the sample by specific comorbidities. Demographic variables were
analyzed by Student's f-test.
Results
Demographic variables
ADHD probands did not differ significantly from control subjects in terms of
mean age (14.2 vs. 14.0), grade (8.2 vs. 8.6), or socioeconomic status. The groups
did differ significantly with regard to estimated Full Scale IQ (/7<.OOO5); the
ADHD probands had a mean Full Scale IQ of 110.6 and the control subjects
had a mean Full Scale IQ of 119.4. The ADHD probands had a lower verbal IQ
as estimated by the vocabulary subtest (107.0 ± 14.8 vs. 115.5 ± 11.8,/? = .002)
and a lower performance IQ as estimated by the block design subtest (112.4 ±
16.3 vs. 122.0 ± 13.7,/7=.OO2). Eighteen subjects with ADHD also had a learning
disability (14 had arithmetic disability and nine had reading disability). Three
controls had a learning disability (two with arithmetic and one with reading)
disability. The rates of learning disability were significantly different between
Rey-Osterrieth Complex Figure in ADHD 1465
ADHD and controls (28% vs. 7%,p=.OO6). Demographic data for the subjects
is presented in Table 1.
ROCF variables
ADHD vs. normal controls. The children with ADHD obtained significantly lower
Copy Organization scores than the control children (see Table 2). ADHD status
remained highly significant {p < .004) in predicting Copy Organization scores even
when controlling for the significant effects of age {p < .0001), estimated IQ {p < .04),
and Copy Accuracy (p < .0002). There was no difference between groups on Copy
Accuracy once the significant effects of age {p < .001) and IQ {p < .03) were taken
into account. There was no difference between groups on Copy Style when
controlling for age and IQ, neither of which contributed significantly to prediction
(see Table 2). OFthe three recall variables, ADHD and control subjects differed
significantly only in terms o£ Recall Style. ADHD status significantly predicted
{p < .01) Recall Style scores even when controlling for the nonsignificant effect
of IQ and the significant effect of age (p < .02). Thus 72% ofthe control children
recalled the figure in a configurational manner while only 50% ofthe children
with ADHD did so.
ADHD and learning disabilities. ADHD children with comorbid learning disability
(LD) obtained significantly lower (p < .03) Copy Organization scores than ADHD
children without identified LD and both performed significantly more poorly
than controls. Age and IQ did not contribute significantly to prediction of Copy
Organization scores when in the same model as LD status. LD status did not aid
in the prediction of Copy Style, Recall Organization or Recall Style scores.
ADHD, psychiatric comorbidity and family history. Psychiatric comorbidity did not
contribute significantly to the prediction of either Organization or Style scores in
either Copy or Recall conditions, although there was a trend {p < .06) for lower
Recall Organization scores in ADHD probands with psychiatric comorbidity versus
1466 L. J. Seidman et al.
those without psychiatric comorbidity. Family history ofADHD was not significantly
related to any ROCF variable.
Age played an important role in the prediction of scores. Age contributed
significantly to the prediction of all variables (it was positively correlated with
performance) except Copy Style, even when controlling for ADHD status and IQ.
However, in no case was there a significant interaction between age and ADHD
status.
Table 2. Rey-Osterrieth complex figure test performance in ADHD probands and controls
Effects of medication. Forty six (71%) ofthe 65 ADHD subjects were receiving
medications (some more than one) whereas none (0%) of the controls were
medicated. Thirty one (48%) were taking stimulants (methylphenidate, A/^=26;
dextroamphetamine, N=2>', pemoline, N=2), 22 (34%) were taking tricyclic
antidepressants (desipramine, N=17; nortryptiline, N=S; imipramine, N=2)
Rey-Osterrieth Complex Figure in ADHD 1467
Table 3 shows ROCF results comparing the 46 children with ADHD on one
or more medication with the 19 on no medication. Analyses indicated that ADHD
subjects with and without any medication were significantly impaired on Copy
Organization compared to controls. Those who were taking medication were also
significantly impaired on Recall Accuracy and Recall Style. Inspection ofthe means
of all ROCF variables suggests a similar pattern of performance in unmedicated
and medicated ADHD subjects.
Discussion
system with ADHD children (Barr et al., 1990; Grodzinsky & Diamond, 1992).
When copying the ROCF, the ADHD children were less accurate in their
renderings, leaving out a significantly larger number of specific features than
did the control children. However, the difference between the groups on the
accuracy measure was no longer significant after controlling for the effects of
age and IQ. Furthermore, the large majority of children with ADHD included
nearly every scorable component of the ROCF, and in most instances when
omissions occurred, only a small fraction of total scorable units were excluded.
Style of copy reproduction also did not distinguish the two groups. Less than
half of the children in each group used a configurational style (i.e. reproducing
larger perceptual units such as an entire diagonal line) when copying the figure,
while the majority in each group reproduced the figure by drawing smaller
units, one step at a time.
ADHD children were significantly impaired on the organization of copy,
which assesses the extent to which various elements of the reproductions were
organized in relation to one another. Their lower level of functioning on this
m'^asure was not a function of differences in age, IQ, or the number of ROCF
elements included in the reproduction.
When asked to reproduce the ROCF from memory, children with ADHD and
control subjects did not differ significantly in the number of elements remembered
or in the extent to which the elements were organized in relation to one another.
However, a significantly larger percentage of control subjects recalled the figure
using a configurational style. Thus, in the recall condition the ADHD children's
organization of the figure improved in relation to the control children but a
significantly smaller proportion of them made the shift to a configurational style
of reproduction.
These results have a number of potential implications regarding the
neuropsychological functioning of children with ADHD. First, the relative
weakness in organization observed in the copy condition—together with
comparable performance in terms of accuracy and style of production—confirms
previous research findings (Barr ^^a/., 1990; Grodzinsky 8c Diamond, 1992) and
generally supports the notion that children with ADHD suffer from cognitive
difficulties that are both specific and identifiable. Second, the lack of difference
in accuracy scores in both conditions, and the comparable organization scores
in the recall condition, suggest that other cognitive functions such as visual-
motor integration and visual memory are relatively intact in this ADHD sample.
Third, the relative improvement observed for children with ADHD in organization
following a 20 min interval suggests that their initially low organization scores
may have been in part a function of impulsivity and lack of planning.
A related and fourth implication stems from the significant difference in the
percentage of children using a configurational style at recall. This finding
suggests that the difference between groups may extend beyond one of impulse
control and planning. A configurational approach to recall implies that a subject
has perceived and then imposed a specific organization on output. This style is
associated with older children (and hence more mature cognitive functioning)
both in this sample and the one on which the scoring system was developed
Rey-Osterrieth Complex Figure in ADHD 1469
(Waber & Holmes, 1985; 1986). Although this variable is labeled "style" in the
Waber and Holmes system, it may also tap higher order organization skills,
particularly in the recall condition prior to which there has been a period of
time to consolidate information in memory. If this interpretation is correct,
significantly fewer children with ADHD imposed a higher level of organization
on recall production, even when accounting for the significant effects of age
and IQ.
Consideration of comorbidity status revealed that the ADHD children with
LD achieved significantly lower organization scores in the copy condition than
the ADHD children without LD. In contrast, no differences were found between
the groups with and without LD on any ofthe other ROCF variables. The relatively
lower organization scores associated with LD is consistent with prior research
using the ROCF (Klicpera, 1983; Waber 8c Bernstein, 1994), and underscores
the necessity to account for this source of variance in future research. The children
with ADHD who did not have LD performed significantly worse as a group than
the control children, indicating that LD does not completely account for the
difference in organization scores found between ADHD subjects and control
subjects. However, learning disabilities did appear to have an additional
compromising effect on the organization score ofthe ROCF.
In order to determine the neurocognitive basis for the effect of LD on ADHD
it will be necessary to have more refined definitions of LD based on more
comprehensive LD assessment. In a larger sample, it would also be useful to
determine if the ROCF correlates of LD were dependent on the method of defining
LD. We were limited by the heterogeneous composition of the LD group
employed in this study as well as by the broader lack of consensus regarding the
most reliable and valid definition of learning disability. Future research might
contrast ADHD children with language-based LD with ADHD children with
nonverbal LD to determine if they perform differently on the ROCF (Semrud-
Clikeman 8c Hynd, 1990; Weintraub 8c Mesulam, 1983). Making these distinctions
will aid in further clarifying the cognitive effects associated with LD and ADHD.
Although preliminary, the data indicate that ADHD children with comorbid
psychiatric conditions did not differ significantly from ADHD children without
comorbidity on any of the ROCF variables. This outcome suggests that the
impairment indexed by the ROCF may be a correlate of ADHD and not of its
commonly associated comorbid conditions. However, a trend towards lower
organization scores on recall was found for the ADHD children with psychiatric
comorbidity, thus suggesting that a significant difference might emerge in studies
with greater statistical power. Moreover, our sample size was too small to consider
the specific effects of anxiety, depression or conduct disorders.
Another limitation of our design is that approximately 71% of the ADHD
children were medicated at the time of assessment compared to none of the
controls. The effects of medication in this sample are unclear because probands
were not only receiving stimulants to treat ADHD symptoms (which tend to
improve some aspects of attentional functioning, (Barkley, 1990) but they were
also receiving other medications whose neuropsychological effects may be less
positive. However, analyses indicated that subjects with ADHD with and without
1470 L. J. Seidman et al.
References
Barkley, R. A. (1990). Attention Deficit Hyperactivity Disorder: a handbook for diagnosis and treatment.
New York: The Guilford Press.
Barkley, R. A., Grodzinsky, G. & DuPaul, G. J. (1992). Frontal lobe functions in attention deficit
disorder with and without hyperactivity: A review and research report. Journal of Abnormal
Child Psychology, 20, 163-188.
Barr, R. G., Douglas, V. I. 8c Sananes, R. (1990). Copying the Rey-Osterrieth Complex Figure:
ADHD-Normal Differences and Stimulant Effects. McGill University and Montreal Children's
Hospital: Departments of Pediatrics and Psychology.
Rey-Osterrieth Complex Figure in ADHD 1471
McGee, R., Williams, S., Moffitt, T. & Anderson, J. (1989). A comparison of 13-year-old boys with
attention deficit and/or reading disorder on neuropsychological measures. Journal of Abnormal
Child Psychology, 17, 37-53.
McGee, R., Williams, S. 8c Silva, P. A. (1987). A comparison of girls and boys with teacher-identified
problems of attention. Journal of the American Academy of Child and Adolescent Psychiatry, 26
711-717.
Moffitt, T. E. &: Silva, P. A. (1988). Self-reported delinquency, neuropsychological deficit, and
history of attention deficit disorder. Journal of Abnormal Child Psychology, 16, 553-569.
Morrison, J. R. 8c Stewart, M. A. (1971). A family study ofthe hyperactive child syndrome. Biological
Psychiatry, 3, 189-195.
Orvaschel, H. & Puig-Antich, J. (1987). Schedule for Affective Disorders and Schizophrenia for
School-Age Children—Epidemiologic Version. Ft. Lauderdale, FL: Nova University.
Osterrieth, P. A. (1944). Le test de copie d'une figure complexe. Archives de Psychologie,
30, 206-256.
Rey, A. (1941). L'Examen psychologique dans les cas d'encephalopathie traumatique. Les Archives
de Psychologie, 28, 286-340.
Reynolds, C. R. (1984). Critical measurement issues in learning disabilities./owrTia/ of Special Education,
18,451-476.
Sattler, J. M. (1988). Assessment of children's intelligence. San Diego: Jerome M. Sattler.
Schachar, R. & Wachsmuth, R. (1990). Hyperactivity and parental psychopathology./owma/ of
Child Psychology and Psychiatry, 31, 381-392.
Seidman, L. J., Biederman, J., Faraone, S. V., Milberger, S., Norman, D., Seiverd, K., Benedict,
K., Guite, J., Mick, E. 8c Kiely, K. (1995). Effects of family history and comorbidity on the
neuropsychological performance of ADHD children: preliminary findings. Journal of the
American Academy of Child and Adolescent Psychiatry, 34, 1015-1024.
Semrud-Clikeman, M. 8c Hynd, G. W. (1990). Right hemispheric dysfunction in nonverbal
learning disabilities: social, academic, and adaptive functioning in adults and children.
Psychological Bulletin, 107, 1-14.
Semrud-Clikeman, M. S., Biederman, J., Sprich, S., Krifcher, B., Norman, D. 8c Faraone, S. (1992).
Comorbidity between ADHD and learning disability: a review and report in a clinically
referred sara^le. Journal of the American Academy of Child and Adolescent Psychiatry, 31,439-44
Shorr, J., Delis, D. & Massman, P. (1992). Memory for the Rey-Osterrieth figure: Perceptual
clustering, encoding, and storage. Neuropsychology, 6, 43-50.
Shue, K. L. 8c Douglas, V. I. (1992). Attention deficit hyperactivity disorder and the frontal lobe
syndrome. Brain and Cognition, 20, 104-124.
Stewart, M. A, deBlois, C. S. & Cummings, C. (1980). Psychiatric disorder in the parents of hyperactive
boys and those with conduct disorder. Journal of Child Psychology and Psychiatry, 21, 283-292.
Waber, D. 8c Bernstein, J. H. (1994). Performance of learning disabled and non-learning disabled
children on the Rey-Osterrieth Complex Figure (ROCF): validation ofthe developmental
scoring system. Presented at the Twenty Second Annual Meeting ofthe International Neuropsycholog
Society in Cincinnati, OH.
Waber, D. & Holmes, J. M. (1985). Assessing children's copy productions ofthe Rey-Osterrieth
Complex Yigure. Journal of Clinical and Experimental Neuropsychology, 7, 264-280.
Waber, D. 8c Holmes, J. M. (1986). Assessing children's memory production ofthe Rey-Osterrieth
Complex Figure. Journal of Clinical and Experimental Neuropsychology, 8, 563-580.
Waber, D. P., Bernstein, J. H. & Merola, J. (1989). Remembering the Rey-Osterrieth Complex
Figure: a dual-code, cognitive neuropsychological model. Developmental Neuropsychology,
5, 1-15.
Wechsler, D. (1974). Manual for the Wechsler Intelligence Scale for Children—Revised. New York
Psychological Corporation.
Wechsler, D. (1991). Manual for the Wechsler Intelligence Scale for Children—Third Edition.
New York: Psychological Corporation.
Weintraub, S. & Mesulam, M. M. (1983). Developmental learning disabilities of the right
hemisphere. Archives of Neurology, 40, 463-468.
Rey-Osterrieth Complex Figure in ADHD 1473
Welner, Z., Welner, A., Stewart, M., Palkes, H. & Wish, E. (1977). A controlled study of siblings
of hyperactive children./owma/ of Nervous and Mental Disorders, 165, 110-117.
Zametkin, A. J., Nordahl, T. E., Gross, M., King, C , Semple, W. E., Rumsey, J., Hamburger, S.
&: Cohen, R. M. (1990). Cerebral glucose metabolism in adults with hyperactivity of childhood
onset. New England Journal of Medicine, 323, 1361-1366.