Professional Documents
Culture Documents
Organizational Quality On The Rey-Osterrieth and Taylor Complex Figure Tests A New Scoring System1
Organizational Quality On The Rey-Osterrieth and Taylor Complex Figure Tests A New Scoring System1
net/publication/269806036
CITATIONS READS
47 1,021
3 authors, including:
Sherry Hamby
University of the South
294 PUBLICATIONS 22,570 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Sherry Hamby on 02 September 2016.
A new system for measuring organizational quality on the Complex Figure Test (Rey, 1942; Taylor,
1969) is described. This system extends the traditional use of the test as a measure of constructional
ability and figural memory. The new system is easy to learn, quick to score, and shows very good
interrater reliability. Organizational quality was found to correlate moderately with copy accuracy,
half-hour recall, and percentage retained. In an initial application of the system (N= 63), organiza-
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
tional quality of the Rey-Osterrieth Complex Figure successfully discriminated between symptom-
This document is copyrighted by the American Psychological Association or one of its allied publishers.
atic (those with acquired immunodeficiency syndrome [AIDS] or AIDS-related complex [ARC])
and asymptomatic subjects positive for human immunodeficiency virus (HIV), but organizational
quality ratings of the Taylor figure did not. The results suggest that the Taylor figure is easier to
organize than the Rey-Osterrieth. Thus, the Taylor figure may not be an appropriate alternative to
the Rey-Osterrieth for the assessment of organizational quality.
The Complex Figure Test, originally developed by Rey has demonstrated the clinical utility of such a scoring system.
(1942), is widely used by clinical neuropsychologists. Copy and Copy planfulness has been shown to differentiate brain-dam-
memory trials are often used to assess constructional skills and aged subjects from normals (Binder, 1982) and dyslexic from
figural memory, respectively. Two versions of the Complex Fig- nondyslexic children (Klicpera, 1983). Copy planfulness also
ure are available. The original figure is the Rey-Osterrieth. Os- predicts delayed recall scores (Bennett-Levy, 1984) and im-
terrieth (1944) developed a 36-point system for scoring repro- proves with age in children (Waber & Holmes, 1985).
duction accuracy on this figure that has been in wide use (for a All of the methods developed to date have demonstrated util-
review, see Lezak, 1983) since its translation into English by ity; nonetheless, each has difficulties for use as either a clinical
E. M. Taylor (1959). The second, the Taylor figure, was devel- or research tool. One problem shared by all four methods is the
oped more recently by L. B. Taylor and his associates (Taylor, difficulty of administration: Each approach requires the exam-
1969,1979). Lezak (1983) has recommended its use as an alter- iner to record the order of every line segment as it is drawn by
native to the Rey-Osterrieth when the Complex Figure Test will the subject. This is typically done by copying the figure that the
be administered more than once. subject draws and numbering each line segment as the subject
More recent articles have explored the Complex Figure's use- proceeds.
fulness as a measure of planning and organizational ability by The systems of Bennett-Levy, Waber and Holmes, and Klic-
examining the subject's copy strategy (Bennett-Levy, 1984; pera share an additional difficulty. These systems are quite
Binder, 1982; Klicpera, 1983; Waber& Holmes, 1985). Bennett- complex and require close inspection of every line segment in
Levy (1984) and Klicpera (1983) have also examined the rela- the reproduction. Consequently, it appears difficult to obtain
tionship between copy strategy and recall score, noting that a reliable and replicable scores for any of these systems. Waber
poor recall score may be the result of either a poorly planned, and Holmes (1985) reported good interrater reliability on many
piecemeal copy or "pure" forgetting of an organized copy. In of their measures but achieved only 52% agreement for their
clinical use, copy strategy is often recorded informally by organization score (between a coder and a computer scoring
switching pen colors as the patient completes the drawing (Le- system). Bennett-Levy (1984) also reported good interrater reli-
zak, 1983). ability data for accuracy scoring but did not report interrater
Four formal scoring systems have been developed to quantify reliabilities for his two new strategy measures, symmetry and
the subject's degree of planfulness and organization. Each study good continuation. Klicpera (1983) did not report interrater
reliabilities. The possibility of obtaining accurate and mean-
ingful data with these methods, especially by other researchers
Sherry L. Hamby, Jean W Wilkins, and Neil S. Barry, AIDS Neuro- and clinicians, is unclear.
logic Center and Departments of Neurology, Psychology, and Psychia- Binder's method (1982) does not show problems with in-
try, University of North Carolina at Chapel Hill.
terrater reliability. However, his system does not make use of
This research was supported by National Institutes of Health/
NINDS Grant 2 PO1 NS 26680-04A1 to the University of North Caro- much of the information available in the figure, and most ele-
lina AIDS Neurologic Center. ments are not evaluated in his rating system. For research pur-
Correspondence concerning this article should be addressed to poses, Binder's system presents additional problems because
Sherry L. Hamby, Department of Neurology, University of North Car- his scaling method is not adequate for use with traditional infer-
olina at Chapel Hill, CB # 7025, Clinical Sciences Building, Chapel, ential statistics (Binder, 1982); for example, his scale exhibited
Hill, North Carolina 27599-7025. floor effects and heterogeneity of variance across groups.
27
28 S. HAMBY, J. WILKINS, AND N. BARRY
for both copy and delay trials (Bennett-Levy, 1984; Klicpera, 1986, definitions). There were 59 men in the sample and 4 women.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
1983). Presumably, subjects who are able to organize the figure Their average age was 33.7 years (SD = 8.1), and they averaged 14.6
in a coherent way will be able to recall it more accurately later. years of education (SD = 2.6). Neither age nor education differed
across groups (p > .35 for both tests).
The present scoring system was designed to meet five goals:
(a) to obtain good interrater reliability; (b) to be easy to learn
and quick to use, so that it will be useful in a wide variety of Procedure
both clinical and research settings; (c) to be useful when only As part of a comprehensive neuropsychological evaluation, subjects
colored pens are used to record the subject's strategy rather were administered copy and 30-minute delayed recall trials of either
than a full record of every line segment; (d) to establish con- the Rey-Osterrieth or Taylor Complex Figures (randomly assigned).
struct validity by demonstrating correlations between organiza- The copy trials were completed using three pens of different colors to
tional quality and other scores typically obtained for the Com- record subjects' approaches to the task. There was no time limit for
plex Figure. Specifically, organizational quality should posi- either trial. The copy and delay protocols were subsequently scored for
accuracy using Taylor's adaptation of Osterrieth's 18-element system
tively correlate with reproduction accuracy on both copy and (Duley et al., in press; Taylor, 1959), and the copy trials were further
delay trials, and with the percentage of the figure that is re- scored for organizational quality.
tained from copy to delay trial (percentage retained = delay/ Demographic information and neurologic and school histories were
copy); and (e) to be applicable to both the Rey-Osterrieth and obtained through a structured interview developed at the AIDS Neuro-
Taylor figures. In addition to the above goals relating to the logic Center. Psychiatric and substance abuse histories were obtained
development of the organizational quality scoring system, an using the Diagnostic Interview Schedule (Robins, Helzer, & Croughan,
initial application of the system is presented here. It is hoped 1985). In addition, each subject completed the Profile of Mood States
that organizational quality will be useful in evaluating different (McNair, Lorr, & Droppleman, 1981) on the day of neuropsychological
patient populations. We examine whether or not organizational
quality can discriminate between asymptomatic and symptom-
atic HIV-positive patients and hypothesize that symptomatic
subjects will receive lower organizational quality scores than
asymptomatic subjects.
The organizational quality system described here is based on
the common division of both figures into 18 scoring elements
(Lezak, 1983). See Appendixes A and B for a full listing of the
standard scoring elements for the Rey-Osterrieth and Taylor
figures, respectively. The new system focuses on three attributes
that seem central to an evaluation of the patient's approach to
the drawing task: the order in which configural elements are
placed in the figure, the appropriate continuation of lines, and
the order of detail elements. In this scoring system, primary
emphasis is given to "configural elements": the base rectangle
or square and the horizontal and vertical midlines. These items
were chosen because the placement of virtually all other items
is contingent on the position of these elements. Illustrations of
the complex figures with configural elements highlighted can
be found in Figures 1 and 2. Ratings are made on a 5-point Figure 1. The Rey-Osterrieth figure with configural elements high-
Likert scale that is appropriate for inferential statistical analy- lighted. (From "UExamen Psychologique Dans Les Cas D'Encephalo-
sis; higher scores indicate better organization. The organiza- pathie Traumatique" by A. Rey, 1942, Archives de Psychologic, 28, p.
tional quality scoring system for the two figures can be found in 329. Copyright 1942 by the Archives de Psychologic. Reprinted by
Appendix C. permission [highlights added]).
ORGANIZATIONAL QUALITY ON COMPLEX FIGURE 29
Construct Validity
Organizational quality was significantly correlated with
three other measures of performance: accuracy of the copy re-
production, accuracy of the delay reproduction, and percentage
retained (delay/copy). For copy scores, r(61) = .32, p < .05, and
for delayed recall, r(61) = .42, p < .001. Finally, for percentage
retained, r(61) = .30, p < .05 (to control for the nonnormality of
percentile data, an arcsine transformation was performed prior
to analysis, Winer, 1971). Tests of the differences between the
Rey-Osterrieth and Taylor figures indicated that the magnitude
of the correlations is the same for both figures (p > .05 for all
three tests).
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
not its organizational qualities. A consideration of organiza- fections. Morbidity & Mortality Weekly Report, 35, 334-339.
tional quality could be used to develop a new figure with a Duley, J. F, Wilkins, J. W, Hamby, S. L., Hopkins, D. G., Burwell, R. D,
structure as complex as that of the Rey-Osterrieth. & Barry, N. S. (in press). Explicit scoring criteria for the Rey-Os-
Organizational quality holds promise as a useful measure of a terrieth and Taylor complex figures. Clinical Neuropsychologist.
subject's ability to organize unstructured figural material. Our Klicpera, C. (1983). Poor planning as a characteristic of problem-solv-
scoring system fulfills our initial objectives. The simplicity of ing behavior in dyslexic children. Acta Paedopsychiatra, 49, 73-82.
the scoring method and the reliability of the measure over- Lezak, M. D. (1983). Neuropsychological assessment (2nd ed.). New
York: Oxford University Press.
comes the major limitations of previous scoring systems. The
McNair, D. M., Lorr, M., & Droppleman, L. F. (1981). Profile of Mood
use of organizational quality as a measure of planning ability
States manual. San Diego, CA: Educational and Industrial Testing
will provide a useful complement to the traditional assessment
Service.
of constructional skill and figural memory on the Complex
Milner, B., & Teuber, H. L. (1968). Alteration of perception and mem-
Figure. Because the Complex Figure is frequently administered ory in man: Reflections on methods. In L. Weiskrantz (Ed.), Analy-
during neuropsychological assessment, organizational quality sis of behavioral change (pp. 268-375). New York: Harper & Row.
provides an especially efficient means of measuring planning Robins, L. N., Helzer, J. E., & Croughan, J. (1985). NIMH Diagnostic
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
ability that should be useful in a wide variety of clinical and Interview Schedule, Version lll-A. Rockville, MD: National Institute
This document is copyrighted by the American Psychological Association or one of its allied publishers.
Appendix A Appendix B
12. Five parallel lines with 2 crossing 3, lower right 12. Semicircle to right of large square
This document is copyrighted by the American Psychological Association or one of its allied publishers.
13. Sides of triangle attached to 2 on right 13. Triangle with enclosed line in right half of large square
14. Diamond attached to 13 14. Row of 7 dots in lower right quadrant
15. Vertical line within triangle 13 parallel to right vertical of 2 15. Horizontal line between 6th and 7th dot
16. Horizontal line within 13, continuing 4 to right 16. Triangle at bottom right corner of lower right quadrant
17. Cross attached to low center 17. Curved line with 3 cross-bars in lower left quadrant
18. Square attached to 2, lower left 18. Star in lower left quadrant
Note. From Psychological Appraisal ofChildrenwithCerebral Defects (p. Note- From Neuropsychological Assessment (2nd ed., p. 397) by M.
399) by E. Taylor, 1959, Cambridge, MA: Harvard University Press. Lezak, 1983, New York: Oxford University Press. Copyright 1983 by
Copyright 1959 by Harvard University Press. Reprinted by permission. Laughlin Taylor. Reprinted by permission.
Appendix C
Complex Figure Organizational Quality Scoring for the Rey-Osterrieth and Taylor Complex Figures
(a) one side of rectangle/square not drawn when others are com- (a) Unnecessary segmentation. The patient should not use more
pleted. lines than necessary to complete the element.
(b) either of the following drawn in two or more segments consti- (b) Lines in a standard element, and elements that are near each
tutes 1 mistake (maximum = 6 mistakes): four sides of rectangle/ other, should be drawn consecutively.
square or two midlines (i.e., it should only take six lines to com- (c) Poor planning that results in the need to redraw an element. For
plete all of the elements above). instance, if they must redraw a diagonal line so that it intersects
(c) any details completed before the configural elements are com- both corners.
pleted, except for the upper left cross (No. 1) of the Rey-Osterrieth. 2. The following is a partial list of common detail mistakes found in
(Because starting in the upper left-hand corner seems to be reproductions of the Rey-Osterrieth (identified by Taylor's num-
more related to standard Western writing practice than to poor bers):
organization, it is not penalized as heavily.) For example, draw- No. 1 Cross completed before configural elements.
ing the right triangle (No. 13) before completing the vertical No. 6 (a) 3 sides of box are not done together (with no break at midline)
midline would constitute a configural mistake. Count one mis- (b) X is not completed immediately after box is drawn
take for each conngural line drawn after the details have been (c) X is drawn as four slashes or two V's (rather than two inter-
drawn. For example, if the right triangle (No. 13) of the Rey-Os- secting lines).
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
terrieth is begun before both midlines are drawn, score as 2 No. 7 Not done immediately after No. 6.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
conngural mistakes. No. 9 (a) Both sides of triangle not completed together
(d) either midline drawn more than 10% away from the center (in (b) Vertical side drawn as part of midline and then slanted side
either direction). That is, the midlines should be in the central completed later.
40-60% of the rectangle/square. Nos. 9,13 The adjacent sides of these two triangles drawn as a single
(e) sides of the rectangle/square not joined at their endpoints, sug- line.
gesting that the subject does not perceive the rectangle/square. No. 13 Both sides of this triangle not completed together.
Small draftmanship errors should not count as a configural mis- Nos. 13,15,16 Not drawn together.
take. For example, if the right side is placed too far to the right, No. 17 Attachment for cross not completed with rest of cross (e.g., done
creating a 6-sided figure, that would count as one configural as part of midline and then finished later).
mistake. Each poorly placed line counts as 1 mistake. No. 18 (a) Slash in box not added when box is first drawn.
(f) a configural element is missing (score 1). (b) Box, or part of box, drawn as part of the basic configural
rectangle.
Secondary Mistakes 3. Common detail mistakes of the Taylor figure:
No. 2 Both sides of triangle not completed at once.
The diagonals (No. 3) of the Rey-Osterrieth and the upper horizon- No. 4 Horizontal midline does not need to extend to left arrow (No. 1)
tal line (No. 6) of the Taylor are considered to be secondary elements. when originally drawn, this segment can be added later.
1. Two errors in the reproduction of the secondary elements are consid- No. 7 Drawn as four slashes or two V's (rather than two intersecting
ered serious enough to be counted as a secondary mistake, which lines).
carries the same weight as configural mistakes. However, the over- Nos. 7-9 These three elements not drawn in consecutive order (i.e.,
all construction of these elements can count as a maximum of one first No. 7, then No. 8, and lastly No. 9).
mistake. The mistakes are the following: No. 11 Line with arrow through quadrant and extending above it
(a) the segments do not meet. For the Rey-Osterrieth, all 4 slashes should not bend at the corner of the square; it should be a straight
of the diagonal should meet. For the Taylor, the upper horizon- line.
tal line should extend continuously across the figure. Nos. 12 & 13 (a) Not completed together.
(b) a segment is incomplete (i.e., does not extend all the way across (b) Do not meet upper horizontal line.
figure). No. 15 Not completed immediately before or after No. 14.
2. When the elements are drawn as connecting segments, score as a No. 17 Line and crossbars not done together.
detail mistake. For the Rey-Osterrieth, score as a detail mistake if No. 18 Asterisk drawn as eight lines radiating from center (or from
the patient uses more than two lines to complete the diagonals. For central dot), rather than four continuous intersecting lines.
the Taylor, score as a detail mistake if the patient uses more than
one line to complete the upper horizontal line.
3. Secondary elements can be completed before midlines with no pen-
alty.
Detail Mistakes
Received July 9,1991
All other elements are considered to be details. Revision received May 28,1992
1. Detail mistakes can be made in three ways: Accepted June 1,1992