Professional Documents
Culture Documents
net/publication/13990923
CITATIONS READS
112 1,974
3 authors, including:
All content following this page was uploaded by Robert Koegel on 15 May 2015.
233
0162-3257/97J0600-0233$12.50/0 © 1997 Plenum Publishing Corporation
234 Koegel, Koegel, and Smith
METHOD
Participants
Six pre- and elementary school-aged children, five boys and one girl,
participated in this study. All were diagnosed by an outside agency as hav-
Test Interpretation for Children with Autism 23S
ing autism and referred to our clinic for treatment of autism. An initial
intake interview confirmed the diagnosis of autism according to DSM-IV
criteria (American Psychiatric Association, 1994), including (a) a qualitative
impairment in reciprocal social interaction as manifested by a preference
to be alone; (b) qualitative impairment in verbal and nonverbal communi-
cation (lack of eye contact, expression, gestures, and expressive language);
(c) a markedly restricted repertoire of activities, preferring to engage in
stereotypies, and or persistent preoccupation with specific objects or parts
of objects; and (d) a marked distress over changes in minor aspects of the
environment. Individual child characteristics are described below.
Child 1 was 9 years 6 months old, and was placed in a segregated
special education class for children with communicative disabilities. His be-
havior was marked by verbal stereotypic behavior and obsessions with spe-
cific cartoon characters. He was generally unresponsive and tended to stare
into space when others attempted to interact with him or place demands
on him. He was able to formulate syntactically correct sentences of at least
five words, although they were typically of a self-stimulatory nature and
rarely social or directed at others. Most communicative interactions tended
to be requests or protests.
Child 2 was 5 years 3 months old. He exhibited a number of stereo-
typies, such as spinning toys, rather than appropriate play. He used short
sentences to express his needs, but was not observed to use language for
social communication. He frequently turned away or said "no" upon at-
tempts to engage him in social interaction or presentation of an instruction.
He was permitted to attend a preschool for primarily nondisabled children
three mornings a week, only if an aide (hired by his parents) was with him.
Child 3 was 4 years 1 month old and was placed in a segregated special
education classroom for children with severe disabilities. He was able to
form sentences, but he most frequently exhibited delayed echolalia, and
verbal self-stimulatory behavior at which times he talked incessantly about
a particular topic, such as the military. Although he did interact occasion-
ally with adults, he was not observed to interact with his peers.
Child 4 was 5 years 9 months old and was placed in a segregated class-
room for children with severe disabilities. She exhibited numerous disrup-
tive behaviors including crying, tantruming, and screaming (typically "no"
or "I hate") when given an instruction. She also had a preoccupation with
certain objects, and avoided social contact. Language use consisted primar-
ily of short sentences to meet her needs.
Child 5 was 3 years 4 months old and attended a preschool primarily
for children without disabilities. He had not yet been assessed for public
school placement. He was able to create sentences of at least five words
and could read at approximately a first-grade level with some comprehen-
236 Koegel, Koegel, and Smith
sion. Socially, he responded fairly well to his mother and nanny, but was
not observed to interact with peers at his school or home. He also engaged
in lengthy periods of self-stimulatory behavior, such as lying down and sift-
ing sand through his hands, throughout the day.
Child 6 was 4 years 10 months old. He was nonverbal and frequently
engaged in tantrums and other disruptive behaviors (whining, crying, lying
on the floor, aggression, etc.), although he tended to cease tantruming and
respond appropriately when his mother was present. He had a preoccupa-
tion with small objects (typically cars, which he repeatedly lined up in rows)
and engaged in tantrums when one was taken away or when the order of
the cars was disrupted. The school district recommended that he be placed
in a classroom for children with severe disabilities, but was currently at-
tending a preschool primarily for children without disabilities.
Design
Reliability
averaged 98.6%, with a range of 94 to 100% across test sessions. These results
suggest a high degree of reliability in the data recording.
RESULTS
DISCUSSION
The results of this study suggest that the interpretation of test results
needs to take into consideration variables affecting groups of individuals
who may have different experiences and whose behaviors may influence
test performance. A child with autism, for example, may lack necessary
attention to the task, motivation to succeed, and/or present significant dis-
ruptive behaviors which would put him/her at a disadvantage in a stand-
Test Interpretation for Children with Autism 241
ardized testing situation. Functionally then, the test session becomes one
of assessing motivation, attention, or compliance more than of assessing
language or intelligence (L. K. Koegel & Koegel, 1995; Zigler et al., 1982).
The underlying assumption of standardized testing is that individuals
must attain and demonstrate certain competencies deemed essential for ef-
fective functioning as members of society (Williams, 1983). Such testing is
often used to assess gains in treatment programs, research studies, school
programs, individual interventions, and so forth. Testing these competencies
is also used in the identification and evaluation of children with disabilities
in order to plan, program, and appropriate services for their education
(Farb, Cottrell, Montague, & Throne, 1977; Fuchs, 1993; Throne & Farb;
1977; Turnbull, 1993). If standardized testing presents a problem for an
individual child, the type of gains the child makes during intervention may
be misinterpreted. As suggested in this study, standardized testing may be
measuring the child's test-taking disability rather than intellectual or verbal
ability. In contrast, defining and eliminating variables that may interfere
with verbal and intellectual performance provide researchers, school per-
sonnel, and specialists with different but possibly more beneficial target
goals for individualized intervention plans. This is consistent with other lit-
erature demonstrating that these variables can affect performance in other
populations as well, including underachievers (Carr, Borkowski, & Maxwell,
1991) and those labeled as having learning disabilities (Ryan, Short, &
Weed, 1986; Torgesen & Licht, 1983).
One reason that could account for the differences in the two conditions
implemented in this experiment relates to the fact that a standardized test,
by nature of the task itself, does not provide contingent consequences for
correct performance on test items. This could easily set up a situation that
would result in low motivation in students with autism, who appear to be
especially sensitive to such conditions. That is, when responses and conse-
quences are not associated, individuals, such as children with autism, may
exhibit particularly poor performance (L. K. Koegel, Valdez-Menchaca, &
Koegel, 1993; R. L. Koegel & Mentis, 1985; Seligman, Klein, & Miller,
1976). This phenomenon may occur when the children exhibit inappropriate
behaviors as an attempt to avoid or escape the test situation (Carr &
Durand, 1985; Horner, Dunlap, & Koegel, 1988). While the motivation/at-
tention condition also did not offer contingent consequences for correct
responses to test items, it did allow for powerful idiosyncratic reinforcement
tailored to the child's needs, for appropriate on-task responding to test
items. This may have overshadowed the lack of a contingency for correct
responding to test stimuli.
In summary, this experiment illustrates numerous important motiva-
tional and attentional variables that may be problematic during the stand-
242 Koegel, Koegel, and Smith
ardized testing of children with autism, and further emphasizes the neces-
sary caution that may be employed pertaining to the utilization and inter-
pretation of standardized tests. The results of the present study describe
important circumstances correlated with variability in test results for chil-
dren with autism. Factors, such as inadequate attention, lack of motivation
to respond to the test items, or attempts to avoid and escape a demanding
test situation, should be taken into consideration when interpreting test
scores, evaluating intervention program outcomes, and planning educa-
tional experiences and intervention programs for children with autism. The
wide variability in the test scores in the two conditions in the present study
emphasizes the importance of incorporating multiple measures in order to
systematically and accurately evaluate the specific variables associated with
positive outcomes of intervention programs.
REFERENCES
American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders
(4th ed). Washington, DC: Author.
Berliner, D. C. (1988). Meta-comments: A discussion of critiques of L. M. Dunn's monograph
"Bilingual Hispanic children on the U.S. mainland." Special Issue: Achievement testing:
Science vs. ideology. Hispanic Journal of Behavioral Sciences, 10, 273-299.
California Association of School Psychologists. (1987). Documentation and recommendations.
Millbrae, CA: Author.
Carr, M., Borkowski, J. G., & Maxwell, S. E. (1991). Motivational components of under-
achievement. Developmental Psychology, 27, 108-118.
Carr, E. G., & Durand, V M. (1985). Reducing behavior problems through functional com-
munication training. Journal of Applied Behavior Analysis, 18, 111-126.
Dunn, L. M., & Dunn, L. M. (1981). Peabody Pictures Vocabulary Test-Revised. Circle Pines,
MN: American Guidance Service.
Farb, J., Cottrell, A. W, Montague, J. C, & Throne, J. M. (1977). Update on research into
increasing intelligence levels of the mentally retarded. In P. Mittler (Ed.), Research to
practice in mental retardation: Proceedings of the Fourth International Congress of the In-
ternational Association for the Scientific Study of Mental Deficiency (Vol. 2, pp. 129-136).
Foster, R., Giddan, J. J., & Stark, J. (1973). Assessment of Children's Language Comprehension.
Palo Alto, CA: Consulting Psychologists Press.
Fuchs, L. S. (1993). Enhancing instructional programming and student achievement with cur-
riculum based measurement. In J. Kramer (Ed.), Curriculum based assessment: Examining
old problems, evaluating new solutions. Hillsdale, NJ: Erlbaum.
Good, R. H., & Salvia, J. (1988). Curriculum bias in published, norm-referenced reading tests:
Demonstrable effects. School Psychology Review, 17, 51-60.
Homer, R. H., Dunlap, G., & Koegel, R. L. (Eds.). (1988). Generalization and maintenance:
Life-style changes in applied settings. Baltimore: Paul H. Brookes Publishing Co.
Koegel, L. K., & Koegel, R. L. (1995). Motivating communication in children with autism.
In E. Schopler & G. B. Mesibov (Eds.), Learning and Cognition in Autism. New York,
NY: Plenum Press.
Koegel, L. K., Valdez-Menchaca, M., & Koegel, R. L. (1993). Autism: A discussion from a
social communication perspective. In V Van Hasselt & M. Hersen (Eds.), Advanced ab-
normal psychology. New York: Plenum Press.
Koegel, R. L., & Koegel, L. K. (1987). Generalization issues in the treatment of autism. Semi-
nars in Speech and Language, 8, 241-256.
Test Interpretation for Children with Autism 243
Koegel, R. L., Koegel, L. K., & Schreibman, L. (1991). Assessing and training parents in
teaching pivotal behaviors. In R. Prinz (Ed.), Advances in behavioral assessment of children
and families. London: Jessica Kingsley.
Koegel, R. L., & Mentis, M. (1985). Motivation in childhood autism: Can they or won't they?
Journal of Child Psychology and Psychiatry, 26, 185-191.
Koegel, R. L., O'Dell, M. C, & Dunlap, G. (1988). Producing speech use in nonverbal autistic
children by reinforcing attempts. Journal of Autism and Developmental Disorders, 18, 525-
538.
Koegel, R. L., O'Dell, M. C, & Koegel, L. K. (1987). A natural language paradigm for teach-
ing non-verbal autistic children. Journal of Autism and Developmental Disorders, 17, 187-
199.
Lambert, N. M. (1981). The clinical validity of the process for assessment of effective student
functioning. Journal of School Psychology, 19, 323-334.
Leiter, R. G. (1979). Letter International Performance Scale: Instruction manual. Chicago:
Stoelting.
Lovaas, O. I. (1987). Behavioral treatment and normal educational and intellectual functioning
in young autistic children. Journal of Consulting and Clinical Psychology, 55, 3-9.
Lovaas, O. K., Koegel, R. L., Simmons, J. Q., & Long, J. S. (1973). Some generalization and
follow-up measures on autistic children in behavior therapy. Journal of Applied Behavior
Analysis, 6, 131-166.
Mittler, (1966). Psychological assessment. In J. K. Wing (Ed.), Early childhood autism: Clinical,
educational, and social aspects. London: Pergamon.
Norris, M. K., Juarez, M. J., & Perkins, M. N. (1989). Adaptation of a screening test for
bilingual and bidialectal populations. Language, Speech, & Hearing Services in Schools, 20,
381-390.
Rothman, R. W, & Cohen, J. (1988). Teaching test taking skills. Academic Therapy, 23, 341-
348.
Ryan, E. B., Short, E. J., & Weed, K. A. (1986). The role of strategy training in improving
the academic performance of learning disabled children. Journal of Learning Disabilities,
19, 521-529.
Seligman, M. E. P, Klein, D. C, & Miller, W. R. (1976). Depression. In H. Leitenberg (Ed),
Handbook of behavior modification. New York: Appleton-Century-Crofts.
Thorndike, R. L., Hagen, E. P., & Sattler, J. M. (1986). Stanford-Binet Intelligence Scale. Riv-
erside, CA: Riverside.
Throne, J. M., & Farb, J. (1977). A functional approach to diagnosis in mental retardation.
In J. S. Martois (Ed.), Proceedings of the Fourth Annual Conference and Exhibition on
Evaluation and Measurement: Office of the Los Angeles County Superintendent of Schools
and the Los Angeles County Board of Education (pp. 161-198). Downey, CA: OLACSS-
LACBE.
Torgesen, J. K., & Licht, B. G. (1983). The learning disabled child as an inactive learner:
Retrospect and prospects. In J. D. McKiney & L. Teagans (Eds.), Current topics and learn-
ing disabilities (pp. 3-31). Norwood, NJ: Ablex.
Turnbull, H. R., III. (1993). Free appropriate public education: The law and children with dis-
abilities. Denver, CO: Love.
Williams, T. S. (1983). Some issues in the standardized testing of minority students. Journal
of Education, 165, 192-208.
Zigler, E., Abelson, W. D., Trickett, P. K., & Seitz, V (1982). Is an intervention program
necessary in order to improve economically disadvantaged children's IQ scores? Child
Development, 53, 340-348.