You are on page 1of 11

Journal of Autism and Developmental Disorders (2021) 51:4033–4042

https://doi.org/10.1007/s10803-020-04867-9

ORIGINAL PAPER

Educational and Diagnostic Classification of Autism Spectrum Disorder


and Associated Characteristics
Janine Stichter1   · Melissa Stormont1 · Nargiza Buranova1 · Melissa Herzog1 · Rose O’Donnell1

Accepted: 31 December 2020 / Published online: 13 January 2021


© The Author(s), under exclusive licence to Springer Science+Business Media, LLC part of Springer Nature 2021

Abstract
Research continues to highlight discrepancies between clinical diagnoses of Autism Spectrum Disorder (ASD) and determi-
nation of special education eligibility for services within school settings. However, limited research has been conducted on
the impact of those discrepancies for the identification of appropriate services within schools. The aim of the current study
is to examine students’ characteristics (e.g., language, social emotional) associated with educational eligibility and clinical
diagnoses. More specifically, the study examines characteristics differentially associated with ASD diagnoses to inform
targeted evidence-based interventions. The study accessed data from a four-year cluster-randomized trial of 283 students
with and without reported ASD diagnosis. The results of the study demonstrate that the educational eligibility of Autism
did not differentiate between students with and without autism on any of the measured characteristics including language,
peer and social competence, academics, and aggressive behaviors. However, the Autism Diagnostic Observation Schedule,
second edition (ADOS-2; Lord et al. in Autism diagnostic observation schedule. Western Psychological Services, Torrance,
CA, 2012) classification was a more sensitive diagnostic measure for characteristics associated with autism. Implications
for research, practitioners, and schools are discussed.

Keywords  Autism · Autism spectrum disorder · Special education · Eligibility · Social competence · Assessment · ADOS-2

The reported prevalence of Autism Spectrum Disorder with Autism was only 15,580 (U.S. Department of Educa-
(ASD) has been consistently and rather drastically increas- tion 2001).
ing over time. According to the most recent statistics, the This drastic rise in students served under the category of
prevalence is 1 in 54 individuals is diagnosed with Autism Autism highlights a growing need to explore the methods
Spectrum Disorder (ASD) (Maenner et al. 2020). This is by which students are identified and the implications of eli-
approximately 10% higher than the rate reported in 2014 gibility determination within the schools for students with
and approximately 175% higher estimates reported in 2000 ASD. More specifically, research has highlighted a notable
(Maenner et al. 2020). Following a similar trend, the number discrepancy between educational eligibility of Autism as
of children identified for special education under the cate- compared to clinical diagnoses of ASD (Barnard-Brak 2019;
gory of Autism has also increased. According to the National Doehring and Volkmar 2016). That inconsistency may result
Center of Education Statistics (2020), in the 2018–2019 in the absence or lack of services provided to students with
school year 11% of the special education population, or ASD, or access to the services under different eligibility
781,000 students, were identified in the Autism category. criteria, which may not be supportive for individuals with
As a comparison, in 1992, just 2 years after Autism was ASD (Doehring and Volkmar 2016). Moreover, evaluation
included as a federally recognized disability category eligi- of social skills deficits, which is a hallmark characteristic
ble for special education, the number of students identified of ASD, is not consistently included across school districts
for Autism eligibility determination (Bateman et al. 2015;
Sansosti and Sansosti 2013). Therefore, the purpose of the
present study is to add to the literature by investigating dif-
* Janine Stichter ferences in characteristics of students with clinical diagnosis
stichterj@missouri.edu of ASD and special education eligibility may impact the
1 process of matching students with appropriate educational
University of Missouri, Columbia, USA

13
Vol.:(0123456789)

4034 Journal of Autism and Developmental Disorders (2021) 51:4033–4042

services, specifically in the area of social competence. To competence, which is essential for their short and long term
provide a context for the study, the literature on Autism eli- success (Ainscow 2005).
gibility, social competence of individuals with ASD, and
the implications of accurate autism identification will be
discussed. Social Competence and Autism

Although social skills impairment remains the hallmark


Autism Eligibility characteristic of Autism Spectrum Disorder, limited atten-
tion is given to assessing social skills of students with ASD
A discrepancy persists between the number of children diag- in school settings (Stichter et al. 2017a, b). Furthermore, not
nosed with ASD and those identified in the Autism eligibil- all districts consider social deficits as meeting the defini-
ity category within schools. According to analysis conducted tion of “educational impact,” especially for students with
by Barnard-Brak (2019) it was estimated that there were strengths in academics (Bateman et al. 2015). Despite having
approximately 54% fewer children with IDEA educational strong academic skills, students with ASD often experience
eligibility of Autism as compared to the estimated CDC rate poor long-term outcomes, as social competence becomes
of ASD in the U.S. One explanation for the under-identifica- increasingly important to a student’s success as they get
tion of students with ASD is that the educational and clinical older (McPartland et al. 2014). Students with ASD may
systems operate under different criteria. Moreover, clinical experience deficits in both social communication and social-
diagnosis of ASD is not sufficient to qualify a student for emotional reciprocity. Social-emotional reciprocity includes
educational services if the disability is not thought to impair difficulty with initiating social interactions and responding
the student’s academic performance. The federal government to social situations, reduced interest in and understanding
defines Autism within the Individuals with Disabilities in of emotions and feelings of other people, abnormal social
Education Act (IDEA 2004) as a “developmental disability approach, poor eye contact, and limited and/or inappropriate
significantly affecting verbal and nonverbal communication facial expressions for the situation (Stichter et al. 2010). Def-
and social interaction, generally evident before age three, icits in social communication include perceived low interest
that adversely affects a child’s educational performance” in peers, poor understanding of the nature of friendships and
(see §300.8). However, many states, and even school dis- common social relationships and building and maintaining
tricts within a given state, differ in their interpretation of the social relationships (Shulman et al. 2020).
“educational impact” required, given the limited guidance to It is also important to note that the social skills impair-
define this concept (Stichter et al. 2017a, b). ments of students with ASD tend to increase during school
For example, while some districts may consider social years and adolescence. Social interactions become more
or emotional impacts when determining educational perfor- complex with maturation and as individuals with ASD
mance, other school districts interpret this criterion as only become aware of their disability and differences as com-
academic performance (Stichter et al. 2017a, b). This results pared to others (Shulman et al. 2020). Furthermore, students
in a number of students who are not receiving special edu- with ASD are likely to experience emotional stress or exhibit
cation services, despite having a clinical diagnosis of ASD. other emotional and/or behavioral problems, which often
Current estimates suggest that only about 74% of students negatively affect their academic performance leading to
with an ASD diagnosis receive special education services increased risk for dropout, and limiting acceptance by their
(Baller et al. 2015). Therefore, individuals with ASD who peers (Zablotsky et al. 2014). Lastly, poor social competence
lack a comorbid diagnosis of intellectual disability are at a of individuals with ASD is linked with post-school outcomes
greater risk of not being identified for appropriate services that are not commensurate with their intellectual abilities
and supports, given their greater likelihood of having aca- and academic success (McPartland et al. 2014).
demic success and/or more subtle symptom presentations
(Bateman et al. 2015; Sansosti and Sansosti 2013). Yet,
under-identification and inaccurate identification of stu- Eligibility and Access to Evidence‑Based
dents with autism may limit their access to recommended Interventions
services or lead to the provision of inappropriate supports
and interventions, particularly in the area of social compe- Of the approximately 74% of students with an ASD diagno-
tence; the absence of appropriate interventions may nega- sis who are identified as needing special education supports,
tively impact students’ development and academic perfor- about one-third of these students receive supports under
mance (Doehring and Volkmar 2016). School environments non-Autism categories (Christensen et al. 2016). If students
are social environments; therefore, students with social skills with ASD are not identified or identified as having another
limitations should be offered supports to promote their social disability, the opportunity to provide needed interventions

13
Journal of Autism and Developmental Disorders (2021) 51:4033–4042 4035

may be missed. Specifically, qualifying for special education Autism category (Barton et al. 2016). As previously men-
services under different categories may affect a student’s tioned, IDEA provides federal legislation for the broad defi-
access to certain services that may be beneficial given their nition of Autism criteria, but individual states can include
needs (Barton et al. 2016). As such, simply qualifying for additional components, interpretations, and procedures or
special education services under any given category is not require varied levels of evaluations (Baller et al. 2015). A
sufficient in meeting the unique and multi-faceted needs of such, most states define Autism using similar criteria in
this population. DSM-5 but may require different documentation to qualify
The lack of alignment between clinical diagnosis, educa- a student for services under the category of Autism.
tional eligibility, and state and regional variances in Autism However, some features of the DSM-5 do not align
identification impede the ability of school professionals to with federal statute on Autism criteria identification (e.g.,
appropriately match evidence-based ASD services and inter- repetitive and stereotyped behaviors, symptoms that cause
ventions to students who might benefit from them (Doehring clinically significant impairment), which leads to misalign-
and Volkmar 2016). Evidence-based practices (EBPs) are ment between educational and medical definitions of ASD
instructional strategies that meet specific criteria and have (Doehring and Volkmar 2016; Stichter et al. 2017a, b). In
been proven to be effective based on a significant body of addition, in some states outside evaluations are necessary,
research (Cook and Cook 2011). What Works Clearing- whereas in other states, outside evaluations can be used
house (WWC), the Council for Exceptional Children (CEC), but are not required (Barton et al. 2016). The assessment
the National Research Council (NRC), and other research requirements also vary by state. In a study by Barton et al.
organizations select effective practices for students with (2016), twenty-four states did not provide any informa-
ASD based on research and accompanying results with this tion on the number and types of observations needed for
population (Cook and Cook 2011; West et al. 2013). One of the Autism eligibility process, while seven states included
the challenges researchers face is describing the population specific details on the observations needed. Fourteen states
for whom the evidence-based practice (EBD) is effective and highlighted that a team of qualified professionals must con-
under what circumstances. Students with Autism Spectrum duct the Autism evaluations at schools, and only four states
Disorder (ASD) are a heterogeneous population (Cook and required school psychologists within the school to adminis-
Cook 2011; Stichter et al. 2017a, b), which makes it highly ter assessments (Barton et al. 2016). According to Sullivan’s
problematic to form equivalent groups among research (2013) analysis of general and special education data from
participants to generalize the findings (West et al. 2013). 46 states, students from some states were nine times as likely
However, there are certainly characteristics more commonly to be found eligible for special education under the category
manifested among individuals with autism than those with- of Autism than in other states.
out autism. Furthermore, there is also limited guidance from the
Exploring how school districts are evaluating students for law and national organizations regarding the assessment of
Autism eligibility is also important to better understand the Autism in schools. Barton et al. (2016) further noted seven-
characteristics of students identified to inform intervention teen states do not include specific information on required
needs. For example, if a school district uses method A to assessment tools to be used by schools to identify Autism,
identify students and this method does not emphasize a key only two states indicated that the DSM-5 should be used,
component of autism in the process, such as social compe- and eight states required standardized or norm-referenced
tence, then interventions that were researched to be effec- assessments. Even when assessments are used, McKenney
tive for students with autism, defined as having social com- et al. (2015) review of school psychology journals noted a
petence deficits, may not be effective for similarly labeled lack of information regarding the practical utility of various
students in that school district. In the absence of policy and Autism specific measures. Further, there is limited informa-
practice changes to improve consistency in school based eli- tion in these journals regarding the reliability and validity
gibility criteria, further examination of the characteristics of Autism specific measures to help guide school psycholo-
used in eligibility determinations can inform appropriate gists’ assessment choices. Additionally, many school psy-
interventions and/or priorities for intervening and with this chologists reported that they did not engage in best practice
population. evaluations for Autism. In other words, they were not using
assessments to explore differential diagnoses (Aiello et al.
2017).
Assessing Characteristics for Evaluation Despite similarities between IDEA eligibility criteria for
Autism and DSM-5, IDEA requires that those deficits must
A major component to the under- or misidentification of adversely impact student’s educational performance (Stichter
students with ASD in the schools is the lack of consistent et al. 2017a, b). This often challenges special education
standards, methods, and expertise for identification under the teams to determine whether social competence deficits are

13

4036 Journal of Autism and Developmental Disorders (2021) 51:4033–4042

severe enough to adversely impact student’s educational per- is beyond the scope of the current paper, but details can
formance. Furthermore, one of the most challenging parts be found in previously published or presented reports (see
of conducting evaluations for autism identification at school Stichter et al. 2016, 2017a, b).
is assessing social skills deficits. This is challenging due to Participating districts/schools nominated and consented
the complexity of social competency and lack of assessment students meeting designated inclusion criteria consistent
tools available to properly evaluate this skill (Shulman et al. with social interventions similar to SCI-A and that were
2020). The diagnostic assessment in school settings often necessary given the cognitive-behavioral underpinnings of
emphasize academic achievement over social competency the intervention: absence of intellectual disabilities (based
and social skills are frequently assessed through reports from on full-scale IQ scores above 75 from a reliable test1), par-
other people (parents, teachers) with limited information ticipation in general education with peers for at least one
gathered from the target student and their peers (Shulman course per day, absence of a primary mental health diagno-
et al. 2020). sis (e.g., exclusion of students for whom their sole or pri-
To adhere to multiple criteria outlined in IDEA, schools mary diagnosis was for major mental health such as bipolar
are expected to conduct several assessments to measure disorder) or major behavioral incidents (e.g., exclusion of
adaptive behavior, cognitive ability, language skills, execu- students with highly aggressive incidents or incidents that
tive functioning, and social competence during the evalua- results in repeated out-of-school suspension), and identified
tion process (Stichter et al. 2017a, b). However, there is no social needs consistent with characteristics and challenges
universal test that is reliable in identifying Autism in every often associated with high functioning autism (e.g., difficulty
single student in special education (Stichter et al. 2017a, b). expressing and/or reading emotions, deficit in problem solv-
The goal of the special education team is to assess the sever- ing skills, emotional dysregulation; Solomon et al. 2004).
ity of the student’s needs in order to choose and implement Although seeking students with needs consistent with ASD,
the most effective interventions to support student’s aca- neither a documented ASD diagnosis nor special education
demic performance and social competence. However, taking eligibility in the Autism category was explicitly required.
into consideration the differences among clinical diagnostic This criteria was important as access to consistent outside
assessments (ADOS, DSM5), IDEA special education eli- medical providers trained in diagnosing ASD varies signifi-
gibility, state and regional variances in identification stu- cantly in the targeted area. Additionally, the nature of the
dents with ASD, it is not clear if students with ASD differ current study was to capture how schools were evaluating
in their characteristics based on meeting different eligibility students for targeted needs. Each school had to have at least
requirements. To this end, it is important to understand how four students who met eligibility criteria to meet the mini-
children with clinical diagnosis and/or educational eligibility mum size needed for an SCI-A group and thus to remain
differ in characteristics in order to understand how those dif- in the study. Since evaluation of the effectiveness of social
ferences could potentially impact treatment considerations. programming is not the focus of the current study, all avail-
The purpose of this study is to investigate if educational able data from all consented students is pooled regardless
eligibility and clinical diagnosis of autism are associated of their SCI-A or BAU assignment and was collected prior
with specific language, social emotional, and other key char- to the start of SCI-A programming.
acteristics. More specifically, among students with autism,
what characteristics are differentially associated with their Students
diagnosis and can therefore be targeted for evidence-based
treatments? Parent consent was obtained for students (n = 155 SCI-A;
n = 137 BAU). For inclusion in the current study, students
had to (a) have an IQ score from a reliable test that was
Method within the inclusion criteria and (b) have a minimum three
indicators of autism (i.e., at least one indicator beyond
Participants and Settings school-based report). After consent, 3 students did not
have the minimum number of indicators, 5 students were
The current quasi-experimental study includes data obtained determined ineligible based upon misreported IQ (i.e.,
during a 4-year cluster-randomized trial designed to assess below inclusion threshold), and 1 student moved from the
the efficacy of the Social Competence Intervention-Adoles-
cent (SCI-A; Stichter et al. 2010, 2016) program as com-
pared to “business as usual” (BAU) social programming
1
conducted 34 publicly funded middle schools in one Mid-  Two tests/scores were considered reliable in the current study:
WASI Abbreviated Scale of Intelligence (WASI; Wechsler 1999) Full
west state. Description of the SCI-A program, various BAU Scale IQ score or WISC-IV Wechsler Intelligence Scale for Children-
settings, and the methodology involved in the efficacy testing 4th Edition (WISC-IV; Wechsler 2003) Global Ability Index score.

13
Journal of Autism and Developmental Disorders (2021) 51:4033–4042 4037

Table 1  Student characteristics (n = 283) Special Education Eligibility


n %
Upon referral to the project, schools reported if the student
Grade level was eligible for special education services with an individ-
 6th grade 114 40.3 ual education plan (IEP) or 504 plan (n = 283 reports, 100%
 7th grade 92 32.5 of total study sample). If the student had an IEP, schools
 8th grade 77 27.2 reported the corresponding eligibility category. For analytic
Gender purposes, we created a binary code for the presence of an
 Male 238 84.1 IEP in the Autism category (0 = no Autism IEP; 1 = Autism
 Female 45 15.9 IEP).
Special education eligibility autism 158 55.8
Emotional disturbance 54 19.1 Autism Diagnostic Observation Schedule (ADOS‑2; Lord
Other health impairment 36 12.7 et al. 2012)
Specific learning disability 4 1.4
Speech impairment 8 2.8 The ADOS-2 is a semi-structured observation during tasks
Section 504 Plan 13 4.6 and interactions with a trained administrator that assesses
No eligibility 8 2.8 students’ behaviors characteristic of autism. Scores are
assigned within domains: (a) reciprocal social interaction,
(b) communication, and (c) restricted, repetitive, and stereo-
school before reliable IQ criteria could be verified. Table 1 typed patterns of behavior. Administrators utilized the Mod-
includes demographic characteristics of the current analytic ule 3 version (appropriate for adolescents with fluent speech
sample of 283 students. All data were obtained prior to the abilities) and have met research reliability standards desig-
Spring semester. Most students were male (84.1%), ages nated by the measure’s developers. The scoring algorithm
ranged from 11.38 to 15.40 years (M = 12.92, sd = 0.92). uses a priori selected items (coded as 0 = no evidence of
Participants had cognitive functioning at or above the study abnormality to 2 = definite evidence of abnormality) to cal-
inclusion criteria (M = 99.83, sd = 14.12). The majority of culate domain scores on Social Affect (SA, range 0–20) and
students were eligible for special education services; most Restricted Behavior (RRB, range 0–8) that are summed to
qualifying under the categories of Autism, Emotional Dis- form a Total Score (range 0–28), with higher scores indicat-
turbance, or Other Health Impairment. Students had a wide ing greater severity of symptoms. The ADOS-2 Classifica-
variety of reported diagnoses, with 69.6% of students hav- tion category is based on the participant’s total score: Non-
ing at least one secondary mental health diagnosis reported, spectrum (Total = 6 or less), Autism Spectrum (Total = 7–8),
and 32.8% having more than one diagnosis reported. Over or Autism (Total = 9 or more).
40% of students (n = 115) had some form of ASD reported, In the current study as part of the a priori methods and
and of this number, 55 students had a secondary diagnosis analysis plan, 60% of consented students were randomly
of ADHD. selected to participate in the ADOS-2 (n = 158). Only 60% of
children were randomly selected within each school district
Measures due to the high cost associated with the ADOS-2 assess-
ment and the requirement to conduct it by the highly quali-
External Diagnosis fied trained professionals. In addition, some students in the
SCI-A condition of the RCT provided consent to participate
As part of the referral process for the RCT, each school in an ancillary study and participated the same research-reli-
reported what diagnosis, if any, the student had on file able ADOS-2 procedures (n = 20). All ADOS-2 observations
(n = 283 reports, 100% of total study sample). Diagnoses were conducted at school during the school day at the onset
provided by an external medical or psychological profes- of each student’s participation in the study. All examiners
sional outside of the school/district (i.e., special education conducting the ADOS-2 were members of the research team
eligibility categorization did not count as a diagnosis) that who had passed all official research-reliability standards per
were included in school records are reported here. This rep- the ADOS-2 developers. Although some schools reported
resents an ecologically valid approach to understanding the students had an existing ADOS score on file, these scores are
types of information to which schools have access. On the not considered in the analysis of concordance of ASD indi-
designated form, Autism, Asperger’s Syndrome, and Perva- cators as we could not verify the research-reliable status of
sive Developmental Disorder-Not Otherwise Specified were the examiner. Additionally, some students’ tests were given
listed categories in an effort reflect varying DSM diagnostic using non-comparable forms (e.g., not Module 3, n = 6,
criteria over the past decade. 7.8%) or were given well before the middle school years

13

4038 Journal of Autism and Developmental Disorders (2021) 51:4033–4042

(46.1% of school-reported ADOS administered before age .60–.73 for the Antisocial Behavior scores (Crowley and
9; 14.5% before age 6). To maximize sample size and power Merrell 2003). Validity of SSBS scales have been demon-
in the current study, data from both the random sample and strated by multiple studies including criterion-related valid-
the additional SCI-A condition are included (n = 178, 62.9% ity (Merrell and Gill 1994), convergent and discriminant
of total study sample). validity, and strong sensitivity to theoretically based group
differences (Merrell and Gill 1994; Merrell et al. 1993). It
Children’s Communication Checklist‑2 (CCC‑2; Bishop 2006) has been shown that the SSBS scale has evidence of strong
classification accuracy of students with different special edu-
For each student, one school professional who knew the cation groups (Crowley and Merrell 2003).
student well completed the CCC-2 via an online data col-
lection system mid-late Fall semester (n = 281, 99.3% of Data Analysis Plan
total study sample; 2 did not complete it). The CCC-2 is
designed to distinguish youth with and without pragmatic To protect against Type 1 error, while also considering Type
language and social interaction difficulties (characteristics 2 error in this exploratory work, MANOVAS were deter-
of ASD), and data demonstrate it has discriminant valid- mined to be the best choice for group difference analyses
ity to distinguish participants with high functioning autism given several related dependent variables can be included
from typical controls, particularly among youth with higher while also considering two independent variables within
IQ (sensitivity = .88, specificity = .53; Bishop 2006). The the same model. ADOS-2 classification (Autism, Autism
CCC-2 includes 70-items across 10 subscales. Four scales Spectrum Disorder, no Autism) and educational diagnosis of
(A–D: speech, syntax, semantics, coherence) assess areas Autism (i.e., yes or no) were entered as the two independent
often associated with specific language impairment. Four variables into five separate MANOVAS with the following
scales (E–H: initiation, scripted language, context and non- dependent variables: pragmatic language, language form and
verbal communication) assess pragmatic aspects of language structure, social emotional competence and relations, other
and communication. Two scales (I–J: social relations, inter- autism characteristics (i.e., academics, interests), and anti-
ests) assess non-language domains characteristic of ASDs. social behavior. Each of these dependent variables included
Each scale contains seven items, five that assess challenges subscales from the CCC-2 and SSBS. Next, where MANO-
and two that assess strengths in the given domain (reverse VAs yielded significant differences for one or both of the
scored). Respondents rated the frequency of each behav- independent variables, univariate analyses were conducted
ior on a 4-point scale (0 =  < once a week/never to 3 = sev- to determine specific subscales with significant mean differ-
eral times (> 2) a day/always). Items in each subscale are ences. When univariates documented differences then fol-
summed with subscale scores ranging from 0 to 21, with low up analyses explored mean differences (i.e., a Tukey for
higher scores indicating greater challenges; raw sums ADOS given it yields three groups). Cohen’s d scores were
are converted to a norm-referenced scaled score (M = 10, also computed for significant mean analyses to determine
SD = 3). According to psychometric testing (Bishop 2006), magnitude of effects; effect sizes of .20 are considered small,
scales have adequate internal consistency (α = .73–.88) and .5 are medium, and .8 or above are large (Cohen 1988).
inter-rater reliabilities (ICCs = .62–.83). The CCC-2 demon-
strates discriminant validity in its ability to distinguish par-
ticipants with HFA from typical controls, particularly among Results
youth with high IQ (sensitivity = .88, specificity = .53).
Multiple Analyses of Variance
School Social Behavior Scales (SSBS; Merrell et al. 1993)
Of the five MANOVAs run, two were significant, one was
The SSBS is a behavior screening tool designed to assess approaching significance and two were not significant. The
children’s’ social and emotional behaviors, identify students MANOVA with dependent variables related to social com-
with challenging behaviors and provide interventions. The petence and social relations yielded significant differences
scale can be implemented by teachers and school person- among groups with and without ADOS diagnoses F = 3.47,
nel in grades K through 12. The SSBS instrument consists p = .001. Groups did not differ based on an IEP diagnosis of
of two separate scales: Social Competence and Antisocial autism F = .56, p = .69 F = .48, p = .87. Differences among
Behavior and includes 65 descriptions of appropriate and groups were documented in univariate analyses for all three
not appropriate social behaviors; raters report behaviors on subscales, which are presented in Table 2. Tukey follow-
a 5-point Likert scale. The SSBS has strong internal con- up comparisons documented significant mean differences
sistency (.94–.98), split-half reliability (.91–.98), test–retest between the group of students with autism and the group
reliability at (.76–.83) for the Social Competence scale and without autism for all subscales with the group with autism

13
Journal of Autism and Developmental Disorders (2021) 51:4033–4042 4039

Table 2  Univariate statistics and student group means (SDs) for ADOS-2 significant results
Rating scale Autism Autism spectrum Non spectrum F ratio p Tukey d

Pragmatics
 Initiation 8.71 (4.62) 7.79 (4.25) 6.77 (4.04) 1.54 .217 – –
 Script lang 5.06 (2.88) 4.26 (2.83) 3.12 (3.16) 3.72 .026 A > NS .66
 Context 7.96 (3.86) 6.42 (4.39) 4.76 (4.21) 6.49 .002 A > NS .79
 Nonverb com 9.59 (4.52) 7.32 (4.49) 5.88 (4.99) 5.98 .003 A > NS .79
Social skills
 Soc relation 9.79 (4.08) 8.00 (4.03) 6.88 (3.89) 5.31 .006 A > NS .70
 Peer prob 30.75 (10.83) 31.37 (9.91) 42.65 (15.15) 8.52 .001 A > NS; AS > NS 1.02; .97
 Social comp 85.32 (22.94) 87.47 (23.09) 102.23 (31.45) 4.24 .016 A < NS .70
Other common
 Academics 23.87 (7.27) 24.47 (7.52) 27.06 (7.73) 1.77 .174 – –
 Interests 8.39 (4.08) 6.63 (3.32) 5.29 (3.69) 5.55 .005 A > NS .76

having more impaired social functioning. Two of the effect pragmatic language skill problems than those without an
sizes were in the medium approaching large range and the autism diagnosis for all three subscales and the effect sizes
SSBS subscale peer problems and relations had a large effect ranged from .66 to .79, which are considered medium effect
size of 1.02. Also on this subscale, the group of students sizes approaching large (Cohen 1988). The group with a
with autism spectrum disorder had higher peer relations diagnosis of autism spectrum disorder did not differ from
problems than their peers without autism and the magni- either of the other groups on the three pragmatic language
tude of the effect was also large. No other differences were subscales.
documented for the autism spectrum group and either other The MANOVA with dependent variables including
group. language form and use characteristics was not significant
The MANOVA with other autism characteristics (i.e., for IEP diagnosis F = .252; p = .91 or ADOS-2 diagnosis,
subscales of interests, academics) was significant for F = 1.74, p = 09. Accordingly, no additional univariate analy-
ADOS-2 Diagnosis F = 2.76, p = .028. Again, the MANOVA ses were conducted. Given it was not significant, the uni-
was not significant for the independent variable IEP diag- variates were not presented in Table 2. Language form and
nosis F = .60, p = .55. In the follow-up univariates, the aca- use included the CCC-2 subscales speech, syntax, seman-
demic subscale was not significant but the interests subscale tics, and coherence. Finally, the MANOVA with dependent
was significant; Tukey follow up analyses documented that variables related to antisocial behavior subscales (i.e., SSBS
the group with autism had higher scores on restricted inter- scales Hostile/Irritable, Antisocial/Aggressive, and Defiant/
ests than the no autism group with a medium effect size. Disruptive) was not significant for IEP diagnosis, F = .73,
The group with autism spectrum disorder did not differ from p = .53 or ADOS-2 Diagnosis F = .39, p = .89. Accordingly,
either group. no follow up univariates were conducted.
For the MANOVA including pragmatic language charac-
teristics (i.e., CCC-2 Initiation, CCC-2 Scripted Language,
CCC-2 Context, and CCC-2 Nonverbal Communication),
IEP diagnosis of autism was not significant F = .58, p = .68. Discussion
However, the independent variable ADOS-2 classification
was approaching significance F = 1.89; p = .06. Given the Although autism has only been recognized as an educational
exploratory nature of this research and that the finding was category for 30 years, extensive research has been conducted
approaching significance, univariates are reported for the to determine evidence based practices for the unique needs
ADOS-2 classification and pragmatic language subscales. of students with autism, including social competence. In
Three of the four univariate analyses were significant includ- order to effectively match students with effective interven-
ing scripted language, context, and nonverbal communica- tions, classification systems need to be sensitive to the char-
tion (see Table 2). Follow up Tukey analyses were conducted acteristics that are most valid and distinguish those students
for the three significant univariates and documented group with a specific disability from those without. Without a clear
differences between the groups with an autism diagnosis understanding of classification systems, and the associated
and those without an autism diagnosis. The group with characteristics of students with specific classifications, a pri-
an autism diagnosis had mean scores that reflected more mary aim of determining eligibility is compromised.

13

4040 Journal of Autism and Developmental Disorders (2021) 51:4033–4042

A central finding of this study includes that an educa- category but may still need support with skills development
tional eligibility classification was not associated with char- (i.e., social competence) (Bateman et al. 2015; Christiansen
acteristics of autism but ADOS-2 classification of autism 2016; Doehring and Volkmar 2016; Sansosti and Sansosti
(i.e., autism, autism spectrum disorder, no autism) was 2013). Moreover, there are students with diagnosis other
associated with key characteristics. More specifically, in this than ASD who may benefit from interventions designed spe-
study we found that the educational diagnosis of Autism did cifically for students with Autism Spectrum Disorder (Lyons
not distinguish between students with and without autism et al. 2016; Walker and Barry 2018; West et al. 2013). The
on key characteristics of language, peer and social relations national lists of interventions for a specific label such as
and competence, or academics and other interests. This is WWC for Autism may not be functional as there are no uni-
a significant finding in that it isn’t clear how students with versal standards for identifying this disability label at school
autism were determined eligible for an IEP if they did not level which question the relevance of services delivered to
differ from peers with other disabilities on key social and students identified. Practitioners need to understand how to
language outcomes. This can be a result of the absence of identify students with specific needs and what interventions
consistent standards and procedures for identifying students to implement to meet their needs instead of using eligibility
under the Autism category at school. Due to the inconsist- criteria which may differ vastly from one school district to
ency of assessment and evaluation requirements across another, from one state to another and create less then opti-
school districts and states, the misidentification or/and under mal benefit for some students.
identification of students most likely to occur (Barnard-Brak
2019; Barton et al. 2016). Limitations
ADOS-2 classifications are challenging to provide for all
children and youth suspected as having autism. However this There are several limitations to this study. First, the data
study documented the ADOS classification discriminated were was collected in one Midwest state. Also, although the
between groups of those with autism and without autism. groups were formed purposely for this study, the specific
The group with ASD (ADOS-2) was significantly differ- inclusion criteria for the study limits the generalizability
ent from the group without autism on peer relations but not of the results to other groups and other states. The current
on any other characteristics. The ADOS/ADOS-2 can be study has the limitation of excluding students with comorbid
time-consuming and requires an extensive training to con- intellectual disabilities, mental health diagnosis, and major
duct this assessment, which makes it challenging to imple- behavior challenges. Therefore, further research should be
ment in school setting. However, as this study clearly found, conducted to understand the process of identification at
when an ADOS has been conducted for a student referred for school and the provision of special education services to
evaluation, it is an important piece of data to be used by the diverse students with ASD who may have more severe social
team (Stichter et al. 2017a, b). ADOS-2 classification proved skills deficits and comorbid diagnoses. Finally, the depend-
to be a more solid diagnostic measure for important and ent variables reported were all teacher ratings and do not
differential characteristics associated with autism. Further- include parent or student reports or direct observation data.
more, ADOS-2 scores did not differentiate among groups on
characteristics not associated with autism (e.g., aggression), Implications
which further supports the utility of the ADOS-2 for autism
and associated characteristics. This study is important to researchers and practitioners who
Taking into consideration the current discrepancies try to match appropriate interventions to students based on
among clinical (ADOS-2) diagnosis and educational eligibil- their needs. Important outcomes associated with an ADOS
ity, state and regional differences in identification of students classification of autism include more problems across char-
with Autism, and the use of interventions labelled as specific acteristics of social problems including difficulties in social
for students with ASD (West et al. 2013; Cook and Cook skills, peer relations and overall social competence as well as
2011), the field needs to create a more universal process/ the pragmatic use of language. As individuals with Autism
standard for special education eligibility under Autism cat- have deficits in social communication and social-emotional
egory to ensure that students are identified in a timely man- reciprocity this creates challenges in establishing friendships
ner and matched to the appropriate services. If the universal and increases risks of being bullied by peers (Zablotsky et al.
process for identifying students with ASD is not feasible, 2014). Students with Autism are reported to have higher
another possible approach might be to research and match risk of being rejected than children with other disabilities
interventions based on the student’s deficit area (i.e., social by their typically developing peers (Zablotsky et al. 2014).
competence) rather than disability label or diagnosis. As Despite reported average intellectual abilities and successful
confirmed by research, there are students who are deemed academic performance, students with Autism are more likely
not eligible for special education services under Autism to experience extreme difficulties developing social skills

13
Journal of Autism and Developmental Disorders (2021) 51:4033–4042 4041

competence and building connections with peers (Carter Barnard-Brak, L. (2019). Educational versus clinical diagnoses of
et al. 2013), and thus, they require interventions and sup- autism spectrum disorder: Updated and expanded findings. School
Psychology Review, 48(2), 185–189. https​://doi.org/10.17105​/
ports for social competence development. In this study we SPR-2018-0009.V48-2.
found a large effect size for the differences between students Carter, E. W., Common, E. A., Sreckovic, M. A., Huber, H. B.,
with autism and ASD and their peers without autism on peer Bottema-Beutel, K., Gustafson, J. R., Dykstra, J., & Hume, K.
relations and the magnitudes for these effects were large. (2014). Promoting social competence and peer relationships for
adolescents with autism spectrum disorders. Remedial and Special
Finally, the findings from this study have implications for Education, 35(2), 91–101. https​://doi.org/10.1177/07419​32513​
school evaluation teams. Specifically teams should consider 51461​8.
making decisions concerning provision of special education Christensen, D. L., Baio, J., Braun, K. V. N., Bilder, D., Charles, J.,
services to students based on the students’ areas of deficits Constantino, J. N., et al. (2016). Prevalence and characteristics of
autism spectrum disorder among children aged 8 years — Autism
and needs rather than medical diagnosis or eligibility label. and Developmental Disabilities Monitoring Network, 11 Sites,
This approach will allow access to interventions for students United States, 2012. MMWR Surveillance Summaries, 65(3),
who may not have an official diagnosis of Autism or may 1–23. https​://doi.org/10.15585​/mmwr.ss650​3a1.
belong to a different disability category but still experience Cohen, J. (1988). Statistical power analysis for the behavioral sciences,
2nd ed. Hillsdale, New Jersey: Erlbaum.
significant difficulties in the area of social competence. In Cook, B. G., & Cook, S. C. (2011). Unraveling evidence-based prac-
addition, this method will potentially reduce the research to tices in special education. The Journal of Special Education,
practice gap as it will promote understanding among practi- 47(2), 71–82.
tioners on how to identify students and interventions which Crowley, S. L., & Merrell, K. W. (2003). The structure of the school
social behavior scales: A confirmatory factor analysis. Assess-
work for them rather than just implementing evidence-based ment for Effective Intervention, 28(2), 41–55. https ​ : //doi.
interventions without recognizing the individual needs of org/10.1177/07372​47703​02800​205.
every student with disability. Doehring, P., & Volkmar, F. R. (2016). Knowledge gaps in ASD
research: Short and long term implications for policy. Journal of
Acknowledgments  The research reported here was supported by the Autism and Developmental Disorders, 46(3), 733–736. https:​ //doi.
Institute of Educational Sciences, U.S. Department of Education, org/10.1007/s1080​3-015-2683-3.
through Grant R305A100342 and R305A130143 to the University of Individuals with Disabilities Education Improvement Act [IDEA] of
Missouri. The opinions expressed are those of the authors and do not 2004, 34 CFR §300.8 et seq., 71 FR 46540 (2006).
represent views of the Institute or the U.S. Department of Education. Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop,
S. L. (2012). Autism diagnostic observation schedule (2nd ed.).
Torrance, CA: Western Psychological Services.
Author Contributions  Conception or design of the work was done by Lyons, G. L., Huber, H. B., Carter, E. W., Chen, R., & Asmus, J.
JS and MH. Data collection was done by JS, MH and RO. Data analysis M. (2016). Assessing the social skills and problem behav-
and interpretation was done by JS, MS and MH. Drafting the article iors of adolescents with severe disabilities enrolled in gen-
JS, MS and NB. Critical revision of the article was done by JS, MS eral education classes. American Journal on Intellectual and
and NG. Developmental Disabilities, 121(4), 327–345. https ​ : //doi.
org/10.1352/1944-7558-121.4.327.
Maenner, M. J., Shaw, K. A., Baio, J., et al. (2020). Prevalence of
autism spectrum disorder among children aged 8 years—autism
References and developmental disabilities monitoring network, 11 sites,
United States. Surveillance Summaries, 69(4), 1–12. https​://doi.
Aiello, R., Ruble, L., & Esler, A. (2017). National study of school psy- org/10.15585​/mmwr.ss690​4a1.
chologists’ use of evidence-based assessment in autism spectrum McKenney, E. L., Dorencz, J., Bristol, R. M., & Hall, L. P. (2015). Pub-
disorder. Journal of Applied School Psychology, 33(1), 67–88. lishing about autism spectrum disorder in six school psychology
Ainscow, M. (2005). Understanding the development of inclusive journals: 2002–2012. Psychology in the Schools, 52(3), 265–283.
education system. Electronic Journal of Research in Educational McPartland, J. C., Klin, A., & Volkmar, F. R. (Eds.). (2014). Asperger
Psychology, 3(7), 17. syndrome: Assessing and treating high-functioning autism spec-
Baller, J. B., Stuart, E. A., McGinty, E. E., Fallin, M. D., & Barry, trum disorders. New York: Guilford Publications.
C. L. (2015). Students with autism served in special education: Merrell, K. W., & Gill, S. J. (1994). Using teacher ratings of social
Trends from 2004–2012. Health Behavior and Policy Review, behavior to differentiate gifted from non-gifted students. Roeper
2(3), 210–218. https​://doi.org/10.14485​/HBPR.2.3.5. Review, 16(4), 286–289.
Barton, E. E., Harris, B., Leech, N., Stiff, L., Choi, G., & Joel, T. Merrell, K. W., Sanders, D. E., & Popinga, M. (1993). Teacher rat-
(2016). An analysis of state autism educational assessment prac- ings of social behavior as a predictor of special education status:
tices and requirements. Journal of Autism and Developmen- Discriminant validity of the School Behavior Scales. Journal of
tal Disorders, 46(3), 737–748. https​://doi.org/10.1007/s1080​ Psychoeducational Assessment, 1, 1220–1231.
3-015-2589-0. National Center for Education Statistics. (2020). Students with dis-
Bateman, B., Lloyd, J. W., Tankersley, M., & Driver, M. K. (2015). abilities. Retrieved from https​://nces.ed.gov/progr​ams/coe/indic​
Who should receive and provide special education? In B. Bate- ator_cgg.asp.
man, J. W. Lloyd, & M. Tankersley (Eds.), Enduring issues in Sansosti, F. J., & Sansosti, J. M. (2013). Effective school-based service
special education: Personal perspectives. New York: Routledge. delivery for students with autism spectrum disorders: Where we
Bishop, D. V. M. (2006). Children’s Communication Checklist—2. are and where we need to go. Psychology in the Schools, 50(3),
Bloomington, MN: Pearson. 229–244. https​://doi.org/10.1002/pits.21669​.

13

4042 Journal of Autism and Developmental Disorders (2021) 51:4033–4042

Shulman, C., Esler, A., Morrier, M. J., & Rice, C. E. (2020). Diagnosis U.S. Department of Education. (2001). Number of children served
of autism spectrum disorder across the lifespan. Child and Adoles- under IDEA by disability and age group, during school years
cent Psychiatric Clinics of North America, 29(2), 253–273. https​ 1991-92 through 2000-01. Office of Special Education Programs,
://doi.org/10.1016/j.chc.2020.01.001. Data Analysis System (DANS). Retrieved from http://www.idead​
Solomon, M., Goodlin-Jones, B. L., & Anders, T. F. (2004). A social ata.org/table​s24th​%5Car aa9.htm.
adjustment enhancement intervention for high functioning autism, Walker, J. D., & Barry, C. (2018). Assessing and supporting social-
Asperger’s syndrome, and pervasive developmental disorder-NOS. skill needs for students with high-incidence disabilities.
Journal of Autism and Developmental Disorders, 34, 649–668. TEACHING Exceptional Children, 51(1), 18–30. https​://doi.
Stichter, J. P., Herzog, M. J., Visovsky, K., Schmidt, C., Randolph, J., org/10.1177/00400​59918​79021​9.
Schultz, T., & Gage, N. (2010). Social competence intervention Wechsler, D. (1999). Wechsler abbreviated scale of intelligence. San
for youth with Asperger syndrome and high-functioning autism: Antonio, TX: Psychological Corporation.
An initial investigation. Journal of Autism and Developmental Wechsler, D. (2003). Wechsler intelligence scale for children-WISC-IV.
Disorders, 40, 1067–1079. Psychological Corporation.
Stichter, J. P., Herzog, M. J., Owens, S. A., & Malugen, E. (2016). West, E. A., Kidwell, J., Umbrager, G., & Cote, D. L. (2013). Current
Manualization, feasibility, and effectiveness of the school-based status of evidence-based practice for students with intellectual
social competence intervention for adolescents (SCI-A). Psychol- disability and autism spectrum disorders. Education and Train-
ogy in the Schools, 53, 583–600. ing in Autism and Developmental Disabilities, 48(4), 443–455.
Stichter, J. P., Conroy, M. A., O’Donnell, R., & Reichow, B. (2017a). Zablotsky, B., Bradshaw, C. P., Anderson, C. M., & Law, P. (2014).
Current issues and trends in the education of children and youth Risk factors for bullying among children with autism spectrum
with autism spectrum disorders. In J. M. Kauffman, D. P. Hal- disorders. Autism, 18(4), 419–427. https​://doi.org/10.1177/13623​
lahan, & P. C. Pullen (Eds.), Handbook of special education (pp. 61313​47792​0.
394–410). London: Routledge.
Stichter, J. P., Herzog, M. J., Kilgus, S. P., & Schoemann, A. M. Publisher’s Note Springer Nature remains neutral with regard to
(2017b). Exploring the moderating effects of cognitive abilities jurisdictional claims in published maps and institutional affiliations.
on social competence intervention outcomes. Behavior Modifica-
tion. https​://doi.org/10.1177/01454​45517​69865​4.
Sullivan, A. L. (2013). School-based autism identification: Prevalence,
racial disparities, and systemic correlates. School Psychology
Review, 42(3), 298.

13
Journal of Autism & Developmental Disorders is a copyright of Springer, 2021. All Rights
Reserved.

You might also like