You are on page 1of 9

Contemporary School Psychology

https://doi.org/10.1007/s40688-020-00335-4

Special Education Evaluation Practices and Procedures: Implications


for Referral and Eligibility Decision-making
Kathrin E. Maki 1 & Sarah R. Adams 2

Accepted: 4 November 2020


# California Association of School Psychologists 2020

Abstract
Special education service provision depends upon referral for evaluation, corresponding evaluation procedures, and resulting
eligibility decisions. However, how school districts and decision-makers (e.g., school psychologists) apply special education
evaluation procedural rules is largely unknown. Through a survey of practicing school psychologists, the current study examined
the most common special education referral concerns, multidisciplinary team (MDT) members’ roles in eligibility decision-
making, the value of various assessment data sources in determining special education eligibility, and differences in those
variables across participants’ years of experience, degree level, and geographic region. Participants reported that reading was
the most common special education referral, school psychologists primarily made special education eligibility decisions with
some input from other MDT members, and test scores were the most valued source of assessment data in determining special
education eligibility. There were no reported differences in these variables across degree or US geographic region, but there were
differences in reported perceptions of the most important sources of assessment data across years of experience. Implications for
practice and future research are discussed.

Keywords Special education . Assessment . School psychology

Prior to 1975, students with disabilities or those otherwise implementation of evaluation procedures at the local school
experiencing difficulties in school largely failed to have their district level to determine special education eligibility is not
unique learning needs met (Zigmond et al. 2009). Fortunately, clear. This study sought to fill this research gap by examining
educational services for students with disabilities have school psychologists’ perceptions of the most common spe-
changed significantly since the original authorization of the cial education referral concerns, primary eligibility decision-
Education for all Handicapped Children Act (EAHCA), now makers, and the most valued sources of assessment data for
the Individuals with Disabilities Education Improvement Act determining special education eligibility.
of 2004 (IDEA; Hardman and Dawson 2008). Today, educa-
tors must provide differentiated instruction to meet the needs
of all students, including those with disabilities (Every
Special Education Referrals and Evaluations
Student Succeeds Act [ESSA] 2015; IDEA 2004) who must
meet state categorical disability eligibility criteria in order to
IDEA outlines 13 disability categories under which a student
benefit from specialized and individualized special education
may receive special education services. In order to be identi-
services (Burns and Ysseldyke 2009; Pub. L. No. 108–446 §
fied with one (or more) of these disabilities, a student must
300.8). Despite these federal- and state-level requirements,
receive a comprehensive evaluation, meet disability eligibility
criteria outlined by state special education regulations, and
* Kathrin E. Maki demonstrate a need for special education services (P. L. No.
kathrin.maki@coe.ufl.edu 108–446 § 300.304 [b]; P. L. No. 108–446 § 300.8 [a][1]).
Given the need to meet categorical disability eligibility
1
Department of Special Education, School Psychology, and Early
criteria, special education referrals and evaluations should
Childhood Studies, University of Florida, align, at least in part, with the characteristics of the disability
FL 32611 Gainesville, USA categories. For example, if a student is being evaluated for
2
Department of Educational Psychology, Ball State University, autism spectrum disorder (ASD), he or she should demon-
Muncie, IN 47306, USA strate social, behavioral, and/or communication difficulties
Contemp School Psychol

that lead to a special education referral and the assessments eligibility and Individualized Education Program (IEP) meet-
conducted as part of the evaluation. However, the nature of ings (Huebner and Gould 1991; Pfeiffer and Hefferman
referral concerns and practices are not well understood per- 1984), which could further undermine eligibility decisions
haps in part because disability eligibility criteria differ across due to the error-prone nature of human decision-making
states (MacFarlane and Kanaya 2009; Maki et al. 2015). (Watkins 2009). Such research, though, is dated and may
Clarification of current practices could support implementa- not reflect MDT functioning since the reported paradigm shift
tion of preventative services, and evidence-based referral and in school psychological practice in which the field has
evaluation practices. attempted to shift away from the role of special education
The largest group of students receiving special educa- gatekeeper and toward prevention of academic, social, emo-
tion services are those identified with specific learning tional, and behavioral difficulties (Reschly 2008).
disabilities (SLD; National Center for Education Furthermore, as part of school psychologists’ increased pre-
Statistics 2020; NCES), and academic underachievement vention efforts, problem-solving teams have become a regular
is the hallmark of SLD. Academic difficulties generally and integral part of pre-referral practices (Burns et al. 2014;
(Lloyd et al. 1991), and reading difficulties specifically VanDerHeyden et al. 2007), which may support MDTs’ en-
(Bramlett et al. 2002), were reported as the most com- gagement in collaborative eligibility decision-making.
mon referrals for special education evaluation. However, However, current research is needed to examine how teams
this prior research may be outdated because the percent- function when making special education eligibility decisions
age of students identified with SLD has steadily de- within today’s school systems that more frequently incorpo-
creased from approximately 50 to 34% (National Center rate team processes and decision-making.
for Education Statistics 2020) since the reauthorization of Despite school psychologists’ shifting roles and greater
IDEA in 2004. Given that the majority of students iden- incorporation of school-based teams, school psychologists
tified with SLD have a reading disability (Cortiella and in particular possess fundamental knowledge and skills crit-
Horowitz 2014), there may be fewer evaluation referrals ical to evaluation practices and eligibility decision-making
for reading difficulties than previously reported. (NASP 2020). Special education evaluations typically in-
The now widespread implementation of multitiered sys- clude the administration of multiple assessment measures
tems of support (MTSS; Spectrum K-12 School Solutions in which school psychologists are uniquely trained and
2010) and the documented effectiveness of reading interven- skilled for interpretation (Ysseldyke et al. 2008). In particu-
tions within MTSS (Gersten et al. 2009; Hall and Burns 2017) lar, school psychologists possess unique skills and compe-
may also affect the number of reading referrals for special tence in statistical and measurement properties that underlie
education evaluation. Moreover, the increased implementa- assessments administered as part of an evaluation battery
tion of problem-solving teams as part of MTSS (Burns et al. (NASP 2020). Special education teachers reported that
2014; VanDerHeyden et al. 2007) also shifted the special school psychologists play the second most active role regard-
education referral process from teacher referral to team referral ing educational setting placement following teachers and
following intervention implementation, which could similarly that school psychologists were fundamental in special edu-
impact the types of referrals for special education evaluation. cation decisions (Becker et al. 2014). However, Becker et al.
Understanding the nature of special education referrals can (2014) focused exclusively on students with ED and exam-
help inform special education evaluation best practices and ined educational placement rather than eligibility decisions.
pre-referral intervention in an effort to devote appropriate re- School psychologists also viewed themselves as leaders on
sources to target difficulties prior to referral. Thus, updated MDTs (Burns et al. 2014; Huebner and Gould 1991). Thus,
research regarding special education referral concerns is school psychologists’ unique contributions to and perspec-
warranted. tive on the evaluation process could result in MDTs’ heavy
reliance on school psychologists when making special edu-
Special Education Eligibility Decision-making cation eligibility decisions, but research examining this hy-
pothesis is needed.
Under IDEA, multidisciplinary teams (MDTs) are required to
determine eligibility for special education services rather than Assessment Data Sources
individual educators making such high-stakes decisions in an
effort to ensure such decisions are valid and appropriate (P.L. In addition to the requirement that MDTs make eligibility
108–446 § 303.24). However, MDTs were shown to demon- decisions, IDEA also requires that special education evalua-
strate a lack of procedural adherence and systematic decision- tions be multifaceted and comprehensive in nature (P. L. No.
making, potentially undermining the validity of such team- 108–446 § 300.304 [b]). Special education evaluations, there-
based decisions (Ysseldyke et al. 1981). Furthermore, individ- fore, should include collection of multiple assessment data
ual MDT members made inequitable contributions within sources which, in turn, should be considered when
Contemp School Psychol

determining eligibility for special education services. Making special education eligibility, (c) what are the most valuable
high-stakes decisions such as special education eligibility de- sources of assessment data in special education eligibility de-
cisions with one or few assessment data sources may be prob- cisions, and (d) to what extent are there differences in the most
lematic given the error inherent in various measures (NASP common referral concerns, primary eligibility decision-
2020). Thus, MDTs should collect assessment data through makers, and most valued assessment data sources for eligibil-
multiple methods and from multiple sources including class- ity across participants’ years of experience, degree, and geo-
room observations, record reviews, interviews with teachers graphic region?
and families, rating scales, and individually administered stan-
dardized tests, and should triangulate these data when deter-
mining eligibility for special education (Salvia et al. 2012; Method
Shapiro 2010). However, the extent to which MDTs rely on
different sources of assessment data in eligibility decision- This study was conducted as part of a larger project examining
making is largely unknown. school psychologists’ special education identification deci-
The limited research examining MDTs’ use of assessment sion-making.
data sources when making special education eligibility deci-
sions has resulted in somewhat variable findings. Preservice Participants
and inservice school psychologists and special education
teachers reported that classroom observations, language Participants included 461 licensed or certified school psy-
ability assessments, student interviews, and emotional func- chologists who practiced in US schools, regularly made
tioning assessments were the most important assessment special education eligibility decisions, and were members
sources when making special education eligibility decisions of the National Association of School Psychologists
(Knoff 1983). Furthermore, for SLD eligibility determina- (NASP). Of the 461 participants, the majority identified
tion specifically, school psychologists reported that individ- as female (82.40%) and 17.60% identified as male. The
ually administered standardized achievement and cognitive majority of the participants identified as white (86.00%),
tests were the most important assessment data sources 4.80% identified as Latino, 4.30% as Black, 2.20% as
(Ysseldyke 1983). However, these findings are dated espe- Asian/Pacific Islander, 1.50% as two or more races/eth-
cially given the 2004 reauthorization of IDEA which funda- nicities, and 0.70% as Native American/Alaskan Native.
mentally altered how the largest disability category, SLD, Regarding degrees, 60.50% of participants held a special-
may be identified in particular. Furthermore, there is a need ist degree, 24.10% held a doctoral degree, and 15.40%
for research that has examined the use of assessment data held a master’s degree. Approximately 25.60% of partic-
sources within special education eligibility broadly given ipants had been practicing for 5 years or less, 26.00% for
IDEA’s requirement regarding comprehensive evaluations six to 10 years, 19.30% for 11 to 15 years, 15.20% for 16
(P. L. No. 108–446 § 300.304 [b]). to 20 years, and 13.90% for more than 20 years.
Participants represented school psychologists from all 50
Purpose states plus Washington, D.C. and the four NASP regions.
Approximately 26.03% (n = 120) of participants were
Although special education services and eligibility practices from the Central region, 25.16% (n = 116) of participants
have been fairly widely researched, previous research regard- were from the Northeast region, 24.51% (n = 113) of par-
ing special education referral concerns, eligibility decision- ticipants were from the West region, and 24.30% (n =
makers, and use of specific sources of assessment data is lim- 112) of participants were from the Southeast region. The
ited. Because research previously suggested that school psy- participants were demographically and geographically
chologists play a leadership role in special education evalua- representative of school psychologists practicing in the
tion procedures (Burns et al. 2014; Huebner and Gould 1991), USA (Walcott and Hyson 2018).
their perceptions of these issues provide meaningful insight
into special education practices. The purpose of this study, Measure
therefore, was to examine school psychologists’ perceptions
of the most common referral concerns for special education Participants completed a survey examining special education
evaluation, the primary decision-maker(s) in special education evaluation and eligibility practices through a secure, web-
eligibility decisions, and the most valuable source(s) of assess- based server. The survey included 32 total items, all of which
ment data in determining special education eligibility. The were multiple-choice format and included an “other” response
following research questions guided the study: (a) what are option so that participants could input a response not provided
the most common referral concerns for special education eval- by the authors. The survey questions of focus in this study
uation, (b) who are the primary decision-makers regarding examined participants’ responses to survey questions
Contemp School Psychol

regarding the most common referrals for special education Analyses


evaluation, the primary eligibility decision-maker(s) within
their MDTs, and the most valuable source(s) of assessment The first three research questions were analyzed using de-
data for determining special education eligibility. Participants scriptive statistics. The frequency of the most common referral
also provided demographic information regarding gender, concerns (e.g., reading, math, behavior), primary special edu-
race/ethnicity, years of experience, highest degree earned, cation eligibility decision-maker (e.g., school psychologist,
and the state in which they practiced. The multiple-choice special education teacher, MDT as a whole), and most valu-
format of the questions resulted in categorical items; thus, able source(s) of assessment data (e.g., standardized test
we assigned numerical codes (e.g., most common referral scores, progress monitoring data, observations, record re-
concern: 1 = reading, 2 = math, 3 = writing, etc.) to each re- views) in determining special education eligibility were exam-
sponse option within each item for data analyses. ined. The fourth research question was analyzed through chi-
The survey was designed based on similar reviews of spe- square tests to examine differences in the most common re-
cial education identification practices (Benson et al. ferral concerns, primary eligibility decision-makers, and most
2020; Maki and Adams 2019). To further ensure validity of valued assessment data source for eligibility across partici-
data obtained from the survey (Johnson and Morgan 2016), pants’ years of experience, degree, and geographical region.
after initial development of the survey, two experts in special For research question 4, an alpha correction was applied to
education identification reviewed and provided critiques of reduce the likelihood of type I error; thus, the adjusted alpha
the survey. In response to their feedback, we added, deleted, level of .017 was used to determine statistical significance
and revised items to ensure adequate content validity. Internal because three chi-square tests were conducted.
consistency for the measure was σ = 0.89.

Results
Procedures
Results are presented in Table 1. The first research question
The University Institutional Review Board and NASP examined school psychologists’ perceptions of the most com-
Research Committee approved the study. The researchers ob- mon referral concerns for special education evaluation.
tained addresses of 1000 practicing school psychologists (ran- Results indicated that 57.70% (n = 266) of participants report-
domly selected by the NASP Research Committee) working ed that reading was the most common referral for special
with pre-kindergarten through 12th grades from the NASP education evaluation followed by behavior (12.80%; n = 59),
membership database. Participants received a letter with infor- math (10.63%; n = 49), attention (10.20%; n = 47), mental
mation about the study, contact information of the principal health (4.60%; n = 21), and writing (4.12%; n = 19).
investigator, and a hyperlink to access the survey. The second research question examined school psycholo-
Participants entered the study hyperlink into their web gists’ perceptions of the primary decision-maker(s) regarding
browser at which time the server presented information re- special education eligibility. Results showed that 39.50% (n =
garding the study purpose, potential risks and benefits of par- 182) of participants reported that school psychologists along
ticipation, the study’s voluntary nature, and anonymity of re- with some input from other members of the MDT primarily
sponses. If the potential participants agreed to complete the make special education eligibility decisions. Approximately
survey, the server presented the following questions to deter- 31.02% (n = 143) of participants indicated that school psy-
mine participant eligibility: (1) are you a practicing licensed or chologists primarily make special education eligibility deci-
certified school psychologist in the United States and (2) do sions, 29.28% (n = 135) reported that the MDT as a whole
you participate in multidisciplinary teams making special ed- makes the special education eligibility decision, and 0.22%
ucation identification decisions? (n = 1) reported that principals primarily make special educa-
If potential participants responded no to either of these tion eligibility decisions. No participants reported that general
questions, they did not meet study eligibility criteria, the sur- education teachers, special education teachers, parents, or
vey ended, and they were thanked for their time. If participants school counselors were primary special education eligibility
responded yes to both questions, the server directed them to decision-makers.
begin the survey. Given the sample recruited (i.e., practicing The third research question examined school psycholo-
school psychologists), the majority of the participants gists’ perceptions of the most valuable source(s) of assessment
responded yes to both eligibility questions (97.67%). data in determining special education eligibility. The largest
Following survey completion, the server directed the partici- proportion of participants reported that standardized test
pants to a new survey (to ensure anonymity of participant scores were most important (41.43%; n = 191), followed by
responses) where they could provide their email address to progress monitoring data (24.51%; n = 113), record reviews
enter a gift card drawing. (12.58%; n = 58), developmental/educational history (8.50%;
Contemp School Psychol

Table 1 Perceptions of primary referral concerns, eligibility decision-maker, and assessment data

% N Years X2 Degree X2 Region X2

Primary referral concern 100.00 461 18.08 12.45 15.50


Reading 57.70 266
Math 10.63 49
Behavior 12.80 59
Attention 10.20 47
Mental health 4.60 21
Writing 4.12 19
Primary decision-maker 100.00 461 12.36 6.40 10.46
School psychologists w/MDT 39.50 182
School psychologists 31.02 143
MDT 29.28 135
Principal 0.22 1
Assessment data source 100.00 461 48.55* 20.16 19.21
Test scores 41.43 191
Progress monitoring data 24.51 113
Record review 12.58 58
Developmental/educational history 8.50 39
Observation data 5.00 23
Interview 1.30 6
All data 6.72 31

*p < 0.017
Years, years of experience; Degree, highest degree earned; Region, geographic region; MDT, multidisciplinary team

n = 39), observation data (5.00%; n = 23), and interviews Discussion


(1.30%; n = 6). An additional 6.72% (n = 31) of participants
reported that all assessment data were equally important in The purpose of this study was to examine school psycholo-
special education eligibility decisions. gists’ perceptions of the most common referral(s) for special
The fourth research question examined differences in the education evaluation, the primary decision-maker(s) regard-
most common referral concern, primary eligibility decision- ing special education eligibility, the most valued source(s) of
makers, and most valuable assessment data source(s) across assessment data in determining special education eligibility,
participants’ years of experience, degree, and geographic re- and differences in these variables across participants’ years of
gion. There were no statistically significant differences in experience, degree, and geographic region. Examination of
most common referral concerns (X2 = 18.08, p = 0.58) or pri- these variables can inform the field of current practices in
mary eligibility decision-maker (X2 = 12.36, p = 0.42) across and outcomes of special education evaluation and eligibility.
years of experience, but there were statistically significant Understanding such practices and outcomes serves to provide
differences in most valued assessment data source across information regarding the extent to which special education
years of experience (X2 = 48.55, p = 0.011), which resulted evaluation and eligibility procedures align with provisions
in a small effect (Cramer’s V = .16). There were no statistically within federal special education law (i.e., IDEA) and how
significant differences in most common referral concern (X2 = school psychologists use data to make special education eligi-
12.45, p = 0.26), primary eligibility decision-maker (X2 = bility decisions.
6.40, p = 0.38), or most valued assessment data source (X2 =
20.16, p = 0.13) across participants’ degree. Results suggested Special Education Evaluation Referrals
that there were no differences in reported most common refer-
ral concern (X 2 = 15.50, p = 0.42), primary eligibility Prior to evaluating a student for special education services,
decision-maker (X2 = 10.46, p = 0.32), or most valued assess- teachers and/or problem-solving teams must refer the student
ment data source (X2 = 19.21, p = 0.57) across geographic for the evaluation, and the referral concern should guide the
region. evaluation process. Results from this study coincided with
Contemp School Psychol

previous research (Bramlett et al. 2002; Lloyd et al. 1991), and eligibility criteria) coincide with their perception of
suggesting that reading was overwhelmingly the most com- playing a primary role in determining special education eligi-
mon referral for special education evaluation across the USA. bility (Burns et al. 2014). However, such findings may also be
Such findings underscore the notion that reading is a funda- somewhat concerning given the IDEA provision that MDTs
mental skill that permeates students’ overall academic func- should complete special education evaluations (P.L. 108–446
tioning in schools (Murnane et al. 2012). Moreover, given the § 303.24).
relationship between academic and behavior performances in MDTs’ contributions to special education evaluation pro-
schools (Valdez et al. 2011), it is possible that students re- cedures are also important because extraneous factors could
ferred for evaluation due to reading concerns could also have impact eligibility decisions. As human decision-makers, error
difficulties in other academic and behavioral areas. However, is inherent within school psychologists’ decision-making pro-
this hypothesis is in need of further study. cesses (Watkins 2009). Confirmation bias, or the subcon-
The finding that reading was the most commonly reported scious influence of preconceived notions, may impact deci-
referral concern also highlights the importance of early pre- sions regarding eligibility status. Thus, if a teacher reports that
vention and intervention supports in schools (Lembke et al. a student demonstrates academic difficulties, decision-makers
2010; Shapiro 2010). MTSS is commonly implemented in may confirm a priori beliefs by determining the student eligi-
schools (Spectrum K-12 School Solutions 2010) and is a ble for special education services regardless of whether he or
framework for providing academic supports for all students she meets eligibility criteria. When MDTs heavily rely on one
(Burns and Gibbons 2012). MTSS frameworks resulted in team member to determine eligibility, decision-making error
improved student outcomes and fewer referrals for special may represent a more significant threat to eligibility decisions
education (VanDerHeyden et al. 2007) and therefore could than when decisions are made as a team (Watkins 2009).
provide appropriate support to students without special edu- Although school psychologists should contribute their unique
cation service provision. However, some studies have perspective on special education evaluation procedures gener-
questioned the effectiveness of tier 2 intervention (Balu et al. ally and eligibility decisions specifically, ensuring all MDTs’
2015), a fundamental component of providing academic sup- members contribute to eligibility decisions could help to en-
port within MTSS frameworks, while others have demonstrat- sure such decisions are reliable and meaningful. However,
ed considerable effectiveness of tier 2 intervention (Burns additional research is needed to directly examine this
et al. 2005; Burns et al. 2016; Gersten et al. 2009). These hypothesis.
mixed findings could reflect the difficulty of large-scale
M T S S i m p l e m e n t a t i o n (N o e l l an d G a n s l e 2 00 9; Assessment Data Sources
VanDerHeyden et al. 2016), which could also impact referrals
for special education evaluation due to inadequate progress in In addition to the IDEA requirement that special education
intervention. However, if schools implement MTSS frame- evaluations and eligibility decisions be team based (P.L.
works with fidelity, they could reduce the number of special 108–446 § 303.24), evaluations must also be comprehensive
education referrals (VanDerHeyden et al. 2007), which can in nature (P. L. No. 108–446 § 300.304 [b]). That is, evalua-
free up school psychological resources for preventative and tions should be multifaceted and include multiple sources of
responsive intervention services, a significant need in schools assessment data (e.g., record reviews, observations, inter-
(Filter et al. 2013; NASP 2020; Ysseldyke et al. 2008). views, test scores). In this study, across the USA, the largest
percentage of school psychologist participants reported that
Special Education Decision-making test scores were the most important source of assessment data
in determining special education eligibility followed by prog-
Because IDEA explicitly allows for professional judgment in ress monitoring data, record reviews, and developmental/
special education evaluation (Pub. L. No. 108–446 § 300), it is educational history. Few participants (6.70%) reported that
important to understand MDT members’ contributions to eli- all sources of assessment data were equally important in de-
gibility decisions. In this study, the largest proportion of par- termining eligibility. Thus, despite the fact that school psy-
ticipants reported that school psychologists, with some input chologists and MDTs collect multiple sources of assessment
from MDT members, primarily make decisions regarding spe- data during the evaluation process, the results from this study
cial education eligibility in all regions of the USA. Although suggested that assessment data are not weighed equally in
these findings suggested that all MDT members contribute in eligibility determination.
some way to eligibility decisions, it was also evident that Such findings are particularly interesting given the reported
school psychologists play a leadership role in such decision- paradigm shift (Reschly 2008) in school psychological prac-
making. School psychologists’ unique contributions to MDT tice from assessing for within child problems to examining
and evaluation processes (e.g., assessment administration, un- environmental variables within a prevention and intervention
derstanding of psychometric issues underlying assessments framework. The statistically significant differences in
Contemp School Psychol

participants’ perceptions of the most valued assessment data Although school psychologists possess unique knowl-
source across their years of experience could reflect this shift edge and experience relevant to the special education
in practices in the field. However, the findings in this study evaluation process, decision-makers should work as a
may reflect both this paradigm shift and traditional assessment team to determine special education eligibility. Doing so
practices because 24.50% of participants reported progress could serve as a safeguard against potential decision-
monitoring data were the most valuable assessment data making errors (e.g., confirmation bias) that could inappro-
source while even more participants reported test scores were priately impact eligibility decisions (Watkins 2009).
the most valuable assessment data source in eligibility deter- Furthermore, school psychologists and MDTs should en-
mination. These results suggested that even with the wide sure that eligibility decisions are based on comprehensive
implementation of prevention and intervention frameworks, evaluation data in order to understand students’ difficul-
special education evaluation procedures may still largely fol- ties within the environmental context (P. L. No. 108–446
low our traditional notions of identifying student difficulties § 300.304 [b]). This ecological perspective also serves to
and disabilities. However, substantial reliance on test scores more directly tie assessment data to instructional and in-
for eligibility determination can be problematic given the in- tervention decisions than isolated test scores, which have
herent measurement error within all test scores and the psy- been shown to lack treatment validity (Vaughn and Fuchs
chometric issues underlying the application of identification 2006), and assessment data should always inform treat-
criteria to such test scores (Francis et al. 2005). Assessment ment decisions (Cromwell et al. 1975; Salvia et al. 2012).
data should be reliable and valid for specific decision-making
purposes, but special education eligibility decisions have been
shown to be particularly problematic (Allen and Hanchon Limitations and Implications for Future Research
2013; Maki et al. 2017) even though high-stakes decisions
necessitate highly reliable data (Salvia et al. 2012). The findings from this study should be interpreted within
Moreover, reliance on test scores may ignore the ecological the context of its limitations. First, the participants were
context within which a child operates despite the fact that all practicing school psychologists. Although school psy-
environmental variables impact student performance chologists’ perspectives on special education evaluation
(Reschly and Christenson 2012; Shapiro 2010) underscoring procedures are important given their role in the MDT,
the importance of examining all sources of assessment data school psychologists should not operate in isolation but
within a comprehensive evaluation. rather should function as part of the MDT. Thus, the find-
ings in this study are limited to school psychologists’
perspectives rather than MDTs’ perspectives as a whole.
Implications for Practice Future research could examine all MDT members’ per-
spectives on such special education evaluation proce-
The findings in this study hold important implications for dures. Second, the survey questions posed to participants
special education evaluation practices. Most school psychol- in this study were presented as forced choice questions in
ogist participants reported that reading is the most common an effort to understand the most common referral con-
referral for special education evaluation. Despite a significant cerns, primary eligibility decision-makers, and most val-
body of research supporting the effectiveness of many reading ued assessment data sources. Thus, participants were re-
intervention practices (Hall and Burns 2017; Lee and Yoon quired to select one option in response to each question
2017; Scammacca et al. 2015), these findings suggested that a when they may have preferred to select more than one
considerable number of students continue to experience diffi- option. Future research could examine similar research
culty with reading. Thus, school psychologists and other questions to those in this study using alternate question
school personnel should ensure that tiered intervention sup- formats. Third, this study examined school psychologists’
ports are implemented effectively and appropriately because perspectives on overall special education evaluation prac-
doing so has been shown to improve student outcomes and tices, but it is possible that some practices may vary by
reduce the number of students referred for special education disability category. Therefore, any potential differences
evaluation (Burns et al. 2005; Compton et al. 2010; across disability categories are not captured in this study’s
VanDerHeyden et al. 2007). Moreover, schools should ensure findings. Future research could examine school psycholo-
that interventions are evidence based because inappropriate gists’ and MDTs’ perspectives in relation to specific dis-
intervention implementation could impact student progress ability categories. Fourth, although the measure demon-
and thus referral for special education evaluation (Burns and strated adequate internal consistency (σ = 0.89), validity
Ysseldyke 2009). On the other hand, researchers should en- of the measure interpretations is unknown. Thus, future
sure that relevant research findings are adequately disseminat- research could examine the validity of interpretations
ed to practitioners to support implementation. based on such measures.
Contemp School Psychol

Conclusion Burns, M. K., & Gibbons, K. (2012). Implementing response-to-


intervention in elementary and secondary schools (2nd ed.). New
York: Routledge.
The current study provided an important perspective on spe- Burns, M. K., & Ysseldyke, J. E. (2009). Reported prevalence of
cial education referral and evaluation practices. Findings sug- evidence-based instructional practices in special education. The
gested that, at least in part, special education evaluation and Journal of Special Education, 43(1), 3–11. https://doi.org/10.1177/
0022466908315563.
eligibility practices may not fully align with federal special
Burns, M. K., Appleton, J. J., & Stehouwer, J. D. (2005). Meta-analytic
education law because school psychologists reported that they review of responsiveness-to-intervention research: examining field-
primarily make special education eligibility decisions, with bas ed and res earch-implemented mode ls. Jo ur na l of
some input from the MDT, and that they primarily rely on test Psychoeducational Assessment, 23, 381–394.
Burns, M. K., Kanive, R., & Karich, A. C. (2014). Best practices in
scores to determine eligibility. Importantly, school psycholo-
implementing school-based teams within a multitiered system of
gists and MDTs should implement practices that not only support. In A. Thomas & J. Grimes (Eds.), Best practices in school
align with legal requirements but they should also ensure prac- psychology VI (pp. 569–582). Bethesda: National Association of
tices are supported by a strong evidence base and result in School Psychologists.
Burns, M. K., Maki, K. E., Karich, A. C., Hall, M., McComas, J., &
treatment planning and improved outcomes for students. The
Helman, L. (2016). Problem analysis at tier 2: Using data to find
purpose of special education evaluation should not be to mere- the category of the problem. In S. R. Jimerson, M. K. Burns, & A.
ly determine eligibility for services, but rather, evaluation VanDerHeyden (Eds.), Handbook of response to intervention: the
should inform intervention and supports for individual student science and practice of multi-tiered systems of support (2nd ed., pp.
needs. Without the end goal of improving student outcomes, 293–307). New York: Springer.
Compton, D. L., Fuchs, D., Fuchs, L. S., Bouton, B., Gilbert, J. K.,
the utility of special education evaluation is undermined. Barquero, L. A., Cho, E., & Crouch, R. C. (2010). Selecting at-
Therefore, school psychologists and MDTs should ensure that risk readers in first grade for early intervention: eliminating false
evaluation procedures align with evidence-based practices in positives and exploring the promise of a two-stage screening pro-
an effort to promote positive outcomes for students. cess. Journal of Educational Psychology., 102, 327–340.
Cortiella, C., & Horowitz, S. H. (2014). The state of learning disabilities:
facts, trends and emerging issues. New York: National Center for
Compliance with Ethical Standards Learning Disabilities.
Cromwell, R. L., Blashfield, R. K., & Strauss, J. S. (1975). Criteria for
The authors declare that they have no conflict of interest. All procedures classification systems. In N. Hobbs (Ed.), Issues in the classification
were approved by and in accordance with the ethical standards of the of children (pp. 4–25). San Francisco: Jossey-Bass, Inc. Publishers.
University Institutional Review Board and with the 1964 Helsinki decla- Every Student Succeeds Act of 2015, Pub. L. No. 114–95 § 114 Stat.
ration and its later amendments or comparable ethical standards. 1177 (2015).
Informed consent was obtained from all individual participants included Filter, K. J., Ebsen, S. A., & Dibos, R. (2013). School psychology cross-
in the study. roads in America: discrepancies between actual and preferred dis-
crete practices and barriers to preferred practice. International
Journal of Special Education, 28, 88–100.
Francis, D. J., Fletcher, J. M., Stuebing, K. K., Lyon, G. R., Shaywitz, B.
A., & Shaywitz, S. E. (2005). Psychometric approaches to the iden-
References tification of LD: IQ and achievement scores are not sufficient.
Journal of Learning Disabilities, 38(2), 98–108.
Allen, R. A., & Hanchon, T. A. (2013). What can we learn from school- Gersten, R., Compton, D., Connor, C. M., Dimino, J., Santoro, L., Linan-
based emotional disturbance assessment practices? Implications for Thompson, S., & Tilly, W. D. (2009). Assisting students struggling
practice and preparation in school psychology. Psychology in the with reading: response to Intervention and multi-tier intervention
Schools, 50, 290–299. https://doi.org/10.1002/pits.21671. for reading in the primary grades. A practice guide. (NCEE 2009-
Balu, R., Zhu, P., Doolittle, F., Schiller, E., Jenkins, J., & Gersten, R. 4045). Washington, DC: National Center for education evaluation
(2015). Evaluation of response to intervention practices for elemen- and regional assistance, Institute of Education Sciences, U.S.
tary school reading (NCEE 2016–4000). Washington, DC: National Department of Education.
Center for Education Evaluation and Regional Assistance, Institute Hall, M. S., & Burns, M. K. (2017). Meta-analysis of targeted small-
of Education Sciences, U.S. Department of Education. group reading interventions. Journal of School Psychology, 66,
Becker, S. P., Paternite, C. E., & Evans, S. W. (2014). Special educators’ 54–66. https://doi.org/10.1016/j.jsp.2017.11.002.
conceptualizations of emotional disturbance and educational place- Hardman, M. L., & Dawson, S. (2008). The impact of federal public
ment decision making for middle and high school students. School policy on curriculum and instruction for students with disabilities
Mental Health, 6, 163–174. https://doi.org/10.1007/s12310-014- in the general classroom. Preventing School Failure: Alternative
9119-7. Education for Children and Youth, 52(2), 5–11. https://doi.org/10.
3200/PSFL.52.2.5-11.
Benson, N. F., Maki, K. E., Floyd, R. G., Eckert, T. L., Kranzler, J. H., &
Fefer, S. A. (2020). A national survey of school psychologists’ prac- Huebner, E. S., & Gould, K. (1991). Multidisciplinary teams revisited:
tices in identifying specific learning disabilities. School Psychology, current perceptions of school psychologists regarding team func-
35(2), 146–157. https://doi.org/10.1037/spq0000344. tioning. School Psychology Review, 20(3), 428–434.
Individuals with Disabilities Education Improvement Act of 2004, Pub.
Bramlett, R. K., Murphy, J. J., Johnson, J., & Wallingsford, L. (2002).
L. No. 108–446,118Stat. 2647; 2004 Enacted H.R. 1350; 108
Contemporary practices in school psychology: a national survey of
Enacted H.R. 1350. Final regulations implementing IDEA 2004
roles and referral problems. Psychology in the Schools, 39, 327–335.
were published in the Federal Register, Monday, August 14, 2006,
https://doi.org/10.1002/pits.10022.
pp. 46540–46845.
Contemp School Psychol

Johnson, R. L., & Morgan, G. B. (2016). Survey scales: a guide to de- Spectrum K-12 School Solutions. (2010). Response to intervention adop-
velopment, analysis, and reporting. New York: Guilford Press. tion survey. Towson: author.
Knoff, H. M. (1983). Effect of diagnostic information on special educa- Valdez, C. R., Lambert, S. F., & Ialongo, N. S. (2011). Identifying pat-
tion placement decisions. Exceptional Children, 49, 440–443. terns of early risk for mental health and academic problems in ado-
Lee, J., & Yoon, S. Y. (2017). The effects of repeated reading on fluency lescence: a longitudinal study of urban youth. Child Psychiatry and
for students with reading disabilities: a meta-analysis. Journal of Human Development, 42, 521–538. https://doi.org/10.1007/s10578-
Learning Disabilities, 50, 213–224. https://doi.org/10.1177/ 011-0230-9.
0022219415605194. VanDerHeyden, A. M., Witt, J. C., & Gilbertson, D. (2007). A multi-year
Lembke, E. S., McMaster, K. L., & Stecker, P. M. (2010). The prevention evaluation of the effects of a response to intervention (RTI) model
science of reading research within a response-to-intervention model. on identification of children for special education. Journal of School
Psychology in the Schools, 47, 22–35. https://doi.org/10.1002/pits. Psychology, 45, 225–256.
20449. VanDerHeyden, A. M., Burns, M. K., Brown, R., Shinn, M. R., Kukic,
Lloyd, J. L., Kauffman, J. M., Landrum, T. J., & Roe, D. L. (1991). Why S., Gibbons, K., Batsche, G., & Tilly, W. D. (2016). RTI works
do teachers refer pupils for special education? An analysis of referral (when it is implemented correctly). Education Week, 35(15), 25.
records. Exceptionality, 2, 115–126. Vaughn, S., & Fuchs, L. S. (2006). A response to “competing views: a
MacFarlane, J. R., & Kanaya, T. (2009). What does it meant to be autistic: dialogue on response to intervention”: why response to intervention
inter-state variation in special education criteria for autism services. is necessary but not sufficient for identifying students with learning
Journal of Child and Family Studies, 18, 662–669. disabilities. Assessment for Effective Intervention, 32, 58–61.
Maki, K. E., & Adams, S. R. (2019). A current landscape of specific
Walcott, C. M., & Hyson, D. (2018). Results from NASP 2015 member-
learning disability identification: Training, practices, and implica-
ship survey, part one: demographics and employment conditions.
tions. Psychology in the Schools, 56, 18–31. https://doi.org/10.
Bethesda: National Association of School Psychologists.
1002/pits.22179.
Maki, K. E., Floyd, R. G., & Roberson, T. (2015). State learning disabil- Watkins, M. W. (2009). Errors in diagnostic decision making and clinical
ity eligibility criteria: a comprehensive review. School Psychology judgment. In T. B. Gutkin & C. R. Reynolds (Eds.), Handbook of
Quarterly, 30, 457–469. https://doi.org/10.1037/spq0000109. school psychology (4th ed., pp. 210–229). Hoboken: Wiley.
Maki, K. E., Burns, M. K., & Sullivan, A. (2017). Learning disability Ysseldyke, J. E. (1983). Current practices in making psychoeducational
identification consistency: the impact of methodology and student decisions about learning disabled students. Journal of Learning
evaluation data. School Psychology Quarterly, 32(2), 254–267. Disabilities, 16, 226–233. https://doi.org/10.1177/
https://doi.org/10.1037/spq0000165. 002221948301600411.
Murnane, R., Sawhill, I., & Snow, C. (2012). Literacy challenges for the Ysseldyke, J. E., Algozzine, B., & Allen, D. (1981). Participation of
twenty-first century: introducing the issue. The Future of Children, regular education teachers in special education team decision mak-
22, 3–15. ing: a naturalistic investigation. The Elementary School Journal, 82,
National Association of School Psychologists. (2020). The professional 160–165.
standards of the National Association of School Psychologists. Ysseldyke, J., Burns, M., Dawson, P., Kelley, B., Morrison, D., Ortiz, S.,
Bethesda: Author. & Telzrow, C. (2008). The blueprint for training and practice as the
National Center for Education Statistics (2020). Children and youth with basis for best practices. In A. Thomas & J. Grimes (Eds.), Best
disabilities. Retrieved from: https://nces.ed.gov/programs/coe/ practices in school psychology V (pp. 37–69). Bethesda: National
indicator_cgg.asp. Accessed July 2020. Association of School Psychologists.
Noell, G. H., & Gansle, K. A. (2009). Moving from good ideas in edu- Zigmond, N., Kloo, A., & Volonino, V. (2009). What, where, and how?
cational systems change to sustainable program implementation: Special education in the climate of full inclusion. Exceptionality: A
coming to terms with some of the realities. Psychology in the Special Education Journal, 17, 189–204. https://doi.org/10.1080/
Schools, 46, 79–89. https://doi.org/10.1080/1057356050023491. 09362830903231986.
Pfeiffer, S. I., & Hefferman, L. (1984). Improving multidisciplinary team
functions. In C. A. Maher, R. J. Illback, & J. E. Zins (Eds.), Publisher’s Note Springer Nature remains neutral with regard to jurisdic-
Organizational psychology in the schools: a handbook for tional claims in published maps and institutional affiliations.
professionals (pp. 283–301). Springfield: Charles C. Thomas.
Reschly, D. J. (2008). School psychology paradigm shift and beyond. In
A. Thomas & J. Grimes (Eds.), Best practices in school psychology
V, 1 (pp. 3–15). Bethesda: National Association of School Kathrin E. Maki, Ph.D. is an Assistant Professor of School Psychology in
Psychologists. the School of Special Education, School Psychology, and Early
Reschly, A. L., & Christenson, S. L. (2012). Moving from “context mat- Childhood Studies at the University of Florida. Her research centers on
ters” to engaged partnerships with families. Journal of Educational the conceptual, psychometric, and decision-making issues related to
and Psychological Consultation, 22, 62–78. https://doi.org/10.1080/ Specific Learning Disabilities (SLD) identification, and the use of assess-
10474412.2011.649650. ment data to drive academic intervention implementation for students
Salvia, J., Ysseldyke, J., & Bolt, S. (2012). Assessment in special and with SLD and other academic difficulties.
inclusive education. Belmont: Wadsworth.
Scammacca, N. K., Roberts, G., & Vaughn, S. (2015). A meta-analysis of Sarah R. Adams is a doctoral candidate in School Psychology at Ball
interventions for struggling readers in grades 4-12. Journal of State University.
Learning Disabilities, 48, 369–390. https://doi.org/10.1177/
0022219413504995.
Shapiro, E. (2010). Academic skill problems (4th ed.). New York:
Guilford. https://doi.org/10.1016/B978-012343014-4/50026-5.

You might also like