You are on page 1of 16

Goal-Setting Interventions for Students with

Behavior Problems: A Systematic Review

Allison L. Bruhn
University of Iowa

Sara C. McDaniel
The University of Alabama

Josephine Fernando and Leonard Troughton


University of Iowa

ABSTRACT: Students with persistent behavior problems, including those with or at risk for emotional
or behavioral disorders, often struggle to be self-regulated learners. To improve self-regulation skills,
numerous strategies have been suggested, including goal setting. Whereas goal setting has focused
mostly on academic and life skills, behavioral goal setting has received less attention, particularly in
terms of determining best practices for effective goal setting in school-based interventions. Thus,
the purpose of this review was to examine the existing literature on interventions using behavioral
goal setting alone and behavioral goal setting as part of a multicomponent intervention for students
with persistent behavior problems. Findings from 40 studies are discussed in terms of participants,
setting, design, measures, intervention components, and outcomes with a specific focus on
directions for future research and implications for practice.

▪ The term “self-determination” has been 1991). For students with EBD, self-regulation is
used to describe a multitude of behaviors difficult, and thus, many students need targeted
and beliefs that help people live independent, or intensive supports aimed at improving self-
self-directed lives (Wehmeyer & Field, 2007). regulation skills necessary for learning. The
Carter, Lane, Crnobori, Bruhn, and Oakes ability to self-regulate learning involves cogni-
(2011) reviewed the literature on self-determi- tive, metacognitive, and motivational components,
nation interventions aimed at improving this making it a complex process (Arslan, 2014). Speci-
broad group of metacognitive skills for stu- fically, self-regulated learners (a) establish a
dents with and at risk for emotional or behav‐ goal, (b) determine learning strategies that sup-
ioral disorders (EBD). Interventions in their port progress toward that goal, (c) apply useful
strategies, and (d) monitor progress toward the
review focused on a range of skills, including
predetermined goal criteria (Arslan, 2014).
making choices and decisions, problem-solving
Generally, this process is learned over time
activities, goal setting, promoting self-advocacy
with most students developing self-regulation
skills, self-awareness, self-knowledge, self-assess-
skills and applying them in various learning
ment, and self-regulation. The most commonly environments without being taught explicitly.
studied self-determination strategy, according to However, some students, such as those with or
their review, was self-regulation. at risk for EBD, require instruction and interven-
tion on all process elements to acquire or
Self-Regulation improve self-regulated learning skills (Arslan,
2014).
Self-regulation, one element of the broad In the review by Carter et al. (2011), they
domain of self-determination, is often used inter‐ found multicomponent self-management or
changeably with the term “self-management.” It self-regulation interventions often contained
is a metacognitive process that allows people to a goal-setting component. This makes sense
control, manage, or regulate their own behavior given setting and working toward goals is part
by thinking about behaviors and planning of becoming a self-regulated learner (Arslan,
proximal or distal courses of action (Bandura, 2014). Other studies focused on goal setting

Behavioral Disorders, 41 (2), 107–121 February 2016 / 107


alone (Carter et al., 2011). Because the purpose prosocial interactions with peers and adults,
of their review was to report on the self-determi- and decreasing defiant or disrespectful beha-
nation literature base as a whole to identify vior in schools. For instance, understanding
critical gaps and make recommendations for how behavioral goals are set and monitored
future research, the authors did not examine may be important for accurate implementation
specifically the goal-setting studies. For instance, and, in turn, school-based outcomes. Further,
there was no discussion about the goal-setting because goal setting may occur as a stand-alone
process or effective components of goal-setting intervention or as part of a multicomponent
interventions. Rather, Carter and colleagues re- intervention, it is necessary to understand how
commended a more detailed review of individual goal-setting procedures and components vary
self-determination domains (e.g., goal setting, self- by intervention.
advocacy, self-management/regulation) to address
these important intervention issues. Reviews of Purpose
self-management/regulation interventions, such
as self-monitoring and its varying components, To better understand behavioral goal set-
exist (Briesch & Chafouleas, 2009; Bruhn, McDa- ting for K–12 students with persistent behavior
niel, & Kreigh, 2015; Joseph & Eveleigh, 2011); problems, we sought to systematically review
this is not true of behavioral goal setting. the literature in this area. Our goal was to
examine the characteristics of participants and
Goal Setting settings in behavioral goal-setting studies, the
methodology used to examine the effectiveness
Within the goal-setting literature, much of the of behavioral goal setting, and the specific
focus has been on academic goal setting and spec‐ components and procedures of behavioral
ific to learning versus performance goals (Cov- goal setting and their associated outcomes.
ington, 2000). Less is known about interventions The following research questions were used
aimed at developing goal-setting and attainment to guide this systematic review:
skills for prosocial or behavioral improvement.
As Covington (2000) pointed out, prosocial 1. What are the characteristics of the students
and behavioral skills are critical to general per- with persistent behavior problems who
sonal development, positive peer relationships, have participated in behavioral goal-setting
and academic achievement. Setting prosocial studies (e.g., gender, grade, disability, iden-
or behavioral goals is important because meet- tification for participation, locale of school)?
ing these goals can lead to both improved aca- 2. In terms of design and measures, what types
demic and behavioral outcomes (Covington, of experimental designs were used, to what
2000). Given the link between goal setting and extent were treatment fidelity and social
student outcomes, it is important to examine validity reported, and were generalization
best practices in goal setting, particularly as it and maintenance data collected?
relates to behavior as this area has been under- 3. To what extent do stand-alone goal-setting
studied in comparison to academic skills. interventions and multicomponent interven-
Moreover, much of the literature on tions that include goal setting incorporate
goal-setting interventions related to improving the following components: student input
behavior focuses on improving life skills or toward goals; goals based on current levels
risk-related behavior, such as proper nutrition, of performance; and data used to (a) moni-
decreasing drug usage and sexual activity, and tor progress of goals, (b) provide feedback
improving physical activity. Although research- about progress, and (c) graph progress pro-
ers in organizational management and psychol- viding reinforcement for meeting goals? Do
ogy have described monitoring progress toward results indicate the unique contribution of
goals and receiving feedback about progress any of these components for improving the
as critical to goal attainment (Locke, 1996; effectiveness of goal setting?
Locke & Latham, 2002), less is known about
the role of these components in goal-setting
interventions for improving classroom behav‐ Method
ior. There appears to be no established set
of best practices for goal-setting procedures or Article Search and Selection Procedures
components related to behavioral or prosocial
outcomes, such as decreasing disruptive behav‐ We began with two systematic, electronic
ior, increasing time on task, improving searches to obtain recent literature on behav‐

108 / February 2016 Behavioral Disorders, 41 (2), 107–121


ioral goal-setting interventions in school set- procedure to determine inclusion or exclusion
tings. Then, we conducted two hand searches (Carter et al., 2011; Bruhn, McDaniel, & Kreigh,
of three literature reviews. Collectively, we 2015). First, titles and abstracts of all retrieved
based the electronic and hand searches on articles were read to determine if the content
our knowledge of the existing literature base of the article should be read in entirety for inclu-
as well as experience with specific interven- sion. That is, if the title or abstract contained
tions that often include a goal-setting compo- information indicating it may meet inclusion
nent (e.g., Check-in/Check-out [CICO]). criteria, then it was selected to be read. Based
In the first search, which was completed on this, we read 210 articles published prior to
during the summer of 2014, psychology and December 2014 to determine if they merited
educational databases PsycInfo and EBSCO inclusion in this review.
were used with search terms including goal set-
ting, behavior, intervention, student, and school. Inclusion and Exclusion Criteria
The results of this search yielded 308 peer-
reviewed treatment–outcome studies occurring All articles selected to be read in entirety
in K–12 settings. were coded on four questions: (a) Is the article
The second search also involved PsycInfo an intervention study reporting student behav‐
and EBSCO and was completed during the ioral outcomes? (b) Does the study take place
summer of 2014. However, additional search in a K–12 school setting? (c) Does the indepen-
terms included Check-In/Check-Out (CICO); dent variable include a behavioral goal-setting
Behavior Education Program; Check and Con- component for students? (d) Do the participants
nect; and Check, Connect, and Expect. These have documented behavioral problems? If the
search terms were added because the first search answer to all four questions was “yes,” then arti-
yielded several articles on these school-based cles were included. First, articles in which an
behavioral interventions that involve a goal- intervention study was described as experimen-
setting component. However, given the authors’ tal, quasi-experimental, pre-post, or single-sub-
knowledge of this literature base, it was clear ject were included as long as student outcomes
the first electronic search did not capture all or were reported in relation to the intervention.
even most of the studies of these interventions. Systematic literature reviews, meta-analyses,
The second electronic search yielded 39 unpublished dissertations, program evaluations,
articles. and case illustrations were excluded.
The third search, completed in November Second, studies had to take place in a K–12
2014, involved reviewing the reference lists school setting. Settings included general and
from the systematic literature review on self- special education classrooms, alternative schools,
determination interventions for students with and residential facilities as long as school-based
or at risk for EBD by Carter and colleagues academic instruction was occurring at the set-
(2011). Because that review included interven- ting. Studies of participants in preschool, post-
tion studies with goal-setting components, we secondary schools, and home settings were
retrieved electronically all 81 articles reviewed excluded.
by Carter et al. Third, the independent variable had to
Finally, currently published reviews on include behavioral goal setting either as a
Tier 2 interventions (Bruhn, Lane, & Hirsch, stand-alone intervention or as part of a multi-
2014) and CICO (Hawken, Bundock, Kladis, component intervention. Authors had to state
O’Keeffe, & Barrett, 2014) were examined for explicitly that behavioral goals were set as
additional articles that were not found in the first part of the intervention. Examples of behavioral
three searches. Tier 2 reviews were selected goals included students aiming to (a) earn a cer-
over Tier 3 given (a) their overlap in content tain number of points for meeting classroom
found in the electronic searches, and (b) goal behavioral expectations (e.g., be respectful
setting has been recommended for use as and responsible) and (b) demonstrate a specific
a low-intensity, resource-efficient, Tier 2 inter- behavior, such as increased positive interac-
vention (Lane, Menzies, Bruhn, & Crnobori, tions with peers and adults, increased work
2011; McDaniel, Bruhn, & Mitchell, 2015). completion, and decreased disruptive behavior
These reviews yielded 14 additional articles, in class or other school setting. Because our
which we retrieved in December 2014. focus was on students with persistent behavior
Between the four searches, 442 articles problems and our research questions were
were retrieved and underwent a gating about behavioral goal setting, goal-setting

Behavioral Disorders, 41 (2), 107–121 February 2016 / 109


TABLE 1
Coding Components
Coding
Components Coding Details
Participants and setting • Describe the gender, age, disability status, educational setting, school level, and geographic setting
Design and measures • Describe the dependent variable(s), experimental design, treatment integrity, social validity, and
maintenance and generalization probes
Intervention components • What behaviors were the participants setting goals for, and what was the specific goal?
• Did the students provide any input about the goal?
• Is there any evidence the goal was individualized or customized based on the student’s present level
of performance or need?
• What (if any) data were used by participants to measure progress toward the goal?
• Did anyone discuss with the student progress toward the goal and, if so, who?
• Did the student receive reinforcement for meeting the goal? Was progress toward the goal graphed?
• Were there other intervention components besides goal setting, and if so, what were they?
• Was there any maintenance or generalization programming?
Intervention outcomes • Describe participant outcomes
• If this was a single-subject design, did authors discuss a functional relation?
• If yes, was there a functional relation present?
• If this was a group design, was a significant effect found, and if so, what was it? Was an effect size
reported, and if yes, what was it?

interventions focused exclusively on academic in Table 1. Items were selected for coding based
skills, life skills, career goals, nutrition, physical on the information necessary to answer the
fitness, diet, health, sports, drugs, alcohol, and research questions. With regards to the inter-
sexual activity were excluded. vention components, we included questions
Finally, participants had to have documented about progress monitoring, feedback, student
behavioral problems. We included only articles input, and reinforcement because goal theorists
indicating participants (a) had a clinical and researchers have cited these as components
diagnosis typical of EBD per the DSM-IV (Amer- that may be included in goal setting with some
ican Psychiatric Association, 1994) or DSM-V suggesting components such as feedback and
(American Psychiatric Association, 2013) monitoring progress enhance the effectiveness
(e.g., ADHD, conduct disorder), (b) were re‐ of goal setting (Bandura & Cervone, 1983;
ceiving special education services for a Locke, 1996; Locke & Latham, 2002). Addition-
high-incidence disability characterized or ally, in terms of reporting the presence or
accompanied by behavior problems (e.g., absence of a functional relation, we relied
EBD, learning disability, speech impairment),
upon author reports rather than our own inter-
or (c) were screened in (via validated assess-
pretation. This was done for several reasons.
ment tool) or nominated by their teachers due
First, as noted by Kratochwill et al. (2013) in an
to persistent internalizing or externalizing pro-
article describing the What Works Clearinghouse
blems. To narrow the focus of the review and
standards for establishing evidence-based prac-
follow a process similar to the review by Carter
tices using single-subject methodology, there is
et al. (2011), studies of participants with severe
(a) no gold standard for the number of replica-
intellectual or developmental disabilities (e.g.,
autism) were excluded. Of the 210 articles tions required to demonstrate a functional rela-
read for inclusion, 39 articles met all four cri- tion, (b) no agreement about how many data
teria and thus were included in the review. points are required in each phase, and (c) often
One of these 39 articles contained two studies a lack of agreement between readers using
that both met inclusion criteria (Fairbanks, visual analysis (e.g., Barlow, Nock, & Hersen,
Sugai, Guardino, & Lathrop, 2007), leading to 2009; Kazdin, 2011; Johnston & Pennypacker,
the review of 40 total studies. 2009). Thus, because the purpose of this review
was not to apply research standards in an effort
Coding and Training Procedures to establish an evidence-based practice but
rather to describe the practice and methodology
We coded each study on multiple com‐ used to evaluate the intervention, we relied
ponents associated with participants, setting, on the authors’ reporting of results, which
experimental design, measures, intervention, had undergone the scrutiny of the peer-review
and outcomes. Coding questions are provided process.

110 / February 2016 Behavioral Disorders, 41 (2), 107–121


To ensure reliable coding, the first two TABLE 2
authors developed a coding form and discussed Participants and Setting
operational definitions. Then, they indepen-
Number of
dently coded eight studies. They discussed Category Participants
each study by comparing answers on the
Gender
coding forms, resolving any discrepancies, and
Male 800
clarifying any ambiguities. Next, the first author
Female 199
met with the last two authors to explain the
Not reported 360
coding form. These three authors coded four
Number of students with reported
studies independently and then compared cod- disabilities or disorders
ing responses. Once 100% agreement was Emotional/behavioral disorder 83
reached on the four studies, the remaining studies Learning disability 19
were divided evenly among all four authors Other health impairment 36
and coded independently by a combination of Developmentally delayed 1
two of the four authors. Pairs of authors met Speech/language impairment 10
either in person or over the phone to discuss Attention deficit hyperactivity 4
each study. Originally, there were 29 disagree- disorder
ments out of a possible 1,440 independently Multiple disabilities 1
coded items (agreement 5 98%). Authors dis-
cussed all items, including initial disagreements, Category Number of Studies
until 100% agreement was met for every item Most frequent method of identifying
on the coding form. In sum, two authors inde- participants
pendently coded all 40 studies and Office discipline referral 5
authors reached 100% agreement on all coded Teacher nomination 16
items. Screening tool 10
Locale
Urban 10
Results Suburban 9
Rural 6
Results are aggregated across all 40 studies Not reported 15
(from 39 articles) for participants, setting, Level
design, and measures. Then, information about Elementary 22
various intervention components is reported in Middle 5
terms of the type of independent variable eval- High 2
uated in each study (e.g., focused goal setting, All 4
self-management, CICO variations, social prob‐ Not reported 7
lem solving) and associated outcomes. Also, it
should be noted that some studies were coded
in multiple categories and thus, category totals need. For example, McIntosh, Campbell, Car-
may exceed 40 (e.g., treatment integrity ter, and Dickey (2009) stated participants were
reported for some components and mentioned nominated by their classroom teachers based
as a limitation for others). on “their levels of problem behavior and per-
ceived need for support beyond universal
Schoolwide Positive Behavior Support (lack
Participants and Setting
of response to tier one intervention)” (p. 85).
Detailed results on participants and setting Regardless of how students were recruited for
are presented in Table 2. Across studies, there participation, they all exhibited persistent behav‐
were 1,359 participants with the vast majority ior problems (see Inclusion Criteria). Locale
(n 5 800) reported as being male. Of these was not reported in 15 studies, but of those
participants, only 146 were reported as having reporting locale, 10 studies occurred in urban
disabilities. The most frequently occurring dis- settings, nine in suburban studies, and six in
ability was EBD (n 5 83). Although some stud‐ rural settings. Twenty-two studies occurred
ies did not include information about how stu- in elementary schools whereas only five
dents were identified for participation, the occurred in middle schools and two in
most frequent method of identification was high schools. Four studies occurred across
teacher nomination (n 5 16 studies). Teacher multiple levels. School level was not
nomination was often described as an observed reported in seven studies.

Behavioral Disorders, 41 (2), 107–121 February 2016 / 111


TABLE 3 Design and Measures antisocial behavior (0.60), social competence
(0.83), spelling (0.88), reading (1.40), writing
Category Number of Studies
(1.71), and math (1.00; Caldarella, Adams,
Treatment integrity
Valentine, & Young, 2009) and 0.01 for anger
Reported 23
control problems, 0.32 for depression, 0.43 for
Mentioned but not reported 4
suicide risk behaviors, 0.15 for self-esteem, 0.45
Mentioned as a limitation 5
for personal control, 0.22 for problem-solving
Not mentioned or reported 10
coping, 0.16 for family distress, 0.67 for family
Social validity
goals met, and 0.59 for family support (Randell,
Reported 27
Eggert, & Pike, 2001).
Not reported 13
The other 22 studies used single-
Maintenance probes
subject methodology with all studies reporting
Yes 13
No 27
improved behavior for participants. In seven of
Generalization probes
these studies, authors explicitly discussed the
Yes 4
presence or absence of a functional relation
No 36
between the intervention and at least one
Group design 18
dependent variable, with six studies demon-
Significant effects reported 17 strating the presence of a functional relation
Effect size reported 6 for at least one participant. Across these six
Single-subject design 22 studies, a functional relation was noted as
Functional relation 7 present for 17 of 19 participants.
discussed by authors A quantitative index (e.g., mean, range) of
Functional relation present 6 treatment integrity (i.e., the extent to which
the intervention was implemented as intended)
Design and Measures was reported in 23 studies. In four studies, treat-
ment integrity was mentioned, but a quantita-
Eighteen studies utilized group-design method‐ tive index was not reported. For example,
ology (e.g., experimental, quasi-experimental, Randell et al. (2001) described the process for
pre-post) with significant, positive effects reported how intervention and control condition ses-
in 17 of these and effect sizes reported in six (see sions were videotaped and assessed for fidelity;
Table 3 for a summary of findings related to however, no fidelity results were reported. In
designs and measures). For example, four stu- another five studies, the lack of treatment integ-
dies of CICO reported effect sizes favoring the rity measurement was described as a limitation
intervention (i.e., in the desirable direction) of the study. Ten studies did not mention nor
across a wide range of dependent variables: report treatment integrity.
direct observation of classroom behaviors, Social validity, which is the perception of the
such as off-task behavior (-0.90; Simonsen, goals, procedures, and outcomes associated with
Myers, & Briere, 2011) and classroom rule the intervention, was reported in 27 studies. Tea-
violations (0.20; Fabiano et al., 2010); cher and student perceptions were assessed via
teacher-completed rating scales on their questionnaires (e.g., Barbrack & Maher, 1984),
perceptions of prosocial behavior (0.42 [partici- peer comparisons (e.g., Mazzotti, Test, & Wood,
pants with escape-maintained behavior] to 2013), and rating scales (e.g., Mong, Johnson, &
0.99 [participants with attention-maintained Mong, 2011). Although the majority of studies
behavior]; McIntosh et al., 2009), problem including a social validity assessment indicated
behavior (0.05 [escape maintained] to 1.04 positive findings, the social validity of CICO
[attention maintained]; McIntosh et al., 2009), varied with some studies indicating low-
academic success (0.37; Fabiano et al., 2010), to-moderate social validity despite significant
academic productivity (0.55; Fabiano et al., improvements in participant behavior (e.g.,
2010), IEP goal improvement (0.69; Fabiano Simonsen et al., 2011) and other studies indicat-
et al., 2010); office discipline referrals (0.19 ing generally favorable perceptions of CICO
[escape maintained] to 0.78 [attention main- (e.g., Todd, Campbell, Meyer, & Horner, 2008).
tained]; McIntosh et al., 2009); and daily Further, in two studies, students indicated greater
progress reports (0.39; Cheney, Flower, & satisfaction with intervention when they were
Templeton, 2008). In two studies of social involved directly in setting goals rather than
problem-solving interventions, effect sizes for having the goals dictated to them by an adult
significant results included teacher ratings of (i.e., Barbrack & Maher, 1984; Maher, 1981).

112 / February 2016 Behavioral Disorders, 41 (2), 107–121


TABLE 4 Number of Studies Including Specified Intervention Components
CICO Self-
Social Problem Variations Management Focused Goal Total
Intervention Components Solving (n 5 7) (n 5 22) (n 5 7) Setting (n 5 4) (N 5 40)
Students provided input about
their goals 3 0 5 4 12
Goals were individualized based
on student performance 2 8 7 3 20
Students received reinforcement
for meeting goals 2 21 5 0 28
Data were used to monitor student
progress 0 22 7 3 32
Progress was discussed with
student 5 22 6 2 35
Data were graphed 0 2 2 1 5

In terms of collecting maintenance and gen- interventions having different levels of adult sup-
eralization probes of behavior, these data were port for setting goals. In the Maher study, students
uncommon. Thirteen studies included mainte- either worked with a counselor to provide input
nance data; only four studies included general- and set goals for themselves, or they were
ization data. One study that stood out involved assigned to a group in which the counselor set
examining the effects of multimedia goal setting goals for them. Goals were associated with pro-
on students’ knowledge of the goal-setting blem behaviors, attendance, compliance, assign-
process and their disruptive behavior. Using ment completion, and relationships with peers
a multiple-baseline across participants design, and teachers. The group of students who were
Mazzotti et al. (2013) found all four participants directly involved in goal setting met significantly
improved their knowledge and behavior during more goals than the students who had the goals
intervention with (a) three of four participants dictated to them. Barbrack and Maher found simi-
maintaining this knowledge and behavior and lar results. In their study, students were assigned to
(b) all participants demonstrating improved one of four counseling groups: (1) students worked
behavior in a generalization setting. with counselors to set goals, (2) students were
informed of goals by the counselor but provided
Independent Variable and Outcomes no input, (3) students had goals set for them but
were not involved nor informed of the goals, or
The components and procedures of the (4) students had no goals. Groups 1 and 2 signifi-
independent variable were highly variable cantly outperformed Groups 3 and 4 in goal
across studies (see Table 4). Some interventions attainment with Group 1 having the highest goal
focused solely on goal setting whereas others attainment scores as well as the most satisfaction
included goal setting as one component of a with the intervention (Barbrack & Maher, 1984).
multicomponent intervention. Of the multicom- For the most part, students set goals based on
ponent interventions, interventions appeared to their current level of performance. In only one
fit into one of three categories: self-management, study was this not the case as it appeared stu-
social problem solving, or some variation of dents set goals but there was no indication goals
CICO. Explanations of these categories are were based on present levels of behavior (Maz-
provided in the following sections. zotti et al., 2013). Across all four studies, students
Focused Goal Setting were not provided reinforcement for meeting
goals. Although data were used to track progress
In these four studies, the primary purpose toward goals in all four studies, only one study
was to evaluate the effects of goal setting on included an additional component of self-
student outcomes (Barbrack & Maher, 1984; Hill graphing progress (Mazzotti et al., 2013). In two
& Brown, 2013; Maher, 1981; Mazzotti et al., studies, it was stated explicitly that data were
2013). In all four studies, some students had input used to track student progress and that an adult
about their goal, and in two studies, some students discussed progress with the students (Barbrack
did not have input about their goal. Specifically, in & Maher, 1984; Mazzotti et al., 2013). Across
studies by Maher (1981) and Barbrack and Maher studies, goal-setting interventions resulted in
(1984), students were assigned to goal-setting functionally related increases in knowledge of

Behavioral Disorders, 41 (2), 107–121 February 2016 / 113


goal-setting procedures and decreases in disrup- met expectations, 2 5 met expectations). Points
tive behavior (Mazzotti et al., 2013), significant received on the daily report card were used as
increases in goal attainment for students with the foundation for goal setting. That is, each
direct input in goal setting (Barbrack & Maher, day, students had a goal of earning a certain
1984; Maher 1981), and significant reductions number of points or percentage of points on
in office discipline referrals (Hill & Brown, 2013). the daily report card. In all 22 studies, the goals
for points (or percentage of points) were set by
Self-Management the adult mentor or CICO coordinator and com-
municated to the students, but students did
Studies of self-management interventions
contained multiple components with a specific not provide input about the behavioral goal.
focus on self-monitoring and self-evaluation In eight of these studies, authors indicated that
(Crum, 2004; Gureasko-Moore, DuPaul, & daily behavior goals were individualized based
White, 2007; Marchant et al., 2007; Martin on a student’s current performance level. For
et al., 2003; McGoey, Prodan, & Condit, example, Hunter et al. (2014) and Simonsen
2007; Moore, Prebble, Robertson, Waetford, et al. (2011) stated students’ daily goals were
& Anderson, 2001; Smith, Young, Nelson, & established by averaging the previous 3 days
West, 1992). Goal setting was included as an of students’ scores on the daily report card.
additional self-management strategy in these Lane, Capizzi, Fisher, and Ennis (2012) stated,
multicomponent interventions. Five of seven “the actual goals established [were] based
studies reported students provided input about on the student’s initial performance levels”
setting behavioral goals (Crum, 2004; Martin (p. 63). In 21 studies, students received reinforce‐
et al., 2003; McGoey et al., 2007; Moore et al., ment, such as praise (e.g., Hawken & Horner,
2001; Smith et al., 1992); in all seven, students’ 2003) or tickets (e.g., Mong et al., 2011) when
goals were based on current performance levels. they met their goals. In all 22 studies, data
Five studies included reinforcement for meeting from the daily report card were used to monitor
goals, and two did not report the use of reinforce‐ student progress toward goals, and that progress
ment (Gureasko-Moore et al., 2007; Moore was discussed with students. Students’ progress
et al., 2001). Across studies, students demon- was graphed in two studies (Lane et al., 2012;
strated improvements in class preparation Simonsen et al., 2011). In terms of outcomes,
(Gureasko-Moore et al., 2007), work comple- a functional relation between CICO (or varia-
tion (Gureasko-Moore et al., 2007; Martin et al., tions) and dependent variables was reported
2003; Smith et al., 1992), on-task behavior by authors in 4 of 15 single-subject studies,
(Crum, 2004; Moore et al., 2001); decreases in indicating increases in daily report card ratings
disruptive (McGoey et al., 2007) and off-task (Campbell & Anderson, 2008; Dart et al.,
behavior (Smith et al., 1992), but authors did 2014; Lane et al., 2012) and academic en‐
not indicate there was a functional relation.
gagement (Campbell, Rodriguez, Anderson, &
Additionally, there were significant increases
Barnes, 2013), and decreases in problem beha-
on Woodcock-Johnson academic achievement
viors such as disruption (Campbell & Anderson,
tests (Martin et al., 2003) and functionally
2008; Campbell et al., 2013). In one single-
related increases in effective communication
subject study, a functional relation was discussed
and peer play (Marchant et al., 2007).
by authors who indicated one could
not be established due to the limitation of the
CICO Variations
design (i.e., AB design; Swoszowski, Jolivette, &
In studies of CICO or some variation Fredrick, 2013). Statistically significant effects
of CICO (e.g., Fabiano et al., 2010; Hunter, were reported for students’ classroom behavior
Chenier, & Gresham, 2014; Swoszowski, (e.g., Fabiano et al., 2010; Simonsen et al.,
McDaniel, Jolivette, & Melius, 2014), at a mini- 2011); daily report cards (e.g., Cheney et al.,
mum, students were involved in checking in 2008; Cheney et al., 2009); scores on the Social
with a mentor at the beginning and end of the Skills Rating System (Gresham & Elliott, 1990;
day and receiving teacher ratings of behavior e.g., Cheney et al., 2008; Cheney et al., 2009),
on a daily report card. The daily report card Teacher Rating Form (Achenbach, 2001; e.g.,
generally consisted of behavioral expectations Cheney et al., 2009), and Behavior Assessment
(e.g., Be Respectful, Be Responsible) with stu- Scale for Children 2 (Reynolds & Kamphaus,
dents rated by their teachers on a scale (e.g., 2004; e.g., McIntosh et al., 2009); academic
0 5 did not meet expectations, 1 5 partially productivity and success (e.g., Fabiano et al.,

114 / February 2016 Behavioral Disorders, 41 (2), 107–121


2010); and office discipline referrals (e.g., Hawken, behavior (Lochman et al., 1993; Randell et al.,
O’Neill, & MacLeod, 2011; McIntosh et al., 2009). 2001). Similarly, in only two studies did stu-
dents receive reinforcement for meeting goals
Social Problem Solving (Amish et al., 1988; Lochman et al., 1989).
Finally, although progress toward meeting
In these seven studies, students partici‐ goals was discussed with students in all seven
pated in small-group interventions that were studies, it was not clear that data were used or
generally led by adults, such as school counse- graphed to monitor student progress in any of
lors, mentors, and teachers (Amish, Gesten, these studies. In addition to the outcomes
Smith, Clark, & Stark, 1988; Caldarella et al., reported above, social problem solving with a
2009; Lochman, Burch, Curry, & Lampron, goal-setting component resulted in significant
1984; Lochman, Coie, Underwood, & Terry, improvements in teacher ratings of student
1993; Lochman, Lampron, Burch, & Curry, 1985; behavior and social competence (Caldarella
Lochman, Lampron, Gemmer, Harris, & Wyckoff, et al., 2009; Lochman et al., 1989), significant
1989; Randell et al., 2001). All interventions decreases in suicide risk and related risk factors
in this group of studies targeted multiple (Randell et al., 2001), and significant decreases
self-determination and social skills but mostly in off-task behavior (Lochman, 1984; Lochman
focused on students solving social problems et al., 1985, 1989). Like the majority of studies
and setting goals to improve their behavior. included in this review, none of these studies
For instance, in a study by Lochman and col- examined the unique effects of individual inter-
leagues (1993) 52 “Black, socially-rejected, vention components on student outcomes.
aggressive or non-aggressive students” (p. 1053)
were randomly assigned to a treatment or con-
trol group. In the treatment group, students
Discussion
received seven, 30-min sessions of social rela- Students with persistent behavior problems,
tionship training during which they (a) talked including those with or at risk for EBD, often lack
about goals for dealing with problem situations the self-regulation skills to be successful learn‐
involving relationships and communication, ers. Given their social and behavioral problems,
and (b) set goals for classroom behaviors. they may need to be taught explicit self-
Results indicated intervention was not effective regulation strategies such as goal setting.
for the whole treatment group, but rather, there Because much of the literature has focused on
were significant reductions in aggression and students setting goals related to academic per-
social rejection as well as improvement in pro- formance or life skills (e.g., obtaining a job),
social behavior for students identified as there was a need to address goal setting in the
aggressive and rejected. In three studies, behavioral domain. Thus, the purpose of this
authors reported that students provided input review was to examine the literature base on
about their behavioral goals (Amish et al., behavioral goal setting for K–12 students ex-
1988; Lochman et al., 1989; Randell et al., hibiting persistent behavior problems. We con-
2001). For example, in the study by Amish et al. ducted systematic electronic and ancestral
(1988), 25 students with severe emotional dis- searches resulting in the inclusion of 40 studies
turbance participated in 15 40-min social prob‐ from 39 articles that were read and
lem-solving lessons in which students dis- coded according to (a) participant and setting
cussed various social problems, set individual characteristics, (b) design and measures, and
goals for solving these problems, thought (c) intervention components and outcomes.
about solutions, and attempted to implement In the following discussion, we report key find-
solutions through a variety of instructional ings, limitations, recommendations for future
activities. Interestingly, in comparison to the research, and implications for practice.
control group, the treatment group learned to Before findings can be interpreted and
generate significantly more solutions to pro- implications for future research and practice
blems; however, these solutions were often can be discussed, it is important to acknowledge
inappropriate or not meaningful. This demon- the limitations of this review. First, although we
strated that although these students acquired conducted two different electronic searches as
the knowledge to set goals and solve problems, well as ancestral searches of three different lit-
their knowledge did not translate to better erature reviews (Bruhn et al., 2014; Carter et al.,
skills. In only two studies did authors indicate 2011; Hawken et al., 2014), we did not hand
goals were individualized based on current search individual journals. Thus, it is possible

Behavioral Disorders, 41 (2), 107–121 February 2016 / 115


we inadvertently missed articles that could screening and discipline referrals, which also
have been included in this review. Addition- rely on teacher perception.
ally, we did not conduct a meta-analysis in Regarding the frequency of studies taking
which studies were analyzed for their overall place in elementary settings, these findings
effect via statistical methods because our main may be due to the limiting inclusion criteria.
goal was to better understand the extent to That is, studies were included only if they
which goal-setting interventions included var- involved behavioral goal setting. Goal-setting
ious components (e.g., student input, graphing, studies at the secondary level, and in particular
reinforcement) and how those components var- high school, may be more focused on transi-
ied by type of intervention (e.g., focused goal tion, career, and life goals given the age and
setting, CICO). Finally, in terms of single-subject immediate future of these students (Carter et al.,
studies, we did not interpret the presence or 2011). Although these goals are important and
absence of a functional relation, but rather, we have the potential to impact student decisions
documented whether the authors discussed this and outcomes, for secondary students who
methodological point. Although we could have have persistent behavior problems, more
provided our own interpretation of graphed research is needed to understand how setting
data, we felt it was important for findings to be behavioral goals can improve classroom behav‐
ior and, in turn, academic outcomes.
interpreted as the authors intended based on
their own reporting of results, as authors often
use different criteria for drawing these conclu- Design and Measures
sions. Thus, we reported only whether authors
In terms of research design, the type of
discussed a functional relation and whether
methodology was almost evenly split between
they stated it was present. A future literature
group and single-subject design. Perhaps the
review could involve evaluating all components
most problematic finding from both types of
of a study according to specific research design
designs was the lack of adequate reporting of
standards (e.g., Gersten et al., 2005; Horner et al., student outcomes. Specifically, Gersten et al.
2005; Kratochwill et al., 2013). (2005), who described the quality indicators
for establishing evidence-based practices using
Key Findings, Limitations, and group experimental and quasi-experimental
Recommendations for Future Research designs, indicated effect size calculations
should accompany inferential statistics. And
Participants and Setting yet, this occurred in only 6 of 18 studies. Simi-
larly, in describing quality indicators for single-
Similar to previous reviews of other self-
subject research, Horner et al. (2005) and
regulation strategies (Briesch & Chafouleas,
Kratochwill et al. (2013) stressed the impor-
2009; Bruhn, McDaniel, & Kreigh, 2015;
tance of using visual analysis to document the
Mooney, Ryan, Uhing, Reid, & Epstein, 2005),
presence of a functional relation between
it was not surprising to find the majority of par-
the independent and dependent variables.
ticipants were male and most studies took But in only seven studies did authors actually
place in elementary settings. However, the discuss this, and in only six did it occur. To
male majority was not quite as pronounced as improve the accuracy of interpreting results,
other reviews (Bruhn, McDaniel, & Kreigh, future researchers should include these indica-
2015). Although this finding is consistent with tors of quality research, particularly because
other research, researchers and practitioners this will help determine whether practices
need to ensure that methods for identifying stu- should be established as evidence based.
dents who need behavioral intervention do not Likewise, measuring treatment integrity is
result in an under-identification of females who an indicator of a high-quality, rigorous study
could benefit from intervention. Specifically, (Bruhn, Hirsch, & Lloyd, 2015; Gersten et al.,
across studies, teacher nomination was the pri- 2005; Horner et al., 2005). Improvement is
mary method for identifying participants. It is needed in documenting treatment integrity as
possible teachers are more likely to nominate a quarter of the studies did not include a
boys for participation. Future research may quantitative measure of intervention integrity.
involve determining if there is any gender bias Again, this finding is similar to previous reviews
within teacher nomination or other tools used of other self-regulation strategies (e.g., Briesch
to identify participants, such as systematic & Chafouleas, 2009; Bruhn, McDaniel, &

116 / February 2016 Behavioral Disorders, 41 (2), 107–121


Kreigh, 2015). Given the growing emphasis on based on the type of intervention (i.e., focused
reporting treatment integrity, we encourage goal setting, self-management, CICO variations,
researchers, journal editors, and peer reviewers and social problem solving). Although all stud‐
to attend to this issue so that valid conclusions ies reported positive outcomes, some outcomes
about intervention effects may be drawn varied with intervention components.
(Bruhn, Hirsch, & Lloyd, 2015; Hagermoser- Specifically, in studies of focused goal set-
Sanetti, Dobey, & Gritter, 2012). ting, students were more likely to attain their
Reporting social validity, on the other goals when they were involved directly in set-
hand, was more common. There is still room to ting those goals (Barbrack & Maher, 1984; Hill
grow, however, as knowing how stakeholders & Brown, 2013; Maher, 1981). In these three
view an intervention’s utility, feasibility, and studies, students also reported strong buy-in to
outcomes has practical and scientific impor- the procedures, which indicates that not only
tance because these views may influence their does allowing students to provide input about
intervention use during a study and thereafter their goals result in positive perceptions about
(Gresham, MacMillan, Beebe-Frankenberger, intervention, but also positive student out-
& Bocian, 2000). Perhaps the most interesting comes. Similar findings were reported in multi-
findings on social validity were about (a) the component studies of self-management in terms
variability of perceptions of CICO and (b) of positive student perception and associated
how student input about behavioral goals outcomes (e.g., McGoey et al., 2007; Moore
impacted students’ satisfaction with goal-setting et al., 2001). These findings are consistent
interventions. Given the positive outcomes asso- with goal-setting theory, which emphasizes
ciated with CICO, determining how to improve that when goals are self-set, people are more
teacher and student buy-in is important for sus- likely to be committed to attaining those goals
tained implementation and improved behavior. (Locke & Latham, 2002). In CICO studies, on
The answer may lie in allowing students to pro- the other hand, adults dictated goals to stu-
vide input about their daily behavior goals as dents. To truly engage students in the metacog-
this has improved student perception in other nitive process of thinking about a goal, setting
goal-setting interventions (e.g., Barbrack & a goal, and trying to achieve that goal, future
Maher, 1984; Maher, 1981). Additionally, con- researchers should examine whether and how
ducting focus groups or surveys with teachers student input about daily behavioral goals
implementing CICO to determine how to within CICO can improve buy-in and out-
improve the intervention and, in turn, social comes. This would be a substantial difference
validity may be an important next step for from current practice but could result in
researchers. more robust behavioral change. Further, this
A final measurement issue is the lack of examination could extend beyond CICO to
generalization and maintenance data as these other multicomponent interventions, such as
data were included in 4 and 13 studies, respec- self-management and social problem solving.
tively. Collecting generalization and mainte- Another component we examined was
nance data may be difficult in applied settings, whether behavioral goals were individualized
such as schools, due to the nature of scheduling based on students’ past or current performance
and other logistical issues. And the costs asso- levels (e.g., setting a goal based on an average
ciated with collecting these measures may be of 3 days of baseline data). About half of the
problematic, particularly when the measures studies included reported some level of individ‐
involve direct observation of student behavior, ualization. Allowing for goal individualization
which can be time- and resource-intensive. based on student performance is a complex
Potential solutions include beginning research issue. First, the type or level of individualiza-
studies earlier in the school year to allow for tion may depend on the type of intervention.
maintenance data to be collected prior to the For instance, in CICO, the daily point goal
school year ending and using generalization may be based on an average of the prior week’s
measures other than direct observation (e.g., performance, which are data regularly col-
teacher-completed behavioral rating scales). lected as part of the intervention (e.g., Hunter
et al., 2014; Simonsen et al., 2011). This individ‐
Independent Variable and Outcomes ualization is important because it may not
make sense for all students receiving CICO to
In the Results section and in Table 4, we start off at a standard goal of 80%, but rather,
report on the various goal-setting components some students may need to start lower than

Behavioral Disorders, 41 (2), 107–121 February 2016 / 117


80% and gradually increase the goal over time included reinforcement. In the CICO and
(e.g., Lane et al., 2012). However, given 15% self-management studies, the researchers and
of a school’s population may require an inter- practitioners likely viewed reinforcement as
vention such as CICO (Hawken, Vincent, & an important intervention component (Bruhn,
Schumann, 2008), individualizing goals within McDaniel, & Kreigh, 2015). However, it is
CICO may pose a practical issue when a large unclear whether these interventions would
number of students are participating. In other have been as effective without the reinforce-
interventions, such as social problem solving, ment component. Future research could
individualizing goals based on previous or cur- involve direct comparisons of goal-setting inter-
rent performance may be more manageable. ventions with and without reinforcement as
That is, in these studies, students received inter- well as identification of students for whom rein-
vention in small group settings with interven- forcement is necessary.
tion often delivered by a counselor. Simply
due to the lower numbers of students receiving Implications for Practice
small group intervention, individualization
may be more feasible. Future research is Although the 40 studies included in
needed to determine the best methods for indi- this review varied across participants, setting,
vidualizing behavioral goals and the practical- design, measures, and intervention components,
ity of doing so in school settings. Additionally, and review procedures were not without limita-
because there were no studies comparing the tions, there are still implications for practice to
effects of individualized goals based on student consider. First, this review indicates most
performance versus generalized goals for research is taking place with boys and
groups of students, this is an avenue for further in elementary settings. Although this does not
exploration. mean females and high schools are not being
Once behavioral goals have been set, stu- assessed or receiving interventions, it is still
dent progress toward goal attainment may be important to note that when schools are charged
tracked. In over three fourths (n 5 32) of stud‐ with delivering supports to all students with
ies, data were used to monitor student progress, behavior problems, they need to ensure females
but data were graphed in only five studies. and high-schoolers do not go unserved. Second,
Further, in 35 studies, progress was discussed selecting interventions should also involve an
with students. These findings are important analysis of social validity. This review has high-
because goal theorists and researchers have lighted a few studies that showed allowing
indicated effective goal attainment requires students to engage fully in the goal-setting pro-
people receive feedback about their progress cess by letting them provide input about the
(Locke & Latham, 2002). Data provide an goal may increase social validity while simulta-
objective way to track progress and a touch- neously improving behavior. Thus, teachers
stone for providing feedback to students. implementing goal-setting interventions should
Although some research in other areas (e.g., consider student input. Finally, the vast majority
undergraduate student performance) has shown of studies reported that data were collected
goal setting plus feedback is more effective than to monitor progress and provide feedback to
goal setting by itself (Bandura & Cervone, 1983; students, which are critical components for
Locke & Latham, 2002), further research in the goal attainment (Locke & Latham, 2002). We
area of behavioral goal setting for K–12 recommend that teachers use data to not only
students is needed to determine the unique individualize goals, but also to monitor student
contribution of progress monitoring, graphing, progress and provide feedback to students
and feedback in improving student behavior about that progress so that, ultimately, they
as no studies examined directly how these achieve their behavioral goals.
individual components affected student
outcomes.
A final component included in 28 REFERENCES
studies was reinforcement for meeting goals. Achenbach, T. A. (2001). Achenbach’s empirical be‐
havioral assessment manual for Teacher Report
Interestingly, the majority of studies including
Form. Burlington, VT: AEBSA.
reinforcement were studies of CICO and American Psychiatric Association. (1994). Diagnostic
self-management, and none of the studies on and statistical manual of mental disorders - Fourth
goal setting alone (i.e., focused goal setting) edition. American Psychiatric Association,
and only two social problem-solving studies Washington, DC.

118 / February 2016 Behavioral Disorders, 41 (2), 107–121


American Psychiatric Association. (2013). Diagnostic *Campbell, A., Rodriguez, B. J., Anderson, C., & Barnes,
and statistical manual of mental disorders - Fifth A. (2013). Effects of a tier 2 intervention on class-
edition. American Psychiatric Association, room disruptive behavior and academic engage-
Washington, DC. ment. Journal of Curriculum and Instruction, 7(1),
*Amish, P. L., Gesten, E. L., Smith, J. K., Clark, H. B., 32–54. doi:10.3776/joci2013.v7n1p32-54
& Stark, C. (1988). Social problem-solving train- Carter, E. W., Lane, K. L., Crnobori, M. E., Bruhn, A. L.,
ing for severely emotionally and behaviorally & Oakes, W. P. (2011). Self-determination inter-
disturbed children. Behavioral Disorders, 13, ventions for students with or at risk for emotional
175–186. and behavioral disorders: Mapping the knowledge
Arslan, S. (2014). An investigation of the relationships base. Behavioral Disorders, 36, 100–116.
between metacognition and self-regulation with *Cheney, D., Flower, A., & Templeton, T. (2008).
structural equation. International Online Journal Applying response to intervention metrics in the
of Educational Sciences, 6, 603–611. doi:10.15345/ social domain for students at risk of developing
iojes.2014.03.009 emotional or behavioral disorders. Journal of
Bandura, A. (1991). Social cognitive theory of self- Special Education, 42, 108–126. doi:10.1177/
regulation. Organizational Behavior and Human 0022466907313349
Decision Processes, 50, 248–281. *Cheney, D., Stage, S., Hawken, L., Lynass, L.,
Bandura, A., & Cervone, D. (1983). Self-evaluative Mielenz, C., & Waugh, M. (2009). A two-year
and self-efficacy mechanisms governing the outcome study of the check, connect, and expect
motivational effects of goal systems. Journal intervention for students at-risk of severe behav‐
of Personality and Social Psychology, 45, ior problems. Journal of Emotional and Behav‐
1017–1028. doi:10.1037/0022-3514.45.5.1017 ioral Disorders, 17, 226–243. doi:10.1177/1063
*Barbrack, C. R., & Maher, C. A. (1984). Effects 426609339186
of involving conduct problem adolescents in
*Crum, C. F. (2004). Using a cognitive-behavioral
the setting of counseling goals. Child & Family
medication strategy to increase on-task behavior
Behavior Therapy, 6(2), 33–43. doi:10.1300/
of a student with a behavior disorder. Interven-
J019v06n02_03
tion in School & Clinic, 39, 305–309. doi:10.1177/
Barlow, D. H., Nock, M. K., & Hersen, M. (2009). Sin-
10534512040390050801
gle-case experimental designs: Strategies for study-
ing behavior change. Boston: Allyn and Bacon. Covington, M. V. (2000). Goal theory, motivation,
and school achievement: An integrative review.
Briesch, A. M., & Chafouleas, S. M. (2009).
Annual Review of Psychology, 51, 171–200.
Review and analysis of literature on self-manage-
doi:10.1146/annurev.psych.51.1.171
ment interventions to promote appropriate class-
room behaviors (1988–2008). School Psychology *Dart, E. H., Furlow, C. M., Collins, T. A., Brewer, E.,
Quarterly, 24, 106–118. doi:10.1037/a0016159 Gresham, F. M., & Chenier, K. H. (2014). Peer-
Bruhn, A. L., Hirsch, S. E., & Lloyd, J. (2015). mediated check-in/check-out for students at-risk
Treatment integrity in school-wide programs: for internalizing disorders. School Psychology
A review of the literature (1993–2012). Journal Quarterly. Advance online publication. doi:10.
of Primary Prevention. Advance online publica- 1037/spq0000092
tion. doi:10.1007/s10935-015-0400-9 *Ennis, R. P., Jolivette, K., Swoszowski, N. C., & John-
Bruhn, A. L., Lane, K. L., & Hirsch, S. E. (2014). son, M. L. (2012). Secondary prevention efforts at
A review of tier 2 interventions conducted within a residential facility for students with emotional
multi-tiered models of prevention evidencing and behavioral disorders: Function-based check-
a primary behavioral plan. Journal of Emotional in, check-out. Residential Treatment for Children
and Behavioral Disorders, 22, 171–189. doi:10. & Youth, 29(2), 79–102. doi:10.10890/0886
1177/1063426613476092 571X.2012.669250
Bruhn, A. L., McDaniel, S., & Kreigh, C. (2015). *Fabiano, G. A., Vujnovic, R. K., Pelham, W. E.,
Self-monitoring interventions for students with Waschbusch, D. A., Massetti, G. M., Pariseau,
behavior problems: A review of current research. M. E., … Volker, M. (2010). Enhancing the
Behavioral Disorders, 40(2), 102–121. effectiveness of special education programming
*Caldarella, P., Adams, M. B., Valentine, S. B., & for children with attention deficit hyperactivity
Young, K. R. (2009). Evaluation of a mentoring disorder using a daily report card. School Psy-
program for elementary school students at chology Review, 39, 219–239.
risk for emotional and behavioral disorders. **Fairbanks, S., Sugai, G., Guardino, D., & Lathrop,
New Horizons in Education, 57(1), 1–16. M. (2007). Response to intervention: Examining
*Campbell, A., & Anderson, C. M. (2008). Enhancing classroom behavior support in second grade.
effects of check-in/check-out with function- Exceptional Children, 73, 288–310. doi:10.1177/
based support. Behavioral Disorders, 33, 233–245. 001440290707300302
*Campbell, A. & Anderson, C. M. (2011). Check-in/ *Filter, K., McKenna, M., Benedict, E. A., Horner, R. H.,
check-out: A systematic evaluation of component Todd, A. W., & Watson, J. (2007). Check in/check
analysis. Journal of Applied Behavior Analysis, 44, out: A post-hoc evaluation of an efficient, Tier 2-
315–326. doi:10.1901/jaba.2011.44-315 level targeted intervention for reducing problem

Behavioral Disorders, 41 (2), 107–121 February 2016 / 119


behaviors in schools. Education and Treatment of Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom,
Children, 30, 69–84. doi:10.1353/etc.2007.0000 S., & Wolery, M. (2005). The use of single-subject
Gersten, R., Fuchs, L. S., Compton, D., Coyne, M., research to identify evidence-based practice in spe-
Greenwood, C., & Innocenti, M. S. (2005). cial education. Exceptional Children, 71, 165–179.
Quality indicators for group experimental and doi:10.1177/001440290507100203
quasi-experimental research in special educa- *Hunter, K. K., Chenier, J. S., & Gresham, F. M. (2014).
tion. Exceptional Children, 60, 294–309. Evaluation of check in/check out for students with
doi:10.1177/001440290507100202 internalizing behavior problems. Journal of Emo-
Gresham, F. M., & Elliott, S. N. (1990). Social Skills tional and Behavioral Disorders, 22(3), 135–148.
Rating System. Circle Pines, MN: American doi:10.1177/1063426613476091
Guidance Service. Johnston, J. M., & Pennypacker, H. S. (2009). Strate-
Gresham, F. M., MacMillan, D. L., Beebe- gies and tactics of behavioral research (3rd ed.).
Frankenberger, M. E., & Bocian, K. M. (2000). New York: Routledge.
Treatment integrity in learning disabilities inter- Joseph, L. M., & Eveleigh, E. L. (2011). A review of
vention research: Do we really know how treat- the effects of self-monitoring on reading perfor-
ments are implemented? Learning Disabilities mance of students with disabilities. The Journal
Research & Practice, 15(4), 198–205. doi:10.1207/ of Special Education, 45, 43–53. doi:
SLDRP1504_4 10.1177/022466909349145
*Gureasko-Moore, S., DuPaul, G. J., & White, G. P. Kazdin, A. E. (2011). Single-case research designs:
(2007). Self-management of classroom prepared- Methods for clinical and applied settings (2nd
ness and homework: Effects on school function- ed.). New York: Oxford University Press.
ing of adolescents with attention deficit Kratochwill, T. R., Hitchcock, J. H., Horner, R. H.,
hyperactivity disorder. School Psychology Review, Levin, J. R., Odom, S. L., Rindskopf, D. M., &
36, 647–664. doi:10.1177/0145445503259387 Shadish, W. R. (2013). Single-case intervention
Hagermoser-Sanetti, L. M., Dobey, L. M., & Gritter, research design standards. Remedial and
K. L. (2012). Treatment integrity of interventions Special Education, 34(1), 26–38. doi:10.1177/
with children in the Journal of Positive Behavior 0741932512452794
Interventions from 1999 to 2009. Journal of *Lane, K. L., Capizzi, A. M., Fisher, M. H., & Ennis,
Positive Behavior Interventions, 14(1), 29–46. doi: R. P. (2012). Secondary prevention efforts at
10.1177/1098300711405853 the middle school level: An application of the
Hawken, L. S., Bundock, K., Kladis, K., O’Keeffe, B., behavior education program. Education and
& Barrett, C. A. (2014). Systematic review of the Treatment of Children, 35, 51–90. doi:10.1353/
check-in, check-out intervention for students at etc.2012.0002
risk for emotional and behavioral disorders. Edu- Lane, K. L., Menzies, H., Bruhn, A. L., & Crnobori, M.
cation and Treatment of Children, 37, 635–658. (2011). Managing challenging behaviors in
doi:10.1353/etc.2014.0030 schools: Research-based strategies that work.
*Hawken, L. S., & Horner, R. H. (2003). Evaluation of a New York: Guilford Press.
targeted intervention within a schoolwide system of *Lochman, J. E., Burch, P. R., Curry, J. F., & Lampron,
behavior support. Journal of Behavioral Education, L. B. (1984). Treatment and generalization
12, 225–240. doi:10.1023/A:1025512411930 effects of cognitive-behavioral and goal-setting
*Hawken, L. S., MacLeod, K. S., & Rawlings, L. interventions with aggressive boys. Journal
(2007). Effects of the Behavior Education Plan of Counseling and Clinical Psychology, 52,
(BEP) on office discipline referrals of elementary 915–916. doi:10.1037/0022-006X.52.5.915
school students. Journal of Positive Behavior *Lochman, J. E., Coie, J. D., Underwood, M. K.,
Interventions, 8, 94–101. doi:10.1177/10983007 & Terry, R. (1993). Effectiveness of a social rela-
070090020601 tions intervention program for aggressive and
*Hawken, L. S., O’Neill, R. E., & MacLeod, K. S. nonaggressive, rejected children. Journal of Con-
(2011). An investigation of the impact of function sulting and Clinical Psychology, 61, 1053–1058.
of problem behavior on effectiveness of the doi:10.1037/0022-006X.61.6.1053
behavior education program (BEP). Education *Lochman, J. E., Lampron, L. B., Burch, P. R., &
and Treatment of Children, 34, 551–574. doi:10. Curry, J. F. (1985). Client characteristics asso-
1353/etc.2011.0031 ciated with behavior change for treated and
Hawken, L. S., Vincent, C. G., & Schumann, J. untreated aggressive boys. Journal of Abnormal
(2008). Response to intervention for social Child Psychology, 13, 527–538.
behavior: Challenges and opportunities. Journal *Lochman, J. E., Lampron, L. B., Gemmer, T. C.,
of Emotional and Behavioral Disorders, 16, Harris, S. R., & Wyckoff, G. M. (1989). Teacher
213–225. doi:10.1177/1063426608316018 consultation and cognitive-behavioral interven-
*Hill, D., & Brown, D. (2013). Supporting inclusion tions with aggressive boys. Psychology in the
of at risk students in secondary school through Schools, 26, 179–188. doi:10.1007/BF00923139
positive behaviour support. International Journal Locke, E. A. (1996). Motivation through conscious
of Inclusive Education, 17, 868–881. doi:10. goal setting. Applied and Preventive Psychology,
1080/13603116.2011.602525 4, 117–124. doi:10.1016/S0962-1849(96)80005-9

120 / February 2016 Behavioral Disorders, 41 (2), 107–121


Locke, E. A., & Latham, G. P. (2002). Building a Reynolds, C. R., & Kamphaus, R. W. (2004). Behavior
practically useful theory of goal setting and task Assessment System for Children (BASC-2)
motivation: A 35 year odyssey. American Psy- (2nd ed.). Bloomington, MN: Pearson Assessments.
chologist, 57, 705–717. doi:/10.1037/0003- *Simonsen, B., Myers, D., & Briere, D. E. (2011).
066X.57.9.705 Comparing a behavioral check-in/check-out
*Maher, C. (1981). Effects of involving conduct prob‐ (CICO) intervention to standard practice in an
lem adolescents in goal setting: An exploratory urban middle school setting using an experimen-
investigation. Psychology in the Schools, 18, tal group design. Journal of Positive Behavior
471–474. doi:10.1002/1520-6807(198110)18:4 Interventions, 13, 31–48. doi:10.1177/1098300
,471::AID-PITS2310180418.3.0.CO;2-2 709359026
*Marchant, M. R., Solano, B. R., Fisher, A. K., *Smith, D. J., Young, K. R., Nelson, J. R., & West, R. P.
Caldarella, P., Young, K. R., & Renshaw, T. L. (1992). The effect of a self-management proce-
(2007). Modifying socially withdrawn behavior: dure on the classroom and academic behavior
A playground intervention for students with inter- of students with mild handicaps. School Psychol-
nalizing behaviors. Psychology in the Schools, ogy Review, 21, 59–72.
44, 779–794. doi:10.1002/pits *Swoszowski, N. C., Jolivette, K., & Fredrick, L. D.
*Martin, J. E., Mithaug, D. E., Cox, P., Peterson, (2013). Addressing the social and academic
L. Y., Van Dycke, J. L., & Cash, M. E. (2003). behavior of a student with emotional and behavi‐
Increasing self-determination: Teaching students oral disorders in an alternative setting. Journal of
to plan, work, evaluate, and adjust. Exceptional Classroom Interaction, 47(2), 28–36.
Children, 69, 431–447. doi:10.1177/0014402 *Swoszowski, N. C., Jolivette, K., Fredrick, L. D., &
90306900403 Heflin, L. J. (2012). Check in/check out: Effects on
*Mazzotti, V. L., Test, D. W., & Wood, C. L (2013). students with emotional and behavioral disorders
Effects of multimedia goal-setting instruction on with attention- or escape-maintained behavior in a
students’ knowledge of the self-determined learn- residential facility. Exceptionality, 20, 163–178.
ing model of instruction and disruptive behavior. *Swoszowski, N. C., McDaniel, S. C., Jolivette, K., &
Journal of Positive Behavior Interventions, 15(2), Melius, P. (2013). The effects of tier II check-in/
90–102. doi:10.1177/1098300712440452 check-out including adaptation for non-respon-
McDaniel, S., Bruhn, A. L., & Mitchell, B. (2015). ders on the off-task behavior of elementary stu-
Tier 2: A framework for identification and inter- dents in a residential setting. Education and
vention. Beyond Behavior, 24(1), 10–17. Treatment of Children, 36, 63–79. doi:10.1353/
*McGoey, K. E., Prodan, T., & Condit, N. (2007). Exam- etc.2013.0024
ining the effects of teacher and self-evaluation of *Todd, A. W., Campbell, A. L., Meyer, G. G., &
disruptive behavior via school-home notes for Horner, R. H. (2008). The effects of a targeted inter-
two young children in kindergarten. Journal of vention to reduce problem behaviors: Elementary
Early and Intensive Behavioral Intervention, 4, school implementation of check in-check out.
365–376. doi:10.1037/h0100349 Journal of Positive Behavior Interventions, 10,
*McIntosh, K., Campbell, A. L., Carter, D. R., & Dickey, 46–55. doi:10.1177/1098300707311369
C. R. (2009). Differential effects of a tier two beha- Wehmeyer, M. L., & Field, S. (2007). Instructional
vior intervention based on function of problem and assessment strategies to promote the
behavior. Journal of Positive Behavior Interventions, self-determination of students with disabilities.
11, 82–93. doi:10.1177/1098300708319127 Thousand Oaks, CA: Corwin Press.
*Mong, M. D., Johnson, K. N., & Mong, K. W. (2011).
Effects of check-in/checkout on behavioral *Articles included in the review
indices and mathematics generalization. Behav‐ **Article contained two studies
ioral Disorders, 36, 225–240.
Mooney, P., Ryan, J. B., Uhing, B. M., Reid, R., &
Epstein, M. H. (2005). A review of self-manage- AUTHORS’ NOTE
ment interventions targeting academic outcomes
for students with emotional and behavioral The authors received financial support through
disorders. Journal of Behavioral Education, 14, the Iowa Measurement Research Foundation.
203–331. doi:10.1007/s10864-005-6298-1
*Moore, D. W., Prebble, S., Robertson, J., Waetford,
Address correspondence to Allison L. Bruhn,
R., & Anderson, A. (2001). Self recording with
goal setting: A self-management programme University of Iowa, Iowa City, IA 52242;
for the classroom. Educational Psychology, 21, E-mail: abruhn@iowa.uiowa.edu.
255–265. doi:10.1080/01443410120065469
*Randell, B. P., Eggert, L. L., & Pike, K. C. (2001).
Immediate post intervention effects of two brief
MANUSCRIPT
youth suicide prevention intervention. Suicide
and Life-Threatening Behavior, 31, 41–61. Initial Acceptance: 12/24/2015
doi:10.1521/suli.31.1.41.21308 Final Acceptance: 01/08/2016

Behavioral Disorders, 41 (2), 107–121 February 2016 / 121


Copyright of Behavioral Disorders is the property of Council for Children with Behavioral
Disorders and its content may not be copied or emailed to multiple sites or posted to a listserv
without the copyright holder's express written permission. However, users may print,
download, or email articles for individual use.

You might also like