You are on page 1of 18

JOURNAL OF APPLIED BEHAVIOR ANALYSIS 2014, 47, 246–263 NUMBER 2 (SUMMER)

AN EVALUATION OF THE GENERALIZATION AND MAINTENANCE


OF FUNCTIONAL COMMUNICATION AND SELF-CONTROL SKILLS
WITH PRESCHOOLERS
KEVIN C. LUCZYNSKI
UNIVERSITY OF NEBRASKA MEDICAL CENTER’S MUNROE-MEYER INSTITUTE

GREGORY P. HANLEY
WESTERN NEW ENGLAND UNIVERSITY

AND

NICOLE M. RODRIGUEZ
UNIVERSITY OF NEBRASKA MEDICAL CENTER’S MUNROE-MEYER INSTITUTE

The preschool life skills (PLS) program (Hanley, Heal, Tiger, & Ingvarsson, 2007; Luczynski &
Hanley, 2013) involves teaching social skills as a means of decreasing and preventing problem
behavior. However, achieving durable outcomes as children transition across educational settings
depend on the generalization and long-term maintenance of those skills. The purpose of this study
was to evaluate procedures for promoting generalization and long-term maintenance of functional
communication and self-control skills for 6 preschool children. When the children’s social skills
decreased across repeated observations during a generalization assessment, we incorporated
modifications to the teaching procedures. However, the effects of the modifications were variable
across skills and children. Satisfactory generalization was observed only after the teacher was
informed of the target skills and teaching strategies. Maintenance of most social skills was observed
3 months after teaching was discontinued. We discuss the importance of improving child and
teacher behavior to promote generalization and maintenance of important social skills.
Key words: delay tolerance, early child care, functional communication, generalization,
maintenance, mand, preschool life skills, prevention, problem behavior, requesting, self-control,
social skills

The National Institute of Child Health and that the increased level of reported problem
Human Development study of early child care behavior for these children persisted through
(2003) identified a positive correlation between sixth grade (Belsky et al., 2007), suggesting
the total amount of time children spent in extended negative outcomes if effective inter-
nonmaternal child care from birth to kindergar- ventions are not developed. Although all the
ten and the frequency of problem behavior such factors that account for the increased likelihood
as aggression and disobedience (based on teacher of problem behavior have not been identified, the
and caregiver reports). A follow-up study showed limited availability of teacher attention, teacher
assistance, and classroom materials may establish
the value of these events and evoke responses that
Portions of this study were conducted in partial have previously produced access to these re-
fulfillment of a PhD in behavior analysis from Western inforcers (Michael, 1993). Of concern is that the
New England University by the first author. We thank Jason
C. Bourret, Amanda M. Karsten, and Rachel H. Thompson most effective responses may take the form of
for their feedback on an earlier version of this manuscript. problem behavior such as hitting, grabbing, and
Address correspondence to Kevin C. Luczynski, Munroe- yelling, thereby increasing the likelihood that this
Meyer Institute, 985450 Nebraska Medical Center, Omaha,
Nebraska 68198 (e-mail: kevin.luczynski@unmc.edu). behavior will occur in the future (Ingvarsson,
doi: 10.1002/jaba.128 Hanley, & Welter, 2009; Luczynski &

246
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 247

Hanley, 2013; McKerchar & Thompson, 2004; not always immediately available in a busy
Reimers et al., 1993). preschool classroom, and these waiting periods
Given the potential for problem behavior in often evoke excessive requesting (Tiger &
preschools and the importance of early interven- Hanley, 2004) or problem behavior (Hanley
tion, Hanley, Heal, Tiger, and Ingvarsson (2007) et al., 2007). In two separate evaluations of the
designed the preschool life skills (PLS) curricu- program, a four-fold and five-fold increase in the
lum, which established classwide procedures to target skills and a 70% and 53% reduction in
help children develop 13 important social skills in problem behavior were observed with children
four key areas (instruction following, functional who attended a university-based (Hanley et al.,
communication, delay tolerance, and friendship 1997) and community-based (Hanley, Fahmie,
skills). The selection of skills was informed by (a) & Heal, in press) preschool, respectively.
the functional communication training literature Despite these positive outcomes, Hanley
on skills that are typically taught to decrease et al. (2007) noted that some children did not
problem behavior (e.g., Durand & Carr, 1991; acquire the functional communication and delay-
Fisher et al., 1993; Hanley, Iwata, & Thompson, tolerance skills and, for some children who
2001; Piazza et al., 1997) and (b) the school- acquired the skills, not all skills were maintained
readiness literature on the types of skills that during follow-up observations. This outcome is
kindergarten teachers believe to be important for problematic because acquisition and mainte-
young children to exhibit (e.g., Lin, Lawrence, nance of social skills are likely related to decreases
& Gorrell, 2003; Rimm-Kaufman, Pianta, & in existing problem behavior and prevention of
Cox, 2000). the development of more severe forms of problem
The PLS program involves arranging events, behavior over time. Another limitation was that
referred to as evocative situations, that frequently Hanley et al. did not compare the effects of the
lead to problem behavior (e.g., momentary PLS program with a separate group of children
unavailability of teacher attention, teacher assis- who did not experience the curriculum. Thus,
tance, and preferred materials) and capitalizing the question remained as to whether the target
on these situations by teaching social skills that skills would have eventually developed from
serve as functional replacements for problem additional exposure to educational opportunities
behavior. The functional communication skills at school, maturation processes assumed to be
include teaching children to request access to associated with physiological developments
events commonly shown to maintain problem (Garon, Bryson, & Smith, 2008), or a combina-
behavior (e.g., adult attention, adult assistance, tion of social interaction and maturation.
and preferred materials). For example, children To address these limitations, Luczynski and
were taught to say “May I have the glue, please?” Hanley (2013) expanded the complexity and
to obtain glue and “Will you help me, please?” number of skills in the functional communica-
to obtain assistance opening the glue. These tion and delay-tolerance units of the PLS and
requests served as functionally equivalent alter- modified features of the teaching format to
natives to problem behavior, such as forcefully increase the likelihood that all children would
grabbing the glue or screaming about the acquire and maintain the skills. First, precursor
difficulty of opening the glue. Next, children responses were taught as one means of increasing
were taught to say “okay” and wait patiently for maintenance of the target vocal requests (Beau-
30 s to 1 min when reinforcers were delayed. lieu, Hanley, & Roberson, 2012). Specifically,
Learning to tolerate delays after the acquisition of children were taught to stop, look at the teacher,
communication responses likely benefits both and raise a hand before or during a target vocal
child and teacher because the requested events are request (e.g., “excuse me”). Second, the class of
248 KEVIN C. LUCZYNSKI et al.

appropriate responses was expanded by teaching might produce better generalization and
children three (instead of one) functionally maintenance.
equivalent vocal requests to access teacher Skinner (1953) noted that generalization is not
attention (“excuse me,” “pardon me,” and the a process that simply occurs after teaching but is
teacher’s name) and two framed requests to access the product of thoughtful programming during
materials (“May I have the [item]?” and “Will you teaching. Stokes and Baer (1977) described a
give me the [item]?”) and assistance (“May I have technology to promote stimulus generalization,
your help?” and “Will you help me?”). Third, which can be described as the occurrence of
children were taught how to tolerate delays to and behavior under stimulus conditions that are not
denials of materials and assistance. Fourth, present during training. Stokes and Osnes (1989)
acquisition of these skills was determined using later defined 12 specific tactics to promote
performance-based criteria instead of the time- generalization in three categories: (a) Make use
based criteria used by Hanley et al. (2007). Fifth, of current functional contingencies by selecting
teaching occurred in a small-group format, rather responses that would likely recruit natural
than a classwide format, with a subset of children consequences and by modifying consequences
whom their classroom teachers had nominated as so that reinforcement is provided for newly
most likely to benefit from improved social skills. acquired responses and withheld for nontarget
The use of performance-based criteria within a responses, (b) teach diversely by using many
small-group format afforded flexibility in the exemplars of stimuli and responses and by
amount of teaching provided for each child and making programmed antecedents and conse-
allowed multiple learning opportunities to be quences less discriminable during teaching, and
arranged within a relatively brief period. Last, the (c) incorporate functional mediators by including
relative advantages of experiencing the teaching common physical and social stimuli during
procedures in addition to the typical preschool teaching and by teaching self-mediated physical
curriculum were evaluated by arranging a and verbal responses.
matched control group of children who did not The PLS program described by Hanley et al.
experience the PLS program. The teaching (2007) incorporated several of the tactics
enhancements were successful. All six children described above to promote stimulus generaliza-
in the treatment group acquired and maintained tion: (a) Responses that were likely to recruit
all of the skills, and problem behavior was nearly natural reinforcing consequences from teachers
eliminated. By contrast, the six children in the were selected (“excuse me,” “Will you help me,
control group showed no skill acquisition, and please?,” and “May I have the [item], please?”);
their problem behavior worsened over the same (b) teaching was carried out by multiple adults
period. and peers, across the entire school day, and during
Complete acquisition and short-term mainte- multiple activities to increase the diversity of
nance of the social skills, as shown in Luczynski stimulus exemplars; and (c) physical (classroom
and Hanley (2013), are necessary, but not materials) and social (peers) stimuli were incor-
sufficient, to develop a prevention curriculum. porated into teaching situations. These tactics
Before larger scaled, randomized evaluations of may have increased the likelihood of observing
the PLS program are conducted, it seems prudent generalization of the target skills, but their effects
to identify the extent to which acquired skills remain unknown because generalization assess-
generalize to new classrooms and teachers, and ments were not conducted.
whether they continue to occur across extended In addition to incorporating generalization
periods of time (e.g., summer break). If they do tactics similar to those arranged in Hanley et al.
not, it is important to examine the factors that (2007), Luczynski and Hanley (2013) included
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 249

several additional tactics. With respect to the Participants were six typically developing
establishment of a functional communication children from two different-aged classrooms
repertoire, precursor responses and multiple vocal who attended an inclusive, nonprofit preschool
requests were taught. Moreover, the communi- that served low-income families. The lead
cation and self-control skills were taught across teachers were given a questionnaire in which
more than 100 different art, manipulative, and they were asked to list the children in their
craft materials. The self-control skills also were classroom for whom they had concerns regarding
taught following a variety of teacher cues that problem behavior and who could benefit from
signaled delayed and denied access to these acquiring the social skills we were targeting. Next,
reinforcers (e.g., “wait, please” and “This item is they were asked to rank the children in order from
not available”). Finally, teaching in a context with most concerning to least concerning. At the
several classroom peers and activity-based mate- beginning of this study, the mean age of the three
rials allowed common social and physical stimuli older children in Classroom A was 5.0 years
from the children’s preschool classroom (and (range, 4.9 years to 5.1 years); the mean age of
likely future classrooms) to be arranged. the three younger children in Classroom B was
Luczynski and Hanley (2013) conducted a 3.9 years (range, 3.7 years to 4.2 years).
systematic replication of the acquisition and
short-term maintenance of the functional com- Setting and Materials
munication and self-control skills taught by Teaching sessions conducted by the experi-
Hanley et al. (2007). By extension, one purpose menter took place in a corner area of the
of the current study was to evaluate the extent to children’s classrooms. Generalization and main-
which tactics that were programmed during the tenance sessions conducted by the teachers
children’s acquisition of the social skills would occurred in the corner area of each teacher’s
promote generalization of the skills to activities classroom. The area in each classroom was 3 m by
that were conducted by unfamiliar teachers in 2 m and contained child-sized chairs and a table
unfamiliar classrooms and maintenance of the typically used for small-group activities. The
skills over a 3-month period. A second purpose experimenters provided the materials used in all
was to evaluate the degree to which informing activities, which included a variety of craft (e.g.,
teachers of the instructional procedures and collages, Popsicle stick houses, cotton ball snow-
target social skills would affect generalization and men), manipulative (e.g., Playdoh, Lincoln
maintenance outcomes. Logs), and fine-motor (e.g., glitter glue, markers)
materials.
METHOD Dependent Measures and Interobserver Agreement
Participants The dependent measures were identical to
Six children participated in this study, all of those reported in Luczynski and Hanley (2013)
whom were members of the test group in and included social skills and problem behaviors
Luczynski and Hanley’s (2013) evaluation. (see Table 1 for definitions). During each session,
Because these children had recently acquired two evocative situations were arranged to test for
the target skills, their participation in the current each of the target social skills (i.e., appropriate
study provided an opportunity to assess proce- requesting, waiting for requests, and accepting
dures to promote generalization and maintenance denials of requests). For one type of evocative
of these skills. Seven days elapsed between situation, activity-related items were presented on
the children’s participation in Luczynski and the table but out of the children’s reach, which
Hanley’s study and the current study. established the value of access to attention,
250 KEVIN C. LUCZYNSKI et al.

Table 1
Operational Definitions of Targeted Social Skills and Problem Behavior

Dependent measures Operational definition


Skill 1: requests for attention
Stopping (precursor behavior) Hands not engaging with activity-related material prior to or simultaneously with a target vocal
request.
Looking (precursor behavior) Head and eyes directed toward teacher prior to or simultaneously with a target vocal request.
Hand raise (precursor behavior) Hand raised equal to or above head prior to or simultaneously with a target vocal request.
Vocal requests Saying, “excuse me,” “pardon me,” or teacher’s name using appropriate tone, volume, and
tempo.
Waiting for teacher attention The absence of additional requests for attention until a non-vocal response (e.g., teacher turns
toward child), vocal response (e.g., teacher says “yes”), or both responses occur.
Skill 2: framed requests for
materials and assistance
Vocal framed requests Saying “May I have the [item]?” or “Will you give me the [item]?” using appropriate tone,
volume, and tempo to access material on the table. Saying “May I have your help?” or “Will
you help me?” to access assistance from the teacher.
Skill 3: delay and denial tolerance
Delay and denial acknowledgment Saying “okay” using appropriate tone, volume, and tempo following a teacher’s signal.
Waiting The absence of additional requests and problem behavior with or without returning to engage
with activity-related materials.
Mediating responsea Saying “When I wait quietly, I get what I want” following the request for attention and framed
requests for materials and assistance skills and then returning to the activity after three
repetitions.
Problem behavior Hitting, pinching, grabbing, slapping, scratching, throwing things toward the teacher within 6
inches, yelling or screaming, and rudeness to access teacher attention, teacher assistance and
materials, and following delays to and denials of those events.
a
The response taught during the informed teaching condition. Most of the text is reprinted from Luczynski and Hanley
(2013) because the same dependent measures were used.

assistance, and materials. For another type of performance from these recordings at a later
evocative situation, delays to and denials of time.
materials and assistance were arranged. Each A second, independent data collector scored
evocative situation represented one trial during target responses during 42% of teaching sessions,
which observers scored the occurrence of the 33% of generalization sessions, 32% of the
social skills or problem behavior. Only indepen- maintenance sessions. An agreement was defined
dent occurrences of the target skills were scored as scoring the same response across all measure-
and reported. If problem behavior and a social ment categories during each evocative situation
skill occurred during the same trial, only problem (i.e., trial-by-trial agreement). Interobserver agree-
behavior was scored. Therefore, these categories ment was calculated by dividing the number of
were mutually exclusive for each evocative agreements by the number of agreements plus
situation. The proportion of trials for each disagreements and converting the result to a
evocative situation in which the target social skill percentage across all children’s performance within
and problem behavior occurred were depicted a session. Mean agreements across trials averaged
graphically. Because the experimenters and data 85% (session range, 65% to 100%) for Skill
collectors were associated with skill acquisition, 1, 90% (session range, 56% to 100%) for Skill 2,
they were not present during any generalization 84% (session range, 70% to 100%) for Skill 3,
and maintenance sessions. We used a hard-drive and 90% (session range, 71% to 100%) for
camcorder on a tripod to record generalization problem behavior. With the exception of seven
and maintenance sessions and scored children’s sessions, the agreement measures were above 80%.
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 251

Procedure were provided. When every child exhibited the


Teaching. The evocative situations and teach- skills on 85% or more of the trials across three
ing procedures replicated those described during nonconsecutive sessions, the teaching condition
the Teach Skill 3 condition in Luczynski and was discontinued.
Hanley (2013), in which the experimenter taught Generalization (preinformed teaching). Five
three social skills to the children in a small-group teachers from the child care center conducted
format. Activity-related items were periodically activities with the children during the generaliza-
presented near the middle of the table, just out of tion assessments. Three teachers rotated across
the children’s reach. Item presentations typically sessions for each group of children. Two teachers
continued until each child emitted a response to conducted sessions exclusively with the children
access attention and materials or assistance on from Classroom A, another two teachers con-
eight occasions. Sessions that ended with fewer ducted sessions exclusively with the children from
than eight trials for a child occurred when three Classroom B, and a fifth teacher conducted
presentations of different items occurred during a sessions with both groups of children. The
1-min period and the statement, “Please remem- teachers had an extensive history as lead teachers
ber that you should use all materials to complete in the child care center (M ¼ 16 years; range, 5 to
the activity,” did not evoke additional responses. 22), and their experience varied with respect to
The presentation of materials served as an the age of the children they supervised (M ¼ 5.2
evocative situation (hereafter described as trials) years old; range, 3.5 to 6.5). Generalization
for attention because it was necessary to obtain a teachers had not previously supervised or taught
teacher’s attention to gain access to materials or the children in this study, which removed the
assistance. During two of the eight trials, delivery possibility that the children’s performance could
of the item or assistance was delayed, and in be influenced by a prior history of interaction
another two trials, delivery of either event was with the generalization teachers.
denied; for the remaining four trials, materials or On the days on which generalization sessions
assistance was delivered immediately. The order were conducted, the experimenter and data
for the types of trials in each session was collectors associated with teaching were not
randomized. In a given activity, each child’s seen by the children so that any stimulus control
behavior was observed during eight evocative exerted by their presence would not influence the
trials for attention, eight evocative trials for children’s performance. A minimum of 24 hr
assistance or materials, two trials in which the separated all generalization sessions. Children
reinforcer was delayed, and two trials in which the never experienced the same teacher and activity in
reinforcer was denied (i.e., 20 total trials). consecutive sessions; the teachers and materials
During a trial, descriptive praise was provided rotated in a counterbalanced manner across
if the child emitted a correct skill. Following an sessions.
incorrect skill, the experimenter described, Before each session, the experimenter de-
modeled, or role-played the skill or used any scribed the activity (e.g., making snowmen) and
combination of these strategies, with an emphasis showed the available materials (e.g., glitter glue,
on the skill components executed in error. If cotton balls, and buttons) to the teacher and
another incorrect response occurred during a answered any questions. The teacher was asked to
role-play, the experimenter used gentle hand- conduct the activity in a way that was most
over-hand guidance, additional vocal prompts comfortable to her and to interact with the
(e.g., “Say, ‘excuse me’ ”), or both until a correct children as she typically did during group-based
response was emitted. After the prompted skill activities in her own classroom, with two
was emitted, descriptive praise and the reinforcer exceptions: the teacher was asked (a) to present
252 KEVIN C. LUCZYNSKI et al.

materials on the table in front of her rather than were markedly different from the formats
distribute them to each child at the beginning of arranged by the experimenter during previous
an activity and (b) to delay and deny the delivery teaching conditions, which involved presenta-
of several items to each child throughout the tions of one or two similar items at a time (e.g.,
activity. Two guidelines for concluding an activity one or two tubes of finger paint). To address this
also were provided: (a) The activity should last discrepancy and prepare the children to respond
between 15 min and 45 min, and (b) each child effectively under these situations, three presenta-
should be allowed to create an activity-related tion formats alternated in a counterbalanced
product. In contrast to sessions during the order across sessions, which, in a given session,
teaching condition conducted by the experi- involved the presentation of one or two items
menter, the evocative situations were not periodically, several (three or more) similar and
arranged systematically, which resulted in a dissimilar items periodically, or all the items at
varying number of trials for each child across once.
sessions. It is important to note that the teachers When the children correctly exhibited requests
were not told about the social skills and the for attention, materials, and assistance, the
teaching procedures, and they were not told to generalization teachers occasionally did not
provide any particular prompts or differential respond (unsignaled denial) or responded to
consequences for the children’s responses. the child after a delay (approximately 5 s to 30 s;
Informed teaching. The children returned to unsignaled delay). By contrast, during previous
the location where the experimenter conducted teaching conditions, the experimenter immedi-
activities, and modifications were made to the ately (a) attended to the child or provided the
arrangement of evocative situations and aspects of materials or assistance or (b) provided a delay or
the teaching procedures based on observations of denial cue. Two teaching modifications were
generalization (preinformed teaching) sessions. introduced, and an additional response was
Specifically, an experimenter observed recorded taught to the children to prepare them for the
sessions and took notes on the teachers’ and intermittent occurrence of unsignaled delays and
children’s behavior to identify differences be- denials in the generalization tests. Contingencies
tween the teacher’s behavior during generaliza- were arranged so that a minimum of 5 s elapsed
tion sessions and the experimenter’s behavior without any change in the experimenter’s
during the previous teaching condition. The behavior following a correct skill; these un-
experimenter observed differences in (a) how the signaled delays varied from 5 s to 30 s. After one
materials were presented throughout activities; occurrence of a correct response for teacher
(b) the occurrence of unsignaled delays and attention and a correct response for access to
denials after correct requests for attention, materials or assistance per activity, an unsignaled
materials, and assistance; and (c) the form of denial was programmed. It should be noted that
cues used to signal a delay to and denial of signaled delay and denial trials were still
materials and assistance. A comparison of the programmed for two trials per session. We also
observations and corresponding modifications to taught the children a mediating response (three
the teaching procedures is shown in Table 2. repetitions of the vocal utterance, “When I wait
Generalization teachers presented several sim- quietly, I get what I want,” and then return to the
ilar and dissimilar items at a time (e.g., several activity) to facilitate tolerance during unsignaled
tubes of finger paint, foam stamps, and water- delays and denials (a similar response was taught
colors) and sometimes presented all the items for by Hanley et al., 2007). In sessions that followed
an activity at once in the middle of the table. acquisition of the mediating response, the
These formats produced evocative situations that experimenter prompted the children to repeat
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 253

Table 2
Comparison of the Differences in Procedures During Teaching and Informed Teaching

Teaching Informed teaching


Type of item presentations
One or two similar items One or two similar items
Several (three or more) similar and dissimilar items
All items
Consequences following correct requests
Short latencies ( 2 s) to attention, materials, Minimum latency of 5 s to attention, materials, and assistance
and assistance and delay and denial cues
Short latencies ( 2 s) to delay and denial cues Longer latency (5 s to 45 s) to delay and denial cues
One unsignaled trial of withholding of attention and material
or assistance (extinction)
Taught a mediating response
Cues for delaying and denying materials and assistance
Clear vocal cues for signaling delays and denials Interspersed clear and vague vocal cues for delays and denials
Clear nonvocal cues for signaling delays and denials Interspersed clear and vague nonvocal cues for delays and denials
Eye contact when delivering cues Interspersed cues with and without eye contact

the vocal response at a progressively lower volume that this assessment took place after completion
until the response was no longer audible. of the informed teaching condition. The same
The vocal and nonvocal cues used by five teachers participated. This assessment was
generalization teachers differed notably from used to evaluate whether the teaching modifica-
those used by the experimenter during previous tions would improve generalization outcomes.
teaching conditions. The cues used by teachers to Generalization plus teaching. A sixth, new,
signal delays and denials took the form of (a) unfamiliar teacher conducted the activities
vague vocal cues such as “I don’t know,” “We’ll during this assessment and subsequent assess-
see,” “Give me a moment,” and “Let me think ments. The classroom areas, types of materials,
about it”; and (b) vague nonvocal cues such as and general guidelines for conducting activities
shaking their heads and waving their hands. In were the same as in the two previous generaliza-
addition, both types of cues were occasionally tion assessments. The difference was that an
delivered without looking at the child. Although experimenter gave the teacher details regarding
the children had learned how to respond to the children’s target skills and teaching proce-
several different vocal cues correctly, including dures. The experimenter explained the proce-
“in a little bit,” “wait, please,” “It’s not available,” dures and modeled behaviors using the following
and “no,” these cues remained consistent and script:
were delivered while the experimenter looked
at the child. To address these discrepancies, the We taught children how to request a
experimenter interspersed clear as well as vague teacher’s attention by stopping what they
vocal and nonvocal cues that were similar to the are doing [experimenter modeled his mo-
tionless hand on the table], looking at the
forms used by teachers during the initial
teacher [experimenter modeled directing his
generalization assessment. When every child head and eyes toward the teacher], raising
exhibited the skills on 85% or more of the trials their hands at or above head level [experi-
across five nonconsecutive sessions, the teaching menter modeled both responses], saying
condition was discontinued. “excuse me,” “pardon me,” or the teacher’s
Generalization (postinformed teaching). The name, and then waiting for the teacher to
procedures were the same as described for respond by remaining silent [experimenter
generalization (preinformed teaching), except modeled a vocal response and correct
254 KEVIN C. LUCZYNSKI et al.

waiting]. After they gained a teacher’s Feedback on implementation of the teaching


attention, they learned to say “May I have tactics was provided once before the second
the [item]?” and “Will you give me the session after an experimenter informally observed
[item]?” to request activity-related material the first session from the recorded video. The
and to say “May I have your help?” and “Will feedback from the experimenter took approxi-
you help me?” to request assistance. A correct
mately 5 min and included reminders that (a) the
request for attention, materials, and assis-
tance should occur without problem behav- children were taught how to wait for a response
ior such as grabbing, hitting, yelling, or from the teacher following a request for attention,
rudeness. When materials and assistance (b) when role playing with the children, it is
were delayed and denied during an activity important to reenact the situation in which
by a teacher, they learned to say “okay” and the error occurred, and (c) the materials can be
return to the activity without engaging in presented in a way that is most natural to the
additional requests. teacher, but the distance of the materials from
If a child does not exhibit the correct each child should be approximately the same.
skills at any point throughout the Long-term maintenance. Our maintenance
activity, please prompt the child to assessment determined the extent to which the
engage in the skill by saying, for social skills and problem behavior occurred
instance, “When you want a teacher’s 3 months after the generalization assessment
attention, make sure you look at them was completed. The teacher who participated in
with your eyes”; you may model the the generalization plus teaching assessment also
correct response by turning your head conducted activities in this assessment. However,
and looking at the child, and you may the teacher was asked not to implement the
role-play the skill by saying, “Let’s teaching procedures and, instead, provide atten-
practice, when you want a teacher’s tion, assistance, and materials contingent on any
attention, stop what you are doing, raise response (i.e., problem behavior, the target skills,
your hand, look at the teacher, say or some other form) that occurred during the
‘excuse me,’ ‘pardon me,’ or my name evocative situations. This was done to assess
and wait quietly,” followed by the child maintenance of the social skills in the extended
practicing the skill with you. When a absence of the teaching procedures. If a target
child correctly requests your attention, skill occurred, the teacher was asked to provide
materials for the activity, your assistance, descriptive praise. The contingencies matched
or appropriately responds when materi- those arranged in the preteaching baseline and
als are delayed or denied, please provide short-term maintenance assessments in Luczyn-
descriptive praise such as, “Nice job ski and Hanley (2013).
stopping, looking, raising your hand, During the 3-month period before this
saying ‘excuse me,’ and waiting silently.” maintenance assessment, the teachers in the
Use of the teaching strategies is flexible children’s classrooms were not informed of the
such that you could use them singly, teaching procedures and target social skills;
collectively, or in a combination as you therefore, it is unlikely that the children
see appropriate. Let’s practice the teach- experienced the teaching procedures during this
ing strategies for each skill. period. One child from each classroom (Joy and
Tex) could not participate in this assessment
After role-playing the teaching strategies for because they transferred to a different school.
each skill (which took approximately 5 min), the Maintenance plus teaching. After the long-
teacher was asked if she had any questions. term maintenance assessment, the experimenter
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 255

provided the same instructions to the teacher as throughout the generalization (preinformed
described in generalization plus teaching. Feed- teaching) assessment.
back after the first session was not provided During informed teaching, all six children
because, based on informal observations from exhibited the skills at variable but high levels,
the recorded video, implementation of the indicating that they learned to engage in the skills
teaching strategies was accurate. This condition under more challenging teaching conditions.
was conducted to determine how rapidly the During generalization (postinformed teaching),
children’s use of the social skills could be we observed immediate decreases in Skill 1 for
reestablished when the teaching procedures Iggy, Tex, Joy, and Brit (Figures 1 and 2);
were reimplemented. however, we observed elevated but variable
responding with Abe and Len (Figure 3). Taken
Design together, the data represent a slight improvement
A reversal design between generalization in generalization with two children for Skill 1.
assessments and teaching conditions was used Marked improvements in generalization for Skill
to evaluate within-subject control over changes in 2 were evident for Iggy, Joy, and Abe compared to
children’s performance. A multiple baseline generalization (preinformed teaching), in that
design across classrooms was used to determine their requests were near or above 80% across the
the effect of the procedures that were arranged later sessions of this phase. Len showed the same
during generalization plus teaching and mainte- high level of Skill 2 as in the first generalization
nance plus teaching on children’s performance. assessment; however, Tex and Brit did not show a
similar degree of improvement for Skill 2. All
children exhibited low or highly variable levels of
RESULTS
Skill 3 in the second generalization assessment. In
The performances of similarly ranked children summary, modest improvements in generaliza-
in Classrooms A and B are depicted as pairs in tion were observed for Skills 1 and 2 with several
Figures 1, 2, and 3 (i.e., pairs of first-, second-, children during the generalization assessment
and third-ranked children), with each skill that followed informed teaching.
depicted in a separate panel. The pair of children During generalization plus teaching, each
in Figure 1 exhibited high levels of all the social child’s performance improved. Four of the six
skills during the initial teaching condition. children exhibited Skill 1 in nearly 85% of trials
Generalization (preinformed teaching) was then across sessions. Iggy and Tex showed improve-
conducted, during which a decrease to near 50% ment but to a lesser degree, with Skill 1 occurring
was quickly observed for requests for attention in approximately 50% of trials across sessions. All
(Skill 1; top row for each child) and delay and children exhibited Skills 2 and 3 at moderate to
denial tolerance (Skill 3; bottom row for each high levels across the last two or three sessions.
child). A decreasing trend also was evident after During the maintenance assessment, three of
several sessions for framed requests for materials the four children engaged in Skill 1 for more than
and assistance (Skill 2; middle row for each child). 50% of the trials, which was similar to or slightly
We observed low levels of Skills 1 and 3, as well as lower than their performance during generaliza-
a slightly higher level (but decreasing trend) of tion plus teaching; however, the fourth child
Skill 2, across the last two sessions of this (Iggy) rarely engaged in Skill 1. Three of the four
assessment. These response patterns were similar children exhibited robust levels of Skill 2 (on
for the other children (Figures 2 and 3), nearly 85% of the trials); Brit, however, rarely
with the exception of Len, who maintained exhibited the skill. Similarly, three of the four
moderate to high levels of Skills 1 and 2 children exhibited high, albeit initially variable,
256 KEVIN C. LUCZYNSKI et al.

Figure 1. Percentage of trials with target skills (filled circles, primary axis) and number of trials per session (bars,
secondary axis) for Iggy and Tex. Rank refers to the lead teacher’s ranking of children in their classroom that could most
benefit from acquiring the target skills. Brackets denote whether a teacher or experimenter conducted the sessions.

levels of Skill 3; only Abe exhibited the skill at a during sessions conducted by teachers than those
low level. Taken together, all four children conducted by the experimenter. To minimize the
exhibited moderate to high levels of at least complexity of sessions, teachers were asked to end
two of the three skills, indicating partial skill an activity after approximately 15 to 45 min had
maintenance after 3 months without teaching. elapsed and the children had created a product.
When teaching was reintroduced during mainte- For this reason, the number of trials (observa-
nance plus teaching, we observed high levels of tions) for each skill was usually greater during the
the skills for all children. sessions conducted by teachers than those
Guidelines for the number of trials conducted conducted by experimenters (Figures 1, 2,
for each skill were intentionally more flexible and 3; open bars, secondary y axis). Children’s
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 257

Figure 2. Percentage of trials with target skills (filled circles, primary axis) and number of trials per session (bars,
secondary axis) for Joy and Brit. Rank refers to the lead teacher’s ranking of children in her classroom who could most benefit
from acquiring the target skills. Brackets denote whether a teacher or experimenter conducted the sessions.

performance did not appear to vary systematically umn) are of the performances from Luczynski
based on the number of trials in each condition. and Hanley (2013); these data are shown here to
Thus, it seems unlikely that the increase in the serve as a comparison for changes in the children’s
number of trials affected the children’s perfor- performance during the generalization and long-
mance during those assessments. term maintenance assessments conducted in the
Figure 4 depicts the means of the children’s current study (second through sixth columns).
social skills and problem behavior across the last During the short-term maintenance assessment,
three sessions of all generalization and mainte- the children exhibited the social skills on an
nance assessments. The data depicted for the average of 91% (range, 84% to 100%) of the
short-term maintenance assessment (first col- trials, and no problem behaviors occurred.
258 KEVIN C. LUCZYNSKI et al.

Figure 3. Percentage of trials with target skills (filled circles, primary axis) and number of trials per session (bars,
secondary axis) for Abe and Len. Rank refers to the lead teacher’s ranking of children in her classroom who could most benefit
from acquiring the target skills. Brackets denote whether a teacher or experimenter conducted the sessions.

Performance decreased during generalization the level observed in the first generalization
(preinformed teaching), with the skills occurring assessment. We also observed a slight decrease in
on 24% of the trials (range, 2% to 57%). When the level of problem behavior (M ¼ 16.5%;
engagement in social skills decreased, the levels of range, 0% to 50%).
problem behavior increased. During the general- In generalization plus teaching, the children
ization (postinformed teaching) assessment, the exhibited the skills on 81% of the trials (range,
level of combined skills remained lower 71% to 91%), and problem behavior was nearly
(M ¼ 50%; range, 17% to 82%) than that eliminated for five of six children. The average
observed during the short-term maintenance level of problem behavior (M ¼ 4.2%; range, 0%
assessment but represented an improvement over to 20%) was similar to that observed during the
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 259

Figure 4. The mean percentage of trials with the three target skills combined (top row; gray bars) and with problem
behavior (bottom row; black bars) during the last three sessions of maintenance and generalization assessments are depicted.
Each child’s performance is denoted by an open circle. The experimenter and teacher labels denote who conducted the
activities across the conditions. The children’s performances during the short-term maintenance assessment (first column) are
from Luczynski and Hanley (2013) and are shown here for comparison.

short-term maintenance assessment. After assessment, the effects were fleeting, and de-
3 months without teaching, the social skills creases in the skills were associated with increased
occurred on 59% (range, 46% to 87%) of the levels of problem behavior. Furthermore, satis-
trials during the long-term maintenance assess- factory improvements were not observed in
ment, and problem behavior remained low across the second generalization test, despite the fact
all children (M ¼ 7.8%; range, 0% to 12%). that over 20 additional teaching sessions were
When teaching was in place, all skills occurred conducted in which antecedents and consequen-
above 80% (range, 72% to 90%), and problem ces during teaching were made less discriminable
behavior was further reduced (M ¼ 4%; range, and a mediating skill for delay tolerance was
0% to 11%). taught. The lack of sustained generalization is a
notable concern, because robust effects are
required for the PLS program to ultimately
prevent the development of problem behavior
DISCUSSION
when children transition across educational
The evaluations in the current study extend settings.
previous research (Hanley et al., 2007, in press; Satisfactory levels of generalization were
Luczynski & Hanley, 2013) by providing achieved only after a teacher was informed of
preliminary results that the PLS program the target skills and teaching procedures (gener-
promotes stimulus generalization of acquired alization plus teaching). This outcome highlights
functional communication and self-control skills the importance of arranging reinforcement for
across unfamiliar teachers and classrooms. Al- the social skills and extinction for problem
though moderate to high levels of generalization behavior in educational environments, at least
were observed in the first two sessions for almost during the initial skill transfer. These modifica-
all children during the initial generalization tions to the generalization contexts can be
260 KEVIN C. LUCZYNSKI et al.

characterized by Stokes and Osnes’s (1989) delays and denials following correct skills
tactics of modifying maladaptive consequences (consequence manipulations). The modifications
and reinforcing occurrences of generalization. in informed teaching were made to incorporate
We did not initially include teacher training the latter two generalization tactics. However,
because we were interested in the extent to which despite these additional efforts to prepare the
teaching children appropriate nonvocal (stop children to respond effectively in the generaliza-
what they are doing, look at the teacher, and raise tion contexts, we again observed notable variabil-
their hands) and vocal (saying, “excuse me,” ity in or a gradual decrease of one or two of the
“pardon me,” or the teacher’s name) communi- social skills for each child across sessions.
cation and self-control responses would naturally Although stakeholders in Luczynski and Hanley
recruit reinforcing consequences from preschool (2013) rated highly the importance of the social
and kindergarten teachers. In fact, Stokes and skills to children’s success in school, our current
Baer (1977) and Stokes and Osnes (1989) analyses suggest that teachers likely need to be
recommend teaching culturally relevant skills as directly instructed about the importance of the
a core generalization tactic, and Lin et al.’s (2003) functional communication and self-control skills
research on school readiness found that kinder- and of the interactions that will promote their
garten teachers, based on their ratings, were maintenance in the classroom.
primarily interested in the improvement of The arrangement of both generalization
children’s social skills. Moderate to high levels assessments represented a challenging test of
of the social skills occurred in the first two the effects of the teaching procedures in that (a) a
sessions, which provided ample opportunity for minimum of 24 hr elapsed between sessions; (b)
the teachers to reinforce these responses. The the generalization teachers were unaware of the
gradual decrease in the skills suggests, however, children’s history, particularly with respect to the
that the skills did not recruit a sufficient amount target skills and teaching procedures; (c) the
of reinforcement from teachers to maintain the teacher, classroom, and activity materials changed
social skills. every session; and (d) the children’s performances
We introduced additional teaching modifica- were repeatedly assessed over a 2-week period in
tions during informed teaching to promote both assessments. In addition, the generalization
stimulus generalization and maintenance that sessions were conducted to insure that partic-
can be characterized by Stokes and Osnes’s ipants had no prior experience with the unfamil-
(1989) generalization category of “train diverse- iar teachers and classrooms. In this way, the
ly,”related to Stokes and Baer’s (1977)“train generalization assessments mimicked an educa-
loosely.” This category is composed of four tional transition from preschool to kindergarten.
generalization tactics, two of which include Given these features, it is notable that elevated
teaching in the presence of a sufficient number levels of generalization were observed during the
of stimulus exemplars (e.g., activity-related first two sessions of the initial generalization
materials) and response exemplars (e.g., teaching (preinformed teaching) assessment. In fact, of the
precursors and several request forms) that were 18 opportunities for generalization across chil-
present during the initial teaching conditions dren (six children multiplied by three skills), a
(i.e., teaching). The other two tactics include skill occurred on more than 80% of trials for 12
making the antecedents and consequences for (67%) of the opportunities in at least one of the
target skills less discriminable, for example, by first two sessions. Furthermore, a skill was
varying the presentation formats and the experi- observed on at least 40% of trials for 15 (83%)
menter’s delay and denial cues (antecedent of the opportunities across both sessions, and this
manipulations) and by arranging unsignaled pattern continued in the third session for nine
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 261

(50%) of the opportunities. These data indicate integrity errors that teachers or caregivers may
that the PLS program promotes the short-term exhibit without training and their effect on skill
occurrence of acquired skills in novel contexts maintenance, generalization, and the reemer-
with teachers who are naive to the target skills and gence of problem behavior also would be
teaching procedures. informative. Future research should also address
Maintenance of the skills across an extended the limitation that we asked a sixth teacher, who
period of time, especially one that matches did not participate in the previous assessments, to
common educational breaks (e.g., summer conduct the generalization plus teaching, long-
vacation), is also an important measure of the term maintenance, and maintenance plus teach-
PLS program’s effects. Hanley et al. (2007) and ing. We introduced a novel teacher for practical
Luczynski and Hanley (2013) conducted main- reasons. The other five teachers had repeatedly
tenance observations of children’s performances, shared their time to conduct multiple activities
but they occurred shortly after teaching was that lasted approximately 15 to 45 min each, and
discontinued. We conducted maintenance ob- we were attempting to be sensitive to their time
servations after 3 months, and the results were commitments. This decision likely had no effect
encouraging. Children exhibited two of three on the outcomes because the children exhibited
social skills on more than 50% of trials across four similar levels of at least two of three social skills in
consecutive sessions and exhibited low to zero the first session of the generalization plus teaching
levels of problem behavior. Taken together, the as observed in the previous generalization (post-
teaching procedures led to some stimulus informed teaching) assessment. Nevertheless, in
generalization of the social skills across different subsequent evaluations, the teachers who con-
teachers and classrooms and sufficient mainte- duct generalization assessments should also
nance for two of the three targeted skills over a 3- participate in training.
month period. Given that extinction was not programmed for
The absence of comprehensive measures of the problem behavior and the teaching procedures
teachers’ behavior throughout the assessments is a were absent for both generalization tests as well as
limitation. Future researchers should collect in the 3-month maintenance test, the controlling
detailed data on teachers’ performances to variables for the children’s improved performance
determine whether, for example, the lack of in the maintenance test require discussion. In the
reinforcement for the social skills, reinforcement long-term maintenance assessment, the teacher
of problem behavior, or both contribute to the was asked to deliver the reinforcers following the
unsatisfactory outcomes in generalization assess- target skills, problem behavior, or any other
ments. In an analogue analysis of the relative response, and she was aware of the target skills;
effects of treatment integrity errors, St. Peter the teachers in the generalization assessments
Pipkin, Vollmer, and Sloman (2009) found were not informed of how to respond and were
detrimental effects when problem behavior not aware of the social skills. Given that the
produced reinforcement (errors of commission) teacher in the maintenance assessment also
but not when appropriate behavior went unrein- conducted generalization plus teaching, the
forced (errors of omission). Given these findings, children’s history of experiencing her delivering
future research should determine whether in- differential consequences may have led to their
forming teachers to withhold reinforcement improved performance because her presence may
following problem behavior, rather than have have signaled the availability of reinforcement for
them implement all of the teaching procedures, the social skills. Taken together, the teacher’s
would be sufficient to boost generalization discriminative control and the contingency for
outcomes. Measurement of a range of potential appropriate behavior likely maintained the
262 KEVIN C. LUCZYNSKI et al.

skills throughout the long-term maintenance program at home on the acquisition, generaliza-
assessment. tion, and maintenance of these social skills.
Our study suggests that informing teachers of
the skills that children have been taught and the
REFERENCES
importance of reinforcing those skills may be
important factors in the generalization and Beaulieu, L., Hanley, G. P., & Roberson, A. A. (2012).
Effects of responding to a name and group call on
maintenance of children’s improved social behav- preschoolers’ compliance. Journal of Applied Behavior
ior. In addition to training teachers on the target Analysis, 45, 685–707. doi: 10.1901/jaba.2012.45-685
skills and teaching procedures, peer-mediation Beaulieu, L., Hanley, G. P., & Roberson, A. A. (2013).
Effects of peer mediation on preschoolers’ compliance
strategies could be evaluated as another compo- and compliance precursors. Journal of Applied Behavior
nent to facilitate generalization and maintenance. Analysis, 46, 555–567.
Beaulieu, Hanley, and Roberson (2013) used Belsky, J., Vandell, D. L., Burchinal, M., Clarke-Stewart,
peer mediation as a tactic to improve the K. A., McCartney, K., Owen, M. T., & The NICHD
Early Child Care Research Network. (2007). Are there
maintenance of 3- and 4-year-old children’s use long-term effects of early child care? Child Development,
of a precursor skill when they respond to 78, 681–701.
individual and group instructions in a small- Durand, V. M., & Carr, E. G. (1991). Functional
communication training to reduce challenging behav-
group format. The precursor skill required that a ior: Maintenance and application in new settings.
child stop playing, look at the teacher, say “yes,” Journal of Applied Behavior Analysis, 24, 251–264. doi:
and wait for an instruction after the teacher says 10.1901/jaba.1991.24-251
Fisher, W., Piazza, C., Cataldo, M., Harrell, R., Jefferson,
the child’s name or “everyone.” The peers who G., & Conner, R. (1993). Functional communication
provided feedback were taught to mediate their training with and without extinction and punishment.
peer’s behavior through instruction, modeling, Journal of Applied Behavior Analysis, 26, 23–36. doi:
role-playing, and descriptive praise. Peer media- 10.1901/jaba.1993.26-23
Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive
tion facilitated maintenance of the precursor skill function in preschoolers: A review using an integrative
after discontinuation of the teaching procedures framework. Psychological Bulletin, 134, 31–60. doi:
and should, therefore, be further evaluated as a 10.1037/0033-2909.134.1.31
Hanley, G. P., Fahmie, T. A., & Heal, N. A. (in press).
tactic to increase generalization and maintenance Evaluation of the preschool life skills program in Head
effects with the skills that were targeted in the Start classrooms: A systematic replication. Journal of
current study. Exploration of the role of Applied Behavior Analysis.
Hanley, G. P., Heal, N. A., Tiger, J. H., & Ingvarsson, E. T.
observational learning (i.e., the child observes (2007). Evaluation of a classwide teaching program for
the delivery of attention, materials, or assistance developing preschool life skills. Journal of Applied
following a peer’s use of the social skills or Behavior Analysis, 40, 277–300. doi: 10.1901/
problem behavior) on children’s responding jaba.2007.57-06
Hanley, G. P., Iwata, B. A., & Thompson, R. H. (2001).
during small groups may be useful, because this Reinforcement schedule thinning following treatment
learning process may account for some of the with functional communication training. Journal of
unexpected response patterns in the current Applied Behavior Analysis, 34, 17–38. doi: 10.1901/
jaba.2001.34-17
study. For instance, a notable increase in requests Ingvarsson, E. T., Hanley, G. P., & Welter, K. M. (2009).
for materials and assistance was observed for after Treatment of escape-maintained behavior with positive
the first two sessions during the generalization reinforcement: The role of reinforcement contingency
and density. Education and Treatment of Children, 32,
(postinformed teaching) assessment, which may 371–401. doi: 10.1353/etc.0.0064
have been due, in part, to her observation of Iggy Lin, H. L., Lawrence, F. R., & Gorrell, J. (2003).
and Abe engaging in this skill and accessing Kindergarten teachers’ views of children’s readiness for
reinforcement for doing so. Finally, research school. Early Childhood Research Quarterly, 18, 225–
237. doi: 10.1016/S0885-2006(03)00028-0
should be conducted on the effects of teaching Luczynski, K. C., & Hanley, G. P. (2013). Prevention
parents to implement portions of the PLS of problem behavior by teaching functional
FUNCTIONAL COMMUNICATION AND SELF-CONTROL 263

communication and self-control skills to preschoolers. Rimm-Kaufman, S., Pianta, R. C., & Cox, M. J. (2000).
Journal of Applied Behavior Analysis, 46, 355–368. doi: Teachers’ judgments of problems in the transition to
10.1002/jaba.44 kindergarten. Early Childhood Research Quarterly, 15,
McKerchar, P. M., & Thompson, R. H. (2004). A 147–166. doi: 10.1300/J019v15n03_01
descriptive analysis of potential reinforcement contin- Skinner, B. F. (1953). Science and human behavior. New
gencies in the preschool classroom. Journal of Applied York, NY: Macmillan.
Behavior Analysis, 37, 431–444. doi: 10.1901/ St. Peter Pipkin, C., Vollmer, T. R., & Sloman, K. N. (2009).
jaba.2004.37-431 Effects of treatment integrity failures during differential
Michael, J. (1993). Establishing operations. The Behavior reinforcement of alternative behavior: A translational
Analyst, 16, 191–206. model. Journal of Applied Behavior Analysis, 43, 47–70.
National Institute of Child Health and Human Develop- doi: 10.1901/jaba.2010.43-47
ment. Early Childhood Care Research Network. Stokes, T. F., & Baer, D. M. (1977). An implicit technology
(2003). Does amount of time spent in child care of generalization. Journal of Applied Behavior Analysis,
predict socioemotional adjustment during the transi- 10, 349–367. doi: 10.1901/jaba.1977.10-349
tion to kindergarten? Child Development, 74, 976– Stokes, T. F., & Osnes, P. G. (1989). An operant pursuit of
1005. doi: 10.1111/1467-8624.00582 generalization. Behavior Therapy, 20, 337–355. doi:
Piazza, C. C., Fisher, W. W., Hanley, G. P., Remick, M. L., 10.1016/S0005-7894(89)80054-1
Contrucci, S. A., & Aitken, T. L. (1997). The use of Tiger, J. H., & Hanley, G. P. (2004). Developing stimulus
positive and negative reinforcement in the treatment control of preschoolers mands: An analysis of schedule-
of escape-maintained destructive behavior. Journal of correlated and contingency-specifying stimuli. Journal
Applied Behavior Analysis, 30, 279–298. doi: 10.1901/ of Applied Behavior Analysis, 37, 517–521. doi:
jaba.1997.30-279 10.1901/jaba.2004.37-517
Reimers, T. M., Wacker, D. P., Cooper, L. J., Sasso, G. M.,
Berg, W. K., & Steege, M. W. (1993). Assessing the
functional properties of noncompliant behavior in an Received June 19, 2012
outpatient setting. Child and Family Behavior Therapy, Final acceptance February 6, 2014
15, 1–15. doi: 10.1300/J019v15n03_01 Action Editor, Jennifer Austin

You might also like