Professional Documents
Culture Documents
https://doi.org/10.1007/s10803-017-3455-z
ORIGINAL PAPER
Abstract
Limited research has explored how to best train caregivers to support their child with autism spectrum disorder (ASD)
despite caregivers being well suited to promote generalization and maintenance of their child’s skills in the natural
environ-ment. Children with ASD have been shown to benefit from social skill training, which is not always conducted in
the natural context. This research examined the efficacy of behavioral skills training (BST) with, and without in situ
training (IST), for teaching caregivers how to also use BST to support their child’s context -specific social skills. Although
caregivers met mastery criterion within BST sessions, their skills did not generalize to the natural environment until IST
was introduced. The implications of the findings are discussed.
Keywords Caregiver training · Behavioral skills training (BST) · In situ training (IST) · Autism spectrum disorder
(ASD) · Social skills · Applied behavior analysis (ABA)
13
\1958 Journal of Autism and Developmental Disorders (2018) 48:1957–1970
discrete-trial teaching (Sarokoff and Sturmey 2004), train-ing mother continued using BST up to 3 months later to help
teachers on using natural language paradigm (Gianoumis et al. improve her son’s conversational skills. She had not gener-
2012), training graduate students to implement manu-alized alized using BST to teach her son new skills although she
cognitive behavior therapy (Hassan et al. 2017), and training indicated she would be confident in doing so. This training
caregivers to implement guided compliance (Miles and package did not involve IST as treatment integrity (i.e.,
Wilder 2009). The components of BST have also been used to BST implementation accuracy) remained above 80% for
teach a variety of social skills including: increasing vocal most tri-als. Although some research indicates that IST can
conversation skills such as greetings and maintaining and lead to more effective outcomes than BST alone (i.e.
ending conversations (Kornacki et al. 2013; Nuernberger et al. instruction, modelling, practice, feedback), IST may not be
2013); changing the topic of conversation and main-taining feasible in all clinical environments. Due to time and
eye contact (Stewart et al. 2007); negotiating and giving resource constraints in community and/or treatment
compliments (Hui Shyuan Ng et al. 2016); joining activities settings IST is not always a viable option when training
and changing games (Peters et al. 2016); teaching caregivers (Hanratty et al. 2016; Miltenberger et al. 2009).
communication in the form of requesting (Loughrey et al.
2014); and numerous play skills (Leaf et al. 2009). Current Research
In situ training (IST) involves practicing a skill in a natu-
ral environment versus a contrived setting. Similar to the BST has demonstrated effectiveness for teaching a variety of
rehearsal component of BST, feedback can be provided skills to diverse populations and there is preliminary support
immediately if the skills are not demonstrated correctly or for using BST to teach social skills to children with ASD in
within a specified time (Hanratty et al. 2016 ; Pan-Skadden et natural settings (e.g., Stewart et al. 2007). We hypoth-esized
al. 2009). Although research suggests that for some indi- that BST would be efficacious for training caregivers how to
viduals BST alone is effective for learning certain skills, for also use BST to support their children’s social skill
others an IST component has proven beneficial in meeting development in an ecological valid setting (i.e., uncontrived
specified mastery criteria (Gunby and Rapp 2014; Milten- free play sessions with their child and other children) . To
berger 2008b; Pan-Skadden et al. 2009). BST combined with evaluate, we added a BST component for caregivers to a pre-
IST is effective for teaching a variety of safety skills to chil- existing children’s social skills group to address previous
dren (Harriage et al. 2016; Himle et al. 2004; Miltenberger et recommendations to promote maintenance and generaliza-tion
al. 2009) including gun safety (Miltenberger et al. 2005) and of child outcomes by training individuals in the child’s
abduction prevention (Johnson et al. 2006), as well as sexual environment (Bellini et al. 2007; Gresham et al. 2001). Using
abuse prevention in women with developmental disabilities a concurrent multiple probe design, Study 1 evalu-ated
(Egemo- Helm et al. 2007). Nuernberger et al. (2013) whether two brief BST sessions (one individual and one
examined the effects of using BST and IST to teach group) would be sufficient for training caregivers how to also
conversation skills to young adults with ASD and indicated implement BST to support their child’s social skills within
that BST with IST was effective (Nuernberger et al. 2013). It free -play sessions with unplanned social situations. In Study
is unclear whether training caregivers to implement BST 2 we hypothesized that the addition of IST would lead to
necessitates an IST component to effectively support social improved caregiver BST implementation accuracy and
skill development in their child with ASD and whether car- generalization with their child. We also hypothesized that
egiver involvement improves child social skills outcomes. caregivers would find the training to be acceptable. This
Matson et al. (2009) reviewed literature which indicated research attempts to address the need for feasible and effica-
that training parents on behavioral procedures led to positive cious social skills training for children with ASD through
treatment effects in the domains of communication, early evaluation of a previously validated training model applied to
intervention, and the treatment of specific fears. Despite the caregivers. Results may inform how to capitalize on
acknowledgement of the efficacy of training parents on opportunities for generalization and maintenance of child
behavioral procedures there is limited research on the use of social skills in the natural environment.
BST for teaching caregivers how to support their child in
social settings. One exception (Stewart et al. 2007) used BST
to train the mother and sister of a child with Asper-ger’s Method
disorder to use BST to support their son/brother in
conversational skills. The researchers conducted an assess- This research was conducted in partnership with an agency
ment, provided training, and took direct observations over a that provides treatment, education, and consultation ser-vices
total of 13 h. After training both the mother and sister were to support individuals with intellectual disabilities and ASD.
able to use BST to teach conversational skills to their Caregivers referred to the agency were asked to choose a
son/brother which led to improved conversational skills. The priority for their child from four available treatment
13
Journal of Autism and Developmental Disorders (2018) 48:1957–1970\ 1959
domains: (1) communication, (2) emotional regulation, (3) Four of the five caregivers who received invitations con-
daily living, and (4) social skills. Caregivers who signed their sented to participate in the study. The fifth caregiver was
child up for the social skills group were invited to par-ticipate unable to participate due to time restrictions, although par-
in the current research. Their children were at the top of a ticipated in the group training for interest. Pseudonyms for
waitlist for service based on their child’s biological age (6–8), the participants in Study 1 were: Amanda, Barbara, Cath-
verbal ability (had to be verbal), and indicated need for social erine, and Daisy (see participant characteristics in Table 1).
skill development. Children’s developmental ages were not Four additional female caregivers of children diagnosed
assessed. The researchers and agency clini-cians designed a with ASD (ages 6–8) were invited to participate in Study 2
BST protocol for caregivers to accompany using the same procedure described above. Caregivers missed
a pre-existing 8-week child social skills program. Partici- several sessions (M = 3, range 0–4) in Study 2 due to weather
pant recruitment for Study 1 commenced once approval restrictions and illness. Pseudonyms for caregiv-ers in Study 2
was received from the Research Ethics Board of the were: Ellen, Felicia, Grace, and Hannah. Only one caregiver
affiliated university. After the completion of Study 1, per child received training in both Study 1 and 2, and were all
recruitment for Study 2 commenced. mothers except Ellen who was a grandmother (see Table 2 for
participant characteristics).
Participants
Settings and Materials
Study 1 included four female caregivers of children diag-
nosed with ASD (ages 6–8) enrolled in an 8-week social skills Training sessions with caregivers took place in a quiet room,
group at the community agency. Caregivers were sent a letter while their child participated in the normally- scheduled social
of invitation from the agency and were asked to con-tact the skills group in a separate room. All data collection and IST
researchers if they were interested in participating in a study sessions took place in the room where children par-ticipated
examining the effects of a caregiver training model for in the social skills group and materials to facilitate social
supporting social skill development in their children with interactions during free-play sessions with peers were
ASD. Caregivers were enrolled in the research on a first available (e.g., toys, games, Lego, action figures, etc.).
come, first served basis. Those who were unable to partici-
pate in the research but were interested in the training were Experimental Design and Procedure
provided the option of participating in a group-based train-ing
session. Caregivers were asked to attend each week of their Study 1 evaluated caregiver training in a concurrent multi-
child’s social skills group (two caregivers missed 1 week ple probe design across four participants. This type of sin-
during baseline), no participants withdrew from the study, and gle case design is appropriate for assessing the efficacy of
no participant data were excluded from the study. an intervention with irreversible changes in behavior (i.e.,
13
\1960 Journal of Autism and Developmental Disorders (2018) 48:1957–1970
learning) and controls for practice effects (Horner and Baer caregiver went into the room at a time to prevent potential
1978) . The design consisted of six phases: baseline assess- confounding variables such as observational learning and to
ment, individual BST session, post-individual BST assess- minimize disruption to the social skills group. All caregiv-ers
ment, group -based BST session, post group- BST assess- were assessed within the same session and the order in which
ment, and a 1-month follow-up assessment. After stable caregivers entered the social skills room was rand-omized for
baseline data was obtained the first caregiver received the all phases. Each caregiver had two 5-min data collection
individual BST session (50-min) while the other partici- sessions during the social skills group each week.
pants remained in baseline. Subsequent caregivers received
the individual training sessions in a staggered fashion on Individual Behavioral Skills Training Intervention
separate weeks during the 8-week social skills group. The
staggering of the intervention across participants allows for The caregiver with the most stable baseline received indi-
effects of the training to be observed while attempting to vidual BST after three data points were obtained. In Study
rule out other variables (Morgan and Morgan 2009). All 1 Amanda received training first despite having a slightly
four caregivers also received a group training on Week 7 ascending baseline due to Barbara and Daisy both missing
of the child social skills group. The flow of participants the first session and not having more than three data points
through the phases is summarized in Table 3. and Catherine had a higher ascending baseline. Barbara
Study 2 assessed caregiver training within a concurrent received training next followed by Catherine and Daisy
multiple probe design across three participants. The design based on the stability of their baseline assessments. In
consisted of five phases: baseline assessment, individual Study 2 Ellen had the most stable baseline and received the
BST, post -individual BST assessment, IST, and a 2 indi-vidual BST session first. Felicia received individual
-month follow-up assessment. Study 2 followed the same BST next as her baseline was both more stable and had
format as Study 1 except caregivers received IST if they fewer missing data points than Grace.
did not maintain 100% implementation of BST steps in the The individual BST session was consistent across Study 1
post-individual training assessment phase and there was no and 2 ranging from 50 to 60 min. A graduate student trainer,
group training component. The flow of participants is under the supervision of a Board Certified Behavior Ana-lyst
summarized in Table 4. (BCBA)™, attempted to teach caregivers using a BST model
how to also use BST to teach social skills to their child with
Baseline Assessment ASD. Parents received instructions on how and why to use
BST to teach social skills with a reference sheet to follow
Caregivers were invited to join a free-play portion of their along with. The trainer then modelled appropriate and
child’s social skills group with other children present. The inappropriate examples of using BST to support social skills
researchers provided the following instructions to the car- with another trainer. The caregiver was then given an
egiver: “Please support your child in this social setting as you opportunity to rehearse three examples that they identified as
normally would for 5 min. I will let you know when the 5 min important social skill targets for their child. Rehearsal was
are up. If you are in the middle of something, please wrap up followed by feedback on performance with specific praise and
as naturally and quickly as possible.” Only one corrective feedback from the trainer. All training was
13
Journal of Autism and Developmental Disorders (2018) 48:1957–1970\ 1961
provided by the first author and a supervising BCBA™. of participation in the study) 1 month after the group ended.
The only difference in Study 2 was that the reference sheet Children had access to the same activities as in group free-
was given to caregivers ahead of time in attempt to reduce play sessions (i.e., board games, Lego, action figures, video
the training time. Mastery criteria was set at 100% games, etc.) to help facilitate social interactions with their
accuracy in implementing the steps of BST across the three peers. Caregivers were told to “Please support your child in
exam-ples chosen by the caregiver and roleplayed with the this social setting as you normally would.” All caregiv-ers
trainer and another trainer role-playing a child. The social were present throughout the follow- up session and data were
validity questionnaires were given to caregivers at the end taken at random 5- min intervals for each caregiver. Follow-
of the individual training to fill out without the researcher up assessment in Study 2 was identical to Study 1, but
present. Post-individual training data collection sessions occurred 2 months after the social skills group ended and
were iden-tical to baseline assessment sessions (in the caregivers were present in the room individually instead of as
natural socials skills group environment). a group during data collection.
13
\1962 Journal of Autism and Developmental Disorders (2018) 48:1957–1970
Procedural Integrity of Behavioral Skills All four caregivers demonstrated 100% accuracy of BST
Training Sessions implementation during role plays with trainers for three
different social skills within a 50-min individual BST
To ensure consistency of the training across caregivers, a training. Caregivers minimally generalized correct BST
BCBA™ observed all training sessions to calculate the implementation with their child in post-individual training
Table 5 Procedural
Introduction
integrity of behavioural
1. The trainer introduces themselves and reviews participant’s rights in research and study details
skills training sessions
2. The trainer provides the caregiver with the reference sheet
3. The trainer provides the caregiver an overview of what BST is, how it is currently used with their child
in the social skills groups and how it may be helpful for the caregiver
4. The trainer and caregiver discuss three social skills targets that can be targeted with BST
Instructions and modelling
5. The trainer verbally reviews instructions
(a) Ensuring the child is attending
(b) Using appropriate language
(c) Ensuring understanding
6. The trainer verbally goes over modelling
(a) Why to model
(b) How to model
7. The trainer models/acts out how to use instructions and how to model social skills
(a) Models appropriate examples
(b) Models inappropriate examples
(c) Discusses the differences with the caregiver
8. The trainer and caregiver rehearse examples from Step 4 (instructions and modelling only)
9. The trainer provides feedback (during or after) and reinforces attempts
Rehearsal and feedback
10. The trainer verbally goes over rehearsal
(a) Importance of rehearsal
(b) How to provide opportunities for their child to practice
(c) How to provide effective feedback
(d) Providing praise for appropriate attempts
11. The trainer models an example of using BST in its entirety
12. The trainer and caregiver rehearse all three examples from Step 4 until mastery (full BST)
13. The trainer provides feedback (during or after) and reinforces attempts
Social validity questionnaire
14. The trainer will provide the caregiver the social validity questionnaire to the caregiver
13
Journal of Autism and Developmental Disorders (2018) 48:1957–1970\ 1963
assessment which occurred in the natural social skills of the experiment. Amanda had an immediate increase in
group setting (M = 5% increase from baseline). Following BST implementation accuracy from baseline to post-
an addi-tional group-BST training session caregivers had individual BST (25% before to 75% after the training), and
minimal improvements compared to post-individual BST returned to near baseline levels in Session 5. Amanda also
(M = 8% increase from baseline). demonstrated an immediate increase in correct BST imple-
Figure 1 presents the percentage correct BST steps mentation post group-BST (0% before to 50% after train-
implemented by caregivers (depicted by the line graph) ing), but returned to baseline levels in Session 15. Amanda
and their child’s social skill success after caregiver had 0% implementation accuracy in follow-up. Her child’s
prompts (depicted by the bar graph) during each phase social skill success was variable across all phases, but
13
\1964 Journal of Autism and Developmental Disorders (2018) 48:1957–1970
tended to be higher when Amanda implemented more steps social skills correctly when Daisy used a more steps of
of BST correctly (e.g., Session 8 and 14). BST correctly (e.g., Session 13–16).
Barbara started the program 1-week late. As such, her All caregivers completed the social validity questionnaire
baseline assessment was delayed, but was stable at 0% after the individual BST session. Table 6 summarizes the
implementation accuracy for three consecutive sessions. mean scores on each of the nine questions. All caregivers
She had an immediate increase in BST implementation indicated that they would use BST to help their child develop
accuracy from baseline to post-individual BST (0–75%). social skills and indicated that evaluating strategies for car-
She returned to 0% implementation accuracy on Session 7 egivers how to provide social support to children with ASD is
and remained variable at higher levels than baseline but important. No caregivers found their prior knowledge
lower than the initial probe after the individual BST ses- sufficient to support social skills (0%) and 75% of caregiv-ers
sion. Barbara demonstrated a small increase in correct BST agreed (25% somewhat agreed) that the training helped them
implementation after group training but returned to 0% a gain knowledge in supporting their child’s social skill
session later and remained at 0% at follow-up. Bar-bara’s development and that what they learned would help them as a
child’s social skill success was variable but tended to be caregiver to support their child’s social skills.
higher when Barbara implemented more steps of BST
correctly across all phases (e.g., Session 6, 9 and 11). Interrater Reliability and Procedural Integrity
Catherine’s baseline data was variable before becoming of Behavior Skills Training Sessions
stable at 0% BST implementation accuracy (i.e., 4 sessions in
a row) and stayed at 0% for most of the sessions after the Average interrater reliability across participants was
individual BST, with one instance where she implemented excellent for both the primary outcome measure of car-
75% of BST steps correctly on Session 13. Catherine did not egiver BST implementation accuracy (ICC = 0.90 with
show any increase in BST implementation accuracy after 95% CI = 0.78–0.96) and for the secondary outcome
group training and remained at 0% at follow-up. Dur-ing both measure, child social skills data (ICC = 0.95 with 95% CI
sessions where she had implemented 75% of BST steps, = 0.87–0.98). Procedural integrity of the trainer behavior
however her child was successful for 100% social skills that was 100% across all sessions and participants.
were prompted (i.e., Session 3 and 13).
Daisy missed 1 week during baseline but remained sta-
ble in her implementation of BST after her absence. There Study 2
was a slight increase in her BST implementation post-indi-
vidual training, however BST implementation accuracy Overall, caregivers’ BST implementation accuracy improved
was variable. Post group-BST, Daisy showed more stable after individual BST (M = 42% increase from baseline), yet
responding but was not using 100% of the BST steps. Dur- similar to Study 1, caregivers did not implement all steps of
ing follow-up, Daisy scored 25% of BST steps with no BST and did so variably. When IST was introduced it lead to
child success. Daisy’s child consistently performed more more stable accurate use of BST (M = 73% increase from
baseline) and a corresponding improvement in children’s
Importance of intervention
Evaluating strategies for caregivers how to provide social support to children with ASD is important 5
I found my prior knowledge of how to support my child in social skills sufficient 3.75
I have learned important skills by participating in this study 4.75
Perceptions of BST
I found that the training (BST) helped me gain knowledge in supporting my child in social skills 4.75
I found the trainer knowledgeable and helpful to my learning of supporting my child in social skills 4.75
I feel confident that I can support my child in obtaining their social skills goals 4
I think that what I have learned will help me as a caregiver to support my child in social skills 4.75
I would recommend BST to other caregivers who have children with ASD 4.5
I will/do use BST to help my child develop social skills regularly 5
13
Journal of Autism and Developmental Disorders (2018) 48:1957–1970\ 1965
social skills. One participant’s data was not included in the so no data is reported. Ellen’s child was successful 100%
final analysis as the training protocol had to be of the time when she used more than 25% of BST steps.
significantly modified to meet the caregiver’s Felicia had an immediate increase in BST implementa-
comprehension needs (e.g., reading textual prompts versus tion accuracy from baseline to post -individual BST (25%
independent rehearsal of BST implementation). before to 75% after training), which declined in Session 8.
As shown in Fig. 2, Ellen had an immediate increase in She was unable to attend multiple sessions and entered IST
BST implementation accuracy from baseline to post- when she returned in Session 13, where she scored 100%
individual BST (0% before to 87.5% after the training), on two consecutive sessions, reaching mastery criteria.
and quickly returned to near baseline levels in the natural During follow-up Felicia maintained relatively high BST
environment (Session 7). Throughout IST Ellen imple- implementation accuracy at 75% and her child’s social
mented BST steps more accurately than in baseline, with skills success was variable but he was successful 100% of
two instances of 100%, non -consecutively (Sessions 10 the time when he did respond (e.g., Sessions 13 and 17).
and 12). Ellen was unable to attend the follow-up session
13
\1966 Journal of Autism and Developmental Disorders (2018) 48:1957–1970
Grace’s baseline data was stable outside of one outlying four caregivers agreed that they would continue to use BST to
data point in Session 9 and several missed sessions. Grace had help their children develop their social skills and that eval-
an immediate increase in BST implementation accuracy from uating strategies for caregivers how to provide social support
baseline to post-individual BST (0% before to 100% to children with ASD is important. No caregivers agreed that
immediately after training) and maintained 100% imple- their prior knowledge was sufficient to support social skills
mentation accuracy for two sessions with a slight decrease to (0%) and 100% of caregivers agreed that the training helped
87.5% in Session 13. Given the slight decrease, Grace entered them gain knowledge in supporting their child’s social skills.
IST in which she scored 100% in two consecutive sessions, Table 8 summarizes the mean scores on the same nine ques-
reaching mastery criteria. During follow-up Grace maintained tions pertaining to the IST component.
high BST implementation accuracy (87.5%). Her child was
successful in responding in almost all instances of Grace Interrater Reliability and Procedural Integrity
using multiple steps of BST (except Session 15). of Behavior Skills Training Sessions
All caregivers completed the social validity questionnaire
after the individual BST session. Given that the question- Average interrater reliability across all participants was
naires were anonymous the results of a fourth caregiver whose excellent for caregiver BST implementation accuracy (ICC
results are not presented are included. Table 7 sum-marizes = 0.93 with 95% CI = 0.78–0.98) and good for child social
the mean scores on each of the nine questions. All skills data (ICC = 0.87 with 95% CI = 0.57–0.96).
Importance of intervention
Evaluating strategies for caregivers how to provide social support to children with ASD is important 5
I found my prior knowledge of how to support my child in social skills sufficient 3
I have learned important skills by participating in this study 4.75
Perceptions of BST
I found that the training (BST) helped me gain knowledge in supporting my child in social skills 5
I found the trainer knowledgeable and helpful to my learning of supporting my child in social skills 4.75
I feel confident that I can support my child in obtaining their social skills goals 4
I think that what I have learned will help me as a caregiver to support my child in social skills 4.75
I would recommend BST to other caregivers who have children with ASD 5
I will/do use BST to help my child develop social skills regularly 5
Table 8 Mean caregiver social validity ratings including in situ training (N = 2) in Study 2
Statement Mean
score (out
of 5)
Importance of intervention
Evaluating strategies for caregivers how to provide social support to children with ASD is important 5
I found my prior knowledge of how to support my child in social skills sufficient 2.5
I have learned important skills by participating in this study 5
Perceptions of BST
I found that the training (BST) helped me gain knowledge in supporting my child in social skills 5
I found the trainer knowledgeable and helpful to my learning of supporting my child in social skills 4
I feel confident that I can support my child in obtaining their social skills goals 5
I think that what I have learned will help me as a caregiver to support my child in social skills 5
I would recommend BST to other caregivers who have children with ASD 5
I will/do use BST to help my child develop social skills regularly 5
13
Journal of Autism and Developmental Disorders (2018) 48:1957–1970\ 1967
Procedural integrity of the trainer behavior was 100% was conducted in collaboration with a clinical agency in an
across all sessions and participants. applied setting, which enhances the ecological validity of
the results given that research conducted in highly con-
trolled conditions may not always be replicated in applied
Discussion settings or may have weaker effect sizes (e.g., Weisz et al.
1995). Further, all caregivers reported high social validity;
Results support existing research indicating that BST with they reported that teaching their children social skills was
IST leads to more efficacious and generalized training out- important and found that BST was helpful. Social valid-ity
comes than BST alone (e.g., Miltenberger et al. 2009) and is an important tenet of behavioral interventions (Baer et
contribute to limited research evaluating BST for training al. 1968, 1987) and an important outcome measure of
caregivers how to support their child’s social skills. Since research and clinical work (Schwartz and Baer 1991) given
it is not always practical or feasible in clinical contexts to that beliefs about credibility or the importance of a
include an IST component due to limited resources, Study treatment can influence outcome and mediator adherence
1 assessed whether two brief (50-min) BST sessions (one to interven-tions (Nock and Kazdin 2001).
individual, one group) were sufficient for caregivers to A common limitation of social skills training programs for
achieve mastery criteria in BST implementation accuracy. We children with ASD is lack of generalization and main-tenance
hypothesized that two brief BST sessions would be sufficient of skills (Rao et al. 2008; Williams White et al. 2007). Since
for caregivers to achieve the mastery criteria in a controlled caregivers are present across more of their child’s
training environment and that implementation accuracy would environments than clinicians, they are ideal candi-dates to
generalize, potentially to a lesser degree, with their child. facilitate opportunities for children to practice and receive
Results confirmed that caregivers could demonstrate 100% feedback on their skills in natural contexts, which leads to
accuracy in BST implementation in the controlled training increased generalization and maintenance of skills (e.g.,
environment, and only minimal accuracy with their child in a Bellini et al. 2007). Study 2 demonstrated that BST with IST
natural environment. We hypothesized that adding an IST lead to increased caregiver BST implementation accuracy
component in place of the group BST session would increase with their child in an ecologically valid setting than after BST
caregivers’ implementation accuracy with their child and lead alone, and preliminary data suggest that child responding
to a potential improvement in chil-dren’s social skills. Results corresponded with caregiver BST accuracy. Further research
of Study 2 demonstrated that caregivers’ BST implementation is needed to fully evaluate the relationship between caregiver
accuracy increased after receiving the IST component, and BST accuracy and child success.
there was a corresponding increase in children’s social skills. This research had several limitations, including lack of
We also hypothesized that caregivers would find the training external validity due to the small number of participants
to be a helpful strategy for assisting in their child’s social skill across studies, and how participants were recruited due to
development, which was confirmed by the outcomes of the the nature of the service delivery model at the community
social validity surveys. agency. A potential limitation of this type of convenience
These findings contribute to the existing literature in a sampling is that the caregivers and children may have dif-
few important ways: (1) to the authors’ knowledge, this is ferent characteristics than other caregivers and children in
the first quasi-experimental evaluation of BST coupled the larger population (e.g., belief that their child can
with IST to teach caregivers how to support social skills, a change, child’s social skill abilities, etc). We did not
highly relevant clinical need in the ASD population; (2) measure car-egiver’s beliefs, motivation, and knowledge
the train-ing focused on teaching caregivers how to use about their child’s social skills, which should be
BST to teach skills necessary for the context versus using considered in future research.
BST to teach pre-determined skills only; and (3) BST Replication is needed and future research may consider
alone, and with IST, were feasibly implemented in a evaluating the training model in a randomized controlled trial.
clinical setting with limited disruption, few resources, and Future research should also examine training caregiv-ers to
had high social validity rat-ings from all caregivers. use BST for different ages and abilities, such as ver-bal or
The focus of this evaluation was teaching caregivers how non-verbal children. Only one caregiver per child participated
to apply BST to support their child’s social skills based on in the training and all caregivers were mothers apart from one
what was appropriate to the context instead of learning how to grandmother. If more than one primary car-egiver participated
apply the steps of BST to teach a few specific skills. This (e.g., mothers and fathers), it may lead to increased
general case analysis approach (e.g., O’Neil 1990) departs generalization of child social skills due to sup-port from
from previous BST research, yet has important implications multiple caregivers. Although the studies assessed skill
for generalization and maintenance of skills for both car- maintenance at 1- and 2-month follow- up, generali-zation
egiver and child. Another key strength is that the research was not assessed outside of the social skills group.
13
\1968 Journal of Autism and Developmental Disorders (2018) 48:1957–1970
Additionally, Felicia missed multiple sessions in Study 2, setting which has limited resources and mandated to make
however, this did not seem to negatively impact her ability positive clinical gains for families. There is merit to
to accurately implement BST during IST. teaching caregivers ways to support their child with ASD
Data were not collected on the number of opportuni-ties in ecologi-cally valid settings, as there will be an ongoing
caregivers had to prompt their child during data col-lection need for the child to learn new skills across the lifespan.
sessions, which may have varied across caregiver/ child Further evalua-tions of this nature are highly warranted.
dyads; if children were engaged in activities appropri-ately
with peers, there may have been limited opportunities to Acknowledgments The project was completed as a portion of the
prompt. Caregivers entered the room on a randomized first author’s Master of Arts thesis. The authors would like to thank
Karen Chartier, the program director at Lake Ridge Community
schedule across all phases in attempt to mitigate this pos- Support Services, all staff members who helped support the project,
sibility. Caregiver selection of social skills was also not and the caregivers and children who participated in the study.
controlled for, and some caregivers may have targeted dif-
ferent levels of social skills difficulty. Similarly, child data Author Contributions All authors participated in the conception
of the study and participated in the design and the manuscript
was collected only on skills prompted by the caregiver, and
preparation. KT and MH lead the design and interpretation of the
therefore may represent their ability to successfully data; AS and JH participated in the acquisition of data. All authors
perform skills that the caregivers felt were important read and approved the final manuscript.
versus their overall social skills.
It is possible that caregivers may have demonstrated Compliance with Ethical Standards
higher BST accuracy across Study 1 and 2 if they had been
taught how to discriminate opportunities to prompt their Conflict of interest The authors declare that they have no conflict
child’s social skills, which may be an inherent component of interest.
of IST. Future research is needed to fully understand what Ethical Approval All procedures performed in studies involving
mechanisms are responsible for change and attempt to con- human participants were in accordance with the ethical standards of
trol for extraneous variables such as difficulty of social the insti-tutional and/or national research committee (Tri-Council
skill across participants. Future research should also standards) and with the 1964 Helsinki declaration and its later
amendments or comparable ethical standards.
examine generalization and maintenance of caregiver BST
imple-mentation across other settings, over time, and in Informed Consent Informed consent was obtained from all
new skill domains. There may also be merit to assessing individual participants included in the study.
the impact of including a second caregiver to increase
opportunities and to also measure child’s performance.
Evaluating whether teaching caregivers how to use BST References
impacts confidence, stress, relationship with their child, and
quality of life may be warranted. Caregivers of children with American Psychiatric Association. (2013) . Diagnostic and statistical
ASD may experience higher levels of stress compared to manual of mental disorders (5th edn; DSM–5). Washington,
DC: Author.
caregivers of children with other disabilities (Dunn et al. Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current
2001). Given that social skill deficits are a core diagnostic dimen-sions of applied behavior analysis. Journal of Applied
feature of ASD, improving children’s social skills is a com- Behavior Analysis, 1, 91–97.
Baer, D. M., Wolf, M. M., & Risley, T. R. (1987). Some still-current
mon goal that may have benefits for their caregivers as well.
dimensions of applied behavior analysis. Journal of Applied
For example, caregiver empowerment has been shown to be a Behavior Analysis, 20, 313–327.
mediator of stress in mothers of children with ASD (Weiss et Bellini, S., Peters, J. K., Benner, L., & Hopf, A. (2007). A meta-
al. 2015). Empowering caregivers by training them to support anal-ysis of school-based social skills interventions for children
with autism spectrum disorders. Remedial and Special
their child’s social skills may be beneficial for both children
Education, 23(3), 153–162.
with ASD and their caregivers, as stress lev-els may decrease Church, C., Alisanski, S., & Amanullah, S. (2000). The social, behav-
given that caregivers found the training to be important, ioral, and academic experiences of children with Asperger syn-
helpful, and reported increased confidence in their skills. drome. Focus on Autism and Other Developmental Disabilities,
15(1), 12–20.
Future research may aim to address the impact of BST on
Daniel, L. S., & Billingsley, B. S. (2010). What boys with an autism
these important variables. spectrum disorder say about establishing and maintaining friend-
These preliminary findings add to the body of research on ships. Focus on Autism and Other Developmental Disabilities,
BST, ASD, and social skill training. Teaching caregivers to 25(4), 220–229.
Dunn, M. E., Burbine, T., Bowers, C. A., & Tantleff- Dunn, S.
use BST with a general case analysis approach versus train- (2001). Moderators of stress in parents of children with autism.
ing a specific set of skills may contribute to caregiver and Commu-nity Mental Health Journal, 37(1), 39–52.
Egemo-Helm, K. R., Miltenberger, R. G., Knudson, P., Findstrom, N.,
child skill maintenance and generalization. Furthermore, this
approach was feasible and appropriate in a clinical treatment Jostad, C., & Johnson, B. (2007). An evaluation of in situ training
13
Journal of Autism and Developmental Disorders (2018) 48:1957–1970\ 1969
to teach sexual abuse prevention skills to women with mental Miles, N. I., & Wilder, D. A. (2009). The effects of behavioral skills
retardation. Behavioral Interventions, 22(2), 99–119. training on caregiver implementation of guided compliance.
Gates, J. A., Kang, E., & Lerner, M. D. (2017). Efficacy of group Jour-nal of Applied Behavior Analysis, 42, 405–410.
social skills interventions for youth with autism spectrum Miltenberger, R., Gross, A., Knudson, P., Jostad, C., & Breitwieser,
disorder: A systematic review and meta-analysis. Clinical C. B. (2009). Evaluating behavioral skills training with and
Psychology Review, 52, 164–181. without simulated in situ training for teaching safety skills to
Gianoumis, S., Seiverling, L., & Sturmey, P. (2012). The effects of children. Education and Treatment of Children, 32(1), 63–75.
behavior skills training on correct teacher implementation of Miltenberger, R. G. (2008a). Behavior modification: Principles and
Natural Language Paradigm teaching skills and child behavior. procedures (4th edn.). Belmont, CA: Thomson Wadsworth.
Behavioral Interventions, 27(2), 57–74. Miltenberger, R. G. (2008b). Teaching safety skills to children:
Gresham, F. M., Sugai, G., & Horner, R. H. (2001). Interpreting out- Preven-tion of firearm injury as an exemplar of best practice in
comes of social skills training for students with high-incidence assess-ment, training and generalization of safety skills.
disabilities. Exceptional Children, 67(3), 331–344. Behavior Analy-sis in Practice, 1(1), 30–36.
Gunby, K. V., & Rapp, J. T. (2014). The use of behavioral skills training Miltenberger, R. G., Flessner, C., Gatheridge, B., Johnson, B., Sat-
and in situ feedback to protect children with autism from abduc-tion terlund, M., & Egemo, K. (2004). Evaluation of behavioral skills
lures. Journal of Applied Behavior Analysis, 47, 856–860. training to prevent gun play in children. Journal of Applied
Hanratty, L. A., Miltenberger, R. G., & Florentino, S. R. (2016). Evalu- Behav-ior Analysis, 37, 513–516.
ating the effectiveness of a teaching package utilizing behavioral Miltenberger, R. G., Gatheridge, B. J., Satterlund, M., Egemo-Helm,
skills training and in situ training to teach sun safety in a preschool K. R., Johnson, B. M., Jostad, C., … Flessner, C. A. (2005).
classroom. Journal of Behavior Education, 25, 310–323. Teach-ing safety skills to children to prevent gun play: An
Harriage, B., Blair, K. C., & Miltenberger, R. (2016). An evaluation evaluation of in situ training. Journal of Applied Behavior
of a parent implemented in situ pedestrian safety skills Analysis, 38, 395–398.
intervention for individuals with autism. Journal of Autism and Morgan, D. L., & Morgan, R. K. (2009). Single-case research
Developmental Disorders, 46(6), 2017–2027. methods for the behavioral and health sciences. Los Angeles,
Hassan, M., Thomson, K. M., Khan, M., Riosa, B. P., & Weiss, J. A. CA: Sage publications.
(2017). Behavioral skills training for graduate students providing National Autism Center. (2015). National Standards Report.
cognitive behavior therapy to children with autism spectrum dis- Retrieved from http://www.nationalautismcenter.org/resources/.
order. Behavior Analysis: Research and Practice, 17(2), 155–165. Nock, M. K., & Kazdin, A. E. (2001). Parent expectancies for child
Himle, M. B., Miltenberger, R. G., Flessner, C., & Gatheridge, B. therapy: Assessment and relation to participation in treatment.
(2004). Teaching safety skills to children to prevent gun play. Journal of Child and Family Studies, 10(2), 155–180.
Journal of Applied Behavior Analysis, 37, 1–9. Nuernberger, J. E., Ringdahl, J. E., Vargo, K. K., Crumpecker, A. C.,
Horner, R. D., & Baer, D. M. (1978). Multiple probe-technique: A & Gunnarsson, K. F. (2013). Using a behavioral skills training
variation on the multiple baseline. Journal of Applied Behavior package to teach conversation skills to young adults with autism
Analysis, 11, 189–196. spectrum disorders. Research in Autism Spectrum Disorders, 7(2),
Hui Shyuan Ng, A., Schulze, K., Rudrud, E., & Leaf, J. J. (2016). Using 411–417.
the teaching interactions procedure to teach social skills to children O’Neill, R. E. (1990). Establishing verbal repertoires: Toward the
with autism and intellectual disability. American Journal On application of general case analysis and programming. The
Intellectual & Developmental Disabilities, 121(6), 501–519. Analy-sis of Verbal Behavior, 8, 113–126.
Johnson, B. M., Miltenberger, R. G., Knudson, P., Egemo-Helm, K., Pan-Skadden, J., Wilder, D. A., Sparling, J., Severtson, E., Donald-
Kelso, P., Jostad, C., & Langley, L. (2006). A preliminary son, J., Postma, N., Beavers, G., & Neidert, P. (2009). The use
evalu-ation of two behavioral skills training procedures for of behavioral skills training and in-situ training to teach children
teaching abduction-prevention skills to school children. Journal to solicit help when lost: A preliminary investigation. Education
of Applied Behavior Analaysis, 39, 25–34. and Treatment of Children, 32(3), 359–370.
Keonig, K., De Los Reyes, A., Cicchetti, D., Scahill, L., & Klin, A. Parsons, M., Rollyson, J., & Reid, D. (2012). Evidence -based staff
(2009). Group intervention to promote social skills in school-age training: A guide for practitioners. Behavior Analysis in
children with pervasive developmental disorders: Reconsidering Practice, 5(2), 2–11.
efficacy. Journal of Autism and Developmental Disorders, Parsons, M. B., Rollyson, J. H., & Reid, D. H. (2013). Teaching
39(8), 1163–1172. practitioners to conduct behavioral skills training: A pyramidal
Kornacki, L. T., Ringdahl, J. E., Sjostrom, A., & Nuernberger, J. E. approach for training multiple human service staff. Behavior
(2013). A component analysis of a behavioral skills training Analysis in Practice, 6(2), 4–17.
pack-age used to teach conversation skills to young adults with Peters, B. B., Tullis, C. A., & Gallagher, P. A. (2016). Effects of a
autism spectrum and other developmental disorders. Research in group teaching interaction procedure on the social skills of stu-
Autism Spectrum Disorders, 7(11), 1370–1376. dents with autism spectrum disorders. Education & Training in
Leaf, J. B., Taubman, M., Bloomfield, S., Palos-Rafuse, L., Leaf, R., Autism & Developmental Disabilities, 51(4), 421–433.
McEachin, J., & Oppenheim, M. L. (2009). Increasing social Rao, P. A., Beidel, D. C., & Murray, M. J. (2008). Social skills inter-
skills and pro- social behavior for three children diagnosed with ventions for children with asperger’s syndrome or high
autism through the use of a teaching package. Research in -function-ing autism: A review and recommendations. Journal
Autism Spec-trum Disorders, 3(1), 275–289. of Autism and Developmental Disorders, 38(2), 353.
Loughrey, T. O., Contreras, B. P., Majdalany, L. M., Rudy, N., Sinn, Reichow, B., & Volkmar, F. R. (2010). Social skills interventions for
S., Teague, P., Marshall, G., McGreevy, P., & Harvey, A. C. individuals with autism: Evaluation for evidence-based practices
(2014). Caregivers as interventionists and trainers: Teaching within a best evidence synthesis framework. Journal of Autism
mands to children with developmental disabilities. Analysis of and Developmental Disorders, 40(2), 149–166.
Verbal Behavior, 30(2), 128–140. Reimers, T. M., Wacker, D. P., & Cooper, L. J. (1991). Evaluation of
Matson, M. L., Mahan, S., & Matson, J. L. (2009). Parent training: A the acceptability of treatments for children’s behavioral difficul-
review of methods for children with autism spectrum disorders. ties: Ratings by parents receiving services in an outpatient clinic.
Research in Autism Spectrum Disorders, 3(4), 868–875. Child & Family Behavior Therapy, 13(2), 53–71.
13
\1970 Journal of Autism and Developmental Disorders (2018) 48:1957–1970
Sarokoff, R. A., & Sturmey, P. (2004). The effects of behavioral Weiss, J. A., MacMullin, J. A., & Lunsky, Y. (2015). Empowerment
skills training on staff implementation of discrete-trial teaching. and parent gain as mediators and moderators of distress in
Journal of Applied Behavior Analysis, 37, 535–538. mothers of children with autism spectrum disorders. Journal of
Schwartz, I. S., & Baer, D. M. (1991). Social validity assessments: Is Child and Family Studies, 24(7), 2038–2045.
current practice state of the art? Journal of Applied Behavior Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995).
Analysis, 24, 189–204. Bridg-ing the gap between laboratory and clinic in child and
Stewart, K. K., Carr, J. E., & LeBlanc, L. A. (2007). Evaluation of adolescent psychotherapy. Journal of Consulting and Clinical
family-implemented behavioral skills training for teacher social Psychology, 63(5), 688–701.
skills to a child with Asperger’s disorder. Clinical Case Studies, Williams White, S., Keonig, K., & Scahill, L. (2007). Social skills
6(3), 252–262. development in children with autism spectrum disorders: A
Tanaka, J. W., & Sung, A. (2016). The “eye avoidance” hypothesis review of the intervention research. Journal of Autism and
of autism face processing. Journal of Autism and Developmental Disorders, 37(10), 1858–1868.
Developmental Disorders, 46(5), 1538–1552.
13