You are on page 1of 12

Original Manuscript

Journal of Special Education Technology


1-12
A Comparison of iPad-Assisted and Flash ª The Author(s) 2020
Article reuse guidelines:
sagepub.com/journals-permissions
Card-Assisted Instruction for Learners DOI: 10.1177/0162643420979935
journals.sagepub.com/home/jst
With Autism

Davaa Ulzii1 , Susan Kabot1, and Christine Reeve1

Abstract
Using electronic tablets to present flash cards for teaching skills is becoming common among practitioners. However, no
published study compared the effectiveness of the electronic tablet-based flash cards to paper flash cards for teaching
receptive labeling skills. The purpose of this study was to compare the efficacy of the iPad-based and paper flash cards for
teaching receptive labeling to learners with autism. An adapted alternating treatments design was used. Participants included one
preschool student with autism and one elementary school student with autism. Findings indicated that iPad-assisted instruction
resulted in a slightly faster acquisition and slightly lower levels of prompts for both participants. No differences were found in the
generalization and maintenance of the skills between the two instructional mediums. Mixed results were found for challenging
behaviors associated with each intervention. Implications and suggestions for future research are discussed.

Keywords
autism, applied behavior analysis, iPad, flash card, receptive labeling skill

As of 2016, approximately one out of 54 eight-year-old chil- listener, such as performing an action. If the understanding is
dren were diagnosed with autism spectrum disorder (ASD) a nonverbal response, it is considered as listener behavior and
across multiple areas of the United States (Maenner et al., termed as receptive language or receptive labeling (Sundberg,
2020). Studies (Kover et al., 2013; Volden et al., 2011; Weis- 2008). Demonstrating comprehension of speech is the most
mer et al., 2010) found that children with ASD have weaker complex skill in the listener repertoire, and it is logical to
receptive language skills compared to typically developing assume that understanding the other person’s speech is also
children. When comparing the early language patterns of chil- required for other verbal operants, such as mand, tact, and
dren with ASD to language patterns of children with develop- intraverbal (Sundberg, 2008). Accordingly, most programs
mental delay using a groups-comparison design, Weismer et al. devote a part of the early intervention curriculum for develop-
(2010) found that the children with ASD scored higher on ing receptive language skills (Grow & LeBlanc, 2013).
expressive language skills compared to the receptive language
skills. Volden et al. (2011) examined syntactic and semantic
language skills in preschool children with ASD using the Pre- Electronic Tablet-Assisted Interventions
school Language Scale, Fourth Edition, and found that overall, for Improving Communication
expressive communication was stronger than the auditory com- Technology-based intervention, such as computer-assisted
prehension skills among the participants. Moreover, Kover interventions have been used to teach various skills to learners
et al. (2013) assessed the characterization of the receptive lan- with ASD (Knight et al., 2013). Within the past decade, the use
guage skills of boys with ASD using the cross-sectional devel- of electronic tablets for education activities became increas-
opmental trajectories approach. Kover et al. found that relative ingly popular in homes and schools. Consequently, the effec-
to their chronological age, school-aged boys with ASD showed tiveness of the tablets for teaching skills has been a focus of
a delay in their receptive language skills. Aside from the group
differences found between children with ASD, developmental
1
delay, or typically developing children, studies (e.g., Kover Nova Southeastern University, Fort Lauderdale, FL, USA
et al., 2013; Weismer et al., 2010) also find individual varia-
Corresponding Author:
bility among participants. Davaa Ulzii, Abraham S Fischler College of Education and School of Criminal
Listener behavior is determined by whether a speaker’s ver- Justice, 3301 College Avenue, Fort Lauderdale, FL 33314, USA.
bal behavior evokes a specific nonverbal response from the Email: du96@nova.edu
2 Journal of Special Education Technology XX(X)

many studies. The effectiveness of the electronic tablets for et al. found that phoneme awareness skills increased in all three
improving expressive communication skills has been exempli- participants.
fied in the studies by Dennis (2016), Kagohara et al. (2012), In the same way, Lorah and Karnes (2016) evaluated the
and Xin and Leonerd (2015). Dennis (2016) examined the effectiveness of the iPad-based app, Language Builder, for the
effects of an iPad-based application and extended instruction acquisition of the listener responding skills in two children with
on the expressive vocabulary, definitions, and generalization ASD using a multiple baseline across responses design. Also,
skills of preschool children using repeated acquisition design. the research included a generalization assessment where the
The study found that all six participants increased their expres- same target picture-identification tasks were presented on
sive verb vocabulary. Dennis (2016) stated that all participants paper picture cards. Both participants gained skills to recep-
appeared to enjoy the iPad-based instruction and did not show tively identify the target items and the identification skills gen-
resistance. eralized to the paper-based picture cards. Lorah and Karnes
Moreover, Kagohara et al. (2012) examined teaching picture recommended future research use a multiple-probe design to
naming skills using an iPad-based speech-generating device for eliminate the potential overexposure to target and nontarget
two adolescents using multiple probes across participants items. The researchers also suggested that replication of this
design. Kagohara et al. found that picture naming using the study should be conducted in a more natural setting (i.e., home
speech-generating device increased accurate picture naming or classroom) and to determine if the environmental factors
in both participants. Similarly, Xin and Leonard (2015) found influenced the learner’s acquisition.
that the use of the iPad application, SonoFlex, increased the On the other hand, Ganz et al. (2015) found mixed results
expressive communication skills in all three participants with when examining the effectiveness of the tablet-based picture
ASD. exchange communication systems on the receptive identifica-
By contrast, Fletcher-Watson et al. (2016) found that iPad tion skills of one preschool student with ASD using a multiple
intervention did not improve social communication skills in baseline across target words design. The participant’s ability to
children when using a groups comparison design. Despite the receptively identify an object improved for two of the target
results, Fletcher-Watson et al. noted that researchers should words but did not show improvement for one of the target
continue to investigate tablet-based interventions considering words.
that the iPad intervention used in their study engaged children Also, Chebli et al. (2017) found mixed results when evalu-
and was perceived positively by the parents. Likewise, ating the generalization of the skills following the instruction of
Rodrı́guez and Cumming (2017) found no differences when one-word concepts using a tablet-based application using mul-
using a group comparison design to investigate the effects of tiple probes across concepts design. The results of the study
a iPad-based Language Builder application on expressive and showed that three of the five participants demonstrated general-
receptive vocabulary skills of students with language-based ization for at least two of the concepts. The other two partici-
disabilities. However, Rodrı́guez and Cumming (2017) noted pants did not demonstrate any generalization skills. Chebli
that the treatment group using the iPad-based intervention et al. (2017) stated the participants who did not show any gen-
made significant gains in their sentence formation skills. eralization also needed a more significant number of prompts
Also, Dennis et al. (2016) found no significant differences in to sit down and stay on task compared to the other participants.
the outcomes of expressive and receptive vocabulary skills. For future studies, Chebli et al. recommended examining
The study used teacher-facilitated intervention and iPad- whether some level of off-task behavior is an indicator for
facilitated intervention for teaching verbs to five at-risk pre- children not benefitting from a tablet-based instruction.
school children. The results of the study indicated that all five
students learned the target verbs during two interventions.
Effects of Electronic Tablet-Based
Although Dennis et al. (2016) utilized an adapted alternating
treatments design (AATD; Sindelar et al., 1985) to compare the
Interventions on Behaviors
teacher-facilitated and iPad-facilitated interventions, several Several studies suggest that the use of electronic tablets or high
variables differed between the conditions, such as presentation tech devices may affect behavioral outcomes. Neely et al.
of a stimulus following an incorrect response and overall (2013) studied the effects of an iPad on challenging behaviors
teacher attention and involvement during instruction. with two children who had a prior history of engaging in chal-
lenging behaviors during instruction. The study utilized an
alternating treatments design to compare the effects of the
Teaching Receptive Labeling Skills Using Electronic
traditional paper/pencil/flashcard instruction and iPad-based
Tablets instruction. The results showed that for both participants, chal-
Thus far a relatively few studies examined the effectiveness of lenging behaviors decreased, and academic engagement
electronic tablets for improving receptive labeling skills in increased during the iPad instruction phase of the study com-
individuals with disabilities. Chai et al. (2015) evaluated the pared to the instruction phase delivered via traditional
effectiveness of the iPad application, Touch Sound, for recep- materials.
tive identification of the initial phonemes using a multiple Lee et al. (2015) compared the therapist-implemented and
probes across behaviors and across participants design. Chai iPad-assisted interventions for teaching skills to two children
Ulzii et al. 3

with ASD using an alternating treatments design. To demon- Method


strate the effects of the two mediums, the researchers used the
Participants and Setting
same pictures for both therapist-implemented intervention and
the iPad-based intervention. The results showed that for one of Participants included two learners with autism. Selection cri-
the participants, there were no differences in the outcome teria to recruit participants included that they had (a) a medical
between the two interventions. For the other participant, there diagnosis of an ASD, (b) ABA treatment goals to improve
were more occurrences of on-task behavior and correct communication skills, (c) adequate motor skills to interact with
responses and fewer occurrences of the challenging behaviors an electronic tablet and flash cards, and (d) an ability to under-
during the iPad-assisted condition. Furthermore, Lee et al. stand and follow spoken directions given in English. Partici-
found that during the final phase of the study, both participants pants were assigned pseudonyms to protect their anonymity.
preferred the iPad-assisted condition when given an option to Emma was a 3-year-old girl with a medical diagnosis of
choose between the two conditions. ASD and mild hearing loss. Emma wore hearing aids during
On the other hand, Vandermeer et al. (2015) found iPad- the day. Emma received in-home ABA therapy four times a
based social stories to be an effective strategy for only one week and attended public preschool 5 half-days a week in an
participant of the study but not for the other two participants inclusive classroom setting. At school, Emma received speech
for increasing on-task behavior in young children with ASD. and language therapy, occupational therapy, physical therapy,
Vandermeer et al. (2015) used the iPad-based application for and consultation from a teacher of the hearing impaired on
social stories, Stories2Learn, to create social stories for model- weekly basis either within the classroom setting or in a 1:1
setting.
ing the on-task behavior. For future studies, Vandermeer et al.
Sage was an 11-year-old girl with a medical diagnosis of
suggested that when recruiting participants, researchers should
ASD. Sage received in-home ABA therapy services five times
gather comprehensive information about the participants, their
a week. Sage attended public school 5 days a week in the
learning style (e.g., visual vs. auditory), and emotional state
special education classroom setting. At school, Sage received
within the classroom.
speech and language therapy, occupational therapy, and phys-
In summary, review of the literature on the effectiveness of
ical therapy weekly in a 1:1 setting.
the electronic tablets for improving communication skills sug-
At the time of the study both participants’ ABA programs
gest the following: (a) studies that examined the effectiveness
for skill acquisition were guided by the Verbal Behavior Mile-
of the electronic tablet-based interventions for improving com- stones Assessment and Placement Program (VB-MAPP; Sund-
munication skills found them to be effective for some learners berg, 2008). Emma’s listener responding skills were at Level 2
and ineffective for other, or do not generalize, (b) learners’ (18–30 months) of the VB-MAPP. Sage’s listener responding
behaviors can interfere with acquisition of the skills, (c) when skills were primarily at Level 2 (18–30 months) of the VB-
given a choice some learners are likely to choose the electronic MAPP. Sage also received partial scores on some of the skills
tablets over traditional materials or stay on task longer. at Level 3 (30–48 months) of the VB-MAPP.
These findings, although important, do not address whether Both participants had an individualized educational pro-
tablet-based flash cards are as effective or more effective than gram at school. Both participants were familiar with the use
paper flash cards. Though there is no evidence suggesting of the iPad. Emma interacted with an iPad at school during
tablet-based pictures are as effective or more effective than educational activities. Sage also engaged in iPad-based educa-
traditional flash cards for teaching receptive labeling skills, tional activities at school and used to listen to children’s music
teachers and practitioners have been using computers and on the iPad when at home. Both participants’ native language
tablets to present flash cards during distance teaching or was English, and they spoke English at home.
telehealth-based services. Therefore, this is a timely question The study was conducted in participants’ homes where they
for practitioners and researchers to examine and find solutions typically received their ABA intervention. The study setting
for the best practice. included a child-sized table and a chair suited for the partici-
pants’ height. The table was positioned against the wall and
within 3 in. (7.62 cm) of the seated child. For both participants,
Purpose of the Present Study during the majority of the study sessions, only one parent was
present at home, and no distracting noise or stimuli were pres-
To the researchers’ knowledge, no published studies compared ent in the environment.
the effectiveness of the electronic tablet-based flash cards and
traditional flash cards for teaching receptive labeling skills.
Therefore, the purpose of this study was to compare the effec- Materials
tiveness of the iPad-assisted and flash card-assisted applied
behavior analysis (ABA) interventions on the acquisition, gen- Flash Cards
eralization, and maintenance of the receptive labeling skills, For teaching receptive labeling of the actions, the researcher
and the number of prompts and challenging behaviors associ- used the Language Builder Verbs and Action Word flash card
ated with each intervention during instructional sessions. set produced by Stages Learning (2018). The Language Builder
4 Journal of Special Education Technology XX(X)

Verbs and Action Word flash cards were printed on a photo Table 1. Targets for Receptive Labeling by Participants and Experi-
paper, which was 12.7 cm in width and 8.89 cm in height. The mental Sets.
cards include photographic images of people from diverse ages, Participant Flash Card iPad Control
gender, and ethnicities engaging in everyday activities in many
different settings. Emma Actions
For teaching receptive labeling of the functional sight
Shaking hands Raising hand Drying hands
words, the researcher created paper flash cards. The words Buttoning Dressing Hanging
selected for the experimental sets were printed on a white paper Yawning Barking Calling
using a bold 88-point Calibri font in black. These flash cards Folding Cutting Peeling
were 12.4 cm in width and 8.8 cm in height and were Pointing Painting Writing
laminated. Sweeping Breaking Tearing
Smelling Tickling Skiing
Stirring Standing Blowing
iPad-Based Cards Pulling Throwing Dripping
Riding Clapping Carrying
In this study, the researchers used an iPad with a screen size of
9.7 in. (24.63 cm). For the iPad-assisted instruction, the Sage Sight Words
researchers used the Language Builder Pro app (Version
Girl Boy Candy
1.3.0) developed by the Stages App (2016). The Language Little Push Coat
Builder Pro app has a function that allows the user to upload Deli Off Movie
images. The researcher uploaded the images of the Language Hot Food Music
Builder’s Verbs and Action card pictures and sight words to the Close Dairy Slow
Language Builder Pro app and created an account for each Drink Men Snack
participant. To control the effects of the variables other than Pickles Soda Caution
the experimental variables, the additional features of the app Enter Chocolate Soup
Volume Cold Straw
(i.e., instructional commands, within-stimulus prompting, Out Danger Water
audio, or visual reinforcement) were turned off either by deac-
tivating the feature or setting it on the maximum number of
trials required prior to activation.
treatment goals. Next, the researchers conducted a logical anal-
ysis of those words by their practicality, initial sounds, number
Reinforcers of letters and syllables. Based on the results of the logical
analysis, the researchers selected a pool of 30 words for each
To differentially reinforce the participants’ independent correct
participant and divided the words into three equal experimental
responses during the instructional phase, the researcher identi-
sets as shown in Table 1: (a) flash card set, (b) iPad set, and (c)
fied reinforcers for each participant using the multiple-stimulus
control set.
presentation without a replacement item (MSWO; DeLeon &
Due to the participants’ individual needs, the instructional
Iwata, 1996) procedure prior to the study. For each participant,
sets varied by the participant. For Emma, receptive labeling of
the top three reinforcers were identified.
action words was chosen as instructional targets. For Sage,
receptive labeling of the functional sight words was chosen
Experimental Design as instructional targets.
Academic skills, such as picture naming and sight word read-
ing, are nonreversible behaviors (Gast, 2014). Thus, with
respect to nonreversibility of the receptive labeling of the Dependent Variables
actions and sight words, an AATD was used to compare the This study measured the outcomes on each learner’s skill
effectiveness of the instructional mediums for teaching recep- acquisition, generalization, maintenance, and frequency of the
tive labeling skills. Separate sets of target behaviors of equal prompts and challenging behaviors associated with each
difficulty were assigned to each intervention. Also, a control instructional medium.
set, on which no instruction occurred, was used for assessing A criterion for skill acquisition was defined as learner pro-
participants’ skills at baseline and at the end of the instructional viding 100% independent correct responses for two consecu-
phase to detect whether history influenced the participants’ tive sessions. Participant’s responses for each trial were
responses (Sindelar et al., 1985). recorded using score keys during the discrete trial instructional
In this study, to identify instructional sets of equal difficulty, (DTI) session.
the researchers used a combination of the approaches recom- Stimulus generalization of the skill was defined as the
mended by Wolery et al. (2014). First, the researchers selected occurrence of the taught behavior when presented with a sti-
possible target words that have high utility across the partici- mulus variation of the mastered stimulus. Stimulus generaliza-
pant’s environment and consistent with the participant’s ABA tion was assessed in two ways: (a) by presenting a stimulus
Ulzii et al. 5

variation of the taught stimulus on the same medium, and (b) previous study (Neely et al., 2013) found that iPad-assisted
identical stimulus presented on the other medium. intervention resulted in more academic engagement compared
Response maintenance was defined by the occurrence of the to the traditional materials. A total of four baseline data points
taught response during the follow-up session 4 weeks postin- were collected for each word in all three experimental sets. The
tervention. The researcher tested the occurrence of the taught researcher did not test each word three times on each instruc-
response once using the stimulus presented during instructional tional medium to prevent possible facilitative effects (i.e.,
sessions. improved performance) due to repeated testing (Cooper
The challenging behavior was defined as participants enga- et al., 2007; Gast, 2014). During the baseline phase, partici-
ging in behaviors not related to the task, such as getting up and pants were reinforced by social praise for attending to the task
attempting to walk away from the table. Challenging behaviors and to encourage responding and demonstrating their optimal
were recorded using the event recording method from the performance during the instructional phase as recommended by
moment the instructional session began, and till the instruc- Gast (2014).
tional session ended.
A response prompt was defined as an additional antecedent
stimulus provided by the instructor to occasion the correct
Instructional Phase
response, such as pointing to the correct stimulus, modeling, As suggested by Wolery et al. (2014), all aspects of the two
and providing physical guidance. Prompting was recorded interventions (i.e., therapist, the number of an array of items
using score keys whenever the least-to-most prompting step presented, prompts, reinforcers, number of trials for each ses-
was required to occasion the correct response during each trial sion, and the setting) were the same except for the instructional
within the instructional session. mediums used.
Using the steps of the DTI, the researcher presented three
target stimuli simultaneously during each trial of the instruc-
Independent Variables tional sessions. The steps of the DTI included: (a) presentation
Independent variables for this study were flash card-assisted of the three target stimuli, (b) researcher delivering the discri-
intervention for receptive labeling and iPad-assisted interven- minative stimulus, which was a verbal instruction (i.e., Touch)
tion for receptive labeling. Instructions for receptive labeling to select the target stimulus for that trial, (c) If the participant
skills were provided using the steps of DTI which consisted of: responded correctly within 5 seconds of the discriminative sti-
(a) presentation of the three target stimuli, (b) verbal instruction mulus, the researcher delivered a small amount of the prede-
to touch the target stimulus for that specific trial, (c) partici- termined reinforcer (i.e., a preferred snack item) with social
pant’s response, and (d) delivery of a reinforcer or prompt praise (e.g., “Nice job!”). Alternatively, if the participant
depending participant’s response. Except for the instructional responded incorrectly or did not respond within 5 seconds of
mediums (i.e., paper flash cards and iPad-based flash cards), all the delivery of the discriminative stimulus, the therapist deliv-
other aspects of the two interventions were the same (i.e., ered the prompt using the least-to-most prompting hierarchy.
therapist, instructional setting, teaching method, number of The researchers chose the least-to-most prompting strategy
trials for each session, an array of stimuli presented, prompts, as it was reported that both participants had a tendency to avoid
reinforcers). or sensitive to physical prompts or touch. The steps of the least-
to-most prompting strategy were: (a) pointing to the correct
stimulus within 3 in. (7.62 cm) of the correct stimulus, (b)
Procedures pointing to the correct stimulus within 1 in. (2.54 cm) of the
All phases of the study were conducted in the same manner. correct stimulus, and (c) gently guiding the student with hand-
The study took place at the participants’ child-sized table, over-hand prompt to occasion the correct response.
which was positioned against the wall. The researcher sat next Following each trial, the position of the pictures or sight
to the participant, no more than 6 in. (15.24 cm) away from the words were changed within the same array. Each picture or
student. The iPad or flash cards were placed immediately in sight word was targeted for instruction five times during each
front of the student on the table within 3 in. (7.62 cm) of the session by rotating the discriminative stimulus across trials and
student. each instructional session consisted of 15 trials. A criterion for
mastery was 100% independent correct responding for two
consecutive sessions. When the participant demonstrated a
Baseline Phase mastery of a target stimulus, the acquired target was removed
During the baseline phase, the researchers tested participants’ from the array to be tested for generalization, and a new target
performance on each word using flash cards twice and using word was added.
iPad twice. This was done to ensure that participants cannot Both interventions were provided on the same days with at
receptively identify the target stimulus regardless of the least a 1 hr gap between the two instructional sessions. The
medium it was presented on. The researchers wanted to demon- order of the iPad-assisted and flash card-assisted instructional
strate that potential novelty effects of the iPad did not influence sessions was selected randomly. If one of the instructional
participants’ performance during the baseline phase as the mediums was selected as the first session of the day for 2 days
6 Journal of Special Education Technology XX(X)

in a row, on the third day, the other instructional medium was IOA. The ABA therapist who worked with each participant
selected as the first session to counterbalance the treatment observed 100% of the sessions during the baseline, instruc-
sequence effects. The participants attended the research ses- tional phase, generalization probes, and final probe. The thera-
sions on average three to four times a week, and the instruc- pists were blind to the hypotheses of the study and were trained
tional phase of the study lasted for 4 weeks. in data collection procedures. Three therapists had a master’s
degree; one was a Board Certified Behavior Analyst (BCBA),
Generalization Probe and two were pursuing a BCBA certification. One therapist was
a special education teacher, and another therapist had a bache-
Stimulus generalization of the skill was assessed by assessing lor’s degree in psychology. The second observer recorded IOA
participants’ ability to receptively label variations (i.e., stimu- data simultaneously with the researcher during 30% of the
lus examples) of the trained stimulus. The researcher assessed sessions.
the skills by (a) presenting different variations of the trained Trial-by-trial IOA for participants’ response to an instruc-
stimulus on the same instructional medium and (b) presenting tional stimulus and a number of prompts used during the instruc-
the trained stimulus on the other instructional medium. For tional phase of the study was calculated for each participant.
example, if the action word “pulling” was taught using flash The mean IOA for instructional trials across interventions
card-assisted instruction, the generalization of the skill was was 97.2% (range: 93%–100%).
tested by presenting (a) two different pictures of the “pulling” The mean IOA for the number of prompts used across two
action involving different people in different settings on flash conditions for both participants was 98.6% (range: 93%–100%).
cards, and by presenting (b) same picture of the “pulling” Also, a total count IOA data was calculated for occurrences
action used during flash card-assisted instruction on the iPad. of the challenging behaviors for each participant during the
instructional phase of the study. The mean IOA for the number
Final Probe of challenging behaviors during instructional sessions was
100% for both participants.
At the conclusion of the instructional phase, the researcher
assessed participants’ ability to receptively label action words
Procedural fidelity. Fidelity data were collected for 31% of the
and sight words from all three experimental sets (i.e., flash
sessions of the study for Sage and for 21% of the sessions for
card, iPad, and control set) using paper flash cards. The final
Emma. The steps of the procedural fidelity for the instructional
probe was conducted in the same setting and environmental
phase included (a) instructional setting is arranged as described
arrangement as the instructional phase of the study.
in the design, (b) therapist gaining the learner’s attention before
delivering the instruction, (c) waiting the appropriate time
Follow-Up Probe delay before providing a prompt, (d) providing the appropriate
Response maintenance refers to the continued occurrence of prompt, and (e) providing the predetermined reinforcement.
the taught behavior when all, or part of the intervention has The procedural fidelity data were calculated by dividing the
been terminated (Cooper et al., 2007). The words mastered number of observed behaviors by the number of opportunities,
during the instructional phase of the study were tested for multiplied by 100 (Gast, 2014). The review of the procedural
maintenance at 4 weeks postintervention. The researcher fidelity data indicated that the researcher achieved 100% accu-
probed the maintenance of the skills using flash cards. The racy in implementing the conditions of the study.
researcher conducted the maintenance probes for each partici-
pant in the same setting as the instructional phase of the study. Analysis of Data
The effectiveness of the two instructional mediums was exam-
Data Recording and Analysis ined using a combination of visual analysis and the percentage
of the nonoverlapping data values (PND; Scruggs & Mastro-
Data Recording pieri, 1998). Visual analysis of the data allows the examiner to
The data were collected on paper data sheets developed by the evaluate the behavior change without imposing a predeter-
researchers. Trial-by-trial data was collected for the acquisi- mined arbitrary level of significance (Cooper et al., 2007). The
tion, prompts, generalization, and maintenance of the skills visual analysis of the data was conducted to analyze the acqui-
using score keys. A count of the challenging behaviors that sition, generalization, and maintenance of the skills for each
occurred during instructional sessions were recorded using intervention, and frequency of prompts and challenging beha-
event recording method. viors associated with each intervention,
Also, PND point values were calculated to examine the effec-
tiveness of the instructional mediums. PND was determined by
Reliability Measures (a) a range of data point values in the first condition; (b) the
To ensure the accuracy of the measurement, interobserver number of data points in the second condition, (c) counting the
agreement (IOA), and procedural fidelity data were collected number of points from the second condition that falls outside of
for each participant during each phase of the study. the range of values of the first condition, and (d) dividing the data
Ulzii et al. 7

Figure 1. Cumulative number of words mastered over sessions by participants.

points that fall outside of the range of the value of a first condition examination of the data graph showed a steady baseline level
by the total number of data points in the second condition and at zero value, which changed to an increasing trend during the
multiplying it by 100 (Scruggs & Mastropieri, 1998). Though the instructional phase. As shown in Figure 1, by the end of the
nonoverlap methods provide valuable information, it should not instructional phase, Emma had mastered receptively labeling
replace the visual analysis and should be used as a supplement 16 out of the 20 action words from the instructional sets. Emma
for interpreting the visual analysis (Rakap et al., 2014). identified nine action words on the iPad-based pictures and
seven action words on flash card-based pictures. The data val-
Results ues for iPad-assisted instruction demonstrated a steady increas-
ing trend. During the final probe session, Emma receptively
Emma labeled four of the 10 action words from the control set inde-
During the baseline phase, Emma receptively labeled zero pendently (see Figure 1). The calculation of the PND showed
action words out of the 30 target action words. Visual that for Emma, the PND score was 84.6 for both interventions.
8 Journal of Special Education Technology XX(X)

14 Flash Card-Assisted
Emma
Instruconal Sessions

Total Number of the Challenging


100 12
iPad-Assisted Instruconal
Percentage of Independent Correct

80 Sessions
10
60
Recepve Labeling

Behaviors
8
40
6
20

0 4
Smulus Variaon 1 Smulus Variaon 2 Idencal Smulus
Presented on the Presented on the Presented on the 2
Same Medium Same Medium Other Medium
0
Smulus Trained on Flash Card Smulus Trained on iPad
Emma Sage

Sage Figure 3. Total number of the challenging behaviors occurred during


instructional sessions by participants.
100
Percentage of Independent Correct

80 behaviors included looking away from the table, fidgeting on


60 the seat by moving side to side, and getting up from the seat.
Recepve Labeling

40

20 Sage
0 During the baseline phase, Sage recognized zero of the 30
Smulus Variaon 1 Smulus Variaon 2 Idencal Smulus
Presented on the Same Presented on the Same Presented on the Other functional sight words. By the end of the instructional phase,
Medium Medium Medium Sage mastered receptively labeling 17 of the 20 target func-
Smulus Trained on Flash Card Smulus Trained on iPad tional sight words from the instructional sets. As shown in
Figure 1, Sage receptively labeled seven sight words on the
Figure 2. Percentage of independent correct responding during sti- flash cards and 10 sight words on the iPad. Also, during the
mulus generalization probes by participants. final probe session, Sage receptively labeled three out of the 10
words from the control set independently on which no instruc-
tion was provided (see Figure 1). For Sage, the PND score was
Interventions with PND scores of 70 to 90 are considered effec-
87.5 for both interventions, which indicated that both interven-
tive interventions (Scruggs & Mastropieri, 1998). tions were effective.
In terms of generalization of the skills, Emma was able to Sage was able to receptively label 100% of the sight words
receptively label 100% of the acquired action words on two on two stimulus variations of the target words (i.e., the same
additional pictures showing the same action performed by dif- words printed in different fonts). Also, Sage demonstrated
ferent people in different settings. Also, Emma receptively 100% successful generalization of the words by receptively
labeled 100% of the acquired action words when the pictures labeling the acquired sight words presented on the other
were presented on the other instructional medium (see instructional medium (see Figure 2).
Figure 2). During the maintenance probe, Sage was able to receptively
During the maintenance probe 4 weeks postintervention, label 100% of the acquired functional sight words correctly.
Emma demonstrated an ability to receptively label 100% of Also, Sage demonstrated textual response for many of the
the action words acquired during the instructional phase. taught sight words independently, although no formal data
Emma needed prompts during 7.2% of the iPad-assisted were collected on this skill.
instructional trials and 9.2% of the flash card-assisted Sage needed prompts during 5.8% of the iPad-assisted
instructional trials. The number of prompts used during the instructional trials and 7.5% of the flash card-assisted instruc-
initial flash card-assisted session was higher than the initial tional trials. The initial flash card-assisted instructional session
iPad-assisted session. When providing prompts to evoke the required the highest number of prompts. Moreover, for Sage,
correct response, gestural prompts were sufficient for the gestural prompts were sufficient 100% of the time when pro-
majority of the time. Hand-over-hand prompts were needed viding prompts to evoke the correct response. Hand-over-hand
only during the initial teaching sessions. Beginning with the prompts were used zero times during instructional sessions.
second teaching session, Emma did not need any hand-over- As shown in Figure 3, for Sage, the occurrences of the
hand prompts. challenging behaviors were low during both instructional con-
Emma engaged in challenging behaviors six times during ditions. Challenging behaviors occurred one time during iPad-
iPad-assisted instructional sessions and 12 times during flash assisted instructional sessions and occurred twice during flash
card-assisted instructional sessions (see Figure 3). Challenging card-assisted instructional sessions.
Ulzii et al. 9

Discussion the other medium. Similar results were found by Lorah and
Karnes (2016) in that participants were able to generalize the
The findings of the current study indicate that both iPad-
receptive labeling skills when the stimuli taught on an iPad
assisted and flash card-assisted instructions resulted in the
were presented on two-dimensional paper flash cards.
acquisition of receptive labeling skills. However, visual anal-
With regard to prompts, the iPad-assisted instruction
ysis of the data shows that acquisition of the skills during the
resulted in a slightly lower level of prompts. Notably, during
iPad-assisted instruction was slightly faster than the flash card-
the initial iPad-assisted instructional session, both participants
assisted instruction for both participants. There were no differ-
needed a significantly lower number of prompts to touch the
ences found in the generalization and maintenance of the skills correct picture or sight word when compared to the initial flash
between the two instructional mediums. Data indicated that card-assisted instructional session. Neither participant needed
iPad-assisted instruction resulted in a slightly lower levels of hand-over-hand prompts during the iPad-assisted instructional
prompts. Lower levels of challenging behaviors were associ- sessions. This could be due to potentially novel effects of the
ated with iPad-assisted instruction for one of the participants iPad, as was seen in studies by Lee et al. (2015). Furthermore,
and no differences were observed in the behavioral outcome of Sage used to listen to her favorite music on an iPad, which
the other participant. could make iPads, in general, an object associated with rein-
Results of this study support the findings by Lorah & Karnes forcement for Sage.
(2016), in that intervention provided by the iPad-based app, Emma engaged in fewer challenging behaviors during the
Language Builder (a version of the app used in this study), iPad-assisted instructional sessions compared to the flash card-
resulted in rapid acquisition of the skills when teaching recep- assisted instructional sessions. However, no differences were
tive labeling to preschool children with ASD. A possible reason observed for Sage. Sage engaged challenging behaviors rela-
for the similar trends seen during the two instructional condi- tively a few times during the study. Possible explanations for
tions in this study could be due to the identical instructional this result could be due to Sage’s motivation for learning to
steps of the DTI used. Studies (e.g., Dib & Sturmey, 2007; read, as was reported by her parents. She participated in ses-
Downs et al., 2007; Lovaas, 1987) showed that DTI to be an sions with minimal support and indicated her expectation of the
effective method for teaching skills to learners with disabilities. activity by placing the “read” icon in her visual activity sched-
Notably, the DTI for teaching receptive labeling skills using a ule. In addition, as discussed above, iPad, in general may have
conditional-only model, which implements DTI by presenting been associated with reinforcing activities for Sage.
and teaching multiple stimuli from the onset of the intervention Another notable finding was that both participants were
rather than teaching the targets in isolation has been demon- engaging in echoic behaviors by repeating the given verbal
strated to be more effective (Grow et al., 2011, Grow & stimulus during instructional sessions. Similar results were
LeBlanc, 2013). Aside from the identical instructional methods seen in a study by Grow and Van Der Hijde (2016). During
used during instructional sessions, the setting, instructor, rein- the final probe and maintenance probe, both participants
forcers, and intensity of the intervention were the same for both expressively labeled some of the words. Expressive labeling
interventions. Also, carryover effects from one intervention of the sight words by Sage was significant progress considering
could have affected the performance on the other instructional the skills required for textual responding.
set since receptive labeling skills are nonreversible behavior The findings of this study suggest that iPad-assisted interven-
(Wolery et al., 2014). tion is a viable alternative to a traditional flash card-assisted
Although no change in performance on the control set is instruction for teaching receptive labeling skills to learners with
ideal for demonstrating the functional independence of the ASD. Since technology-based instructions have the potential to
interventions, improved performance on the control set was decrease errors that may occur during instruction (Lorah &
observed in this study. A possible explanation for that is includ- Karnes, 2016), electronic tablets and apps can be a useful tool
ing words of high utility may have contributed to improved for implementing interventions for teachers and practitioners. If
performance on the control set for both participants. The parti- used effectively, electronic tablets and apps can eliminate poten-
cipants attended public school 5 days a week and were likely to tial human errors such as the timing of the prompts, interspersing
encounter those words outside of the research setting. The of the target stimuli, and accurate data collection.
researchers considered the possibility of this effect when Moreover, iPad-assisted instruction can facilitate within sti-
selecting target stimuli for the experimental sets. However, it mulus prompts relatively easily by highlighting the target stimu-
is recommended to teach words that are practical and relevant lus or fading the nontarget the stimuli. Though within stimulus
to the participants’ needs, and consistent with their ABA treat- prompts are useful for learners who are aversive to physical
ment and educational goals (More & Travers, 2013). touch, they are used infrequently due to the efforts it requires
In terms of the generalization and maintenance of the to create (Cooper et al., 2007; Grow & LeBlanc, 2013).
skills, data from the study showed no differences between
flash card-assisted and iPad-assisted instructions. Once the
skill was mastered, participants were able to generalize it Limitations and Future Research
on variations of the target stimulus presented on the same Although the researchers attempted to minimize the common
instructional medium and an identical stimulus presented on threats to internal validity by adding a control set, randomly
10 Journal of Special Education Technology XX(X)

assigning the order of the interventions, and implementing the Authors’ note
interventions in distant temporal order, there were other limita- The authors would like to thank the families that participated in this
tions related to the validity of the study. The study included study.
only two participants from two different age groups. Therefore,
caution must be implied regarding the generalizability of the Declaration of Conflicting Interests
findings of this study to other populations. Also, the general- The author(s) declared no potential conflicts of interest with respect to
ization probe of this study assessed the participants’ stimulus the research, authorship, an/or publication of this article.
generalization skills using two-dimensional stimuli only. Prob-
ing the skill generalization using materials in different formats, Funding
real-life objects, and across settings may provide further infor- The author(s) received no financial support for the research, author-
mation on the skill generalization. As noted by Chebli et al. ship, and/or publication of this article.
(2017), the ability to generalize words taught on electronic
tablets to a real life objects is not easy for all learners. ORCID iD
Another limitation of this study is the inability to determine Davaa Ulzii https://orcid.org/0000-0003-2656-6507
the significance of the learning gained by the participants.
Though iPad-assisted intervention resulted in slightly faster References
acquisition for both participants, further analyses of the signif- Chai, Z., Vail, C. O., & Ayres, K. M. (2015). Using an iPad application
icance of this behavior change will provide more information to promote early literacy development in young children with dis-
about the findings of this study. abilities. The Journal of Special Education, 48(4), 268–278.
A possible area of future research would be to evaluate the https://doi.org/10.1177/0022466913517554
effectiveness of the iPad-assisted instruction while turning on Chebli, S. S., Lanovaz, M. J., & Dufour, M. (2017). Generalization
one of the additional features of the iPad or app. Adding only following tablet-based instruction in children with autism spectrum
one of the available features such as within stimulus prompting disorders. Journal of Special Education Technology, 32(2), 70–79.
to the tablet-based receptive labeling instruction will help https://doi.org/10.1177/0162643416681499
researchers to examine the each variable effectively. Cooper, J. O., Heron, T. M., & Heward, W. L. (2007). Applied beha-
In this study, the researchers used an iPad with a screen size vior analysis (2nd ed.). Pearson.
of 9.7 in. (24.63 cm) since it is used most commonly in an DeLeon, I. G., & Iwata, B. A. (1996). Evaluation of a multiple-
educational setting. As of 2020, iPads with larger screens are stimulus presentation for assessing reinforcer preferences. Journal
available on the market. Using an iPad with a larger screen may of Applied Behavior Analysis, 29, 519–532. https://doi.org/10.
produce different results since the size, array, and positioning 1901/jaba.1996.29-519
of the cards can be different on a larger screen. For example, Dennis, L. R. (2016). The effects of a multi-component intervention
the previous study by Mechling and Ayres (2012) found that on preschool children’s literacy skills. Topics in Early Childhood
compared to a smaller screen, the use of a larger screen (i.e., Special Education, 36(1), 15–29. https://doi.org/10.1177/
laptop) was associated with a higher percentage of correct 0271121415577399
responding in all participants when following the steps of the Dennis, L. R., Whalon, K., Kraut, L., & Herron, D. (2016). Effects of a
fine motor tasks delivered by video modeling. teacher versus iPad-facilitated intervention on the vocabulary of at-
risk preschool children. Journal of Early Intervention, 38(3),
170–186. https://doi.org/10.1177/1053815116663177
Conclusion Dib, N., & Sturmey, P. (2007). Reducing student stereotypy by
The current study contributes to the literature by directly com- improving teacher’s implementation of discrete-trial teaching.
paring effects of iPad-based flash cards and paper flash cards Journal of Applied Behavior Analysis, 40, 339–343. https://doi.
for teaching receptive labeling skills to learners with autism. org/10.1901/jaba.2007.52-06
Evidence from this study shows that iPad-assisted instruction Downs, A., Downs, R. C., Johansen, M., & Fossum, M. (2007). Using
for teaching receptive labeling skills are as effective as tradi- discrete trial teaching within a public preschool program to facil-
tional flash card assisted instruction. Also, iPad-assisted recep- itate skill development in students with developmental disabilities.
tive labeling instruction has the potential to facilitate within Education and Treatment of Children, 30(3), 1–27. https://doi.org/
stimulus prompts by highlighting the target stimulus or fading 10.1353/etc.2007.0015
out the nontarget stimuli relatively easily, which may benefit Fletcher-Watson, S., Petrou, A., Scott-Barrett, J., Dicks, P., Graham,
learners who are aversive to physical prompts or physical C., O’Hare, A., Pain, H., & McConachie, H. (2016). A trial of an
touch. Aside from delivering instructional commands, prompts, iPad™ intervention targeting social communication skills in chil-
and reinforcers, most apps can collect data and generate graphs, dren with autism. Autism: The International Journal of Research
which can alleviate challenges related to limited time and and Practice, 20, 771–782. https://doi.org/10.1177/13623613
resources for practitioners and families. However, the decision 15605624
to use technology to teach skills to learners with ASD should Ganz, J. B., Hong, E. R., Goodwyn, F., Kite, E., & Gilliland, W.
not be taken lightly and should be made on an individual basis (2015). Impact of PECS tablet computer app on receptive identi-
(Knight et al., 2013). fication of pictures given a verbal stimulus. Developmental
Ulzii et al. 11

Neurorehabilitation, 18(2), 82–87. https://doi.org/10.3109/ Surveillance Summaries, 69(4), 1–12. https://doi.org/10.15585/


17518423.2013.8215 mmwr.ss6904a1
Gast, D. L. (2014). General factors in measurement and evaluation. In Mechling, L. C., & Ayres, K. M. (2012). A comparative study:
D. L. Gast & J. R. Ledford (Eds.), Single case research methodol- Completion of fine motor office related tasks by high school
ogy: Applications in special education and behavioral sciences students with autism using video models on large and small
(2nd ed., pp. 85–104). Routledge. screen sizes. Journal of Autism and Developmental Disorders,
Grow, L. L., Carr, J. E., Kodak, T., Jostad, C. M., & Kisamore, A. N. 42(11), 2364–2373. https://doi.org/10.1007/s10803-012-1484-1
(2011). A comparison of methods for teaching receptive labeling to More, C. M., & Travers, J. C. (2013). What’s app with that? Selecting
children with autism spectrum disorders. Journal of Applied Beha- educational apps for young children with disabilities. Young
vior Analysis, 44, 475–498. https://doi.10.1901/jaba2011.44-475 Exceptional Children, 16(2), 15–32. https://doi.org/10.1177/
Grow, L. L., & LeBlanc, L. (2013). Teaching receptive language 1096250612464763
skills: Recommendations for instructors. Behavior Analysis in Neely, L., Rispoli, M., Camargo, S., Davis, H., & Boles, M. (2013).
Practice, 6(1), 56–75. https://doi.org/10.1007/BF03391791 The effect of instructional use of an iPad on challenging behavior
Grow, L. L., & Van Der Hijde, R. (2016). A comparison of procedures and academic engagement for two students with autism. Research
for teaching receptive labeling of sight words to a child with autism in Autism Spectrum Disorders, 7(4), 509–516. https://doi.org/10.
spectrum disorder. Behavior Analysis in Practice, 10(1), 62–66. 1016/j.rasd.2012.12.004
https://doi.org/10.1007/s40617-016-0133-0 Rakap, S., Snyder, P., & Pasia, C. (2014). Comparison of nonoverlap
Kagohara, D. M., van der Meer, L., Achmadi, D., Green, V. A., methods for identifying treatment effect in single-subject experi-
O’Reilly, M. F., Lancioni, G. E., Sutherland, D., Lang, R., mental research. Behavioral Disorders, 39(3), 128–145. https://
Marschik, P. B., & Sigafoos, J. (2012). Teaching picture naming doi.org/10.1177/019874291303900303
to two adolescents with autism spectrum disorders using systema- Rodrı́guez, C. D., & Cumming, T. M. (2017). Employing mobile
tic instruction and speech-generating devices. Research in Autism technology to improve language skills of young students with
language-based disabilities. Assistive Technology: The Official
Spectrum Disorders, 6(3), 1224–1233. https://doi.org/10.1016/j.
Journal of RESNA, 29(3), 161–169. https://doi.org/10.1080/
rasd.2012.04.001
10400435.2016.1171
Knight, V., McKissick, B. R., & Saunders, A. (2013). A review of
Scruggs, T. E., & Mastropieri, M. A. (1998). Summarizing single-
technology-based interventions to teach academic skills to students
subject research: Issues and applications. Behavior Modifications,
with autism spectrum disorder. Journal of Autism and Develop-
22(3), 221–242. https://doi.org/10.1177/01454455980223001
mental Disorders, 43(11), 2628–2648. https://doi.org/10.1007/
Sindelar, P. T., Rosenberg, M. S., & Wilson, R. J. (1985). An adapted
s10803-013-1814-y
alternating treatments design for instructional research. Education
Kover, S. T., McDuffie, A. S., Hagerman, R. J., & Abbeduto, L.
and Treatment of Children, 8(1), 67–76.
(2013). Receptive vocabulary in boys with autism spectrum dis-
Stages App (2016). Language builder pro (Version 1.3.0) [Mobile
order: Cross-sectional developmental trajectories. Journal of Aut-
app]. App Store. https://apps.apple.com/us/app/language-builder-
ism and Developmental Disorders, 43(11), 2696–2709. https://doi.
pro/id807695241
org/10.1007/s10803-013-1823-x
Stages Learning (2018). Language builder: Verbs and action words
Lee, A., Lang, R., Davenport, K., Moore, M., Rispoli, M., van der
[Flash card set]. https://www.stageslearning.com/products/lan
Meer, L., Carnett, A., Raulston, T., Tostanoski, A., & Chung, C.
guage-builder-verbs-action-words
(2015). Comparison of therapist implemented and iPad-assisted Sundberg, M. L. (2008). VB-MAPP verbal behavior milestones
interventions for children with autism. Developmental Neuroreh- assessment and placement program: A language and social skills
abilitation, 18(2), 97–103. https://doi.org/10.3109/17518423. assessment program for children with autism or other developmen-
2013.8302 tal disabilities: guide. AVB Press.
Lorah, E. R., & Karnes, A. (2016). Evaluating the language builder™ Vandermeer, J., Beamish, W., Milford, T., & Lang, W. (2015). iPad-
application in the acquisition of listener responding in young chil- presented social stories for young children with autism. Develop-
dren with autism. Journal of Developmental and Physical Disabil- mental Neurorehabilitation, 18, 75–81. https://doi.org/10.3109/
ities, 28(2), 255–265. https://doi.org/10.1007/s10882-015-9464-y 17518423.2013.809811
Lovaas, O. I. (1987). Behavioral treatment and normal educational and Volden, J., Smith, I. M., Szatmari, P., Bryson, S., Fombonne, E.,
intellectual functioning in young autistic children. Journal of Con- Mirenda, P., Roberts, W., Vaillancourt, T., Waddell, C., Zwaigen-
sulting and Clinical Psychology, 55(1), 3–9. https://doi.org/10.103 baum, L., Georgiades, S., Duku, E., & Thompson, A. (2011). Using
7/0022-006X.55.1.3 the preschool language scale, fourth edition to characterize lan-
Maenner, M. J., Shaw, K. A., Baio, J., Washington, A., Patrick, M., guage in preschoolers with autism spectrum disorders. American
DiRienzo, M., Christensen, D. L., Wiggins, L. D., Pettygrove, S., Journal of Speech-Language Pathology, 20(3), 200–208. https://
Andrews, J. G., Lopez, M., Hudson, A., Baroud, T., Schwenk, Y., doi.org/10.1044/1058-0360(2011/10-0035)
White, T., Rosenberg, C. R., Lee, L., Harrington, R. A., Huston, Weismer, S. E., Lord, C., & Esler, A. (2010). Early language patterns of
M., . . . Dietz, P. M. (2020). Prevalence of autism spectrum dis- toddlers on the autism spectrum compared to toddlers with devel-
order among children aged 8 years—Autism and developmental opmental delay. Journal of Autism and Developmental Disorders,
disabilities monitoring network, 11 Sites, United States, 2016. 40(10), 1259–1273. https://doi.org/10.1007/s10803-010-0983-
12 Journal of Special Education Technology XX(X)

Wolery, M., Gast, D. L., & Ledford, J. R. (2014). Comparison designs. ogy effectively for teaching skills to individuals with a disabil-
In D. L. Gast & J. R. Ledford (Eds.), Single case research meth- ity. She is an adjunct faculty at Nova Southeastern University.
odology: Applications in special education and behavioral
sciences (2nd ed., pp. 297–345). Routledge. Susan Kabot, EdD, CCC-SLP has developed and administered
Xin, J. F., & Leonard, D. A. (2015). Using iPads to teach communi- programs for children and young adults with autism for over 35
cation skills of students with autism. Journal of Autism and Devel- years. She teaches courses in autism at Nova Southeastern
opmental Disorders, 45, 4154–4164. https://doi.org/10.1007/ University at the undergraduate and graduate levels. She cur-
s10803-014-2266-8 rently is the Chair of the Florida Developmental Disabilities
Council and serves on the Panel of Professional Advisors for
the Autism Society.
Author Biographies
Christine Reeve, PhD, BCBA-D received a doctorate in Clin-
Davaa Ulzii, BCBA, has provided autism, early intervention, ical Psychology at SUNY Stony Brook. She has worked as a
and mental health services for over 10 years, and this study was consultant and trainer for schools for more than 20 years and
completed as partial fulfillment of the requirements for her adjunct faculty at Nova Southeastern University for the last 10
doctoral degree. Her research interest includes using technol- years.

You might also like