You are on page 1of 19

JOURNAL OF APPLIED BEHAVIOR ANALYSIS 2015, 48, 1–19 NUMBER 1 (SPRING)

EXAMINATION OF THE RELATION BETWEEN AN ASSESSMENT OF


SKILLS AND PERFORMANCE ON AUDITORY–VISUAL
CONDITIONAL DISCRIMINATIONS FOR CHILDREN
WITH AUTISM SPECTRUM DISORDER
TIFFANY KODAK
UNIVERSITY OF WISCONSIN–MILWAUKEE

ANDREA CLEMENTS AND AMBER R. PADEN


UNIVERSITY OF NEBRASKA MEDICAL CENTER’S MUNROE-MEYER INSTITUTE

BRITTANY LEBLANC
UNIVERSITY OF WISCONSIN–MILWAUKEE

JOSLYN MINTZ
UNIVERSITY OF NEBRASKA MEDICAL CENTER’S MUNROE-MEYER INSTITUTE

AND

KAREN A. TOUSSAINT
UNIVERSITY OF NORTH TEXAS

The current investigation evaluated repertoires that may be related to performance on auditory-to-
visual conditional discrimination training with 9 students who had been diagnosed with autism
spectrum disorder. The skills included in the assessment were matching, imitation, scanning, an
auditory discrimination, and a visual discrimination. The results of the skills assessment showed that
4 participants failed to demonstrate mastery of at least 1 of the skills. We compared the outcomes of
the assessment to the results of auditory–visual conditional discrimination training and found that
training outcomes were related to the assessment outcomes for 7 of the 9 participants. One
participant who did not demonstrate mastery of all assessment skills subsequently learned several
conditional discriminations when blocked training trials were conducted. Another participant who
did not demonstrate mastery of the auditory discrimination skill subsequently acquired conditional
discriminations in 1 of the training conditions. We discuss the implications of the assessment for
practice and suggest additional areas of research on this topic.
Key words: autism spectrum disorder, brief experimental analysis, conditional discrimination,
skills assessment

A fundamental component of many types of


We thank Keri Adolf, Whitney Brancht, Elizabeth tasks is engagement in discriminations among
Bullington, Vincent Campbell, Nitasha Dickes, Rashea
Fuchtman, Shaji Haq, Monica Howard, Ami Kaminski, stimuli, and this is typically a high-priority goal in
Tina Konrad, Megan Levesque, Sienna Schultz, Annelle educational programs for individuals with autism
Waterhouse, and Keri Walters for their assistance with spectrum disorder (ASD; Green, 1996). Teaching
various aspects of data collection. Portions of these data were children with ASD to discriminate among stimuli
collected while the first author was at the University of
Nebraska Medical Center’s Munroe-Meyer Institute. is accomplished through training simple and
Address correspondence to Tiffany Kodak, University of conditional discrimination skills. A simple dis-
Wisconsin–Milwaukee, 2441 E. Hartford Ave., Garland crimination contains three elements: an anteced-
210, Milwaukee, Wisconsin 53201 (e-mail: tiffany.kodak@
gmail.com). ent, response, and consequence. Responses that
doi: 10.1002/jaba.160 occur in the presence of an antecedent stimulus

1
2 TIFFANY KODAK et al.

are reinforced, but the response is not reinforced discriminations (i.e., matching arbitrary symbols)
in the presence of different antecedent stimuli during subsequent trial-and-error training. Before
(Green, 2001). An example of a simple visual the component simple discriminations were
discrimination is opening the door to a house taught, the participants did not demonstrate
when the deadbolt is unlocked but not when the mastery on the matching task. First, the
lock is engaged. Discrimination training with participants were taught the successive discrimi-
individuals with ASD may begin with a series of nation between the two sample stimuli. A
simple discriminations (e.g., following instruc- successive discrimination involves differential
tions) before training of more complex discrim- responding between sample stimuli that are
inations is initiated (Lovaas, 2003). presented in succession (e.g., responding at
Establishment of more advanced discrimina- differential rates between a picture of a bird and
tion skills is also important because many a picture of a dog presented sequentially). Next,
common educational tasks require a conditional the authors taught a simultaneous discrimination
discrimination. A conditional discrimination between two comparison stimuli by reinforcing
includes four components: a conditional or differential responding to one of the two stimuli
second-order discriminative stimulus, first-order (e.g., a picture of a bird and a dog that are
discriminative stimulus, response, and conse- presented simultaneously) during each session.
quence (Catania, 2012). Thus, a correct response The participant’s mastery of both component
in the presence of a particular first-order discriminations (i.e., successive and simultaneous)
discriminative stimulus depends on the presence was not sufficient to produce correct performance
or absence of another (conditional) discrimina- on the visual–visual conditional discrimination
tive stimulus that may not have any physically task during subsequent trial-and-error training.
distinguishing characteristics in common with Therefore, Saunders and Spradlin (1989) modi-
the first-order stimulus. Matching and many fied the training format. Initially, trial-and-error
listener responses are conditional discriminations training trials were intermixed so that two
that are frequently targeted in early intervention different conditional discrimination tasks were
programs (Green, 1996, 2001). Some listener alternated across successive trials. They subse-
responses may require an auditory–visual (A-V) quently modified training trials so that trials were
conditional discrimination because the child presented in blocks (i.e., the same sample stimulus
must respond to one antecedent stimulus in and comparison stimuli were presented repeatedly
the presence of an auditory conditional discrimi- with no alternation). When criterion performance
native stimulus. That is, the child engages in a was met with blocked trials, alternating trials were
nonvocal response (e.g., pointing to a picture of a subsequently faded back in. The block-trials
dog in an array of three pictures) after presenta- procedure and subsequent fading in of trial
tion of an auditory conditional discriminative alternation resulted in acquisition of the two
stimulus (e.g., “touch dog”). conditional discriminations.
Prior research on conditional discrimination Saunders and Spradlin (1989) showed that
training has evaluated whether establishing other teaching simple component discriminations was
simple discriminations might facilitate the acqui- insufficient to produce conditional discrimina-
sition of conditional discriminations (Grow, Carr, tion, and the use of blocked training trials was
Kodak, Jostad, & Kisamore, 2011; Saunders & necessary to promote acquisition of arbitrary
Spradlin, 1989, 1990). For example, Saunders visual-to-visual matching. However, this oc-
and Spradlin (1989) examined the effects of curred only after participants had been taught
teaching two-component simple discriminations simple discriminations. Therefore, it is unclear
on correct responding to visual–visual conditional whether the blocked trials would have been
ASSESSMENT OF SKILLS 3

effective if participants had not previously been inations, Level 4 measures identity matching, and
taught simple discriminations. Also, it is unclear Levels 5 and 6 measure A-V conditional discrim-
what additional skills participants had in their inations. Although studies on the ABLA show
repertoires before training. For example, both that this assessment can be used to identify
participants could engage in identity matching important foundational skills for A-V conditional
(e.g., matching identical pictures), and they discrimination training (e.g., Stubbings &
exhibited “functional speech” (p. 2). Therefore, Martin, 1995; Wacker, Steil, & Greenebaum,
it is possible that participants would not have 1983), this assessment tool may not be used
benefited from blocked training trials if they did frequently in classroom settings nor is it
not yet have these skills. In addition, the authors commercially available. Therefore, professionals
did not evaluate whether acquisition of the may benefit from additional assessment tools that
component discriminations or the blocking are more readily available for use with their clients
training procedure could facilitate acquisition or students.
of other types of conditional discrimination The ABLA also does not include a measure of
training (e.g., A-V conditional discriminations). scanning. Scanning an array of stimuli may be a
Additional skills might help to establish the critical skill needed to benefit from A-V
necessary repertoires for learners to acquire A-V conditional discrimination training, because
conditional discriminations. For instance, an A-V these discriminations are typically taught with
conditional discrimination requires an individual table-top learning tasks. That is, the trainer
to attend to and engage in a discrimination presents objects or pictures in an array on the
between auditory stimuli (e.g., the spoken words table in front of the participant, and the
“bird” and “dog”), scan an array of picture cards participant must scan each picture or object in
on the table, match an auditory stimulus to a this array. Looking at materials in an array has
visual stimulus, differentiate between important been shown to be a critical component of other
features of picture cards, and imitate the teacher’s types of instruction (e.g., discrete-trial training;
model (if the teacher points to or indicates the Smith, 2001). Therefore, measurement of scan-
correct picture in the array). Thus, skills such as ning ability may provide important information
auditory discrimination, scanning, matching, relevant to table-top instruction on A-V condi-
visual discrimination, and imitation may be tional discrimination tasks.
related to the development of A-V conditional The purpose of the current study was to
discriminations (Kerr et al., 1977; Mayville & evaluate potential skills that may be correlated
Mulick, 2010). with accurate performance on A-V conditional
Despite the importance of teaching A-V discrimination training. We evaluated whether
conditional discriminations and the large amount mastery-level responding on matching, visual
of time focused on teaching these skills during discrimination, auditory discrimination, imita-
children’s special education and early intervention tion of pointing, and scanning were related to
services, there are few assessment procedures that outcomes on A-V conditional discrimination
measure children’s specific skills that may be training.
related to performance on A-V conditional
discriminations. In a notable exception, the
METHOD
Assessment of Basic Learning Abilities (ABLA;
Kerr et al., 1977) measures skills relevant to Participants and Setting
learning A-V conditional discriminations. The Participants included nine children who had
assessment includes six levels: Level 1 measures been diagnosed with ASD. Seven of the
imitation, Levels 2 and 3 measure visual discrim- participants had received their diagnosis from a
4 TIFFANY KODAK et al.

multidisciplinary team of professionals who if the participant touched the target picture card or
specialized in the assessment and treatment of placed a picture card on top of an identical picture
ASD or developmental disabilities. Two partic- card in an array within 5 s of the initiation of the
ipants had received their diagnosis from an trial. We scored a prompted correct response if the
independent psychologist who was not associated participant touched the target picture card or
with the study. Refer to Table 1 for each placed a picture card on top of an identical card in
participant’s age, diagnosis, age-equivalence score an array within 5 s of a model prompt or if he or
on the Peabody Picture Vocabulary Test–4, and she physically guided. During A-V conditional
presence or absence of an echoic repertoire discrimination training, we defined a prompted
(defined as correctly repeating at least three correct response as touching the correct comparison
sounds or words during early intervention pro- stimulus within 5 s of the therapist’s model or after
gramming or on the Early Echoic Skills Assess- the therapist moved the correct comparison
ment developed by Barb Esch). All of the stimulus 15 cm closer to the participant. Scanning
participants had at least one individual education was defined as an uninterrupted shifting of the
plan goal related to learning A-V conditional participant’s eye gaze from one stimulus to the
discriminations, and five of them also had next. We converted each of these measures to a
this goal as part of their early intervention percentage after calculating the number of trials
programming. with the occurrence of a target behavior divided by
All participants attended either a hospital- the total number of trials in a session.
based early intervention program or a university- Two independent observers simultaneously
based research laboratory. We conducted sessions collected data on all dependent variables during at
in a private therapy room that contained a table, least 40% of sessions. A trial was scored as an
chairs, data collectors, and all relevant session agreement if both observers recorded the same
materials (e.g., picture cards, toys). target responses during the trial. We calculated
trial-by-trial agreement coefficients by dividing
Response Measurement and Interobserver the number of trials with an agreement by the
Agreement total number of trials in the session and
The dependent variables included unprompted converting the result to a percentage. Mean
correct responses, prompted correct responses, and agreement collected across all dependent variables
scanning. We scored an unprompted correct response (except scanning) for the skills assessment was
above 95% (range, 87% to 100%) for all
participants. Mean agreement for scanning was
Table 1 above 94% (range, 82% to 100%) for all
Participants’ Characteristics participants. A second observer also collected
data during 26% to 97% of all A-V conditional
Participant and age PPVTa age Echoic
(years:months) equivalence Diagnosis repertoire discrimination training sessions. Mean agree-
ment for all dependent variables for the A-V
Hal 5:1 <2 Autism No
Linda 8:3 3:6 Autism Yes conditional discrimination training was above
Rose 4:6 2:8 Autism Yes 90% (range, 90% to 100%) for all participants
Brandan 6:7 5:4 Autism Yes
Larry 5:1 <2 Autism No with the exception of Linda, whose mean
Freddy 9:4 <2 Autism No agreement was 90% (range, 56% to 100%).
Wyatt 4:3 2:9 Autism Yes
Josh 5:5 3:2 Autism, global Yes
developmental delay Procedural Integrity
Amar 5:10 2:10 Autism, Fragile X Yes A second observer also collected data on
a
Peabody Picture Vocabulary Test–4. procedural integrity during 41% to 94% of A-V
ASSESSMENT OF SKILLS 5

conditional discrimination training sessions for reached the mastery criterion. Our mastery
Hal, Rose, Linda, Brandan, Larry, Freddy, Wyatt, criterion for A-V conditional discrimination
and Amar. We also collected procedural integrity training was two consecutive sessions with un-
data for Josh; however, these data were collected prompted correct responses at or above 80%.
during only 12% of sessions. We scored an
instance of procedural integrity for each trial if the Preference Assessment
experimenter presented the stimuli as indicated We conducted multiple-stimulus-without-re-
on the data sheet, provided a clear and concise placement (MSWO) preference assessments daily
instruction, and provided the correct consequen- for tangible and edible items according to
ces after unprompted and prompted correct procedures described by Carr, Nicolson, and
responses or an incorrect response, as indicated in Higbee (2000). Participants received one of the
the protocol. We calculated procedural integrity top three items identified in the daily MSWO
for each session by dividing the total number of contingent on unprompted correct responses.
trials implemented with integrity by the total
number of trials in a session and converting the Skills Assessment
result to a percentage. Mean procedural integrity During each trial, the experimenter placed two
for treatment was above 95% (range, 96% to or three picture cards (10 cm by 15 cm) or a single
100%) for all participants. blank white card in front of the participant. We
conducted sessions in each condition until the
General Procedure mastery criterion was met or a total of seven
All skills assessment sessions contained 12 (Freddy only) or 10 sessions were conducted.
trials. Conditional discrimination training ses- Because the goal of this assessment was to
sions contained 10 (Josh), 12 (Wyatt and Amar), assess which skills were in participants’ existing
or 16 trials (Hal, Rose, Linda, Brandan, Larry, repertoires rather than to establish new skills, we
and Freddy). We conducted two to seven skills limited the number of sessions in each condition.
assessment sessions and two to six conditional Identity matching. The experimenter placed
discrimination training sessions per day, two to three picture cards in an array on the table in front
five times per week. We evaluated the effects of the participant, handed him or her a picture
of each condition of the skills assessment on card that matched the correct comparison
unprompted correct responses and scanning stimulus in the array, and said “match.” The
within a multielement design. We evaluated participant had 5 s to engage in a response. If the
whether participants acquired the target stimuli participant placed the picture card on top of the
during A-V conditional discrimination training identical picture in the array, the experimenter
within either a concurrent (Hal and Rose) or provided enthusiastic praise and access to a highly
nonconcurrent (Larry, Freddy, and Brandan) preferred edible or tangible item for 20 s. If he or
multiple baseline design across participants, a she did not respond within 5 s or emitted an error,
reversal design (Linda), or an adapted alternating the experimenter removed the array and moved
treatments design (Wyatt, Josh, and Amar). to the next trial. The location of the correct
The mastery criterion for the skills assessment comparison stimulus was randomly rotated across
was two consecutive sessions with unprompted trials, so that the correct comparison stimulus was
correct responses at or above 80%. We also used located in the left, middle, and right positions of
this criterion to determine mastery of scanning. the array an equal number of times in each
We continued to collect data on scanning, even session. The purpose of this condition was to
if the participant reached the mastery criterion, determine whether the participant had an
if unprompted correct responses had not yet established repertoire of identity matching with
6 TIFFANY KODAK et al.

picture cards. The data collectors measured in the correct response (i.e., either touching the
unprompted correct responses and scanning white card or refraining from touching the card
during each trial. by folding his or her hands in his or her lap or on
Imitation of pointing. The experimenter the table for 5 s), and delivered reinforcement.
placed two picture cards in an array on the table After two sessions at the 0-s prompt delay, the
in front of the participant and said “do this” while experimenter waited up to 5 s for a response and
she pointed to one of the pictures. If the did not provide any type of physical guidance for
participant pointed to the same picture card the 10 sessions whose data are shown in the
within 5 s, the experimenter provided enthusias- figures. The purpose of this condition was to
tic praise and 20-s access to a highly preferred evaluate whether the participant differentially
edible or tangible item. If the participant pointed responded across the two auditory stimuli.
to an incorrect picture card or did not respond Visual discrimination (all participants except
within 5 s, the experimenter removed the array Freddy). The experimenter presented two pic-
and moved to the next trial. She modeled ture cards on the table in front of the participant.
touching the stimulus located in the left and She did not provide any type of vocal prompt
right positions in the array an equal number of during trials. During each trial, touching one
times per session. The purpose of this condition picture card (e.g., a dog; S þ) within 5 s resulted
was to determine whether the participant could in reinforcer delivery in all sessions. If the
imitate the experimenter’s behavior with picture participant touched the second stimulus (e.g., a
cards. Data collectors measured unprompted triangle; S–) or did not engage in a response
correct responses and scanning during each trial. within 5 s, the experimenter removed the picture
Auditory discrimination. The experimenter cards and initiated the next trial. The Sþ was
placed a blank white picture card on the table placed in the left and right positions an equal
in front of the participant and presented one of number of times per session. As in the auditory
two auditory stimuli in a random order across discrimination condition, a 0-s prompt delay was
trials. If the participant touched the white card in conducted for the first two sessions (data not
the presence of one auditory stimulus (e.g., a cat shown) to ensure contact with the contingency
meowing; S þ) within 5 s, the experimenter for correct responding. During these sessions, the
delivered enthusiastic praise and a highly experimenter immediately physically guided the
preferred edible or tangible item for 20 s. The participant to touch the picture card associated
absence of a card touch in the presence of the with reinforcement and delivered praise and a
second auditory stimulus (e.g., a car horn; S–) highly preferred edible or tangible item. After
within 5 s produced reinforcement. If the two sessions at the 0-s prompt delay, the experi-
participant emitted an error (i.e., touched the menter did not provide physical guidance for the
card in the presence of the S– or did not touch the remainder of the sessions. The purpose of this
card in the presence of the S þ), the experimenter condition was to evaluate whether the partic-
removed the card and initiated the next trial. ipants differentially responded across visual
For the first two sessions of this condition (data stimuli. The visual discrimination condition
not shown), a 0-s prompt delay was used to was not conducted with Freddy because he
ensure contact with the contingency for correct demonstrated accurate visual discriminations
responding before independent correct perfor- before the study when he used pictures to
mance on the auditory discrimination was communicate.
assessed. During these sessions, the experimenter Scanning. We collected data for scanning
presented one of two auditory stimuli, immedi- during sessions from two other conditions
ately physically guided the participant to engage (identity matching and imitation trials) in the
ASSESSMENT OF SKILLS 7

skills assessment. We measured scanning during correct responding on none or one of four trials
these two conditions to evaluate potential differ- were included in treatment.
ences in participants’ scanning behavior when For the adapted alternating treatments design
they were required to scan two (imitation) or (Wyatt, Josh, and Amar), we attempted to equate
three (identity matching) pictures. The purpose the target responses across conditions by (a)
of this measurement was to evaluate whether assigning targets that had the same number of
participants consistently looked at each stimulus correct responses during the pretest, (b) matching
within an array of visual stimuli. the number of syllables in targeted words, and (c)
assigning targets with similar beginning sounds
Auditory–Visual Conditional Discrimination (e.g., bed and book) to different conditions. We
Training assigned three (Wyatt and Amar) or five (Josh)
The training procedures were based on those targets to each condition with an adapted
described by Kodak et al. (2011). In addition, we alternating treatments design. We assigned eight
included training procedures that were frequently targets for participants with a multiple baseline
used during conditional discrimination training design across participants or a reversal design.
in the participants’ classroom at school (e.g., Baseline. The experimenter placed three
baseline with praise, reinforcement condition) (Wyatt, Josh, and Amar) or four (Hal, Rose,
and early intervention programming (e.g., iden- Linda, Brandan, Larry, and Freddy) comparison
tity-matching prompt). During each trial, the stimuli on a table in front of the participant and
experimenter placed an array of three or four presented the auditory sample stimulus. Correct
stimuli in front of the participant on the table, responses within 5 s produced brief praise followed
presented the auditory sample stimulus, waited by presentation of the next instructional trial.
5 s for a response, and provided a consequence if Baseline without praise (Linda, Wyatt, and
relevant to the condition. For sessions with 12 Josh). The procedures were identical to baseline
trials, the presentation of stimuli was randomized except that the experimenter did not provide
so that each stimulus served as Sþ and S– an praise for correct responses. We removed praise
equal number of times across sessions, and each for correct responding for these participants
sample stimulus was equally placed in the left, because it was hypothesized that praise alone may
center, and right positions of the array. For function as reinforcement (based on responding
sessions with 10 or 16 trials, we attempted to in other instructional programs). The purpose of
equate the location of stimuli across sessions so baseline without praise was to evaluate respond-
that each stimulus served as an Sþ and S– an ing in the absence of reinforcement.
equal number of times in each session or across Reinforcement. The procedures were similar to
blocks of four sessions. baseline except that the experimenter delivered
Pretest. To identify potential target stimuli to praise and a highly preferred stimulus (i.e., one
include in training, the experimenter placed three small piece of food or 20-s access to a leisure item)
(Wyatt, Josh, and Amar) or four (Hal, Rose, after correct responses within 5 s of the auditory
Linda, Brandan, Larry, and Freddy) comparison sample stimulus. If the participant made an error
stimuli on the table in front of the participant and or did not respond within 5 s, the next trial began.
presented an auditory sample stimulus (e.g., Position prompt and reinforcement. This con-
“banana”). If the participant responded correctly dition was identical to the reinforcement condi-
within 5 s of the auditory sample stimulus, the tion except that we included a 5-s constant
experimenter provided brief praise. The experi- prompt delay (Karsten & Carr, 2009) during
menter presented each stimulus four times in training. The experimenter conducted one
random order. Only stimuli associated with session at a 0-s prompt delay for all participants
8 TIFFANY KODAK et al.

with an adapted alternating treatments design Blocking plus identity-matching prompt and
(Wyatt, Josh, and Amar; 0-s session data are not reinforcement (Hal only). This condition was
shown), and increased the delay to 5 s in the identical to the identity-matching prompt and
second session of training. Contingent on an reinforcement condition except that we reduced
unprompted correct response, the experimenter the size of the array and taught stimuli in pairs
delivered praise and a preferred item. Contingent using the blocking procedure described by Sa-
on an error or no response within 5 s, the unders and Spradlin (1990). The experimenter
experimenter presented a prompt by moving the repeatedly presented one sample stimulus during
correct comparison stimulus approximately all 16 trials until Hal showed correct unprompted
15 cm closer to the participant and then re- responses during at least 80% of trials for one
presenting the auditory sample stimulus. If the session (i.e., the mastery criterion for reducing
participant touched the correct comparison the block size). Contingent on an error or no
stimulus that was 15 cm closer, this was recorded response within 5 s of the initiation of the trial, the
as a prompted correct response and only praise experimenter delivered the identity-matching
was delivered. If the participant did not emit a prompt. Unprompted correct responses produced
correct prompted response, the experimenter praise and a preferred item. Prompted correct
removed the material and initiated the next trial. responses produced praise only. Incorrect promp-
Model prompt and reinforcement (Amar only). ted responses resulted in the initiation of the next
This condition was identical to the position- trial. After Hal’s correct unprompted responding
prompt condition except that instead of moving reached the mastery criterion, the second sample
the correct comparison stimulus contingent on stimulus was presented during all 16 trials until Hal
an error or no response within 5 s, the reached mastery. The experimenter reduced the
experimenter modeled the correct response by size of the blocks of trials by half (eight trials of each
pointing to the correct comparison stimulus stimulus) until responding met the 80% criterion.
while she re-presented the auditory sample The experimenter continued to reduce the size of
stimulus. As in the position-prompt condition, the blocks by half (i.e., four, then two, randomly
the experimenter provided praise and an edible alternating between stimuli) each time correct
item for unprompted correct responses and praise unprompted responding reached the mastery
only for prompted correct responses. If the criterion. We repeated the blocking procedure
participant did not emit a correct prompted with additional pairs of stimuli until Hal mastered
response, the experimenter removed the materials all eight stimuli in this condition.
and initiated the next trial.
Identity-matching prompt and reinforcement
RESULTS
(Hal and Amar). This condition was identical
to the position-prompt condition except that The results of each participant’s skills assess-
instead of moving the correct comparison 15 cm ment are summarized in Table 2. Figure 1 shows
closer to the participant contingent on an error or the results of the skills assessment for Hal, Rose,
no response within 5 s, the experimenter pre- and Linda. Hal reached mastery criterion in only
sented an identity-matching prompt (Fisher, the matching condition. Rose displayed mastery-
Kodak, & Moore, 2007). That is, the experi- level responding in all assessment conditions
menter held up a picture card that was identical to within two sessions except for the auditory
the correct comparison stimulus and said, “This discrimination condition, which took nine
is a —. Point to —.” Unprompted correct sessions. Linda also met the mastery criterion in
responses produced praise and a preferred item. all assessment conditions, and she mastered each
Prompted correct responses produced praise only. condition within two sessions. Hal, Rose, and
ASSESSMENT OF SKILLS 9

Table 2

Trials per Identity Auditory Visual A-V


Participant session matching Imitation discrimination discrimination Scan CD
Hal 16 þ    þ þa
Rose 16 þ þ þ þ þ þ
Linda 16 þ þ þ þ þ þ
Brandan 16 þ þ þ þ þ þ
Larry 16 þ þ  þ þ 
Freddy 16 þ þ  þ þ 
Wyatt 12 þ þ þ þ þ þ
Josh 10 þ þ þ þ þ þ
Amar 12 þ þ  þ þ þ

Note. The number of training trials per session during A-V conditional discrimination training (A-V CD), and
responding that met (þ) or did not meet () the mastery criterion during identity-matching, imitation, auditory
discrimination, visual discrimination, and scanning conditions. The final column shows whether the participants
acquired the A-V conditional discriminations during training in at least one condition.
a
An alternative training procedure was required to produce mastery during training.

Linda exhibited high levels of scanning behavior responding met the mastery criterion in the
during the matching and imitation conditions. imitation condition. Josh met the mastery
Figure 2 shows the results of the skills criterion for all assessed skills, although he
assessment for Brandan, Larry, and Freddy. required three sessions to demonstrate mastery
Brandan met the mastery criterion in all in the visual discrimination condition. Amar met
assessment conditions within two sessions. Larry the mastery criterion in the imitation, visual
reached the mastery criterion in all assessment discrimination, and matching conditions. How-
conditions except for the auditory discrimination ever, he did not meet the mastery criterion in the
condition. Freddy met the mastery criterion auditory discrimination condition.
during the matching and imitation conditions The results of conditional discrimination
but not during the auditory discrimination training are displayed in Table 2 and Figures 4
condition. Brandan and Freddy exhibited high and 5. The results for Hal, Rose, and Linda are
levels of scanning during the matching and displayed in Table 2. Their conditional discrimi-
imitation conditions. Larry showed levels of nation training results are not shown but are
scanning in the second matching session and in available in Kodak et al. (2011). Hal’s results (p.
both sessions of the imitation condition. There- 1065; Figure 2, bottom) showed that conditional
fore, the results indicated that Brandan and Larry discrimination training using reinforcement,
had all assessed skills in their repertoire, and position prompt, or identity matching did not
Freddy showed three of the four assessed skills. result in mastery performance, whereas training
Figure 3 shows the results of the skills using a blocking procedure did result in criterion
assessment for Wyatt, Josh, and Amar. Wyatt performance (p. 1072; Figure 8). Blocking has
met the mastery criterion for all assessed skills been shown to produce conditional discrimina-
within two sessions per condition except for tions with sets of two targets at a time (Saunders
scanning. He engaged in scanning in 90% of & Spradlin, 1989, 1990). Hal’s skills assessment
trials during one session of the imitation results correlated with the results of his A-V
condition, and he displayed lower levels of conditional discrimination, because he did not
scanning in the second session. Additional show mastery of auditory and visual discrim-
sessions were not conducted because his correct inations or imitation in the skills assessment nor
10 TIFFANY KODAK et al.

Figure 1. The percentage of correct responses (left) and scanning (right) during the skills assessment for Hal (top), Rose
(middle), and Linda (bottom).

did he learn A-V conditional discriminations conditional discriminations in the reinforcement


through standard training procedures (e.g., condition, which corresponds to criterion perfor-
prompt delay). However, his assessment results mance in all conditions of their skills assessment.
were not correlated with his outcomes during The conditional discrimination training re-
blocking. Rose (p. 1069; Figure 6, middle) and sults for Brandan, Larry, and Freddy are shown in
Linda (p. 1067; Figure 4) showed mastery of A-V Figure 4, which displays unprompted correct
ASSESSMENT OF SKILLS 11

Figure 2. The percentage of correct responses (left) and scanning (right) during the skills assessment for Brandan (top),
Larry (middle), and Freddy (bottom).

responses only. Brandan’s unprompted correct conditional discrimination training. Larry’s re-
responses reached the mastery criterion in the sponding remained low in the reinforcement
reinforcement condition after 11 sessions. condition and was variable and at chance level
Therefore, Brandan’s mastery performance in in the position-prompt condition. Larry’s low
all conditions of the skills assessment was levels of responding during A-V conditional
correlated with his mastery of targets during discrimination training were correlated with his
12 TIFFANY KODAK et al.

Figure 3. The percentage of correct responses (left) and scanning (right) during the skills assessment for Wyatt (top), Josh
(middle), and Amar (bottom).

outcomes on the skills assessment, which showed and position-prompt conditions. Thus, we
that he did not display accurate responding to the observed a correlation between Freddy’s A-V
auditory discrimination task. Freddy’s training conditional discrimination training and the
data showed consistently low levels of unprompt- results of his skills assessment, because he
ed correct responding across the reinforcement did not master A-V conditional discriminations
ASSESSMENT OF SKILLS 13

Figure 4. The percentage of correct responding during


conditional discrimination training for Brandan, Larry, and
Freddy. BL ¼ baseline; Srþ ¼ reinforcement condition.

or auditory discriminations in the skills


assessment.
The conditional discrimination training results
for Wyatt, Josh, and Amar are shown in Figure 5,
which displays unprompted correct responses
only. We used an adapted alternating treatments
Figure 5. The percentage of correct responses during
design with these participants to compare the conditional discrimination training for Wyatt (top), Josh
effects of several training procedures on acquisi- (middle), and Amar (bottom).
tion of targeted A-V conditional discriminations.
Wyatt’s unprompted correct responses were at or
below chance level in baseline. During training, showed an immediate increase in unprompted
he reached the mastery criterion in the position- correct responses in the position-prompt condi-
prompt condition after four sessions and in the tion, and he reached the mastery criterion after
reinforcement condition after nine sessions. His two sessions. His unprompted correct responses
responding remained near chance level in the did not meet the mastery criterion in the
control condition. Josh’s results showed that reinforcement or control conditions, despite
unprompted correct responses were low and the fact that more than double the number of
consistent across conditions in baseline. He training sessions were conducted than in the
14 TIFFANY KODAK et al.

position-prompt condition. Overall, the skills condition of the skills assessment, he exhibited
assessment outcomes for Wyatt and Josh corre- different response latencies in the presence of the
lated with those obtained during A-V conditional Sþ and S– during this condition. Amar’s latency
discrimination training, because they demon- from stimulus presentation to touching the card
strated mastery of all conditions in the skills averaged 1.4 s in the presence of the Sþ and 3.3 s
assessment and acquired A-V conditional dis- in the presence of the S–. Although Amar’s
criminations in at least one training condition. response latency was different in the presence of
Amar engaged in low levels of correct each auditory stimulus, these data were not used
responding in all conditions in baseline. After for determining mastery performance because we
the introduction of training, Amar demonstrated did not conduct similar analyses with the other
mastery of the targets in the reinforcement participants to determine mastery performance in
condition in eight sessions. We discontinued this condition.
training in the identity-matching and model- This study replicates and extends the existing
prompt conditions after we had conducted more literature on A-V conditional discrimination
than twice the number of sessions required to training in several ways. First, the current
produce mastery in the reinforcement condition. investigation extends the literature on measuring
Amar was near the mastery criterion during some skills that may be related to accurate performance
sessions of the identity-matching condition, and during visual–visual conditional discrimination
he frequently labeled the target stimuli as well as (Saunders & Spradlin, 1989) to A-V conditional
other stimuli by their correct color (e.g., pointed discrimination. Both participants in Saunders
at green items and said “green”). He did not and Spradlin (1989) exhibited functional speech
frequently label items by the colors included in and identity matching before participation in the
the model-prompt condition. Overall, the out- study. Although all of the participants in the
comes of Amar’s A-V conditional discrimination present investigation demonstrated accurate
training and his skills assessment were inconsis- identity matching in the skills assessment, they
tent, because mastery-level responding during had limited vocal repertoires. In fact, all but one
A-V conditional discrimination training did not of the participants who failed the auditory
correlate with his low levels of correct responding discrimination condition in the skills assessment
in the auditory discrimination condition of the could echo (i.e., point-to-point correspondence
skills assessment. with an auditory verbal stimulus; Skinner, 1957)
fewer than three sounds (see Table 2 for a list of
participants who did and did not echo). The
DISCUSSION
strength of an individual’s echoic repertoire may
The results of the skills assessment were have implications for A-V conditional discrimi-
correlated with outcomes of A-V conditional nation training because participants who do not
discrimination training for seven of our nine echo words or sounds may be unable to engage in
participants. A lack of correspondence was a successive discrimination between auditory
observed for Hal and Amar. Both of these sample stimuli (i.e., an auditory discrimination).
participants did not show criterion performance In this case, participants who are unable to
during the skills assessment and subsequently discriminate between the auditory sample stimuli
demonstrated mastery during conditional dis- dog, banana, and cat during A-V conditional
crimination training in either the blocking discrimination training will be unlikely to benefit
(Hal) or reinforcement (Amar) training condi- from this type of training. However, all of the
tion. Although Amar did not exhibit criterion participants in our study had goals related to A-V
performance during the auditory discrimination conditional discrimination and were working on
ASSESSMENT OF SKILLS 15

these skills in their classroom settings. The conditional discriminations. Although partici-
relation between a child’s echoic repertoire and pants could attend to stimuli at various points in
success with A-V conditional discrimination time without scanning from one picture to the
training should be investigated further in future next, scanning may be beneficial when arrays of
studies. materials are presented. For example, during
Previous research that measured skills for A-V training of sight words, students should scan all
conditional discrimination training suggests the letters within each word in the array to assist
that the conditions included in the skills assess- in acquiring discriminations among written
ment are helpful variables to measure before A-V words that are similar (e.g., seen and sees).
conditional discrimination training is initiated Responding may be inaccurate if the student
(e.g., Martin, Yu, & Vause, 2004). The compo- does not scan each and every letter in every word
nents of the current skills assessment are before responding. Anecdotal observations of
similar to conditions included in the ABLA participants in the current study indicated that
(Kerr et al., 1977). However, there are a few they may have scanned the array until they
distinctions worth noting. First, tasks in the reached the picture associated with the correct
ABLA occur in a particular order. For example, response in a trial. We observed this pattern of
the ABLA measures imitation before matching is responding during Larry’s first matching session
evaluated. If an individual does not demonstrate in the skills assessment. He frequently scanned
mastery at one level, the assessment ends. the array until he came to the comparison
Although it is reasonable to discontinue an stimulus that matched the sample stimulus (an
assessment if it is presumed that the individual identical picture). Thus, he frequently responded
will not demonstrate mastery of skills at higher correctly despite not having scanned the entire
levels, the results of the current investigation array of comparison stimuli. Although measuring
challenge whether mastery of one task is necessary scanning in this way may underestimate the
for mastery of a different task. For example, Hal participant’s level of scanning within the session
demonstrated mastery of matching but not by omitting instances of partial or incomplete
imitation, auditory discriminations, or visual scanning of the array, scanning an entire array is
discriminations. In addition, all but one of the an important skill for many educational tasks.
participants who failed at least one condition in More research on levels of scanning and accurate
the skills assessment demonstrated mastery of responding during conditional discrimination
matching in just two sessions (the fewest number training is warranted.
of sessions possible to conduct in the assessment, The present investigation also extends Kodak
based on the mastery criterion). Thus, it remains et al. (2011) and Lerman, Vorndran, Addison,
unclear whether the difference in performance and Kuhn (2004) by evaluating a variety of
across skills relates to the types of tasks included interventions for training conditional discrim-
in our assessment compared to the ABLA or some inations. Kodak et al. conducted a brief ex-
other variable. perimental analysis (BEA; e.g., Eckert, Ardoin,
The current skills assessment measured scan- Daly, & Martens, 2002) of instructional variables
ning, which is not a behavior that is measured in that influence acquisition of A-V conditional
the ABLA. Correct performance on A-V condi- discriminations and found that the BEA accu-
tional discriminations is facilitated if the partici- rately identified an intervention that was
pant attends to the comparison stimuli in the equally or more efficient than an arbitrarily
array before he or she responds (Fisher selected intervention. The conditional discrimi-
et al., 2007; Smith, 2001). However, less is nation training results for Amar, Josh, and
known about the role of scanning during A-V Wyatt replicate and extend prior work on BEA
16 TIFFANY KODAK et al.

by applying this method to the identification of whereas other participants had a greater number
effective academic interventions for individuals of sessions in this condition. Therefore, it is
with ASD or global developmental delay. Similar possible that Freddy could have demonstrated
to the results of Lerman et al., our conditional mastery of the auditory discriminations had we
discrimination training data also indicated that conducted an additional three sessions. In
the most effective and efficient training proce- addition, we did not include a visual discrimina-
dure varied across participants, although we did tion condition with Freddy because he consis-
not compare the same interventions with all tently engaged in accurate visual discriminations
participants. This collection of studies suggests when he communicated using pictures in other
the importance of conducting brief assessments settings. It may have been helpful to include a
to determine instructional strategies that will visual discrimination condition to demonstrate
produce the most rapid learning for children with mastery of this skill and maintain consistency
ASD. across participants.
The current study replicates previous research Another limitation of the study was that we did
on differential reinforcement during skill acqui- not collect data on the duration of the skills
sition (e.g., Karsten & Carr, 2009; Vladescu & assessment. Our long-term goal is for teachers,
Kodak, 2010). Several of our participants school psychologists, behavioral consultants, and
acquired A-V conditional discriminations in the other practitioners to use the skills assessment
reinforcement condition (Rose, Brandan, and with students before A-V conditional discrimi-
Amar). Of particular interest are the data from nation training is conducted. Therefore, infor-
Amar’s conditional discrimination training in mation regarding the efficiency of the assessment
which he acquired targets in the reinforcement tool would be useful. Future research on this
condition before he acquired targets in conditions assessment procedure should measure the
that included both prompting and differential amount of time required to complete the
reinforcement. Previous evaluations with Amar assessment. It is also unclear if a 10-session
showed that praise functioned as reinforcement. maximum is an appropriate discontinuation
In the current investigation, the type of differen- criterion. Rose was the only participant in the
tial reinforcement across conditions varied. The current study who demonstrated mastery of one
reinforcement condition was associated with of the targeted skills after the fifth session. It may
different schedules of reinforcement (i.e., a be possible to decrease the total number of
fixed-ratio 1 schedule of reinforcement for sessions further to improve the efficiency of this
unprompted correct responses and extinction assessment tool. However, any attempts to
for incorrect or no responses). In comparison, improve efficiency should be evaluated in relation
conditions that included prompts produced to the potential for inaccurate outcomes.
different qualities of reinforcement (i.e., high- We used a nonconcurrent multiple baseline
quality praise and edible items for unprompted design across participants with Brandan, Larry,
correct responses and lower quality praise for and Freddy during conditional discrimination
prompted correct responses). Our findings training. We recommend use of the adapted
highlight the need for additional research that alternating treatments design in future studies so
compares the effects of different types of that each participant serves as his or her own
differential reinforcement (i.e., different sched- control. In addition, the skills assessment did not
ules, differences in quality) on skill acquisition. include a control condition. Inclusion of a control
There were several limitations of the current condition in a multielement design permits a
study. First, Freddy’s skills assessment included demonstration of experimental control when all
only seven auditory discrimination sessions, test conditions in the assessment produce similar
ASSESSMENT OF SKILLS 17

levels of responding. The absence of a control ing. It may be possible in future research to
condition is less problematic in assessments in modify the procedures in certain conditions to
which we observed differentiated levels of correct enhance the accuracy or efficiency of this
responding across conditions (Hal, Rose, Larry, assessment. For example, if echoic behavior is
Freddy, and Amar). Future studies using similar predictive of correct responding during the
skills assessments could include at least one auditory discrimination condition, this condition
relevant control condition to demonstrate that could be replaced with an echoic assessment such
changes in responding in assessment conditions as the Early Echoic Skills Assessment included in
are related to the independent variable and not the Verbal Behavior Milestones Assessment and
some extraneous variable. Placement Program (Sundberg, 2008). Further-
The use of only two stimuli in the visual more, if the individual consistently uses the
discrimination condition of the skills assessment picture exchange communication system (PECS)
could also be considered a limitation. Children to communicate with others and has completed
may be more likely to demonstrate position biases Phase 3 of PECS training (Bondy & Frost, 2001),
in smaller arrays of stimuli due to the likelihood a visual discrimination condition could be
of reinforcement (Kangas & Branch, 2008; omitted.
MacKay, 1991). That is, responding to one Our participants’ inaccurate responding dur-
position in a two-stimulus array is reinforced on ing the auditory discrimination condition war-
approximately a variable-ratio 2 schedule. A rants further investigation. Incorrect responding
larger array of stimuli could be included in future during this condition may be related to
studies with a visual discrimination condition. In inadequately developed auditory discrimination
addition, our skills assessment did not inform a skills or a prior history of reinforcement for
specific instructional strategy to use during A-V engaging in a card-touch response. All of the
conditional discrimination training. Future stud- participants had a history of reinforcement for
ies could evaluate whether modification of the pointing to or touching cards presented in an
current conditions or the addition of specific array. Although we did not specifically program
conditions would inform the selection of an alternative response to engage in during the
instructional strategies. presentation of one auditory stimulus (S–), we
The present investigation did not seek to did guide the participants to keep their hands
demonstrate a causal link between the absence of together in their laps or on the table during these
certain skills measured in the assessment and trials in the 0-s prompt-delay sessions. Thus,
failure to acquire targets during A-V conditional clasping one’s hands together could be considered
discrimination training. This endeavor would an alternative response that was reinforced during
require teaching skills not associated with relevant 0-s prompt-delay trials. We based our
mastery-level responding on the skills assessment auditory discrimination condition procedures on
and conducting A-V conditional discrimination prior go/no-go research, in which participants
training after the missing skills had been refrain from responding to a compound visual
mastered. Our research team is currently investi- stimulus (two symbols presented side by side)
gating whether doing so will improve outcomes if the symbols are not arbitrarily related (e.g.,
on conditional discrimination training for stu- Debert, Matos, & McIlvane, 2007). However,
dents who initially fail to demonstrate mastery of specifically programming two nonvocal responses
these skills. (e.g., clapping and raising arms) in the auditory
It remains unclear whether we identified all of discrimination condition may be preferable for
the repertoires that are correlated with perfor- students with a history of reinforcement for card
mance on A-V conditional discrimination train- touching.
18 TIFFANY KODAK et al.

The present investigation offers preliminary Kangas, B. D., & Branch, M. N. (2008). Empirical
information on measuring behavioral repertoires validation of a procedure to correct position and
stimulus biases in matching-to-sample. Journal of the
within a skills assessment that can be used by Experimental Analysis of Behavior, 90, 103–112. doi:
professionals who seek to teach A-V conditional 10.1901/jeab.2008.90-103
discriminations to individuals with ASD. Con- Karsten, A. M., & Carr, J. E. (2009). The effects of
differential reinforcement of unprompted responding
ducting assessments that determine the presence on the skill acquisition of children with autism. Journal
or absence of related skills may prevent exposing of Applied Behavior Analysis, 42, 327–334. doi:
students to lengthy training from which they are 10.1901/jaba.2009.42-327
unlikely to benefit. Kerr, N., Meyerson, L., Flora, J., Tharinger, D., Schallert,
D., Casey, L., & Fehr, M. J. (1977). The measurement
of motor, visual, and auditory discrimination skills in
mentally retarded children and adults and in young
REFERENCES normal children. Rehabilitation Psychology, 24, 91–206.
doi: 10.1037/h0090912
Bondy, A., & Frost, L. (2001). The picture exchange Kodak, T., Fisher, W. W., Clements, A., Paden, A. R., &
communication system. Behavior Modification, 25, Dickes, N. R. (2011). Functional assessment of
725–744. doi: 10.1177/0145445501255004 instructional variables: Linking assessment and treat-
Carr, J. E., Nicolson, A. C., & Higbee, T. S. (2000). ment. Research in Autism Spectrum Disorders, 5, 1059–
Evaluation of a brief multiple-stimulus preference 1077. doi: 10.1016/j.rasd.2010.11.012
assessment in a naturalistic context. Journal of Applied Lerman, D. C., Vorndran, C., Addison, L., & Kuhn, S. A. C.
Behavior Analysis, 33, 353–357. doi: 10.1901/ (2004). A rapid assessment of skills in young children
jaba.2000.33-353 with autism. Journal of Applied Behavior Analysis, 37,
Catania, A. C. (2012). Learning (5th ed.). Cornwall-on- 11–26. doi: 10.1901/jaba.2004.37-11
Hudson, NY: Sloan. Lovaas, O. I. (2003). Teaching individuals with developmental
Debert, P., Matos, M. A., & McIlvane, W. (2007). delays: Basic intervention techniques. Austin, TX: Pro-
Conditional relations with compound abstract stimuli Ed.
using a go/no-go procedure. Journal of the Experimental MacKay, H. A. (1991). Conditional stimulus control. In I.
Analysis of Behavior, 87, 89–96. doi: 10.1901/ H. Iversen & K. A. Lattal (Eds.), Techniques in the
jeab.2007.46-05 behavioral and neural sciences: Vol. 6. Experimental
Eckert, T. L., Ardoin, S. P., Daly, E. J., III, & Martens, B. K. analysis of behavior (Part 1, pp. 301–350). Amsterdam:
(2002). Improving oral reading fluency: A brief Elsevier.
experimental analysis of combining an antecedent Martin, G. L., Yu, C. T., & Vause, T. (2004). Assessment of
intervention with consequences. Journal of Applied Basic Learning Abilities test: Recent research and future
Behavior Analysis, 35, 271–281. doi: 10.1901/ directions. In W. L. Williams (Ed.), Advances in
jaba.2002.35-271 developmental disabilities: Etiology, assessment and
Fisher, W. W., Kodak, T., & Moore, J. W. (2007). intervention (pp. 161–176). Reno, NV: Context Press.
Embedding an identity-matching task within a Mayville, E. A., & Mulick, J. (Eds.). (2010). Behavioral
prompting hierarchy to facilitate acquisition of condi- foundations of effective autism treatment. Cambridge,
tional discriminations in children with autism. Journal MA: Sloan.
of Applied Behavior Analysis, 40, 489–499. doi: Saunders, K. J., & Spradlin, J. E. (1989). Conditional
10.1901/jaba.2007.40-489 discrimination in mentally retarded adults: The effect of
Green, G. (1996). Early behavioral intervention for autism: training the component simple discriminations. Journal
What does research tell us? In C. E. Maurice, G. E. of the Experimental Analysis of Behavior, 52, 1–12. doi:
Green, & S. C. Luce (Eds.), Behavioral intervention for 10.1901/jeab.1989.52-1
young children with autism (pp. 22–44). Austin, TX: Saunders, K. J., & Spradlin, J. E. (1990). Conditional
Pro-Ed. discrimination in mentally retarded adults: The
Green, G. (2001). Behavior analytic instruction for learners development of generalized skills. Journal of the
with autism: Advances in stimulus control technology. Experimental Analysis of Behavior, 54, 239–250. doi:
Focus on Autism and Other Developmental Disabilities, 10.1901/jeab.1990.54-239
16, 72–85. doi: 10.1177/108835760101600203 Skinner, B. F. (1957). Verbal behavior. East Norwalk, CT:
Grow, L. L., Carr, J. E., Kodak, T. M., Jostad, C. M., & Appleton-Century-Crofts. doi: 10.1037/11256-000
Kisamore, A. N. (2011). A comparison of methods for Smith, T. (2001). Discrete trial training in the
teaching receptive labeling to children with autism treatment of autism. Focus on Autism and Other
spectrum disorders. Journal of Applied Behavior Analysis, Developmental Disabilities, 16, 86–92. doi: 10.1177/
44, 475–498. doi: 10.1901/jaba.2011.44-475 108835760101600204
ASSESSMENT OF SKILLS 19

Stubbings, V., & Martin, G. L. (1995). The ABLA Behavior Analysis, 43, 351–355. doi: 10.1901/
test for predicting performance of developmentally jaba.2010.43-351
disabled persons on prevocational training tasks. Wacker, D. P., Steil, D. A., & Greenbaum, F. T. (1983).
International Journal of Practical Approaches to Disability, Assessment of discrimination skills of multiply-handi-
19, 12–17. doi: 10.1352/0895-8017(1998)102 capped preschoolers and prediction of classroom task
<0473:MTTTAO>2.0.CO;2 performance. Journal of the Association for the Severely
Sundberg, M. L. (2008). Verbal Behavior Milestones Handicapped, 8, 65–78.
Assessment and Placement Program. Concord, CA:
AVB Press.
Vladescu, J. C., & Kodak, T. (2010). A review of recent Received December 10, 2012
studies on differential reinforcement during skill Final acceptance May 29, 2014
acquisition in early intervention. Journal of Applied Action Editor, Eileen Roscoe

You might also like