Professional Documents
Culture Documents
MICHELE POPYNICK
EDITE PONTES
SHARON STEELE
Surrey Place Centre
The authors would like to thank Tom Bowman for his support of this research, Zhu-hui Li
for assistance with data summary, and Tina Pecile for computer graphics. Requests for reprints
should be sent to Joe Ducharme, Centre for Behavioural Rehabilitation, Acquired Brain Injury
Program, Chedoke-McMaster Hospitals, Box 2000, Hamilton, Ontario, L8N 3Z5.
353 0005-7894/96/0353-037251.00/0
Copyright 1996 by Associationfor Advancementof BehaviorTherapy
All rights of reproduction in any form reserved.
354 DUCHARME ET AL.
Long, 1988). With this approach, parents serve as intervention agents and
are typically trained to deliver effective requests, to reinforce child coopera-
tion, and to apply consequences for noncompliance, such as time-out and
manual guidance.
Extensions of this research have recently been conducted to determine strat-
egies for increasing compliance while reducing the need for physical inter-
ventions contingent on noncompliance. Although such consequences have
been demonstrated effective (e.g., Forehand & King, 1977; Peed, Roberts,
& Forehand, 1977; Parrish et al., 1986), implementation may require the use
of force and may result in resistance and confrontation (Roberts, 1982, 1984).
Recent research on "errorless" compliance training (Ducharme & Popynick,
1993; Ducharme et al., 1994; Ducharme, in press) has demonstrated that
many children, with or without clinical diagnoses, who exhibit severe non-
compliance (levels that would typically result in a clinical referral) can be
taught generalized compliance without need for physical consequences.
Errorless compliance training involves observational assessment to deter-
mine probability of child compliance to a range of parental requests and sub-
sequent development of a hierarchy of four request probability levels, specific
to the individual child, based on these compliance probabilities. During as-
sessment and subsequent treatment, parents deliver requests in a naturalistic
manner at times when the request is relevant to the family schedule.
At treatment initiation, children are exposed almost exclusively to requests
from the first compliance probability level (requests empirically determined
to yield high levels of compliance). Opportunities for parents to provide abun-
dant contingent reinforcement are thus frequent. Succeeding probability
levels are systematically introduced over several weeks until the child even-
tually demonstrates increased compliance to requests from the fourth prob-
ability level (those that posed serious pretreatment difficulty to parents.)
We labeled this approach "errorless" because the observational assessment
of compliance probabilities enables systematic introduction of increasingly
more demanding requests at a gradual rate that is easily manageable to the
child. Response errors (i.e., noncompliant responses) are thus greatly re-
duced throughout treatment, rendering decelerative consequences, and the
stressful physical encounters that sometimes accompany them, unnecessary.
With the errorless compliance intervention, the child learns to cooperate
while experiencing high levels of success and parent praise.
We examined several important treatment issues in the first two errorless
compliance studies. In Ducharme and Popynick (1993), we conducted the
first evaluation of this strategy, and demonstrated substantial treatment
effects, generalization to requests not included in training and covariant
improvements in behaviors not specifically targeted for intervention. The
procedure used in this investigation was labor-intensive, however, and we
evaluated a more efficient strategy, abbreviated along several treatment param-
eters, in the Ducharme et al. (1994) study. We found similar treatment, gen-
eralization, and covariant effects using the abbreviated approach.
G R O U P ERRORLESS C O M P L I A N C E T R A I N I N G 355
Method
Participants and Setting
Subjects were four boys and one girl randomly selected from a larger pool
of children who had been referred to an outpatient mental retardation center
because of noncompliance to parental requests and other oppositional be-
havior. All five children exhibited severe levels on noncompliance (failure
356 DUCHARME ET AL.
Compliance
Child compliance to parental requests was the dependent measure. The
child was considered compliant if the appropriate motor response to the re-
quest was initiated within 10 s of the request, and completed within 40 s.
Failure to exhibit a motor response, failure to initiate within 10 s, or failure
to complete within 40 s, even if the appropriate motor response was exhib-
ited, were considered noncompliance.
Event recording was used to code all compliance data. Each event was ini-
358 DUCHARME ET AL.
tiated by a request provided by the parent and ended by one of three alter-
natives: (a) the failure of the child to initiate the task within 10 s, (b) the failure
of the child to complete the task within 40 s, or (c) the successful completion
of the task within 40 s of the request (the latter two options were considered
only if the child initiated the requested activity within 10 s of the request).
Interobserver Agreement
The reliability of parent-collected data was examined through comparisons
with the videotaped data. Videotaping was conducted for 44% of parent ses-
sions (30% of baseline assessment, 37% of Phase 1, 24% of Phase 2, 32%
of Phase 3, 42% of Phase 4, 41% of transitions, 100% of generalization
probes, and 100% of follow-up sessions). Overall agreement was calculated
on a trial-by-trial basis, with number of agreements per event divided by the
number of agreements plus disagreements and multiplied by 100%. Inter-
observer agreement averaged 90% for baseline assessment (range 71% to
100%), 87% for Phase 1 (range 62% to 100%), 86% for Phase 2 (range 56%
to 100%), 83% for Phase 3 (69% to 100%), 85% for Phase 4 (range 44% to
100%), 98% for transitions (range 94% to 100%), 88% for generalization
probes (range 63% to 100%), and 95% for follow-up sessions (range 44%
to 100%).
Interobserver agreement checks on the videotape coding were conducted
on 92% of the videotaped sessions (100% of baseline assessment, 100% of
Phase 1, 89% of Phase 2, 100% of Phase 3, 100% of Phase 4, 83% of tran-
sition, 100% of generalization, and 76% of follow-up sessions). Overall agree-
ment was calculated as above and averaged 98% for baseline assessment
(range 92% to 100%), 97% for Phase 1 (range 85% to 100%), 96% for Phase
2 (range 93% to 100%), 96% for Phase 3 (range 92% to 100%), 96% for Phase
4 (range 87% to 100%), 100% for transitions, 96% for generalization probes
(range 88% to 100%), and 96% for follow-up sessions (range 69% to 100%).
Procedures
All parent training of assessment and treatment procedures occurred in a
series of four group training workshops (two assessment sessions and two
treatment sessions) conducted by the first author and one of the research
assistants in a small clinic conference room. Each group training session was
approximately 2 hours in length. This training in assessment and treatment
was conducted individually in the family homes in previous studies (Ducharme
& Popynick, 1993; Ducharme et al., 1994), thereby requiring considerably
more training and travel time.
Group Parent Trainingfor Assessment of Compliance Probabilities
Group Training Session 1: Estimation of compliance probabilities. In the
first parent training session, parents introduced themselves to each other and
provided a brief overview of the kinds of problems they were experiencing
GROUP ERRORLESS COMPLIANCE TRAINING 359
with their child's behavior. The trainer followed this discussion with a de-
tailed description of the treatment procedure and rationale.
Parents used the remaining session time to provide a cursory estimate of
the probability of child compliance to each request on a list of approximately
200 commonly used household requests. This procedure was included as a
means of determining which requests to include in the observational assess-
ment of compliance probabilities (see below). The list sampled several do-
mains of compliance, such as dressing (e.g., "put on your sweater"), hygiene
(e.g., "wash your hands"), leisure (e.g., "throw me the ball"), and social inter-
action (e.g., "shake my hand"). Parents rated each request according to the
likelihood of compliance by the child, as follows: (a) "almost always" (76%
to 100% of the time), (b)"usually" (51% to75% of the time), (c)"occasion-
ally" (26% to 50% of the time), and (d) "rarely" (0% to 25% of the time).
Group Training Session 2: Request delivery and data collection. After the
first group session, trainers selected approximately 32 requests for each child
from the list of requests rated by each parent (approximately 8 requests from
each of the 4 probability levels, as rated by the parents). Trainers recorded
these requests on data sheets that were provided to the parents in this group
session.
The trainers used modeling, rehearsal, and performance-feedback proce-
dures to teach parents to complete the baseline assessment of compliance
probabilities. Parents learned several components of appropriate request de-
livery, including using a single component request, delivering the request in
the imperative, maintaining eye contact and proximity, using a polite but firm
tone of voice, avoiding prompts or discussion after the request, providing the
child with time to respond, and avoiding repetitions of the request. Request
training was provided prior to baseline to ensure consistency of request de-
livery throughout all phases of the study and to decrease the likelihood that
child noncompliance was the result of poor request delivery.
Trainers taught parents to involve themselves in activities that were part
of their daily routine when conducting compliance sessions to ensure natural
request presentation. Parents were asked to follow their typical practice in
response to their child's compliance or noncompliance to requests. Parents
also learned to collect data on child compliance, using the operational defini-
tion of compliance described above.
Baseline Assessment
Parent-conducted baseline assessment sessions. After Group Session 2
was completed, baseline assessment of compliance probabilities was initiated
in each participant's home. Parents conducted sessions in which they
presented their child with the 32 requests selected from the questionnaire.
Parents also collected data on the child's response to each request. All base-
line data on compliance were gathered from these sessions.
The number of baseline assessment sessions, which averaged about 45 min
in length, ranged from 10 to 17 for parent-collected data. Of these, research
360 DUCHARME ET AL.
Treatment
Parent-conducted treatment sessions: Phase 1 (Level 1 requests). Parents
conducted treatment sessions in the home approximately three to five times
per week using request delivery and data collection procedures taught in
Group Training Session 2 and treatment procedures taught in Group Training
Session 3. The data from these sessions (as well as from all subsequent
phases and transitions) were used to evaluate the effects of treatment. During
each session, parents provided each of 4 requests from Level 1 three times.
Only 4 of the 6 requests per level were used in treatment because 2 requests
per level were allocated to generalization assessment (see Parent-conducted
Generalization Sessions, below). As in baseline, the research assistant video-
taped treatment sessions approximately twice a week.
Parent-conducted transition sessions. Decisions about shifts to subse-
quent probability levels were based on compliance data submitted to trainers.
If a shift was deemed appropriate (e.g., the child was compliant to over 75%
of requests delivered over two consecutive sessions), parents conducted tran-
sition sessions in the home to allow a smooth progression between levels.
In transition sessions, parents provided requests to the child from both ad-
joining probability levels. Parents repeated transition sessions if the child's
compliance in the first transition did not continue at levels consistent with
or above the previous phase.
Parent-conducted treatment sessions: Phase 2, 3, and 4 (Level 2, 3, and
4 requests). Parents conducted these sessions in the home exactly as in Phase
1, with the exception that they issued only Level 2 requests in Phase 2, Level
3 requests in Phase 3, and Level 4 requests in Phase 4.
Parent-conducted generalization sessions. Each parent/child dyad was
videotaped in the home in generalization sessions during all phases. These
sessions were conducted for research evaluation purposes to determine the
extent of generalization obtained during treatment (Ducharme & Popynick,
1993; Ducharme et al., 1994). Parents conducted one generalization session
per treatment phase on the same day as a treatment session, after several treat-
ment sessions from that phase had already been conducted.
During generalization sessions, parents issued requests from all four prob-
ability levels. Of the 6 requests designated to each level during the hierar-
chical categorization, 4 requests per level were included as part of each gen-
eralization session (i.e., 16 requests in total). Two of these 4 requests per
level (i.e., 8 total requests) were not included in the treatment sessions. These
requests (generalization requests) served as measures of generalization to re-
quests at the same probability level. The other 2 requests (training requests)
were included in the treatment sessions and thus served as a comparative mea-
sure of compliance to specifically trained requests. Mode of request presenta-
tion and consequence procedures during generalization probes were identical
to the empirical probability analysis and baseline sessions.
Generalization probes provided two distinct measures of generalization:
(a) within-level generalization and (b) across-level generalization. Within-
362 D U C H A R M E ET AL.
Results
Baseline Assessment
Percentages of compliance to requests from the four probability levels for
both parent and videotaped data before treatment are presented in Figure 1.
Given that interobserver agreement between parent-collected and videotape
data was high and parent data were much more extensive, all descriptive
statistics presented in the Results are based on the parent-collected data.
GROUP ERRORLESS COMPLIANCE TRAINING 363
GROUP 1
CHILD 1 CHILD 2
100 1 ,*~ p--~,
.ol.~ ;~Z~ / ........
LEVEL 1
4O " / :|- o
0 ~. . . . . .
It 4 e
II . . . . . . .
8 10 12 14 18
o~ ~-~ ~-~ ~- ;-~- +-~
BO 80 -., LEVEL 3
i i e e t0 1 i 14 I s
LEVEL 4
:!
O
~) GROUP 2
U.
0 CHrLD 3 CHILD 4 CHILD 5
LEVEL 1
| "7___ .....
I 4 0 8 10 11 14 le
:___ ! 4 6 8 10 12 14
-o 2 4 6 8 10 11 14 le
eoi
eo . . . . . . . . . . . . . . LEVEL 2
o ~. . . . . . o h . . . . . . .
2 4 0 8 10 1;[ 14 18 o ~ i 6 8 10 n 1U 2 4 6 8 10 12 14 le
o . . . . . . . o" . . . . . . . .
:~ 4 0 8 to 12 14 2 4 e 8 lO 12 14 18
eo 60
'70~. ,EV.,4
40 ' A
o . . . . .
R 4 8 8 lO t2 14 18 0 2 4 0 8 10 12 14 t e
SESSIONS
FIG. 1. Percentage of compliance to requests from the four probability levels graphed sep-
arately across sessions for both parent-collected and videotape data in baseline.
364 DUCHARME ET AL.
Scores for Level 1 requests in baseline were consistently high across all five
children.
Compliance to all Level 1 requests occurred in 51% of all baseline sessions.
Compliance to Level 4 requests was low, as children complied to 20% or
fewer of these requests in 54% of the sessions. Requests from Level 2 and
3 yielded highly variable child responses. Responses to these requests ap-
peared to be affected more by situational factors, such as the mood of the
child or his/her level of hunger or fatigue, than requests from Levels 1
and 4.
Mean percentages of compliance across all five children in baseline were
88% for Level 1, 67% for Level 2, 51% for Level 3, and 26% for Level 4.
100
80
eO
40
20
100
el=
40
20
ttt 0
(J
Z
_< 100
~_ !!"""i~i~i i~;~i~!;~;;i;;;i~-~.~.!..,.-...-
-,,:I.........! .............~.i
..I
D. 80 ,,.....-t-..... '~-~ t:;'~: m i
:i eO
o
40 CHILD 3
IL
o 20
0 //--//--//--//--//--d-- ,/
Z 100
uJ
80
re
ILl e0 .
Q.
44: CHILD 4
:,',));/::~iii ::?;;?,':1 o °"
20
i • ,~ F _.,,; ,, ,, : a m m
2, ~ ......)!))))))6~i))))))!))))))))))
i)))))))))))))))i
)))))))))))j
.................
J c,.,~,
~= ~ WEEKS
I PARENTDATA
VIDEO D A T A
~r4
J"
...... E ~ .......
I
Fro. 2. Percentage of compliance across children and treatment phases for both parent-
collected and videotaped data. Shaded areas represent mean baseline compliance levels to re-
quests from 'the probability level being trained in that phase. Timing of group training sessions
is indicated at the bottom of the graph. Group Training Session 1 is not indicated because it
occurred before initiation of data collection. Group Training Session 3 (GT3) occurred imme-
diately prior to treatment for both groups and was therefore time-lagged for Group 2.
366 DUCHARME ET AL.
PRETREATMENT
TREATMENT PHASES
ASSESSMENT
Level 1 Level 2 Level 3 Level 4
100
90
80
8
n 70
E
8 60
"6
g 50
40
(1)
0-
30
b
20
10
0 i i i i
1 2 3 4 1 2 3 4
Probability Levels
I"TrainingRequests[]GeneralizafionRequests
I
FIG. 3. Overall mean percentage of compliance to training and generalization requests in
baseline and the four treatment phases during generalization probe sessions.
Generalization
Within-level generalization. Generalization within each compliance prob-
ability level (i.e., generalization to requests at the same probability level as
requests currently being trained at the time of the generalization session) is
shown in Figure 3. Generalization data for all five subjects were combined.
Generalization to requests of the same level being trained was demonstrated
in all phases except Phase 2. Compliance to Level 2 training and generali-
zation requests during Phase 2 generalization sessions was unexpectedly low,
showing decreases of 17 and 11 percentage points respectively from baseline
levels. This finding is counterintuitive, contrary to previous evidence (Du-
GROUP ERRORLESS COMPLIANCE TRAINING 367
charme & Popynick, 1993; Ducharme et al., 1994), and may represent
random fluctuations in child behavior that were evident due to the small
number of generalization probes conducted in each phase.
Within-level generalization is most relevant in Phases 3 and 4 because re-
quests in these phases had been low probability in baseline and therefore prob-
lematic to parents before treatment. Mean percentage of compliance to gen-
eralization requests for Phase 3 and 4 was 70% for each phase, an increase
over baseline levels of 14% for Level 3 generalization requests and 47% for
Level 4 generalization requests. These findings suggest that when children
were trained on requests from a specific level during treatment, compliance
to generalization requests from the same probability level increased.
Across-level generalization. During generalization sessions in specific
phases of treatment, generalization to requests from subsequent untrained
levels was also measured to determine the number of probability levels that
must be trained before widespread generalization to all probability levels was
obtained. Across-level generalization means are depicted in Figure 4. These
PRETREATMENT
ASSESSMENT TREATMENT PHASES
Level1 Level2 Level3 Level4
100
90
°!
8O
70
6O
5O
4O
30
20
10
FIG. 4. Overall mean percentage of compliance to requests from all four probability levels
in baseline and the four treatment phases during generalization probe sessions.
368 DUCHARME ET AL.
data indicate that generalized compliance gains to Level 3 and Level 4 re-
quests were not obtained after training with Level 1 and/or Level 2 requests.
In general, only after requests from a specific probability level were included
in training was generalization to requests from that level obtained, although
slight and gradual improvements were noted.
For example, in Phase 1, the overall level of compliance to Level 4 requests
improved only 6 percentage points over the baseline level of 26 %. When
Level 2 requests were introduced in Phase 2, compliance to Level 4 requests
increased another 15 percentage points, to 47 %. In Phase 3, an increase of
16 percentage points to 63 % can be observed. Finally, in Phase 4, compliance
to Level 4 reached its peak, with a total increase of 42 percentage points over
the baseline level.
Consumer Satisfaction
All participant parents completed the consumer satisfaction questionnaire.
With a score of 5.0 representing the highest degree of satisfaction, parents
of Child 2 and 4 both rated the intervention highest with mean ratings of 4.6.
Parents of Child 1 and Child 5 provided mean ratings of 4.4 and 4.0, respec-
tively. The parent of Child 3 provided the lowest consumer satisfaction rating
of 3.3. The overall mean consumer satisfaction score was 4.2.
Follow-up
Child compliance to Level 4 follow-up requests can be seen in Figure 2.
Compliance to Level 4 requests was used for follow-up to demonstrate the
degree of improvement over baseline levels of compliance to Level 4 requests
after treatment (as noted above, compliance to Level 4 was used to illustrate
baseline levels of compliance). These follow-up data demonstrated that com-
pliance to the most problematic requests continued at a high level long after
treatment completion. Overall mean compliance to Level 4 requests across
all children and follow-up sessions was 86%. Overall mean compliance
across all four request levels, children, and follow-up sessions was 89%.
Of most significance to the present study were the levels of long-term
follow-up at assessment sessions of 6 months and more than 1 year. The over-
all mean level of compliance across all children for the 6-month follow-up
was 95% to all requests and 89% to Level 4 requests. We conducted follow-
up assessment after more than 14 months for four of the five children. Overall
compliance was 95% to all requests and 93% to Level 4 requests.
Discussion
We addressed several important issues related to the effective use of error-
less compliance training in this study. The results suggest that the errorless
approach can be taught to parents in a highly efficient clinic-based group
format with minimal loss of treatment and generalization effects. Throughout
all phases of the study, parents collected data on child compliance suggesting
G R O U P ERRORLESS C O M P L I A N C E T R A I N I N G 369
antee that parents were similarly accurate when recording on their own. The
correspondence in parent data trends between sessions with and without the
research assistant, however, suggests that parent recording accuracy under
the two circumstances was comparable.
Child compliance to parental requests during follow-up was often higher
than compliance levels during the intervention. Based on follow-up data and
verbal reports of parents during the follow-up period, child noncompliance
was no longer an issue in the families after treatment. Considering that the
treatment was nonintrusive, with no punitive consequence employed for non-
compliance, these maintenance results are promising and provide the first em-
pirical evidence that errorless compliance training can produce gains that en-
dure far beyond treatment termination.
Because errorless compliance training is substantially different from con-
ventional compliance training approaches, we have attempted with this series
of studies to systematically evaluate treatment parameters necessary to ensure
effectiveness and practicality for clinicians. The results have been encour-
aging. There are, however, several limitations that suggest methodological
adaptations in future research.
First, the current study and previous errorless compliance investigations
(Ducharme & Popynick, 1993; Ducharme et al., 1994) were conducted with
small samples. Although small N samples are useful to determine initial effec-
tiveness of new behavioral interventions and to establish an efficient training
protocol, a randomized trials design with a much larger sample is necessary
to provide evidence of generality to specific clinical populations. The mul-
tiple baseline across-groups design used in this study presented a related con-
cern. Although this design provided for simultaneous replication within each
group, the presence of only one time-lagged baseline reduced the experi-
mental rigor (Barlow & Hersen, 1984).
The evaluation of errorless compliance training could also benefit from pre-
and post-assessment with standardized measures of child behavior, such as
the Child Behavior Checklist (Achenbach & Edelbrock, 1983). Significant
change on such measures from baseline to posttreatment would provide
strong evidence that the errorless intervention produces widespread and clin-
ically significant treatment effects.
Finally, the group format, although highly efficient, presents practicality
problems if parents miss group sessions or if parents are unmotivated to col-
lect accurate data consistently or conduct other program procedures indepen-
dently. Missed sessions would require rescheduling in an individual format
and data collection problems might require the inclusion of motivational sys-
tems for parents. For example, provision of tickets to be exchanged for
tangible rewards, such as children's clothing or toys, contingent on appro-
priate program participation, might be effective for enhancing parent coop-
eration, especially for parents of low socioeconomic status. Despite these
limitations, the group approach to errorless compliance training resulted in
much more efficient use of the clinician's time than individual visits to the
GROUP ERRORLESSCOMPLIANCETRAINING 371
References
Achenbach, T. M., & Edelbrock, C. S. (1983). Manual for the Child Behavior Checklist and
Child Behavior Profile. Burlington, VT: University of Vermont.
Barlow, D. H., & Hersen, M. (1984). Single case experimental designs. New York: Pergammon
Press.
Barlow, D. H., Hayes, S. C., & Nelson, R. O. (1984). The scientist practitioner: Research and
accountability in clinical and educational settings. New York: Pergammon Press.
Baum, C. G., Forehand, R. L., & Zegiob, L. E. (1979.). A review of observer reactivity in
adult-child interactions. Journal of Behavioral Assessment, 1, 167-178.
Ducharme, J. M. (1996). Errorless compliance training: Optimizing clinical efficacy. Behavior
Modification, 20, 259-280.
Ducharme, J. M., & Feldman, M. A. (1992). Comparison of staff training strategies to promote
generalized teaching skills. Journal of Applied Behavior Analysis, 25, 165-179.
Ducharme, J. M., Pontes, E., Guger, S., Crozier, K., Lucas, H., & Popynick, M. (1994). Error-
less compliance to parental requests II: Increasing clinical practicality through abbrevia-
tion of treatment parameters. Behavior Therapy, 25, 469-487.
Ducharme, J. M., & Popynick, M. (1993). Errorless compliance to parental requests: Treat-
ment effects and generalization. Behavior Therapy, 24, 209-226.
Forehand, R., & King, H. E. (1977). Noncompliant children: Effects of parent training on be-
havior and attitude change. Behavior Modification, 1, 93-108.
Forehand, R., & Long, N. (1988). Outpatient treatment of the acting out child: Procedures,
long-term follow-up data, and clinical problems. Advances in Behavior Research and
Therapy, 10, 129-177.
Forehand, R. L., & McMahon, R. J. (1981). Helping the noncompliant child: A clinician's
guide to parent training. New York: Guilford Press.
Harris, S. L. (1983). Families of the developmentally disabled: A guide to behavioral interven-
tion. New York: Pergammon.
Hayes, S. C., Rincover, A., & Solnick, J. V. (1980). The technical drift of applied behavior
analysis. Journal of Applied Behavior Analysis, 13, 275-285.
Kelly, J. A. (1980). The simultaneous replication design: The use of a multiple baseline to es-
tablish experimental control in single group social skills treatment studies. Journal of Be-
havior Therapy and Experimental Psychiatry, 11,203-207.
Parrish, J. M., Cataldo, M. E, Kolko, D., Neef, N. A., & Egel, A. (1986). Experimental
analysis of response covariation among compliant and inappropriate behavior. Journal of
Applied Behavior Analysis, 19, 241-254.
Peed, S., Roberts, M., & Forehand, R. (1977). Evaluation of the effectiveness of a standardized
parent training program in altering the interactions of mothers and their noncompliant chil-
dren. Behavior Modification, 1, 323-350.
Roberts, M. W. (1982). Resistance to timeout: Some normative data. Behavioral Assessment,
4, 237-246.
Roberts, M. W. (1984). An attempt to reduce time out resistance in young children. Behavior
Therapy, 15, 210-216.
Sprague, J. R., & Horner, R. H. (1984). The effects of single instance, multiple instance and
general case training on generalized vending machine use by moderately and severely
handicapped students. Journal of Applied Behavior Analysis, 17, 273-278.
Wells, K. C., & Forehand, R. (1985). Conduct and oppositional disorders. In P. H. Bornstein
372 DUCHARME ET AL.
and A. E. Kazdin (Eds.), Handbook of Clinical Behavior Therapy With Children, 218-265.
Homewood, IL: Dorsey.
Wolf, M. M. (1978). Social validity: The case for subjective measurement or how applied be-
havior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203-214.