You are on page 1of 18

JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2011, 95, 91–108 NUMBER 1 ( JANUARY)

A MODEL OF RESURGENCE BASED ON BEHAVIORAL MOMENTUM THEORY


TIMOTHY A. SHAHAN AND MARY M. SWEENEY
UTAH STATE UNIVERSITY

Resurgence is the reappearance of an extinguished behavior when an alternative behavior


reinforced during extinction is subsequently placed on extinction. Resurgence is of particular
interest because it may be a source of relapse to problem behavior following treatments involving
alternative reinforcement. In this article we develop a quantitative model of resurgence based on the
augmented model of extinction provided by behavioral momentum theory. The model suggests that
alternative reinforcement during extinction of a target response acts as both an additional source of
disruption during extinction and as a source of reinforcement in the context that increases the
future strength of the target response. The model does a good job accounting for existing data in
the resurgence literature and makes novel and testable predictions. Thus, the model appears to
provide a framework for understanding resurgence and serves to integrate the phenomenon into
the existing theoretical account of persistence provided by behavioral momentum theory. In
addition, we discuss some potential implications of the model for further development of behavioral
momentum theory.
Key words: resurgence, extinction, behavioral momentum, relapse, alternative reinforcement

________________________________________

Resurgence is generally defined as the creased. Such resurgence effects have been
reappearance of an extinguished target behav- noted repeatedly in a number of situations and
ior when an alternative behavior reinforced with a range of different species (see Doughty
during extinction is also subsequently placed & Oken, 2008; Epstein, 1985; Lattal & St. Peter
on extinction (e.g., Cleland, Foster, & Temple, Pipkin, 2009, for reviews).
2000). In the laboratory, experiments examin- The phenomenon of resurgence is of
ing resurgence typically include three phases. particular interest because it could be a major
During Phase 1, a target behavior is reinforced source of relapse following behavioral inter-
on a baseline schedule. In Phase 2, the target ventions for a variety of applied problems. For
behavior is placed on extinction and an example, the treatment of problem behavior
alternative behavior is reinforced. In Phase 3, in persons with developmental disabilities
the alternative behavior is also placed on often involves simultaneous extinction of the
extinction and the target behavior increases problem behavior and reinforcement of ap-
(i.e., resurgence occurs). For example, Leiten- propriate behavior (e.g., Carr & Durand, 1985).
berg, Rawson, and Bath (1970) reinforced Resurgence of problem behavior can occur with
lever pressing of rats on a variable-interval (VI) such treatments when reinforcement for the
30-s schedule of food delivery in Phase 1. In alternative behavior is later reduced or elimi-
Phase 2, pressing the original lever was no nated (e.g., Volkert, Lerman, Call, & Trosclair-
longer reinforced, and pressing an alternative Lasserre, 2009; see also Lieving, Hagopian,
lever was reinforced on a fixed-ratio (FR) 10 Long, & O’Connor, 2004). In addition, resur-
schedule. In Phase 3, pressing the alternative gence effects have been suggested as a possible
lever was also placed on extinction, and source of relapse to drug abuse with a decrease
responding on the original lever then in- in the availability of alternative nondrug rein-
forcers (Podlesnik, Jimenez-Gomez, & Shahan,
Thanks to Chris Podlesnik, Amy Odum, Tony Nevin, 2006; Winterbauer & Bouton, 2010).
and the Behavior Analysis seminar group at Utah State Although resurgence is increasingly recog-
University for many conversations about resurgence. In
addition, Amy Odum and Tony Nevin provided helpful nized as an important behavioral phenome-
comments on an earlier version of the manuscript. This non, there has been little attempt to systema-
work was supported by NIH grant R01AA016786. tize the existing literature or to provide a
Address correspondence to Timothy A. Shahan, De- formal account of the processes governing
partment of Psychology, 2810 Old Main Hill, Utah State
University, Logan, UT 84322 (e-mail: tim.shahan@
resurgence. In what follows, we develop a
usu.edu). quantitative model of resurgence. The model
doi: 10.1901/jeab.2011.95-91 suggests that resurgence can be understood as

91
92 TIMOTHY A. SHAHAN and MARY M. SWEENEY

an extension of the process of extinction as ment previously experienced in the discrimi-


characterized by behavioral momentum theory. native-stimulus context. Quantitatively, that is,
 
A Model of Relapse and the Problem of Resurgence Bt {t(czdr )
log ~ ð1Þ
Resurgence is just one of a number of Bo rb
relapse phenomena characterized by the reap-
pearance of previously extinguished behavior. where Bt is response rate at a particular time t
Other examples of such phenomena include in extinction, B0 is the preextinction baseline
reinstatement and renewal. Reinstatement response rate, c is the disruption produced by
refers to the reappearance of extinguished terminating the contingency between the
responding when a response-independent response and reinforcer, d scales disruption
reinforcer is delivered (e.g., Reid, 1958). from the elimination of reinforcers (i.e.,
Renewal refers to the recurrence of a behavior generalization decrement), r is the rate of
that was trained in one stimulus context, reinforcement in the presence of the discrim-
extinguished in a different context, and then inative stimulus context in baseline, and b is
reappears when the original training context is sensitivity to reinforcement rate. Thus, as time
presented again (i.e., ABA renewal; Nakajima, in extinction progresses, the disruption char-
Tanaka, Urushihara, & Imada, 2000). Bouton acterized by the numerator increases, but the
(e.g., 2004) has suggested that such relapse impact of this disruption is lessened for
phenomena are consistent with accounts of responding previously occurring in a context
extinction that are based on the assumption associated with a higher rate of reinforcement.
that extinction does not produce unlearning. Importantly, the rate of reinforcement (i.e., r)
Furthermore, Bouton suggests that the effects experienced in the preextinction discrimina-
of extinction are context specific and that tive context includes all sources of reinforce-
relapse occurs when stimulus conditions dif- ment occurring in that context, regardless of
ferent from those present during extinction whether they are contingent upon the target
are subsequently encountered. response, independent of the target response,
Bouton’s approach to extinction shares or even contingent on an alternative response.
some important properties with behavioral The prediction that resistance to extinction
momentum theory. Behavioral momentum (or other disruptors) in the presence of a
theory (e.g., Nevin & Grace, 2000) also discriminative stimulus depends upon all
suggests that the decreases in behavior associ- sources of reinforcement obtained in the
ated with extinction are not a result of presence of that stimulus has been confirmed
unlearning, and that resistance to extinction in numerous experiments with a variety of
depends upon the value of the Pavlovian species, responses, and reinforcer types (e.g.,
stimulus–reinforcer relation between a dis- Ahearn, Clark, Gardenier, Chung, & Dube,
criminative stimulus context and all reinforc- 2003; Cohen, 1996; Grimes & Shull, 2001;
ers obtained in that context. Based on these Harper, 1999; Igaki & Sakagami, 2004; Mace et
considerations, Podlesnik and Shahan (2009, al., 1990; Nevin, Tota, Torquato, & Shull, 1990;
2010) suggested that an extension of the Shahan & Burke, 2004).
augmented model of behavioral momentum To extend the augmented model of extinc-
(Nevin & Grace, 2000; Nevin, McLean, & tion to relapse of extinguished behavior,
Grace, 2001) could provide a quantitative Podlesnik and Shahan (2009, 2010) suggested
model of relapse of extinguished operant that relapse occurs when some change in
behavior. contextual circumstances produces a decrease
The augmented model of behavioral mo- in the disruption associated with extinction. As
mentum suggests that decreases in responding a result of the decrease in disruption, respond-
during extinction result from the disruptive ing increases. Specifically,
effects of terminating the contingency be-  
tween a response and a reinforcer and the Bt {t(mczndr )
log ~ ð2Þ
generalization decrement associated with re- Bo rb
moval of reinforcers from the situation.
Furthermore, the disruptive impact of extinc- where the added parameter m scales a reduc-
tion varies inversely with the rate of reinforce- tion in the disruptive effects of contingency
A MODEL OF RESURGENCE 93

suspension (i.e., c) and n scales a reduction in during Phase 2 extinction produce faster
the generalization decrement (i.e., dr) associ- elimination of the target response, but a larger
ated with the occurrence of the relapse- increase in responding (i.e., resurgence) when
producing event, and other terms are as in the alternative reinforcer is removed in Phase
Equation 1. During extinction, m and n are 3. The difficulty for Equation 2 is that even
equal to 1, and Equation 2 is the same as with an inflated value of the c parameter to
Equation 1. With the occurrence of a relapse- accommodate the added disruptive effects of
producing event, m and n may assume values alternative reinforcement and the associated
of less than 1 and responding increases faster response elimination, the equation
because of a reduction in extinction-associated cannot capture the larger increase in respond-
disruption in the numerator. In addition, as is ing when a higher rate of alternative rein-
true with resistance to extinction, Equation 2 forcement is removed. The reason is that the
predicts that response rates as a proportion of value of the c parameter remains constant
baseline during relapse should be greater in during the alternative reinforcement phase
the presence of a stimulus associated with a and during the resurgence phase when the
higher rate of reinforcement prior to extinc- alternative reinforcer is removed. Simply re-
tion (i.e., higher r). This prediction is consis- ducing disruptive impact by decreasing m
tent with the data from a number of experi- and/or n when alternative reinforcement is
ments by Podlesnik and Shahan (2009, 2010) removed cannot predict the opposite effects of
examining relapse in reinstatement, renewal, a higher rate of reinforcement during re-
and resurgence preparations. sponse elimination and during resurgence.
Despite the fact that Equation 2 has provid- Thus, a more specific model is required to
ed good fits to data from some resurgence provide an acceptable theory of resurgence.
experiments (Podlesnik & Shahan, 2010),
further consideration suggests that the model A Model of Resurgence
fails as a theory of resurgence. The problem is The model of resurgence we develop here is
that when Equation 2 is used to describe data based on the augmented model of extinction
from resurgence experiments, the value of the (i.e., Equation 1) with two additions. First, the
c parameter required for the fits has been presence of an alternative source of reinforce-
considerably larger than for the value (i.e., ment during extinction is assumed to have a
< 1) in typical applications of Equation 1 to disruptive effect of its own. Second, the
extinction data (Nevin et al. 2001) and additional source of reinforcement in the
applications of Equation 2 to other relapse context during extinction is also assumed to
phenomena (e.g., reinstatement). The reason contribute to the future strength of the
is that in a resurgence preparation, reinforce- initially trained target behavior. Specifically,
ment for an alternative response is introduced  
during Phase 2 extinction and tends to Bt {t(kRa zczdr )
log ~ ð3Þ
produce faster elimination of responding than Bo (r zRa )b
standard extinction (e.g., Leitenberg et al.,
1970). But, the c parameter should only be where all terms are as in Equation 1. Like the
capturing the disruptive effect of eliminating augmented model upon which it is based,
the contingency between the target response Equation 3 has parameters for suspending the
and its reinforcer, not the added disruptive contingency between the target behavior and
effects of having an alternative source of reinforcement (i.e., c), scaling the generaliza-
reinforcement present during extinction. In tion decrement associated with removal of
short, c is serving as an inappropriate catchall reinforcers for the target behavior from the
disruptor term when Equation 2 is applied to situation (i.e., d), and sensitivity to reinforce-
resurgence. ment (i.e., b). The added variable Ra is the rate
A second and related problem with Equa- of alternative reinforcement introduced dur-
tion 2 as an account of resurgence is that the ing extinction, and the added parameter k
equation cannot predict an important finding scales the disruptive impact of that alternative
in the resurgence literature. Leitenberg, Raw- reinforcement on the target behavior. Thus,
son, Mulick (1975, Experiment 3) showed that the addition of alternative reinforcement
higher rates of alternative reinforcement during extinction increases the disruptive
94 TIMOTHY A. SHAHAN and MARY M. SWEENEY

impact in the numerator by kRa, and higher and simulations reported here. In addition,
rates of alternative reinforcement produce the value of d has been near 0.001 in previous
larger decrements in the target behavior as a fits of Equation 1 to extinction data (e.g.,
result. When alternative reinforcement is Nevin & Grace, 2000) and fits of Equation 2 to
removed, Ra in the numerator goes to zero, relapse data (Podlesnik & Shahan, 2010).
and the suppressive effect of the alternative Thus, we have fixed d as a constant at that
reinforcement on the target behavior is value for the fits and simulations reported
removed—thus resulting in increased re- here. As a result, fits of Equation 4 below
sponding (i.e., resurgence). In addition, the include the use of two free parameters (i.e., k
inclusion of Ra in the denominator suggests and c) and two fairly well established constants
that, like reinforcement experienced in the (i.e., b and d).
preextinction baseline (i.e., r), alternative It should be noted that, like Equation 1 and
reinforcement experienced within the discrim- behavioral momentum theory more generally,
inative context during extinction of the target Equations 3 and 4 use responding relative to
behavior also strengthens the target behavior. baseline as the primary dependent measure. A
It is important to note that in both the version of the model predicting absolute
standard augmented model of extinction response rates during extinction and resur-
(Equation 1) and in Equation 3, the rate of gence is easily obtainable by multiplying both
reinforcement experienced during baseline sides of Equation 4 by baseline response rates
(r) is carried forward to extinction, and thus (i.e., B0) such that,
represents the effects of a history of reinforce- {t(kRa zczdr )
ment in the stimulus context on resistance to Bt ~Bo :10 (r zRa )b ð5Þ
extinction. Similarly, in addition to r, the
added Ra in the denominator of Equation 3 where all terms are as in Equation 4. Even
is carried forward to the resurgence condition though Equation 5 predicts absolute response
and represents the strengthening effects of the rates, it nonetheless suggests that preextinc-
history of alternative reinforcement during tion baseline response rates must be consid-
extinction of the target behavior. ered when accounting for extinction and the
As suggested for the previous relapse model response rate increases associated with resur-
of Podlesnik and Shahan (2010), we use the gence. Fits of Equation 4 and Equation 5 to
exponentiated version of the resurgence mod- data produce the same parameter values and
el because doing so does not require log- account for the same percentages of variance.
transformed data and permits the inclusion of Regardless, from the perspective of behavioral
zero values common in research examining momentum theory responding relative to
postextinction relapse. Accordingly, the expo- baseline is the appropriate measure of resis-
nentiated version1 is: tance to change (i.e., response strength), and
thus we will use Equation 4 in the analyses
Bt {t(kRa zczdr )
below.
~10 (r zRa )b ð4Þ
Bo As we will describe in detail below, Equation
4 appears to provide a fairly comprehensive
where all terms are as in Equation 3. Although account of findings in the resurgence litera-
Equations 3 and 4 have four parameters, in ture. Where possible, we provide fits of the
practice, sensitivity to reinforcement (i.e., b) is model to existing datasets using the Frontline
typically near 0.5 (Nevin, 2002) and we have Systems Solver for Mac Excel 2008. Typically,
fixed it as a constant at that value for all fits tabled data were not available in the original
1
publications. Thus, where possible, data were
Nevin and Grace (2005) and Nevin, Davison, and electronically extracted from figures using
Shahan (2005) have used a similar exponentiated version
of behavioral momentum theory after a conversion to GraphClick 3.0. Unfortunately, the data from
natural logarithms (i.e., using base e). We have maintained most reports in the literature are not amena-
the base of 10 to remain consistent with the usual ble to formal fits because some of the relevant
statement of Equation1 in base 10 logarithms and to allow data required for fitting the model are not
direct comparison of parameter values with the majority of
previous applications of Equation 1 to extinction data. The
presented. Often, rates of alternative rein-
choice of which base to use in the exponentiated version forcement during extinction of the target
does not change the quality of fits of the equations. response are not reported or recoverable from
A MODEL OF RESURGENCE 95

other measures, and/or behavioral data are


not presented with sufficient detail. Nonethe-
less, even though formal fits are not possible
for many findings in the literature, we will
discuss how existing data appear to be consis-
tent with the predictions of the model. We
begin by examining the core assumption of
the model that the rate of the alternative
source of reinforcement during response
elimination in Phase 2 and its removal during
Phase 3 play a critical role in resurgence.

The Source of Alternative Reinforcement


and Resurgence Fig. 1. Reanalysis of data from Leitenberg et al. (1975)
in which alternative reinforcement (i.e., Ra) during
Equation 3 suggests that it is the dual effects extinction of a target behavior occurred at either a high
of alternative reinforcement as an added rate (VI 30) or a low rate (VI 120) and then also was placed
disruptor during Phase 2 (i.e., kRa in the on extinction (i.e., No Ra). The lines and reported
numerator) and as an added source of parameter values were generated with least-squares regres-
sion of Equation 4 to the data.
reinforcement in the discriminative stimulus
context (i.e., Ra in the denominator) that
determine resurgence in Phase 3. Further- sponse than the low-rate and no-alternative-
more, because resurgence occurs as a result of reinforcement groups. Nonetheless, in Phase 3
the decrease in disruption associated with the when all reinforcement was withheld, the
change in frequency of alternative reinforce- group with the high rate of alternative
ment, resurgence should only occur when the reinforcement during the previous extinction
rate of alternative reinforcement in the situa- condition showed more resurgence than the
tion is decreased. Importantly, resurgence group with the lower rate of reinforcement.
should occur in Phase 3 when alternative The group with no alternative reinforcement
reinforcement is reduced relative to Phase 2, during extinction did not show resurgence.
regardless of the details of the source of Figure 1 shows the fit of Equation 4 to the
alternative reinforcement. For example, al- data from the high and low rate alternative
though higher rates of alternative reinforce- reinforcement groups from Leitenberg et al.
ment should produce greater disruption dur- (1975, Experiment 3) expressed as a propor-
ing Phase 2 and greater resurgence in Phase 3, tion of baseline rates. The model provides a
the details of the type of schedule should not good description of the data, accounting for
matter. In what follows, we discuss the existing 95% of the variance. The obtained value of c
data with respect to these predictions. (i.e., 0.89) is comparable to previous fits of
As noted above, Leitenberg et al. (1975) Equation 1 to standard extinction data. The
examined the effects of frequency of alterna- fact that Leitenberg et al. included a control
tive reinforcement during extinction on sub- group with no alternative reinforcement dur-
sequent resurgence when that alternative ing extinction provides a useful opportunity to
reinforcement was removed. Specifically, three evaluate the c parameter in Equation 4. If
groups of pigeons responded on a VI 120-s Equation 4 has remedied the concern with the
schedule of food delivery during the Phase 1 previous model that c was serving as an
baseline. In Phase 2, one group received inappropriate disruptor term, then fitting
standard extinction with no alternative source Equation 1 to the data from the control group
of reinforcement, a second group received a that did not show resurgence should yield a
low rate of reinforcement (i.e., VI 240 s) for value of c that is similar to the value obtained
pecks to a second key, and a third group by fitting Equation 4 to the groups with
received a high rate of reinforcement (i.e., VI alternative reinforcement during extinction.
30 s) for pecks to the second key. During this Accordingly, Equation 1 accounts for 90% of
phase, the group with the high rate of the variance in the data from the control
reinforcement for the alternative response group with c as a free parameter and a 5 0.5
showed faster elimination of the target re- and d 5 0.001, as in the fit above. The
96 TIMOTHY A. SHAHAN and MARY M. SWEENEY

obtained value of c is 0.93, and fixing it as a moved in a subsequent condition, a larger


constant at the 0.89 value obtained above amount of resurgence occurred than with the
changes the percentage of variance accounted decrease to a VI 360-s schedule.
for by less than 1%. Furthermore, including As noted above, Equation 4 suggests that it is
the data from the control group in the fits of rate of alternative reinforcement that plays a
Equation 4 reported in Figure 1 results in critical role in resurgence rather than the
similar values of c (i.e., 0.91) and k (i.e., 0.05) schedule type. Leitenberg et al. (1975, Exper-
and percentage of variance accounted for (i.e., iment 2) examined resurgence with groups of
93%) as the fits to data for just the two groups rats exposed to either FR or yoked VI
with alternative reinforcement during extinc- schedules providing the same rates of alterna-
tion. Thus, Equation 4 appears to provide a tive reinforcement during extinction of the
reasonable account of the effects of alternative target behavior. The groups exposed to
reinforcement on the speed of response alternative reinforcement provided by both
elimination and subsequent resurgence when FR and VI schedules showed faster response
the alternative reinforcement is removed. elimination than a control group receiving no
Lieving and Lattal (2003) provide support alternative reinforcement. Most important for
for the prediction of Equation 4 that it is a present purposes, the FR and VI groups
reduction in the rate of an alternative source showed similar amounts of resurgence when
of reinforcement that produces resurgence. In the alternative reinforcement was removed.
their Experiment 3, pigeons’ key pecking was Winterbauer and Bouton (2010) recently
reinforced on a VI 30-s schedule of food obtained similar results. They exposed differ-
delivery during the Phase 1 baseline. During ent groups of rats to FR, random-interval (RI),
Phase 2 extinction, alternative reinforcement and response-independent random-time (RT)
was arranged for pressing a treadle on a VI 30 s. schedules of alternative reinforcement during
When the VI 30 s of treadle-press reinforce- Phase 2 extinction of a target behavior (i.e.,
ment was changed to response-independent lever pressing). The different schedules ar-
reinforcement on a variable-time (VT) 30-s ranged the same rate of alternative reinforce-
schedule, resurgence of key pecking did not ment and, as suggested by Equation 4,
occur. However, when the VT 30-s reinforce- produced similar amounts of resurgence when
ment was removed in the next phase, resur- they were removed. Furthermore, consistent
gence of key pecking did occur. Thus, the with findings from the RT alternative rein-
occurrence of resurgence required that the forcement group in Winterbauer and Bouton,
alternative reinforcement be removed. Lieving the presence of even a freely available cup of
and Lattal obtained a similar result when VI food during extinction speeds response elim-
120-s schedules were used for the Phase 1 ination and produces recurrence of extin-
baseline, Phase 2 extinction, and the switch to guished responding when it is removed (En-
VT reinforcement. Also consistent with Equa- kema, Slavin, Spaeth, & Neuringer, 1972).
tion 4, the amount of resurgence was smaller Finally, another way of arranging alternative
when the rate of alternative reinforcement reinforcement during response elimination is
being removed was lower as arranged by the VI to reinforce the absence of the target behavior
120 s than the VI 30 s. In addition, in with a differential-reinforcement-of-other-be-
Experiment 4, Lieving and Lattal showed that havior schedule (DRO). It should be noted
a reduction of alternative reinforcement to a that Equation 4 models the disruptive impact
nonzero level can also result in resurgence of of extinction in the numerator, and is not an
an extinguished target behavior. A reduction explicit model of DRO. Regardless, for present
in the rate of alternative reinforcement from a purposes it is sufficient to note that within the
VI 30-s schedule to a VI 360-s schedule resulted general framework provided by Equation 4,
in a small amount of resurgence. This out- removal of alternative reinforcement provided
come is consistent with Equation 4 because by a DRO should also produce resurgence.
even reductions of alternative reinforcement Consistent with this suggestion, Uhl and
to nonzero levels in the numerator (i.e., kRa) Garcia (1969) found that rats receiving alter-
result in some reduction of disruption, and native reinforcement on a DRO schedule
thus increases in the target response. When showed a recurrence of responding when that
alternative reinforcement was completely re- reinforcement was removed (see also da Silva,
A MODEL OF RESURGENCE 97

Maxwell, & Lattal, 2008). A subsequent study what is clear from the available data is that
with squirrel monkeys by Mulick, Leitenberg, when reinforcement obtained for the nonoc-
and Rawson (1976) showed that removal of currence of a target behavior on a DRO
DRO reinforcement did not produce resur- schedule is subsequently removed, resurgence
gence when it was suspended in Phase 3. occurs.
However, because the DRO was relatively Together, the results of the studies reviewed
ineffective at eliminating responding in Phase above suggest that, consistent with Equation 4,
2, little DRO reinforcement was actually resurgence results from the removal of alter-
obtained. Thus, when the DRO was suspend- native reinforcement, regardless of the source.
ed, little reinforcement was removed, and As suggested by the equation, higher rates of
consistent with Equation 4 little resurgence alternative reinforcement accelerate response
occurred (cf. Pacitti & Smith, 1977). elimination but increase the magnitude of
One experiment by Doughty, da Silva, and resurgence when they are removed. Resur-
Lattal (2007) with pigeons at first appears to gence requires that at least some of the
suggest that the use of a DRO to schedule alternative reinforcement be removed, and
alternative reinforcement during response the amount of resurgence that occurs appears
elimination could produce different effects to increase with the magnitude of decrease in
than reinforcement of an alternative response. alternative reinforcement rate. Finally, at this
In their Experiment 1, rates of alternative point, the details of the schedule of alternative
reinforcement provided by an alternative key reinforcement during response elimination
peck response or by a DRO were equated appear not to matter, as long as similar rates
during Phase 2 response elimination. Despite of reinforcement are arranged.
the equal reinforcement rates, greater resur-
gence occurred in Phase 3 following the DRO Time in Extinction and Exposure to
than following reinforcement of the alterna- Alternative Reinforcement
tive key peck during extinction. Unfortunately, In Equation 4, time plays a critical role in
this effect is difficult to interpret given that it the reduction of responding produced by
was not replicated in their Experiment 4 when exposure to extinction plus alternative rein-
treadle pressing was used as the alternative forcement. The overall magnitude of the
response. This lack of replication occurred disruptive impact of extinction and exposure
despite the fact that a direct comparison of to alternative reinforcement in the numerator
resurgence using key pecking versus treadle grows continuously with time (i.e., t). Thus,
pressing as the alternative response failed to longer durations of exposure to extinction and
produce any compelling difference in resur- alternative reinforcement during Phase 2
gence in their Experiment 5. Other research would be expected to reduce the magnitude
has also shown that the topography of the of resurgence. Figure 2 shows a simulation of
alternative response during extinction does how different durations of exposure to extinc-
not affect resurgence (cf. Leitenberg et al., tion plus alternative reinforcement in Phase 2
1975). As a result, the reason for the initial affect resurgence in Phase 3. As the duration
finding in Doughty et al. and its failure to of exposure to extinction plus alternative
replicate remain unclear. Thus, at present it reinforcement increases, the expected amount
remains unclear if removing equal rates of of resurgence decreases. Data reported in
DRO reinforcement versus reinforcement pro- Leitenberg et al. (1975, Experiment 4) are
duced by an alternative response produces any consistent with this prediction. In their exper-
systematic differences in resurgence. The iment, different groups of rats were exposed to
general approach suggested by Equation 4 either 3, 9, or 27 days of extinction plus
would predict that no such differences should alternative reinforcement in Phase 2 before
be expected. Should removal of equal rates of the alternative reinforcer was removed in
reinforcement delivered by a DRO and an Phase 3. Although the authors do not describe
alternative response ultimately turn out to the schedule of alternative reinforcement
produce reliable differences in resurgence, the used, the data appear to be generally consis-
disruptor terms in the numerator of Equation tent with the model. The rats exposed to
4 would likely need to be modified to capture 27 days of extinction plus alternative rein-
the added complexities of DRO. Regardless, forcement showed no significant resurgence,
98 TIMOTHY A. SHAHAN and MARY M. SWEENEY

Fig. 3. Simulation of the effect of repeated addition


(i.e., Ra) and removal (i.e., No Ra ) of alternative
reinforcement during extinction as generated by Equation
4. Simulations are based on a VI 60-s schedule of
reinforcement during the baseline and a VI 30-s schedule
of alternative reinforcement during extinction using the
parameter values listed in the figure.

ing as extinction progresses. Specifically, when


alternative reinforcement is successively added
and removed during continued exposure to
extinction, resurgence should occur repeated-
ly, but with decreasing magnitudes across
exposures. Figure 3 shows a simulation of two
successive exposures to Phases 2 and 3 during
which alternative reinforcement is present
during extinction and then removed. Initial
removal of the alternative reinforcement
during extinction produces a robust increase
in responding, but when alternative reinforce-
ment is returned, responding quickly decreas-
es. Finally, when alternative reinforcement is
again removed, responding increases, but the
increase is smaller than when alternative
reinforcement was initially removed. Examina-
Fig. 2. Simulation of the effects of increasing dura- tion of the simulation in Figure 3 reveals an
tions of extinction plus alternative reinforcement (i.e., Ra) important aspect of the model of resurgence
on resurgence (i.e., No Ra) as generated by Equation 4.
The simulations are based on a VI 60-s schedule of
suggested by Equation 4. When alternative
reinforcement during the baseline and a VI 30-s schedule reinforcement is present, Equation 4 gener-
of alternative reinforcement during extinction using the ates one extinction function with a larger
parameter values listed in the figure. disruptor term, and thus, less overall respond-
ing. When alternative reinforcement is absent,
but those exposed to 3 and 9 days did. Although Equation 4 generates another extinction func-
the difference between the amount of resur- tion associated with a smaller disruptor term
gence for the 3-day and 9-day groups was not and overall more responding. When alterna-
statistically significant, the data are visually tive reinforcement is repeatedly presented and
ordered such that 3 days . 9 days . 27 days. removed, as in Figure 3, the predictions of the
The continuous growth of disruption in the model result from switching between these two
numerator of Equation 4 as a function of time extinction functions across time. In addition,
in extinction also suggests that repeated because time in extinction (i.e., t) continues to
resurgence tests should produce less respond- increase regardless of the presence or absence
A MODEL OF RESURGENCE 99

of alternative reinforcement, lower overall Figure 4 shows a simulation of the effects of


levels of responding are predicted with succes- a four-fold difference in baseline reinforce-
sive removals of alternative reinforcement ment rates (i.e., VI 30 s vs. VI 120 s) and a
occurring at later time points in extinction. range of alternative reinforcement rates on
The predictions in Figure 3 could represent resistance to extinction and resurgence. The
an interesting test of the model. However, top-left panel shows extinction in the absence
experiments in which resurgence has been of alternative reinforcement (i.e. Ra 5 0),
repeatedly examined have included a return to where responding previously maintained by
the Phase 1 baseline condition before the the higher rate of reinforcement arranged by a
successive exposures to Phases 2 and 3 (Liev- VI 30 s (i.e., Rich) is clearly more resistant to
ing & Lattal, 2003; da Silva et al., 2008). When extinction than that previously maintained by
baseline conditions are reestablished between a VI 120 s (i.e., Lean). In the absence of
subsequent Phase 2 and 3 tests, time in alternative reinforcement, Equation 4 reduces
extinction (i.e., t) is reset to zero prior to each to the standard augmented model of extinc-
test. Thus, under these conditions, Equation 4 tion (i.e., Equation 1), and no resurgence
predicts the each reexposure to Phases 2 and 3 occurs. In the top right panel, low-rate
should produce the same amount of resur- alternative reinforcement is arranged during
gence. The data from the two experiments extinction and then removed on the sixth
appear to be consistent with this prediction. session. Comparison with the top-left panel
We know of only one relevant report examin- shows that, as discussed above, response
ing the effects of successive conditions in elimination is faster with the added reinforce-
which alternative reinforcement was present ment than without it. Most importantly, the
or removed (Nevin & Wacker, in press). Nevin difference between the Rich and Lean com-
and Wacker provide summary data from a ponents is reduced with the addition of
number of cases in which alternative rein- alternative reinforcement, and removal of that
forcement associated with functional commu- alternative reinforcement produces resur-
nication training alternated with more typical gence. The other panels show the effects of
extinction of problem behavior of children in increases in the rate of alternative reinforce-
naturalistic environments. Consistent with the ment. As the rate of alternative reinforcement
predictions of Equation 4, their summary increases (i.e., the duration of the VI schedule
suggests that resurgence of problem behavior of Ra is shortened), response elimination is
decreased with successive presentations and faster, and the difference between the Rich
removals of alternative reinforcement provid- and Lean components decreases. The decreas-
ed by functional communication training. ing difference for the Rich and Lean compo-
Nonetheless, a more thorough assessment of nents with higher rates of alternative rein-
the prediction of Equation 4 that resurgence forcement occurs despite the fact that the
results from switching between two extinction overall magnitude of the resurgence effect
functions with differential disruption terms will increases when those higher rates of alterna-
require additional experimental investigation. tive reinforcement are removed. Thus, al-
though the model predicts that differential
Reinforcement Rates Prior to Response Elimination baseline reinforcement rates affect both resis-
Like the relapse model of Podlesnik and tance to extinction and resurgence, the effects
Shahan (2009, 2010), the model of resurgence of differential reinforcement during baseline
suggested by Equation 4 is based on behavioral are relatively small in most cases because of an
momentum theory. Thus, Equation 4 predicts interaction with the rate of alternative rein-
that higher baseline reinforcement rates forcement.
should produce relatively greater resistance Although a parametric examination of the
to extinction and greater resurgence. Howev- effects of baseline reinforcement rate on
er, as we demonstrate below, the addition of resurgence has not been published, our
alternative reinforcement (i.e., Ra) in Equa- laboratory has examined such effects in a few
tion 4 reduces the expected impact of differ- experiments. Figure 5 shows the data from
ential baseline reinforcement rates compared three experiments in which the effects of
to that predicted by the standard augmented different baseline reinforcement rates on
model (Equation 1). resurgence were examined using multiple
100 TIMOTHY A. SHAHAN and MARY M. SWEENEY

Fig. 4. Simulations of the effects of baseline reinforcement rate (i.e., VI 30 or VI 120) and rate of alternative
reinforcement during extinction (i.e., Ra) on resurgence as generated by Equation 4.

schedules of reinforcement. The top panel both predict that the overall stimulus reinforc-
shows data from 5 pigeons that received Phase er relation arranged by a multiple-schedule
1 baseline training on a multiple schedule with component stimulus is the relevant determi-
a VI 30 s in a Rich component and a VI 120 s in nant of resistance to extinction and resur-
a Lean component (Podlesnik & Shahan, gence. During Phase 2 extinction of the target
2010). A VI 30-s schedule arranged reinforce- behavior (and removal of the VT reinforcers),
ment for pecking an alternative key during a VI 30-s schedule arranged reinforcement for
Phase 2 extinction of the target behavior. The pecking an alternative key. Finally, the bottom
middle panel shows data for 7 pigeons trained panel shows data from 4 rats trained on a
on a multiple schedule with a VI 120-s + VT 20- Phase 1 multiple schedule with a VI 45-s + VT
s schedule in a Rich component and a VI 120-s 15-s schedule in the Rich component and a VI
schedule alone in a Lean component during 45 s alone in a Lean component (Podlesnik &
Phase 1 baseline training (Podlesnik & Sha- Shahan, 2010). Alternative reinforcement dur-
han, 2009). Although the higher rate of ing Phase 2 extinction was arranged for
baseline reinforcement was accomplished by pulling a chain on a VI 10-s schedule. In all
including response-independent reinforcers three experiments, resistance to extinction in
during the baseline, behavioral momentum Phase 2 and resurgence in Phase 3 were
theory (e.g., Nevin et al., 1990) and Equation 4 somewhat greater in the Rich component than
A MODEL OF RESURGENCE 101

ments, they arranged concurrent schedules in


Phase 1 such that: (1) one response occurred
at a higher rate and produced higher rein-
forcement rates, (2) one response occurred at
a higher rate, but the two responses produced
equal reinforcement rates, and (3) the re-
sponses occurred at similar rates, but pro-
duced different reinforcement rates. In Phase
2, responding was eliminated with either
extinction plus alternative reinforcement for
pecking a third key or DRO imposed on both
of the target responses. In Phase 3, all
alternative reinforcement was removed. In all
three experiments, absolute response rates
during Phase 3 resurgence were higher for
the response that previously had the highest
response rate during baseline. Differential
reinforcement rates for the two concurrent
responses during Phase 1 had no impact on
resurgence. However, from the perspective of
behavioral momentum theory and Equation 4,
the overall rate of reinforcement in the
stimulus context is the critical variable, not
the rate of reinforcement produced by a
particular response. With concurrent schedules
of reinforcement, the two responses occur in
the same stimulus context, and thus share the
same overall stimulus–reinforcer relation (e.g.,
Nevin et al., 1990). Accordingly, differential
resurgence would not be expected for concur-
rent operants differing in the reinforcement
rates they produce. da Silva et al. also showed
response rates expressed as a proportion of
Fig. 5. Least-squares regressions of Equation 4 to baseline and demonstrated that, consistent with
existing datasets in which different baseline reinforcement Equation 4, resurgence relative to baseline did
rates were arranged in the baseline condition. See text not differ for the concurrent responses, despite
for details.
the differences in baseline absolute response
rates. Thus, the overall reinforcement rate
in the Lean component. Nonetheless, as experienced in the baseline condition appears
expected, the effects of arranging differential to govern subsequent resurgence of all respons-
reinforcement rates in the baseline tended to es in that context, regardless of their baseline
be relatively small as a result of the high rates frequency of occurrence.
of alternative reinforcement arranged during Contrary to the conclusion above, Reed and
extinction. These effects were well described Morgan (2007) have suggested that resur-
by Equation 4, which accounted for . 90% of gence is governed by baseline response rates
the variance for each dataset with reasonable rather than baseline reinforcement rates. In
parameter values. two experiments with rats, Reed and Morgan
Additional support for the suggestion that arranged a multiple schedule in Phase 1 such
resurgence depends upon the overall rate of that reinforcement rates were similar in two
reinforcement experienced during the preex- components, but response rates were higher in
tinction baseline comes from da Silva et al. one component than the other (Experiment
(2008), who examined resurgence of pigeons’ 1 5 RR vs. RI; Experiment 2 5 differential
key pecking following training on concurrent reinforcement of high rates vs. differential
schedules of reinforcement. In three experi- reinforcement of low rates). However, in Phase
102 TIMOTHY A. SHAHAN and MARY M. SWEENEY

2, rather than reinforcing an alternative forced and then extinguished key pecking of
response or using a DRO to eliminate pigeons. Once key pecking had ceased, some
responding, Reed and Morgan exposed their other response (e.g., wing raising) was rein-
rats to a multiple fixed-interval (FI) schedule forced 20 times on a FR 1 schedule. Following
for the same target response used in Phase 1. the 20 reinforcers for the alternative behavior,
Although subsequent removal of the FI rein- all reinforcement was withheld and key peck-
forcement in a third phase produced an ing increased. Thus, even when the target
increase in responding in some cases, this response is eliminated beforehand, extinction
unusual procedure introduces numerous com- of a subsequently reinforced alternative behav-
plexities. First, in both experiments, the rate of ior appears to produce resurgence. For conve-
the previously low-rate behavior tended to nience, we will refer to this type of resurgence
increase during the FI-reinforcement condi- as Epstein-type resurgence.
tion, an outcome that is clearly inconsistent Before we begin a discussion of the applica-
with viewing that phase as a form of response bility of Equation 4 to Epstein-type resurgence,
elimination. As a result of this procedure, it is worth noting that few data generated by
when FI reinforcement was removed in Phase this procedure are available. In addition, with
3, the high-rate behavior was starting at a rate the exception of the Lieving and Lattal (2003)
lower than baseline and the low-rate behavior experiment, the data are not presented with
at a rate higher than baseline. This difference sufficient detail to allow assessment of the size
makes it difficult to interpret responding of the increase in responding relative to
during extinction in Phase 3 relative to the baseline training levels. Regardless, in trying
Phase 1 baseline. Second, the fact that the to understand this type of resurgence from the
target response continued to produce the perspective of Equation 4, initial extinction of
reinforcer during Phase 2 argues against the target behavior in the absence of alterna-
characterizing such reinforcers as alternative tive reinforcement would mean that Ra 5 0,
reinforcers at all. Together, these differences and thus, Equation 4 reduces to the standard
from the usual resurgence preparation make it augmented model of extinction (i.e., Equation
difficult to interpret Reed and Morgan’s 1). When the alternative reinforcer is intro-
findings. Given that in some cases baseline duced, Ra would then appear in the numerator
response rates have been shown to impact as an added source of disruption and in the
resistance to change independent of reinforce- denominator as a source of reinforcement in
ment rates using procedures similar to Reed the situation. Given the low levels of respond-
and Morgan (e.g., Lattal, 1989; Nevin, Grace, ing prior to the addition of alternative
Holland, & McLean, 2001), it is certainly reinforcement, the added source of disruption
possible such effects could also occur with in the numerator would have little measure-
resurgence. Additional experiments using typ- able effect on behavior. Subsequent release
ical resurgence procedures will be required to from the added disruption when the alterna-
examine whether baseline response rates tive source of reinforcement is removed would
impact resurgence independent of reinforce- also have a small effect, and Equation 4
ment rates, and how such effects should be predicts a small increase in responding due
interpreted if they occur. the presence of Ra in the denominator. Given
that Cleland et al. (2000) and Epstein (1983)
Extinguishing the Target Behavior Prior to provide no information about the rate of the
Alternative Reinforcement target behavior prior to extinction, it is
In all of the resurgence experiments dis- possible that the small increase in responding
cussed above, alternative reinforcement was predicted by Equation 4 could account for the
introduced at that same time that extinction increases observed in those experiments.
started for the target behavior. A small subset The Epstein-type resurgence experiment
of experiments have also shown that resur- reported by Lieving and Lattal (2003) ob-
gence occurs if the target response is extin- tained larger increases in responding with
guished prior to introduction of alternative removal of the alternative reinforcer (to about
reinforcement (Cleland et al., 2000; Epstein, 25–50% of baseline rates), and Equation 4
1983; Lieving & Lattal, 2003, Experiment 1). does not predict such large increases in
For example, Epstein (1983) initially rein- responding in its current form. However, one
A MODEL OF RESURGENCE 103

aspect of the Epstein-type resurgence proce- A common previous account of resurgence


dure overlooked by Equation 4 is the possibil- was that the phenomenon results from an
ity that the reintroduction of reinforcement to interaction between the target behavior and
the situation after extinction of the target the alternative behavior reinforced during
behavior might have a reinstatement-like extinction. This response-prevention hypothe-
effect. As noted above, reinstatement refers sis (e.g., Rawson, Leitenberg, Mulick, &
to the reappearance of extinguished respond- LeFebvre, 1977) suggests that when an alter-
ing following the delivery of response-inde- native behavior is introduced during extinc-
pendent reinforcement (e.g., Reid, 1958). If tion of the target behavior, the occurrence of
one assumes that reinforcers delivered contin- the alternative behavior competes with the
gent upon an alternative response following target behavior and prevents it from complete-
extinction of a target behavior might also have ly extinguishing. When the alternative behav-
a reinstatement-like effect, then inclusion of ior is no longer reinforced, the competition
this effect in the model of resurgence provided between the two behaviors is eliminated and
by Equation 4 would be required in order to the incompletely extinguished target behavior
account for resurgence in Epstein-type prepa- is free to occur again. Thus, unlike the present
rations. One approach to including a rein- account, which suggests that it is the occur-
statement-like effect of alternative reinforce- rence of alternative reinforcement that dis-
ment in Equation 4 would be to combine that rupts the target behavior, the response pre-
equation with the model of reinstatement (i.e., vention hypothesis suggests that it is the
Equation 2 above) suggested by Podlesnik and occurrence of behavior maintained by the
Shahan (2009, 2010). Thus, the combined alternative reinforcer that disrupts the target
model would simply be Equation 4 with the behavior. It is worth noting that similar
m and n parameters from Equation 2. With dueling interpretations about interactions
appropriate parameter values, such a com- between two concurrently available operant
bined model can predict an Epstein-type responses were addressed in the 1960s and
resurgence effect comparable in magnitude 1970s. The question was whether decreases in
to that obtained by Lieving and Lattal. one behavior with increases in reinforcement
Regardless, given the paucity of data on for the other behavior occurred because of a
Epstein-type resurgence, further speculation competition between the two responses or
about how such a model might capture this because of the direct interaction between
phenomenon would seem unjustified at pres- reinforcement sources (i.e., relative reinforce-
ent. Suffice it to say that such a model might ment rate). The data clearly supported an
provide a reasonable starting point to ap- interpretation based on direct interaction
proach the phenomenon once additional data between the sources of reinforcement rather
are available. than an indirect interaction mediated through
response competition (e.g., Catania, 1963;
Relationship to Existing Accounts of Resurgence Rachlin & Baum, 1972). In fact, such direct
The model of resurgence proposed here reinforcement interaction provides the foun-
suggests that resurgence can be understood dation for all of matching theory (i.e., Herrn-
within the larger theoretical framework of stein, 1961, 1970) and behavioral momentum
behavioral momentum theory. When an alter- theory (e.g, Nevin & Grace, 2000). Thus, the
native source of reinforcement is added previous failures of response interactions to
during extinction of the target behavior, the provide an account for the relative allocation
availability of that alternative reinforcement of current responses seem to argue against
serves as an additional source of disruption. In such interactions playing a major role in the
addition, the alternative source of reinforce- effects of alternative reinforcement during
ment in the situation increases the future extinction.
strength of the target behavior by contributing In addition to the concern noted above, the
to the Pavlovian stimulus–reinforcer relation most problematic aspect of the response-
associated with the context. When the alterna- prevention hypothesis is that it suggests
tive reinforcement is removed, disruption of occurrence of the target behavior during
the target behavior is reduced and responding Phase 2 response elimination and during
increases (i.e., resurgence occurs). Phase 3 resurgence should be inversely relat-
104 TIMOTHY A. SHAHAN and MARY M. SWEENEY

ed. The reason is that when the target problems as an account of resurgence. First, it
behavior occurs more during response elimi- predicts that although responding during
nation, it should be more completely extin- extinction is positively related to the baseline
guished, and thus occur less when the alter- reinforcement rate, resurgence (i.e., B1R) is
native reinforcement is removed during Phase inversely related to baseline reinforcement
3. Although some data could be interpreted as rate. The data in Figure 5 clearly show that
being consistent with this expectation (e.g., responding during extinction and during
the Leitenberg et al., 1975 data modeled in resurgence are positively related (see also
Figure 1), the response-prevention hypothesis Podlesnik & Shahan, 2010). Second, and most
nonetheless appears to be false. For example, importantly, the left-hand side of Equation 7 is
in a series of experiments, Winterbauer and a formal statement of the response prevention
Bouton (2010) have shown that the frequency hypothesis. The model suggests that target
of occurrence of the target behavior during responding during Phase 2 response elimina-
response elimination is not related to the tion and Phase 3 resurgence is allocated to one
amount of resurgence obtained. This outcome or the other of those phases, and thus,
led Winterbauer and Bouton to conclude that resurgence results from the prevention of
response prevention plays little role in resur- extinction of the target behavior. As discussed
gence. Further evidence that the response- above, the response-prevention hypothesis is
prevention hypothesis is false comes from likely false. Given these considerations, Equa-
Epstein-type resurgence, which demonstrates tion 7 does not appear to provide a viable
that resurgence occurs even if the target account of resurgence.
behavior is extinguished prior to introduction Finally, Bouton and Swartzentruber (1991)
of the alternative reinforcement. Thus, the have suggested that resurgence might be
above considerations suggest that the re- understood as resulting from a contextual
sponse-prevention hypothesis does not provide renewal effect. As noted above, renewal involves
a viable account of resurgence. an increase in extinguished responding with a
The model of resurgence proposed here change in context from that in which extinction
also shares some features with the only other took place. For example, in ABA renewal,
previous formal attempt to model resurgence. training occurs in Context A, extinction in
Cleland, Guerin, Foster, and Temple (2001) Context B, and then responding increases
proposed an account of resurgence based on when the subject is returned to Context A.
the matching law such that: Bouton and Swartzentruber suggested that
    resurgence might occur because training in
B1E r1 which an operant response is reinforced
log ~a log z log b ð7Þ
B1R r2E represents Context A, and extinction in the
presence of an alternative source of reinforce-
where B1E is the rate of the target behavior ment serves as Context B. When the alternative
during extinction plus alternative reinforce- source of reinforcement is removed, the con-
ment for a second behavior in Phase 2, and B1R text may be more similar to Context A than
is the rate of the target behavior during Phase Context B, and responding increases. However,
3 resurgence when the alternative reinforcer is more recently, Winterbauer and Bouton (2010)
removed. The reinforcement term r1 is the have suggested that resurgence would be more
rate of reinforcement for the target behavior appropriately characterized as ABC renewal
in the Phase 1 baseline prior to response because the absence of reinforcement in Phase
elimination and the term r2E is the rate of 3 resurgence is more like a new context (i.e.,
alternative reinforcement for the second be- Context C) than the original training context
havior during Phase 2 response elimination. (i.e., Context A). Although this account seems
Like the model proposed above, Equation 7 plausible, ABC renewal of operant behavior has
suggests that occurrence of the target behavior not been reliably observed, and the increase in
during extinction is directly related to the responding appears to be rather small when it
baseline rate of reinforcement and inversely does occur (Bouton, Todd, Vurbic, & Winter-
related to the rate of reinforcement for the bauer, in press; Zironi, Burattini, Aicardi, &
alternative behavior. Despite these similarities Janak, 2006). As a result, it is not clear that ABC
to the present approach, Equation 7 has two renewal can account for the robust increases in
A MODEL OF RESURGENCE 105

responding often observed in resurgence ex- how to incorporate the rate of reinforcement
periments. In addition, it is not clear how a provided by the alternative response. As is
renewal-based approach to resurgence can clear from Equations 3 and 4, we have assumed
account for the variety of effects reviewed that the effects of the baseline reinforcement
above. Thus, at present, it is not clear that an rate (r) and the alternative reinforcement rate
ABC renewal effect will provide a viable account (Ra) are additive. With the transition to Phase
of operant resurgence. Generating and testing 3 when all reinforcement is removed from the
differential predictions based on the model of situation, we have carried forward both r and
resurgence proposed here and based on an Ra in order to be consistent with the initial
ABC-renewal account could be a promising transition from baseline to Phase 1. As
area for future research. Nonetheless, the demonstrated by the success of the current
concept of context might prove sufficiently model, this approach seems to work well in
flexible to make a renewal-based account accounting for existing data from resurgence
difficult to test and/or falsify. experiments.
One interesting implication of the approach
Potential Implications for Behavioral above is that it assumes that the target
Momentum Theory response from baseline can be further
Although the model of resurgence present- strengthened while it is undergoing extinction
ed here (i.e., Equation 4) is a relatively if an alternative source of reinforcement is
straightforward extension of behavioral mo- introduced into the discriminative stimulus
mentum theory, it does raise some interesting context. Given that behavioral momentum
issues about the augmented model of extinc- theory suggests that resistance to extinction is
tion (i.e., Equation 1) upon which it is based. driven by the discriminative stimulus–reinforc-
For convenience we again present the aug- er relation, this implication may not seem
mented model of extinction here: particularly controversial. As noted above, it is
  well established that the inclusion of addition-
Bt {t(czdr ) al response-independent reinforcement or
log ~ ð8Þ
Bo rb reinforcement contingent upon a concurrent
response increases resistance to change of a
where all terms are as in Equation 1. In target behavior via the stimulus–reinforcer
previous applications of the augmented model relation (e.g., Nevin et al., 1990). However,
to extinction data, a baseline is established and because the current model assumes that
then Equation 8 is applied to account for the reinforcement from previous conditions is
decrease in responding associated with expo- carried forward to the next temporal epoch
sure to extinction (e.g., Nevin et al., 2001). As and added to the prevailing reinforcement
noted above, such applications of the aug- conditions, it is not difficult to imagine
mented model carry the reinforcement rate scenarios in which the underlying logic of this
experienced in baseline (i.e., r in the denom- approach becomes strained. For example,
inator) into the extinction condition. In consider a sequence of conditions like those
essence, the r term serves as a sort of perfect simulated above in Figure 3 in which alterna-
memory of the reinforcement history in the tive reinforcement is repeatedly added and
baseline condition. All decreases in respond- removed from the situation. For the simula-
ing are driven by the growth of the disruption tion in Figure 3 the alternative reinforcement
in the numerator of the equation. This rate was included in the denominator of
approach has proven fairly successful in terms Equation 4 for the initial extinction plus
of accounting for the effects of baseline alternative reinforcement condition only.
reinforcement rate on resistance to extinction. The subsequent increases and decreases in
In extending Equation 8 to account for responding occurred as a result of the addition
resurgence, we have followed the same basic and removal of the disruptive effects of
approach by carrying forward the reinforce- alternative reinforcement (Ra) in the numer-
ment rate experienced in baseline into the ator of Equation 4. One could reasonably
extinction plus alternative reinforcement argue that for the sake of consistency another
phase (i.e., Phase 2). With the transition to Ra term should be added to the denominator
Phase 2, a question that immediately arises is with the reintroduction of alternative rein-
106 TIMOTHY A. SHAHAN and MARY M. SWEENEY

forcement in the final condition. It turns out than the usual 0.5. One can also imagine more
that doing so produces only a modest increase complex approaches to calculating the inte-
in the amount of resurgence predicted in the gration of reinforcement rates across condi-
final condition. tions such as decaying effects of previously
The simulation of alternations between dif- experienced reinforcement rates with time, or
ferent conditions of alternative reinforcement a variety of other more complex algorithms. At
presented in Figure 3 only includes a series of present, the available data do not appear to
four conditions. But, what of longer sequences justify such additional complexity or to ade-
involving transitions between multiple rates of quately constrain the choice of one approach
alternative reinforcement? Should the reinforc- over the other. Nonetheless, the generation of
er rates from a long series of experienced additional data based on sequences of chang-
reinforcement rates across temporal epochs ing reinforcement conditions for a target
similarly be included in the denominator behavior and alternative reinforcement might
additively (e.g., r +Ra1 +Ra2 +…Ran)? Clearly, suggest more appropriate ways to proceed with
such perfect memory for experienced reinforce- the future development of behavioral momen-
ment rates and their additive strengthening tum theory in general. Such development
across many temporal epochs becomes absurd could lead to a fairly broad quantitative theory
over the long run. In order to account for of how behavioral history is mediated through
changing reinforcement rates across conditions, the integration of experienced reinforcement
behavioral momentum theory will need to deal conditions as amassed in the Pavlovian stimu-
with how reinforcement rates across conditions lus–reinforcer relation.
and temporal epochs should be integrated.
In developing of the present model of Conclusions
resurgence, we have pursued the path that The model of resurgence developed here
seemed the simplest and most consistent with suggests that resurgence can be understood
previous applications of the augmented model within the framework of behavioral momentum
of extinction. As we hope is clear from the theory as expressed in an extension of the
success of the model, this approach appears augmented model of extinction. The model
adequate for the time being and provides a suggests that resurgence occurs as a result of
reasonable starting point as a theory of the dual effects of alternative reinforcement
resurgence based on behavioral momentum during extinction of a target response. First,
theory. Nonetheless, a number of alternative alternative reinforcement suppresses the target
approaches could be used to account for behavior by acting as an additional source of
resurgence, but these approaches would need disruption. Second, alternative reinforcement
to inform behavioral momentum theory more strengthens the Pavlovian stimulus–reinforcer
generally in order to maintain conceptual relation, thus increasing the future strength of
consistency. For example, rather than assum- the target behavior when the countervailing
ing that reinforcement rates experienced disruptive effects are removed. The model does
across conditions are additive, one could a good job of providing a coherent approach
assume that reinforcement rates are averaged. for systematizing the existing resurgence liter-
It turns out that using average rather than ature and it makes novel and testable predic-
additive reinforcement rates changes parame- tions about effects that have not yet been
ter values and the quality of fits of the present observed. Thus, we suggest that the model as
model very little. If such an approach were to formalized in Equation 4 provides a good
be pursued, it would suggest that fits of the framework within which to pursue the study
augmented model to standard extinction data of resurgence and to integrate the phenome-
(i.e., without alternative reinforcement) non into the larger existing theoretical account
should also use the average of reinforcement of operant response persistence provided by
rates during baseline and during extinction. behavioral momentum theory. In addition,
This, of course, would amount to nothing consideration of the present model suggests
more than using 0.5r (i.e., [r+0]/2) in the that future development of behavior momen-
denominator of applications of the augment- tum theory should focus on how the effects of
ed model to standard extinction, thus requir- reinforcement conditions experienced across
ing a standard sensitivity value slightly greater temporal epochs might be integrated.
A MODEL OF RESURGENCE 107

REFERENCES Lattal, K. A., & St. Peter Pipkin, C. (2009). Resurgence of


previously reinforced responding: Research & appli-
Ahearn, W. H., Clark, K. M., Gardenier, N. C., Chung, B. I., cation. The Behavior Analyst Today, 10, 254–265.
& Dube, W. V. (2003). Persistence of stereotypy: Leitenberg, H., Rawson, R. A., & Bath, K. (1970).
Examining the effects of external reinforcers. Journal Reinforcement of competing behavior during extinc-
of Applied Behavior Analysis, 36, 439–447. tion. Science, 169, 301–303.
Bouton, M. E. (2004). Context and behavioral processes in Leitenberg, H., Rawson, R. A., & Mulick, J. A. (1975).
extinction. Learning & Memory, 11, 485–494. Extinction and reinforcement of alternative behavior.
Bouton, M. E., & Swartzentruber, D. (1991). Sources of Journal of Comparative and Physiological Psychology, 88,
relapse after extinction in Pavlovian and instrumental 640–652.
learning. Clinical Psychology Review, 11, 123–140. Lieving, G. A., Hagopian, L. P., Long, E. S., & O’Connor, J.
Bouton, M. E., Todd, T. P., Vurbic, D., & Winterbauer, (2004). Response-class hierarchies and resurgence of
N. E. (in press). Renewal after the extinction of free severe problem behavior. The Psychological Record, 54,
operant behavior. 621–634.
Carr, E. G., & Durand, V. M. (1985). Reducing behavior Lieving, G. A., & Lattal, K. A. (2003). Recency, repeatabil-
problems through functional communication train- ity, and reinforcer retrenchment: An experimental
ing. Journal of Applied Behavior Analysis, 18, 111–126. analysis of resurgence. Journal of the Experimental
Catania, A. C. (1963). Concurrent performances: Rein- Analysis of Behavior, 80, 217–233.
forcement interaction and response independence. Mace, F. C., Lalli, J. S., Shea, M. C., Lalli, E. P., West, B. J.,
Journal of the Experimental Analysis of Behavior, 6, Roberts, M., & Nevin, J. A. (1990). The momentum of
253–263. human behavior in a natural setting. Journal of the
Cleland, B. S., Foster, T. M., & Temple, W. (2000). Experimental Analysis of Behavior, 54, 163–172.
Resurgence: The role of extinction. Behavioural Mulick, J. A., Leitenberg, H., & Rawson, R. A. (1976).
Processes, 52, 117–129.
Alternative response training, differential reinforce-
Cleland, B. S., Guerin, B., Foster, T. M., & Temple, W.
ment of other behavior, and extinction in squirrel
(2001). On terms: Resurgence. The Behavior Analyst,
monkeys (saimiri sciureus). Journal of the Experimental
24, 255–260.
Analysis of Behavior, 25, 311–320.
Cohen, S. L. (1996). Behavioral momentum of typing
Nakajima, S., Tanaka, S., Urushihara, K., & Imada, H.
behavior in college students. Journal of Behavior
(2000). Renewal of extinguished lever-press responses
Analysis & Therapy, 1, 36–51.
upon return to the training context. Learning and
da Silva, S. P., Maxwell, M. E., & Lattal, K. A. (2008).
Motivation, 31, 416–431.
Concurrent resurgence and behavioral history. Journal
of the Experimental Analysis of Behavior, 90, 313–331. Nevin, J. A. (2002). Measuring behavioral momentum.
Behavioural Processes, 57, 187–198.
Doughty, A. H., da Silva, S. P., & Lattal, K. A. (2007).
Differential resurgence and response elimination. Nevin, J. A., Davison, M., & Shahan, T. A. (2005). A theory
Behavioural Processes, 75, 115–128. of attending and reinforcement in conditional dis-
Doughty, A. H., & Oken, G. (2008). Extinction-induced criminations. Journal of the Experimental Analysis of
response resurgence: A selective review. The Behavior Behavior, 84, 281–303.
Analyst Today, 9, 27–34. Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum
Enkema, S., Slavin, R., Spaeth, C., & Neuringer, A. (1972). and the law of effect. Behavioral and Brain Sciences, 23,
Extinction in the presence of free food. Psychonomic 73–130.
Science, 26, 267–269. Nevin, J. A., & Grace, R. C. (2005). Resistance to change
Epstein, R. (1983). Resurgence of previously reinforced in the steady state and in transition. Journal of
behavior during extinction. Behaviour Analysis Letters, Experimental Psychology: Animal Behavior Processes, 31,
3, 391–397. 199–212.
Epstein, R. (1985). Extinction-induced resurgence: Pre- Nevin, J. A., Grace, R. C., Holland, S., & McLean, A. P.
liminary investigations and possible applications. The (2001). Variable-ratio versus variable-interval sched-
Psychological Record, 35, 143–153. ules: Response rate, resistance to change, and
Grimes, J. A., & Shull, R. L. (2001). Response-independent preference. Journal of the Experimental Analysis of
milk delivery enhances persistence of pellet-rein- Behavior, 76, 43–74.
forced lever pressing by rats. Journal of the Experimental Nevin, J. A., McLean, A. P., & Grace, R. C. (2001).
Analysis of Behavior, 76, 179–194. Resistance to extinction: Contingency termination
Harper, D. N. (1999). Drug-induced changes in respond- and generalization decrement. Animal Learning &
ing are dependent on baseline stimulus–reinforcer Behavior, 29, 176–191.
contingencies. Psychobiology, 27, 95–104. Nevin, J. A., Tota, M. E., Torquato, R. D., & Shull, R. L.
Herrnstein, R. J. (1961). Relative and absolute strength of (1990). Alternative reinforcement increases resistance
response as a function of frequency of reinforcement. to change: Pavlovian or operant contingencies?
Journal of the Experimental Analysis of Behavior, 4, Journal of the Experimental Analysis of Behavior, 53,
267–272. 359–379.
Herrnstein, R. J. (1970). On the law of effect. Journal of the Nevin, J. A., & Wacker, D. P. (in press). Response strength
Experimental Analysis of Behavior, 13, 243–266. and persistence. In G. J. Madden (Ed.), Handbook of
Igaki, T., & Sakagami, T. (2004). Resistance to change in Behavior Analysis: Volume 2. Washington D.C.: Ameri-
goldfish. Behavioural Processes, 66, 139–152. can Psychological Association.
Lattal, K. A. (1989). Contingencies on response rate and Pacitti, W. A., & Smith, N. F. (1977). A direct comparison
resistance to change. Learning and Motivation, 20, of four methods for eliminating a response. Learning
191–203. and Motivation, 8, 229–237.
108 TIMOTHY A. SHAHAN and MARY M. SWEENEY

Podlesnik, C. A., Jimenez-Gomez, C., & Shahan, T. A. (2006). Shahan, T. A., & Burke, K. A. (2004). Ethanol-maintained
Resurgence of alcohol seeking produced by discontinu- responding of rats is more resistant to change in a
ing non-drug reinforcement as an animal model of drug context with added non-drug reinforcement. Behav-
relapse. Behavioral Pharmacology, 17, 369–374. ioral Pharmacology, 15, 279–285.
Podlesnik, C. A., & Shahan, T. A. (2009). Behavioral Uhl, C., & Garcia, E. (1969). Comparison of omission
momentum and relapse of extinguished operant with extinction in response elimination in rats.
responding. Learning & Behavior, 37, 357–364. Journal of Comparative and Physiological Psychology, 69,
Podlesnik, C. A., & Shahan, T. A. (2010). Extinction, 554–562.
relapse, and behavioral momentum. Behavioural Pro- Volkert, V. M., Lerman, D. C., Call, N. A., & Trosclair-
cesses, 84, 400–411. Lasserre, N. (2009). An evaluation of resurgence
Rachlin, H., & Baum, W. M. (1972). Effects of alternative during treatment with functional communication
reinforcement: Does the source matter? Journal of the training. Journal of Applied Behavior Analysis, 42,
Experimental Analysis of Behavior, 18, 231–241. 145–160.
Rawson, R. A., Leitenberg, H., Mulick, J. A., & Lefebvre, M. Winterbauer, N. E., & Bouton, M. E. (2010). Mechanisms
F. (1977). Recovery of extinction responding in rats of resurgence of an extinguished instrumental behav-
following discontinuation of reinforcement of alter- ior. Journal of Experimental Psychology: Animal Behavior
native behavior: A test of two explanations. Animal Processes, 36, 343–353.
Learning & Behavior, 5, 415–420. Zironi, I., Burattini, C., Aicardi, G., & Janak, P. H. (2006).
Reed, P., & Morgan, T. A. (2007). Resurgence of behavior Context is a trigger for relapse to alcohol. Behavioural
during extinction depends on previous rate of Brain Research, 167, 150–155.
response. Learning & Behavior, 35, 106–114.
Reid, R. L. (1958). The role of the reinforcer as a stimulus. Received: May 11, 2010
British Journal of Psychology, 49, 292–309. Final Acceptance: October 11, 2010

You might also like