Professional Documents
Culture Documents
________________________________________
Resurgence is generally defined as the creased. Such resurgence effects have been
reappearance of an extinguished target behav- noted repeatedly in a number of situations and
ior when an alternative behavior reinforced with a range of different species (see Doughty
during extinction is also subsequently placed & Oken, 2008; Epstein, 1985; Lattal & St. Peter
on extinction (e.g., Cleland, Foster, & Temple, Pipkin, 2009, for reviews).
2000). In the laboratory, experiments examin- The phenomenon of resurgence is of
ing resurgence typically include three phases. particular interest because it could be a major
During Phase 1, a target behavior is reinforced source of relapse following behavioral inter-
on a baseline schedule. In Phase 2, the target ventions for a variety of applied problems. For
behavior is placed on extinction and an example, the treatment of problem behavior
alternative behavior is reinforced. In Phase 3, in persons with developmental disabilities
the alternative behavior is also placed on often involves simultaneous extinction of the
extinction and the target behavior increases problem behavior and reinforcement of ap-
(i.e., resurgence occurs). For example, Leiten- propriate behavior (e.g., Carr & Durand, 1985).
berg, Rawson, and Bath (1970) reinforced Resurgence of problem behavior can occur with
lever pressing of rats on a variable-interval (VI) such treatments when reinforcement for the
30-s schedule of food delivery in Phase 1. In alternative behavior is later reduced or elimi-
Phase 2, pressing the original lever was no nated (e.g., Volkert, Lerman, Call, & Trosclair-
longer reinforced, and pressing an alternative Lasserre, 2009; see also Lieving, Hagopian,
lever was reinforced on a fixed-ratio (FR) 10 Long, & O’Connor, 2004). In addition, resur-
schedule. In Phase 3, pressing the alternative gence effects have been suggested as a possible
lever was also placed on extinction, and source of relapse to drug abuse with a decrease
responding on the original lever then in- in the availability of alternative nondrug rein-
forcers (Podlesnik, Jimenez-Gomez, & Shahan,
Thanks to Chris Podlesnik, Amy Odum, Tony Nevin, 2006; Winterbauer & Bouton, 2010).
and the Behavior Analysis seminar group at Utah State Although resurgence is increasingly recog-
University for many conversations about resurgence. In
addition, Amy Odum and Tony Nevin provided helpful nized as an important behavioral phenome-
comments on an earlier version of the manuscript. This non, there has been little attempt to systema-
work was supported by NIH grant R01AA016786. tize the existing literature or to provide a
Address correspondence to Timothy A. Shahan, De- formal account of the processes governing
partment of Psychology, 2810 Old Main Hill, Utah State
University, Logan, UT 84322 (e-mail: tim.shahan@
resurgence. In what follows, we develop a
usu.edu). quantitative model of resurgence. The model
doi: 10.1901/jeab.2011.95-91 suggests that resurgence can be understood as
91
92 TIMOTHY A. SHAHAN and MARY M. SWEENEY
suspension (i.e., c) and n scales a reduction in during Phase 2 extinction produce faster
the generalization decrement (i.e., dr) associ- elimination of the target response, but a larger
ated with the occurrence of the relapse- increase in responding (i.e., resurgence) when
producing event, and other terms are as in the alternative reinforcer is removed in Phase
Equation 1. During extinction, m and n are 3. The difficulty for Equation 2 is that even
equal to 1, and Equation 2 is the same as with an inflated value of the c parameter to
Equation 1. With the occurrence of a relapse- accommodate the added disruptive effects of
producing event, m and n may assume values alternative reinforcement and the associated
of less than 1 and responding increases faster response elimination, the equation
because of a reduction in extinction-associated cannot capture the larger increase in respond-
disruption in the numerator. In addition, as is ing when a higher rate of alternative rein-
true with resistance to extinction, Equation 2 forcement is removed. The reason is that the
predicts that response rates as a proportion of value of the c parameter remains constant
baseline during relapse should be greater in during the alternative reinforcement phase
the presence of a stimulus associated with a and during the resurgence phase when the
higher rate of reinforcement prior to extinc- alternative reinforcer is removed. Simply re-
tion (i.e., higher r). This prediction is consis- ducing disruptive impact by decreasing m
tent with the data from a number of experi- and/or n when alternative reinforcement is
ments by Podlesnik and Shahan (2009, 2010) removed cannot predict the opposite effects of
examining relapse in reinstatement, renewal, a higher rate of reinforcement during re-
and resurgence preparations. sponse elimination and during resurgence.
Despite the fact that Equation 2 has provid- Thus, a more specific model is required to
ed good fits to data from some resurgence provide an acceptable theory of resurgence.
experiments (Podlesnik & Shahan, 2010),
further consideration suggests that the model A Model of Resurgence
fails as a theory of resurgence. The problem is The model of resurgence we develop here is
that when Equation 2 is used to describe data based on the augmented model of extinction
from resurgence experiments, the value of the (i.e., Equation 1) with two additions. First, the
c parameter required for the fits has been presence of an alternative source of reinforce-
considerably larger than for the value (i.e., ment during extinction is assumed to have a
< 1) in typical applications of Equation 1 to disruptive effect of its own. Second, the
extinction data (Nevin et al. 2001) and additional source of reinforcement in the
applications of Equation 2 to other relapse context during extinction is also assumed to
phenomena (e.g., reinstatement). The reason contribute to the future strength of the
is that in a resurgence preparation, reinforce- initially trained target behavior. Specifically,
ment for an alternative response is introduced
during Phase 2 extinction and tends to Bt {t(kRa zczdr )
log ~ ð3Þ
produce faster elimination of responding than Bo (r zRa )b
standard extinction (e.g., Leitenberg et al.,
1970). But, the c parameter should only be where all terms are as in Equation 1. Like the
capturing the disruptive effect of eliminating augmented model upon which it is based,
the contingency between the target response Equation 3 has parameters for suspending the
and its reinforcer, not the added disruptive contingency between the target behavior and
effects of having an alternative source of reinforcement (i.e., c), scaling the generaliza-
reinforcement present during extinction. In tion decrement associated with removal of
short, c is serving as an inappropriate catchall reinforcers for the target behavior from the
disruptor term when Equation 2 is applied to situation (i.e., d), and sensitivity to reinforce-
resurgence. ment (i.e., b). The added variable Ra is the rate
A second and related problem with Equa- of alternative reinforcement introduced dur-
tion 2 as an account of resurgence is that the ing extinction, and the added parameter k
equation cannot predict an important finding scales the disruptive impact of that alternative
in the resurgence literature. Leitenberg, Raw- reinforcement on the target behavior. Thus,
son, Mulick (1975, Experiment 3) showed that the addition of alternative reinforcement
higher rates of alternative reinforcement during extinction increases the disruptive
94 TIMOTHY A. SHAHAN and MARY M. SWEENEY
impact in the numerator by kRa, and higher and simulations reported here. In addition,
rates of alternative reinforcement produce the value of d has been near 0.001 in previous
larger decrements in the target behavior as a fits of Equation 1 to extinction data (e.g.,
result. When alternative reinforcement is Nevin & Grace, 2000) and fits of Equation 2 to
removed, Ra in the numerator goes to zero, relapse data (Podlesnik & Shahan, 2010).
and the suppressive effect of the alternative Thus, we have fixed d as a constant at that
reinforcement on the target behavior is value for the fits and simulations reported
removed—thus resulting in increased re- here. As a result, fits of Equation 4 below
sponding (i.e., resurgence). In addition, the include the use of two free parameters (i.e., k
inclusion of Ra in the denominator suggests and c) and two fairly well established constants
that, like reinforcement experienced in the (i.e., b and d).
preextinction baseline (i.e., r), alternative It should be noted that, like Equation 1 and
reinforcement experienced within the discrim- behavioral momentum theory more generally,
inative context during extinction of the target Equations 3 and 4 use responding relative to
behavior also strengthens the target behavior. baseline as the primary dependent measure. A
It is important to note that in both the version of the model predicting absolute
standard augmented model of extinction response rates during extinction and resur-
(Equation 1) and in Equation 3, the rate of gence is easily obtainable by multiplying both
reinforcement experienced during baseline sides of Equation 4 by baseline response rates
(r) is carried forward to extinction, and thus (i.e., B0) such that,
represents the effects of a history of reinforce- {t(kRa zczdr )
ment in the stimulus context on resistance to Bt ~Bo :10 (r zRa )b ð5Þ
extinction. Similarly, in addition to r, the
added Ra in the denominator of Equation 3 where all terms are as in Equation 4. Even
is carried forward to the resurgence condition though Equation 5 predicts absolute response
and represents the strengthening effects of the rates, it nonetheless suggests that preextinc-
history of alternative reinforcement during tion baseline response rates must be consid-
extinction of the target behavior. ered when accounting for extinction and the
As suggested for the previous relapse model response rate increases associated with resur-
of Podlesnik and Shahan (2010), we use the gence. Fits of Equation 4 and Equation 5 to
exponentiated version of the resurgence mod- data produce the same parameter values and
el because doing so does not require log- account for the same percentages of variance.
transformed data and permits the inclusion of Regardless, from the perspective of behavioral
zero values common in research examining momentum theory responding relative to
postextinction relapse. Accordingly, the expo- baseline is the appropriate measure of resis-
nentiated version1 is: tance to change (i.e., response strength), and
thus we will use Equation 4 in the analyses
Bt {t(kRa zczdr )
below.
~10 (r zRa )b ð4Þ
Bo As we will describe in detail below, Equation
4 appears to provide a fairly comprehensive
where all terms are as in Equation 3. Although account of findings in the resurgence litera-
Equations 3 and 4 have four parameters, in ture. Where possible, we provide fits of the
practice, sensitivity to reinforcement (i.e., b) is model to existing datasets using the Frontline
typically near 0.5 (Nevin, 2002) and we have Systems Solver for Mac Excel 2008. Typically,
fixed it as a constant at that value for all fits tabled data were not available in the original
1
publications. Thus, where possible, data were
Nevin and Grace (2005) and Nevin, Davison, and electronically extracted from figures using
Shahan (2005) have used a similar exponentiated version
of behavioral momentum theory after a conversion to GraphClick 3.0. Unfortunately, the data from
natural logarithms (i.e., using base e). We have maintained most reports in the literature are not amena-
the base of 10 to remain consistent with the usual ble to formal fits because some of the relevant
statement of Equation1 in base 10 logarithms and to allow data required for fitting the model are not
direct comparison of parameter values with the majority of
previous applications of Equation 1 to extinction data. The
presented. Often, rates of alternative rein-
choice of which base to use in the exponentiated version forcement during extinction of the target
does not change the quality of fits of the equations. response are not reported or recoverable from
A MODEL OF RESURGENCE 95
Maxwell, & Lattal, 2008). A subsequent study what is clear from the available data is that
with squirrel monkeys by Mulick, Leitenberg, when reinforcement obtained for the nonoc-
and Rawson (1976) showed that removal of currence of a target behavior on a DRO
DRO reinforcement did not produce resur- schedule is subsequently removed, resurgence
gence when it was suspended in Phase 3. occurs.
However, because the DRO was relatively Together, the results of the studies reviewed
ineffective at eliminating responding in Phase above suggest that, consistent with Equation 4,
2, little DRO reinforcement was actually resurgence results from the removal of alter-
obtained. Thus, when the DRO was suspend- native reinforcement, regardless of the source.
ed, little reinforcement was removed, and As suggested by the equation, higher rates of
consistent with Equation 4 little resurgence alternative reinforcement accelerate response
occurred (cf. Pacitti & Smith, 1977). elimination but increase the magnitude of
One experiment by Doughty, da Silva, and resurgence when they are removed. Resur-
Lattal (2007) with pigeons at first appears to gence requires that at least some of the
suggest that the use of a DRO to schedule alternative reinforcement be removed, and
alternative reinforcement during response the amount of resurgence that occurs appears
elimination could produce different effects to increase with the magnitude of decrease in
than reinforcement of an alternative response. alternative reinforcement rate. Finally, at this
In their Experiment 1, rates of alternative point, the details of the schedule of alternative
reinforcement provided by an alternative key reinforcement during response elimination
peck response or by a DRO were equated appear not to matter, as long as similar rates
during Phase 2 response elimination. Despite of reinforcement are arranged.
the equal reinforcement rates, greater resur-
gence occurred in Phase 3 following the DRO Time in Extinction and Exposure to
than following reinforcement of the alterna- Alternative Reinforcement
tive key peck during extinction. Unfortunately, In Equation 4, time plays a critical role in
this effect is difficult to interpret given that it the reduction of responding produced by
was not replicated in their Experiment 4 when exposure to extinction plus alternative rein-
treadle pressing was used as the alternative forcement. The overall magnitude of the
response. This lack of replication occurred disruptive impact of extinction and exposure
despite the fact that a direct comparison of to alternative reinforcement in the numerator
resurgence using key pecking versus treadle grows continuously with time (i.e., t). Thus,
pressing as the alternative response failed to longer durations of exposure to extinction and
produce any compelling difference in resur- alternative reinforcement during Phase 2
gence in their Experiment 5. Other research would be expected to reduce the magnitude
has also shown that the topography of the of resurgence. Figure 2 shows a simulation of
alternative response during extinction does how different durations of exposure to extinc-
not affect resurgence (cf. Leitenberg et al., tion plus alternative reinforcement in Phase 2
1975). As a result, the reason for the initial affect resurgence in Phase 3. As the duration
finding in Doughty et al. and its failure to of exposure to extinction plus alternative
replicate remain unclear. Thus, at present it reinforcement increases, the expected amount
remains unclear if removing equal rates of of resurgence decreases. Data reported in
DRO reinforcement versus reinforcement pro- Leitenberg et al. (1975, Experiment 4) are
duced by an alternative response produces any consistent with this prediction. In their exper-
systematic differences in resurgence. The iment, different groups of rats were exposed to
general approach suggested by Equation 4 either 3, 9, or 27 days of extinction plus
would predict that no such differences should alternative reinforcement in Phase 2 before
be expected. Should removal of equal rates of the alternative reinforcer was removed in
reinforcement delivered by a DRO and an Phase 3. Although the authors do not describe
alternative response ultimately turn out to the schedule of alternative reinforcement
produce reliable differences in resurgence, the used, the data appear to be generally consis-
disruptor terms in the numerator of Equation tent with the model. The rats exposed to
4 would likely need to be modified to capture 27 days of extinction plus alternative rein-
the added complexities of DRO. Regardless, forcement showed no significant resurgence,
98 TIMOTHY A. SHAHAN and MARY M. SWEENEY
Fig. 4. Simulations of the effects of baseline reinforcement rate (i.e., VI 30 or VI 120) and rate of alternative
reinforcement during extinction (i.e., Ra) on resurgence as generated by Equation 4.
schedules of reinforcement. The top panel both predict that the overall stimulus reinforc-
shows data from 5 pigeons that received Phase er relation arranged by a multiple-schedule
1 baseline training on a multiple schedule with component stimulus is the relevant determi-
a VI 30 s in a Rich component and a VI 120 s in nant of resistance to extinction and resur-
a Lean component (Podlesnik & Shahan, gence. During Phase 2 extinction of the target
2010). A VI 30-s schedule arranged reinforce- behavior (and removal of the VT reinforcers),
ment for pecking an alternative key during a VI 30-s schedule arranged reinforcement for
Phase 2 extinction of the target behavior. The pecking an alternative key. Finally, the bottom
middle panel shows data for 7 pigeons trained panel shows data from 4 rats trained on a
on a multiple schedule with a VI 120-s + VT 20- Phase 1 multiple schedule with a VI 45-s + VT
s schedule in a Rich component and a VI 120-s 15-s schedule in the Rich component and a VI
schedule alone in a Lean component during 45 s alone in a Lean component (Podlesnik &
Phase 1 baseline training (Podlesnik & Sha- Shahan, 2010). Alternative reinforcement dur-
han, 2009). Although the higher rate of ing Phase 2 extinction was arranged for
baseline reinforcement was accomplished by pulling a chain on a VI 10-s schedule. In all
including response-independent reinforcers three experiments, resistance to extinction in
during the baseline, behavioral momentum Phase 2 and resurgence in Phase 3 were
theory (e.g., Nevin et al., 1990) and Equation 4 somewhat greater in the Rich component than
A MODEL OF RESURGENCE 101
2, rather than reinforcing an alternative forced and then extinguished key pecking of
response or using a DRO to eliminate pigeons. Once key pecking had ceased, some
responding, Reed and Morgan exposed their other response (e.g., wing raising) was rein-
rats to a multiple fixed-interval (FI) schedule forced 20 times on a FR 1 schedule. Following
for the same target response used in Phase 1. the 20 reinforcers for the alternative behavior,
Although subsequent removal of the FI rein- all reinforcement was withheld and key peck-
forcement in a third phase produced an ing increased. Thus, even when the target
increase in responding in some cases, this response is eliminated beforehand, extinction
unusual procedure introduces numerous com- of a subsequently reinforced alternative behav-
plexities. First, in both experiments, the rate of ior appears to produce resurgence. For conve-
the previously low-rate behavior tended to nience, we will refer to this type of resurgence
increase during the FI-reinforcement condi- as Epstein-type resurgence.
tion, an outcome that is clearly inconsistent Before we begin a discussion of the applica-
with viewing that phase as a form of response bility of Equation 4 to Epstein-type resurgence,
elimination. As a result of this procedure, it is worth noting that few data generated by
when FI reinforcement was removed in Phase this procedure are available. In addition, with
3, the high-rate behavior was starting at a rate the exception of the Lieving and Lattal (2003)
lower than baseline and the low-rate behavior experiment, the data are not presented with
at a rate higher than baseline. This difference sufficient detail to allow assessment of the size
makes it difficult to interpret responding of the increase in responding relative to
during extinction in Phase 3 relative to the baseline training levels. Regardless, in trying
Phase 1 baseline. Second, the fact that the to understand this type of resurgence from the
target response continued to produce the perspective of Equation 4, initial extinction of
reinforcer during Phase 2 argues against the target behavior in the absence of alterna-
characterizing such reinforcers as alternative tive reinforcement would mean that Ra 5 0,
reinforcers at all. Together, these differences and thus, Equation 4 reduces to the standard
from the usual resurgence preparation make it augmented model of extinction (i.e., Equation
difficult to interpret Reed and Morgan’s 1). When the alternative reinforcer is intro-
findings. Given that in some cases baseline duced, Ra would then appear in the numerator
response rates have been shown to impact as an added source of disruption and in the
resistance to change independent of reinforce- denominator as a source of reinforcement in
ment rates using procedures similar to Reed the situation. Given the low levels of respond-
and Morgan (e.g., Lattal, 1989; Nevin, Grace, ing prior to the addition of alternative
Holland, & McLean, 2001), it is certainly reinforcement, the added source of disruption
possible such effects could also occur with in the numerator would have little measure-
resurgence. Additional experiments using typ- able effect on behavior. Subsequent release
ical resurgence procedures will be required to from the added disruption when the alterna-
examine whether baseline response rates tive source of reinforcement is removed would
impact resurgence independent of reinforce- also have a small effect, and Equation 4
ment rates, and how such effects should be predicts a small increase in responding due
interpreted if they occur. the presence of Ra in the denominator. Given
that Cleland et al. (2000) and Epstein (1983)
Extinguishing the Target Behavior Prior to provide no information about the rate of the
Alternative Reinforcement target behavior prior to extinction, it is
In all of the resurgence experiments dis- possible that the small increase in responding
cussed above, alternative reinforcement was predicted by Equation 4 could account for the
introduced at that same time that extinction increases observed in those experiments.
started for the target behavior. A small subset The Epstein-type resurgence experiment
of experiments have also shown that resur- reported by Lieving and Lattal (2003) ob-
gence occurs if the target response is extin- tained larger increases in responding with
guished prior to introduction of alternative removal of the alternative reinforcer (to about
reinforcement (Cleland et al., 2000; Epstein, 25–50% of baseline rates), and Equation 4
1983; Lieving & Lattal, 2003, Experiment 1). does not predict such large increases in
For example, Epstein (1983) initially rein- responding in its current form. However, one
A MODEL OF RESURGENCE 103
ed. The reason is that when the target problems as an account of resurgence. First, it
behavior occurs more during response elimi- predicts that although responding during
nation, it should be more completely extin- extinction is positively related to the baseline
guished, and thus occur less when the alter- reinforcement rate, resurgence (i.e., B1R) is
native reinforcement is removed during Phase inversely related to baseline reinforcement
3. Although some data could be interpreted as rate. The data in Figure 5 clearly show that
being consistent with this expectation (e.g., responding during extinction and during
the Leitenberg et al., 1975 data modeled in resurgence are positively related (see also
Figure 1), the response-prevention hypothesis Podlesnik & Shahan, 2010). Second, and most
nonetheless appears to be false. For example, importantly, the left-hand side of Equation 7 is
in a series of experiments, Winterbauer and a formal statement of the response prevention
Bouton (2010) have shown that the frequency hypothesis. The model suggests that target
of occurrence of the target behavior during responding during Phase 2 response elimina-
response elimination is not related to the tion and Phase 3 resurgence is allocated to one
amount of resurgence obtained. This outcome or the other of those phases, and thus,
led Winterbauer and Bouton to conclude that resurgence results from the prevention of
response prevention plays little role in resur- extinction of the target behavior. As discussed
gence. Further evidence that the response- above, the response-prevention hypothesis is
prevention hypothesis is false comes from likely false. Given these considerations, Equa-
Epstein-type resurgence, which demonstrates tion 7 does not appear to provide a viable
that resurgence occurs even if the target account of resurgence.
behavior is extinguished prior to introduction Finally, Bouton and Swartzentruber (1991)
of the alternative reinforcement. Thus, the have suggested that resurgence might be
above considerations suggest that the re- understood as resulting from a contextual
sponse-prevention hypothesis does not provide renewal effect. As noted above, renewal involves
a viable account of resurgence. an increase in extinguished responding with a
The model of resurgence proposed here change in context from that in which extinction
also shares some features with the only other took place. For example, in ABA renewal,
previous formal attempt to model resurgence. training occurs in Context A, extinction in
Cleland, Guerin, Foster, and Temple (2001) Context B, and then responding increases
proposed an account of resurgence based on when the subject is returned to Context A.
the matching law such that: Bouton and Swartzentruber suggested that
resurgence might occur because training in
B1E r1 which an operant response is reinforced
log ~a log z log b ð7Þ
B1R r2E represents Context A, and extinction in the
presence of an alternative source of reinforce-
where B1E is the rate of the target behavior ment serves as Context B. When the alternative
during extinction plus alternative reinforce- source of reinforcement is removed, the con-
ment for a second behavior in Phase 2, and B1R text may be more similar to Context A than
is the rate of the target behavior during Phase Context B, and responding increases. However,
3 resurgence when the alternative reinforcer is more recently, Winterbauer and Bouton (2010)
removed. The reinforcement term r1 is the have suggested that resurgence would be more
rate of reinforcement for the target behavior appropriately characterized as ABC renewal
in the Phase 1 baseline prior to response because the absence of reinforcement in Phase
elimination and the term r2E is the rate of 3 resurgence is more like a new context (i.e.,
alternative reinforcement for the second be- Context C) than the original training context
havior during Phase 2 response elimination. (i.e., Context A). Although this account seems
Like the model proposed above, Equation 7 plausible, ABC renewal of operant behavior has
suggests that occurrence of the target behavior not been reliably observed, and the increase in
during extinction is directly related to the responding appears to be rather small when it
baseline rate of reinforcement and inversely does occur (Bouton, Todd, Vurbic, & Winter-
related to the rate of reinforcement for the bauer, in press; Zironi, Burattini, Aicardi, &
alternative behavior. Despite these similarities Janak, 2006). As a result, it is not clear that ABC
to the present approach, Equation 7 has two renewal can account for the robust increases in
A MODEL OF RESURGENCE 105
responding often observed in resurgence ex- how to incorporate the rate of reinforcement
periments. In addition, it is not clear how a provided by the alternative response. As is
renewal-based approach to resurgence can clear from Equations 3 and 4, we have assumed
account for the variety of effects reviewed that the effects of the baseline reinforcement
above. Thus, at present, it is not clear that an rate (r) and the alternative reinforcement rate
ABC renewal effect will provide a viable account (Ra) are additive. With the transition to Phase
of operant resurgence. Generating and testing 3 when all reinforcement is removed from the
differential predictions based on the model of situation, we have carried forward both r and
resurgence proposed here and based on an Ra in order to be consistent with the initial
ABC-renewal account could be a promising transition from baseline to Phase 1. As
area for future research. Nonetheless, the demonstrated by the success of the current
concept of context might prove sufficiently model, this approach seems to work well in
flexible to make a renewal-based account accounting for existing data from resurgence
difficult to test and/or falsify. experiments.
One interesting implication of the approach
Potential Implications for Behavioral above is that it assumes that the target
Momentum Theory response from baseline can be further
Although the model of resurgence present- strengthened while it is undergoing extinction
ed here (i.e., Equation 4) is a relatively if an alternative source of reinforcement is
straightforward extension of behavioral mo- introduced into the discriminative stimulus
mentum theory, it does raise some interesting context. Given that behavioral momentum
issues about the augmented model of extinc- theory suggests that resistance to extinction is
tion (i.e., Equation 1) upon which it is based. driven by the discriminative stimulus–reinforc-
For convenience we again present the aug- er relation, this implication may not seem
mented model of extinction here: particularly controversial. As noted above, it is
well established that the inclusion of addition-
Bt {t(czdr ) al response-independent reinforcement or
log ~ ð8Þ
Bo rb reinforcement contingent upon a concurrent
response increases resistance to change of a
where all terms are as in Equation 1. In target behavior via the stimulus–reinforcer
previous applications of the augmented model relation (e.g., Nevin et al., 1990). However,
to extinction data, a baseline is established and because the current model assumes that
then Equation 8 is applied to account for the reinforcement from previous conditions is
decrease in responding associated with expo- carried forward to the next temporal epoch
sure to extinction (e.g., Nevin et al., 2001). As and added to the prevailing reinforcement
noted above, such applications of the aug- conditions, it is not difficult to imagine
mented model carry the reinforcement rate scenarios in which the underlying logic of this
experienced in baseline (i.e., r in the denom- approach becomes strained. For example,
inator) into the extinction condition. In consider a sequence of conditions like those
essence, the r term serves as a sort of perfect simulated above in Figure 3 in which alterna-
memory of the reinforcement history in the tive reinforcement is repeatedly added and
baseline condition. All decreases in respond- removed from the situation. For the simula-
ing are driven by the growth of the disruption tion in Figure 3 the alternative reinforcement
in the numerator of the equation. This rate was included in the denominator of
approach has proven fairly successful in terms Equation 4 for the initial extinction plus
of accounting for the effects of baseline alternative reinforcement condition only.
reinforcement rate on resistance to extinction. The subsequent increases and decreases in
In extending Equation 8 to account for responding occurred as a result of the addition
resurgence, we have followed the same basic and removal of the disruptive effects of
approach by carrying forward the reinforce- alternative reinforcement (Ra) in the numer-
ment rate experienced in baseline into the ator of Equation 4. One could reasonably
extinction plus alternative reinforcement argue that for the sake of consistency another
phase (i.e., Phase 2). With the transition to Ra term should be added to the denominator
Phase 2, a question that immediately arises is with the reintroduction of alternative rein-
106 TIMOTHY A. SHAHAN and MARY M. SWEENEY
forcement in the final condition. It turns out than the usual 0.5. One can also imagine more
that doing so produces only a modest increase complex approaches to calculating the inte-
in the amount of resurgence predicted in the gration of reinforcement rates across condi-
final condition. tions such as decaying effects of previously
The simulation of alternations between dif- experienced reinforcement rates with time, or
ferent conditions of alternative reinforcement a variety of other more complex algorithms. At
presented in Figure 3 only includes a series of present, the available data do not appear to
four conditions. But, what of longer sequences justify such additional complexity or to ade-
involving transitions between multiple rates of quately constrain the choice of one approach
alternative reinforcement? Should the reinforc- over the other. Nonetheless, the generation of
er rates from a long series of experienced additional data based on sequences of chang-
reinforcement rates across temporal epochs ing reinforcement conditions for a target
similarly be included in the denominator behavior and alternative reinforcement might
additively (e.g., r +Ra1 +Ra2 +…Ran)? Clearly, suggest more appropriate ways to proceed with
such perfect memory for experienced reinforce- the future development of behavioral momen-
ment rates and their additive strengthening tum theory in general. Such development
across many temporal epochs becomes absurd could lead to a fairly broad quantitative theory
over the long run. In order to account for of how behavioral history is mediated through
changing reinforcement rates across conditions, the integration of experienced reinforcement
behavioral momentum theory will need to deal conditions as amassed in the Pavlovian stimu-
with how reinforcement rates across conditions lus–reinforcer relation.
and temporal epochs should be integrated.
In developing of the present model of Conclusions
resurgence, we have pursued the path that The model of resurgence developed here
seemed the simplest and most consistent with suggests that resurgence can be understood
previous applications of the augmented model within the framework of behavioral momentum
of extinction. As we hope is clear from the theory as expressed in an extension of the
success of the model, this approach appears augmented model of extinction. The model
adequate for the time being and provides a suggests that resurgence occurs as a result of
reasonable starting point as a theory of the dual effects of alternative reinforcement
resurgence based on behavioral momentum during extinction of a target response. First,
theory. Nonetheless, a number of alternative alternative reinforcement suppresses the target
approaches could be used to account for behavior by acting as an additional source of
resurgence, but these approaches would need disruption. Second, alternative reinforcement
to inform behavioral momentum theory more strengthens the Pavlovian stimulus–reinforcer
generally in order to maintain conceptual relation, thus increasing the future strength of
consistency. For example, rather than assum- the target behavior when the countervailing
ing that reinforcement rates experienced disruptive effects are removed. The model does
across conditions are additive, one could a good job of providing a coherent approach
assume that reinforcement rates are averaged. for systematizing the existing resurgence liter-
It turns out that using average rather than ature and it makes novel and testable predic-
additive reinforcement rates changes parame- tions about effects that have not yet been
ter values and the quality of fits of the present observed. Thus, we suggest that the model as
model very little. If such an approach were to formalized in Equation 4 provides a good
be pursued, it would suggest that fits of the framework within which to pursue the study
augmented model to standard extinction data of resurgence and to integrate the phenome-
(i.e., without alternative reinforcement) non into the larger existing theoretical account
should also use the average of reinforcement of operant response persistence provided by
rates during baseline and during extinction. behavioral momentum theory. In addition,
This, of course, would amount to nothing consideration of the present model suggests
more than using 0.5r (i.e., [r+0]/2) in the that future development of behavior momen-
denominator of applications of the augment- tum theory should focus on how the effects of
ed model to standard extinction, thus requir- reinforcement conditions experienced across
ing a standard sensitivity value slightly greater temporal epochs might be integrated.
A MODEL OF RESURGENCE 107
Podlesnik, C. A., Jimenez-Gomez, C., & Shahan, T. A. (2006). Shahan, T. A., & Burke, K. A. (2004). Ethanol-maintained
Resurgence of alcohol seeking produced by discontinu- responding of rats is more resistant to change in a
ing non-drug reinforcement as an animal model of drug context with added non-drug reinforcement. Behav-
relapse. Behavioral Pharmacology, 17, 369–374. ioral Pharmacology, 15, 279–285.
Podlesnik, C. A., & Shahan, T. A. (2009). Behavioral Uhl, C., & Garcia, E. (1969). Comparison of omission
momentum and relapse of extinguished operant with extinction in response elimination in rats.
responding. Learning & Behavior, 37, 357–364. Journal of Comparative and Physiological Psychology, 69,
Podlesnik, C. A., & Shahan, T. A. (2010). Extinction, 554–562.
relapse, and behavioral momentum. Behavioural Pro- Volkert, V. M., Lerman, D. C., Call, N. A., & Trosclair-
cesses, 84, 400–411. Lasserre, N. (2009). An evaluation of resurgence
Rachlin, H., & Baum, W. M. (1972). Effects of alternative during treatment with functional communication
reinforcement: Does the source matter? Journal of the training. Journal of Applied Behavior Analysis, 42,
Experimental Analysis of Behavior, 18, 231–241. 145–160.
Rawson, R. A., Leitenberg, H., Mulick, J. A., & Lefebvre, M. Winterbauer, N. E., & Bouton, M. E. (2010). Mechanisms
F. (1977). Recovery of extinction responding in rats of resurgence of an extinguished instrumental behav-
following discontinuation of reinforcement of alter- ior. Journal of Experimental Psychology: Animal Behavior
native behavior: A test of two explanations. Animal Processes, 36, 343–353.
Learning & Behavior, 5, 415–420. Zironi, I., Burattini, C., Aicardi, G., & Janak, P. H. (2006).
Reed, P., & Morgan, T. A. (2007). Resurgence of behavior Context is a trigger for relapse to alcohol. Behavioural
during extinction depends on previous rate of Brain Research, 167, 150–155.
response. Learning & Behavior, 35, 106–114.
Reid, R. L. (1958). The role of the reinforcer as a stimulus. Received: May 11, 2010
British Journal of Psychology, 49, 292–309. Final Acceptance: October 11, 2010