Baron, 2005. Positive and Negative Reinforcement PDF

You might also like

You are on page 1of 14

The Behavior Analyst 2005, 28, 85-98 No.

2 (Fall)

Positive and Negative Reinforcement:


Should the Distinction Be Preserved?
Alan Baron
University Wisconsin-Milwaukee
of
Mark Galizio
University of North Carolina at Wilmington
Michael (1975) reviewed efforts to classify reinforcing events in terms of whether stimuli are added
(positive reinforcement) or removed (negative reinforcement). He concluded that distinctions in
these terms are confusing and ambiguous. Of necessity, adding a stimulus requires its previous
absence and removing a stimulus its previous presence. Moreover, there is no good basis, either
behavioral or physiological, that indicates the involvement of distinctly different processes, and on
these grounds he proposed that the distinction be abandoned. Despite the cogency of Michael's
analysis, the distinction between positive and negative reinforcement is still being taught. In this
paper, we reconsider the issue from the perspective of 30 years. However, we could not find new
evidence in contemporary research and theory that allows reliable classification of an event as a
positive rather than a negative reinforcer. We conclude by reiterating Michael's admonitions about
the conceptual confusion created by such a distinction.
Key words: classification of reinforcers, positive reinforcement, negative reinforcement, stim-
ulus onset, stimulus offset

According to Thorndike's (191 1) win's principle of natural selection.


law of effect, responses that lead to fa- These two selective processes-evolu-
vorable consequences increase in fre- tion and reinforcement-permit organ-
quency (in current terminology, they isms to cope with environmental
are reinforced) and those that have stresses and organismic needs. Evolu-
neutral consequences or lead to unfa- tion selects adaptive forms within en-
vorable ones become less frequent. tire species. Reinforcement selects
These relations have come to play an adaptive responses within each indi-
essential role in our understanding of vidual's lifetime.
operant behavior. Reinforcement not The observation that a wide range of
only defines what is or is not an oper- environmental events can strengthen
ant response but also provides an ac- responding has fueled efforts to clas-
count of the acquisition of adaptive re- sify reinforcers into a manageable
sponses and the extinction of maladap- number of categories. The prevailing
tive ones. Skinner (1976, 1981), and approach for the past 50 or more years
others before him, elevated the rein- differentiates two types: positive and
forcement principle to the level of Dar- negative (Keller & Schoenfeld, 1950).
In the case of positive reinforcers,
We thank Marshall Dermer, Rob Hakan, Jay strengthening effects are attributed to
Moore, Michael Perone, and Ray Pitts for help- the stimuli whose presentation is con-
ful comments on earlier versions of this manu- tingent on responding (as when a hun-
script. Preparation of this article was supported gry rat's lever press produces a food
by Grant DA 012879 from the National Insti- pellet). In the case of negative rein-
tutes of Health.
Please address correspondence and reprint re- forcers, reinforcement is dependent on
quests to either author: Alan Baron, Department the removal of stimuli (as when the le-
of Psychology, University of Wisconsin- ver press terminates a painful electrical
Milwaukee, Milwaukee, Wisconsin 53201 shock).
(e-mail: ab@uwm.edu), or Mark Galizio, De- This distinction between presenta-
partment of Psychology, University of North
Carolina at Wilmington, Wilmington, North Car- tion and removal is a central feature of
olina 28401 (e-mail: Galizio@uncw.edu). most discussions of operant condition-
85
86 ALAN BARON & MARK GALIZIO

ing. Presentation and removal also lier label for positive reinforcement),
have come to define different areas of the response not only produces a stim-
research. On the one hand is a set of ulus but produces a stimulus that
phenomena and issues whose study evokes pleasure or satisfaction. By
most often involves positive reinforce- comparison, escape-avoidance training
ment. Within the animal laboratory, in- (negative reinforcement) involves ar-
vestigations of schedules, choice, and rangements in which the response re-
stimulus control usually present food duces pain, anxiety, or some other
as the reinforcer. By comparison, in- forms of discomfort or distress.
vestigations of the aversive control of From the start, behavior-analytic dis-
behavior most often involve negative cussions of the reinforcement process
reinforcers. The subject is able to shied away from such interpretations
terminate intense stimuli (usually of reinforcement on the grounds that
shocks), or, in the case of avoidance, they assign causal status to events that
escape from situations in which such are ill defined and not easily observ-
events can occur. able (Skinner, 1938). The more desir-
Occasionally, writers have com- able alternative is to couch the distinc-
mented on similarities rather than dif- tion strictly in terms of the stimulus
ferences between the two forms of re- change that follows the response (Kel-
inforcement (e.g., Baron, 1991; Hine- ler & Schoenfeld, 1950). Thus, in his
line, 1984), for example, the parallel authoritative glossary of behavior-ana-
effects of postponing the stimulus lytic terms, Catania (1998) provides
change. Also, a few researchers have the reader with this current definition:
sought paradigms that might bridge the "A stimulus is a positive reinforcer if
gap, such as procedures in which re- its presentation increases the likelihood
sponding produces a period of time-out of responses that produce it, or a neg-
from avoidance (Perone & Galizio, ative reinforcer if its removal increases
1987; Verhave, 1962) or avoids a pe- the likelihood of responses that termi-
riod of time-out from positive rein- nate or postpone it" (p. 405). As we
forcement (Baron & Kaufman, 1966; will see, a definition in these terms, al-
Stone, 1961). Nevertheless, treatments though avoiding the pitfalls of moti-
of operant conditioning continue to vational interpretations, has some
place behavior maintained by positive problems of its own.
and negative reinforcers under separate
headings (e.g., Catania, 1998; Iversen Michael's Objection
& Lattal, 1991; Mazur, 2002; Pierce &
Cheney, 2004). What might be regarded as a water-
The purpose of this article is to re- shed in behavior-analytic discussions
view the current status of these two of positive and negative reinforcement
forms of reinforcement. In particular, was Michael's (1975) article, to which
we reconsider Michael's (1975) call to he gave the provocative title, "Positive
abandon the distinction. Although Mi- and Negative Reinforcement, a Dis-
chael's views have not been refuted to tinction That Is No Longer Necessary;
our knowledge, there are few signs that or a Better Way to Talk about Bad
his recommendations are being heeded. Things." His discussion forcefully
brought the ambiguity of the distinc-
Traditional Bases for the Distinction tion to the attention of behavior ana-
lysts. The matter was not, however,
Traditional treatments sharpened the completely new; definitional problems
distinction between positive and nega- had previously been considered by
tive reinforcement by introducing mo- both behavior-analytic and more moti-
tivational variables (e.g., Hilgard & vationally oriented writers (e.g., Cata-
Marquis, 1940; Mowrer, 1960; Thorn- nia, 1973; D'Amato, 1969; Mowrer,
dike, 1911). In reward training (an ear- 1960).
POSITIVE AND NEGATIVE REINFORCEMENT 87
Michael (1975) identified two is- periment cited by Catania (1998).
sues, the first of which pertained to a Weiss and Laties (1961) observed that
longstanding confusion about the dif- rats kept in a cold chamber would
ference between negative reinforce- press a lever that turned on a heat
ment and punishment. He observed lamp. This outcome can be regarded as
that the term negative reinforcement the product of positive reinforcement
had been used by a number of writers because the lamp's onset adds heat to
(including Skinner himself in The Be- the environment. But the behavior also
havior of Organisms, 1938) not only to reduces the extent to which the envi-
refer to stimulus termination but also ronment is cold and thus can be re-
to punishment, that is, consequences garded as an instance of negative re-
that suppress responding. Happily, this inforcement. Similar questions can be
ambiguity has been laid to rest in that raised about any reinforcement proce-
current usage reserves the term punish- dure. Although food is usually regard-
ment for suppressive operations. How- ed as a positive reinforcer, its presen-
ever, a link between reinforcement and tation also serves to reduce a state of
punishment remains, in that it has be- deprivation (negative reinforcement).
come customary to use the presenta- Similarly, the negatively reinforcing
tion-removal difference developed properties of escape from shock can be
originally for reinforcement to also dis- attributed to the onset of the stimuli
tinguish between two types of punish- correlated with safety (positive rein-
ment (e.g., Catania, 1998; Mazur, forcement). Moreover, the problem is
2002). Thus, responding can be sup- by no means confined to unconditioned
pressed not only by delivery of a shock forms of reinforcement. Delivery of
(positive punishment) but also by with- money contingent on some behavior
drawal of food (negative punishment). has the consequence of ending a mo-
Michael's (1975) second issue is the neyless period, and escape from con-
one that concerns us here. His point ditioned aversive stimuli produces sit-
was that the reinforcing functions of an uations in which the stimuli are absent.
event, either its presentation or its re- Faced with these ambiguities, Mi-
moval, hinge on the context in which chael (1975) concluded that there is no
the event occurs. The response-contin- good basis for continuing to describe
gent presentation of a stimulus re- reinforcers as positive or negative. In
quires, of necessity, that the response his view, communication is not imped-
terminate a previous period when the ed if the focus is on the stimulus
stimulus was absent. By the same to- changes that strengthen behavior rather
ken, the response-contingent termina- than on the onset or the offset of stim-
tion of a stimulus cannot be accom- uli. If a distinction is to be made, it
plished unless the response has been should be between processes of rein-
preceded by a period when the stimu- forcement and processes of punish-
lus was present. The argument, then, is ment, that is, between environmental
that positive and negative reinforce- changes that strengthen and environ-
ment are changes from one stimulus mental changes that suppress.
condition to another, not the simple
presentation or removal of a stimulus. Michael's Analysis
Without this essential clarification, the
claim that a reinforcer is exclusively By most standards, Michael's (1975)
positive or negative always can be analysis is quite cogent. Nevertheless,
challenged by the assertion that the al- even a cursory survey of textbooks in-
ternative form is the true basis for the dicates that the positive-negative dis-
reinforcing effect. tinction continues to be taught to psy-
The conundrum for those who want chology students, and this might sug-
to stick to the presentation-removal gest that Michael's views have been
distinction is well illustrated by an ex- discredited. Perhaps new research find-
88 ALAN BARON & MARK GALIZIO

ings or new theories have bolstered the fects. This feature of reinforcement
distinction he believed should be aban- was discussed by Weiss and Laties
doned. Or, perhaps, the original rea- (1961) in their study of heat reinforce-
sons for abandoning the distinction ment (or, if you like, cold termination).
were faulty. Instead, Michael's classic They commented that heat reinforce-
article is not always cited in textbooks, ment appeared to produce more reli-
even those that address operant condi- able effects than reinforcers that re-
tioning in detail. When his views have quire eating or drinking, and they at-
been given some attention (e.g., Cata- tributed the difference to the "long
nia, 1998; Pear, 2001; Pierce & Che- chain of processes that intervene be-
ney, 2004), the message is somewhat tween behavior and the ultimate ef-
mixed. Although the validity of his ar- fect" of eating and drinking. By com-
gument may be acknowledged, the dis- parison, the effect of heat "is practi-
tinction that he argued against contin- cally instantaneous" (Weiss & Laties,
ues to be used as a way of classifying 1961, p. 1344).
both different operant procedures and Perhaps the case can be made that
different research areas. stimulus change usually is more abrupt
Given the persistence of this pecu- for negative than for positive reinforce-
liar state of affairs, it seems worthwhile ment (cf. termination and food con-
to reconsider Michael's discussion in sumption). But even assuming that
the light of developments since his ar- negative contingencies produce more
ticle was published. He considered and reliable conditioning (we do not know
rejected three possible justifications for of experiments that have demonstrated
the distinction. this), this does not mean that the dif-
1. The strengthening effects of posi- ference is fundamental. A feature of
tive and negative reinforcers may dif- stimulus change is that rates of onset
fer in such regards as their temporal and offset can vary, thus introducing
properties, their relation to other in- differing degrees of delay before the
dependent variables, or their role in event is fully present or fully absent.
the development of discriminations. Although such time-dependent differ-
Michael (1975) could not find a ences play an important role in operant
good basis for such a conclusion. Al- conditioning, they are better viewed as
though the environmental changes that a parameter of reinforcement (delay of
function as reinforcers have unique reinforcement) than as a difference in
properties, "these properties seem just the reinforcement process itself. For
as relevant to the distinctions among example, if Weiss and Laties's (1961)
the various kinds of positive reinforce- procedure had entailed a slow onset of
ments as between positive and negative the heat lamp, we would expect that
reinforcement" (p. 41). Consistent conditioning would be retarded by
with this interpretation, our review of comparison with food- and water-de-
the literature on aversive control (Bar- livery procedures. Or consider the re-
on, 1991) led us to conclude (as had inforcing functions of drugs: The re-
Hineline, 1984) that similarities be- inforcing effect of a given dose of co-
tween positive and negative reinforce- caine varies as a function of the mode
ment effects are more apparent than of delivery (oral, intravenous, or intra-
differences. Most notably, the well- nasal) because of differences in speed
known parameters of positive rein- of onset of drug effects.
forcement (the magnitude, delay, and 2. There are differences in the phys-
schedule of stimulus presentations) iological structures or processes that
have similar influences on responses underlie positive and negative rein-
maintained by negative reinforcement. forcement.
A possible difference, one not men- Michael (1975) concluded that phys-
tioned by Michael (1975), pertains to iological information did not help to
the rapidity of the strengthening ef- clarify the distinction. However, the
POSITIVE AND NEGATIVE REINFORCEMENT 89
many advances in neuroscience since system of the brain (and in particular
his article warrant a reconsideration of the nucleus accumbens) has been
the literature. The literature on the linked to the actions of rewarding stim-
physiological substrates of the rein- ulation (Kiyatkin, 1995; Vaccarino,
forcement process is much too broad Schiff, & Glickman, 1989; Wise &
to survey in this paper. However, we Bozarth, 1987), and an amygdala-hy-
will briefly consider research in the pothalamic-central gray system to pro-
three areas that seem most relevant: cesses of pain and fear (Davis, Cam-
pharmacological investigations, re- peau, Kim, & Falls, 1995; Panksepp,
search on the neurobiology of rein- Sacks, Crepeau, & Abbot, 1991). How-
forcement, and investigations of psy- ever, these neurobiological distinctions
chophysiological changes that may ac- do not correspond in straightforward
company reinforcement. ways to the distinction between posi-
Research from the behavioral phar- tive and negative reinforcement. Re-
macology laboratory has been guided search on dopaminergic mesolimbic
by a search for drugs.to counteract syn- involvement has largely involved pro-
dromes that are triggered by aversive cedures that would be classified as pos-
events (tension, anxiety), and negative- itive reinforcers. For example, the ev-
reinforcement baselines have been idence for dopamine release in the nu-
used to model these syndromes. Early cleus accumbens comes from experi-
experiments within this framework ments in which animals responded for
suggested unique links between classes such events as food, opportunity for
of drugs and type of reinforcement. For sexual interaction, or stimulant drugs
example, antipsychotic and anxiolytic (Kiyatkin, 1995). However, these re-
drugs appeared to have different ef- sults cannot be viewed as showing a
fects on shock-avoidance and food-re- unique link between dopamine and
inforced baselines. However, a key ex- positive reinforcement. Parallel exper-
periment by Kelleher and Morse iments with avoidance schedules have
(1964) indicated otherwise. They ad- indicated similar patterns of dopamine
ministered drugs with opposing phar- release in the nucleus accumbens
macological properties (either amphet- during shock avoidance (e.g., Mc-
amine or chlorpromazine) to monkeys Cullough, Sokolowski, & Salamone,
responding on identical schedules of 1993). To complicate matters, other re-
positive and negative reinforcement search has raised doubts about the
(stimulus-shock termination vs. food functional role of dopamine in the nu-
presentation). Their major finding was cleus accumbens. Insofar as mesolim-
that drug effects depended consider- bic dopamine is implicated in the neu-
ably more on the response rates con- robiology of reinforcement, the best
trolled by the schedules than on wheth- evidence appears to suggest that it en-
er the reinforcer was positive or nega- compasses both forms of reinforce-
tive. Although subsequent researchers ment-negative as well as positive (see
continued to search for relations be- Salamone, Correa, Mingote, & Weber,
tween drugs and baseline reinforcers, 2003; Salamone, Cousins, & Snyder,
the evidence does not support a phar- 1997, for reviews).
macological basis for distinguishing Finally, on a more behavioral level,
between performances under schedules evidence has not been forthcoming to
of positive and negative reinforcement support Mowrer's (1960) original con-
(for reviews, see Barrett & Katz, 1981; tention that characteristic emotional
Dworkin, Pitts, & Galizio, 1993). processes are evoked by aversive and
Research on the neurobiology of re- appetitive stimuli. Behavior analysts
ward and punishment also has sought have not formed a consensus about the
physiological distinctions between pos- proper way to view the process of
itive and negative reinforcement. For emotion (for a recent exchange of
example, the dopaminergic mesolimbic views, see Friman, Hayes, & Wilson,
90 ALAN BARON & MARK GALIZIO

1998; Lamal, 1998). In keeping with inconsistent); and it requires prior


our discussion of the physiology of training with conventional schedules of
positive and negative reinforcement, reinforcement (a common procedure is
we will concentrate on the psycho- to replace the shocks in a shock-avoid-
physiological responses that may ac- ance schedule with a fixed-interval
company the action of reinforcers. shock schedule). Moreover, the case
Commonly used markers have includ- can be made that, despite appearances
ed changes in heart rate, blood pres- to the contrary, the shocks actually
sure, respiration, and skin conductance. function as punishers. According to
Despite considerable research over this view, responding is maintained be-
the past 50 years, the literature on the cause fixed-interval shocks suppress
psychophysiology of reinforcement has long interresponse times (Galbicka &
been inconclusive. A major stumbling Platt, 1984). Also plausible is that the
block has been the failure to identify shocks possess a discriminative func-
specific response patterns that might tion: As a consequence of the animal's
differentiate between different classes history of avoidance training, the
of emotion, for example, the difference fixed-interval shocks serve as cues for
between such antithetical states as continued responding (Laurence, Hine-
"fear" and "joy." In addition, the ex- line, & Bersh, 1994). Information
pectation that the psychophysiological about psychophysiological reactions
changes would vary in orderly ways, under schedules of shock-maintained
that is, increase in magnitude in antic- behavior might help to clarify matters,
ipation of the impending reinforcer and but to our knowledge such data have
diminish following the reinforced op- not been reported.
erant response, has not been consis- In brief, then, hopes that definitions
tently borne out. Also problematic is of positive and negative reinforcement
the observation that stimuli may some- might be enhanced by references to
times serve as effective reinforcers in neurobiological or psychophysiologi-
the absence of observable affective re- cal processes have not been fulfilled.
sponses. Perhaps this is not surprising insofar as
The phenomenon of shock-main- stimulus functions depend in critical
tained responding raises additional ways on historical and contextual var-
questions about the role of emotion in iables as well as on physical features
positive and negative reinforcement of stimuli (e.g., intensity, quality).
(Morse & Kelleher, 1977; for a recent Whether future technological advances
review, see Pear, 2001). Painful electric (e.g., more sensitive recording equip-
shocks usually serve the role of aver- ment, identification of more appropri-
sive stimuli: as negative reinforcers ate response patterns) will allow fruit-
through their offset or as punishers ful research on this question remains to
through their onset. However, under be seen. Some lines that are being pur-
some circumstances the onset of re- sued with both animal models and hu-
sponse-contingent shocks has been mans include variations in the startle
found to have the opposite effect of response (Davis & Astrachan, 1978;
maintaining responding (i.e., the Dawson, Schell, & Boehmelt, 1999),
shocks function as positive reinforc- brain activity (Bjork et al., 2004;
ers). As noted by Pear and others, cau- Small, Zatorre, Dagher, Evans, &
tion is in order in viewing this para- Jones-Gotman, 2001), electromyo-
doxical outcome. The phenomenon ap- graphic activity of facial muscles
pears to have limited cross-species (Lundqvist, 1995; Ritz, Dahme, &
generality (most of the research has Claussen, 1999), and ultrasonic vocal-
been with squirrel monkeys); it appears izations in rats (Knutson, Burgdorf, &
most often in connection with fixed-in- Panksepp, 2002).
terval schedules of response-produced 3. By maintaining the distinction, we
shocks (results with ratio schedules are can more effectively warn applied be-
POSITIVE AND NEGATIVE REINFORCEMENT 91

havior analysts about the undesirable between instances when self-injurious


aspects of negative reinforcement. behavior was maintained by escape
Michael (1975) rejected this argu- from task demands (negative reinforce-
ment on three grounds: First, he point- ment) and instances when such behav-
ed out that if the distinction is difficult ior was maintained by the attention of
to make, then it also must be the case others or by access to food or other
that such advice cannot easily be heed- materials (positive reinforcement). Al-
ed. Second, he observed that it is an though these findings may support a
empirical question whether negative useful classification of the events that
reinforcement procedures indeed are maintain problem behavior, they do not
undesirable. Last, he questioned the address the definitional ambiguity
wisdom of maintaining "a distinction identified by Michael. Is it better to
at the level of basic science because of speak of the consequence as increased
its possible social implications" (p. attention or as relief from loneliness?
42). As escape from an aversive task or as
We see no basis for disagreeing with access to an alternative activity? Either
Michael's evaluation. No doubt, pro- description appears to be appropriate.
cedures that use negative reinforce- The same dilemma has appeared in
ment as a method of applied behavior the drug abuse literature. Some writers
analysis continue to be frowned at, and have proposed that drug use by novices
some have argued that use of such is maintained by positive contingen-
terms as reinforcement and punishment cies, but that as use becomes more
should be abandoned in the interests of chronic, control transfers to negative
gaining broader acceptance of behav- ones (termination of withdrawal dis-
ior-analytic approaches (e.g., Brown & tress). On these grounds, negative rath-
Hendy, 2001). Nevertheless, the ques- er than positive reinforcement is taken
tion of whether an applied procedure is to be the more critical factor underly-
undesirable cannot be given a general ing drug dependence (Crowley, 1972;
answer without specifying the problem Farber, Khavari, & Douglass, 1980).
behaviors addressed by the procedures. Although this analysis may capture im-
When painful stimuli are used as a portant features of addiction, it illus-
means of behavior modification, un- trates once again our definitional prob-
desirable side effects may be out-
weighed by the severity of the disorder lem. No doubt, a host of changes can
under treatment. In addition, it is not occur with habitual drug use, including
difficult to point to undesirable aspects diminished effects of the drug due to
of procedures that are often considered tolerance and the occurrence of various
to involve positive reinforcement, as withdrawal symptoms that are termi-
when deprivation is needed as an es- nated by drug delivery. However, at all
tablishing operation or when the rein- stages in a history of drug use, admin-
forcing potency of an activity distracts istration of the drug creates a change
the individual from more worthwhile from a drugless state to one in which
pursuits (Perone, 2003). the drug is active. As with reinforcers
Since Michael's (1975) article, some in general, the behavioral functions of
applied behavior analysts have come to either state cannot be evaluated with-
emphasize the positive-negative dis- out reference to the alternate state that
tinction in their analyses of problem is contingent on responding.
behaviors. Iwata et al. (1994) studied In summary, the three reasons con-
self-injurious behavior from this stand- sidered (and rejected) by Michael
point, and their results suggested that (1975) for preserving the positive-neg-
individuals differed in the extent to ative distinction seem no more con-
which their behavior was maintained vincing now than they did to him some
by one or the other forms of reinforce- 30 years ago. However, Michael's ar-
ment. Thus, their study distinguished ticle did not exhaust possible reasons.
92 ALAN BARON & MARK GALIZIO

In the following sections, we consider rats engaged in behaviors antithetical


some additional possibilities. to lever pressing when first placed in
the cold chamber: they huddled and
The Role of Competing Responses shivered. Although these responses
served the function of conserving heat,
A distinction originally proposed by they also interfered with the heat-pro-
Catania (1973; see also Catania, 1998) ducing lever-press response. When a
and subsequently by Hineline (1984) response did occur, heat from the lamp
and Pierce and Cheney (2004) pertains momentarily raised the animal's skin
to the temporal relation between the temperature and the interfering re-
operant response and the stimulus sponses subsided. According to this
change. At the time of responding, the analysis, the pattern of interfering be-
stimulus is absent in the case of posi- havior defines the reinforcer as nega-
tive reinforcement but present for neg- tive. In other words, responding was
ative reinforcement. This temporal dif- reinforced by termination of cold rath-
ference can have a bearing on the ex- er than by onset of warmth.
tent to which stimulus-evoked respons- This analysis can be extended to
es can compete with the particular avoidance paradigms in which the
response chosen by the researcher for aversive event is absent at the time of
study. responding. Although the avoidance
Consider the behavioral interactions response is temporally separated from
when lever pressing is positively rein- the primary aversive event (e.g.,
forced with food. Delivery of the re- shock), the response occurs in the pres-
inforcer brings the operant response to ence of stimuli correlated with shock.
a halt: The rat leaves the lever, ap- As with escape behavior, the develop-
proaches the food cup, and eats the ment of efficient avoidance behavior
food. Because the contingencies are ar- may be hindered by the appearance of
ranged so that the responses of lever responses that are similar to those
pressing and eating occur at different evoked by shock.
times, competition between these re- Although compelling in some re-
sponse systems is minimized except, spects, a distinction based on response
perhaps, at the point of transition from competition falls short. Consider,
one to the other. By comparison, lever again, food reinforcement. Although it
pressing that is negatively reinforced is the case that the operant response
by removal of shock occurs in the pres- occurs in the absence of responses
ence of the shock. Moreover, the shock evoked by the food stimulus itself, this
stimulus evokes a variety of character- does not preclude the possibility of
istic responses (e.g., crouching, jump- competing responses generated by the
ing, or running) that can interfere with establishing conditions for the reinforc-
the response chosen by the researcher er. A rat working for food also is food
(lever pressing is especially susceptible deprived, and deprivation (more pre-
to such interference). However, once cisely, the stimuli accompanying dep-
the operant response has been executed rivation) may evoke behaviors that are
and the aversive stimuli terminated, the incompatible with the lever-press re-
competition is more or less ended: The sponse (e.g., grooming, inspecting the
operant response has gained the rein- food cup), thus arguing for a process
forcer and the stimulus for shock- of negative rather than positive rein-
evoked responding has been removed. forcement. Moreover, we can point to
Catania (1998) used the presence or everyday examples in which avoidance
absence of competing responses to de- behavior appears to occur in the ab-
cide whether lever pressing in the sence of disruptive or interfering re-
Weiss and Laties (1961) experiment sponses (e.g., we may fill up the gas
was positively or negatively rein- tank before we run out of gas, and set
forced. The report indicated that the the alarm clock the night before). Ca-
POSITIVE AND NEGATIVE REINFORCEMENT 93

tania (1998) acknowledged this ambi- inforced by them have more effectively learned
guity, and his last word was that "re- and remembered where and how to get them and
therefore have been more likely to survive and
inforcement always involves changes transmit this susceptibility to the species. It has
in the organism's situation and inevi- often been pointed out that competition for a
tably leads to differences in responding mate tends to select the more skillful and pow-
before and after the change" (p. 101). erful members of a species, but it also selects
those more susceptible to sexual reinforcement.
As a result, the human species, like other spe-
Feelings of Reinforcement cies, is powerfully reinforced by sugar, salt, and
sexual contact. This is very different from say-
A different approach to reinforce- ing that these things reinforce me because they
ment focuses on what Skinner (1976) taste or feel good. (Skinner, 1976, pp. 52-53)
referred to as "the feelings of rein-
forcement." Skinner observed that Skinner's discussion of rewards and
"feelings have dominated the discus- punishment provides a clue as to why
sion of rewards and punishment for the conception of two forms of rein-
centuries" (p. 53), and he did not ques- forcement has persisted despite the
tion that different forms of reinforce- lack of a clear operational basis for de-
ment may evoke distinctively different termining which is which. Perhaps the
feelings. By "feelings," Skinner was feelings of positive and negative rein-
referring to private events that are re- forcement are different. Consider the
vealed by "asking the subject how he labels given these states. Beginning
'feels' about certain events" (1953, p. with Thorndike (1911), positive rein-
82). Indeed, surveys have been devel- forcers have been described in such
oped with the objective of identifying terms as satisfying, pleasing, and plea-
the relative strength of different rein- surable. Descriptive terms for the feel-
forcing events and activities. Cautela's ing of negative reinforcement are more
(1972) reinforcement survey schedule difficult to find, and Thorndike used
asks respondents to rate events in terms the term satisfier to refer to both pos-
of how much "joy or pleasurable feel- itive and negative reinforcement.
ings" each provides (the survey in- Mowrer (1960), however, coined the
cludes such diverse items as "eating term relief to refer to states that accom-
ice cream," "playing basketball," and pany the withdrawal of aversive stim-
"dogs"). The resulting information has uli, and the same sense is conveyed by
been used in programs of behavior the dictionary definition: "Relief-an
therapy and research (e.g., Baron, easing as of pain, discomfort, or anxi-
DeWaard, & Galizio, 1981). ety" (Webster's New World Dictio-
Skinner's treatment of the feelings of nary, 1994). These commonsense
reinforcement followed his philosoph- views of the difference between feel-
ical views about the role of private ings of pleasure and feelings of relief
events in general. He did not take issue are paralleled by textbook treatments
with descriptions that include referenc- of positive and negative reinforcement
es to feelings-that a person's respons- in separate sections-one in which the
es are accompanied by the presentation reinforcers involve presentation of
or removal of events said to be liked such events as food, praise, or money,
or disliked. "But this does not mean and one in which the reinforcers are
that his feelings are causally effective; termination of electric shock, loud
his answer reports a collateral effect" sounds, or expressions of disapproval.
(1976, p. 53). In these writings and Paralleling Skinner's (1976) consid-
elsewhere (Skinner, 1986), he turned to eration of the place of feelings in the
other mechanisms for a causal account reinforcement process is his discussion
of the origins of reinforcement, in par- of the feelings of accompanying states
ticular, evolutionary processes: of motivation (feelings of "conditions
Salt and sugar are critical requirements, and in- of the body"). For both positive and
dividuals who were especially likely to be re- negative reinforcement, these states are
94 ALAN BARON & MARK GALIZIO

correlated with the establishing opera- can be solved by concentrating on the


tions for the reinforcers rather than by establishing operations and other con-
the reinforcer itself. In the case of food textual variables that give rise to feel-
reinforcement, for example, the feeling ings. Within such an analysis, the in-
state is evoked by the absence of food tensity of these variables plays a cen-
(thus, the sequence when responding is tral role. In the case of food reinforce-
reinforced might be described as a ment, for example, the extent of
transition from distress to pleasure). By deprivation intensifies feelings of re-
comparison, when reinforcement in- inforcement as well as reinforcer effec-
volves termination of shock, the feel- tiveness. In the case of negative rein-
ing state is evoked by the shock itself forcers such as shock, by comparison,
(the sequence is distress to relief). the most important sources of reinforc-
Feelings of reinforcement and moti- er strength are to be found in the in-
vation may have a place in descriptions tensity and duration of the stimulus
of reinforcement. However, they can that is terminated.
hardly be relied on to distinguish pos- For some writers, the severity of
itive from negative reinforcement (we these operations contributes to whether
emphasize that this was Skinner's point the reinforcer is regarded as positive or
also). Not the least of the problems is negative. This view is apparent in Sid-
that the burden of the definition is man's (1989) analysis of coercion, in
shifted from environmental events (i.e., other words, performances that occur
the onset and offset of the stimuli) to in the face of what are termed threats
the organism's responses to these and duress. According to Sidman,
events (the so-called feeling states). Both positive and negative reinforcers control
Equally apparent is that procedures for our behavior, but I do not call positive reinforce-
identifying these states are obscure. On ment coercion. When we produce things or
the human level, we must depend on events that we usually consider useful, infor-
notoriously unreliable verbal reports, mative, or enjoyable for their own sake, we are
and on the nonhuman level, where under the control of positive contingencies. But
when we get rid of, diminish, escape, or avoid
most basic research has been conduct- annoying, harmful, or threatening events, nega-
ed, such information simply is not tive reinforcers are in control; with that kind of
available. And even if we are willing control, I speak of coercion. (pp. 36-37)
to accept verbal reports at face value, Sidman went on to point to circum-
the distinctions are not all that clear stances under which procedures con-
cut. The thin line is exemplified by the ventionally regarded as positive rein-
story of the foolish individual who hits forcement actually involve negative re-
himself on the thumb with a hammer inforcement because the procedures are
because it feels so good when the pain coercive:
stops. Indeed, termination of states of
pain or anxiety may evoke pleasure- Prisoners, first placed in solitary confinement,
like states (e.g., migraine sufferers re- are then permitted social contacts as reinforce-
ment for docility; first starved, so they can then
port euphoric feelings when their head- get food in return for subservience. Freedom and
ache is relieved), and termination of food look like positive reinforcers, but when
mild annoyers also may be felt as plea- they are contingent on the cessation of artifi-
surable (as when one scratches an itch) cially imposed deprivations, their effectiveness
just as interruption of pleasurable is a product of negative reinforcement; they be-
come instruments of coercion. (p. 41)
states may be reported as aversive
(Solomon, 1980; Solomon & Corbit, By this account, the same operation,
1974). food delivery or social contact, can be
viewed as stimulus presentation or as
Establishing Operations stimulus removal, depending on the se-
verity of the establishing operation.
Perhaps the conceptual problems Extreme deprivation (starvation, isola-
created by references to feeling states tion) is analogous to an aversive event,
POSITIVE AND NEGATIVE REINFORCEMENT 95
and termination of this state, that is, distinction on the level of procedure,
negative reinforcement, is the defining that is, as a useful way of organizing
feature. But the focus changes when operations that may have reinforcing or
responding is under lesser levels of punishing effects. Michael's (1975)
deprivation. Now performances are analysis, together with the amplifica-
controlled by the addition of the posi- tions we have offered in this article,
tively reinforcing stimuli to the sub- indicate otherwise. The essential diffi-
ject's environment (in the example, culty, as we have noted throughout, is
food or social contact). that the operational specification of
Sidman's (1989) approach to the dif- which reinforcers are positive and
ference between positive and negative which are negative contains an essen-
reinforcement is innovative. However, tial ambiguity.
it appears to be limited because we do The dilemma is particularly apparent
not have easy ways of scaling the level when one considers textbook treat-
of different establishing operations. ments of positive and negative rein-
How can we identify the point at which forcement, most of which make their
the operations correlated with normal point by providing "real-life" exam-
hunger shade over into starvation or ples of reinforcers (no doubt to spark
the point at which an annoying shock the interests of students). Textbooks
becomes distinctly painful? Without play a vital role within any scientific
answers to questions such as these, the endeavor: they represent an important
problems of ambiguity we noted for way that the knowledge gained within
the other definitions remain unre- a field is passed on to the next gener-
solved. ation. We did not attempt a complete
survey of textbooks currently in use.
Conclusion However, even a cursory survey of
those that we found on our shelves and
The position laid out by Michael the shelves of our colleagues provides
(1975) was that we can preserve the numerous illustrations of the ambiguity
distinction between pleasure and dis- identified by Michael.
tress-between good and bad things, As a case in point, consider a stu-
as he put it-without preserving the dent confronted with the following two
ambiguous and sometimes misleading behavior sequences intended to illus-
distinction between positive and nega- trate positive and negative reinforce-
tive reinforcement. In his view the dis- ment: (a) A child turns on the TV to
tinction between consequences that watch a cartoon program; (b) I take an
strengthen behavior (reinforcement) aspirin to relieve my headache. Which
and those that weaken behavior (pun- is which? Although the first example
ishment) is quite sufficient to encom- was intended to illustrate positive re-
pass the principles of behavior analysis inforcement and the second negative
(see also Morse & Kelleher, 1977). Our reinforcement, a closer look within the
review has not provided us with com- context of Michael's critique quickly
pelling evidence to the contrary, and reveals the arbitrariness of the distinc-
we are led to the same conclusion tion. Both instances of operant behav-
reached by Michael. ior (turning on the TV, opening the
We noted at the start that a classifi- medicine bottle) involve the produc-
cation of reinforcers (and punishers) tion of stimuli (the cartoon, the aspirin)
into positive and negative provides a as well as consequences that terminate
way of classifying a range of diverse prior events (boredom, a headache). In
events into a smaller number of cate- the former case, the example focuses
gories. Although we could not find sat- on the immediate consequence of the
isfactory support for a classification in response (onset of the cartoon), where-
terms of different processes, perhaps a as in the second the focus is on more
case can be made for maintaining the remote consequences (relief from the
96 ALAN BARON & MARK GALIZIO

headache). However, there is nothing REFERENCES


in the distinction, as originally drawn Baron, A. (1991). Avoidance and punishment.
by Keller and Schoenfeld (1950) and In I. H. Iversen & K. A. Lattal (Eds.), Tech-
subsequently employed by others, that niques in the behavioral and neural sciences:
allows one to be certain which event is Vol. 6. Experimental analysis of behavior
critical. We should note that we found (Part 1, pp. 173-217). Amsterdam: Elsevier.
Baron, A., DeWaard, R. J., & Galizio, M.
instances in which authors acknowl- (1981). Factor-analytically derived subscales
edged that either interpretation is pos- for the reinforcer survey schedule: Reinforcer
sible, which, of course, is true. How- preference as a function of drug use and sex.
Behavior Modification, 5, 203-220.
ever, this concession undercuts the pur- Baron, A., & Kaufman, A. (1966). Human free-
pose of the labels in the first place: to operant avoidance of "time-out" from mon-
provide a straightforward way of talk- etary reinforcement. Journal of the Experi-
ing about two forms of reinforcement. mental Analysis of Behavior, 9, 557-565.
Barrett, J. E., & Katz, J. L. (1981). Drug effects
In summary, if we are to continue to on behaviors maintained by different events.
talk about two kinds of reinforcement, In T. Thompson, P. B. Dews, & W A. McKim
we advise caution in the ways the (Eds.), Advances in behavioral pharmacology
terms are used. The continued role (Vol. 3, pp. 119-165). New York: Academic
Press.
played by the terms positive and neg- Bjork, J. M., Knutson, B., Fong, G. W. Caggi-
ative reinforcement in behavior-analyt- ano, D. M. Bennett, S. M., & Hummer, D. W.
ic discussions suggests that the distinc- (2004). Incentive-elicited brain activation in
tion is serving a useful communicative adolescents: Similarities and differences from
young adults. Journal of Neuroscience, 23,
function. The terms make it plain that 1793-1802.
when we are talking about reinforcers Brown, J. F, & Hendy, S. (2001). A step toward
we are referring to environmental ending the isolation of behavior analysis: A
common language with evolutionary science.
events rather than cognitive or physi- The Behavior Analyst, 24, 163-171.
ological happenings. They provide a Catania, A. C. (1973). The nature of learning.
shorthand way of pointing to the rein- In J. A. Nevin & G. S. Reynolds (Eds.), The
forcers that have traditionally been study of behavior (pp. 31-68). Glenview, IL:
Scott, Foresman.
used for the experimental study of dif- Catania, A. C. (1998). Learning (4th ed.). Up-
ferent problem areas: positive rein- per Saddle River, NJ: Prentice Hall.
forcement in the case of schedules, Cautela, J. R. (1972). Reinforcement survey
choice, and stimulus control (food is schedule: Evaluation and current applications.
Psychological Reports, 30, 683-690.
presented), and negative reinforcement Crowley, T. J. (1972). The reinforcers for drug
for escape and avoidance (shock is ter- abuse: Why people take drugs. Comprehen-
minated). Moreover, the distinction is sive Psychiatry, 13, 51-62.
so well embedded within discussions D'Amato, M. R. (1969). Instrumental condi-
tioning. In M. H. Marx (Ed.), Learning pro-
of operant behavior that one cannot cesses (pp. 35-118). New York: MacMillan.
navigate the literature without being Davis, M., & Astrachan, M. I. (1978). Condi-
familiar with it. These considerations tioned fear and startle magnitude: Effects of
different footshock or backshock intensities
may be good enough reason to contin- used in training. Journal of Experimental Psy-
ue to teach the distinction to our stu- chology: Animal Behavior Processes, 4, 95-
dents. Nevertheless, it is apparent that 103.
the terms positive and negative come Davis, M., Campeau, S., Kim, M., & Falls, W.
A. (1995). Neural systems of emotion: The
with considerable conceptual baggage. amygdala's role in fear and anxiety. In J. L.
By remembering the ambiguities in- McGaugh, N. M. Weinberger, & G. Lynch
herent within the distinction, we are (Eds.), Brain and memory: Modulation and
mediation of neuroplasticity (pp. 3-40). New
less likely to use it to justify ethical or York: Oxford University Press.
practical decisions. At the least, we Dawson, M. E., Schell, A. M. & Boehmelt, A.
should recognize that the question of H. (Eds.). (1999). Startle modification: Im-
functional differences between positive plications for neuroscience, cognitive science
and clinical science. New York: Cambridge
and negative reinforcement remains University Press.
controversial. Dworkin, S. I., Pitts, R., & Galizio, M. (1993).
POSITIVE AND NEGATIVE REINFORCEMENT 97
Schedule-controlled behavior: Negative rein- forcement: A distinction that is no longer nec-
forcement. In F van Haaren (Ed.), Methods in essary; or a better way to talk about bad
behavioral pharmacology (pp. 101-116). Am- things. Behaviorism, 3, 33-44.
sterdam: Elsevier. Morse, W. H., & Kelleher, R. T. (1977). Deter-
Farber, P. D., Khavari, K. A., & Douglass, F M. minants of reinforcement and punishment, In
(1980). A factor analytic study of reasons for W. K. Honig & J. E. R. Staddon (Eds.), Hand-
drinking: Empirical validation of positive and book of operant behavior (pp. 174-200). En-
negative reinforcement dimensions. Journal of glewood Cliffs, NJ: Prentice Hall.
Consulting and Clinical Psychology, 48, 780- Mowrer, 0. H. (1960). Learning theory and be-
781. havior. New York: Wiley.
Friman, P C., Hayes, S. C., & Wilson, K. G. Panksepp, J., Sacks, D. S., Crepeau, L. J., &
(1998). Why behavior analysts should study Abbot, B. B. (1991). The psycho- and neu-
emotion: The example of anxiety. Journal of robiology fear systems in the brain. In M. R.
Applied Behavior Analysis, 31, 137-156. Denny (Ed.), Fear, avoidance and phobias: A
Galbicka, G., & Platt, J. R. (1984). Interre- fundamental analysis (pp. 7-60). Hillsdale,
sponse-time punishment: A basis for shock- NJ: Erlbaum.
maintained behavior. Journal of the Experi- Pear, J. J. (2001). The science of learning. Phil-
mental Analysis of Behavior, 41, 291-308. adelphia: Psychology Press.
Hilgard, E. R., & Marquis, D. G. (1940). Con- Perone, M. (2003). Negative effects of positive
ditioning and learning. New York: Appleton- reinforcement. The Behavior Analyst, 26, 1-
Century-Crofts. 14.
Hineline, P. N. (1984). Aversive control: a sep- Perone, M., & Galizio, M. (1987). Variable-in-
arate domain? Journal of the Experimental terval schedules of timeout from avoidance.
Analysis of Behavior, 42, 495-509. Journal of the Experimental Analysis of Be-
Iversen, I. H., & Lattal, K. A. (Eds.). (1991). havior, 47, 97-113.
Techniques in the behavioral and neural sci- Pierce, W. D., & Cheney, C. D. (2004). Behav-
ences: Vol. 6. Experimental analysis of be- ior analysis and learning (3rd ed.). Mahwah,
havior. Amsterdam: Elsevier. NJ: Erlbaum.
Iwata, B. A,, Pace, G. M., Dorsey, M. F, Zar- Ritz, T., Dahme, B., & Claussen, C. (1999).
cone, J. R., Vollmer, T. R., Smith, R. G., et al. Gradients of facial EMG and cardiac activity
(1994). The functions of self-injurious behav- during emotional simulation. Journal of Psy-
ior: An experimental-epidemiological analy- chophysiology, 13, 3-17.
sis. Journal of Applied Behavior Analysis, 27, Salamone, J. D., Correa, M., Mingote, S., & We-
215-240. ber, S. M. (2003). Nucleus accumbens do-
Kelleher, R. T., & Morse, W. H. (1964). Escape pamine and the regulation of effort in food-
behavior and punished behavior. Federation seeking behavior: Implications for studies of
Proceedings, 23, 808-817. natural motivation, psychiatry and drug abuse.
Keller, F S., & Schoenfeld, W. N. (1950). Prin- Journal of Pharmacology and Experimental
ciples of psychology. New York: Appleton- Therapeutics, 305, 1-8.
Century-Crofts. Salamone, J. D., Cousins, M. S., & Snyder, B.
Kiyatkin, E. A. (1995). Functional significance J. (1997). Behavioral functions of nucleus ac-
of mesolimbic dopamine. Neuroscience and cumbens dopamine: Empirical and conceptual
Biobehavioral Reviews, 19, 573-598. problems with the anhedonia hypothesis. Neu-
Knutson, B., Burgdorf, J., & Panksepp, J. roscience and Biobehavioral Reviews, 21,
(2002). Ultrasonic vocalizations as indices of 341-359.
affective states in rats. Psychological Bulletin, Sidman, M. (1989). Coercion and its fallout.
128, 961-977. Boston: Authors Cooperative.
Lamal, P. A. (1998). Advancing backwards. Skinner, B. E (1938). The behavior of organ-
Journal of Applied Behavior Analysis, 31, isms. New York: Appleton-Century-Crofts.
705-706. Skinner, B. F (1953). Science and human be-
Laurence, M. T., Hineline, P. N., & Bersh, P. J. havior. New York: MacMillan.
(1994). The puzzle of responding maintained Skinner, B. F (1976). About behaviorism. New
by response-contingent shock. Journal of the York: Vintage Books.
Experimental Analysis of Behavior, 61, 135- Skinner, B. F (1981). Selection by consequenc-
153. es. Science, 213, 501-504.
Lundqvist, L. (1995). Facial expressions are Skinner, B. F (1986). What is wrong with daily
contagious. Journal of Psychophysiology, 9, life in the Western world? American Psychol-
203-211. ogist, 41, 568-574.
Mazur, J. E. (2002). Learning and behavior (5th Small, D. M., Zatorre, R. J., Dagher, A., Evans,
ed.). Upper Saddle River, NJ: Prentice Hall. A. C., & Jones-Gotman, M. (2001). Changes
McCullough, L. D., Sokolowski, J. D., & Sala- in brain activity related to eating chocolate.
mone, J. D. (1993). A neurochemical and be- Brain, 124, 1720-1733.
havioral investigation of the involvement of Solomon, R. L. (1980). The opponent process
nucleus accumbens dopamine in instrumental theory of acquired motivation. American Psy-
avoidance. Neuroscience, 52, 919-925. chologist, 35, 691-712.
Michael, J. (1975). Positive and negative rein- Solomon, R. L., & Corbit, J. D. (1974). An op-
98 ALAN BARON & MARK GALIZIO
ponent process theory of motivation: I. The conditioning theory and the impact of biolog-
temporal dynamics of affect. Psychological ical constraints on learning theory (pp. 111-
Review, 81, 119-145. 142). Hillsdale, NJ: Erlbaum.
Stone, G. C. (1961). Nondiscriminated avoid- Verhave, T (1962). The functional properties of
ance behavior in human subjects. Science, a time out from an avoidance schedule. Jour-
133, 641-642. nal of the Experimental Analysis of Behavior,
Thomdike, E. L. (1911). Animal intelligence: 5, 391-422.
Experimental studies. New York: Macmillan. Weiss, B., & Laties, V. G. (1961). Behavioral
Vaccarino, F J., Schiff, B. B., & Glickman, S. thermoregulation. Science, 133, 1338-1344.
E. (1989). Biological view of reinforcement. Wise, R. A., & Bozarth, M. A. (1987). A psy-
In S. B. Klein & R. R. Mowrer (Eds.), Con- chomotor stimulant theory of addiction. Psy-
temporary learning theories: Instrumental chological Review, 94, 469-492.

You might also like