You are on page 1of 15

Psychological Review

1974, Vol. 81, No. 3, 199-213

A MOTIVATIONAL VIEW OF LEARNING,


PERFORMANCE, AND BEHAVIOR
MODIFICATION *
DALBIR BINDRA"
McGill University, Montreal, Quebec, Canada

The theoretical formulation advanced here wholly discards the response-


reinforcement principle. It attributes learned behavior modifications to the
building of central representations of contingencies between situational
stimuli and incentive stimuli; certain situational stimuli are thereby turned
into conditioned incentive-discriminative stimuli. It is proposed that central
motivational states, generated by the joint influence of organismic-state
variables and unconditioned or conditioned incentive stimuli, influence the
response-eliciting potency of particular situational stimuli. The specific re-
sponse form that emerges is a fresh construction created by the momentary
motivational state and the spatio-temporal distribution of various distal and
contact discriminative-incentive stimuli in the situation. These and related
working assumptions are shown to clarify certain long-standing problems
of behavior theory and to provide a basis for deriving satisfactory interpre-
tations of several hitherto perplexing phenomena of conditioning, motiva-
tional modulation of instrumental behavior, and observational learning.

Perhaps the most incontrovertible law of modifications of behavior. One hypothesis


adaptive behavior is that an animal's ex- is that reinforcing stimuli have "response-
perience with reinforcing stimuli in a sit- reinforcing" properties which influence the
uation can produce a marked and lasting strength of association between the given
modification of its actions in that situation. stimulus situation and those responses that
Reinforcing stimuli include such biologically are instrumental in bringing about the re-
important objects, events, and situations as inforcing stimulation. This response-rein-
food, water, an odor, a taste, a sexual part- forcement principle attributes learned be-
ner, a nest or home area, the call of a dis- havior modifications to the contingency
tressed offspring, a loud noise, a predator, existing between a response and the rein-
and injurious levels of heat or cold. They forcing stimulation. The second hypothesis
are also called "affective," "hedonic," "emo- is that reinforcing stimuli have "incentive-
tional," or "incentive" stimuli. They tend motivational" properties which influence the
to be pleasing or discomforting, that is, they response-energizing capabilities of the stim-
frequently elicit appetitive or aversive re- uli that contribute to the occurrence of the
actions; they are contrasted with "neytral" response. This incentive-motivational prin-
stimuli which are neither pleasant nor un- ciple attributes learned behavioral modifica-
pleasant, but hedonically neutral. tion to the contingency existing between
There are two main hypotheses about the the situational stimuli and the reinforcing
exact role of reinforcing stimuli in learned stimulation.
For about half a century following the
1
The preparation of this paper was supported enunciation of the law of effect (Thorndike,
by Grant MH-03238-10 from the U. S. Public 1911), the response-reinforcing principle
Health Service (National Institute of Mental
Health) and Grant A-7918 from the National gradually became the main accepted basis
Research Council of Canada. I have benefited for explaining the phenomena of behavior
from discussions with several students and col- modifications produced through the manip-
leagues. ulation of experiential (learning) or moti-
2
Correspondence concerning this paper should
be addressed to D. Bindra, Department of Psy-
vational variables (e.g., Bollard & Miller,
chology, McGill University, P. O. Box 6070, 1950; Hull, 1943; Skinner, 1938, 1953).
Montreal 101, Quebec, Canada. Though the incentive-motivational view had
199
200 DALBIR BINDRA

its proponents (e.g., Troland, 1932; Young, forcement principle is both unnecessary and
1948), they had relatively little influence invalid.
on formal behavior theory. However, start- Whether the incentive-motivational prin-
ing about 1950, the incentive-motivational ciple remains an adjunct to the response-
principle began to appear in formal accounts reinforcement principle or becomes a self-
of learning and performance (Cofer, 1959; sufficient alternative to it depends largely
Hull, 1952; Logan, 1960; Mowrer, 1947; on how far a coherent framework can be
Seward, 1951, 1956; Sheffield, 1966; developed around the concept of incentive
Spence, 1956), and recently, a variety of motivation and how successfully the frame-
lines of investigation has produced strong work can be used to deal with the varied
support for the incentive-motivational prin- phenomena of learning, performance, and
ciple ; these developments have been re- behavior modification. The purpose of this
viewed by, for example, Appley (1970), article is to outline one such framework, to
Bindra (1968), and Bolles (1967, 1972). indicate its main points of departure from
Despite increasing interest in it, the incen- other attempts to emphasize the role of mo-
tive-motivational principle has so far been tivation in behavior, and to examine some
accepted mainly as an adjunct to the re- of its implications.
sponse-reinforcement principle; the latter
continues to be regarded by most as the pri- MOTIVATION, LEARNING, AND
mary principle governing learned behavior PERFORMANCE
modifications.
However, there is now evident a clear Like other theoretical accounts of learned
theoretical shift away from the response- behavior modifications, the motivational
reinforcement interpretation of learned be- framework presented here has three main
havior modifications and toward the general aspects: some assumptions about the nature
incentive-motivational idea (Bindra, 1969a, of motivation, some about the nature of
1972; Bolles, 1972; Cofer & Appley, 1964; learning, and some about how the two com-
Estes, 1969a, 1972; Logan, 1969; Mowrer, bine to produce the observed changes in
1960; Walker, 1969). Bolles (1972), for performance. Since several elements of the
example, has argued that response-contin- proposed framework must be already fa-
gent reinforcement is neither necessary nor miliar to the reader, I shall merely outline
sufficient for instrumental learning, and he the main points.
has tried to explain learning largely in
Nature of Motivation
terms of the contingencies of reinforcing
stimulation with other stimuli. Estes The view of motivation adopted here is
(1969b, 1972) has suggested that reinforc- that motivational processes should not be
ing stimulation does not act backward to linked either exclusively to organismic-state
strengthen the response that preceded, "but variables (or "homeostatic drives"), empha-
rather provides an opportunity for the or- sized by Woodworth (1918), Richter
ganism to learn a relationship between the (1927), Hull (1943), and Estes (1958),
stimulus which evoked its response and the or exclusively to stimulus properties ("he-
[reinforcing stimulation] [1972, p. 726, donic quality") of environmental incentive
italics added]." Similarly, Bindra (1969a, objects, emphasized by Troland (1932,
1972) has argued that the primary effect of chap. 23), Young (1948), and Pfaffmann
the reinforcement procedure is "not re- (1960), but equally to both. According to
sponse strengthening, but the creation of this emerging view of motivation (e.g.,
a motivational state that influences a wide Bindra, 1968, 1969a, 1969b; Black, 1969;
variety of subsequent behavior of the ani- Cofer & Appley, 1964; Flynn, 1967; Pfaff
mal [1969a, p. 7]." He has concluded that & Pfaffmann, 1969), the source of any mo-
the incentive-motivational principle is suf- tivational influence on behavior is neither
ficient by itself to explain learned behavior any (humoral or sensory) aspect of or-
modifications and that the response-rein- ganismic states as such, nor any incentive
MOTIVATION AND LEARNING 201

stimulus per se, but some process that com- Unconditioned Response
bines the two.
The basic motivational concept of the
Food »•(?
proposed framework is the central motive
state (Bindra, 1968; Morgan, 1943; Stellar,
1954). As used here, the central motive Hunger -
state is a hypothetical set of neural pro-
cesses that promotes goal-directed actions in
relation to particular classes of incentive
stimuli—for example, it promotes food- FIGURE 1. A schematic plan of the hypothetical
seeking and eating in relation to food, or motivational process and its influence on three as-
defensive fighting and escape in relation to pects of response. (Abbreviations: cms, central
a predator. Motivational state and "emo- motive state; e, eating central motive state; f,
tional state" are interchangeable terms central representation of food; s-m coord., sen-
sory-motor coordinations.)
(Bindra, 1969b). A central motive state is
generated by the joint influence of (a) cer-
tain specific aspects of organismic-state fac- actional (consummatory or rejectional)
tors (variations in the humoral concentra- acts, and partly of instrumental (locomo-
tions of salts, sugar, or hormones, the tion and skilled) actions. How are these
sensory inflow from viscerosomatic changes, different aspects of response influenced by
etc.) and (£>) certain potent stimulus prop- a prevailing central motivational state?
erties of environmental incentive objects Figure 1 shows possible mechanisms by
(usually gustatory, cutaneous, or olfactory which a food-related or, for convenience,
qualities but also certain visual or auditory say "eating" central motive state influences
qualities). Stimuli arising from an appeti- the three aspects of response. An eating
tive incentive object generate (when or- central motive state (e) is generated by the
ganismic state is appropriate) an appetitive combined influence of certain organismic-
central motive state, and this creates a ten- state features (say, low blood-sugar level,
dency to approach the incentive object when sensory inflow from an empty stomach,
the object is located distally, and, on con- etc.) and the central representation of cer-
tact with the object, to perform whatever tain properties of food (e.g., its odor). The
response is compatible with the contact eating central motive state has a general
stimulus features of the object . (e.g., its excitatory or priming influence on those
size, taste, hardness). Stimuli arising from sensory-motor coordinations which are typi-
an aversive incentive object generate (when cally involved in appetitive behavior as op-
organismic state is appropriate) an aversive posed to those typically involved in aversive
central motive state, and this creates a ten- behavior. In addition, the central motive
dency to struggle or reject and to move state has two specific influences. First, it
away from the object when the animal is directly activates certain regulatory sensory-
in contact with it, and to avoid it when the motor coordinations, thus producing specific
aversive stimuli are distal. Note that the viscerosomatic reactions, such as salivation.
central motive state determines the (incen- Second, the central motive state, through
tive) object in relation to which the animal its reciprocal connections with the central
will act; the exact form of the response is representation of food (f), excites it fur-
determined by the specific discriminative ther; that is, the central representation of
properties of the object and its spatial posi- food, which provided the incentive sensory
tion in relation to the animal. qualities required for the generation of the
As shown in Figure 1, the response an central motive state, is itself excited fur-
animal displays in relation to incentive stim- ther by the same central motive state. The
uli (under certain specific organismic-state enhancement of the excitation of the central
conditions) consists partly of regulatory representation of food results in the acti-
(viscerosomatic) reactions, partly of trans- vation of the sensory-motor coordinations
202 DALBIR BINDRA

of instrumental and transactional acts (pre- critically depend on feedback from prior
viously developed through maturation and internal reactions (for a review, see Bindra,
learning). The central representation of 1968; Rescorla & Solomon, 1967). Ac-
the distal (e.g., visual or olfactory) dis- cording to the present view, response selec-
criminative properties of food activate the tion and motivation are integrated because
sensory-motor coordinations of instrumental the environmental object (e.g., food) in re-
approach acts; once the animal has come in lation to which a response (e.g., approach
contact with food, the central representation and eating) is made is the same object
of the contact stimulus properties of food whose stimuli (e.g., food odor) have earlier
(e.g., touch, taste) activate consummatory contributed to the generation of the food-
acts of eating. related central motive state (see Figure 1);
Three essential—and more or less dis- the motivation and the goal of the response
tinctive—features of this model of the na- are determined by the same incentive ob-
ture of motivational influence on response ject—hence the integration. This interpre-
should be noted. First, by specifying three tation is similar to that offered by Cofer
separate mechanisms for the production of and Appley (1964), who suggested that
visceral-regulatory, transactional, and in- motivation-arousing stimuli also serve as
strumental acts, the model implies that the discriminative cues. The present model
three need not be perfectly correlated. Thus goes a step further in indicating how the
the observed instances of "dissociation" be- potency of particular environmental stimuli
tween the visceral-regulatory and instru- —unconditioned or conditioned incentive
mental responses (see Rescorla & Solomon, stimuli—may be selectively enhanced by a
1967) need not be perplexing; the source certain central motive state (see Figures 1
of the perplexity is the common assumption and 2). The motivational influence does
of a unitary determination of the various not energize or activate a preselected re-
aspects of response. sponse, but leads to the production of a
Second, the traditional view, arising from fresh response which gets constructed as
the writings of Tolman (1932) and Hull the animal acts in relation to certain en-
(1943, 1952), was that the motivational vironmental stimuli which have been made
factor does not enter into determining which more potent.
response would occur, but serves merely to Third, it is important to note that, in the
push out the response selected by a prior model proposed here, motivational fluctua-
response-selection process ("habit," "ex- tions are not dependent on the feedback
pectancy," etc.). This left unanswered the from response consequences (e.g., reinforc-
question of how the response selection and ing stimulation produced by a response),
motivational arousal combine to lead to the
which is emphasized in the cybernetic the-
occurrence of a particular instrumental re-
sponse. If motivational arousal is a purely ories of Mowrer (1960), Miller (1963),
energizing factor without any directional or Konorski (1967), and Estes (1969a). As
selective function, why, for example, does Bolles (1972) has noted, such theories fail
food motivation produce actions that lead to explain the occurrence of the first re-
the animal to food, and sexual motivation sponse whose feedback is postulated to in-
produce actions that lead the animal to a duce motivation and to control further re-
sexual partner, and not vice versa? The sponding. According to the present model,
concept of sensory feedback, from "drive the central motive state is generated directly
stimuli" (Hull, 1943), from "emotion" by organismic-state and incentive variables,
(Mowrer, 1960), or from anticipatory goal and, once generated, "feeds forward" to
reactions (Hull, 1952; Spence, 1960), was make certain particular environmental stim-
one way of answering the question. How- uli so potent that the animal must act in
ever, evidence shows that the integration of relation to them rather than in relation to
motivation and response selection does not any other stimuli.
MOTIVATION AND LEARNING 203

What Is Learned? observed to occur concomitantly or discon-


comitantly. However, "contingency rein-
As a first approximation, it seems reason- forcement," the procedure of presenting
able to say that what a mammal learns in a reinforcing stimulation following Si or fol-
situation—the representations that somehow lowing Si:S2, is not a necessary condition
become incorporated into its brain—are the for contingency learning. That animals
contingent relations existing between the learn contingencies without reinforcement
events that regularly occur in that situation.
(of stimulus contingencies or of responses)
A contingent relation between two stimulus is shown by certain types of habituation ex-
events, Si and 82, is often said to be "posi- periments. For example, it is known that
tive" or "negative." A positive contin- not only the introduction of a novel stimu-
gency, 81:82, means that the occurrence of lus but also the removal or absence of a
51, the signaling or conditioned stimulus is routinely encountered stimulus from a fa-
followed, for a certain duration, by an in- miliar test situation evokes orientation re-
crease in the probability of occurrence of sponses (e.g., Berlyne, 1960; Grings, 1960;
52, the predicted or unconditioned stimulus, Peeke & Grings, 1968; Unger, 1964). The
the increase being relative to background fact that the absence of an object can evoke
("noncontingent") probability of 82; this
orientation reactions indicates that the con-
contingency makes Si and S2 concomitant tingency existing between the situation (the
events. A negative contingency, 81:82, background stimulus complex) and the ob-
means that the occurrence of Si is followed, ject must have been learned during the fa-
for a certain duration, by a decrease in the miliamation or habituation trials—in the
probability of occurrence of Sg below the absence of any reinforcing stimulation (by
prevailing background probability; this con- definition, the habituation procedure is a
tingency makes Si and 82 disconcomitant nonreinforcement procedure). The results
events. Encounters with certain positive of experiments on perceptual learning, la-
and negative contingencies, that is, experi- tent learning, and sensory preconditioning
ence with concomitance and disconcomit- (see Kimble, 1961) are also most directly
ance of the stimulus events, leads to con- interpretable as learning without the influ-
tingency learning, that is, the development ence of reinforcing stimulation.
of central representations of the environ- There are two essential points in the
mental contingencies. Such central repre- above characterization of learning. The first
sentations may be called central contingency is that contingent relations are learned
organisations. When activated by Si, a through observation; reinforcing or incen-
positive contingency organization excites tive stimulation is neither necessary for con-
and a negative contingency organization in- tingency learning, nor does it contribute
hibits the central representation of 82. The anything to the learning. On this point,
degree of such conditioned excitation or in- my view resembles that of several present-
hibition reflects the "expectancy" or ex- day theorists, including Estes (1969b) and
pected imminence of the occurrence of Sa Bolles (1972). The second point is that,
following the occurrence of Si. The greater according to the view outlined above, learn-
the contingent increase in the probability of ing involves the development of stimulus-
S2 predicted by Si, the greater will be the stimulus contingencies only; stimulus-re-
(positive) expectancy or the conditioned sponse or response-stimulus contingencies
excitation of the central representation of are not critical in learned behavior modifica-
82; the greater the contingent decrease in tions. Contrary to this, Estes' view is that
the probability of S2 predicted by Si, the learning can involve stimulus-stimulus,
greater will be the (negative) expectancy stimulus-response, as well as response-
or the conditioned inhibition of the central stimulus "associative linkages," while Bolles
representation of 82. argues that animals can learn response-
The learning of a contingency between stimulus expectancies in addition to stimu-
two stimuli requires, of course, that they be lus-stimulus expectancies. In one sense,
204 DALBIR BINDRA
a) Conditioning (Early Trials procedure. They allow an important role
for contingencies involving response-^ro-
Light
duced stimuli; I regard contingencies in-
volving response-producing stimuli as the
Food *• Approaching critical ones. The fact that monkeys with
total spinal deafferentation can learn and
Hunger *• Eating
efficiently perform an instrumental skill
•Salivating, etc
(Taub & Herman, 1968) indicates that, at
least in the adult animal, any possible con-
tingencies between response-produced stim-
uli and subsequent stimulation are probably
b) Conditioning (Test Trials) not critical for instrumental learning.
L,ght — Learning, Motivation, and Response
Production
[>«*
not giv> Approaching
The main working assumption about the
interrelations of learning, motivation, and
response production proposed here is this:
Salivating . etc
The modification of behavior produced by
contingency learning depends on the moti-
vational properties acquired by certain in-
FIGURE 2. A schematic plan of the hypothetical
process by which through conditioning (a) an itially neutral stimuli during the contingency
initially neutral stimulus (light) can become capa- learning. Figure 2 illustrates this for a
ble of generating a motivational influence (b) conditioning experiment in which a light
which then affects various aspects of response out- onset is the conditioned stimulus and food
put. (Abbreviations: 1, central representation of is the unconditioned stimulus. During the
light; cms, central motive state; e, eating central
motive state; f, central representation of food; early stage of conditioning (Figure 2a) a
s-m coord., sonsory-motor coordination.) light .'food contingency is gradually learned,
which is shown as broken-line reciprocal
the difference between the position of Estes connections between the central representa-
and Bolles on the one hand and mine on the tion of light (/) and the central representa-
other may be trivial. For their positions tion of food (/). During this stage the
may mean merely that response-produced occurrence of the response still depends on
stimuli may form a part of some so-called the presentation of food, and the light lacks
response-stimulus contingencies; so that, the capability of producing any aspect of
in fact, any learned contingency would be a the response produced by food. After con-
stimulus-stimulus contingency, even though ditioning has been achieved (Figure 2b~),
in procedural terms it may be convenient the onset of light excites /, and through its
to describe it as a response-stimulus one. learned contingency with food, / excites /
However, there may be an important differ- thereby creating the eating central motive
ence between the two positions. The Estes- state ( e ) , which then enhances the central
Bolles interpretation of a procedural re- representation of first food and then light.
sponse-stimulus contingency seems to be As noted earlier in the description of Figure
that the contingency between the stimuli 1, the enhancement of the central represen-
arising from a response and the subsequent tation of the distal stimulus features of the
(reinforcing) stimulation is the critical one light would produce approach responses di-
in instrumental training. My interpreta- rected at the light. If the animal is able to
tion is that it is the contingency between make contact with the light, it would also
the stimuli that elicits or contributes to the display some consummatory acts that may
occurrence of a response and the subse- resemble, to some degree, those elicited by
quent stimulation (incentive or neutral) the contact stimuli of food (acts such as
that is critical, no matter what the training gnawing, licking, biting), but because the
MOTIVATION AND LEARNING 205
light source lacks the stimulus features of tional) responses, which depend largely on
an edible object, the whole consummatory contact receptors, are likely to be quite dif-
action would not occur until food is pre- ferent. This explains why the conditioned
sented. However, the viscerosomatic reac- response in Pavlovian experiments is not
tions linked to the central motive state of always exactly the same as the total uncon-
eating would occur, for they are not de- ditioned response; while the viscerosomatic
pendent on specific discriminative stimuli. (e.g., salivation) and some instrumental
Note that, unlike the response-reinforce- (e.g., orientation to the conditioned stim-
ment view, the role of a conditioned stimu- ulus, neck stretching) appear regularly, the
lus postulated here is not that of becoming- consummatory acts (e.g., biting, chewing)
associated with a specific response, but one made in relation to the incentive object
of providing the motivational arousal that (e.g., food) are not normally made when
can influence a wide range of behavior in the conditioned stimulus is presented alone.
relation to that conditioned stimulus (in the Clearly, the animal acts in relation to the
absence of the unconditioned incentive conditioned stimulus in the same way as it
stimulus). The precise form of the re- would to the unconditioned stimulus only
sponse is not predetermined but is shaped to the extent that the spatio-temporal posi-
by the prevailing motivational state and tion in relation to other stimuli and the
the current environmental discriminative physical characteristics of the conditioned
stimuli. stimulus are the same as those of the un-
The most important environmental de- conditioned stimulus.
terminers of the form of response appear to If the form of the instrumental response
be (fl) the spatio-temporal arrangement of is determined by the momentary incentive
the various conditioned and unconditioned value of the various unconditioned and con-
incentive stimuli in the given situation, and ditioned incentive stimuli in the situation,
(b) the physical characteristics of condi- how does the response become uniform, sta-
tioned stimuli in relation to those of the ble, and stereotyped with practice? This is
unconditioned stimuli. If the conditioned a question that was left unanswered by
stimulus is presented in the same situation Mowrer's (1960) motivational account of
and in roughly the same spatial and tem- learning, and he was criticized for it (Mil-
poral positions in which the unconditioned ler, 1963). In the present framework, the
stimulus is normally presented, the animal answer to this question is to be found in the
is likely to display the same instrumental uniformity and stability of the spatio-tem-
acts (approach or withdrawal) in relation poral arrangement of the incentive stimuli
to the conditioned stimulus as it would nor- in the training situation. Consider a hun-
mally make in relation to the unconditioned gry rat learning a simple running response
stimulus in that situation. If, in addition in a straight alley placed between a start
to keeping the total situation the same, the box at one end and a goal box containing
conditioned stimulus resembles the uncon- some food at the other. In the first few
ditioned stimulus in physical appearance, trials, the rat explores the runway until it
the animal might also display some of the happens to reach the goal box and the food.
same type of transactional acts in relation Food stimuli would generate a feeding cen-
to the conditioned stimulus as it would tral motive state and lead to eating. As
normally display in relation to the uncon- the animal is given further training trials,
ditioned stimulus. In general, responses certain salient stimuli would become con-
that depend on distal receptors, such as ditioned incentive stimuli. The conditioned
certain viscerosomatic regulatory reactions incentive value of these stimuli would form
(e.g., salivation or heart rate changes) and a gradient with the conditioned stimuli in
instrumental acts, may be expected to be the start box having the lowest values.
roughly the same for the conditioned stim- Now, when the animal is placed in the
ulus and the unconditioned stimulus, but start box, it would move from one location
the transactional (consummatory or rejec- to another, always approaching an area of
206 DALBIR BINDRA

relatively greater conditioned incentive cause the animal would no longer be acting
value, until it reaches the food. With fur- in relation to specific intermediate stimuli.
ther training, as the incentive values of the Only after the reinstigation of exploratory
conditioned stimuli increase and explora- responses, owing to the absence of food in
tory responses decline, the speed with which the habitual location, would a new response
the response is completed would increase. begin to take shape. Even while the new
Further, as a consequence of practice, with response is being integrated, the animal will
the arrangement of the situational stimuli occasionally forget that the situation has
kept constant, the central representations of been altered and will perform the old re-
the successive conditioned stimuli would be- sponse (Spear, 1967; Staddon, 1972). A
come associated so that the central repre- delay in the disintegration of a trained re-
sentation of a particular stimulus (say, the sponse is also seen when, after training,
middle section of the runway) would be- food is made available at an additional loca-
come excited before any input from that tion in the runway (e.g., in the middle of
stimulus. This integration of the central the runway) ; the rat does not immediately
representation of the chain of successive give up the trained response of going to the
conditioned stimuli would result in "short- goal box in favor of eating in the middle
circuiting," leading to action in relation to of the runway (Stoltz & Lott, 1964). How-
anticipated remote conditioned stimuli; for ever, in these experiments food is presented
example, the rat, instead of looking at and in two places so that the factors of familiar-
approaching each intermediate conditioned ity of the location at which food is nor-
stimulus in the runway, would look at the mally eaten and the predictability of the
end of the runway and approach it directly. time of food delivery may become relatively
Thus the response would transform from a more important than the extra effort re-
"guided" series of discrete and disjointed quired. The importance of the factor of
acts to one that is unified, smooth, and "bal- familiarity of eating location is shown by
listic," which could be triggered as a whole the observation that the rat is quite likely
by the initial conditioned stimuli. At this to transport the food from the middle of the
stage even gross sensory insults, for exam- alley to the goal box and then eat it there
ple, blinding, would have little effect on (Cohen-Salmon & Blancheteau, 1967).
performance (DeFeudis, 1968; Honzik, The phenomena of "working" (e.g., lever
1936). The essential point of this view is pressing) in the presence of "free" food
not to deny response integration but to sug- may also be similarly interpreted (e.g.,
gest that the integrated response does not Morgan, in press). In these situations the
arise from the integration-by-reinforcement animal usually does eat the free food in the
of successive stimulus-act components, but early part of the trial; this argues against
from the integration-by-contingency learn- the idea that any reinforced motor organi-
ing of the central representation of condi- zation has to be obliterated before the ani-
tioned stimuli, which is made possible by the mal will approach the new location of free
uniformity and stability of the situation. food.
If the uniformity, stability, and stereo-
typing of the final response resides in the IMPLICATIONS AND PREDICTIONS
uniformity and stability of the training sit-
uation, then the response integration should In the course of the above exposition I
eventually break down if the spatial layout mentioned some long-standing problems in
of the critical unconditioned and conditioned the fields of motivation and learning that
stimuli were to be altered; for example, if can be adequately dealt with by the pro-
the food were made available in another posed ideas. How are motivational arousal
part of the runway. The disintegration of and response selection integrated to pro-
the response and the development of a new duce responses that are appropriate both
stable response in relation to the new loca- motivationally and in terms of environmen-
tion of food would not be immediate be- tal discriminative stimuli? Why are the
MOTIVATION AND LEARNING 207

viscerosomatic, consummatory, and instru- only, as is clone in the typical classical con-
mental components of a response somewhat ditioning experiment. Indeed the appear-
independent of each other? Why, in Pav- ance of stable "instrumental components"
lovian conditioning, is the conditioned re- (e.g., superstitions and preparatory acts)
sponse not an exact replica of the uncon- has long been noted in the course of classi-
ditioned response? How is the stability cal conditioning (e.g., Pavlov, 1927; Skin-
and stereotypy of habits learned in the lab- ner, 1948; Zener, 1937). More formally,
oratory to be reconciled with the flexibility several recent experiments have shown that
and innovativeness seen in the behavior of what appear in all respects to be instru-
animals in their natural environments? mental responses may be shaped and con-
Answers to such questions, which have per- trolled by arranging response-independent,
plexed theorists for many years, are explicit stimulus-contingent incentive stimulation.
or clearly implied in the theoretical frame- The influence of the stimulus-stimulus con-
work outlined in the previous pages. It tingency may be clearly observed in the la-
now remains to examine some distinctive tency of occurrence of the first response,
predictions that may be derived from the that is, before the training procedure can be
proposed ideas in order to test them. said to have been contaminated by any re-
There are two essential ideas in the pres- sponse-incentive contingency, and the prob-
ent view of the principles underlying learned ability of responding can be shown to vary
modifications of behavior. The first is that directly with the strength of the stimulus-
the principle of contingency learning be- stimulus contingency (e.g., Brown & Jen-
tween stimuli (which is conceptually de- kins, 1968; Gamzu & Schwartz, 1973;
rived from the classical conditioning para- Gamzu • & Williams, 1973; Moore, 1973;
digm) is sufficient for explaining learned Williams & Williams, 1969).
behavioral modifications; the principle of However, the demonstration that instru-
response reinforcement is unnecessary. The mental responses can be shaped without any
second is that performance—the production explicit response-reinforcement contingency
and form of an instrumental response—is need not mean that response-incentive con-
determined jointly by the type of the pre- tingencies contribute nothing to learning as
vailing organismic state and the spatio- it normally occurs in most training situa-
temporal layout of the conditioned incentive tions. In order to prove the present thesis,
stimuli in the situation. For the purpose that response-incentive contingencies are
of illustrating how these ideas may be used completely without effect, it would be neces-
to derive specific predictions that bear di- sary to isolate the stimulus-incentive and
rectly on the issue of incentive-motivational response-incentive contingencies. Since, ac-
versus response-reinforcement interpreta- cording to the present view, the critical
tion of adaptive behavior, I have selected stimulus contingencies are those involving
examples from three areas of research. the stimuli in relation to which the response
These are (a) distinction between classical is to be made (e.g., the manipulandum),
conditioning and instrumental training, (6) we would require the isolation of such
effects of extraneous conditioned stimuli response-determining stimuli from the ac-
on instrumental responses, and (c) learn- tual response occurrence (e.g., isolation of
ing by observation of models. the observation of lever stimuli from the
lever-pressing response). No way of neatly
Classical Conditioning and Instrumental achieving this has yet been devised. How-
Training ever, the question may be approached, if
not unequivocally resolved, by determining
If learning is wholly a matter of building the relative efficacy of stimulus-incentive
central representations of stimulus-stimulus and response-incentive contingencies. While
contingencies, then it should be possible to not specifically addressed to this issue, some
obtain uniform and stable instrumental re- experiments by Williams and Williams
sponses by arranging such contingencies (1969) suggest that variations of stimulus-
208 DALBIR BINDRA

incentive contingencies can have such pro- (owing to the novelty of the unconditioned
found effect on an animal's behavior as to stimulus), it would be dissipated or attenu-
override the effects usually attributed to ated with repetition of that unconditioned
response-incentive contingencies. stimulus. These CS-US contingencies may
Though more systematic studies of the be positive (concomitance, CS:US), or
question are required, the available findings negative (disconcomitance, CS:US), and
make it plausible at least to entertain the the US may be an appetitive incentive stim-
idea that response-incentive contingencies ulus (US I a p ), an aversive incentive stimu-
may contribute nothing to learning. The lus (US IaT ), or a neutral stimulus (US N ).
apparent superiority of the instrumental The motivational properties acquired by a
training procedure over the classical one for conditioned stimulus would depend on both
response shaping may simply be the conse- the type of contingency (positive or nega-
quence of the fact that arranging a response- tive) and the nature of the incentive prop-
incentive contingency is the best way so far erties of the unconditioned stimulus (ap-
discovered for insuring that the animal will petitive, aversive, or neutral). We may
observe the critical stimulus features which thus recognize six types of conditioned
must enter into the stimulus-incentive con- stimuli, _CSIaP, CSf^, CS IaT , CS1", CSN,
tingency for producing the specified re-
sponse promptly and reliably. If response- and CSN. When the contingency is positive
incentive contingencies are proved to be and the unconditioned stimulus is an in-
useless, the observed differences in the be- centive stimulus (appetitive or aversive),
havioral outcomes of the typical classical the conditioned stimulus becomes capable
and instrumental training procedures would of enhancing the corresponding (appetitive
have to be accounted for in terms of differ- or aversive) central motive state and pro-
ences in the types of stimulus-incentive con- motes instrumental (approach or with-
tingencies that typically operate in the two drawal) responses (but not transactional
procedures (see Bindra, 1972). acts—see above) in relation to itself (CS)
of the type that, were the unconditioned
Effects of Extraneous Conditioned Stimuli stimulus present, would be performed in
on Instrumental Responses relation to it (US). When the contingency
It has long been known that a conditioned is negative and the unconditioned stimulus
stimulus developed in a classical condition- is an incentive stimulus, the conditioned
ing (response-independent) procedure can stimulus becomes capable of attenuating the
influence an instrumental response trained prevailing central motive state and thereby
separately and without any association with suppresses responses that would normally
that conditioned stimulus (e.g., Estes, 1943; be performed in relation to the conditioned
Estes & Skinner, 1941). According to the stimulus in the situation. And when the
present view, the type of influence the con- unconditioned stimulus is itself a neutral
ditioned stimulus (CS) has depends on the stimulus, the conditioned stimulus produces
type of motivational properties it has ac- a decline in the existing central motive
quired during its pairing with an uncondi- states and reduces the probability of any
tioned stimulus (US). If the uncondi- response, yielding the observations made in
tioned stimulus is an incentive object, the typical novelty-habituation experiments.
conditioned stimulus would generate the Thus, the influence on instrumental re-
same central motive state as is generated by sponses of all three types—promotion of
the unconditioned stimulus (provided the responding, suppression of responding, and
appropriate organismic state is present). habituation of responding—are regarded
If the unconditioned stimulus is a neutral here as arising from the motivation-enhanc-
stimulus, the conditioned stimulus would ing and motivation-attenuating consequences
not become capable of generating any spe- of conditioned stimuli.
cific central motive state, and even if an It follows that, in general, the introduc-
investigatory motive state is first aroused tion of conditioned aversive stimuli (e.g.,
MOTIVATION AND LEARNING 209

a tone that has been paired with an electric Now consider the reported discrepancy
shock) would enhance the occurrence of an between the dramatic and consistent effects
aversive instrumental response (e.g., an on instrumental responses obtained with
avoidance response) and suppress the oc- response-independent aversive conditioned
currence of an appetitive instrumental re- stimuli and the rather weak and variable
sponse (e.g., lever pressing for food), and effects obtained with corresponding appeti-
the introduction of conditioned appetitive tive stimuli. As seen above, in the case of
stimuli (e.g., a tone paired with free de- an avoidance instrumental response, the in-
livery of food) would enhance the occur- troduction of a response-independent aver-
rence of an appetitive instrumental response sive conditioned stimulus (say, a tone) in
and suppress the occurrence of an aversive the start box would increase the conditioned
instrumental response. The fact that this aversive properties of the start box and
prediction has not always been confirmed, make the animal withdraw from it quickly ;
especially in the case of appetitive condi- the instrumental response would be facili-
tioned stimuli, has produced discussion but tated both in terms of latency and response
no solution. However, the present view time. However, in the case of a food-
now offers a solution. approach instrumental response in the same
As noted earlier, the form and occurrence alley, the introduction of a response-inde-
of an instrumental response is determined pendent appetitive conditioned stimulus
by the nature and spatio-temporal distribu- (the same tone) in the start box would
tion of conditioned incentive stimuli in the make the animal act in relation to the tone
experimental situation. This means that in the start box itself. The acts displayed
the influence on an instrumental response in relation to the tone in the start box would
of any particular extraneous conditioned be orientation toward and exploration of
stimulus would vary with the topographical the direction of sound source. Only after
position of the stimulus. Consider an ex- failing to find the food in the start box
ample. In a typical avoidance experiment would the animal traverse the runway to
in a unidirectional alley, the avoidance- the goal box. Thus, the latency of instru-
response performance may be altered by mental response initiation may be raised,
the introduction of a conditioned stimulus, but the number of trials required for ex-
say, a tone that has previously been corre- tinction may also be greater than the num-
lated with an electric shock or some other ber required in the absence of the con-
aversive unconditioned stimulus. The in- ditioned stimulus. Such effects of the
strumental response of running from the introduction of an aversive or appetitive
dangerous start box to the safe box at the conditioned stimulus in the start box have
end of the alley would be facilitated by the been observed by Rice (1966) and Bolles
introduction of the tone. This would occur (1970). Thus, according to the present
because the tone would enhance the moti- view, the main reason for the discrepancy
vational state and thus increase the condi- in the effects of response-independent ap-
tioned incentive (aversive) properties of petitive and aversive conditioned stimuli lies
the start box (in the absence of the shock). in the fact that, in typical experiments of
But suppose that the tone, instead of being this type, the locations of the conditioned
presented as an unlocalizeable encompassing appetitive stimulus (start box) and the un-
sound, as is usually the case, is presented conditioned appetitive stimulus (goal box)
through a loudspeaker placed in the safe tend to be different, whereas the locations
box at the end of the runway. According of the conditioned aversive stimulus (start
to the present view, the tone would suppress box) and the unconditioned aversive stimu-
the instrumental response (of running in lus (start box) tend to be the same. Fur-
the direction of the aversive tone). Certain ther experimental tests of this interpreta-
experimental findings (e.g., Bolles & Gros- tion are needed; in the meantime it may be
sen, 1970; Katzev, 1967) support this type noted that the interpretation is a more gen-
of prediction. eral one and can explain a wider range of
210 DALBIR BINDRA

obtained results than the idea of motivation between various environmental objects and
promoting a predetermined instrumental the mother's approach and withdrawal re-
response. actions in relation to those objects. This
is one way in which the child may be guided
Learning by Observation of Models to or away from various situational stimuli
The learning of a certain denned instru- which have incentive properties for the
mental response by an animal may be facili- mother. The particular actions performed
tated if it observes another animal, usually by the child need not always resemble those
a member of the same species, perform a of the mother, but they would tend to re-
similar response. Traditional explanations semble those of the mother if the child's
of such learning by observing the perform- motivational state is the same as that of the
ance of models have invoked the response- mother at the time of the test, and if the
reinforcement principle or have attributed child has been able to observe the specific
it to the learning of a "generalized re- stimulus features of the objects in relation
sponse" of doing what the model does (e.g., to which the mother has acted. Observa-
Miller & Dollard, 1941; Mowrer, 1950). tional learning then is not response learn-
But such explanations are inadequate (Ban- ing, nor is it a generalized tendency to copy
dura, 1962; Bandura & Walters, 1963; the actions of the model; rather, it is learn-
Estes, 1970). First, they are internally in- ing the incentive value of various stimulus
consistent because they attribute learning to events vicariously through the observed
the response-reinforcement principle and transactions of an attractive (appetitive)
yet postulate learning without prior occur- model with those stimulus events. The re-
rence of the response-to-be-learned; the sults of some recent experiments with rats
principle of response reinforcement requires (e.g., Galef, 1971; Galef & Clark, 1971)
that the response occur before—be instru- and with cats (e.g., Chesler, 1969) support
mental in producing—the reinforcement. such an incentive-motivational account of
Second, the suggestion that learning from observational learning.
models may represent a generalized re- An interesting prediction may be derived
sponse to do what the model is doing merely from the above interpretation. If the con-
begs the question; even if it is true that the tribution of observing the model depends
generalized response is acquired through re- wholly on the learner's learning about the
sponse reinforcement, how does such a gen- actions of the model in relation to various
eralized response facilitate the learning of environmental stimuli, then it should be
a specific instrumental action? possible for the learner to learn without ob-
An alternative explanation of learning by serving the consequences (rewarding or
observation of models may be derived from punishing) of the model's actions (for the
the account of learning and performance model). In other words, the critical re-
proposed here. Assume that the model is quirement is not that the learner observe
a strong conditioned appetitive incentive the model being reinforced but only that he
stimulus for the learner. Then, according observe the model's prereinforcement trans-
to the present view, the learner, who is ob- actions with certain discriminative stimuli.
serving the model—say, a child observing In order to determine if this is so, it is
his mother-—would frequently follow the necessary to isolate the learner's observa-
mother and thus would encounter the same tion of the model's transactions with dis-
environmental objects as the mother does. criminative stimuli from the learner's ob-
Now, the mother, by performing certain ac- servation of the model being reinforced, as
tions in relation to some of the objects, well as of the model's reaction to the rein-
would impart to the child some knowledge forcement. Two such properly controlled
about the incentive properties those objects animal studies were reported recently.
have for the mother. This would occur be- They showed that the benefit that rats de-
cause, by following the mother, the child rived in discrimination learning from ob-
would observe the (stimulus) contingencies serving a model perform the same task was
MOTIVATION AND LEARNING 211

attributable to the viewing of the model In W. J. Arnold & D. Levine (Eds.), Nebraska
"contiguous with the cue pattern" and not symposium on motivation: 1969. Lincoln: Uni-
versity of Nebraska Press, 1969.
to the viewing of the model being rein- BOLLES, R. C. Theory of motivation. New
forced or punished (Groesbeck & Duer- York: Harper & Row, 1967.
feldt, 1971; Kohn & Dennis, 1972). It is BOLLES, R. C. Species-specific defense reactions
known from several experiments on chil- and avoidance learning. Psychological Review,
1970, 77, 32-48.
dren (e.g., Bandura, 1971) that the obser- BOLLES, R. C. Reinforcement, expectancy, and
vation of the model being reinforced may learning. Psychological Review, 1972, 79, 394-
facilitate the emergence of the model's 409.
behavior in the learner. This would be pre- BOLLES, R. C., & GROSSEN, N. E. Function of the
dicted from the present formulation because CS in shuttle-box avoidance learning by rats.
Journal of Comparative and Physiological Psy-
the observation of an incentive stimulus in chology, 1970, 70, 165-169.
relation to the discriminative cues (and BROWN, P. L., & JENKINS, H. M. Auto-shaping
the model) would enhance conditioned mo- of the pigeon's key-peck. Journal of the Ex-
tivation and hence, performance. However, perimental Analysis of Behavior, 1968, 11, 1-8.
CHESLER, P. Maternal influence in learning by
the main point here is that observational observation in kittens. Science, 1969, 166, 901-
learning by observing only the model's 903.
transactions with discriminative cues is pos- COFER, C. N. Motivation. Annual Review of
sible, and this may well be the only basis Psychology, 1959, 10, 173-202.
of observational learning per se—apart from COFER, C. N., & APPLEY, M. H. Motivation:
Theory and research. New York: Wiley, 1964.
performance. COHEN-SALMON, C., & BLANCHETEAU, M. Trans-
port et consommation de la nourriture dans un
REFERENCES parcours experimental chez le rat blanc. L'-
Annee Psychologique, 1967, 67, 377-384.
APPLEY, M. H. Derived motives. Annual Re- DEFEUDIS, P. A. The role of sensory factors in
view of Psychology, 1970, 21, 48S-S18. the organization of instrumental response. Un-
BANDURA, A. Social learning through imitation. published master's thesis, McGill University,
In M. R. Jones (Ed.), Nebraska Symposium 1968.
on Motivation: 1962. Lincoln: University of BOLLARD, J., & MILLER, N. E. Personality and
Nebraska Press, 1962. psychotherapy. New York: McGraw-Hill,
BANDURA, A. Vicarious and self-reinforcement 1950.
processes. In R. Glaser (Ed.), The nature of ESTES, W. K. Discriminative conditioning. I. A
reinforcement. New York: Academic Press, discriminative property of conditioned anticipa-
1971. tion. Journal of Experimental Psychology, 1943,
BANDURA, A., & WALTERS, R. H. Social learning 32, 1SO-155.
and personality development. New York: Holt, ESTES, W. K. Stimulus-response theory of drive.
Rinehart, & Winston, 1963. In M. R. Jones (Ed.), Nebraska Symposium i;n
BERLYNE, D. E. Conflict, arousal, and curiosity. Motivation: 1958. Lincoln: University of Ne-
New York: McGraw-Hill, 1960. braska Press, 1958.
BINDRA, D. A neuropsychological interpretation ESTES, W. K. New perspectives on some old
of the effects of drive and incentive-motivation issues in association theory. In N. J. Mackin-
on general activity and instrumental behavior. tosh & W. K. Honig (Eds.), Fundamental is-
Psychological Review, 1968, 75, 1-22. sues in associative learning. Halifax, Nova
BINDRA, D. The interrelated mechanisms of re- Scotia: Dalhousie University Press, 1969. (a)
inforcement and motivation, and the nature of
their influence on response. In W. J. Arnold ESTES, W. K. Reinforcement in human learning.
& D. Levine (Eds.), Nebraska Symposium on In J. T. Tapp (Ed.), Reinforcement and be-
Motivation: 1969. Lincoln: University of Ne- havior. New York: Academic Press, 1969. (b)
braska Press, 1969. (a) ESTES, W. K. Learning theory and mental de-
BINDRA, D. A unified interpretation of emotion velopment. New York: Academic Press, 1970.
and motivation. Annals of the New York ESTES, W. K. Reinforcement in human behavior.
Academy of Sciences, 1969, 150, 1071-10S3. (b) American Scientist, 1972, 60, 723-729.
BINDRA, D. A unified account of classical con- ESTES, W. K., & SKINNER, B. F. Some quan-
ditioning and operant training. In A. H. Black titative properties of anxiety. Journal of Ex-
& W. F. Prokasy (Eds.), Classical conditioning perimental Psychology, 1941, 29, 390-400.
11: Current research and theory. New York: FLYNN, J, P. The neural basis of aggression
Appleton-Century-Crofts, 1972, in cats. In D. C. Glass (Ed.), N'europhysiology
BLACK, R. W. Incentive motivation and the pa- and emotion. New York: Rockefeller Univer-
rameters of reward in instrumental conditioning. sity Press, 1967.
212 DALBIR BINDRA

GALEF, B. G., JR. Social effects in the weaning MORGAN, C. T. Physiological psychology. New
of domestic rat pups. Journal of Comparative York: McGraw-Hill, 1943.
and Physiological Psychology, 1971, 75, 358- MORGAN, M. J. Resistance to satiation. Animal
362. Behaviour, in press.
GALEF, B. G., JR., & CLARK, M. M. Social fac- MOWRER, O. H. On the dual nature of learning
tors in the poison avoidance and feeding beha- —a re-interpretation of "conditioning" and
vior of wild and domesticated rat pups. Journal "problem-solving." Harvard Educational Re-
of Comparative and Physiological Psychology, view, 1947, 17, 102-148.
1971, 75, 341-3S7. MOWRER, O. H. Learning theory and personality
GAMZU, E., & SCHWARTZ, B. The maintenance dynamics. New York: Ronald, 1950.
of key pecking by stimulus-contingent and re- MOWREE, O. H. Learning theory and behavior.
sponse-independent food presentation. Journal New York: Wiley, 1960.
of the Experimental Analysis of Behavior, 1973, PAVLOV, I. P. Conditioned reflexes. (Trans, by
19, 65-72. G. V. Anrep) London: Oxford University Press,
GAMZU, E., & WILLIAMS, D. R. Associative fac- 1927.
tors underlying the pigeon's key pecking in PEEKE, S. C., & GRINGS, W. W. Magnitude of
auto-shaping procedures. Journal of the Ex- UCR as a function of variability in the CS-
perimental Analysis of Behavior, 1973, 19, 225- UCS relationship. Journal of Experimental
232. Psychology, 1968, 77, 64-69.
GRINGS, W. W. Preparatory set variables related PFAFF, D. W., & PFAFFMANN, C. Olfactory and
to classical conditioning of autonomic responses. hormonal influences on the basal forebrain of
Psychological Review, I960, 67, 243-252. the male rat. Brain Research, 1969, 15, 137-
GROESBECK, R. W., & DUERFELDT, P. H. Some 156.
relevant variables in observational learning of PFAFFMANN, C. Pleasures of sensation. Psycho-
the rat. Psychonomic Science, 1971, 22, 41-43. logical Review, 1960, 67, 253-268.
HONZIK, C. H. The sensory basis of maze learn- RESCORLA, R. A., & SOLOMON, R. L. Two-process
ing in rats. Comparative Psychological Mono- learning theory: Relationships between Pavlo-
graphs, 1936, 13 (Whole No. 64). vian conditioning and instrumental learning.
HULL, C. L. Principles of behavior. New York: Psychological Review, 1967, 74, 151-182.
Appleton-Century-Crofts, 1943. RICE, R. W. Incentive motivation and approach-
HULL, C. L. A behavior system. New Haven: avoidance tendencies. Unpublished master's
Yale University Press, 1952. thesis, McGill University, 1966.
KATXEV, R. Extinguishing avoidance responses RICHTER, C. P. Animal behavior and internal
as a function of delayed warning signal termi- drives. Quarterly Review of Biology, 1927, 3,
nation. Journal of Experimental Psychology, 307-342.
1967, 75, 339-344. SEWARD, J. P. Experimental evidence for the
KIMBLE, G. A. Hilgard and Marquis' condition- motivating function of reward. Psychological
ing and learning. New York: Appleton-Cen- Bulletin, 1951, 48, 130-148.
tury-Crofts, 1961. SEWARD, J. P. Drive, incentive, and reinforce-
KOHN, B., & DENNIS, M. Observation and dis- ment. Psychological Revieiv, 1956, 63, 195-203.
crimination learning in the rat: Specific and SHEFFIELD, F. D. A drive-induction theory of re-
nonspecific effects. Journal of Comparative and inforcement. In R. N. Haber (Ed.), Current
Physiological Psychology, 1972, 78, 292-296. research in motivation. New York: Holt, Rine-
KONORSKI, J. Integrative activity of the brain. hart, & Winston, 1966.
Chicago: University of Chicago Press, 1967. SKINNER, B. F. The behavior of organisms: An
LOGAN, F. A. Incentive. New Haven: Yale Uni- experimental analysis. New York: Appleton-
versity Press, 1960. Century-Crofts, 1938.
LOGAN, F. A. Fundamentals of learning and moti- SKINNER, B. F. "Superstition" in the pigeon.
vation. Dubuque, Iowa: Brown, 1969. Journal of Experimental Psychology, 1948, 38,
MILLER, N. E. Some reflections on the law of 168-172.
effect produce a new alternative to drive re- SKINNER, B. F. Science and human behavior.
duction. In M. R. Jones (Ed.), Nebraska Sym- New York : Macmillan, 1953.
posium on Motivation: 1963. Lincoln: Univer- SPEAR, N. E. Retention of reinforcer magnitude.
sity of Nebraska Press, 1963. Psychological Review, 1967, 74, 216-234.
MILLER, N. E., & BOLLARD, J. Social learning Si'ENCE, K. W. Behavior theory and conditioning.
and imitation. New Haven: Yale University New Haven: Yale University Press, 1956.
Press, 1941. STENCE, K. W. Behavior theory and learning.
MOORE, B. R. The role of directed Pavlovian Englewood Cliffs, N. J.: Prentice-Hall, 1960.
reactions in simple instrumental learning in the STADDON, J. E. R. Temporal control and the the-
pigeon. In R. A. Hinde & J. Stevcnson-Hinde ory of reinforcement schedules. In R. M. Gil-
(Eds.), Constraints on learning: Limitations bert and J. R. Millenson (Eds.), Reinforce-
and predispositions. New York: Academic ment: Behavioral analyses. New York: Aca-
Press, 1973. demic Press, 1972.
MOTIVATION AND LEARNING 213
STELLAR, E. The physiology of motivation. Psy- WALKER, E. L. Reinforcement—"The one ring."
chological Review, 1954, 61, 5-22. In J. T. Tapp (Ed.), Reinforcement and be-
STOLTZ, S. B., & LOTT, D. F. Establishment in havior. New York: Academic Press, 1969.
rats of a persistent response producing a net WILLIAMS, D. R., & WILLIAMS, H. Auto-main-
loss of reinforcement. Journal of Comparative tenance in the pigeon: Sustained pecking despite
and Physiological Psychology, 1964, 57, 147-149. contingent non-reinforcement. Journal of the
TAUB, E., & HERMAN, A. J. Movement and learn- Experimental Analysis of Behavior, 1969, 12,
ing in the absence of sensory feedback. In S. J. S11-520.
Freedman (Ed.), The neuropsychology of spa- WOODWORTH, R. S. Dynamic psychology. New
tially oriented behavior. Homewood, 111.: Dor- York: Columbia University Press, 1918.
sey Press, 1968. YOUNG, P. T. Appetite, palatability and feeding
THORNDIKE, E. L. Animal intelligence. New habit: A critical review. Psychological Bulletin,
York: Macmillan, 1911. 1948, 45, 289-320.
TOLMAN, E. C. Purposive behavior in animals ZENER, K. The significance of behavior accom-
and men. New York: Century, 1932. panying conditioned salivary secretion for the-
TROLAND, L. T. The principles of psychophysiol- ories of the conditioned response. American
ogy. Vol. 3. New York: Van Nostrand, 1932. Journal of Psychology, 1937, 50, 384-403.
UNGER, S. M. Habituation of the vasoconstric-
tive orienting reaction. Journal of Experimental (Received March 16, 1973 ; revision received
Psychology, 1964, 67, 11-18. November 5, 1973)

You might also like