You are on page 1of 22

JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2002, 78, 95–116 NUMBER 1 ( JULY)

FROM MOLECULAR TO MOLAR:


A PARADIGM SHIFT IN BEHAVIOR ANALYSIS
W ILLIAM M. B AUM
UNIVERSIT Y OF CALIFORNIA–DAVIS

A paradigm clash is occurring within behavior analysis. In the older paradigm, the molecular view,
behavior consists of momentary or discrete responses that constitute instances of classes. Variation
in response rate reflects variation in the strength or probability of the response class. The newer
paradigm, the molar view, sees behavior as composed of activities that take up varying amounts of
time. Whereas the molecular view takes response rate and choice to be ‘‘derived’’ measures and
hence abstractions, the molar view takes response rate and choice to be concrete temporally ex-
tended behavioral allocations and regards momentary ‘‘responses’’ as abstractions. Research findings
that point to variation in tempo, asymmetry in concurrent performance, and paradoxical resistance
to change are readily interpretable when seen in the light of reinforcement and stimulus control of
extended behavioral allocations or activities. Seen in the light of the ontological distinction between
classes and individuals, extended behavioral allocations, like species in evolutionary taxonomy, con-
stitute individuals, entities that change without changing their identity. Seeing allocations as individ-
uals implies that less extended activities constitute parts of larger wholes rather than instances of
classes. Both laboratory research and everyday behavior are explained plausibly in the light of con-
crete extended activities and their nesting. The molecular view, because it requires discrete responses
and contiguous events, relies on hypothetical stimuli and consequences to account for the same
phenomena. One may prefer the molar view on grounds of elegance, integrative power, and plau-
sibility.
Key words: resistance to change, individual, class, concrete/abstract, molar, molecular, atomism

No man is an Iland, intire of it selfe; every man er paradigm but is absent from the first. Nei-
is a peece of the Continent, a part of the maine; ther concept is wrong. Each makes sense
if a Clod bee washed away by the Sea, Europe within one paradigm but is nonsense in the
is the lesse . . . any mans death diminishes me, other. That is why, in contrast to theoretical
because I am involved in Mankinde; And there-
fore never send to know for whom the bell
disputes, paradigm clashes cannot be settled
tolls; It tolls for thee. by data. Any particular set of data may be
John Donne (1572–1631) meaningful to one paradigm and meaning-
less to another or may have different inter-
Every scientific paradigm includes both pretations according to different paradigms.
epistemological claims—claims about knowl- The interpretations will be ‘‘incommensu-
edge, such as what it is and how it is ob- rate’’—that is, each will make sense only with-
tained—and ontological claims—claims as to in its paradigm (Kuhn, 1970).
what we are to know about (Kuhn, 1970). In The purpose of this paper is to describe
paradigm clashes, ontological claims often and support a paradigm that has developed
matter most. In the Ptolemaic view of the uni- within behavior analysis over about the last 30
verse, the planets, like other heavenly bodies, years. I will call it the molar view, because mo-
revolve around the earth. Their irregular lar carries the connotation of aggregation or
movements in the sky were explained with extendedness, and the molar view is based on
the use of epicycles, circles within the circular the concept of aggregated and extended pat-
orbits around the earth. In the modern view, terns of behavior. Its roots may be traced back
the sun, moon, and planets constitute a solar to the 1960s, but it became clearly visible in
system. The concept of epicycle makes sense the 1970s (e.g., Baum, 1973; Rachlin, 1976),
in one paradigm but is absent from the other. and it was articulated explicitly in the 1980s
The concept of solar system exists in the oth- and 1990s (e.g., Baum, 1997; Chiesa, 1994;
Lee, 1983; Rachlin, 1994, 2000). Like the he-
I thank Michael Ghiselin and Howard Rachlin for help- liocentric view of the solar system, the molar
ful comments on an earlier draft of this paper.
Correspondence should be addressed to William M. behavior-analytic view clashes with an older
Baum, 1095 Market, #217, San Francisco, California paradigm (Baum, 2001; Dinsmoor, 2001;
94103 (e-mail: wmbaum@ucdavis.edu). Hineline, 2001), which I will call the molec-

95
96 WILLIAM M. BAUM

ular view, because it is based on an atomism any particular event might be described with
of discrete events at moments in time. I will great precision, the goal for defining a stim-
focus on the contrasting ontological claims ulus or response, as a class, was to specify the
made by the molar and molecular views, even class’s defining properties. The lever press,
though they also clash on epistemological for example, would consist of the class of acts,
grounds (e.g., the uses of cumulative records all of which achieved the necessary move-
vs. digital counters), because the ontological ment of the lever. The nondefining proper-
clash, though more fundamental, is less ob- ties could be ignored or could serve as the
vious. means for further differentiation. One would
know if one’s defining properties were cor-
THE MOLECULAR VIEW rect by the consistency of one’s results when
the class is so defined—that is, in ‘‘smooth
In the 19th century, many psychologists curves for secondary processes’’ (p. 366),
sought to put psychology on a sound scientif-
what he was later to call functional relations.
ic basis by focusing on the association of
In this way, Skinner made possible a science
ideas, sensations, and movements. These
units of consciousness were conceived of as of behavior—that is, behavior, as opposed to
discrete events that could be ‘‘hooked’’ to- physiology or consciousness.
gether or associated according to certain Skinner’s stimulus and response, however,
principles. Chief among these principles was were classes of discrete events, the same sort
the law of contiguity, which stated that two of events as the previous century’s ideas, sit-
events that occurred close together in time uated at moments in time and explained by
(i.e., in temporal contiguity) would tend to contiguity between events in time. A reflex
recur together. In particular, if the idea of for Skinner (1935/1961) was a correlation
food happened to follow closely upon the between two classes, meaning that when a
idea of a musical tone, then when the idea of member of the stimulus (as class) occurred,
the tone recurred, the idea of the food would it would be followed by a member of the re-
recur. This seemed a way to account for both sponse (as class). Conditional reflexes were
the stream of consciousness and for the build- created by the repeated contiguity of mem-
up of complex ideas from simpler ideas, as bers of the two classes. Later, he treated the
molecules are built up from atoms. law of effect in similar fashion: The response
Although the association of ideas became (as class) was strengthened by repeated con-
less popular in the 20th century, the original tiguity between its members and the mem-
atomism persisted in the concepts of stimulus bers of the reinforcer (as stimulus class).
and response. A stimulus was a discrete event Skinner (1938) equated response strength
in the environment, and a response was a dis- to probability. He proposed to measure prob-
crete event in behavior. The principle of as- ability as response rate. He saw response rate
sociation by contiguity persisted in the con- as an expression of response probability or
cept of the conditional reflex. strength, often writing as if this were the true
In a classic paper, ‘‘The Generic Nature of dependent variable (Skinner, 1938, 1950,
the Concepts of Stimulus and Response,’’
1953/1961, 1957/1961). Response rate
Skinner (1935/1961) attempted to create def-
would be the outcome of probability acting
initions of stimulus and response that would
serve as the basis for a science of behavior. moment to moment, as if at every moment a
One can hardly overstate the importance of probability gate determined whether a re-
this paper to the development of behavior sponse would occur just then or not. Changes
analysis. Skinner proposed a solution to the in response rate were an outcome of changes
problem of particularity that plagues behav- in response strength, possibly acting locally,
ior analysis as it does any science: If each as in the fixed-interval scallop (Ferster &
event (stimulus or response) is unique, how Skinner, 1957). Stimulus control occurred as
does one achieve the reproducibility required a result of modulating response strength, as
for scientific study? His answer was that a if in the presence of a discriminative stimulus
stimulus or a response was not a unitary event the probability gate became more or less lib-
but was a class of unitary events. Although eral in its moment-to-moment decisions.
MOLECULAR TO MOLAR 97

A MOLAR VIEW lowed a scientific approach to the subject


In 1969, Baum and Rachlin proposed a dif- matter. The concept of discrete response al-
ferent view of response rate. We drew on T. lowed quantification. Skinner’s (1938) prep-
F. Gilbert’s (1958) suggestion that responses aration, based as it was on the reflex, en-
like lever presses and key pecks might occur couraged researchers to think of the response
in bouts at a constant rate, which he called as momentary, as an event without duration.
the tempo of responding. Variation in re- Skinner even set out one of his requirements
sponse rate, in this molar view, would result for a response to study that it should be brief
from variation in the duration of bouts and and easily repeated, because these properties
the pauses between bouts (e.g., Shull, Gay- would allow rate to vary over a wide range. A
nor, & Grimes, 2001). The time spent re- concept like the delay-of-reinforcement gra-
sponding (T) at the tempo (k) would deter- dient depends on the idea that the response
mine the number of responses (N): N 5 kT. occurs at a certain point in time from which
If S is the duration of the sample (usually the delay is measured. The concept of contiguity
session duration), then response rate (B) is itself depends on the idea that two discrete
given by events (e.g., response and reinforcer) mark
the beginning and end of such a delay, the
kT duration of which, for perfect contiguity,
B5 . (1)
S should be zero.
The notion of activity takes for granted the
We suggested that behavior might be thought possibility of quantification, extending it be-
of as divided among activities that lasted for yond discrete responses and contiguity. The
periods of time (i.e., bouts). Taking time as key difference lies in the recognition that ac-
the universal scale of behavior, we proposed tivities take up time. In an earlier paper, I
that the dependent variable be thought of as argued that the reinforcement relation might
time spent responding (T 5 N/k) or propor- be thought of as a correlation (Baum, 1973).
tion of time spent responding: In the molar view, an activity like lever press-
T N ing, extending in time, is seen as accompanied
5 . (2) by the reinforcers it produces. Many reinforc-
S kS
ers may be involved, and consequences, be-
Accordingly, we wrote of choice as time allo- ing extended like activities, often consist of
cation, the allocation of time among contin- changes in reinforcer rate or changes in re-
uous activities, and we characterized the inforcer magnitude. The idea that reinforcers
matching law as a matching of relative time accompany an activity might be misinterpret-
spent in an activity to relative reinforcement ed to mean that delay is irrelevant, a claim
obtained from that activity. The idea was ex- that apparently would be easy to refute by ex-
tended to other changes in responding, such perimentation. As in other paradigm clashes,
as behavioral contrast (White, 1978). however, in the molecular–molar clash the
The elaboration of this idea is the para- phenomena observed are simply seen in dif-
digm that I am calling the molar view of be- ferent terms. A procedure that arranges food
havior. Whereas the central ontological claim delivery to immediately follow depressions of
of the molecular view is that behavior consists a lever arranges a strong correlation between
of discrete responses, the central ontological lever pressing and rate of food delivery. A
claim of the molar view is that behavior con- procedure that arranges food deliveries to
sists of temporally extended patterns of ac- follow responses at some delay arranges a
tion. I shall call these activities. Besides the lesser correlation, because the food deliveries
concept of an activity, the molar view is based may fail to accompany the activity. To effect
also on the concept of nesting, the idea that changes in behavior, strong correlations work
every activity (e.g., playing baseball) is com- best; to maintain activities already occurring
posed of parts (batting) that are themselves frequently, weak correlations may suffice
activities. I shall focus first on activities and (Baum, 1973).
discuss nesting later. The point might seem trivial, until we turn
Historically, the notion of reproducible dis- to other types of activity. Had Skinner chosen
crete events, whether ideas or responses, al- to study wheel running instead of lever press-
98 WILLIAM M. BAUM

ing, his situation would have been different. (Baum, 1997). I shall recapitulate briefly.
Experimenters often measure wheel running Suppose I show you a snapshot of a rat with
in revolutions or quarter-revolutions, but its paw on a lever, and I ask you, ‘‘Is the rat
these are artifices aimed at creating discrete pressing the lever?’’ You will have to reply, ‘‘I
responses where none are apparent. Premack don’t know. I have to see what comes next.’’
(1965, 1971) instead proposed time as the You won’t know until you see the whole (ex-
measure. If we turn this reasoning onto activ- tended) lever press. In other words, you
ities like lever pressing, we see that discrete would never be able to tell from a momentary
responses like lever presses are an outcome picture of the behavior what behavior was oc-
of instrumentation. ‘‘Responses’’ are momen- curring at that moment. Only after the whole
tary events (usually switch closures) contrived pattern unfolded would you be able to look
by the apparatus (e.g., lever or key). Their back and infer that at that moment the rat
momentary character is only an artifact of the was pressing the lever. The momentary re-
use of electrical switches. As a thermometer, sponse is never observable at the moment. It
whether stuck into a bowl of ice cream or a is always inferred afterwards. Like instanta-
pile of cow manure, indicates only the tem- neous velocity in physics, instantaneous be-
perature, regardless of the stuff it is stuck havior cannot be measured at the moment it
into, so a lever, when stuck into the activity is supposed to have occurred but must be in-
of a rat, indicates only rate of switch closure, ferred from a more extended pattern. That
regardless of what sort of activity it is stuck is why it might fairly be called an abstraction.
into. That is why one may argue that it is impossi-
When I was a graduate student, laboratory ble to reinforce a momentary response; one
practice dictated that one attach a lever or can only reinforce some activity with some
key to a pulse former, a device that would duration.
generate a uniform pulse on each operation The second argument is that reinforce-
of the lever or key. Laboratory lore claimed ment consists of selection. Possibly Ashby
this was essential to keep the subjects from (1954) was the first to recognize the parallel
holding the switch. I tested this claim by omit- between reinforcement and natural selection.
ting the pulse formers in an experiment on Campbell (1956) spelled out the idea that re-
concurrent schedules (Baum, 1976). I mea- inforcement is a type of selection, and R. M.
sured both number of lever presses (switch Gilbert (1970) and Staddon and Simmelhag
operations) and time that the lever was de- (1971) elaborated it further. Skinner (1981)
pressed. The measures turned out to be himself proposed it eventually. The essential
equivalent, because the activity continued to point is that behavior varies as do genotypes
result in jiggling of the lever, producing many within a population of organisms. As differ-
switch operations. Even though the duration ential reproductive success increases some ge-
of the operations varied, the average was con- notypes while decreasing others, so differen-
sistent enough that time and number of tial reinforcement increases some behavioral
presses could be interchanged, as in Equation variants while decreasing others. This paral-
2. Just as a rat’s jiggling of a lever operates it lel, however, requires competition among var-
at certain points in the jiggling, a pecking key iants, in the sense that the increase of one
operates only at a certain point in the move- variant necessitates the decrease of others.
ment of a pigeon’s head. When Pear (1985) With genotypes, this occurs because the size
arranged a system for keeping continuous of the population tends to remain constant at
track of the position of a pigeon’s head, key the carrying capacity of the environment
pecking appeared as cyclic motion, a wave (i.e., the number of organisms that the re-
form. sources of the environment can maintain).
Two simple arguments might persuade one For behavior, the competition requires that
to think about behavior in terms of activities the total of behavior in any period of time
rather than discrete responses: (a) Momen- should, like the carrying capacity, remain
tary events are abstractions and (b) reinforce- constant. In other words, it requires that be-
ment operates by selection. The first, that mo- havior take up time, and presumably that all
mentary events cannot be observed, but only the behavior that occurs in a time period take
inferred, was argued in an earlier paper up all the time. Just as the limit to a biological
MOLECULAR TO MOLAR 99

population necessitates that if longer necked unique. Therefore, in the molecular view,
giraffes increase in frequency then shorter strength attaches to the class and is inferred
necked giraffes must decrease in frequency, from the number of members of the class
so the temporal limit to behavior necessitates that occur in any given time period (i.e., from
that if pecks at the left key increase in fre- the calculated rate). A rat may press a lever
quency then pecks at the right key must de- 30 times per minute or twice per minute. I
crease in frequency. At the least, the idea that may drive to work seven times per week or
reinforcement is a kind of selection requires once per week. A reinforcer may follow each
that discrete responses must have duration. occurrence of a discrete unit, but only some
Add to that the possibility that the so-called occurrences need be followed by reinforcers
responses may vary in duration, and you have for the rate of occurrence of members of the
granted that behavior consists of activities. class to be maintained—that is, reinforce-
The so-called response becomes indistin- ment may be intermittent. The more often
guishable from a bout of an activity. members of the class are reinforced, the
Someone wedded to the molecular view greater the strength of the class.
might reply in a number of different ways. In contrast, the guiding metaphor of the
One might reject the analogy to natural se- molar view is allocation. If the molecular view
lection altogether and stick with momentary likens behavior to picking numbers out of a
responses. One might insist that in any time hat, the molar view likens behavior to cutting
period greater and lesser amounts of behav- up a pie. Choice is time allocation (Baum &
ior may occur. The molarist might reply that Rachlin, 1969). All behavior entails choice.
sacrificing the elegance of selection is a high All behavior entails time allocation. To be-
cost to pay for the sake of keeping to mo- have is to allocate time among a set of activ-
mentary responses. ities. Such an allocation is a behavioral pat-
tern. If a pigeon spends 60% of its time
pecking at one response key, 30% of its time
STRENGTH VERSUS pecking at another, and 10% of its time in
ALLOCATION other, unmeasured activities, that is the pat-
The difference between the molar and mo- tern of its behavior while in the experiment.
lecular views may be seen in their different If a person spends 47% of his or her recrea-
guiding metaphors. Whereas the molecular tional time watching television, 40% reading,
view relies on the idea of strength, the molar 10% walking, and 3% going to movies, that
view relies on the idea of allocation. These is a pattern of recreational behavior. Such
different ideas depend on the different on- patterns or allocations are necessarily extend-
tological claims of the two paradigms. ed in time.
In the molecular view, reinforcers strength- Because every activity itself is composed of
en behavior. They do this by following im- other activities—that is, because every activity
mediately upon or soon after a bit of behav- is a whole constituted of parts—every activity
ior, a response. The underlying assumption of itself contains an allocation of behavior. In
a central role for contiguity in time entails this sense we may say that every activity is a
the ontological claims of the molecular view, behavioral allocation. The pigeon’s allocation
because contiguity exists at or around a cer- in the experiment may be called its experi-
tain moment in time. For two events to be mental activity, and the allocation of recrea-
contiguous, to occur close to the same mo- tional time may be called the person’s recre-
ment, they must either be momentary or ational activity. We shall discuss this further
have distinct beginnings and ends. For a re- when we take up the concept of nesting.
sponse to be followed immediately by a re- In the molar view, the appearance that be-
inforcer, the response and the reinforcer havior might be composed of discrete units
must be discrete events. Thus, the contiguity- arises because activities often occur in epi-
based notion of reinforcement espoused by sodes or bouts. Task completion provides
the molecular view entails the ontological many examples: completion of a fixed-ratio
claim that behavior consists of discrete events. run, of a house, of writing a paper, of reading
Strength cannot attach to a single instance a book. In the laboratory, the training of re-
of a discrete unit, because each of those is sponse chains originated to try to model such
100 WILLIAM M. BAUM

extended units. In the molecular view, the se- before, many activities lack any natural unit.
quence is thought to terminate at least some What is the discrete unit of watching televi-
of the time with a reinforcer and to be held sion, reading, sleeping, or driving a car? Ap-
together with conditional reinforcers along plied behavior analysts recognize this when
the way to ultimate reinforcement. In the mo- they set goals such as increasing time on task.
lar view, an activity like building a house en- Even in the laboratory, activities like wheel
tails a pattern of activities such as pouring the running and lever holding lack any nonarbi-
foundation, framing the structure, insulating, trary unit. Such activities, for which the mo-
putting in windows and doors, and finishing lecular view must invent ‘‘responses,’’ readily
the interior. House construction seems like a lend themselves to the idea of allocation.
unit only because it is labeled as such, as one
may call an episode of napping a nap or a
bout of walking a walk. To a building con- THREE EXAMPLES OF
tractor, construction of one house would MOLAR EXPLANATION
seem more like an episode of building than Although the conflict between two para-
a discrete unit. Against the molecular view, digms cannot be resolved by data, the power
one might argue that behavioral chains some- of a paradigm may be seen in its ability to
times bear little resemblance to extended be- interpret various phenomena of the labora-
havior in the real world. Is it plausible to treat tory. Three examples of the power of the mo-
obtaining a bachelor’s degree as a behavioral lar view appear in its ability to treat (a) vari-
chain? Except for repetitive sequences like ation in tempo, (b) asymmetrical concurrent
those of the assembly line, real-life sequences performances, and (c) resistance to change.
like building a house or baking a cake rarely
follow a rigid order. Even the fixed-order Variation in Tempo
chain of the laboratory (e.g., chain fixed in- Herrnstein’s (1970, 1974) formulation of
terval fixed ratio) may be seen as a sequence the matching law relied on response rate. He
of activities (fixed-interval activity, then fixed- expressed it in the form
ratio activity), and if some activities are main-
B1 r1
tained better than others, that is a matter to 5
OB Or
n n , (3)
be studied. Completion of any task may be
i i
seen as an episode of an activity. Even activi- i 51 i 51
ties that usually end in a certain way, such as
search, last for varied durations; sooner or lat- which states that the relative response rate of
er the forager encounters prey, sooner or lat- any of n alternative responses matches the
er one finds a parking space. relative reinforcement obtained from those n
In particular, the molar view holds that the alternative responses. Herrnstein (1970) fur-
so-called response is an episode of an activity. ther supposed that the sum total of behavior
Grant that pecks and presses take up time (the denominator on the left side of Equa-
and that the time taken up by each cycle of tion 3) was a constant. On this assumption,
activity—of body motion back and forth or up Equation 3 is rewritten as
and down—takes up about the same amount r1
of time (Baum, 1976; Pear, 1985), and then B1 5 k , (4)
r1 1 rO
Equation 2 illustrates how switch operations
(N ) are convertible to time and how that where rO represents all reinforcement ob-
time may be considered relative to the total tained from alternatives other than Alterna-
(T ). In other words, rate of pecking or press- tive 1, and k represents the sum total of be-
ing is equivalent to an allocation—relative havior expressed in the response units of B1.
time spent pecking or pressing. Even if count- In keeping with the notion of time alloca-
ing responses is convenient, from the molar tion that Baum and Rachlin (1969) put for-
viewpoint a response rate is a relative time in ward, however, the constant k in Equation 4
the activity. may be reinterpreted as the tempo of the ac-
In the molar view, discrete behavioral units tivity defining B1. It equals the response rate
are not only illusory but often are simply im- that would occur if all behavior were allocat-
possible. As Baum and Rachlin (1969) argued ed to Alternative 1—that is, the response rate
MOLECULAR TO MOLAR 101

if all the time were spent in Activity 1, some- Aparicio, 1999; Herrnstein & Heyman, 1979).
times called the asymptotic response rate. If the tempo on the VR alternative were high-
Substituting Equation 1 into Equation 4 al- er, the same amount of time spent at that al-
lows one to rewrite Equation 4 to have pro- ternative would result in more responses
portion of time spent in Activity 1 matching counted (i.e., more switch operations) there
proportion of reinforcement obtained from than if that time were spent at the VI alter-
Activity 1. native. Relative ‘‘responses’’ would deviate
One seeming challenge to Equation 4 from matching.
arose from research by McDowell and asso- The generalized matching law has been
ciates (e.g., Dallery, McDowell, & Lancaster, used to estimate such deviations from match-
2000) that cast doubt on Herrnstein’s as- ing:
sumption of constancy of k. They found that s

12
several operations, such as varying depriva- B1 r
5b 1 , (6)
tion or reinforcer magnitude, result in differ- B2 r2
ent values of k when the response (of B1) re-
mains ostensibly the same. McDowell offered where b is a proportionate bias that is inde-
equations that predicted variation in asymp- pendent of the rates of reinforcement, r1 and
totic response rate, but at the cost of assum- r2, and s is the sensitivity to variation in the
ing discrete responses of invariant duration ratio of reinforcement. If b and s both equal
(e.g., McDowell, 1987). How might one ex- 1.0, the strict matching of Equation 5 occurs.
plain variation in k while retaining the molar When deviations from strict matching occur,
view? they are usually estimated as values of b and
One may interpret McDowell’s findings as s different from 1.0. If the tempos of B1 and
showing that the operations that vary k affect B2 differed, one would expect a value of b
the tempo of responding, perhaps by affect- different from 1.0, favoring the VR (e.g.,
ing response topography. If k increases with Baum & Aparicio, 1999; Herrnstein & Hey-
increasing magnitude of reinforcement, that man, 1979).
might be because the increased magnitude A stronger challenge to the matching law
results in more vigorous responding, which arises from the observation that a difference
results in less time per response. The higher in topography or tempo may affect s (Baum,
tempo of the activity would result in more Schwendiman, & Bell, 1999). Equation 6 is
switch closures counted in the same amount usually fitted to behavior and reinforcer ra-
of time. Thus the observation of varying k is tios in its logarithmic form,
readily accommodated by the molar view. B1 r
log 5 s log 1 1 log b, (7)
Asymmetrical Concurrent Performances B2 r2
Another challenge to the matching law is because this form is symmetrical around the
the observation that behavior at two choice indifference point (behavior and reinforcer
alternatives may differ qualitatively. The two- ratios both equal to 1.0) and because, being
alternative version, expressed as linear, it is easier to fit. The equation is fitted
B1 r to behavior ratios determined for several re-
5 1, (5) inforcer ratios to both sides of equality (i.e.,
B2 r2 sometimes making Alternative 1 richer, some-
may be thought of as derived by taking the times making Alternative 2 richer) on the as-
ratio of Equation 3 to the similar equation sumption that parameters s and b remain in-
written for Alternative 2. Such a derivation dependent of variation in the reinforcer
would be justified only if k were equal for the ratio. Baum et al. found that when pigeons
two alternatives. Suppose that the topography were exposed to pairs of concurrent VI sched-
of the two responses differed, resulting in a ules long enough for performance to remain
difference in tempo (k). For example, sup- stable over a substantial sample, the behavior
pose that one alternative was reinforced ac- ratios deviated systematically from Equation
cording to a variable-interval (VI) schedule 7. On closer examination, a simple pattern of
and the other was reinforced according to a behavior appeared: Responding occurred al-
variable-ratio (VR) schedule (e.g., Baum & most exclusively on the rich alternative, in-
102 WILLIAM M. BAUM

Fig. 1. Apparent deviations from matching explained by the fix-and-sample pattern. Left: The top graph shows
apparent undermatching. Close examination reveals systematic deviation from the fitted line (the generalized match-
ing law). The bottom graph shows the same data fitted with the two lines predicted by fix and sample. Right: an
instance of apparent overmatching, with systematic deviation from the generalized matching law. The bottom graph
shows the data fitted with the two lines predicted by fix and sample, eliminating the systematic deviation.

terrupted only by brief visits to the lean al- 973, fitted with one line (top) and with two
ternative. This pattern, which we called ‘‘fix lines (bottom). A casual look at the top graph
and sample,’’ predicted two lines, each with would lead one to conclude that the results
slope s equal to 1.0 but with different bias b, were typical of such experiments: a good fit
depending on whether Alternative 1 or Alter- to Equation 7 with a moderate amount of un-
native 2 was the lean alternative (Houston & dermatching (s 5 0.8). Closer inspection re-
McNamara, 1981). We found that the two-line veals that, going from left to right, the data
model, with the same number of parameters points first lie above the line, then below the
as the one-line model, fitted the data better line, then above again, and then below again.
and with no systematic deviations. Not only is the two-line fit better, but also the
Figure 1 illustrates the finding. The two left variation in choice appears to conform close-
graphs show the behavior ratios from Pigeon ly to the assumed slopes of 1.0. Indeed, the
MOLECULAR TO MOLAR 103

undermatching shown in the top graph is ex- native. In other words, if the subscripts in
plained by the inappropriate fitting of one Equation 7 were reinterpreted to mean rich
line to data better described by two. and lean, rather than left and right, then the
The two right graphs in Figure 1 demon- bias would differ from 1.0 only because the
strate a similar explanation for an example of time per peck differed, just as the earlier dis-
apparent overmatching. They show behavior cussion suggested for concurrent VI VR
ratios from Pigeon 490 in the Baum–Rachlin schedules.
(1969) experiment, fitted with one line and In the overmatching example, Baum and
with two. Again the two-line fit (bottom) Rachlin (1969) measured only time spent on
shows less systematic deviation, again the two sides of a chamber; there were no re-
slopes of 1.0 seem appropriate, and again the sponse keys. We observed informally that the
apparent deviation of slope s from 1.0 may be pigeons would station themselves near the
explained as the result of inappropriate fit- middle of the chamber and move rapidly
ting of one line to data better described by back and forth. Whereas behavior on the rich
two. side consisted of standing or dancing, a visit
Although the two-line fits in Figure 1 both to the lean side consisted of stepping over
show biases that explain the deviations of s there, waiting out the signaled changeover
from 1.0, these biases differ from the bias b delay (COD), and then either running to the
in Equations 6 and 7. Whereas the usual bias feeder on the lean side or immediately hop-
is assumed to be independent of reinforcer ping back again to the rich side. Under such
ratio, the biases in the two-line model depend circumstances, the visits to the lean side con-
on the reinforcer ratio, because they depend stituted brief episodes of an activity (i.e., sam-
on which is the leaner alternative. In the un- pling) different from that at the rich side (fix-
dermatching example, the bias favored ing). One need only assume that our
whichever was the lean alternative. In the procedure underestimated the time spent per
overmatching example, the bias favored visit to the lean side to explain the apparent
whichever was the rich alternative. The over-
biases in the lower right graph in Figure 1.
matching example shows standard position
In particular, we excluded time spent during
bias too; that is why the vertical crossover oc-
the COD from our calculations, on the
curs at a reinforcer ratio less than 1.0.
ground that it was signaled timeout from the
The results shown in Figure 1 support the
experiment. Had we included that time, we
idea that behavior at the rich alternative and
behavior at the lean alternative constitute dif- would have had to decide how to allocate it
ferent activities that, in turn, comprise parts between the two sides. Owing to premature
of a more extended pattern (i.e., the fix-and- changeovers to the lean side, most of the
sample activity) involving both alternatives. changeover time was probably spent on the
Behavior at the rich alternative consists of lean side. Limitations of our electromechan-
staying there—fixing—whereas behavior at ical equipment prevented us from solving this
the lean alternative consists of brief visiting— problem.
sampling. In the undermatching example, The important point made by Figure 1,
the pigeons pecked at two keys, but visits to however, is that such instances of under-
the lean key nearly always consisted of single matching and overmatching may be readily
isolated pecks. To explain the apparent bias explained by adopting the molar view, be-
in favor of the lean alternative, one need only cause it allows choice between the rich and
assume that less time was spent per peck at lean alternatives to be seen as time allocation
that key. For example, a pigeon stationed in between two different activities. The molec-
front of the rich key would ‘‘travel’’ to the ular view presumably would explain Figure 1
lean key by stretching its neck toward the key, as the aggregation of many discrete responses
and in that position, make a brief exploratory made at the two alternatives, combined with
peck. Measured as time spent, a number of assumptions about the reinforcement of
pecks at the lean key would represent less switching and delay gradients. A molarist
time than the same number of pecks at the might judge the account logically correct, but
rich key, and counting them equally would would regard it as implausible and inelegant,
overestimate the time spent at the lean alter- illustrating once again that a paradigm clash
104 WILLIAM M. BAUM

is resolved by such considerations rather than One may question whether the notions of in-
by data (Kuhn, 1970). termittent and continuous reinforcement
have any meaning in relation to extended ac-
Activities, Stimulus Control, and tivities. In the molar view, reinforcers coin-
Resistance to Change cide with various parts of the activity in vari-
A seeming challenge for the molar view ous forms. What matters is the aggregate of
comes from research and theory about be- consequences that the activity (allocation)
havioral momentum, a recent reexpression of produces relative to other activities (alloca-
the notion of response strength (Nevin, 1974, tions) over time. In the simplified environ-
1992; Nevin & Grace, 2000). The experi- ment of the laboratory, concurrent schedules
ments show that persistence of responding arrange that a pattern of choice (an alloca-
(resistance to change) depends on prior rate tion) produces a rate of reinforcement
of reinforcement. The molar interpretation (Baum, 1981). As with choice patterns of self-
of the results, which eschews response control, in which impulsive behavior is im-
strength, stems from a molar view of rein- mediately reinforced and self-control pays off
forcement and stimulus control. better only in the long run, even though the
In an earlier paper (Baum, 1973), I argued more extended choice pattern would pro-
that, just as behavior is extended, so too are duce more reinforcers in the long run, local
consequences extended. As response rate is reinforcement contingencies may prevent the
real (i.e., to be known about), so rate of re- choice pattern (allocation) from evolving to-
inforcement and rate of punishment are real. ward the maximum possible (Rachlin, 1995,
The molar analogue to contiguity is correla- 2000; Vaughan & Miller, 1984). An experi-
tion—that is, correlation between extended ment by Heyman and Tanz (1995), however,
activities and extended consequences. If I for- showed that providing signals allowed chang-
get to add baking powder when I’m making es in reinforcer rate to reinforce changes in
a cake, the result is disappointing, but my choice pattern (allocation). They arranged
cake baking generally pays off well and is that when pigeons’ choice over a sample of
maintained by its high rate of mainly good responses deviated toward a more extreme al-
consequences. In the molar view, reinforce- location than would be expected from the
ment is like starting and stoking a fire. Spe- matching law (Equation 5), relative reinforce-
cial materials and care get the fire going, and ment would remain unchanged, but that the
throwing on fuel every now and then keeps overall reinforcer rate would increase and a
the fire going. light would come on. They found that devi-
McDowell’s experiments on variation in k ations from matching were reinforced by the
(e.g., Dallery et al., 2000) and experiments changes in overall reinforcer rate.
on asymmetrical concurrent performances The molar concept of reinforcement also
support the idea that behavior consists of ex- implies a molar concept of stimulus control.
tended allocations or activities. Reinforce- In the experiment by Heyman and Tanz
ment and punishment may change the time (1995), the light signaled a relation between
spent in an activity (i.e., allocation), but also an extended pattern (an allocation) and an
may change the allocation among the parts increase in reinforcer rate. In the molecular
and even the parts themselves. This latter view, a discriminative stimulus signals that
kind might be called change in topography, some responses may be intermittently rein-
referring roughly to the way an activity is forced, and its presence increases the proba-
done. Whatever the change, the molar view bility of the response. In the molar view, a
attributes it to differential extended conse- discriminative stimulus signals more frequent
quences. reinforcement of one activity or allocation
Once we move away from the atomism of than another, and its presence increases the
discrete responses, we should expect that the time spent in that activity. Reinforcers that oc-
way we talk about reinforcement and stimulus cur in the presence of the stimulus plus the
control will change too, even if only in subtle presence of the activity or allocation increase
ways. In the molecular view, for example, the control of the stimulus over that activity
‘‘continuous’’ reinforcement is often con- or allocation.
trasted with ‘‘intermittent’’ reinforcement. In the molar view, a response rate, whether
MOLECULAR TO MOLAR 105

measured in experiments in which the activ- ward explanations. Pigeons were exposed, as
ities consist of repetitive motions like key usual, to a multiple schedule, one in which
pecks or lever presses (e.g., White, 1985) or the same VI schedule occurred in both com-
used to measure general activity (Buzzard & ponents. In one component, however, it was
Hake, 1984), is equivalent to an allocation, a the only schedule present, whereas in the
pattern of behavior, an activity. We have seen other component, a second schedule rein-
that experiments on variation in k and asym- forcing pecks on a second key (Experiment
metrical concurrent performances may be in- 2) or delivering food independently of be-
terpreted as changes in response rate result- havior (Experiment 1) was paired with the
ing from changes in extended patterns of constant schedule. Although the overall rate
responding. Heyman and Tanz’s (1995) ex- of reinforcement was lower in the single-VI
periment embodies the molar idea of stimu- component, the response rate there was high-
lus control, in which control over extended er than the response rate on the same key in
patterns of responding entails control over the component with the concurrent VI (as
response rate and choice. If extended pat- would be expected; Rachlin & Baum, 1972).
terns of behavior (activities or allocations) The crucial result was that, comparing the re-
may be reinforced and controlled by discrim- sponse rates on the constant-schedule key
inative stimuli, then we should expect that re- during extinction, the lower response rate de-
sponse rates are both reinforceable and sub- creased more slowly than the higher response
ject to stimulus control. rate.
We may apply these expanded notions of Nevin (1992) interpreted this result and
reinforcement and stimulus control to exper- the earlier experiments to mean that rein-
iments on behavioral momentum and resis- forcement builds behavioral momentum: The
tance to change (Nevin, 1974, 1992; Nevin & more reinforcement, the more momentum;
Grace, 2000). In a typical experiment, pi- the more momentum, the less the response
geons are exposed to a multiple schedule is susceptible to disruption. To maintain this
composed of two components, each consist- theory, however, he had to distinguish be-
ing of a VI schedule of food reinforcement tween what he called operant and respondent
for pecking at a response key. One VI is rich- aspects of the components. The difficulty was
er than the other and thus maintains a higher that pecks at the constant-VI key were rein-
rate of key pecking. Once the two rates of key forced at the same rate in both components;
pecking have stabilized, a variety of different the extra reinforcers that made the differ-
operations may be used to disrupt the re- ence in resistance to change were associated
sponding; the usual ones are prefeeding, with the second key or some other behavior,
food presentations during timeout periods and how reinforcement of other behavior
between components, and extinction. The could increase a response’s momentum was
typical result is that response rate decreases unclear. Nevin concluded that, because the
in both components, but by a larger propor- overall reinforcer rate was higher in the two-
tion in the component with fewer reinforcers. VI component, the momentum of all behav-
For prefeeding and food presentations be- ior in a component must depend on all the
tween components, the decreases in response reinforcers in that component. The associa-
rate might be interpreted as the result of a tion of reinforcers for other behavior with the
decrease in magnitude of programmed (VI) component’s stimulus constituted a respon-
reinforcement relative to background rein- dent or Pavlovian aspect to determining mo-
forcement. In terms of Equation 4, these op- mentum.
erations would decrease rate of pecking by The ideas of reinforcement and stimulus
increasing rO. How Equation 4 might account control of extended patterns of behavior (al-
for the difference in rate of extinction is less locations) open the way to a different inter-
clear, but one might suppose that higher pretation of experiments on resistance to
rates of key pecking, once established, tend change. In a multiple schedule, we may sup-
to persist longer in the absence of reinforce- pose that if the contingencies of reinforce-
ment. Nevin, Tota, Torquato, and Shull ment differ from component to component,
(1990) reported an experiment, however, they will generate different allocations of be-
that undermined such seemingly straightfor- havior in the presence of the different dis-
106 WILLIAM M. BAUM

criminative stimuli. All the reinforcers in a IDEAL RESPONSE CLASSES


component serve to reinforce the allocation VERSUS CONCRETE
occurring there, and the stimulus enjoins BEHAVIORAL PATTERNS
that allocation. The more reinforcement, the
more the stimulus enjoins the allocation. In The concept of behavioral momentum,
a multiple schedule with two different VI like the concept of response strength, flows
schedules in two components, the higher re- from the molecular, atomistic view of behav-
inforcer rate will be associated with the allo- ior. Momentum, like strength, is considered
cation that generates (i.e., is equivalent to) the possession of a class, the members of
the higher response rate, stimulus control which are momentary responses. Skinner’s
will be stronger over that allocation, and that (1935/1961, 1938) operant, for example, was
stimulus will sustain that allocation longer as a class with discrete responses as members,
it disintegrates (i.e., transforms into some and when its strength was high its members
other allocation including little or no peck- occurred at a high rate. His ill-fated idea of
ing) during extinction. As the experiments the reflex reserve depended on just such a
show, the higher rate allocation will take lon- notion of strength, and Nevin’s notion of mo-
ger to disintegrate than the lower rate allo- mentum—the contemporary equivalent of
cation. In Nevin et al.’s (1990) crucial exper- the reflex reserve—similarly depends for its
iment, different allocations occur in the definition on the idea of response class. In
one-VI component and in the two-VI com- the molecular view, one supposedly specifies
ponent. The allocation in the one-VI com- the ideal properties required for membership
ponent entails a higher response rate on the in the class (e.g., a certain force, a certain
constant-VI key, but that allocation is less re- extent, etc.). Any lever press or key peck that
inforced. The allocation in the two-VI com- possesses the ideal properties may be record-
ponent entails responding on both keys and ed. To estimate response rate, one counts a
is more reinforced. Because stimulus control number of instances and divides by the time
is stronger over the two-VI allocation, that interval during which they were counted. An
one disintegrates more slowly during extinc- increase or decrease in response rate reflects
tion. Hence the response rate on the con- an increase or decrease in strength or mo-
stant-VI key falls more slowly in the two-VI mentum of the class. The more the members
component. of the class are reinforced, the more is the
Although this explanation of variation in class’s strength. That response rates on inter-
resistance to change bears some similarity to val schedules fall short of those on ratio
Nevin’s explanation, it has advantages. First, schedules, for example, is explained by the
it is arguably simpler. It requires no appeal to differential reinforcement of long inter-
separate operant and respondent aspects, be- response times (IRTs) in interval schedules,
cause it invokes only the idea that stimulus the IRT being considered another property
control depends on rate of reinforcement. of the response or instance (Ferster & Skin-
Second, it requires only an expansion of the ner, 1957; Morse, 1966). Reinforcement then
concepts of stimulus control and reinforce- selectively strengthens different response
ment to apply to extended patterns of behav- classes. The high rates on ratio schedules are
ior, instead of the introduction of new con- attributed to the absence of differential re-
cepts, such as behavioral momentum and inforcement of IRTs. In this view, response
mass (Nevin & Grace, 2000). These concepts, rate always remains an abstraction, because
borrowed by analogy from Newtonian me- the concrete particulars are the responses,
chanics, seem particularly unlikely to explain the class instances.
the dynamics of behavior, because mechanics In the molar view, an activity occupies more
offers only nonhistorical immediate causes time or less time, depending on the condi-
(Aristotle’s efficient causes; Rachlin, 1995). tions of reinforcement. No notion of strength
In the molar view, reinforcement is a process or momentum enters the picture. When be-
of selection, resembling natural selection— havior is seen as composed of continuous ac-
an entirely different sort of causation and tivities or extended patterns (i.e., alloca-
fundamentally historical (Baum & Heath, tions), response rate is no longer an
1992; Baum & Mitchell, 2000; Skinner, 1981). expression of strength or momentum. A re-
MOLECULAR TO MOLAR 107

sponse rate, as an allocation, is seen as con- also in the lack of any requirement that they
crete. have members or that such members exist
Increases or decreases in rate of key peck- (e.g., human beings who can leap over tall
ing may or may not indicate increases or de- buildings in a single bound). Useful classes
creases in the time spent pecking. The ex- have members, which, unless they are other
amples of varying k (tempo), asymmetrical classes (a possibility we will ignore here), con-
concurrent performances, and varying resis- stitute concrete particulars—concrete in the
tance to change show that at least two possi- sense that one can point to them or at least
bilities exist. First, response rate may increase observe them, and particular in the sense
or decrease because the mix of activities that each is just one thing. So, although op-
changes to include more or less time spent erant classes are abstract, responses (instanc-
in the repetitive activity, as implied by Equa- es) would be considered concrete (Skinner,
tion 4 (cf. Shull et al., 2001). Second, re- 1935/1961).
sponse rate may increase or decrease because Besides being members of classes, concrete
the repetitive activity itself (its topography) particulars are individuals (see Ghiselin,
changes. The difference in response rates be- 1997, and Hull, 1988, for longer explana-
tween ratio and interval schedules arises be- tions). An individual is a cohesive whole that
cause the schedules reinforce different pat- is situated in space and time—a historical en-
terns of responding—that is, different tity. That is, an individual (e.g., B. F. Skinner)
activities. Interval schedules differentially re- has a location, a beginning, and potentially
inforce activities that result in lower rates of an end. Individuals have no instances (e.g.,
key operation, whereas ratio schedules differ- B. F. Skinner is who he is and has no instanc-
entially reinforce activities that result in high es). Individuals cannot be defined except by
rates of key operation (Baum, 1981). Across ostension (i.e., by pointing; e.g., that is my cat
the low range of reinforcer rates, as reinforc- there). Individuals have parts (left leg, right
er rate increases across VI schedules (i.e., as leg, liver, and heart), rather than instances.
the average interval gets shorter), response The quote from John Donne at the begin-
rate increases and levels off, as Equation 4 ning expresses well the relation of part to
would predict, but when the VI schedule be- whole; as a clod is part of Europe, so any man
comes brief enough, it begins to function like is a part of mankind. Classes cannot do any-
a ratio schedule, and response rate increases thing; only individuals can do things (e.g., cat
up to the same level as for a comparable VR cannot walk into the room, whereas my cat
(Baum, 1993). The increase across the low can).
range of reinforcer rates represents an in- In particular, whereas individuals can
crease in time spent in low-tempo key peck- change, classes cannot change. B. F. Skinner
ing, whereas the increase across the high changed from boyhood to adulthood, but he
range of reinforcer rates represents an in- was still the same individual, B. F. Skinner. A
crease in time spent in high-tempo key peck- class remains fixed because it is defined by
ing (Baum, 1981, 1993). fixed properties or rules. If the properties or
rules change, we only have a new class. The
Class Versus Individual only change associated with a class is in the
This difference between the molecular and number of its instances. Were we to discover
molar views—the difference between re- an individual able to leap tall buildings in a
sponse strength and behavioral allocation— single bound, that class would no longer be
corresponds to the ontological distinction be- empty. Mathematical sets cannot change even
tween class and individual (Ghiselin, 1997; in this way, because adding or subtracting el-
Hull, 1988). The molecular view, as laid out ements from a set creates a new set.
by Skinner (1935/1961), relied on the notion Any science that deals with change, wheth-
of operant classes. A class is defined by spec- er phylogenetic change, developmental
ifying a list of properties or rules of member- change, or behavioral change, requires enti-
ship (e.g., all actions that depress the lever). ties that can change and yet retain their iden-
Classes are abstract in the sense that one can tity (e.g., Homo sapiens, my cat, or my diet),
only talk about them, not point to them or because only such entities provide historical
measure them. Their abstract nature appears continuity. In other words, because only in-
108 WILLIAM M. BAUM

dividuals can change and yet maintain histor- any stage; they become new parts. The end-
ical continuity, such a science must deal with point of the process (if any) will be a stable
individuals. Although individual usually allocation maintained by stable reinforce-
means individual organism in everyday dis- ment contingencies.
course, philosophers mean something more Although the idea that particular discrete
general. Organisms exemplify cohesive responses are instances of a class remains
wholes, but so too do activities or allocations. common (e.g., in textbooks), the molecular
Just as an organism is made up of a liver, kid- view allows at least one other possibility.
neys, brain, and the like, functioning togeth- Glenn, Ellis, and Greenspoon (1992) pro-
er to produce results in the environment, so posed that the aggregate of particular occur-
too an utterance (e.g., ‘‘I need help with this rences be thought of as analogous to a pop-
problem’’) is made up of sounds that func- ulation of organisms. As each individual
tion together to produce results in the envi- organism is a part of the population, so each
ronment. The various parts of the whole are particular discrete unit is a part of a behav-
themselves individuals (e.g., the liver or the ioral population, rather than an instance of a
uttered word ‘‘help’’); all individuals are com- class. Thus, one could redefine an operant as
posed of other individuals. This point will be a behavioral population, which would be an
important when we discuss the nesting of ac- individual rather than a class. Response rate
tivities. then would correspond to the size of the pop-
By way of example, we may compare the ulation. Such a population would constitute
molecular and molar accounts of differential an individual, but different from an activity
reinforcement (‘‘shaping’’). Skinner (1935/ or allocation, because its parts would be dis-
1961) recognized that reinforcement of a cer- crete responses (Glenn & Field, 1994). Their
tain class of responses generates responses proposal illustrates that the molecular view
that may actually lie outside the reinforced cannot be said to entail the concept of re-
class. He called this process induction (see also sponse class in the way that it can be said to
Segal, 1972). Induction is essential for shap- entail discrete units.
ing novel behavior, because the new induced During the 1960s and 1970s, Skinner’s no-
responses may be reinforced. To do this, one tion of the operant as a class came in for crit-
defines a new class for reinforcement, one ical discussion (e.g., Schick, 1971; Segal,
that excludes some of the old members. Re- 1972; Staddon, 1973). The main problem was
inforcement of this new class leads to induc- how to deal with the induction of new behav-
tion of further new responses, which allows ior. Catania (1973) proposed a solution that
definition of another new class, and so on, resembles the proposal by Glenn et al.
until some target class is reached. (1992). He suggested distinguishing between
One challenge for this molecular account the descriptive operant and the functional
of shaping is that reinforcement may induce operant—that is, between the operant as
undesirable behavior, sometimes called ad- specified by class properties and the operant
junctive or interim behavior (Staddon & Sim- as the pattern of behavior that actually results
melhag, 1971). The problem is that such be- from reinforcement. Catania’s suggestion
havior interferes with the process of shaping overlooks, however, that the functional oper-
(Breland & Breland, 1961; Segal, 1972) and ant constitutes a different ontological kind,
falls outside the reinforced classes. Conse- one that eludes definition by a list of prop-
quently, the molecular view treats it as a sep- erties. It overlooks that, in moving from de-
arate type, distinct from operant behavior scriptive operant to functional operant, one
and with rules of its own. also moves from class to individual. The func-
The molar view of shaping instead incor- tional operant, which Catania represented by
porates induced behavior into the account. drawing frequency distributions, corresponds
The process begins, not with a response class, to a population of responses, but the respons-
but with an allocation of activities (an individ- es no longer can be seen as instances of a
ual). Some activities (parts) are reinforced. class, because now they are parts of a whole—
The allocation changes, the parts reinforced whatever unspecified responses occur after
change, and the allocation changes further. reinforcement. They could be seen (in the
Induced activities may enter the allocation at molar view) as parts of an extended behav-
MOLECULAR TO MOLAR 109

ioral allocation, an individual. That allocation particularly if the environment changes, but
is both engendered by and maintained by the the species remains the same individual, just
reinforcement it produces. Like Glenn et al., as a person who grows and ages remains the
however, Catania based his idea on discrete same individual. The existence of a species
responses. In their related discussion, Glenn through time is referred to as its lineage. A
et al. argued, lineage is an extended temporal entity in
In the ontological sense, an operant is . . . an much the same way that a pattern of behavior
entity—a unit, an extant individual. . . . It is is an extended temporal entity.
composed of a population of behavioral oc- Ghiselin’s point was at first controversial
currences that are distributed over time, each among biologists, but gradually gained accep-
occurrence having a unique spatiotemporal tance. Now, even its critics acknowledge that
location. The operant can evolve (as only op- ‘‘Only a few biologists and (bio)philosophers
erants and species can but organisms and re- have resisted [it]’’ (Mahner & Bunge, 1997,
sponses cannot). (p. 1333) p. 254).
The main difference between this and the Like a species, an allocation of behavior—
molar view is its implicit reliance on discrete an activity—is an individual. It is an entity
responses (‘‘occurrences’’). If one added the with a beginning and an end, integrated by
point that the occurrences take up time, in- its function; that is, by its effects in the envi-
troducing an analogue to the carrying capac- ronment. Just as taking away an organism’s
ity (limited size of a biological population), leg changes its functioning, so taking away
and one added that the occurrences were part of a behavioral pattern changes its envi-
bouts of extended activities, the concept of ronmental effects. Forget to add baking pow-
behavioral population would become almost der to a cake mix, and the result may be in-
the same as the concept of allocation. One edible. A particular cake baking, however, is
further concept, implied by the analogy to bi- part of a more extended allocation of baking
ological evolution, is the idea that activities or cooking, including both successful and un-
are nested, that every activity (allocation) is successful attempts and all their various out-
composed of parts that are other activities. comes.
This illustrates another parallel between
Species and Activities extended activities and species: their similar
As Individuals participation in larger individuals. Common
Another way to understand the concrete- ancestry unites species into more extended
ness of behavioral allocations, activities, and individuals at the level of genus. Genera unite
response rates is by comparison to evolution- into still larger individuals, and so on, right
ary theory. Glenn et al. (1992) were drawing up to phylum and, finally, life (Ghiselin,
on Ghiselin’s (1981, 1997) argument that 1997). Although individuals at these various
species are not classes but individuals. That taxonomic levels may be more or less extend-
is, the relation of an organism to its species ed, no matter how large or small they still are
is not the relation of instance to class, but the individuals. Homo sapiens, as a species in the
relation of part to whole. As before, the word genus Homo, is a part of the genus, just as the
individual here refers to an integrated entity other species in that genus are parts of it.
that may change through time. As before, in Geospiza fortis is one species of Darwin’s finch-
contrast to a class, an individual is situated in es. It, Geospiza scandens, and several other spe-
time and space (i.e., has a beginning and cies make up the genus Geospiza. In relation
end) and has parts but no instances (e.g., B. to the genus, the species are parts of a whole,
F. Skinner). An organism is an individual, of not instances of a class.
course, but, Ghiselin explains, so too is a spe-
cies. A species is an individual composed of
the organisms that make it up, in the same NESTING OF
way as John Donne noted that every man is ACTIVITIES
a part of mankind. All the individual birds in Activities, like species, are parts of more ex-
the Galapagos Islands that make up the spe- tended activities. Getting to work each day
cies Geospiza fortis are parts of that whole. Se- may be part of working each day. Working
lection may change a species through time, each day may be part of holding a job. Hold-
110 WILLIAM M. BAUM

Fig. 2. One person’s hypothetical activity patterns. Left: pattern of life activities, showing time divided among
health and maintenance (i.e., personal satisfaction), gaining resources (e.g., job), relationships (e.g., friends), and
reproduction (e.g., family). Middle: pattern of health and maintenance nested within the life activities, showing time
divided among medical (e.g., visits to practitioners), eating, personal hygiene, and recreation. Right: pattern of
recreation nested within health and maintenance, showing time divided among watching television, reading, movies,
and walking (i.e., exercise). All of these patterns constitute individuals, because they change without changing their
identity.

ing a job may be part of making a living. Mak- The Molar View of Ever yday Life
ing a living may be part of gaining resources.
Gaining resources may end with retirement, We may illustrate the conceptual power of
and all such parts may make up a whole, the idea of nested activities with a hypotheti-
which we could call a lifetime lived (Baum, cal example. Liz is a married woman in her
1995, 1997; Rachlin, 1994). 40s, who lives in a city, works selling retire-
The converse holds, too: Activities and spe- ment plans for a mutual fund company, and
cies are made up of parts consisting of less has an 18-year-old son who still lives at home.
extended individuals. A species may be com- As I suggested in earlier papers (Baum, 1995,
posed of several populations. A population 1997), her life may be divided into four basic
may be composed of several demes. Demes, activities: personal satisfaction (i.e., health
populations, and species all are composed of and maintenance), job (i.e., gaining resourc-
organisms, which are composed of organs, es), relationships, and family (i.e., reproduc-
which are composed of cells, and so on. For tion). The left graph in Figure 2 shows the
the purposes of evolutionary theory, one pattern of these activities at this point in Liz’s
stops at the smallest individual that may life. Leaving out the 9 hr she spends sleeping
evolve—a deme, a population, or a species. each night, we see that she spends about 35
An activity like getting to work may be com- hr (33%) per week in personal satisfaction,
posed of parts like starting the car, driving to 36 hr (34%) in gaining resources, 24 hr
the highway, driving on the highway, driving (23%) in making and maintaining relation-
to the campus, hunting for a parking place, ships, and 10 hr (10%) in family activities.
and walking to the office. Driving on the The allocation was different 10 or 15 years
highway has parts like adjusting speed, switch- earlier, when her son was young and she was
ing lanes, scanning for police cars, and swear- caring for her husband’s children from pre-
ing at other drivers. And so on, for each part. vious marriages. As an individual, the activity
Some least extended activity exists for the has changed and will change again over the
analysis of behavior, as it does for evolution- course of Liz’s life, but it will remain the same
ary theory, defined by its usefulness and, individual, the pattern of Liz’s life. All four
probably, by its likelihood of evolving. Highly of the activities shown in the left graph may
practiced and stereotyped activities like shift- be analyzed in more detail and seen to be
ing gears in a car change rarely; they attract composed of other activities. For example,
little interest as targets of modification, Liz’s family activities consist of occasionally
whereas driving speed may change signifi- caring for her husband’s grandchildren and
cantly and is a frequent target of attempts at primarily of caring for her son: feeding him,
modification (e.g., ‘‘speed kills’’). cleaning up after him, advising him, and in-
MOLECULAR TO MOLAR 111

terfering in his life sufficiently to make him researchers almost never seek to change, al-
rebellious. though other sorts of pecks, containing dif-
The middle graph in Figure 2 shows the ferent parts, exist, such as water-reinforced
time Liz spends in personal satisfaction de- pecks and explorator y pecks ( Jenkins &
composed into parts. She spends about 3 hr Moore, 1973; Schwartz & Williams, 1972; Wo-
(8%) per week seeing medical practitioners, lin, 1948/1968). A similar, though more var-
10 hr (29%) eating, 7 hr (20%) in personal ied, list of motions might be made for a rat’s
hygiene, and 15 hr (43%) in recreation. This lever press. Key pecks or lever presses may be
allocation also is an individual, subject to parts of key pecking or lever pressing rein-
change, and is nested within or incorporated forced, say, on a VI schedule. Key pecking or
into the more extended allocation of Liz’s life lever pressing on two different keys or levers
activities. Each of the activities composing the may be parts of an allocation of behavior be-
activity of personal satisfaction also is an in- tween two sources of reinforcement (Ploog &
dividual and is itself composed of individuals. Zeigler, 1997). We usually measure the re-
The right graph in Figure 2 shows Liz’s rec- sponding on one of the keys or levers as a
reational activities broken into parts. She response rate. We measure the allocation as
spends about 7 hr (47%) per week watching choice or relative response rate.
television, 6 hr (40%) reading, 0.5 hr (3%) In contrast, the molecular view sees choice
watching movies, and 1.5 hr (10%) walking or concurrent performance as consisting of
for exercise. This allocation of recreational occurrences of two responses, each at a cer-
activity constitutes an individual and is part of tain rate. The response rates may be com-
Liz’s personal satisfaction and, because of pared by calculating some relative measure
that, is part of Liz’s life activity. Each of the (proportion or ratio) but such a measure is
parts of Liz’s recreational activities could be seen as only a summary or as ‘‘derived’’ (Ca-
further decomposed into parts that also tania, 1981; Herrnstein, 1961). At least one
would be individuals (Baum, 1995, 1997). researcher has suggested that relative mea-
In contrast, the molecular view invites one sures, as derived, should be viewed with sus-
to view life as a time line of discrete events, picion and that response rate is the only true
one following another—a behavioral stream measure of behavior (Catania, 1981). The
(e.g., Schoenfeld & Farmer, 1970). To the limitations of such a view become apparent
molarist, such a characterization, though pos- when we consider a specific example.
sible, appears impoverished and to resemble Alsop and Elliffe (1988) exposed 6 pigeons
little the way people actually talk about their to over 30 pairs of concurrent VI schedules,
lives (i.e., inelegant and low on external va- varying both relative and overall rate of re-
lidity). inforcement. I reanalyzed their data by
Figure 2 implies that one might go into any grouping them according to five levels of re-
amount of detail about Liz’s activities. Where inforcer ratio (r): 0.12, 0.25, 1.0, 4.0, and 8.0.
should subdividing stop, and how does one Within each group, the obtained reinforcer
define the parts? Answers would depend on ratios varied a bit, but the variation from
the purpose of the analysis, whether it be group to group was larger than the variation
therapeutic intervention, basic research, or within a group (although to achieve this, five
something else. The issues involved are ad- conditions with aberrant reinforcer ratios out
dressed most directly in the context of labo- of 186 were omitted—one each for 3 pigeons
ratory research. and two for 1 pigeon). For each reinforcer
ratio, overall reinforcer rate varied from
Applications in the Laborator y about 10 to about 400 reinforcers per hour.
As a laboratory example, we may consider Figure 3 shows the average results, which
activities like key pecking and lever pressing. were representative of the results for the in-
A pigeon’s food peck, when examined in de- dividual birds.
tail, constitutes an individual with parts: for- The top graph in Figure 3 shows the total
ward head motion, eye closing, opening of rate of pecking at the two keys as a function
the beak, head withdrawal, closing of the of the overall reinforcer rate. The curve rep-
beak, eye opening (Ploog & Zeigler, 1997; resents the least squares fit of Equation 4 (rO
Smith, 1974). It is a stereotyped pattern that 5 9.44; k 5 94.6). The only unusual feature
112 WILLIAM M. BAUM

of this analysis is that pecks at the two keys


were combined, whereas usually Equation 4
would apply to pecks at a single key. Recalling
that Equation 4 describes choice between
schedule-reinforced activity and other back-
ground activities, we see that choice between
key pecking and other activities followed the
orderly pattern expected from the matching
law. That the various sets of symbols all over-
lap each other shows that reinforcer ratio had
no effect on this choice pattern.
The middle graph in Figure 3 shows that
the overall key pecking contained within it
another regular pattern. Here the ratio of
pecks at the two keys is plotted against overall
reinforcer rate. As in the top graph, the dif-
ferent symbols represent data from the dif-
ferent reinforcer ratios from the two keys. A
horizontal line, corresponding to the average
peck ratio, is drawn through each set of sym-
bols to allow assessment of trend. As overall
reinforcer rate varied, each reinforcer ratio
maintained a certain peck ratio, which re-
mained approximately invariant across over-
all reinforcer rate. In other words, regardless
of the overall rate of reinforcement, the be-
havior ratio remained about the same for
each reinforcer ratio, in accordance with the
generalized matching law (Equation 7).
The bottom graph in Figure 3 shows that,
on still closer examination, a pattern exists
within the behavior ratios, the activity that I
earlier called fix and sample (Baum et al.,
1999). To see whether such a pattern was
present, I calculated for each behavior ratio
the average number of pecks in a visit to the
nonpreferred key and the probability of leav-


forcer ratio, but is independent of overall rate of rein-
forcement. Bottom: the fix-and-sample pattern nested
within the pattern of relative responding. The bottom
five horizontal lines indicate the averages of probability
of visiting the nonpreferred alternative, p(N), across the
levels of reinforcer ratio. The smaller the relative rein-
Fig. 3. A study of concurrent schedules that illustrates forcement for visiting the nonpreferred alternative, the
the concept of nested patterns. Top: combined rate of lower the probability of visiting it. Hence, the symbols for
key pecking on two concurrent VI schedules as a function r equal to 0.12 and 8.0 (circles and diamonds) show the
of overall rate of reinforcement. The different symbols lowest p(N), and the symbols for r equal to 1.0 (triangles)
represent different levels of reinforcer ratio (r). The show the highest p(N). The uppermost horizontal line
curve represents the least squares fit of Equation 4 to all shows the average number of pecks per visit at the non-
the points. Middle: relative responding at the two alter- preferred alternative (Nppv; right vertical axis). The av-
natives as a pattern nested within the pattern of overall erage duration of a visit to the nonpreferred alternative
rate of key pecking. The horizontal lines represent the remained approximately constant at eight pecks, consis-
average behavior ratio at each level of reinforcer ratio. tent with the fix-and-sample pattern. All variables are
Behavior ratio varies, as would be expected, across rein- transformed to Base 2 logarithms.
MOLECULAR TO MOLAR 113

ing the preferred key to visit the nonpre- may be nested within each other. Nested with-
ferred key (number of visits to the nonpre- in the pattern of overall responding to the
ferred key divided by number of pecks at the keys (top graph) was a pattern of allocation
preferred key). The fix-and-sample pattern of the overall responding between the keys,
would be revealed by invariant visits to the measured by the behavior ratio (middle
nonpreferred key combined with variation graph). Nested within the behavior ratio was
only in the probability of visiting the nonpre- a pattern of visitation at the two keys, a pat-
ferred key. For convenience, both probability tern of fixing on the preferred alternative
of visiting the nonpreferred key [p(N)] and and briefly sampling the nonpreferred alter-
number of pecks per visit to the nonpre- native with a frequency depending on the re-
ferred key (Nppv) are shown in the same inforcer ratio (bottom graph). In the molar
graph; p(N) is represented on the left vertical view, all of these patterns constitute alloca-
axis, and Nppv is represented on the right tions—between pecking and background ac-
vertical axis. The five lower sets of symbols tivities (top graph), between pecking left and
show that p(N), like the behavior ratio, dif- pecking right (middle graph), and between
fered across reinforcer ratios, but remained fixing and sampling (bottom graph).
approximately invariant for each reinforcer
ratio as overall reinforcer rate varied. Each
reinforcer ratio produced a certain, roughly CONCLUSION
invariant, probability of a visit to the nonpre- An activity, like a species, is an individual,
ferred alternative. The horizontal lines show a concrete particular with parts, not a class
the averages. As would be expected from the with instances. Contrary to 19th- and early
results of Baum et al. (1999), the lowest prob- 20th-century thinking, the concrete particu-
abilities of visiting the nonpreferred key oc- lars of behavior need not be momentary or
curred for the strongest preferences, gener- discrete, but extend through time as parts of
ated by the most extreme reinforcer ratios (8 behavioral patterns (activities or allocations)
and 0.12). The two intermediate reinforcer over minutes, hours, days, or years. Like spe-
ratios (4 and 0.25) produced intermediate cies, they only need to have a beginning and
p(N), and the 1:1 reinforcer ratio, which pro- potentially an end. This recognition changes
duced the weakest preferences, produced the the notions of reinforcement and stimulus
highest probabilities of visiting the nonpre- control, but only moderately. Instead of
ferred side. The higher the relative reinforce- thinking of reinforcement as a sort of ‘‘mo-
ment for the nonpreferred key, the higher ment of truth’’ (e.g., Ferster & Skinner, 1957;
the frequency of visiting the nonpreferred Skinner, 1948), defined by contiguity with a
key. The uppermost sets of symbols show that momentary response, we may think of rein-
Nppv, the visit duration to the nonpreferred forcement as a cumulative effect, as selection
key, remained invariant with respect to both through time (Skinner, 1981; Staddon, 1973),
overall reinforcer rate and reinforcer ratio. shaping patterns of behavior (activities) in
Independence from overall reinforcer rate is lineages. Because reinforcement operates on
shown by the adherence of the points to the the activity as a whole, we are relieved of any
horizontal line representing the average. need to imagine that the parts are all sepa-
That the different symbols all lie on top of rately reinforced. Behavioral chains, for ex-
one another shows independence from the ample, need not be held together with imag-
reinforcer ratio. Visits to the nonpreferred ined conditional reinforcers, because they are
side, regardless of rate or distribution of re- reinforced as a whole (Baum, 1973; Rachlin,
inforcement, always lasted about eight pecks 1991). Avoidance need not be explained with
(i.e., 23; see right vertical axis), presumably imagined stimuli and reinforcers (Baum,
long enough to outlast the 2-s COD. Regard- 1973, 2001). We understand the behavior of
less of the behavior ratio, the same activity of a species in relation to the climate and re-
briefly visiting (i.e., sampling) the nonpre- sources available in its evolutionary environ-
ferred key held; only the probability of visit- ment. Similarly, instead of thinking of stimu-
ing changed to produce the different behav- lus control as changing the probability of a
ior ratios shown in the middle graph. response, we may think of discriminative stim-
Figure 3 shows how activities or patterns uli as setting the context in which certain ac-
114 WILLIAM M. BAUM

tivities or patterns are reinforced and wax in quantitative theory, and in its applicability to
the time that they occupy. Making these ex- everyday life. The results of Alsop and Elliffe
tensions, we increase our ability to explain (1988; Figure 3) illustrate the way the molar
disparate phenomena, such as variation in as- view both integrates results at various levels
ymptotic response rate (k), asymmetrical con- of analysis and fits them into a quantitative
current performances (Figure 1), resistance framework. The hypothetical example of Liz
to change, and the relations among analyses (Figure 2) illustrates the power of the molar
at various levels of generality (Figures 2 and view to apply to everyday concepts like ‘‘hold-
3; Hineline, 2001). ing a job’’ or ‘‘recreation’’ (see Rachlin, 1994,
Questions remain, of course. If an activity for further discussion). Taking our cue from
is an individual, how should we think about another historical science, evolutionary biol-
its coherence? Ghiselin (1997) explains that ogy, we see that extendedness of allocations
organisms have a special cohesiveness that or activities in no way excludes them from
species and other taxa lack; an organism concreteness. On the contrary, I have argued
functions as an integrated whole. The parts that the discrete events of the molecular view
of a species may be less crucial than those of are abstractions (see Baum, 1997, for further
an organism, but a species has coherence be- discussion). Although someone committed to
cause it is defined as a reproductive unit, re- the molecular view might disagree, I have ar-
productively isolated from other such units gued that on these grounds of plausibility, ex-
(Mayr, 1970) and because the parts of the planatory power, and elegance the molar view
species share common ancestry (i.e., are is the superior paradigm.
parts of the same lineage). Higher taxa, from
genus on up, have coherence only because of
common ancestry. In analogy to biological REFERENCES
taxa, the parts of an activity share common Alsop, B., & Elliffe, D. (1988). Concurrent-schedule per-
ancestry—are parts of the same lineage—be- formance: Effects of relative and overall reinforcer
cause they result from the same history of se- rate. Journal of the Experimental Analysis of Behavior, 49,
lection (reinforcement). The various parts of 21–36.
Ashby, W. R. (1954). Design for a brain. London: Chap-
the activity we call ‘‘holding a job’’ cohere man & Hall.
because they share a common function (gain- Baum, W. M. (1973). The correlation-based law of effect.
ing resources) and a common history of se- Journal of the Experimental Analysis of Behavior, 20, 137–
lection (reinforcement) among variants that 153.
functioned better and worse. Activities may Baum, W. M. (1976). Time-based and count-based mea-
surement of preference. Journal of the Experimental
become extinct in the same way as species, by Analysis of Behavior, 26, 27–35.
a loss of functionality of the whole. The end Baum, W. M. (1981). Optimization and the matching
of an unrewarding marriage (an activity) is law as accounts of instrumental behavior. Journal of the
the end of an individual, like the extinction Experimental Analysis of Behavior, 36, 387–403.
Baum, W. M. (1993). Performances on ratio and interval
of a species. Further evidence of coherence schedules of reinforcement: Data and theory. Journal
in the parts of an activity may be found in of the Experimental Analysis of Behavior, 59, 245–264.
common variation in the face of change in Baum, W. M. (1995). Introduction to molar behavior
environmental factors (Herrnstein, 1977). analysis. Mexican Journal of Behavior Analysis, 21, 7–25.
Food deprivation, for example, changes time Baum, W. M. (1997). The trouble with time. In L. J.
Hayes & P. M. Ghezzi (Eds.), Investigations in behavioral
allocation to a host of food-related activities. epistemology (pp. 47–59). Reno, NV: Context Press.
A more complete answer to the question of Baum, W. M. (2001). Molar versus molecular as a para-
coherence awaits further research. digm clash. Journal of the Experimental Analysis of Behav-
Although the research discussed here sug- ior, 75, 338–341.
Baum, W. M., & Aparicio, C. F. (1999). Optimality and
gests advantages to the molar view over the concurrent variable-interval variable-ratio schedules.
molecular, deciding between the two para- Journal of the Experimental Analysis of Behavior, 71, 75–
digms depends, not on data, but on satisfac- 89.
tory interpretation of data. No one should Baum, W. M., & Heath, J. L. (1992). Behavioral expla-
doubt that molecular accounts of concurrent nations and intentional explanations in psychology.
American Psychologist, 47, 1312–1317.
performance are possible. The advantages to Baum, W. M., & Mitchell, S. H. (2000). Newton and Dar-
the molar view lie in its ability to integrate win: Can this marriage be saved? Behavioral and Brain
experimental results, in its promotion of Sciences, 23, 91–92.
MOLECULAR TO MOLAR 115

Baum, W. M., & Rachlin, H. C. (1969). Choice as time geon to maximize overall reinforcement rate. Journal
allocation. Journal of the Experimental Analysis of Behav- of the Experimental Analysis of Behavior, 64, 277–297.
ior, 12, 861–874. Hineline, P. N. (2001). Beyond the molar-molecular dis-
Baum, W. M., Schwendiman, J. W., & Bell, K. E. (1999). tinction: We need multiscaled analyses. Journal of the
Choice, contingency discrimination, and foraging the- Experimental Analysis of Behavior, 75, 342–347.
ory. Journal of the Experimental Analysis of Behavior, 71, Houston, A. I., & McNamara, J. (1981). How to maxi-
355–373. mize reward rate on two varable-interval paradigms.
Breland, K., & Breland, M. (1961). The misbehavior of Journal of the Experimental Analysis of Behavior, 35, 367–
organisms. American Psychologist, 16, 681–684. 396.
Buzzard, J. H., & Hake, D. F. (1984). Stimulus control Hull, D. L. (1988). Science as a process: An evolutionary
of schedule-induced activity in pigeons during multi- account of the social and conceptual development of science.
ple schedules. Journal of the Experimental Analysis of Be- Chicago: University of Chicago Press.
havior, 42, 191–209. Jenkins, H. M., & Moore, B. R. (1973). The form of the
Campbell, D. T. (1956). Adaptive behavior from random auto-shaped response with food or water reinforcers.
response. Behavioral Science, 1, 105–110. Journal of the Experimental Analysis of Behavior, 20, 163–
Catania, A. C. (1973). The concept of the operant in the 181.
analysis of behavior. Behaviorism, 1, 103–115. Kuhn, T. S. (1970). The structure of scientific revolutions
Catania, A. C. (1981). The flight from experimental (2nd ed.). Chicago: University of Chicago Press.
analysis. In C. M. Bradshaw, E. Szabadi, & C. F. Lowe Lee, V. L. (1983). Behavior as a constituent of conduct.
(Eds.), Quantification of steady-state operant behavior (pp. Behaviorism, 11, 199–224.
49–64). Amsterdam: Elsevier North-Holland. Mahner, M., & Bunge, M. (1997). Foundations of biophi-
Chiesa, M. (1994). Radical behaviorism: The philosophy and losophy. Berlin: Springer-Verlag.
the science. Boston: Authors Cooperative. Mayr, E. (1970). Populations, species, and evolution. Cam-
Dallery, J., McDowell, J. J, & Lancaster, J. S. (2000). Fal- bridge, MA: Harvard University Press.
sification of matching theory’s account of single-alter- McDowell, J. J. (1987). A mathematical theory of rein-
native responding: Herrnstein’s k varies with sucrose forcer value and its application to reinforcement de-
concentration. Journal of the Experimental Analysis of Be- lay in simple schedules. In M. L. Commons, J. E. Ma-
havior, 73, 23–43. zur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative
Dinsmoor, J. A. (2001). Stimuli inevitably generated by analyses of behavior: Vol. 5. The effect of delay and of in-
behavior that avoids electric shock are inherently re- tervening events on reinforcement value (pp. 77–105).
inforcing. Journal of the Experimental Analysis of Behavior, Hillsdale, NJ: Erlbaum.
75, 311–333. Morse, W. H. (1966). Intermittent reinforcement. In W.
Ferster, C. B., & Skinner, B. F. (1957). Schedules of rein- K. Honig (Ed.), Operant behavior: Areas of research and
forcement. New York: Appleton-Century-Crofts. application (pp. 52–108). New York: Appleton-Centu-
Ghiselin, M. T. (1981). Categories, life, and thinking. ry-Crofts.
Behavioral and Brain Sciences, 4, 269–313. Nevin, J. A. (1974). Response strength in multiple sched-
Ghiselin, M. T. (1997). Metaphysics and the origin of species. ules. Journal of the Experimental Analysis of Behavior, 21,
Albany: State University of New York Press. 389–408.
Gilbert, R. M. (1970). Psychology and biology. The Ca- Nevin, J. A. (1992). An integrative model for the study
nadian Psychologist, 11, 221–238. of behavioral momentum. Journal of the Experimental
Gilbert, T. F. (1958). Fundamental dimensional prop- Analysis of Behavior, 57, 301–316.
erties of the operant. Psychological Review, 65, 272–285. Nevin, J. A., & Grace, R. C. (2000). Behavioral momen-
Glenn, S. S., Ellis, J., & Greenspoon, J. (1992). On the tum and the law of effect. Behavioral and Brain Sciences,
revolutionary nature of the operant as a unit of be- 23, 73–130.
havioral selection. American Psychologist, 47, 1329– Nevin, J. A., Tota, M. E., Torquato, R. D., & Shull, R. L.
1336. (1990). Alternative reinforcement increases resis-
Glenn, S. S., & Field, D. P. (1994). Functions of the en- tance to change: Pavlovian or operant contingencies?
vironment in behavioral evolution. The Behavior Ana- Journal of the Experimental Analysis of Behavior, 53, 359–
lyst, 17, 241–259. 379.
Herrnstein, R. J. (1961). Relative and absolute strength Pear, J. J. (1985). Spatiotemporal patterns of behavior
of response as a function of frequency of reinforce- produced by variable-interval schedules of reinforce-
ment. Journal of the Experimental Analysis of Behavior, 4, ment. Journal of the Experimental Analysis of Behavior, 44,
267–272. 217–231.
Herrnstein, R. J. (1970). On the law of effect. Journal of Ploog, B. O., & Zeigler, H. P. (1997). Key-peck proba-
the Experimental Analysis of Behavior, 13, 243–266. bility and topography in a concurrent variable-interval
Herrnstein, R. J. (1974). Formal properties of the variable-interval schedule with food and water rein-
matching law. Journal of the Experimental Analysis of Be- forcers. Journal of the Experimental Analysis of Behavior,
havior, 21, 159–164. 67, 109–129.
Herrnstein, R. J. (1977). The evolution of behaviorism. Premack, D. (1965). Reinforcement theory. In D. Levine
American Psychologist, 32, 593–603. (Ed.), Nebraska symposium on motivation (pp. 123–180).
Herrnstein, R. J., & Heyman, G. M. (1979). Is matching Lincoln: University of Nebraska Press.
compatible with reinforcement maximization on con- Premack, D. (1971). Catching up with common sense,
current variable interval, variable ratio? Journal of the or two sides of a generalization: Reinforcement and
Experimental Analysis of Behavior, 31, 209–223. punishment. In R. Glaser (Ed.), The nature of reinforce-
Heyman, G. M., & Tanz, L. (1995). How to teach a pi- ment (pp. 121–150). New York: Academic Press.
116 WILLIAM M. BAUM

Rachlin, H. (1976). Behavior and learning. San Francisco: Appleton-Century-Crofts. (Original work published
Freeman. 1953)
Rachlin, H. (1991). Introduction to modern behaviorism Skinner, B. F. (1961). The experimental analysis of be-
(3rd ed.). New York: Freeman. havior. In Cumulative record (Enlarged ed., pp. 100–
Rachlin, H. (1994). Behavior and mind: The roots of modern 131). New York: Appleton-Century-Crofts. (Original
psychology. New York: Oxford University Press. work published 1957)
Rachlin, H. (1995). Self-control: Beyond commitment. Skinner, B. F. (1961). The generic nature of the con-
Behavioral and Brain Sciences, 18, 109–159. cepts of stimulus and response. In Cumulative record
Rachlin, H. (2000). The science of self-control. Cambridge, (Enlarged ed., pp. 347–366). New York: Appleton-
MA: Harvard University Press. Century-Crofts. (Original work published 1935)
Rachlin, H., & Baum, W. M. (1972). Effects of alternative Skinner, B. F. (1981). Selection by consequences. Science,
reinforcement: Does the source matter? Journal of the 213, 501–504.
Experimental Analysis of Behavior, 18, 231–241. Smith, R. F. (1974). Topography of the food-reinforced
Schick, K. (1971). Operants. Journal of the Experimental key peck and the source of 30-millisecond interres-
Analysis of Behavior, 15, 413–423. ponse times. Journal of the Experimental Analysis of Be-
Schoenfeld, W. N., & Farmer, J. (1970). Reinforcement havior, 21, 541–551.
schedules and the ‘‘behavior stream.’’ In W. N. Staddon, J. E. R. (1973). On the notion of cause, with
Schoenfeld (Ed.), The theory of reinforcement schedules applications to behaviorism. Behaviorism, 1, 25–63.
(pp. 215–245). New York: Appleton-Century-Crofts. Staddon, J. E. R., & Simmelhag, V. (1971). The ‘‘super-
Schwartz, B., & Williams, D. R. (1972). Two different stition’’ experiment: A re-examination of its implica-
kinds of key peck in the pigeon: Some properties of tions for the principles of adaptive behavior. Psycholog-
responses maintained by negative and positive re- ical Review, 78, 3–43.
sponse-reinforcer contingencies. Journal of the Experi- Vaughan, W., Jr., & Miller, H. L., Jr. (1984). Optimization
mental Analysis of Behavior, 18, 201–216. versus response-strength accounts of behavior. Journal
Segal, E. F. (1972). Induction and the provenance of of the Experimental Analysis of Behavior, 42, 337–348.
operants. In R. M. Gilbert & J. R. Millenson (Eds.), White, K. G. (1978). Behavioral contrast as differential
Reinforcement: Behavioral analyses (pp. 1–34). New York: time allocation. Journal of the Experimental Analysis of
Academic. Behavior, 29, 151–160.
Shull, R. L., Gaynor, S. T., & Grimes, J. A. (2001). Re- White, K. G. (1985). Interresponse-time analysis of stim-
sponse rate viewed as engagement bouts: Effects of ulus control in multiple schedules. Journal of the Ex-
relative reinforcement and schedule type. Journal of perimental Analysis of Behavior, 43, 331–339.
the Experimental Analysis of Behavior, 75, 247–274. Wolin, B. R. (1968). Difference in manner of pecking a
Skinner, B. F. (1938). The behavior of organisms. New York: key between pigeons reinforced with food and with
Appleton-Century-Crofts. water. In A. C. Catania (Ed.), Contemporary research in
Skinner, B. F. (1948). ‘‘Superstition’’ in the pigeon. Jour- operant behavior (p. 286). Glenview, IL: Scott, Fores-
nal of Experimental Psychology, 38, 168–172. man. (Original work published 1948)
Skinner, B. F. (1950). Are theories of learning necessary?
Psychological Review, 57, 193–216. Received May 18, 2001
Skinner, B. F. (1961). The analysis of behavior. In Cu- Final acceptance March 12, 2002
mulative record (Enlarged ed., pp. 70–76). New York:

You might also like