Professional Documents
Culture Documents
Choice between sucrose and wheel-running reinforcement was assessed in two experiments. In the first
experiment, ten male Wistar rats were exposed to concurrent VI 30 s VI 30 s schedules of wheel-running
and sucrose reinforcement. Sucrose concentration varied across concentrations of 2.5, 7.5, and 12.5%.
As concentration increased, more behavior was allocated to sucrose and more reinforcements were
obtained from that alternative. Allocation of behavior to wheel running decreased, but obtained wheel-
running reinforcement did not change. Overall, the results suggested that food-deprived rats were
sensitive to qualitative changes in food supply (sucrose concentration) while continuing to defend
a level of physical activity (wheel running). In the second study, 15 female Long Evans rats were exposed
to concurrent variable ratio schedules of sucrose and wheel-running, wheel-running and wheel-running,
and sucrose and sucrose reinforcement. For each pair of reinforcers, substitutability was assessed by the
effect of income-compensated price changes on consumption of the two reinforcers. Results showed
that, as expected, sucrose substituted for sucrose and wheel running substituted for wheel running.
Wheel running, however, did not substitute for sucrose; but sucrose partially substituted for wheel
running. We address the implications of the interrelationships of sucrose and wheel running for an
understanding of activity anorexia.
Key words: choice, reinforcement value, substitutability, activity anorexia, behavioral economics,
sucrose, wheel running, lever press, rat
________________________________________
Activity anorexia occurs when rats are running) at a time when food intake is limited
placed on food restriction and provided with seems counterintuitive to survival and repro-
the opportunity to run. The initial effect is that duction (see Pierce, 2001 for an evolutionary
food intake is reduced, body weight declines, account). Activity anorexia in rats also shares
and wheel running increases. As running features observed in human anorexia. Un-
escalates, food intake drops off and body derstanding the interplay between eating and
weight plummets downward, further augment- physical activity may be informative in the
ing wheel running and suppressing food treatment of a subset of human anorexia in
intake. The result of this cycle is emaciation which food restriction is combined with
and, if allowed to continue, the eventual death heightened levels of activity.
of the animal (Epling & Pierce, 1991, 1996; In the analysis of food intake and physical
Epling, Pierce, & Stefan, 1983; Routtenberg, activity, operant investigations of the reinforce-
1968; Routtenberg & Kuznesof, 1967). ment value of wheel running and eating can
One reason this phenomenon is of consider- play a central role. For example, Pierce,
able interest is because it defies intuition based Epling, and Boer (1986) investigated the
on assumptions of energy balance. Specifically, interrelationship between food and wheel-
the increased expenditure of energy (wheel running reinforcement. These researchers
demonstrated that the reinforcing value of
The first experiment in this report is based on an food, as indexed by a progressive-ratio pro-
undergraduate thesis submitted by the third author in cedure, was reduced when rats ran in a wheel
partial fulfillment of a B.Sc. degree at Mount Allison prior to responding for food reinforcement;
University, Sackville, Canada. This research was supported also, the reinforcing value of running was
by Grant 0GP0170022 from the Natural Sciences and
Engineering Research Council of Canada to the first increased when rats were food deprived. The
author. We thank Brian Millar for his assistance with interrelationship between these two reinforce-
conducting the second experiment. ment effects is central to the theory of activity
Correspondence regarding this article should be sent to anorexia proposed by Epling and Pierce
Terry W. Belke, Department of Psychology, Mount Allison
University, Sackville, New Brunswick, Canada, E4L 1C7 or
(1996). More recently, Belke, Pierce, and
via E-mail to TBELKE@MTA.CA. Jensen (2004) used operant procedures to
doi: 1901.10/jeab.2006.98-05 show that prefeeding rats prior to reinforce-
131
132 TERRY W. BELKE et al.
ment sessions had only transient effects on that animals would abandon wheel running as
wheel running and responding for the oppor- sucrose concentration increased; rates of re-
tunity to run, when body weight remained inforcement were not varied so that assess-
constant. In contrast, prefeeding caused a sus- ment of matching and response bias (or
tained decrease in wheel running and re- preference) is not possible. Interval schedules
sponding for the opportunity to run when were programmed because these contingen-
the pre-fed amount raised body weight. cies maintain a distribution of behavior when
The present study also uses operant proce- the amount of reinforcement is different on
dures to analyze the interrelationship between the alternatives.
food and wheel-running reinforcement. In the The problem of reinforcement value or
paradigm in which activity anorexia usually is efficacy of wheel running and sucrose also is
studied, the opportunity to run and the raised by the present study. A recent experi-
opportunity to eat do not occur concurrently. ment by Belke and Hancock (2003) placed rats
Typically, animals are given the opportunity to on a single operant schedule and showed that
run in a wheel for 22.5 hr without access to 0.1 ml of a 2.5% sucrose solution maintained
food and then given the opportunity to a similar rate of responding as an opportunity
consume food without the opportunity to to run in a wheel for 15 s. At concentrations
run in the remaining 90 min—a procedure above 2.5%, responding for sucrose was
ensuring that wheel running does not com- greater; below 2.5% responding maintained
pete with eating by sucrose was less. Based on these results,
This separation of the opportunities to eat Belke and Hancock (2003, p. 253) concluded
and run removes the element of choice from that ‘‘the value of an opportunity to run for
the activity anorexia procedure. An energy 15 s was approximately equal to the value of
balance perspective would suggest that given a drop of 2.5% sucrose solution for these rats’’.
a choice between running and eating, food- Belke and Hancock’s (2003) results suggest
restricted animals would most likely choose to that, in the present study, rats exposed to
eat rather than run. That is, feeding directly a concurrent schedule of wheel running and
increases the animal’s net energy balance but sucrose would not differ in allocation of time
running is energy costly in terms of calories and behavior between an opportunity to run
used. This assumption is embodied in Collier’s for 15 s and the opportunity to consume
(1970, p. 575) statement that ‘‘since in the a 0.1 ml of 2.5% sucrose solution. If the
long run, it is better to eat than to run, sucrose concentration is greater than 2.5%,
running as we have shown, is a weak re- then more behavior would be allocated to the
inforcer’’. Food deprivation (and body weight sucrose alternative. With lower concentrations,
decline) is expected to increase the reinfor- more behavior would be allocated to the
cing value of both of these reinforcers; wheel-running alternative. Even though the
however, because the reinforcing value of duration of the opportunity to run in the
eating had greater survival and reproductive present study is 30 rather than 15 s, this
value than running, food should be preferred. prediction still holds because the reinforce-
The present study sought to examine these ment value of wheel running, as indexed by
assumptions about the relationship between preference, does not vary with duration
running and eating using a concurrent oper- (Belke, 2006).
ant procedure (see Aparicio & Baum, 1997, for Behavioral economics provides a way of
an operant approach to animal foraging). describing the allocation of behavior between
When food-deprived animals are given the commodities such as sucrose and wheel
opportunity to choose directly between run- running. For example, the imposed food
ning and eating, how will they choose? Under restriction that initiates activity anorexia can
what conditions will running be selected over be conceptualized as a substantial increase in
food and when will food be chosen over the price of food, resulting in reduced food
running? This study represents a starting point consumption. Low food consumption, in turn,
for addressing these central questions. A increases consumption of physical activity—
concurrent variable-interval schedule (conc VI suggesting that food and physical activity may
VI) of wheel running and sucrose reinforce- be economic substitutes. That is, an increase in
ment was used to investigate the possibility the price of one commodity leads to a decline
CONCURRENT SUCROSE AND WHEEL RUNNING 133
Training the animals to press for the opportu- tion of the concurrent VI VI schedules, VI
nity to run in a wheel occurred in a different schedules on both alternatives did not advance
set of running wheels equipped with retract- until the first response following the termina-
able levers (MED Associates ENV-112), a sole- tion of a reinforcer from either alternative.
noid-operated brake, and 24-V DC lights. In Variable-interval schedules also were pro-
this phase, the opportunity to run for 60 s was grammed not to advance during reinforce-
made contingent upon a single press (FR 1) of ment periods. The rats were kept on the
the retractable lever. A lever press caused the concurrent VI 30 VI 30 schedule of reinforce-
lever to retract and the brake to release. The ment for another 16 days to determine side
wheel was free to turn for 60 s. After 60 s the biases. The data from these trials were
brake was asserted and the retractable lever recorded as baseline condition data and were
extended. A session terminated when 30 used in an additional analysis in the results.
reinforcers were completed. Next the schedule The rats then were exposed to sessions in
of reinforcement was changed systematically in which only one lever was operative and presses
the following sequence: variable ratio (VR) 3, to this lever produced a drop of approximately
VR 5, and VR 9. Subjects remained on each 0.1 ml of 7.5% (w/v) sucrose solution as
schedule about 4 days before advancing to the a reinforcer. If a side bias was present, the
next schedule. nonpreferred lever was designated the lever
Following this initial training phase, the that yielded the sucrose solution. Only the
animals were moved from the wheels equipped stimulus light above the operative lever was
with the retractable levers to the wheels illuminated. When sucrose was delivered, the
equipped with the Plexiglas panels to begin chamber lights were briefly illuminated. Ses-
training on concurrent schedules of wheel- sions took place in the running wheel and
running reinforcement. They first were ex- terminated after 30 min. Five rats were ex-
posed to sessions in which only the right or left posed to the left lever being operative and 5
lever was operative. Only the stimulus light were exposed to the right lever being opera-
above the operative lever was illuminated, and tive. After 2 days on the sucrose lever, the rats
the light was briefly extinguished for 0.08 s were exposed to 2 days during which the other
when a lever press occurred. The reinforce- lever was operative and provided the opportu-
ment schedule was VI 30 s and the reinforcer nity to run for 30 s. This pattern continued for
was the opportunity to run for 30 s. When the 10 days before the rats were exposed to the
programmed interval elapsed and a response experimental conditions.
occurred on the operative lever, the stimulus
light was extinguished and the brake was Experimental Procedure
released, leaving the wheel free to turn for For the experimental conditions, both levers
30 s. The 24-V DC lights attached to the wheel were operative and both stimulus lights were
frame were illuminated during the reinforce- illuminated. The reinforcement schedule was
ment period. After 30 s, the brake was en- a modified concurrent VI 30 VI 30 schedule.
abled, the 24-V DC lights illuminating the Completion of the requirement on one lever
wheel chamber (chamber lights) were extin- provided the opportunity to run for 30 s, the
guished, and the stimulus light was illuminat- other provided a drop of sucrose solution. A
ed once more. Each animal was exposed to five nominal reinforcer duration of 1 s was as-
sessions with one lever operative, and then five sumed for the sucrose reinforcer. For half the
sessions with the other lever operative. Follow- rats, the opportunity to run was associated with
ing this, the animals were exposed to a con- the left lever; for the remaining rats, the right
current (conc) VI 30-s VI 30-s schedule for lever. Sucrose concentrations were varied over
20 days. A changeover delay (COD) of 0.5 s values of 2.5, 7.5, and 12.5 percent. Table 1
was in effect to diminish the reinforcement of shows the order of concentrations for each rat.
switching between alternatives. This relatively Sessions terminated after 60 min.
brief COD was maintained as several animals Performance at a given concentration was
were not obtaining reinforcement on both judged to be stable when three criteria were
alternatives. To prevent the long pauses that met: a) a minimum of 20 sessions was
typically follow the termination of a wheel- completed, b) the difference between the
running reinforcer from affecting the opera- highest and lowest response proportion over
CONCURRENT SUCROSE AND WHEEL RUNNING 135
Table 1
alternative that later was changed to sucrose
Order of sucrose concentrations for each rat and the reinforcement. Time values were plotted on
assignment of wheel-running (W) and sucrose (S)
reinforcers with the left (L) and right (R) levers.
a logarithmic scale because decreases in time
allocation to wheel running were less than
Sucrose concentration increases to sucrose. On a linear scale this
Rat Assignment (L/R) First Second Third
difference obscured changes in time allocation
to the wheel-running alternative.
ID1 W/S 2.5% 12.5% 7.5% Time allocation was first corrected for
ID6 S/W 7.5% 2.5% 12.5%
ID12 W/S 7.5% 2.5% 12.5%
postreinforcement pauses (PRPs) because the
ID17 W/S 7.5% 12.5% 2.5% schedules did not operate during pauses (see
ID19 S/W 12.5% 2.5% 7.5% Table 2). Median pauses usually were longer
KC4 S/W 2.5% 7.5% 12.5% following wheel running and systematically
KC8 W/S 2.5% 7.5% 12.5% decreased with concentration following wheel
KC9 S/W 12.5% 7.5% 2.5%
KC15 W/S 12.5% 7.5% 2.5% running, F(2,18) 5 7.96, p , .01, but not
KC17 S/W 7.5% 12.5% 2.5% sucrose. Table 2 shows systematic decreases in
median pauses following wheel running for
five rats; nonsystematic changes occurred in
four rats. A consequence of the decline in
the last five consecutive sessions was no greater PRPs following wheel running was an increase
than 0.05, and c) there was no trend, either in time available to allocate between the
increasing or decreasing, in the last three alternatives. At 7.5% and 12.5% concentra-
sessions. If these criteria were not met after 40 tions, time allocated between the alternatives
sessions, however, the sucrose concentration increased, on average, by 297 and 400 s.
was changed. As depicted in Figure 1, time allocated to
Lever presses, time spent on, changeovers sucrose increased with concentration, F(2,18)
to, and reinforcers obtained from each alter- 5 16.37, p , .001. Mean time allocations for
native were recorded during each session, as the 2.5, 7.5, and 12.5% concentrations were
well as number of wheel revolutions. Time on 582.45, 1067.2, and 1214.35 s, respectively.
an alternative was defined by changeovers; that Systematic increases with concentration are
is, an animal was considered being on an evident for seven rats. In contrast, time spent
alternative, and time was accumulated, until on the wheel-running alternative decreased,
a response was made on the other alternative. F(2,18) 5 12.76, p , .001, as concentration
Lever presses and time spent on the alter- increased. Mean time allocations were 584.24,
natives were used to obtain measures of 396.47, and 351.87 s, respectively. Systematic
behavior allocation. Variation in behavior decreases are evident for five rats. For the
allocation as a function of changes in sucrose remaining rats, time allocated at 12.5% was
concentration was analyzed by ANOVAs with less than at 2.5%; however, allocation at 7.5%
repeated measures. Paired t-tests were used to did not fall between the other two values—
compare measures of behavior allocation and most often it was lower than at 12.5%.
obtained reinforcers at the 2.5% sucrose Although time allocation to sucrose increased
concentration. All analyses were based on data and to wheel running decreased, the magni-
from the last five sessions at each concentra- tude of the changes differed. Typically, in-
tion (see Appendix A). creases in time allocated to the sucrose
alternative were greater than decreases to
RESULTS wheel running.
Figure 1 depicts the allocation of time Comparisons between reinforcer types
between sucrose (unfilled circles) and wheel showed that at 2.5%, 3 rats allocated more
running (filled circles) as a function of sucrose time to the sucrose alternative whereas 5
concentration for each rat. In addition, time allocated more time to wheel running. At
allocation to the two alternatives during the 7.5%, 7 rats allocated more time to sucrose. At
baseline condition when both alternatives 12.5%, 8 rats allocated more time to the
provided the opportunity to run is depicted sucrose alternative. Paired t-test comparisons
as unfilled and filled squares. The alternative showed that time allocation to the sucrose
represented by the unfilled square was the alternative was significantly higher at 7.5% and
136 TERRY W. BELKE et al.
Fig. 1. Mean time (in s) allocated to the wheel running (filled circles) and sucrose (unfilled circles) alternatives
plotted on a logarithmic scale as a function of sucrose concentration for each rat. Mean time allocations during the
baseline condition in which both alternatives produced the opportunity to run are plotted as filled and unfilled squares
along the ordinate axis. The unfilled square represents the alternative that was changed to produce sucrose
reinforcement. Standard error values are plotted for each mean. (Note: some standard errors are too small to be seen.)
CONCURRENT SUCROSE AND WHEEL RUNNING 137
Table 2
Median postreinforcement pause durations (in s) following wheel-running and sucrose
reinforcers in the 2.5, 7.5, and 12.5% concentration conditions for each rat.
12.5%, t(9) 5 23.36, p ,.01; t(9) 5 22.25, p Baseline allocations showed that with the
,.05 (both one tailed). exception of 1 rat, fewer responses were
Finally, time allocations under baseline allocated to the alternative that would be
conditions show that 7 rats allocated less time changed to sucrose. Consequently, as with
to the alternative that was changed to sucrose. time allocation, the increases in response
Consequently, an initial side bias did not play allocation with concentration were not influ-
a role in the increase in time allocation to this enced by side bias.
alternative as concentration increased. Changes in behavior allocation can yield
Figure 2 shows the equivalent data for changes in obtained reinforcement. Figure 3
response allocation. As was the case with time, depicts for each rat the number of reinforcers
responses allocated to the sucrose alternative obtained from the two alternatives as a func-
increased with concentration, F(2,18) 5 4.77, tion of concentration, as well as allocations
p , .05. Eight rats display systematic increases under the baseline condition. Usually, the
in responses allocated to the sucrose alterna- number of sucrose reinforcers increased with
tive. The remaining 2 show higher responses at concentration, F(2,18) 5 13.16, p , .001. On
12.5% than at 2.5%; however, responses at average, 25.3, 38.6, and 44.5 sucrose reinforc-
7.5% were lower and higher than at 12.5%, ers were obtained when concentrations were
respectively. With respect to the wheel-running 2.5, 7.5, and 12.5%, respectively. Eight rats
alternative, responses allocated to this alterna- showed systematic increases in obtained su-
tive decreased as concentration increased, crose reinforcers with increases in concentra-
F(2,18) 5 4.25, p , .05. Systematic decreases tion. For the remaining 2 rats, obtained
are evident for 4 rats. The remaining rats did sucrose reinforcers were not monotonically
not show monotonic decreases with higher related to sucrose concentration. In contrast,
values of sucrose concentration. As with time the number of obtained wheel-running re-
allocation, increases in responses to the inforcers did not vary systematically with
sucrose alternative were greater than decreases concentration, F(2,18) 5 0.15. On average,
to wheel running. 25.8, 25.2, and 25.4 wheel-running reinforcers
Comparisons across reinforcer types show were obtained across the 2.5, 7.5, and 12.5%
that at 2.5% 4 rats allocated similar numbers of concentrations, respectively. Across individual
responses to both alternatives. At 7.5%, more animals, no consistent pattern of changes is
responses were allocated to the sucrose alter- evident.
native by 5 rats. For the 12.5% concentration, Comparisons between the alternatives show
8 rats allocated more responses to sucrose. that two, six, and nine rats obtained more
Paired t-test comparisons showed that re- sucrose reinforcers at 2.5%, 7.5% and 12.5%
sponses allocated to the sucrose alternative concentrations, respectively. Paired t-test com-
were greater when the concentration was parisons showed that more reinforcers were
12.5%, t(9) 5 22.01, p ,.05 (one tailed.) obtained from the sucrose alternative when
138 TERRY W. BELKE et al.
Fig. 2. Mean number of responses (lever presses) allocated to the wheel running (filled circles) and sucrose (unfilled
circles) alternatives plotted on a logarithmic scale as a function of sucrose concentration for each rat. Mean response
allocations during the baseline condition in which both alternatives produced the opportunity to run are plotted as filled
and unfilled squares along the ordinate axis. The unfilled square represents the alternative that was changed to produce
sucrose reinforcement. Standard error values are plotted for each mean. (Note: some standard errors are too small to be
seen.)
CONCURRENT SUCROSE AND WHEEL RUNNING 139
the concentrations were 7.5 and 12.5%, t(9) 5 & Dunbar, 1998). The current result shows
21.86, p ,.05; t(9) 5 22.87, p ,.01 (both one that pause duration can be modified by
tailed). motivation to engage in other behaviors in
The data from the baseline condition show the context.
no systematic differences in obtained reinforc- Also of note is the pattern of increased
ers between the two alternatives when both allocation to and reinforcers obtained from
provided the opportunity to run. Figure 3 also the sucrose alternative without an equivalent
shows that when the rats were moved from the decline in obtained wheel-running reinforcers.
concurrent schedule of wheel running (base- One interpretation for this pattern is that
line) to sucrose and wheel running, the food-deprived animals are sensitive to the
number of obtained wheel-running reinforcers quality of food in their environment, but are
on the unchanged alternative increased mark- motivated also to maintain food-related travel
edly for every rat. As a result of this increase, (Pierce, 2001). In other words, food-deprived
the average numbers of obtained wheel-run- animals continue to respond for physical
ning reinforcers in the 2.5%, 7.5% and 12.5% activity rather than show exclusive preference
conditions were 84%, 82%, and 82% of the for a high-calorie alternative.
average numbers obtained in the baseline From a behavioral economic perspective,
condition (M 5 30.9). This tendency to our results suggest that food (sucrose) and
defend a level of wheel running may have physical activity (wheel running) are not
contributed to the lack of a decline in wheel- highly substitutable. If these commodities were
running reinforcers as sucrose concentration substitutes, a reduction in the price of sucrose
increased. (i.e., increase in concentration) would lead to
a marked increase in the consumption of
DISCUSSION sucrose and a marked decrease in the con-
The distribution of behavior between wheel sumption of wheel running. Although animals
running and sucrose varied systematically with moderately increased consumption of sucrose,
sucrose concentration. As concentration in- consumption of wheel running did not
creased, more behavior was allocated to change. Wheel running may be marginally
sucrose, less to wheel running. Increases for substitutable with, or be independent of,
sucrose, however, were not accompanied by sucrose.
equivalent decreases for wheel running. Sim- This qualitative analysis of the economic
ilarly, sucrose reinforcers increased while relationship between sucrose and wheel run-
obtained wheel-running reinforcers remained ning must be regarded with caution for two
unchanged. Thus, the rats were able to reasons. Interval schedules, unlike ratio sched-
reallocate behavior to obtain the sweeter, ules, are relatively insensitive to changes in
more nutritive food (sucrose) and maintain response rate. Consequently, rats could not
their levels of wheel running; they likely did easily compensate for increased concentration
this by decreasing postreinforcement pauses by reducing the rate of occurrence of wheel-
on the wheel-running alternative. running reinforcers. Also, income was not
This decline in the pause following wheel adjusted as concentration varied. To obtain
running, with increased efficacy of an alterna- only the effect of price on consumption,
tive source of reinforcement in the context, is income must be adjusted to allow the same
the first demonstration of such an effect. level of consumption at each price. Experi-
Postreinforcement pauses are of interest with ment 2 was designed to rectify these problems
this particular reinforcer because they can and provide a precise quantitative assessment
convey the effects of variables that affect the of the substitutability between sucrose and
efficacy of wheel running as a reinforcer. wheel running.
Previous research showed that postreinforce-
ment pauses following wheel running were EXPERIMENT 2
most strongly determined by body weight
(Belke, 1996, 2004) and duration of the Green and Rachlin’s (1991) procedure for
running period (Belke 1997; Belke & Dunbar, assessing the substitutability of qualitatively
1998) but weakly affected, if at all, by the different reinforcers was used to assess the
schedule of reinforcement (Belke, 1996; Belke relationship between wheel running and su-
140 TERRY W. BELKE et al.
Fig. 3. Mean number of reinforcers obtained from the wheel running (filled circles) and sucrose (unfilled circles)
alternatives plotted on a logarithmic scale as a function of sucrose concentration for each rat. Mean obtained reinforcers
during the baseline condition in which both alternatives produced the opportunity to run are plotted as filled and
unfilled squares along the ordinate axis. The unfilled square represents the alternative that was changed to produce
sucrose reinforcement. Standard error values are plotted for each mean. (Note: some standard errors are too small to be
seen.)
CONCURRENT SUCROSE AND WHEEL RUNNING 141
following equation from Green and Rachlin Constant, Quebec, served as subjects. Prior to
(1991): participating in the present study, the rats had
x=y ~ kðq=pÞm : ð1Þ been shaped to press a lever in a standard
operant conditioning chamber by students in
In Equation 1, x and y represent the responses a conditioning course. The rats were main-
allocated to the alternatives yielding reinforc- tained at a target weight that was approximate-
ers X and Y; p and q are the variable-ratio ly 85% of a free-feeding body weight taken
requirements associated with reinforcers X when the weights of the rats rose just beyond
and Y, respectively. The estimated parameters, 300 grams (i.e., adult weight). Target weights
k and m, are interpreted similarly to the varied around 260 g +/2 10 g. All other
parameters of the generalized matching equa- conditions were as specified in Experiment 1.
tion (Baum, 1974) and represent systematic
response bias and sensitivity of response Apparatus
allocation to changes in relative price (q/p), The apparatus from Experiment 1 was used
respectively. in Experiment 2.
Based on Equation 1, substitutability values
are obtained by a linear regression of the Procedure
natural log of relative response allocation, ln Training the rats to respond on a lever for
(x/y), on the natural log of the inverse of the opportunity to run and on concurrent
relative price, ln (q/p). The slope of this schedules of wheel-running reinforcement
regression is the estimate of the sensitivity followed a regimen similar to that outlined
parameter, m, in Equation 1. The estimate of in Experiment 1. Following the training phase,
substitutability, s, is calculated as m/(m +1). all rats were placed on concurrent VR 10 VR 10
The complete derivation of Equation 1 is schedules of wheel-running (30 s) and sucrose
given by Green and Rachlin (1991, pp. 140– (0.1 ml of 7.5% w/v) reinforcement. For half
141) and is based on maximization of the the rats, sucrose was on the right; for the other
utility from different combinations of two half, sucrose was on the left. PRPs following
commodities (reinforcers). wheel-running reinforcers were measured, and
The interpretation of substitutability (s) a 2.5-s pause was programmed to follow
depends on its value. A negative value, s , 0, sucrose delivery, allowing for consumption.
indicates that the two reinforcers are comple- The budget for this initial condition was 600
ments. A value of s 5 0 indicates that the lever presses.
commodities are independent. A positive When performance on the initial condition
value, s . 0, indicates substitutability. Degree was judged stable, two additional conditions
of substitutability between two commodities is were arranged in which the schedule values
captured by the value of s within the range of were VR 20 VR 5 and VR 5 VR 20. The order of
0 , s , 1. As s approaches 1, commodities presentation of these additional conditions
approach complete substitutability. For exam- was counterbalanced across rats. A budget for
ple, sucrose completely substitutes for sucrose each rat for each additional condition was
as wheel running does for wheel running, but calculated. To obtain the budget for a condi-
sucrose may only be a partial or incomplete tion, the number of reinforcers obtained on
substitute for wheel running. In Experiment 2, each alternative in the initial condition was
rats were exposed to concurrent VR schedules multiplied by the VR value for that alternative
of sucrose and wheel-running reinforcement, in the new condition. The sum of these
wheel-running and wheel-running reinforce- products was the budget for the new condi-
ment, and sucrose and sucrose reinforcement tion. For example, if a rat obtained 10
to assess the substitutability between these reinforcers on the left VR 10 schedule in the
qualitatively similar and different reinforcers. initial condition and the schedule value for
this alternative in the new condition was VR
METHOD 20, then the 10 obtained reinforcers were
Subjects multiplied by 20 to obtain a value of 200. On
Fifteen female Long-Evans rats obtained the right alternative in the initial condition,
from Charles River Breeding Laboratories, St. the rat would have obtained 50 reinforcers on
CONCURRENT SUCROSE AND WHEEL RUNNING 143
Table 3
Mean responses, time (in s), reinforcers, changeovers, and wheel revolutions on the left (L) and
right (R) alternatives from the 9 sessions that met the stability criteria for each concurrent ratio
schedule for the sucrose–wheel, wheel–wheel, and sucrose–sucrose reinforcer combinations for
the group of rats that completed all conditions. Time spent lever pressing is exclusive of
reinforcer and postreinforcement pause durations. Average session time in minutes (ST) also
is provided.
the VR 10 schedule and the new schedule for repeated again with sucrose on both alterna-
this alternative was VR 5, then 50 reinforcers tives. All aspects of the procedure were the
multiplied by the 5 would produce a value of same with the exception that the budget in the
250. Consequently, the budget for the new initial condition was 400 rather than 600 lever
condition for this rat would be 200 plus 250 for presses. This change occurred to ensure that
a total of 450 lever presses. sessions with wheel running on both alter-
Budget values calculated in this manner natives would not be prohibitively longer than
ensured that the budget lines for the addi- sessions with wheel running and sucrose.
tional conditions crossed the budget line from Each condition remained in effect until
the initial condition, at the point representing a number of stability criteria were met. First,
the subjects’ initial allocation of obtained a minimum of 20 sessions had to occur before
reinforcers from the two alternatives. A budget performance could be judged stable. After 20
line was defined as the line representing all sessions, response proportions from the last
possible combinations of obtained reinforcers nine sessions were divided into three groups of
from the two alternatives, given the constraints three sessions and the average for each group
of the budget and the schedule values on the was calculated. The difference between the
two alternatives. This line would be located in highest and the lowest average response
a space defined by reinforcers obtained on the proportions had to be equal to or less than
right alternative along the abscissa and re- 0.05 and there could be no trend across the
inforcers obtained on the left on the ordinate. three averages. When these three criteria were
For the initial condition, the budget line met, performance was judged to be stable.
would run from an endpoint value on the Dependent measures were the same as in
abscissa representing all reinforcers obtained Experiment 1.
on the right alternative (i.e., 600/10 5 60) and
none on the left (0/10 5 0) to an endpoint on RESULTS
the ordinate representing no reinforcers ob- Table 3 shows the results averaged over the
tained on the right alternative (0/10 5 0) and nine sessions that met the stability criteria; the
all reinforcers obtained on the left (600/10 5 results are shown for each condition of each
60). combination of reinforcers for the group. Data
Following completion of the conditions with for individual animals are shown in Appen-
concurrent schedules of wheel running and dix B. Rats BZ 1, BZ 3, and BZ 8 failed to
sucrose reinforcement, the same three condi- complete all conditions across the three re-
tions (initial plus two additional) were re- inforcer combinations due to health reasons;
peated with wheel-running reinforcement on consequently, data from these rats were not
both alternatives. Finally, the conditions were included in subsequent analyses.
144 TERRY W. BELKE et al.
Figs. 6a and 6b. Mean number of wheel-running and sucrose reinforcers consumed under the three different price/
budget conditions for the sucrose–wheel-running reinforcer combination for each rat and the group. The group graph
displays the data from the 12 rats that completed all three conditions across all three combinations of reinforcer types.
Arrows indicate consumption amounts that would have yielded the determination that the commodities were
independent; these values were derived by generating distributions that would have produced a substitutability value
of zero.
the substitutability value from the expected 1.0 native may be, other alternatives are occasion-
value. Consequently, observed substitutability ally sampled’’ (p. 141).
values for a commodity with itself are likely to Changes between alternatives also reflect
fall below 1.0. For example, Green and Rachlin the degree of sensitivity to the contingencies of
(1991) obtained substitutability values of .72 reinforcement. That is, a high level of switch-
and .73 for two rats when both alternatives ing is associated with low sensitivity to the ratio
programmed ratio schedules of electrical contingencies and, presumably, lower ob-
brain stimulation—attributing these substitu- served substitutability values. The relationship
tion values to ‘‘a tendency to alternate, which between switching and substitutability values is
ensures that, however advantageous one alter- evident from correlations between the per-
146 TERRY W. BELKE et al.
Figs. 7a and 7b. Mean number of wheel-running reinforcers consumed under the three different price/budget
conditions for the wheel-running–wheel-running reinforcer combination for each rat and the group. The group graph
displays the data from the 12 rats that completed all three conditions across all three combinations of reinforcer types.
Arrows indicate consumption amounts that would have yielded the determination that the commodities were
independent; these values were derived by generating distributions that would have produced a substitutability value
of zero.
centages of responses that were changeovers Table 4 shows the percentage of the total
on the conc VR 10 VR 10 schedule and responses that were changeover responses
obtained substitutability values. For the calculated for each set of concurrent ratio
wheel–wheel and sucrose–sucrose combina- requirements for the sucrose–wheel, wheel–
tions, the correlations were 2.75 (p 5 .005) wheel, and sucrose–sucrose combinations for
and 2.68 (p 5 .015), respectively. However, each rat. For the sucrose–sucrose arrange-
substitutability values obtained for the su- ment, the mean percentages of total responses
crose–wheel arrangement were not significant- that were changeovers for the conc VR 10 VR
ly correlated with switching on the conc VR 10 10, conc VR 5 VR 20, and conc VR 20 VR 5
VR 10 schedule, r (12) 5 0.16. conditions were 16.0, 12.0, and 12.4, respec-
CONCURRENT SUCROSE AND WHEEL RUNNING 147
Figs. 8a and 8b. Mean number of sucrose reinforcers consumed under the three different price/budget conditions
for the sucrose–sucrose reinforcer combination for each rat and the group. The group graph displays the data from the
12 rats that completed all three conditions across all three combinations of reinforcer types. Arrows indicate
consumption amounts that would have yielded the determination that the commodities were independent; these values
were derived by generating distributions that would have produced a substitutability value of zero.
tively. For the wheel–wheel combination, the mean percentages were 29.0, 19.3, and 27.2,
equivalent percentages were 28.7, 29.2, and respectively. The level of switching for the conc
29.4, respectively. The percentage of change- VR 10 VR 10 condition was the same as that
overs in the conc VR 10 VR 10 wheel–wheel when both reinforcers were wheel running. In
condition was almost twice the percentage for addition, switching diminished when the re-
the same schedule when sucrose was the sponse requirement for sucrose was reduced,
reinforcer on both alternatives, t(11) 5 4.13, t(11) 5 3.26, p 5 .008, but did not diminish
p , .002. The higher level of changing over when the requirement for wheel running was
may account for the lower substitutability reduced.
values for the wheel–wheel combination rela- The data from the sucrose–sucrose combi-
tive to those for the sucrose–sucrose combina- nation across rats are presented in Appendix B
tion. For the sucrose–wheel combination, the and suggest that side biases may have played
148 TERRY W. BELKE et al.
Table 4
Percentage of total responses that were changeover responses for the concurrent VR 10 VR 10,
VR 5 VR 20, and VR 20 VR 5 conditions for the sucrose–wheel, wheel–wheel, and sucrose–sucrose
arrangements for each rat.
Table 5
Local response rate (lever presses/min) and time (min) to complete 400 lever presses in the
concurrent VR 10 VR 10 conditions for the wheel–wheel and sucrose–sucrose combinations for
each rat. Also presented are local response rate and obtained reinforcers on the sucrose and
wheel running alternatives from the concurrent VR 10 VR 10 condition of the sucrose–wheel
combination for each rat.
economic conditions (budgets and prices) stitute for wheel running. Previous research
affected the number of wheel-running re- assessing the substitutability of food and water
inforcers obtained, as well as the rate of wheel also showed asymmetrical relations (Allison &
running per opportunity. As the number of Mack, 1982; Rachlin & Krasnoff, 1983). Water
opportunities to run increased, animals de- substituted for food when rats were food
creased the rate of running per opportunity; in deprived; however, when the rats were water
contrast, as the number of opportunities deprived, the two commodities were comple-
decreased, the rates of running increased. ments (less water and food consumed). The
Overall, the animals appear to compensate current results also indicate that substitutabil-
for changes in the number of wheel-running ity values for sucrose–sucrose were greater
opportunities imposed by the economic con- than for the wheel–wheel combination with
straints by adjusting their rates of running per both arrangements falling below the expected
opportunity. value for perfect substitutes. The data for
Lastly, for the conc VR 10 VR 10 condition of changeovers show that rats have a higher
the sucrose–wheel combination, the type of tendency to switch between alternatives when
reinforcer obtained for the first 10 reinforcers the reinforcer is wheel running than when it is
of the session was assessed. Average percent- sucrose. The difference in switching appears to
ages of sucrose reinforcers obtained for the account for the lower substitutability values of
first to the tenth reinforcers were 47, 55, 56, the wheel–wheel arrangement relative to the
57, 56, 51, 53, 53, 49, and 56. Thus, at the sucrose–sucrose combination.
beginning of a session, animals were just as In terms of changeovers, Belke and Belli-
likely to obtain wheel running as they were to veau (2001) also observed high levels of
obtain sucrose. Although food deprived, these switching for rats on concurrent VI schedules
animals were not consuming and sating on of wheel-running reinforcement, using the
sucrose before choosing to run. apparatus from the current study. Across the
different schedule combinations investigated,
DISCUSSION the mean percentage of total responses that
The results from Experiment 2 show that were changeover responses was 27.4%. When
sucrose and wheel running have complex response allocations were corrected for change-
interrelationships. In terms of the economic overs by subtracting one response from each
relation, the findings suggest partial substitut- alternative for every changeover from that
ability and asymmetry in the relationship– alternative, the difference in sensitivity be-
wheel running is independent of sucrose tween response and time allocation disap-
whereas sucrose functions as a partial sub- peared.
150 TERRY W. BELKE et al.
Table 6
Substitutability values, uncorrected (U) and corrected (C) for changeovers, for the sucrose–
wheel, wheel–wheel, and sucrose–sucrose combinations for each rat that completed
all combinations.
To assess whether the difference in sub- observed when both alternatives provided
stitutability values between wheel running and sucrose. This higher alternation in the su-
sucrose was due to high levels of switching, the crose–wheel arrangement on ratio schedules
same correction was applied to the data from may explain the animals’ switching on the
the present study. Response allocations were modified concurrent VI VI schedules of
corrected by subtracting the number of Experiment 1; that is, by switching between
changeovers for each alternative from the alternatives, the rats were able to maintain the
response allocation to that option; this correc- obtained number of wheel-running reinforcers
tion was done for each of the ratio-schedule against increasing concentrations of sucrose.
conditions for each rat. Reinforcer allocations On the concurrent VI schedules, a high
were adjusted for the reduction in responses to frequency of visits to both alternatives (with
each alternative with the constraint that the sufficient responses to exceed the changeover
prices (responses/reinforcer) remain the requirements) would allow animals to obtain
same as they were for the uncorrected data. most, if not all, of the reinforcers set up on the
Substitutability values were then calculated for schedules. In Experiment 1, the mean per-
the corrected data. Table 6 shows the cor- centages of responses that were changeovers
rected values. Mean substitutability values for for the 2.5%, 7.5%, and 12.5% sucrose
the sucrose–wheel, wheel–wheel, and sucrose– concentration conditions were 25.7, 21.2, and
sucrose combinations based on changeover 21.0, respectively. A repeated measures AN-
corrected data were .22, .54, and .57. Paired t- OVA revealed no effect of concentration on
test comparisons showed that with the correc- the percentage of responses that were change-
tion for switching, substitutability values for overs, F(2,18) 5 1.97, ns. This insensitivity of
the wheel–wheel and sucrose–sucrose condi- changeovers to sucrose concentration allowed
tions were no longer significantly different. the rats to regulate their opportunities for
Correction for changeovers, however, did not wheel running even when the sweetness and
alter substantially the substitutability values for caloric value of the sucrose alternative im-
the sucrose–wheel arrangement. Nor did it proved.
affect the asymmetry in economic relations In addition to changeovers, Belke and
between sucrose and wheel running. Belliveau (2001) noted low response rates
It also is important to note that when the generated by, and long PRPs following,
rats chose between sucrose and wheel-running wheel-running reinforcement. In the present
reinforcers, their switching resembled the study, we also observed low response rates for
higher level observed for the wheel–wheel wheel-running reinforcement compared to
arrangement rather than the lower level response rates for sucrose. Although not
CONCURRENT SUCROSE AND WHEEL RUNNING 151
reported in Table 3, PRPs were longer follow- In terms of wheel running, the results
ing wheel running than sucrose reinforce- showed that animals adjust their wheel-run-
ment. For example, in the conc VR 10 VR 10 ning rates to compensate for the economic
condition of the sucrose–wheel arrangement, constraints on the opportunities to run. As the
mean PRPs following wheel running and number of obtained reinforcers decreased,
sucrose reinforcers were 14.5 and 3.7 s, re- rate of running increased. Similar compensa-
spectively. Further research is required to tory changes in wheel-running rate occur with
investigate the effect of differences in response changes in the duration of an opportunity to
rates, PRPs, and changeovers between wheel- run (Belke, 1997; Belke & Hancock, 2003). As
running and sucrose reinforcement on choice the duration of an opportunity to run
between these commodities. One possibility is decreases, running rate increases. In both
that the stimulus context of the wheel cham- cases, animals alter the level of physical activity
ber is integral to wheel-running reinforce- in accord with the environmental constraints
ment, but plays a less salient role for tradition- placed on wheel running. One possibility is
al reinforcers such as sucrose. that the changes in wheel-running rate allow
In terms of choice and preference, the food-deprived animals to defend a level of
results showed that the animals’ rates of physical activity (Pierce, 2001). Another impli-
responding for wheel running and sucrose as cation is that changes in wheel-running rates
separate reinforcers did not predict choice within opportunities to run may affect operant
between these commodities. When given the responding for opportunities to run (Belke,
opportunity to consume sucrose, animals 1997; 2000). Finally, changes in wheel-running
responded at much higher rates than when rates imply that economic constraints affect
given the opportunity to run; however, when consumption in two ways–regulating the fre-
offered together, animals did not prefer quency of purchases (number of obtained
sucrose over wheel running. Furthermore, opportunities) as well as the rate of use (wheel-
differences in response rates observed when running rates) within each purchase.
the reinforcers were separately assessed dis-
appeared when they were combined. Recently,
GENERAL DISCUSSION
we have taken photographs of an animal
pressing a lever for opportunities to run on A major finding of the present study is that
a wheel. The rat tended to move up the side of wheel running does not substitute for sucrose
the braked wheel and then quickly move down on concurrent ratio schedules of reinforce-
and press the lever. This behavior probably was ment. Our result apparently contradicts
reinforced intermittently when lever pressing Broocks et al.’s (1990) hypothesis (and obser-
met the schedule requirement, released the vation) that hyperactivity compensates for
brake, and provided the highly motivated neurotransmitter changes in NE and DA
animal with a ‘‘running start’’. One implica- induced by semi-starvation. One possibility,
tion of the behavioral sequence would be to resolving the differences between the studies,
reduce the animal’s response rate for wheel is that the relationship between food con-
running. Assuming that sucrose reinforcement sumption and physical activity depends on
does not generate a similar behavioral se- regulation by a third variable—body weight. In
quence (i.e., the animal remains stationary in an experiment by Pierce et al., (1986) using
front of the lever while pressing), the response a progressive-ratio schedule of reinforcement,
rate engendered by sucrose would be higher rats responded more for bouts of wheel
than for wheel running. This difference in running at 75% body weight than at 100% of
topography of responding also would account free-feeding weight—indicating that the re-
for the lower asymptotic response rate gener- inforcement value of physical activity increases
ated by wheel-running reinforcement com- with food deprivation and weight loss.
pared with sucrose (Belke, 1998). Further In a recent experiment by Belke (2004), the
research is necessary to substantiate these role of body weight in the regulation of the
presumed differences in topography and re- reinforcement value of both wheel running
sponse rates established by contingencies of and food was clarified. Rats at low body weight
sucrose and wheel-running reinforcement ar- initiated responding sooner, and responded
ranged within the context of a running wheel. faster, in the presence of stimuli signaling
152 TERRY W. BELKE et al.
upcoming opportunities to run or consume Another major finding from the present
sucrose. As body weight approached free- study is that sucrose partially substitutes for
feeding levels, the effect on behavior differed wheel running. This finding may be relevant to
depending on the nature of the reinforcer the cessation of activity that occurs as food
(wheel or sucrose). Although rates of response availability increases in a location or patch.
changed to a similar degree for the wheel and Belke et al. (2004) showed that prefeeding an
food reinforcement, the probability of initiat- animal before a session of responding for an
ing a response for wheel running (given opportunity to wheel run produced a transient
a signaled opportunity) decreased more with decrease in running and responding—a find-
gains in body weight compared to sucrose. As ing in accord with the partial substitutability of
weight approached ad libitum levels, the in- sucrose for wheel running. When prefeeding
centive value of a stimulus predicting food increased body weight, however, substantive
remained considerably higher than for a stim- and sustained decreases in running and lever
ulus signaling wheel running. pressing for running occurred. The partial
In the natural habitat, animals attain free- substitutability of food for physical activity may
feeding weight only when food is abundant be a mechanism that underlies the cessation of
and at these times food-related travel di- activity anorexia.
minishes. As food supply is reduced by famine One limitation of our study is that the
or drought, body weight declines driving up control of body weight through postsession
physical activity that in turn reduces feeding in feeding (i.e., an open economy) has implica-
a location or patch. Adiposity and level of tions for assessing the economic effects of food
energy stores, as reflected by body weight, restriction. In the open economy of our
appear to play a key role in regulating level of experiment, the price of food has two compo-
physical activity and food intake as food supply nents: the price of food during the session
changes. An implication of regulation by body (earned food) and the free food supplied
weight is that economic constraints on con- outside the experimental session. Let’s say that
sumption may be limited by animals’ long- the price of the earned food is X and the price
term level of food deprivation. In other words, of the free food is zero so the average price of
if body weight regulates food consumption food must be less than X. If free food is now
and activity, then economic constraints may restricted and more is earned during the
compete with body weight in affecting con- session, some formerly free food now costs X,
sumption of these two commodities. As a re- so the average price of food must go up. In the
sult, changes in economic constraints may natural environment, there is no free food
not yield all possible bundles of these (i.e., closed economy) and depletion of a food
two commodities–from all sucrose with no source or patch means that animals must do
wheel running to all wheel running with no more work to obtain the same amount of food
sucrose. and caloric content. One implication is that
In the present study, body weight was food restriction in everyday habitats directly
controlled and maintained at 85% of free- affects the price of food, but the limiting of
feeding adult weight (400 g for males, 300 g food outside the session in our experiment
for females). Due to postsession feeding, only indirectly altered the overall cost of food.
changes in the consumption of sucrose during If animals earned all of their food in the
reinforcement periods did not translate into operant chamber (e.g., Collier & Johnson,
changes in body weight that would lower 1997) then the effects of food restriction
animals’ consumption of wheel running. In would parallel more closely the economic
order to investigate the effect of body weight situation faced by foraging animals in the wild.
on wheel running and food consumption, the
relationship between wheel running and su- Extension to Activity Anorexia
crose would need to be assessed at different With respect to the phenomenon of activity
body-weight levels. Future research should use anorexia, the current results showed that when
concurrent ratio schedules to investigate sub- given a choice between running and eating,
stitutability between sucrose and wheel run- hungry rats did not abandon running. The
ning when animals are maintained at 75 and contingencies of reinforcement of this study
95 percent of their free-feeding weights. allowed the rats to respond exclusively to one
CONCURRENT SUCROSE AND WHEEL RUNNING 153
alternative—but exclusive preference did not ment differed for the two manipulations—
develop. Additionally, there was no require- concurrent modified VI VI schedules for the
ment that the rats run on their wheels during concentration manipulation and concurrent
the reinforcement period. However, the food- VR VR schedules for the frequency manipula-
deprived animals maintained a level of run- tions—frequency had a greater effect on the
ning while shifting more time and behavior to distribution of behavior than did concentra-
the sucrose alternative, obtaining a greater tion.
number of sucrose reinforcers. These findings Sensitivity to the frequency or density of
and considerations have implications for an food in a location may be one way that animals
analysis of activity anorexia based behavior eventually stop a food-related trek (Johnson,
principles and considerations of evolution and Triblehorn, & Collier, 1995). In natural
natural selection (Epling & Pierce, 1991; habitats, food quality and quantity do not
Epling et al., 1983; Pierce, 2001). necessarily occur together—high quality food
During times of famine, there would be a net (high caloric value) can be either prevalent or
negative energy balance between foraging for sparse. Unless food items occur at high
small, less-preferred, and difficult-to-obtain frequency, improvement in body weight and
food items and traveling to a more-abundant energy reserves would not be sustained and
food source (see marginal value theorem the search for food should continue. The
(MVT), Charnov, 1976; qualitative predictions general implication is that density is a better
of MVT are well supported by research; predictor of food availability than quality when
quantitative predictions have been less accu- animals are on an extended food-related trek.
rate, Nonacs, 2001). Reduction of food supply
(increased price) would have increased loco- REFERENCES
motion or travel mostly through its local
effects on body weight and energy stores. Allison, J., & Mack, R. (1982). Polydipsia and autoshaping:
Drinking and leverpressing as substitutes for eating.
Longer-term reduction of body weight would Animal Learning & Behavior, 10, 465–475.
have instigated and maintained food-related Aparicio, C. F., & Baum, W. M. (1997). Comparing
travel of foraging animals, or the wheel locomotion with lever-press travel in an operant
running of our experimental rats (Belke et simulation of foraging. Journal of the Experimental
Analysis of Behavior, 68, 177–192.
al., 2004; Pierce, 2001). In everyday niches, Baum, W. M. (1974). On two types of deviation from the
increasing contact with food (new patch) matching law: Bias and undermatching. Journal of the
would have resulted in reduction of travel, an Experimental Analysis of Behavior, 22, 231–242.
increase in body weight, and termination of Belke, T. W. (1996). The effect of a change in body weight
the food-related trek. The partial substitutabil- on running and responding reinforced by the
opportunity to run. The Psychological Record, 46,
ity of sucrose for wheel running in the present 421–433.
study reflects one aspect of two energy-balance Belke, T. W. (1997). Running and responding reinforced
processes; the initiation and maintenance of by the opportunity to run: Effect of reinforcer
travel induced by loss of body weight and duration. Journal of the Experimental Analysis of Behavior,
67, 337–351.
energy stores (wheel running does not sub- Belke, T. W. (1998). Qualitatively different reinforcers and
stitute for food) and the termination of parameters of Herrnstein’s (1970) response-strength
locomotion as food supply increases (food equation. Animal Learning & Behavior, 26, 235–242.
does substitute for wheel running). Belke, T. W. (2000). Studies of wheel-running reinforce-
ment: Parameters of Herrnstein’s (1970) response-
In the present study, rats maintained their strength equation vary with schedule order. Journal of
level of wheel running (Collier & Hirsch, 1971; the Experimental Analysis of Behavior, 73, 319–331.
see also Sherwin, 1998 for similar behavior in Belke, T. W. (2004). Responding for sucrose and wheel-
mice) even as the quality (concentration of running reinforcement: Effect of body weight manip-
sucrose) and frequency (obtained sucrose ulation. Behavioural Processes, 65, 189–199.
Belke, T. W. (2006). Concurrent schedules of wheel-
reinforcers) of food improved—presumably, running reinforcement: Choice between different
because the nutritional changes did not durations of opportunity to run. Learning and Behav-
alleviate deprivation or increase body weight. ior, 34, 61–70.
At the same time, the rats showed sensitivity to Belke, T. W., & Belliveau, J. (2001). The generalized
matching law describes choice on concurrent variable-
the changes in quality and frequency of food interval schedules of wheel-running reinforcement.
in their environment (Redhead & Tyler, Journal of the Experimental Analysis of Behavior, 75,
1988). Although the schedules of reinforce- 299–310.
154 TERRY W. BELKE et al.
Belke, T. W., & Dunbar, M. (1998). Effects of fixed-interval Green, L., & Rachlin, H. (1991). Economic substitutability
schedule and reinforcer duration on responding of electrical brain stimulation, food, and water. Journal
reinforced by the opportunity to run. Journal of the of the Experimental Analysis of Behavior, 55, 133–143.
Experimental Analysis of Behavior, 70, 69–78. Johnson, D. F., Triblehorn, J., & Collier, G. (1995).
Belke, T. W., & Hancock, S. D. (2003). Responding for Rats’meal-ending rules in depleting patches. Animal
sucrose and wheel-running reinforcement: Effects of Behaviour, 49, 1707–1709.
sucrose concentration and wheel-running reinforcer Nonacs, P. (2001). State-dependent behavior and the
duration. Journal of the Experimental Analysis of Behavior, marginal value theorem. Behavioral Ecology, 12, 71–83.
79, 243–265. Pierce, W. D. (2001). Activity anorexia: Biological, behav-
Belke, T. W., Pierce, W. D., & Jensen, K. (2004). Effect of ioral, and neural levels of selection. Behavioral and
short-term prefeeding and body weight on wheel Brain Sciences, 24, 551–552.
running and responding reinforced by the opportu- Pierce, W. D., Epling, W. F., & Boer, D. P. (1986).
nity to run in a wheel. Behavioural Processes, 67, 1–10. Deprivation and satiation: The interrelations between
Broocks, A., Liu, J., & Pirke, K. M. (1990). Semistarvation- food and wheel running. Journal of the Experimental
induced hyperactivity compensates for decreased Analysis of Behavior, 46, 199–210.
norepinephrine and dopamine turnover in the
Rachlin, H., & Krasnoff, J. (1983). Eating and drinking: An
mediobasal hypothalamus of the rat. Journal of Neural
economic analysis. Journal of the Experimental Analysis of
Transmission, 79, 113–124.
Behavior, 39, 385–404.
Charnov, E. L. (1976). Optimal foraging: The marginal
Redhead, E., & Tyler, P. A. (1988). An experimental
value theorem. Theoretical Population Biology, 9,
129–136. analysis of optimal foraging behaviour in patchy
Collier, G. H. (1970). Work: A weak reinforcer. Transac- environments. Quarterly Journal of Experimental Psychol-
tions of the New York Academy of Sciences, 32, 557–576. ogy B: Comparative and Physiological Psychology, 40,
Collier, G. H., & Hirsch, E. (1971). Reinforcing properties 83–102.
of spontaneous activity in the rat. Journal of Compar- Routtenberg, A. (1968). ‘‘Self-starvation’’ of rats living in
ative and Physiological Psychology, 77, 155–160. activity wheels: Adaptation effects. Journal of Compar-
Collier, G., & Johnson, D. F. (1997). Who is in charge? ative and Physiological Psychology, 66, 234–238.
Animal vs experimenter control. Appetite, 29, 159–180. Routtenberg, A., & Kuznesof, A. W. (1967). Self-starvation
Epling, W. F., & Pierce, W. D. (1991). Solving the anorexia of rats living in activity wheels on a restricted feeding
puzzle: A scientific approach. Toronto: Hogrefe and schedule. Journal of Comparative and Physiological
Huber. Psychology, 64, 414–421.
Epling, W. F., & Pierce, W. D. (1996). Activity anorexia: Sherwin, C. (1998). The use and perceived importance of
Theory, research, and treatment. Mahwah, NJ: Erlbaum. three resources which provide caged laboratory mice
Epling, W. F., Pierce, W. D., & Stefan, L. (1983). A theory the opportunity for extended locomotion. Applied
of activity-based anorexia. International Journal of Animal Behaviour Science, 55, 353–367.
Eating Disorders, 3, 27–46.
Green, L., & Freed, D. E. (1993). The substitutability of
reinforcers. Journal of the Experimental Analysis of Received: November 22, 2005
Behavior, 60, 141–158. Final acceptance: April 26, 2006
CONCURRENT SUCROSE AND WHEEL RUNNING 155
APPENDIX A
Mean responses, time (in s), reinforcers, changeovers (CO), and revolutions for the wheel (W)
and sucrose (S) alternatives for each sucrose concentration for each rat. The schedule of
reinforcement was a modified concurrent VI 30-s VI 30-s schedule. Sessions (Sess) to stability for
each schedule also are provided. Base refers to the baseline condition in which both alternatives
produced the opportunity to run for 30 s. This condition occurred prior to changing one of the
alternatives to sucrose reinforcement. The alternative that was changed to sucrose reinforcement
is listed under ‘‘S’’.
APPENDIX B
Mean responses, time (in s), reinforcers, and revolutions on the left (L) and right (R)
alternatives from the nine sessions that met the stability criteria for each concurrent ratio
schedule for the sucrose–wheel, wheel–wheel, and sucrose–sucrose reinforcer combinations for
each rat. Time spent lever pressing is exclusive of reinforcer and postreinforcement pause
durations. Average total changeovers (CO), average session time in minutes (ST), and number of
sessions to stability (SS) also are provided.
APPENDIX B
(Continued )
APPENDIX B
(Continued )