Professional Documents
Culture Documents
Hursh 2008
Hursh 2008
The strength of a rat’s eating reflex correlates with hunger level when strength is measured by the
response frequency that precedes eating (B. F. Skinner, 1932a, 1932b). On the basis of this finding,
Skinner argued response frequency could index reflex strength. Subsequent work documented difficulties
with this notion because responding was affected not only by the strengthening properties of the
reinforcer but also by the rate-shaping effects of the schedule. This article obviates this problem by
measuring strength via methods from behavioral economics. This approach uses demand curves to map
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
how reinforcer consumption changes with changes in the “price” different ratio schedules impose. An
This document is copyrighted by the American Psychological Association or one of its allied publishers.
exponential equation is used to model these demand curves. The value of this exponential’s rate constant
is used to scale the strength or essential value of a reinforcer, independent of the scalar dimensions of
the reinforcer. Essential value determines the consumption level to be expected at particular prices and
the response level that will occur to support that consumption. This approach permits comparing
reinforcers that differ in kind, contributing toward the goal of scaling reinforcer value.
An enduring goal of learning theory has been to define a Response Rate as Strength
measure capable of indexing the strength or value of a rein-
forcer—a pursuit that may be called “hedonic scaling” (Miller, In reviewing the history of the concept of the reflex, Skinner
1976). Evidence of this pursuit can be seen across the discipline (1931) argued that a single organizing principle can be discerned:
(Hull, 1943; Pavlov, 1927; Skinner, 1938). Its stature may From Descartes to Sherrington, the reflex has always referred to a
explain why it became the subject of Skinner’s first research correlation between a stimulus and a response. To demonstrate the
effort. Despite this focus, the goal of hedonic scaling has yet to utility of this correlation to a science of behavior, Skinner (1932a)
be realized. mapped the relation between hunger drive and the eating reflex by
The purpose of the present article is to add our efforts to presenting hungry rats with food pellets and measuring how the
those of others. To anticipate some of our claims, we have rate of food consumption changed as a function of time since
adopted the language, methods, measures, and analyses of mi- beginning eating. He thought that as a superordinate proxy for the
croeconomics—a discipline honed by studying human consum- components of the eating reflex, changes in the degree of hunger
ers in their natural setting—which may bring us closer to would surely be reflected in orderly and continuous changes in the
creating a hedonic scale than efforts heretofore. Realizing this rate of pellet consumption. He was not disappointed: He found that
goal requires some changes in how we do an experimental for hungry rats, the rate of food consumption was a smooth,
analysis of behavior. However, once this is done, an economic monotone-decreasing, positively accelerated function of the time
equation can be offered that seems capable of yielding a cred- spent eating.
ible ordering of the values of different reinforcers and predict- Next, Skinner (1932b) repeated this experiment, this time with
ing their impact on behavior. We begin with a brief history of a lever press preceding initiation of the eating reflex. Despite the
the pursuit of an index of strength in the experimental analysis addition of an initial member to the reflex chain, the function
of behavior. relating the rate of pellet consumption to time spent eating was
unchanged from his prior experiment. This meant that the rate of
pellet consumption, an index of reflex strength, could itself be
measured in terms of the lever press. From this observation was
Steven R. Hursh, Institutes for Behavior Resources, Baltimore, Mary- born the notion that response rate can measure reflex strength
land, and School of Medicine, Johns Hopkins University; Alan Silberberg, (Skinner, 1932b, 1938). Ironically, 70 years of experimental anal-
Department of Psychology, American University. ysis return us to a conception of strength not far from Skinner’s
We thank Gail Winger and James Woods for their generous support (1932a). Our only qualification to his view is that consumption
through National Institutes of Health Grant DA 015449 and the use of must be scaled in relation to constraint.
many of their data sets for development of our concepts. We thank Stephen Despite his early endorsement of rate as an index of reflex
Lea for his very helpful insights and thoughtful comments on earlier
strength, Skinner devoted little space in subsequent writing to this
versions of this article. We thank David R. Williams for his observations
on the history of the notion of operant strength. We thank Edmund Fantino
topic, perhaps because his own research showed a strength con-
for his helpful comments on exponential demand. struct to be problematic. In Ferster and Skinner (1957), multiple
Correspondence concerning this article should be addressed to Steven R. data sources confirmed that response rate itself can be shaped
Hursh, Institutes for Behavior Resources, 2104 Maryland Avenue, Balti- directly by reinforcement, causing, for example, ratio schedules to
more, MD 21218. E-mail: srhursh@ibrinc.org support higher response rates than interval schedules, even when
186
EXPONENTIAL MODEL OF DEMAND 187
the rates of reinforcement for these different types of schedules are traditional operant analysis, but the connectedness of this work to
the same (pp. 399 – 407; also see discussion of tandem schedules operant analysis cannot be denied.
and differential reinforcement, pp. 415–502). The problem is clear: To illustrate this new approach, we consider a “behavioral
How can response rate index reflex strength when the value it economic” experiment by Elsmore, Fletcher, Conrad, and Sodetz
assumes is governed not solely by the reinforcer but also by the (1980). In one experiment from their study, baboons chose be-
local contingencies of reinforcement? tween food and infusions of heroin under a range of conditions: At
one extreme, income was high (they had many choices to “spend”
per day), and at the other, income was low (they had only a few
Relative Response Rate as Strength choices per day). Under the former condition, monkeys chose
more heroin than food, but under the latter condition, this prefer-
Herrnstein (1970) noted that relative response rate, the measure
ence tended to reverse. More recently, identical shifts in preference
used in choice, was more sensitive to changes in reinforcer rates
between two commodities have been shown with human subjects
than was the single-schedule approach advanced by Skinner. He
under conditions of increasing price (Bickel & Madden, 1999;
noted that although Skinner’s single-schedule measure can suc-
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
assumption is central to the methods this article proposes regarding work required to produce it. Often, this means plotting the number
how to assess a reinforcer’s strength. of reinforcers earned per day as a function of price, with price
defined as the number of responses an animal must make under an
Behavioral Momentum as Strength FR schedule in order to produce a reinforcer. When microecono-
mists plot consumption as a function of price, they call that
A recent analogic addition to the mix of measures of strength function a demand curve. In their approximations to microeco-
has been offered by Nevin (1992; also see Nevin & Grace, 2000). nomics, behavioral economists use the same language.
In their scheme, response rate is an analogue of the velocity of a To ensure the integrity of its links to microeconomics, demand
moving body, and the resistance of this measure to change from, analysis by the behavioral economist requires procedural changes
say, extinction or satiation, is akin to inertial mass. Called behav- in the traditional operant methods illustrated above. Other factors
ioral momentum, this construct is typically evaluated in a multiple equal, demand analysis favors use of ratio schedules over others
variable-interval schedule in which components differ only in because they simplify the definition of price as responses per
some dimension of reinforcement, such as rate or amount. When reinforcer. And since the price the worker pays is viewed as a
responding was disrupted by some experimental manipulation
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
(e.g., undergoing extinction, providing response-independent rein- is more tractable if all goods are earned, and none given—an
forcement, or reducing an animal’s motivation level), Nevin and arrangement called a closed economy (Hursh, 1980, 1984). When
his colleagues found that response rate in the schedule that pro- food is the reinforcer, a closed economy provides all food within
vided the higher rate or amount of reinforcement was more resis- the experimental arrangement and eliminates postsession feeding.
tant to change than the alternate schedule. Finally, the economic perspective encourages the evaluation of
This covariation between apparent schedule value and resistance reinforcers that differ in kind, not just in rate of occurrence.
to change supports the use of the behavioral-momentum construct Studies have evaluated demand for different essential commodi-
in scaling the strength of a reinforcer. However, more work may be ties, such as food, water, and sucrose (Bauman, Raslear, Hursh,
needed. The theory underlying behavioral momentum requires that Shurtleff, & Simmons, 1996; Hursh, 1980, 1984; Lea, 1978; Mad-
resistance to change be independent of the response-rate differ- den, Dake, Mauel, & Rowe, 2005; Tsunematsu, 2000), and ines-
ences various types of schedules naturally create and be solely
sential reinforcers, such as drugs, saccharin-sweetened water, brain
dependent on the reinforcer rates or amounts these components
stimulation, TV time, nesting material, and money (Dawkins,
provide. In two conditions of Experiment 2 of their study, Nevin,
1983; Gunnarsson, Mathews, Foster, & Keeling, 2000; Harris,
Grace, Holland, and McLean (2001) tested this thesis by using a
Briand, Orth, & Galbicka, 1999; Hursh, 1991; Hursh, Galuska,
multiple variable-interval, variable-ratio schedule that provided
Winger, & Woods, 2005; Hursh & Natelson, 1981; Hursh &
approximately equal rates of reinforcement. They found that
Winger, 1995; Jacobs & Bickel, 1999; Johnson & Bickel, 2006;
variable-interval responding was more resistant to change by dis-
Matthews & Ladewig, 1985; Rowlett, 2000).
rupters than variable-ratio responding, an outcome that weakens
In sum, a demand analysis changes the questions we ask, the
the utility of behavioral momentum as a measure of strength or
methods we use, and the measures of our work. More likely than
value of a reinforcer.
not, comparisons among schedules that differ in type will not be a
primary concern, nor will measures of response rate and the
Demand as Strength near-exclusive use of food as a reinforcer. In their stead, the
This gives closure on the major, operant-based accounts of behavioral economist will typically favor use of ratio over interval
strength that have been advanced to date, save the one that is the schedules and will create curves of demand (instead of response
target of this paper: a scaling of strength on the basis of the rate) for reinforcers that are earned and seldom freely given (cf.
economics of demand. To us, it seems no small irony that a goal Bauman, 1991).
that has proved elusive for operant analysts—measuring the value These differences in approach reflect between-discipline differ-
of a reinforcer—is a process we engage in every day whenever we ences in goals. The operant analyst scales the effects of different
make consumer decisions in the human economy. So, for this types of schedules on the strength of behavior. In most of these
reason, it is surprising that only recently have learning theorists comparisons, behavior is maintained by the same reinforcer and
entertained the idea that microeconomics, the discipline that doc- the datum measuring between-schedule differences is the rate of
uments the decision processes in the human economy, might be response. The behavioral economist, on the other hand, typically
useful in scaling reinforcer value (Allison, 1983; Hursh, 1980, scales consumer demand for different goods on the same schedule.
1984; Lea, 1978). The measure reflecting between-good differences is the demand
Called behavioral economics, this new approach has led some curve itself, the function relating quantity consumed to the work
students of operant behavior to change their language, methods, required to produce it.
and predictions in ways that are consonant with the discipline of The complementarity between the goals of the operant analyst
microeconomics they have adopted. Subjects now are often viewed and the behavioral economist ensures the continued development
as animal workers, and their behavior is no longer strengthened by of both approaches. Indeed, a given researcher is likely to switch
reinforcement. Instead, they earn goods in exchange for labor, with approaches depending on which element of the response-reinforcer
the price they pay defined in terms of the response-reinforcer relationship is of primary interest. When comparisons among
feedback function. Although at one time plots of response rate as schedules are desired, traditional operant methods often seem more
a function of reinforcer rate prevailed, one now sees plots of how advantageous. Alternatively, when attention turns from the
consumption of a good changes as a function of the amount of response-reinforcer feedback function to evaluating the properties
EXPONENTIAL MODEL OF DEMAND 189
of the reinforcer itself, a demand-based analysis is likely to prove well-defined, multiple-point demand curves and a mathematical
more useful. equation that accommodates them.
We contend that a demand analysis brings added value to an For this reason we now turn to a more suitable data set— one
operant theorist when his or her focus shifts from feedback func- provided by Hursh (1991). In this study, two monkeys earned their
tions to the reinforcers they arrange. To illustrate the comparative daily ration of food and saccharin-sweetened water by responding
advantage that a demand analysis brings to comparisons among under FR schedules, the sizes of which were manipulated across
reinforcers, we return to the Elsmore et al. (1980) study discussed sessions. The top panel of Figure 1 presents the demand data in
earlier. To remind the reader, in one experiment from that report, logarithmic coordinates for these two goods averaged across both
baboons chose between infusions of heroin and food under a range monkeys. Lines connect successive data points so as to define two
of income conditions: when they had many choices per day and the curves.
price of both goods was low to when they had few choices and the Two features of these curves are noteworthy: Both curves are
price of both goods was high. In the former case, the subjects downward sloping, and the curve for saccharin water drops more
preferred heroin to food, but in the latter case, one baboon pre- rapidly than the curve for food. This multipoint presentation of
ferred food to heroin. Although this change in preference obviates demand has the important advantage over the Elsmore et al. (1980)
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
scaling reinforcer value in terms of any preference test, matters data set of delineating the true form of demand curves—that they
differ when these data are viewed from the perspective of a are not only downward sloping but also that the negative slope
demand analysis. The very feature that compromises use of a often accelerates with increasing price. Further, we can see the
preference test—that choice is price dependent— defines the func- problem inherent with using elasticity of demand alone as an index
tions that generate a demand curve. When the quantity of each of value: Not only does elasticity change continuously with
good consumed is plotted as a function of price, the curve for changes in price for each good but the rate of change differs
heroin decreases more rapidly than does the curve for food. between goods at each price point also. In any between-good
Clearly, these subjects preferred heroin to food when the price of comparison, it is not possible to pick a price point at which “value”
each was low but tended to reverse this preference when the price resides, a weakness of the behavioral economic approach noted by
was high. These results were subsequently replicated in a second Killeen (1995). Although his simple linear demand equation is not
experiment by Elsmore et al. (reported in Hursh, 1991) with rhesus an adequate resolution to the problem, a general solution is offered
monkeys working under FR schedules. Consistent with their here that addresses the spirit of his concern.
baboon-based choice data, consumption of heroin was more sen- The approach we favor is to scale “value”—what we call es-
sitive to increases in the FR than was consumption of food. sential value—in terms of the rate of change in elasticity of
The price dependency of between-good preference suggests that demand. Given the curvilinear appearance of most multipoint
Miller (1976) erred in creating a matching-based scale for ranking demand curves, how does one select a single number that repre-
the value of goods because his model assumed that value could be sents a good’s elasticity of demand that can serve as our measure
assessed independently of price and income. What Elsmore et al.’s of essential value? The answer is to use a model that has a
(1980) demand curves made clear was that the assessment of the parameter for the rate of change in elasticity. If the model accom-
comparative value of two goods must include not only a compar- modates the curvature of most demand curves with a single pa-
ison of consumption level between two goods but also each good’s rameter that specifies the rate of change in elasticity, then we have
price point. In terms of how the word is commonly used, a good’s in the value of that parameter a simple index of a good’s essential
“value” is a joint function of hedonically positive and negative value. It is to the definition of such a single-parameter model that
characteristics. The positive characteristics in value are all the we now turn.
appetitive attributes the good has, such as its positive biological
effects on the consumer. The negative characteristics in value are
all features of the price charged in its purchase. For example, it Demand Equations
could be the time or responses that must be paid for each good.
Linear-Elasticity Equation
Microeconomists call sensitivity to the cost-benefit ratio “elas-
ticity of demand.” It indexes the degree to which consumption is Prior to the present article, there was only one model for
insensitive to the effects of price increases. Unfortunately, scaling behavioral-economic demand curves—Hursh, Raslear, Bauman,
reinforcer value, using Elsmore et al.’s (1980) model, on the basis and Black’s (1989) linear-elasticity equation. When their equation
of comparative elasticity of demand for food and heroin is prob- is applied to demand curves plotted in logarithmic coordinates, it
lematic because the demand “lines” of this study almost certainly states that
misrepresent the curvilinear form that a demand curve would draw
were demand assessed at more price points. For this reason, the ln Q ⫽ ln L ⫹ bln P ⫺ aP, (1)
negative slopes of these functions have limited quantitative reso-
lution. where Q is the quantity consumed, price (P) is set by the FR
A way to improve predictive resolution is to mimic the added schedule, L is the level of consumption as P approaches zero, b is
predictive power that Herrnstein’s (1961) choice procedure lends the slope of the demand curve after an infinitesimally small in-
to a simple preference test. By collecting several data points in crease from a zero-level price, and a is a coefficient.
choice and modeling the slope of preference change across them In this equation, the value of L is determined empirically. For
with the matching equation, he provided a basis for not just rank example, in assessing demand for food, L could be defined as the
ordering the value of two goods but also scaling the distance in amount consumed under unrestricted access. The value of b is
value between them. To follow his approach, we need at least two, expected to be near zero. This expectation is based on the assump-
190 HURSH AND SILBERBERG
tion that an imperceptibly small increase in price should, by virtue Because a and b are fixed in value for each demand curve,
of its imperceptibility, leave consumption levels unchanged. elasticity changes as a linear function of P.
The slope of the Equation 1 draws in log-log space defines By setting elasticity equal to ⫺1 and solving for P, we arrive
elasticity of demand. That is, at the price point economists call unit elasticity, in which a 1%
increase in price results in a 1% decrease in consumption. The
Elasticity ⫽ b ⫺ aP. (2) limb of the curve to the left of this point shows inelastic
demand (where a 1% increase in price results in a ⬍1% de-
crease in consumption), but the limb to the right of this point
Empirical Demand Curves shows elastic demand (where a 1% increase in price results in
1000 Food Demand
a ⬎1% decrease in consumption). This is also the point of
Saccharin Demand maximal responding or expenditure, previously defined as Pmax
(see Hursh and Winger, 1995). The price at unit elasticity for
(Food Pellets or Squirts)
100 This panel presents the same demand data as the top panel.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
100
mand curve. Regrettably, the price paid for this constraint is
high: Although it does no damage to the predictive adequacy of
Equation 1 when applied to demand for food (R2 ⫽ .95), it
10 causes the linear-elasticity equation to fail in fitting the
saccharin-demand curve (R2 ⫽ .7).
Our goal of using an equation’s parameter to index a good’s
essential value has, for the moment, been cut short. What is needed
1 is a new equation that maintains the predictive successes of the
10 100 1,000
FR linear-elasticity equation but addresses the need of having a single
R2 L b a parameter defining changes in elasticity of demand. The presen-
Food 0.96 218 0.075 0.0064 tation of such an equation is a primary purpose of the present
Saccharin 0.95 39397 -1.9 -0.0041
article.
Exponential Demand Equation
of two monkeys. The middle panel shows the same data with curves fit
Daily Consumption
100
using the linear-elasticity model. The bottom panel presents the same data
with curves fit using the exponential-demand equation (Equation 4). Ver-
tical dashed lines indicate the calculated point of unit elasticity from each
model; for the linear-elasticity model, the slope of saccharin demand is
10
more negative than ⫺1 starting from the origin. The variance accounted for
(R2) and parameter values of each equation are shown in the tables below
the middle and bottom panels. In the linear-elasticity equation, L and b,
k = 2.3 respectively, signify level of consumption at the lowest price and the slope
1
10 100 1,000 of the demand curve after a small price increase from a price of zero. In the
FR exponential-demand equation, ␣ defines the rate of change in the expo-
R2 Q0 nential; Q0 specifies the highest level of demand; and k is a constant that
Food 0.96 4.6e-006 288 specifies the range of the dependent variable with price increases. FR ⫽
Saccharin 0.97 2.4e-005 628 fixed-ratio.
EXPONENTIAL MODEL OF DEMAND 191
Exponential-Demand Equation Second, the values its parameters assume seem more plausible. In
particular, the linear-elasticity equation’s values of L (the initial
The economics literature provides little guidance on how to level of consumption at a low price) for saccharin and b for food
define a demand curve for behavioral-economic data. The problem are, in the former case, too high (consumption is 39,397) and, in
is that microeconomists define demand in terms of large numbers the latter case, positive instead of equaling zero or being negative
of consumers, creating market-demand curves, but behavioral as expected (for normal goods, economists assume consumption
economists study demand at the level of the individual consumer. never increases with price; yet a positive b value predicts this
This difference in aggregation is unsurprising. For behavioral outcome). Third, only the exponential equation correctly describes
economists, the demand curve remains part of a functional analy- the initial range of saccharin consumption as a positively acceler-
sis, and for this reason, they remain intent on characterizing the ating function of price with a slope between 0 and ⫺1 (see dashed
relation between price and consumption for a single consumer. For lines for unit elasticity in the bottom panel of Figure 1). Finally,
microeconomists, on the other hand, there is little concern with the exponential equation fulfills the goal of having a single pa-
modeling a psychological process. Instead, they focus on predict- rameter (␣) to scale elasticity of demand, our basis for defining
ing how the relation between price and consumption will play out essential value given a constant range of consumption (k).
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Reinforcer Consumption Curve ing at least .95 in all individual curves and a global fit of .986.
Second, the manipulations that should decrease essential value
1000
(reflected in an increase in the ␣ parameter) did so: As shown in
R2 = 0.989 Table 2, increases in the availability of a temporally removed,
“cheap” food (the delivery of one third vs. two thirds of the daily
food ration after 12 hr of work), and of temporally proximal,
(Reinforcers per Day)
Daily Consumption
Table 1 Table 2
Parameter Values of Exponential-Demand Model for Fits to Parameter Values of Equation 6 for Fits to Four Demand
Two Demand Curves for Food Reinforcers by Rats Curves for Earned Food With Varying Amounts of Free Food
After the Work Session With Monkeys
Reinforcer
Condition
Parameter 1 pellet 2 pellets
Parameter No free 1/3 free 2/3 free 5-min CRF
Q0 533 273
k 3.00 3.00 Q0 305 336 285 588
␣ 2.5 ⫻ 10⫺06 2.5 ⫻ 10⫺06 k 3.13 3.13 3.13 3.13
␣ 1.99 ⫻ 10⫺06 2.78 ⫻ 10⫺06 6.67 ⫻ 10⫺06 1.47 ⫻ 10⫺05
Note. Q0 specifies the highest level of demand; k represents the range of
the dependent variable in logarithmic units; ␣ specifies the rate of change Note. No free denotes that all food had to be earned in the experimental
in the exponential. session; 1/3 free and 2/3 free indicate the portion of the daily ration given
after the session ended; 5-min continuous reinforcement (CRF) signifies
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
that for 5 min at session’s end, every response was reinforced. Q0 specifies
This document is copyrighted by the American Psychological Association or one of its allied publishers.
adequacy than for their felicity of fit. One way of deflecting such the highest level of demand; k represents the range of the dependent
variable in logarithmic units; ␣ specifies the rate of change in the expo-
criticism is to model all demand curves from a single review article
nential.
where those curves were selected by that article’s author for
reasons other than their prospects of fitting Equation 6. Toward
this end, we have applied Equation 6 to the 15 demand curves in data variance accommodated by Equation 6 was 0.94 and the
Figure 1 from Lea (1978) that are composed of five or more data interquartile range of these proportions was 0.92 to 0.985.
points. These curves are presented in Figure 5. The letter code in Finally, our claim that Equation 6 adequately adjusts for differ-
each panel matches that used by Lea. The reader is referred to Lea ences in Q0 is illustrated in Figure 6. Hursh and Winger (1995)
for references and discussion of these studies. The values of ␣ and proposed to normalize demand curves in terms of the size of the
R2 are shown in each panel; the span of the exponential (k) was reinforcer relative to baseline consumption, Q0. This approach has
constrained to the best value between 1 and 4 log units. Generally been demonstrated as a useful way to isolate the strength of
speaking, Equation 6 does an acceptable job of characterizing the demand for drugs that differ in dose and potency (Hursh et al.,
data in this figure. This conclusion is supported by noting that 2005; Ko, Terner, Hursh, Woods, & Winger, 2002; Winger, Hursh,
across the 15 data sets in the figure, the median proportion of the Casey, & Woods, 2002; Winger, Woods, & Hursh, 1996).
This normalization process is inherent in Equation 6. Normal-
ization of price is accommodated by the inclusion of Q0 in the
Exponential Fit to Earned Food exponential rate constant, and normalization of consumption is
with Additional Food accommodated by a logarithmic transformation of consumption.
1000 Scalar variations in the price that result from varying amounts of
R2 = 0.986 reinforcement under each response requirement are reflected in the
standardized price as the amount of responding that would be
Earned Food Consumption
1 10 100 purposes, ethical concerns have been raised concerning the quality
Unit Price of life for the animals. One of the first questions that must be
answered is what features of the environment or what kinds of
consumables are of greatest importance to animals. Scientific
Humans - Cigarette Puffs methods, behavior analysis, and economic theory have been pro-
100 posed to address this question (Dawkins, 1983, 1990; Gunnarsson
R2 = 0.98 et al., 2000; Harris et al., 1999; Matthews & Ladewig, 1985;
Sumpter, Foster, & Temple, 1995; Sumpter, Temple, & Foster,
10 1999), and the approach detailed here seems to provide one clear
Consumption
you given this choice while thirsty in the desert. What this example
10 shows is that relative reinforcer strength or value as measured in
choice fails because it is not independent of income and price. As
a corollary of this conclusion, there is no direct relationship be-
tween essential value and the outcome of a preference test. The
Heroin = 0.0015 results of Elsmore et al. (1980) cited earlier illustrate the effects of
Cigarettes = 0.011 an income variable on choice.
1
Choice is a complex derivation from underlying demand rela-
Jacobs & Bickel, 1999 k = 1.4
tionships, but because consumption at a particular price is depen-
0.001 0.01 0.1 1 10 100 dent on the prices of alternatives and possible interactions with
Unit Price other available substitutes and complements (Hursh, 1978, 1980,
1984), the outcome of a particular choice test is not reliably related
Figure 4. The fit of the exponential-demand equation to three data sets
to a simple comparison of essential values. On the other hand,
from pigeons and humans. Data sets are from the references cited in each
panel. Variance accounted for (R2) and the value of ␣ for each commodity comparative demand curves for commodities that do not interact
are shown in each panel. (i.e., they are neither substitutes nor complements) should predict
choice under conditions of equal price (see Bickel & Madden,
1999; Bickel et al., 2000; Madden et al., 2000). Although it is
EXPONENTIAL MODEL OF DEMAND 195
1000 1000
L3 CHH
100 S 100 R
100
10 Ethanol
= ~ 3.2e-007 = 3.9e-006 Sunflower Seed = 0.00039
This document is copyrighted by the American Psychological Association or one of its allied publishers.
R2 = 0.94
100 10 1 1
1 10 100 1000 1 10 100 1000 1 10 100 0.1 1 10 100
1000
100 100 H1 100
WC
HB
H2
100
10 Monkey 10 Siamese Fighting Fish 10 Siamese Fighting Fish
Rat Food Pellet W orm W orm
Food Pellet = 4.6e-005 = 0.00052 = 0.00032
= 1.0e-005 R2 = 0.99 R2 = 0.98 R2 = 0.99
R2 = 0.94
10 1 1 1
10 100 1000 1 10 100 1000 0.1 1 10 100 1 10
10 10 Rat 10 Goldfish
1 k 4
Rat
Sucrose Sucrose Food Pellet
= 3.79e-005
= 6.56e-005
R2 = 0.998 R2 = 0.995
= 0.00047
R2 = 0.98
median R2 = 0.94
1 1 1
1 10 100 1000 1 10 100 1000 0.1 1 10 100
FR
Figure 5. Data from fifteen studies reviewed by Lea (1978) and shown in his Figure 1. These data were
extracted from the figures and reanalyzed here using the exponential-demand model. Each graph is labeled with
a key that indicates the species, reinforcer, the value of the ␣ parameter, and the R2 for the exponential-demand
equation. The letter code in each panel matches that used by Lea in his study.
beyond the scope of this article to elaborate on how this might be underlying demand curves of the goods chosen describe the more
accommodated within the context of exponential demand, our general impact of different reinforcers on behavior across the full
analysis of demand-curve data from two-commodity situations spectrum of constraint. For this reason, we contend that essential
indicates that the consumption of one of two reinforcers is the value, and not preference, is the superior approach for defining
weighted sum of two exponentials. One exponential is related to reinforcer strength or value.
the price of the target commodity, and the second is related to the
price of the alternative commodity. The sign of the weighting Conclusions
factor determines whether the two reinforcers interact as substi-
tutes or complements. If the constant has a negative sign, then A simple classroom exercise can be used to explain the notion
consumption of one subtracts from consumption of the other and of operant strength: Imagine a student is told there is $10 in the top
the two commodities are defined as substitutes. The degree of drawer of the teacher’s office desk. The door to the office is
substitution is determined by the size of the weighting factor. unlocked, and the student may take the money whenever it is
Alternatively, if the weighting factor is zero, then demand for one convenient. As matters unfold, the student picks up the money 3
of the reinforcers is independent of the price of the other. days later, the student’s next occasion for visiting that area of the
From the perspective of a demand analysis, preference is a campus. Next, the teacher repeats this experiment, but this time the
derived outcome of comparative levels of consumption, and the amount in the desk drawer is $10,000. To no one’s surprise, the
196 HURSH AND SILBERBERG
Exponential Demand an FR 50 more rapidly for two food pellets than for one. Despite
the superficial similarity to the money experiment presented
alfentanil above, the training history necessary to illustrate this effect com-
plicates the analysis, as, by responding more rapidly for two pellets
than for one, two things now vary: the amount of reinforcement
R2 = 0.986 and the rate of reinforcement. To what degree is the increased
100 vigor of responding due to the increase in the amount of food
Consumption (Infusions)
0.01 mg/kg concern that any dependent variable used to assess strength might
0.003 mg/kg be a consequence not just of the reinforcer used but also of the
0.001 mg/kg rate-shaping properties of the schedule by which it is presented.
A major virtue of a behavioral-economic approach is that its use
0.0003 mg/kg
of schedules is holistic—the focus is on the relation between
1
1 10 100 1,000 10,000 behavioral output and consumption and not on rates of response,
rates of reinforcement, or the specific response–reinforcer relations
FR that produce these measures. The question is as follows: Just how
Standardized Demand hard is an animal willing to work to produce the goods it con-
sumes? In this regard, a behavioral-economic approach to assess-
1 ing strength has a face validity that is hard to reproduce when the
underlying schedule of reinforcement is an important property of
the assessment.
Proportional Consumption
rally toward the use of ratio schedules over others and will scale
these variables in terms of consumption constrained by price.
Sessions will end not after an arbitrary number of reinforcers but
0.1 when the subject has “had enough” at the price the investigator is
“charging.” In our view, a demand curve constructed in this way
0.01 mg/kg Alfentanil
has embedded within it the true measure of value.
0.003 mg/kg Where in that curve does true value reside? One need only
0.001 mg/kg measure the rate at which consumption diminishes with price.
0.0003 mg/kg Considered alone, such a measure of value is problematic because
value changes continuously with the price charged. The solution
0.01 this paper proposes is to use the exponential model of demand
10 100 1,000 10,000 100,000 based on standard units of price. Its virtue is that it can largely
Standardized Price (FR x Q 0) reproduce this continuously changing demand curve in terms of an
equation that has a single free parameter that determines slope. It
Figure 6. For four doses of alfentanil self-administered by monkeys, is the value that parameter attains that scales a good’s essential
exponential-demand (Equation 6) fit to consumption data and standardized value.
demand are shown, respectively, in the top and bottom panels. Variance
accounted for (R2) across all curves is shown in the top panel and the Table 3
parameter values of the equation for each condition are shown in Table 3.
Parameter Values of Equation 6 for Fits to Daily Self-
In the bottom panel, the point of unit elasticity is indicated with a dashed
Administered Infusions of Four Doses of Alfentanil by Monkeys
vertical line. Data are from Ko et al., 2002. FR ⫽ fixed ratio; Q0 ⫽ highest
level of demand.
Dose (mg/kg)
student bolts from the classroom and picks up the money 5 min Q0 26 63 147 232
later. k 1.76 1.76 1.76 1.76
In this example, behavior indexed the strength of the reinforcer, ␣ 1.41 ⫻ 10⫺05 1.41 ⫻ 10⫺05 1.41 ⫻ 10⫺05 1.41 ⫻ 10⫺05
whether measured in terms of its vigor or its speed. Ironically, Note. Q0 specifies the highest level of demand; k represents the range of
showing a similar effect through the use of schedules of reinforce- the dependent variable in logarithmic units; ␣ specifies the rate of change
ment proves more difficult. To illustrate, imagine a rat completes in the exponential.
EXPONENTIAL MODEL OF DEMAND 197
mental Analysis of Behavior, 72, 299 –316. Hursh, S. R., & Natelson, B. J. (1981). Electrical brain stimulation and
This document is copyrighted by the American Psychological Association or one of its allied publishers.
Bickel, W. K., Madden, G. J., & Petry, N. M. (1998). The price of change: food reinforcement dissociated by demand elasticity. Physiology and
The behavioral economics of drug dependence. Behavior Therapy, 29, Behavior, 26, 509 –515.
545–565. Hursh, S. R., Raslear, T. G., Bauman, R., & Black, H. (1989). The
Bickel, W. K., Marsch, L. A., & Carroll, M. E. (2000). Deconstructing quantitative analysis of economic behavior with laboratory animals. In
relative reinforcing efficacy and situating the measures of pharmacolog- K. G. Grunert & F. Ölander (Eds.), Understanding economic behavior
ical reinforcement with behavioral economics: A theoretical proposal. (pp. 383– 407). Dordrecht, Netherlands: Kluwer Academic.
Psychopharmacology, 153, 44 –56. Hursh, S. R., Raslear, T. G., Shurtleff, D., Bauman, R., & Simmons, L.
Bickel, W. K., Warren, K., & DeGrandpre, R. J. (1996). Modeling drug (1988). A cost-benefit analysis of demand for food. Journal of the
abuse policy in the behavioral economics laboratory. In L. Green & J. H. Experimental Analysis of Behavior, 50, 419 – 440.
Kagel (Eds.), Advances in behavioral economics: Vol. 3. Substance use Hursh, S. R., & Winger, G. (1995). Normalized demand for drugs and other
and abuse (pp. 69 –95). Norwood, NJ: Ablex. reinforcers. Journal of the Experimental Analysis of Behavior, 64, 373–
Catania, A. C., & Reynolds, G. S. (1968). A quantitative analysis of the 384.
responding maintained by interval schedules of reinforcement. Journal Jacobs, E. A., & Bickel, W. K. (1999). Modeling drug consumption in the
of the Experimental Analysis of Behavior, 11, 327–383. clinic using simulation procedures: Demand for heroin and cigarettes in
Dawkins, M. S. (1983). Battery hens name their price: Consumer demand opioid-dependent outpatients. Experimental and Clinical Pharmacology,
theory and the measurement of ethological “needs.” Animal Behaviour, 7, 412– 426.
31, 1195–1205. Johnson, M. W., & Bickel, W. K. (2006). Replacing relative reinforcing
Dawkins, M. S. (1990). From an animal’s point of view: Motivation, efficacy with behavioral economic demand curves. Journal of the Ex-
fitness, and animal welfare. Behavioral and Brain Sciences, 13, 1– 61. perimental Analysis of Behavior, 85, 73–93.
Elsmore, T. F., Fletcher, G. V., Conrad, D. G., & Sodetz, F. J. (1980). Killeen, P. R. (1995). Economics, ecologics, and mechanics: The dynamics
Reduction of heroin intake in baboons by an economic constraint. of responding under conditions of varying motivation. Journal of the
Pharmacology Biochemistry and Behavior, 13, 729 –731. Experimental Analysis of Behavior, 64, 405– 431.
Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. New Ko, M. C., Terner, J., Hursh, S., Woods, J. H., & Winger, G. (2002).
York: Appleton-Century-Crofts. Relative reinforcing effects of three opioids with different durations of
Giordano, L. A., Bickel, W. K., Shahan, T. A., & Badger, G. J. (2001). action. Journal of Pharmacology and Experimental Therapeutics, 301,
Behavioral economics of human drug self-administration: Progressive 698 –704.
ratio versus random sequences of response requirements. Behavioural Lea, S. E. G. (1978). The psychology and economics of demand. Psycho-
Pharmacology, 12, 343–347. logical Bulletin, 85, 441– 466.
Gunnarsson, S., Mathews, L. R., Foster, T. M., & Keeling, L. J. (2000). Madden, G. J., Bickel, W. K., & Jacobs, E. A. (2000). Three predictions of
The demand for straw and feathers as litter substrates by laying hens. the economic concept of unit price in a choice context. Journal of the
Applied Animal Behaviour Science, 65, 321–330. Experimental Analysis of Behavior, 73, 45– 64.
Hall, G. A., & Lattal, K. A. (1999). Reward density and variable-interval Madden, G. J., Dake, J. M., Mauel, E. C., & Rowe, R. R. (2005). Labor
schedule performance in an open economy. Journal of the Experimental supply and consumption of food in a closed economy under a range of
Analysis of Behavior, 72, 341–354. fixed- and random-ratio schedules: Tests of unit price. Journal of the
Harris, L. D., Briand, E. J., Orth, R., & Galbicka, G. (1999). Assessing the Experimental Analysis of Behavior, 83, 99 –118.
value of television as environmental enrichment for individually housed Matthews, L. R., & Ladewig, J. (1985). Operant conditioning: Theory and
rhesus monkeys: A behavioral economic approach. Contemporary Top- practical application in farm animal welfare research. Aktuielle Arbeiten
ics, 38, 48 –53. zur Artgemassen Tierhaltung, Herausgegeben vom Kuratorium fur
Herrnstein, R. J. (1961). Relative and absolute strength of response as a Technik und Bauwesen in der Landwirtschaft, 311, 134 –141.
function of frequency of reinforcement. Journal of the Experimental Miller, H. L., Jr. (1976). Matching-based hedonic scaling in the pigeon.
Analysis of Behavior, 4, 267–272. Journal of the Experimental Analysis of Behavior, 26, 335–347.
Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Nevin, J. A. (1992). An integrative model for the study of behavioral
Analysis of Behavior, 13, 243–266. momentum. Journal of the Experimental Analysis of Behavior, 57,
Hodos, W. (1961, September 29). Progressive ratio as a measure of reward 301–316.
strength. Science, 134, 943–944. Nevin, J. A., & Grace, R. C. (2000). Preference and resistance to change
Hodos, W., & Kalman, G. (1963). Effects of increment size and reinforcer with constant-duration schedule components. Journal of the Experimen-
volume on progressive ratio performance. Journal of the Experimental tal Analysis of Behavior, 74, 79 –100.
Analysis of Behavior, 6, 387–392. Nevin, J. A., Grace, R. C., Holland, S., & McLean, A. P. (2001). Variable-
198 HURSH AND SILBERBERG
ratio versus variable-interval schedules: Response rate, resistance to criterion on progressive-ratio performance. Journal of the Experimental
change, and preference. Journal of the Experimental Analysis of Behav- Analysis of Behavior, 70, 123–138.
ior, 76, 43–74. Stafford, D., LeSage, M. G., & Glowa, J. R. (1998). Progressive-ratio
Pavlov, I. P. (1927). Conditioned reflexes (G. V. Anrep, Trans.). London: schedule of drug delivery in the analysis of drug self-administration: A
Oxford University Press. review. Psychopharmacology, 139, 169 –184.
Peden, B. F., & Timberlake, W. (1984). Effects of reward magnitude on Sumpter, C. E., Foster, T. M., & Temple, W. (1995). Predicting and scaling
key pecking and eating by pigeons in a closed economy. The Psycho- hens’ preferences for topographically different responses. Journal of the
logical Record, 34, 397– 415. Experimental Analysis of Behavior, 63, 151–163.
Rowlett, J. K. (2000). A labor-supply analysis of cocaine self- Sumpter, C. E., Temple, W., & Foster, T. M. (1999). The effects of
administration under progressive-ratio schedules: Antecedents, method- differing response types and price manipulations on demand measures.
ologies, and perspectives. Psychopharmacology, 153, 1–16. Journal of the Experimental Analysis of Behavior, 71, 329 –354.
Silberberg, A., Warren-Boulton, F. R., & Asano, T. (1987). Inferior-good Tsunematsu, S. (2000). Effort- and time-cost effects on demand curves for
and Giffen-good effects in monkey choice behavior. Journal of Exper- food by pigeons under short session closed economies. Behavioural
imental Psychology: Animal Behavior Processes, 13, 292–301. Processes, 53, 47–56.
Skinner, B. F. (1931). The concept of the reflex in the description of Winger, G., Hursh, S. R., Casey, K. L., & Woods, J. H. (2002). Relative
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
On p. 772 (Real Data section) of the article ‘The Hazards of Underspecified Models: The Case of
Symmetry in Everyday Predictions,” by Peter Sedlmeier and Berna Kılınç (Psychological Review,
2004, Vol. 111, No. 3, pp. 770 –780), some numbers were listed incorrectly. The correct numbers
are as follows:
For soccer world championships (1930 –1978), number of games in which a given team both won
and led at halftime ⫽ 151, number of games in which a team won the game ⫽ 243, number of games
in which a team led at halftime ⫽ 196, P(WinMid兩WinEnd) ⫽ .62, and P(WinEnd兩WinMid) ⫽ .77.
For the German Bundesliga (1994 –1995), number of games in which a given team both won and
led at halftime ⫽ 132, number of games in which a team won the game ⫽ 223, number of games
in which a team led at halftime ⫽ 174, P(WinMid兩WinEnd) ⫽ .59, and P(WinEnd兩WinMid) ⫽ .76.
The conditional probabilities are referred to again on p. 778. There, it should read ‘These quotients
correspond to P(WinMid兩WinEnd)/P(WinEnd/WinMid), the empirical values of which were found
to be .81 and .78 (.62/.77 and .59/.76, see above).”
DOI: 10.1037/0033-295X.115.1.186