You are on page 1of 5

Opinion

What’s conditioned in conditioned


place preference?
Joseph P. Huston1, Maria A. de Souza Silva1, Bianca Topic1, and Christian P. Müller2
1
Center for Behavioral Neuroscience, Institute of Experimental Psychology, University of Düsseldorf, 40204 Düsseldorf, Germany
2
Section of Addiction Medicine, Department of Psychiatry and Psychotherapy, Friedrich-Alexander-University Erlangen-
Nuremberg, 91054 Erlangen, Germany

Conditioned place preference (CPP) is a learned behavior [16–19]. Although the theoretical underpinnings of CPP
shown in many vertebrates, including humans. CPP are complex, there is a general assumption that it is based
occurs when a subject comes to prefer one place more on classical conditioning-derived ‘incentive motivation’
than others because the preferred location has been [20,21]. However, this may be an oversimplification of
paired previously with rewarding events. The CPP para- the multiple learning processes involved, which may bias
digm is widely used to explore the reinforcing effects of and misdirect the interpretation of experimental results
natural and pharmacological stimuli, including drugs of with this paradigm. Here, we address the question of what
addiction. There is a general assumption that an ac- is actually conditioned in the CPP procedure and what
quired place preference is based on classical condition- learning processes may occur.
ing derived ‘incentive motivation’. However, this may be An important impetus to experimental use of CPP was
an oversimplification of the multiple learning processes the discovery of rewarding effects of brain stimulation by
involved. We argue that although CPP may appear as an Olds and Milner [22], who observed that rats returned to
incentive-driven behavior related to secondary reinfor- the site of a chamber where they had received electrical
cers, it may also be a result of operant conditioning of brain stimulation. Subsequently, CPP was observed with
behavior prevailing at the conditioning site, as well as a various other rewarding agents and it became a screening
result of conditioned treatment effects. Here, we outline tool for new drugs with an unknown reward potential
alternative explanations for an observed CPP, which may [23,24]. For example, CPP is one way to investigate the
fundamentally affect the interpretation of results with reinforcing effects and addiction potential early in devel-
this paradigm in its use as a screening tool for rewarding opment of new drug therapies. Whereas CPP methods are
properties of treatments. undoubtedly simpler to employ than drug self-administra-
tion techniques [23], it is certainly not simpler to interpret
Humans and most animal species prefer certain places results derived there from. Distinct learning processes are
over others. Although place preferences may be solely due involved in the establishment of a CPP. In addition, CPP
to sensory characteristics of particular places, they may retrieval depends on yet other mechanisms. A CPP can be
also be acquired as a consequence of events which are induced by various pathways but also altered in multiple
associated with those places. These events can shape the ways [25,26]. Understanding and experimental character-
preferred dwelling and local behavior for the future, which ization of the reinforcer-specific mechanisms is, thus, piv-
is considered to be a result of learning and memory and otal for an advanced interpretation of CPP results.
observed as conditioned place preference (CPP). CPP can
be easily induced under controlled experimental conditions What is conditioned during CPP learning?
in many species, such as flies [1], rodents [2,3], primates There are at least three major processes by which to
[4,5], and humans [6] (Box 1). account for why an animal spends more time in a place
The CPP method has assumed considerable importance in which it received a reinforcer. Whichever of these three
and is now routinely used in the neurosciences, genetics, processes is operative will determine the interpretation of
and pharmacology to explore the reinforcing effects of the result of the place-preference experiment.
natural and pharmacological stimuli [3]. A major advan-
tage of the method is that it can identify reinforcing as well Incentive-driven behavior
as aversive effects of a treatment in the same procedure The most commonly assumed explanation invokes the seek-
[7,8]. It also plays an important role in the study of addic- ing out of a place or stimulus complex which had been paired
tive and potentially addictive drugs [9–15]. In that, phar- with the reinforcer. The underlying learning process for
macological (e.g., receptor agonist/antagonist) or genetic incentive-driven behavior is assumed to be based on Pav-
(e.g., receptor knock out) brain manipulations are tested lovian conditioning [27]. Thereby, the reinforcer can be a
for how they affect CPP as an addiction-related behavior drug treatment or a conventional ‘reward’, such as food, that
the animal ‘likes’ or ‘wants’ [28]. In this paradigm, the
Corresponding author: Huston, J.P. (huston@uni-duesseldorf.de).
Keywords: conditioned place preference; reinforcement; reward; incentive; classical reinforcer, an unconditioned stimulus (UCS), has some
conditioning; operant conditioning; conditioned drug effects. effects on the organism which elicits an unconditioned
162 0165-6147/$ – see front matter ß 2013 Elsevier Ltd. All rights reserved. http://dx.doi.org/10.1016/j.tips.2013.01.004 Trends in Pharmacological Sciences, March 2013, Vol. 34, No. 3
Opinion Trends in Pharmacological Sciences March 2013, Vol. 34, No. 3

Box 1. How CPP is measured drugs are administered before CPP conditioning, their be-
In principle, CPP involves the association of a treatment with a
havioral effects are usually expressed and perceived during
particular section of an arena. A ‘rewarding/reinforcing’ effect is and after place conditioning. These behaviors can be single
considered to be manifested by a relative increase in time spent in limb movements or complex chains of behavior. In another
the area that had been paired with the treatment. CPP in rodents context, this was shown as ‘superstitious behavior’ and
and primates is usually tested in test boxes which contain at least demonstrated by Skinner and others in pigeons [32,33].
two different compartments, which differ sufficiently [14,57,58] or
in test environments with distinct subareas [13,59]. Thereby,
Superstitious behavior occurs upon inadvertent reinforce-
proximal intra-maze cues appear to be of greater importance for ment of spontaneously shown behaviors, which then in-
compartment distinction than distal spatial cues [60]. The CPP crease in frequency. During CPP conditioning, a behavior
procedure involves three phases that can be varied in the number or chain of behavior can hypothetically be enhanced in its
of trials [21,60]. During a baseline phase, the animal is allowed to frequency and linked to a particular place by a reinforcing
explore all areas of the maze without restrictions to habituate to
the environment and to provide a baseline for sojourn times in the
agent. When the animal confronts this place again, it is
single compartments. Thereby, no gross spontaneous preference likely to re-engage in whatever behavior was reinforced in
for one of the compartments should emerge. In the conditioning that context including those behaviors that produce contact
phase, the treatment (e.g., a drug with rewarding properties) is with the place [34]. Thus, the behavior is under control of the
paired with the conditioning compartment. Although drugs are
discriminative stimuli (SD) that prevailed during presenta-
administered before the animal is placed in the compartment,
natural reinforcers, such as food or sexual encounter, are tion of the reinforcer (Figure 1). Consequently, engaging in
presented in the compartment. Thereafter, the animals are such reinforced behavior will increase the probability that
returned to their home cages. A pseudo-conditioning session is the animal will remain in the vicinity of the SD (i.e., in the
usually administered, whereby the animal receives a sham compartment in which it received the reinforcer).
treatment (e.g., a vehicle injection) and is placed in the alternative
compartment of the maze. This is done to avoid a novelty based
preference and to control for the emotional effects of the (mostly Conditioned treatment effects
aversive) drug application procedure. Conditioning and pseudo- As a third theoretical alternative, pharmacologically in-
conditioning are repeated several times [40]. Drug-induced CPP is duced CPP may be a consequence of conditioned treatment
usually tested after a vehicle injection, but may be enhanced after effects. A stimulus paired with a drug-induced behavior
a drug injection [23]. The main readout in the paradigm is the time
that is spent in the conditioning compartment during test minus
can serve to elicit behavior very similar to that induced by
baseline. If the difference is positive, a CPP and ‘reinforcing action’ of the drug itself [35–37]. Conditioned drug effects may occur
the treatment is inferred. If the difference is negative, a conditioned independently of a drug–CPP [38]. Their potential contri-
place avoidance and aversive action of the treatment is concluded. bution to CPP is particularly obvious in the case of psy-
chostimulant drugs, the behavioral effects of which are
response (UCR). This is associated with the stimulus well known to be conditionable to environmental cues
properties of the place, which become conditioned stimuli which have been paired with their action [35,36,39]. As
(CS). Consequently, the CS assume ‘incentive value’ of their in case 2 above for operantly conditioned behavior, condi-
own, which leads the organism to ‘seek’ these out, or to tioned treatment effects may increase the probability that
‘prefer’ them [20,21,29–31]. According to this view, the the animal will remain in the vicinity of the stimuli asso-
expression of a CPP reflects a Pavlovian conditioned ap- ciated with the acute treatment effects which may finally
proach response similar to sign-tracking behavior, that is, contribute to CPP sojourn time (Box 1). Note that the
the animal is attracted to the CS [32]. An additional contri- resulting place preference in this case may be totally
bution is assumed by conditioned reinforcement or reward. independent of any ‘reinforcing’ consequences of the treat-
This is the learning about the relationship between the ment, and the term ‘place preference’ would be a misnomer,
rewarding effects of a stimulus and the cues in the paired because the animal’s conditioned response may simply
compartment. Both processes were dissociated at anatomi- prevent it from leaving this particular environment
cal level. Whereas the Pavlovian conditioned approach (Figure 1). Such an account may explain the difficulty
depends on amygdala and nucleus accumbens, conditioned and lack of a CPP dose–response function for the powerful
reinforcement appears to rely on the hippocampus [26]. pharmacological reinforcer, cocaine [40–42]. Cocaine-in-
Although such an analysis has considerable face validity duced hyperactivity can readily be conditioned to an
it should be remembered that it is a theoretical accounting UCS [35,36,39]. The CS may then elicit conditioned hyper-
and not to be confused as fact. The notion of ‘conditioned activity during testing. This activity may actually increase
incentive’ as developed by Bolles [30] and Bindra [29] has the probability that the animal will leave the conditioning
much appeal as an explanatory concept, but it may only compartment in the test and, thus, mask possible reinfor-
partially provide a valid account for the CPP phenomenon cing (case 2) and incentive (case 1) processes. The same
(Figure 1). reinforcer may also lead to conditioned treatment effects
that may be incompatible with leaving the treatment
Operant conditioning of behavior prevailing at the compartment (e.g., vocalization [34,43]). A single condi-
conditioning site tioned drug effect may or may not imply that a drug has
Less obvious is the theoretical possibility that CPP occurs as reward or reinforcing value, in spite of an apparent CPP.
a consequence of reinforced behavior. A reinforcer acts to And in some cases, the conditioned drug effect may simply
increase the probability of recurrence of those behaviors mask the reinforcing properties of the drug.
that precede or coincide with the onset of a rewarding event. Hypothetically, all three processes could operate con-
Both natural stimuli and drugs can influence behaviors that currently in a CPP paradigm and, thus, contribute addi-
are spontaneously shown in the test environment. Although tively or counteract one another. These factors must be
163
Opinion Trends in Pharmacological Sciences March 2013, Vol. 34, No. 3

Baseline Condioning Test

(a) Incenve-driven behavior


UCS*+ UCS*- CS+* CS*-

(b) Operant condioned behavior


SD*+ SD*- SD+* SD*-

R R

(c) Condioned drug effects


Observed:
place preference
UCS*+ UCS*- CS+* CS*-

UCR CR

TRENDS in Pharmacological Sciences

Figure 1. Different learning processes may lead to conditioned place preference (CPP) after drug or natural reinforcers. (a) CPP may occur as incentive-driven behavior. As a
result of conditioning, neutral, unconditioned stimuli (UCS) work as proximal/intra-maze (UCS+) and distal/extra-maze (UCS*+) cues that become associated with the
positive drug effects (orange). Thereby, they become conditioned stimuli (CS+/CS*+) which may elicit incentive motivation to ‘seek them out’ during the test. The UCS–/
UCS*– become associated with sham (vehicle) treatment to become a CS–/CS*– and do not elicit an incentive motivation during the test. (b) Animals may show
spontaneous behaviors (R) in the maze which can be reinforced by operant conditioning. Thereby, proximal and distal discriminative stimuli (SD+/SD*+) become associated
with R by the reinforcer. During the test, SD+/SD*+ may induce R, which prevents the animal from leaving the conditioning compartment. The SD–/SD*– will be associated
with sham treatment and do not elicit specific behavioral responses during the test. (c) Drugs and natural reinforcer may induce an acute unconditioned behavioral
response (UCR). This can be conditioned to a UCS+/UCS*+. They become a CS+/CS*+ and may elicit a conditioned response (CR) similar to the UCR during the test.
Thereby, the CR occurs in the conditioning compartment and prevents the animal from leaving this compartment.

considered when interpreting the outcome of any CPP tion can be limited when conditioned drug effects on loco-
experiment. Possible interactions between brain manipu- motor activity occur.
lations and all three processes should be considered. Testing the contribution of operant behavior may re-
quire a more careful monitoring of spontaneous behaviors
Dissociating mechanisms at experimental level and their frequency in the CPP compartments. One may
Assuming that all three processes are active in the CPP, need to score these behaviors during baseline and the
and let us say that one wishes to test the influence of a conditioning sessions. An increase in frequency of these
brain manipulation on CPP, it might be possible to segre- behaviors during conditioning trials can show whether a
gate the contribution of the three processes to the main reinforcer (e.g., a drug) acts on these spontaneous beha-
CPP readout, the sojourn time, by small manipulations viors. Accordingly, this action should result in distinct
during testing and behavioral fine analysis. The contribu- effects during conditioning, but not during pseudo-condi-
tion of incentive processes to CPP can be assessed by tioning sessions (Box 1). Finally, a comparison of behav-
manipulating the perception of the CS+, for example, by ioral frequency/time in the conditioning compartment
using clear versus opaque walls between compartments between baseline and test may then show the degree of
during testing [26]. With clear walls, the CS+ is visible also operant conditioning and reveal how much of CPP sojourn
from the sham-conditioned compartment and may induce time can be explained by these behaviors. To segregate
approach behavior into the conditioned compartment. operant conditioned behaviors from conditioned drug
With opaque walls and the CS+ only being visible inside effects, the scoring may need to be done retrospectively,
the conditioned compartment, it may not induce condi- that is, behaviors/sequences occurring during the test in
tioned approach behavior from the other compartment. the conditioning compartment may need to be identified
A higher sojourn time during a CPP test in the ‘clear’ and subsequently scored and compared during baseline.
versus the ‘opaque’ condition can provide an index for Although conditioned behaviors should be the same be-
incentive learning as an acting mechanism [26]. Alterna- tween all animals (e.g., hyperlocomotion [35,36,39], instru-
tive measures, such as the time per stay in the conditioned mental and superstitious behavioral sequences may be
compartment may also be considered [25], but interpreta- highly specific for individual animals [32].
164
Opinion Trends in Pharmacological Sciences March 2013, Vol. 34, No. 3

The contribution of conditioned drug effects may be Concluding remarks


tested by measuring the acute drug effects on behavior In this opinion article, we discuss the alternative explana-
during conditioning trials (e.g., on locomotor activity [37]), tions for an observed CPP and advocate the view that
and then assess them again during the test trial, separate- although remaining a valuable instrument to assess the
ly for conditioning and pseudo-conditioning compartments. potential of a stimulus or drug treatment to serve as a
An increase in behavioral frequency/time between baseline reward, the interpretation given to concomitant changes in
and test (and between treatment groups) provides an genetics, epigenetics, neuropharmacology, and neuroanat-
indicator for conditioned drug effects. omy must take into account processes besides classical
Depending on the species tested and the reinforcer conditioning based incentives that can contribute to results
used, a fine analysis of CPP behavior may be able to tell of CPP experiments. Accumulating evidence shows that
more about the specific effects of central nervous system there are multiple processes working in parallel which
(CNS) manipulations. Different anatomical lesions may determine the establishment and retrieval of a CPP. It
block, for example, a morphine-induced CPP to the same is suggested that by relatively modest expansions in the
degree by either inhibiting conditioned approach test design and a fine analysis of behavior during CPP
responses or behavior in the conditioning compartment establishment and testing, advanced use of the technique
[26]. It may also help to reveal why certain reinforcers, can be made which may then yield valuable information on
such as cocaine, work in a CPP paradigm only in some but the nature of the reward learning and retrieval processes
not all individuals [34]. Applying an analysis of all three involved. Because not all processes apply to the same
mechanisms may, thus, be able to tell an experimenter by extent for all natural or pharmacological reinforcers alike,
which way a CPP was blocked. the interplay between the described, but so far only sepa-
rately investigated processes needs to be characterized
Other mechanisms affecting CPP simultaneously. For each reinforcer, appropriate instru-
Memory mental and conditioned behaviors shown in a CPP setting
Whether or not any of the three possible effects of the need to be identified so that interpretation may no longer
treatment will be manifested in the test trial will depend rely on sojourn times only. Based on that, the interpreta-
on whether the animal remembers/retrieves the respective tion of manipulations will advance and help to understand
associations [26,44]. A drug may be reinforcing and at the the often complex effects of genetic or pharmacological
same time establish a state–state dependent learning interventions on parallel acting brain systems that control
[45,46]. This may diminish the probability of recalling reward learning.
associations when animals are tested in a drug-free state
[23,47]. Furthermore, should an additional treatment ef- Acknowledgments
fect on the CPP be the object of interest (e.g., a genetic This work was supported by Deutsche Forschungsgemeinschaft grants
DE 792/2-4, Hu 306/27-2, as well as NEURON-ERANET DISCover
manipulation), such a treatment can potentially influence
(BMBF 01EW1003), and funds of the Friedrich–Alexander-University
establishment of the three processes above, but also the Erlangen–Nuremberg.
memory/retrieval for any of these. A further complication
arises when one considers that a treatment may influence References
not only the memory retrieval but also the cue processing 1 Kaun, K.R. et al. (2011) A Drosophila model for alcohol reward. Nat.
and associative process themselves for either of these three Neurosci. 14, 612–619
[48,49]. 2 Cunningham, C.L. et al. (2006) Drug-induced conditioned place
preference and aversion in mice. Nat. Protoc. 1, 1662–1670
3 Tzschentke, T.M. (2007) Measuring reward with the conditioned place
Release-reward preference (CPP) paradigm: update of the last decade. Addict. Biol. 12,
Simply releasing an unhandled animal into a chamber 227–462
might have rewarding effects on its own, given that han- 4 Barros, M. et al. (2013) Decreased methylation of the NK3 receptor coding
gene (TACR3) after cocaine-induced place preference in marmoset
dling by a human experimenter is usually an aversive
monkeys. Addict. Biol. http://dx.doi.org/10.1111/j.1369-1600.2011.00409
experience for the animal. This may be influenced by 5 Wang, J. et al. (2011) Effect of morphine on conditioned place
further pharmacological treatment and eventually influ- preference in rhesus monkeys. Addict. Biol. 17, 539–546
ence behavior attributed to properties of the treatment. 6 Childs, E. and de Wit, H. (2009) Amphetamine-induced place
preference in humans. Biol. Psychiatry 65, 900–904
7 Lammel, S. et al. (2012) Input-specific control of reward and aversion in
Extinction
the ventral tegmental area. Nature 491, 212–217
Another serious problem pertains to the testing trial in the 8 Lemos, J.C. et al. (2012) Severe stress switches CRF action in the
CPP. Every test trial is essentially an extinction trial with nucleus accumbens from appetitive to aversive. Nature 490, 402–406
unique behavioral responses [45]. These can include ex- 9 Bilbao, A. et al. (2008) Loss of the Ca2+/calmodulin-dependent protein
tinction-induced aggression, ‘frustration’, and less obvious, kinase type IV in dopaminoceptive neurons enhances behavioral effects
of cocaine. Proc. Natl. Acad. Sci. U.S.A. 105, 17549–17554
extinction-induced ‘despair’. Extinction-induced behaviors 10 Deng, J.V. et al. (2010) MeCP2 in the nucleus accumbens contributes to
may also induce search behavior [50] and escape from the neural and behavioral responses to psychostimulants. Nat. Neurosci.
previously rewarded chamber [51,52]. This will reduce the 13, 1128–1136
probability that the animal spends time in the treatment 11 Jocham, G. et al. (2007) Neurokinin 3 receptor activation potentiates the
compartment. A similar problem exists with spatial learn- psychomotor and nucleus accumbens dopamine response to cocaine, but
not its place conditioning effects. Eur. J. Neurosci. 25, 2457–2472
ing in the Morris water maze [52–56] where the ‘probe’ trial 12 LaPlant, Q. et al. (2010) Dnmt3a regulates emotional behavior and
may indicate not simply recall of the conditioned place, but spine plasticity in the nucleus accumbens. Nat. Neurosci. 13,
resistance to extinction and its emotional concomitants. 1137–1143

165
Opinion Trends in Pharmacological Sciences March 2013, Vol. 34, No. 3

13 Pum, M.E. et al. (2008) Role of medial prefrontal, entorhinal, and 37 Cunningham, C.L. and Noble, D. (1992) Conditioned activation
occipital 5-HT in cocaine-induced place preference and induced by ethanol: role in sensitization and conditioned place
hyperlocomotion: evidence for multiple dissociations. preference. Pharmacol. Biochem. Behav. 43, 307–313
Psychopharmacology (Berl.) 201, 391–403 38 Reicher, M.A. and Holman, E.W. (1977) Location preference and flavor
14 Solinas, M. et al. (2008) Reversal of cocaine addiction by environmental aversion reinforced by amphetamine in rats. Anim. Learn. Mem. 5,
enrichment. Proc. Natl. Acad. Sci. U.S.A. 105, 17145–17150 343–346
15 Szumlinski, K.K. et al. (2005) Homer2 is necessary for EtOH-induced 39 Carey, R.J. et al. (2005) Evidence for Pavlovian conditioning of cocaine-
neuroplasticity. J. Neurosci. 25, 7054–7061 induced responses linked to emotional behavioral effects. Pharmacol.
16 McBride, W.J. et al. (1999) Localization of brain reinforcement Biochem. Behav. 80, 123–134
mechanisms: intracranial self-administration and intracranial place- 40 Bardo, M.T. et al. (1995) Conditioned place preference using opiate and
conditioning studies. Behav. Brain Res. 101, 129–152 stimulant drugs: a meta-analysis. Neurosci. Biobehav. Rev. 19, 39–51
17 Müller, C.P. et al. (2007) Serotonin and psychostimulant addiction: 41 Durazzo, T.C. et al. (1994) Cocaine-induced conditioned place approach
focus on 5-HT1A-receptors. Prog. Neurobiol. 81, 133–178 in rats: the role of dose and route of administration. Pharmacol.
18 Olmstead, M.C. (2006) Animal models of drug addiction: Where do we Biochem. Behav. 49, 1001–1005
go from here? Q. J. Exp. Psychol. (Colchester) 59, 625–653 42 Shimosato, K. and Watanabe, S. (2003) Concurrent evaluation of
19 Sanchis-Segura, C. and Spanagel, R. (2006) Behavioural assessment of locomotor response to novelty and propensity toward cocaine
drug reinforcement and addictive features in rodents: an overview. conditioned place preference in mice. J. Neurosci. Methods 128,
Addict. Biol. 11, 2–38 103–110
20 Bardo, M.T. and Bevins, R.A. (2000) Conditioned place preference: 43 Ma, S.T. et al. (2010) Repeated intravenous cocaine experience:
what does it add to our preclinical understanding of drug reward? development and escalation of pre-drug anticipatory 50-kHz
Psychopharmacology (Berl.) 153, 31–43 ultrasonic vocalizations in rats. Behav. Brain Res. 212, 109–114
21 Prus, A.J. et al. (2009) Conditioned place preference. In Methods of 44 White, N.M. and Milner, P.M. (1992) The psychobiology of reinforcers.
Behavior Analysis in Neuroscience (Buccafusco, J.J., ed.), CRC Press Annu. Rev. Psychol. 43, 443–471
22 Olds, J. and Milner, P. (1954) Positive reinforcement produced by 45 Bouton, M.E. and Moody, E.W. (2004) Memory processes in classical
electrical stimulation of septal area and other regions of rat brain. conditioning. Neurosci. Biobehav. Rev. 28, 663–674
J. Comp. Physiol. Psychol. 47, 419–427 46 Overton, D.A. (1978) Basic mechanisms of state-dependent learning.
23 Bozarth, M.A. (1987) Conditioned place preference: a parametric Psychopharmacol. Bull. 14, 67–68
analysis using systemic heroin injections. In Methods of Assessing 47 Dockstader, C.L. and van der Kooy, D. (2001) Mouse strain differences
the Reinforcing Properties of Abused Drugs (Bozarth, M.A., ed.), pp. in opiate reward learning are explained by differences in anxiety, not
241–273, Springer reward or learning. J. Neurosci. 21, 9077–9081
24 Katz, R.J. and Gormezano, G. (1979) A rapid and inexpensive 48 Carey, R.J. et al. (2008) Cocaine effects on behavioral responding to a
technique for assessing the reinforcing effects of opiate drugs. novel object placed in a familiar environment. Pharmacol. Biochem.
Pharmacol. Biochem. Behav. 11, 231–233 Behav. 88, 265–271
25 Bardo, M.T. et al. (1984) Conditioned place preference with morphine: 49 Pum, M.E. et al. (2011) The effects of cocaine on light-induced activity.
the effect of extinction training on the reinforcing CR. Pharmacol. Brain Res. Bull. 84, 229–234
Biochem. Behav. 21, 545–549 50 Pecoraro, N.C. et al. (1999) Incentive downshifts evoke search
26 White, N.M. et al. (2005) Learning the morphine conditioned cue repertoires in rats. J. Exp. Psychol. Anim. Behav. Process 25, 153–167
preference: cue configuration determines effects of lesions. 51 Komorowski, M. et al. (2012) Distance from source of reward as a marker
Pharmacol. Biochem. Behav. 81, 786–796 for extinction-induced ‘‘despair’’: modulation by the antidepressants
27 Rescorla, R.A. and Wagner, A.R. (1972) A theory of Pavlovian clomipramine and citalopram. Neuroscience 223, 152–162
conditioning: variations in the effectiveness of reinforcement and 52 Huston, J.P. et al. (2009) Toward an animal model of extinction-
nonreinforcement. In Classical Conditioning II: Current Research induced despair: focus on aging and physiological indices. J. Neural
and Theory (Black, A.H. and Prokasy, W.F., eds), pp. 64–99, Transm. 116, 1029–1036
Appleton-Century-Crofts 53 Schulz, D. et al. (2007) ‘‘Despair’’ induced by extinction trials in the
28 Berridge, K.C. (2007) The debate over dopamine’s role in reward: the water maze: relationship with measures of anxiety in aged and adult
case for incentive salience. Psychopharmacology (Berl.) 191, 391–431 rats. Neurobiol. Learn. Mem. 87, 309–323
29 Bindra, D. (1974) A motivational view of learning, performance, and 54 Schulz, D. et al. (2007) Extinction-induced ‘‘despair’’ in the water maze,
behavior modification. Psychol. Rev. 81, 199–213 exploratory behavior and fear: effects of chronic antidepressant
30 Bolles, R.C. (1972) Reinforcement, expectancy, and learning. Psychol. treatment. Neurobiol. Learn. Mem. 87, 624–634
Rev. 79, 394–409 55 Huston, J.P. et al. Animal models of extinction-induced depression: loss
31 Spiteri, T. et al. (2000) What is learned during place preference of reward and its consequences. Neurosci. Biobehav. Rev. (in press)
conditioning? A comparison of food- and morphine-induced reward. 56 Topic, B. et al. (2008) Extinction-induced ‘‘despair’’ in aged and adult
Psychobiology 28, 367–382 rats: links to neurotrophins in frontal cortex and hippocampus.
32 Skinner, B.F. (1948) ‘Superstition’ in pigeons. J. Exp. Psychol. 38, Neurobiol. Learn. Mem. 90, 519–526
168–172 57 Mueller, D. and Stewart, J. (2000) Cocaine-induced conditioned place
33 Staddon, J.E.R. et al. (1971) The ‘‘superstition’’ experiment: a preference: reinstatement by priming injections of cocaine after
reexamination of its implications for the principles of adaptive extinction. Behav. Brain Res. 115, 39–47
behavior. Psychol. Rev. 78, 3–43 58 Rotter, A. et al. (2012) Glucocorticoid receptor antagonism blocks
34 Meyer, P.J. et al. (2012) A cocaine cue is more preferred and evokes ethanol-induced place preference learning in mice and attenuates
more frequency-modulated 50-kHz ultrasonic vocalizations in rats dopamine D2 receptor adaptation in the frontal cortex. Brain Res.
prone to attribute incentive salience to a food cue. Bull. 88, 519–524
Psychopharmacology (Berl.) 219, 999–1009 59 Hasenöhrl, R.U. et al. (1989) Conditioned place preference in the corral:
35 Carey, R.J. and Damianopoulos, E.N. (1992) Opponent-process theory a procedure for measuring reinforcing properties of drugs. J. Neurosci.
and drug conditioning: an assessment for conditioned stimulant- Methods 30, 141–146
induced movement. Behav. Brain Res. 51, 139–147 60 Cunningham, C.L. et al. (2006) Spatial location is critical for
36 Carey, R.J. and Gui, J. (1998) Cocaine conditioning and cocaine conditioning place preference with visual but not tactile stimuli.
sensitization: What is the relationship? Behav. Brain Res. 92, 67–76 Behav. Neurosci. 120, 1115–1132

166

You might also like