Professional Documents
Culture Documents
919–934, 2010
doi:10.1093/schbul/sbq068
Advance Access publication on June 21, 2010
919
D. M. Barch & E. C. Dowd
patients4,13, (4) patients on medications4,9, (5) patients off Although an oversimplification, it helps to organize this
medications12, (6) first-episode patients8, (7) chronic large literature by thinking of 4 major components to the
patients11, and (8) patients across many different translation of appetitive or reward information into be-
cultures.5,6,8,10,13 havioral responses3,24,27–29 (see figure 1). The first com-
The constructs of anhedonia/avolition play a major ponent, referred to as ‘‘hedonics or liking,’’ reflects the
role in many theories of schizophrenia, including those ability of the organism to ‘‘enjoy’’ the stimulus or event
that focus on liability to the disorder.14–17 However, as that may provide pleasure or reward. For many years, it
reviewed below, studies suggest that when provided was suggested that the neurotransmitter dopamine (DA)
with potentially enjoyable stimuli, events or experiences, was the primary substrate of liking.24 However, more re-
individuals with schizophrenia seem to enjoy such expe- cent research has shown that experimental depletion of
riences as much as controls.18–23 Nonetheless, one of the DA does not reduce liking when it can be measured by
fundamental challenges in the development of therapeu- facial expression and/or subjective reports.24 Instead, he-
tic interventions is that individuals with schizophrenia donic responses (at least to primary sensory stimuli) seem
seem less motivated to engage in goal-directed behavior to be mediated by activation of the opioid and gamma
that would bring them into contact with potentially en- amino butyric acidergic systems in the nucleus accum-
thirsty vs not),44 the delay before the reward occurs,45,46 from nucleus accumbens and related forebrain cir-
the different reward options available (eg, juice vs wine cuitry.58–61 For example, research has shown that ACC
after a hard day),47,48 and the changing contingencies as- lesions as well as depletions of accumbens DA lead ani-
sociated with a stimulus (a previously rewarded response mals to choose low effort but low reward options over
is now punished).49 Some researchers have described the higher reward but higher effort options.46,58,59,62–65
OFC as being involved in ‘‘working memory for value’’ The potential role of ACC in computing effort may fit
or the ability to maintain, update, and integrate different nicely with its suggested role in responding to conflict
sources of information about value over a short period of and error-related signals,66–68 as feedback about conflict
time.3,50 Human functional neuroimaging studies also and errors may be an important source of information
highlight activation of OFC under conditions requiring about the amount of effort a particular course of action
value representations,51,52 including those in which re- is likely to require. Indeed, some work in healthy popu-
sponse contingencies need to be updated, such as reversal lations has suggested that error/conflict effects in ACC
learning.51,53,54 In addition, humans with OFC lesions are modulated by motivational/affective and reward
can show reversal learning impairments.55–57 variables.69,70 However, it is not yet clear whether the
Another aspect of representing value information is same regions of ACC that respond to conflict/error are
‘‘effort computation,’’ ie, determining the cost of engag- those involved in effort computations or whether these
ing in whatever actions it will take to obtain that out- represent different functional subdivisions of ACC,
come. For example, one may really want to obtain though both types of studies have shown activation of
chocolate cookies and may perceive eating these cookies similar regions of dorsal anterior cingulate.60,61,66,71
as rewarding, but the effort associated with having to go Nonetheless, even if it should turn out that this reflects
to the store may prevent the person from pursuing a common mechanism, it helps to outline the role that
actions to obtain the cookies. A growing body of research ACC may play in a range of decision-making domains.
suggests that the dorsal anterior cingulate cortex (ACC) A fourth component is the ability to ‘‘generate and ex-
may be important for evaluating the effort associated ecute goal-directed action plans necessary to achieve the
with different action plans, in concert with DA input valued outcome.’’ Wallis and others have suggested that
921
D. M. Barch & E. C. Dowd
this function is carried out by the lateral prefrontal cortex ing and watching TV) and that individuals with schizo-
(PFC) (in particular, dorsolateral PFC [DLPFC]).3,72,73 phrenia report less anticipatory pleasure than do
Such a role for the DLPFC in motivated behavior would controls even for those goal-directed events that they do
be consistent with its role in top-down control of cogni- experience.26
tive processing, planning, and response execution is con- Despite the robust evidence for relatively intact self-
sistent with models suggesting that the DLPFC provides reports of experienced pleasure or valence in group anal-
a bias signal that helps to facilitate goal-directed behav- yses of studies with individuals with schizophrenia, it is
ior72 and is consistent with evidence for impaired action also increasingly clear that there are important individual
planning following lateral prefrontal lesions.74,75 In other differences in the level of anhedonia/avolition that may
words, intact DLPFC function may be necessary to influence these experiences. For example, we and others
translate information about value into goal representa- have found that patients who self-report greater levels of
tions that can be implemented as action plans to achieve social and physical anhedonia report experiencing less-
the desired outcome. Furthermore, some theories of goal positive responses to putatively positive stimuli such as
maintenance in DLPFC emphasize the importance of pictures, faces, and words.100,105 Interestingly, however,
phasic DA input as a gating signal that serves to update these relationships are not unique to positive stimuli.
In terms of studies using explicit rewards, robust ven- which learning is relatively easy,125–134 though with a few
tral striatal responses to the receipt of money have been exceptions.135,136
observed in patients treated with either typical or atypical In contrast, when the paradigms become more difficult
antipsychotics.113–115 Interestingly, Simon found that the and include varying levels of probability and discrimina-
magnitude of the reward receipt response in the ventral tion, individuals with schizophrenia show more evidence
striatum was inversely associated with severity of depres- of impaired reinforcement learning.137,138 For example,
sion but not with anhedonia.114 Schlagenhauf did not Gold and colleagues139 found evidence for impaired
find group differences in the response to rewards in learning in schizophrenia on the Frank Probabilistic Dis-
the ventral striatum, though they did not clearly see intact crimination Task. A novel feature of this task is that it
responses in patients, and there were reduced striatal enables examination of reward value learning through
responses to loss avoidance among the individuals with transfer effects. In the transfer phase, individuals with
schizophrenia.116 Furthermore, they did see reduced re- schizophrenia showed less of a tendency to choose the
ward-related responses in medial PFC.116 At least one stimulus previously associated with higher reward value.
study did find some evidence for reduced striatal Although this pattern could reflect impaired basal gan-
responses to the receipt of juice (though medication glia-mediated reinforcement learning mechanisms, it
paradigms involve passive (ie, Pavlovian) conditioning, errors, which in theory should also depend on a represen-
whereas others, such as the Knutson paradigm,37 require tation of expected reward. As noted above, this study did
speeded responses to obtain rewards. Several studies have not control for the effects of smoking on taste processing
reported reduced ventral striatum activity in schizophre- in schizophrenia (which could alter responses to juice),
nia using the Knutson paradigm. Juckel and Schlagen- representing a confound for assessing positive prediction
hauf found such effects in unmedicated individuals errors (responses to unexpected juice rewards). Interest-
with schizophrenia116,150 as well as in individuals taking ingly, however, Waltz et al did find that the magnitude of
typical antipsychotics but not in individuals treated with prediction errors in basal ganglia among patients was
atypicals.151,152 However, in the Schlagenhauf study, the negatively correlated with avolition scores, suggesting
apparent improvement in reward cue responses among a link to clinically relevant symptoms. In more recent
the individuals switched to olanzapine (eg, lack of group work, Walter et al found intact prediction error responses
difference) was strongly influenced by reduced reward in the striatum for both positive and negative prediction
cue responses in controls at follow-up. Juckel also found errors, though again this was a relatively low negative
that the severity of negative symptoms predicted the re- symptom sample.
duction in ventral striatal responses in unmedicated and There has also been one imaging study looking at the
Weather Prediction Task. Weickert et al146 found that
related to the severity of negative symptoms, again point- the translation to more abstract representations that are
ing to the importance of examining individual difference likely to govern daily life function.
relationships among individuals with schizophrenia. Fur-
thermore, at least 2 studies have also found altered
Effort Computations and ACC Function in Schizophrenia
activation in frontal regions during probabilistic rein-
forcement learning, suggesting a potentially important To our knowledge, there is no work directly addressing
role for cortically mediated mechanisms. effort computations in schizophrenia. However, research
has examined ACC function in schizophrenia using a va-
riety of conflict and error processing paradigms. As noted
Value Computations and OFC Function in Schizophrenia
above, it is not clear whether conflict monitoring and/or
As described above, one hypothesis is that the OFC sup- error processing share similar cognitive mechanisms with
ports the computation of value or the integration of the effort computation or rely on the same ACC regions,
reinforcing properties of the stimulus with the internal though there is growing evidence that both are associated
state of the organism, which includes updating changes with activation of the dorsal ACC.60,61,66,71 Nevertheless,
in the reinforcing properties of the stimulus. There are this literature does provide hints as to the functional in-
in schizophrenia.199–204 However, there have been a few ever approach one chooses to use, the large body of lit-
nonreplications,205,206 and some suggestions that reduced erature demonstrating an important effect of negative
NAA may result from antipsychotic treatment.207 An im- symptom severity indicates that small sample studies
portant question is whether the cognitive control impair- of unselected patients are no longer useful or informative
ments observed in schizophrenia that have been for moving the work in this area forward. Of course, ar-
associated with altered DLPFC function reflect problems guing that one should examine individual differences in
in translating reward information into goal representa- anhedonia and avolition in schizophrenia in both behav-
tions. One means to examine this issue is to determine ioral and imaging studies begs the question of whether
how motivational incentives impact cognitive perfor- our existing measures are adequate for these purposes.215
mance, potentially via modulation of DLPFC activity. Recent consensus-building work has argued that the
Several studies suggest that individuals with schizophre- existing measures are in fact not adequate1 and the devel-
nia are not able to improve their performance on cogni- opment of new measures is underway, with a focus on
tive tasks when offered monetary incentives,208–211 but an incorporating constructs and findings from the basic sci-
equal number suggest at least some evidence for improve- ence literature. Importantly, such measures may allow us
ment with reward.212–214 There is also work on the use of to more validly map the phenomenology of schizophre-
has not directly tied such deficits to impairments in reward We believe that studying the neural mechanisms of re-
processing. Moreover, it is also difficult to disentangle ward processing in schizophrenia is critically important
DLPFC-dependent mechanisms related to reward pro- for understanding the poor functional outcomes that
cessing from other similar processes, such as cue-based are prominent in this population. Research has identified
reward prediction and/or value-effort computations. the persistence of cognitive deficits even with treatment as
Nonetheless, there are intriguing hints that individuals one of the key mechanisms constraining functional abil-
with schizophrenia may not be able to use reward infor- ity in schizophrenia.222,223 However, symptoms such as
mation to modulate cognitive control and DLPFC anhedonia and avolition also represent significant con-
function, suggesting a potentially important role for straints on functional outcome in this illness. The pres-
cortical–striatal interactions in mediating impairment in ence of anhedonia is associated with poor community
motivated and goal-directed behavior in schizophrenia. and social function99,224–228 and predicts poor long-
Thus, in future studies, it will be critical to examine the term outcomes.99,229–231 It may turn out that some of
interaction of these mechanisms in the same individuals, the same mechanisms leading to cognitive deficits in
taking into account clinical heterogeneity. schizophrenia also contribute to anhedonia and avoli-
The above discussion reviews the potential mechanisms tion, such as DLPFC-mediated disturbances in goal
maintenance.232,233 If so, then treatments aimed at im-
928
Goal Representations and Motivational in Schizophrenia
41. Montague PR, Dayan P, Sejnowski TJ. A framework for 60. Croxson PL, Walton ME, O’Reilly JX, Behrens TE,
mesencephalic dopamine systems based on predictive Heb- Rushworth MF. Effort-based cost-benefit valuation and
bian learning. J Neurosci. 1996;16:1936–1947. the human brain. J Neurosci. 2009;29:4531–4541.
42. Frank MJ, Seeberger LC, O’Reilly RC. By carrot or by 61. Botvinick MM, Huffstetler S, McGuire JT. Effort discount-
stick: cognitive reinforcement learning in parkinsonism. ing in human nucleus accumbens. Cogn Affect Behav Neuro-
Science. 2004;306:1940–1943. sci. 2009;9:16–27.
43. Dayan P, Balleine BW. Reward, motivation, and reinforce- 62. Rudebeck PH, Buckley MJ, Walton ME, Rushworth MF. A
ment learning. Neuron. 2002;36:285–298. role for the macaque anterior cingulate gyrus in social valu-
44. Rolls ET, Sienkiewicz ZJ, Yaxley S. Hunger modulates the ation. Science. 2006;313:1310–1312.
responses to gustatory stimuli of single neurons in the cau- 63. Rudebeck PH, Walton ME, Millette BH, Shirley E,
dolateral orbitofrontal cortex of the macaque monkey. Eur Rushworth MF, Bannerman DM. Distinct contributions
J Neurosci. 1989;1:53–60. of frontal areas to emotion and social behaviour in the rat.
45. Roesch MR, Olson CR. Neuronal activity in Eur J Neurosci. 2007;26:2315–2326.
primate orbitofrontal cortex reflects the value of time. 64. Rushworth MF, Behrens TE, Rudebeck PH, Walton ME.
J Neurophysiol. 2005;94:2457–2471. Contrasting roles for cingulate and orbitofrontal cortex in
46. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, decisions and social behaviour. Trends Cogn Sci.
Rushworth MF. Separate neural pathways process different 2007;11:168–176.
929
D. M. Barch & E. C. Dowd
80. Sakagami M, Watanabe M. Integration of cognitive and memory in schizophrenia. J Abnorm Psychol. 2007;116:
motivational information in the primate lateral prefrontal 43–55.
cortex. Ann N Y Acad Sci. 2007;1104:89–107. 100. Herbener ES, Song W, Khine TT, Sweeney JA. What
81. Krawczyk DC, Gazzaley A, D’Esposito M. Reward modu- aspects of emotional functioning are impaired in schizophre-
lation of prefrontal and visual association cortex during an nia? Schizophr Res. 2007;98:239–246.
incentive working memory task. Brain Res. 2007;1141:168– 101. Doop ML, Park S. On knowing and judging smells: identi-
177. fication and hedonic judgment of odors in schizophrenia.
82. Kobayashi S, Nomoto K, Watanabe M, Hikosaka O, Schizophr Res. 2006;81:317–319.
Schultz W, Sakagami M. Influences of rewarding and aver- 102. Schneider F, Habel U, Reske M, Toni I, Falkai P, Shah NJ.
sive outcomes on activity in macaque lateral prefrontal cor- Neural substrates of olfactory processing in schizophrenia
tex. Neuron. 2006;51:861–870. patients and their healthy relatives. Psychiatry Res.
83. Locke H, Braver TS. Motivational influences on cognitive 2007;155:103–112.
control: behavior, brain activation, and individual differen- 103. Aghevli MA, Blanchard JJ, Horan WP. The expression and
ces. Cogn Affect Behav Neurosci. 2008;8:99–112. experience of emotion in schizophrenia: a study of social
84. Tsujimoto S, Sawaguchi T. Context-dependent representa- interactions. Psychiatry Res. 2003;119:261–270.
tion of response-outcome in monkey prefrontal neurons. 104. Tremeau F, Antonius D, Cacioppo JT, et al. Anticipated,
Cereb Cortex. 2005;15:888–898. on-line and remembered positive experience in schizophre-
930
Goal Representations and Motivational in Schizophrenia
unpredictable and predictable primary reinforcers. Neuro- 136. Pantelis C, Barber FZ, Barnes TR, Nelson HE, Owen AM,
psychopharmacology. 2009;34:1567–1577. Robbins TW. Comparison of set-shifting ability in patients
118. Blanchard JJ, Bellack AS, Mueser KT. Affective and social- with chronic schizophrenia and frontal lobe damage. Schiz-
behavioral correlates of physical and social anhedonia in ophr Res. 1999;37:251–270.
schizophrenia. J Abnorm Psychol. 1994;103:719–728. 137. Morris SE, Heerey EA, Gold JM, Holroyd CB. Learning-re-
119. Laruelle M, VanDyck C, Abi-Dargham A. SPECT imaging lated changes in brain activity following errors and perfor-
of dopamine release following amphetamine challenge in mance feedback in schizophrenia. Schizophr Res.
healthy subjects and in patients with schizophrenia. J Nucl 2008;99:274–285.
Med. 1995;36:10P. 138. Koch K, Schachtzabel C, Wagner G, et al. Altered activa-
120. Laruelle M, D’Souza GD, Zoghbi S, Baldwin R, Charney D, tion in association with reward-related trial-and-error learn-
Innis R. SPECT measurement of dopamine synaptic concen- ing in patients with schizophrenia. Neuroimage.
tration in the resting state. J Nucl Med. 1996;37:32. 2009;50:223–232.
121. Laruelle M, Abi-Dargham A, Gil R, Kegeles L, Innis R. In- 139. Waltz JA, Frank MJ, Robinson BM, Gold JM. Selective re-
creased dopamine transmission in schizophrenia: relation- inforcement learning deficits in schizophrenia support pre-
ship to illness phases. Biol Psychiatry. 1999;46:56–72. dictions from computational models of striatal-cortical
122. Toda M, Abi-Dargham A. Dopamine hypothesis of schizo- dysfunction. Biol Psychiatry. 2007;62:756–764.
phrenia: making sense of it all. Curr Psychiatry Rep. 140. Gold JM, Waltz JA, Prentice KJ, Morris SE, Heerey EA.
931
D. M. Barch & E. C. Dowd
typical neuroleptics to olanzapine. Psychopharmacology 169. Bertollo DN, Cowen MA, Levy AV. Hypometabolism in ol-
(Berl). 2008;196:673–684. factory cortical projection areas of male patients with
153. Murray GK, Corlett PR, Clark L, et al. Substantia nigra/ schizophrenia: an initial positron emission tomography
ventral tegmental reward prediction error disruption in psy- study. Psychiatry Res. 1996;60:113–116.
chosis. Mol Psychiatry. 2008;13:267–276. 170. Moberg PJ, Turetsky BI. Scent of a disorder: olfactory func-
154. Turnbull OH, Evans CE, Kemish K, Park S, Bowman CH. tioning in schizophrenia. Curr Psychiatry Rep. 2003;5:
A novel set-shifting modification of the Iowa gambling task: 311–319.
flexible emotion-based learning in schizophrenia. Neuropsy- 171. Alain C, McNeely HE, Yu H, Christensen BK, West R.
chology. 2006;20:290–298. Neurophysiological evidence of error monitoring deficits in
155. Shurman B, Horan WP, Nuechterlein KH. Schizophrenia patients with schizophrenia. Cereb Cortex. 2002;12:
patients demonstrate a distinctive pattern of decision-mak- 840–846.
ing impairment on the Iowa Gambling Task. Schizophr 172. Kerns JG, Cohen JD, MacDonald AW, 3rd, et al. Decreased
Res. 2005;72:215–224. conflict- and error-related activity in the anterior cingulate
156. Sevy S, Burdick KE, Visweswaraiah H, et al. Iowa gambling cortex in subjects with schizophrenia. Am J Psychiatry.
task in schizophrenia: a review and new data in patients with 2005;162:1833–1839.
schizophrenia and co-occurring cannabis use disorders. 173. Kopp B, Rist F. An event-related brain potential
Schizophr Res. 2007;92:74–84. substrate of disturbed response monitoring in paranoid
932
Goal Representations and Motivational in Schizophrenia
neuroimaging studies of working memory in schizophrenia. 203. Thomas MA, Ke Y, Levitt J, et al. Preliminary study of
Hum Brain Mapp. 2005;25:60–69. frontal lobe 1H MR spectroscopy in childhood-onset schizo-
187. Davidson LL, Heinrichs RW. Quantification of frontal and phrenia. J Magn Reson Imaging. 1998;8:841–846.
temporal lobe brain-imaging findings in schizophrenia: 204. Cecil KM, Lenkinski RE, Gur RE, Gur RC. Proton mag-
a meta-analysis. Psychiatry Res. 2003;122:69–87. netic resonance spectroscopy in the frontal and temporal
188. Minzenberg MJ, Laird AR, Thelen S, Carter CS, Glahn DC. lobes of neuroleptic naive patients with schizophrenia.
Meta-analysis of 41 functional neuroimaging studies of exec- Neuropsychopharmacology. 1999;20:131–140.
utive function in schizophrenia. Arch Gen Psychiatry. 205. Delamillieure P, Constans JM, Fernandez J, et al. Proton
2009;66:811–822. magnetic resonance spectroscopy (1H MRS) in schizophre-
189. Van Snellenberg JX, Torres IJ, Thornton AE. Functional nia: investigation of the right and left hippocampus,
neuroimaging of working memory in schizophrenia: task thalamus, and prefrontal cortex. Schizophr Bull. 2002;28:
performance as a moderating variable. Neuropsychology. 329–339.
2006;20:497–510. 206. Wood SJ, Berger G, Velakoulis D, et al. Proton magnetic
190. Shenton ME, Dickey CC, Frumin M, McCarley RW. A re- resonance spectroscopy in first episode psychosis and
view of MRI findings in schizophrenia. Schizophr Res. ultra high-risk individuals. Schizophr Bull. 2003;29:
2001;49:1–52. 831–843.
191. Selemon LD, Mrzljak J, Kleinman JE, Herman MM, 207. Bustillo JR, Lauriello J, Rowland LM, et al. Longitudinal
933
D. M. Barch & E. C. Dowd
a final common pathway in schizophrenia? Schizophr Bull. 228. Bellack AS, Morrison RL, Wixted JT, Mueser KT. An anal-
2007;33:971–981. ysis of social competence in schizophrenia. Br J Psychiatry.
221. West AR, Floresco SB, Charara A, Rosenkranz JA, Grace 1990;156:809–818.
AA. Electrophysiological interactions between striatal gluta- 229. Mueser KT, Douglas MS, Bellack AS, Morrison RL. As-
matergic and dopaminergic systems. Ann N Y Acad Sci. sessment of enduring deficit and negative symptom subtypes
2003;1003:53–74. in schizophrenia. Schizophr Bull. 1991;17:565–582.
222. Green MF, Kern RS, Braff DL, Mintz J. Neurocognitive 230. Fenton WS, McGlashan TH. Natural history of schizophre-
deficits and functional outcome in schizophrenia: are we nia subtypes. II. Positive and negative symptoms and long-
measuring the ‘‘right stuff’’? Schizophr Bull. 2000;26: term course. Arch Gen Psychiatry. 1991;48:978–986.
119–136. 231. Herbener ES, Harrow M, Hill SK. Change in the relation-
223. Green MF, Kern RS, Heaton RK. Longitudinal studies ship between anhedonia and functional deficits over a 20-
of cognition and functional outcome in schizophrenia: year period in individuals with schizophrenia. Schizophr
implications for MATRICS. Schizophr Res. 2004;72: Res. 2005;75:97–105.
41–51. 232. Barch DM, Carter CS, Cohen JD. Context processing deficit
224. Rey ER, Bailer J, Brauer W, Handel M, Laubenstein D, in schizophrenia: diagnostic specificity, 4-week course, and
Stein A. Stability trends and longitudinal correlations of relationships to clinical symptoms. J Abnorm Psychol.
negative and positive syndromes within a three-year fol- 2003;112:132–143.
934