You are on page 1of 11

REVIEWS

The human imagination: the cognitive


neuroscience of visual mental imagery
Joel Pearson   
Abstract | Mental imagery can be advantageous, unnecessary and even clinically disruptive.
With methodological constraints now overcome, research has shown that visual imagery
involves a network of brain areas from the frontal cortex to sensory areas, overlapping with
the default mode network , and can function much like a weak version of afferent perception.
Imagery vividness and strength range from completely absent (aphantasia) to photo-​like
(hyperphantasia). Both the anatomy and function of the primary visual cortex are related
to visual imagery. The use of imagery as a tool has been linked to many compound cognitive
processes and imagery plays both symptomatic and mechanistic roles in neurological and
mental disorders and treatments.

What is the human imagination? What is this amazing individuals can experience vivid colour without colour
ability, which most of us have, that allows us to travel information stimulating the retina2. In post-​traumatic
through space and time, testing out different virtual stress disorder (PTSD), individuals experience flash­
worlds, objects, foods, fears and pleasures? When we backs or vivid, intrusive memories of trauma expe­
think about the sensory characteristics of something rienced as involuntary imagery 3. Such conscious,
like an apple or a sunset, most of us have a conscious involuntary sensory experiences, without a direct cor­
visual experience of those things. We literally become responding sensory input, have elsewhere been dubbed
conscious of some version of the apple or sunset, albeit ‘phantom perceptions’2. One proposed overarching
a degraded, fuzzy or weak experience. framework is that internal experiences like imagery
Mental imagery has played a central role in discus­ can be divided into two types of imagery-​like experi­
sions of mental function for thousands of years, first by ences, where one is voluntary and the other involuntary.
philosophers, then by psychologists, and now by neuro­ These two categories are analogous to the subtypes of
scientists. Almost any behaviour or cognitive process attention — endogenous and exogenous4 — and, as in
that might gain from sensory simulation tends to utilize the early days of research into attention, current work
mental images. is just beginning to shed light on the commonalities
However, to a minority of individuals, the idea that and differences between these two forms of phantom
people can have a voluntary conscious sensory experi­ perception2.
ence in their mind’s eye comes as a complete surprise; Importantly, mental imagery covers all five senses;
these individuals lack the ability to voluntarily form however, visual mental imagery research has tended to
mental images: aphantasia1. On the other side of the dominate, as is also the case with perception research.
spectrum, strong imagery plays a core role in many Focusing research on one faculty can make the endeav­
anxiety disorders, depression, schizophrenia and our more tractable and studying vision has several
Parkinson disease, and is increasingly being harnessed advantages over studying the other senses. Humans
as a uniquely powerful tool for psychological treatment. are visual creatures; this is clear when we look at the
Mapping out imagery’s seemingly contradictory contri­ proportion of cortical tissue assigned to processing
butions to human cognition, whereby imagery can be visual information as compared to the other senses.
both advantageous and clinically disruptive, or even Additionally, visual perception is vivid and full of
possibly unnecessary (aphantasia), offers exciting novel detailed information, often making visual stimuli
insights into the human mind. informative tools, as is the case with many illusions that
School of Psychology, When people talk about the mind’s eye, they typi­ induce forms of involuntary phantom vision. However,
The University of New South
Wales, Sydney, Australia.
cally refer to the voluntary experience of creating a it is worth noting the limitations this focus on vision
conscious sensory experience at will. However, there are has on our overall understanding of mental imagery
e-​mail: jpearson@
unsw.edu.au many examples of involuntary sensory experiences that and it is perhaps too often assumed that findings
https://doi.org/10.1038/ are equally decoupled from direct sensory input. For from visual imagery will naturally generalize to the
s41583-019-0202-9 example, in synaesthesia and in many visual illusions, other senses.

Nature Reviews | Neuroscience


Reviews

Reverse directionality
Neural mechanisms of visual imagery Due largely to the imagery debate (Box 1), the major­
The reverse direction of neural Mental imagery involves activity across a large neural ity of neural imaging work on mental imagery has
information flow, for example, network spanning frontal areas right back to primary focused on early visual areas and the overlap or similar­
from the top-​down, as opposed sensory areas. The neuroscience of imagery can be ities between visual imagery and visual perception. As
to the bottom-​up.
divided into work looking at the mechanisms involved such, not much brain imaging work has investigated this
in triggering the imagery process, mechanisms of gener­ systemic model of voluntary imagery in operation as a
ation or manipulation, as well as mechanisms underlying whole, though evidence from various different studies
the strength and vividness of visual imagery content and does appear to support it.
its overlap with sensory perception. However, imagining
an apple, doing a mental rotation task or imagining per­ Frontal areas. Forming or manipulating a mental image
forming a sporting activity are three very different tasks does appear to involve activity in the frontal areas7–10.
that too often get referred to simply as imagery. Much However, the activity in frontal areas seems largely inde­
work has been done investigating visual imagery in pendent of the precise content of the imagery9–11. This
particular, and the role of the primary visual cortex suggests that frontal areas play more of a general organ­
(V1), for reasons relating to the imagery debate (Box 1). izational or executive role in coordinating spatial and
Further, more recently, the large individual differences sensory areas, rather than holding imagery representa­
in imagery strength and vividness have been harnessed tions or content per se. The frontal cortex shows up as
to obtain information about the neural mechanisms of an active area in many functional magnetic resonance
imagery. Here, a brief overview is given of the evidence imaging (fMRI) studies7,9–12. However, despite some
for the involvement of different neural areas and how evidence of reverse directionality through the processing
imagery is processed across the network of these areas. hierarchy5,6, it remains unclear how the different areas
throughout the brain cooperate dynamically to achieve
Imagery creation: vision in reverse the goal of an imagery experience. Part of the difficulty
It is hypothesized that voluntary mental imagery is based in parsing out the isolated role of frontal areas is due
on combinations of information retrieved from stored to the diversity of types of imagery tasks performed in
memory. Accordingly, a very simple yet intuitive model fMRI experiments. For example, imagining an apple,
of functional voluntary imagery has been proposed as doing a mental rotation task or imagining a physical
depicted in Fig. 1: a reverse visual hierarchy5,6. In addi­ activity are three very different tasks that logically should
tion to the empirical evidence, this model also makes involve different brain areas, yet all get referred to under
intuitive sense as it is difficult to imagine content you the umbrella term ‘imagery’13,14.
have never been exposed to and therefore have no mem­
ories of. Typically, in imagery generation, we are com­ Hippocampus. Some evidence suggests that the hippo­
bining different content that our senses have previously campus might be required to form complex or spatially
been exposed to and is stored in our memory. distributed images. When individuals form such images,
a blood oxygen level-​dependent (BOLD) response has
been documented in the hippocampus15,16. Likewise,
Box 1 | imagery debate
individuals with hippocampal damage show spatially
starting in the 1970s and running until the 2000s, a debate over the nature of mental related impairments in constructing imagined experi­
representation dominated mental imagery research21,134. the debate hinged on the ences and their narrative descriptions lack richness and
question of what formats the brain could represent information in. One side of the spatial coherence17. When single neurons are measured
debate argued that information about visual objects was stored in a symbolic, and even directly in humans, a small percentage of hippocampal
language-​like, format135, whereas the other side argued that such information can be
cells do respond to imagery18; however, other work has
stored in a number of different ways, including depictive formats. accordingly,
the debate largely focused on the two representational options: propositional and
failed to show a role for the hippocampus in imagery cre­
depictive. a propositional format would be something similar to a descriptive format ation19,20. In sum, although probably involved in spatial
used in a language. Depictive representations are often referred to as pictorial for and memory elements of imagery, the exact role of the
shorthand, as depictive representations require a functional space like a two-​dimensional hippocampus in imagery remains unclear.
XY coordinate plane or picture (see ref.21 for examples).
throughout the 1970s and 1980s, various behavioural paradigms produced evidence Visual cortex. Questions about the role of the early visual
that imagery could be represented in a depictive format, only for the other side of the cortex, in particular V1, in mental imagery have domi­
debate to point out alternative interpretations of the data136,137. when neuroimaging nated brain imaging work on mental imagery for the last
became available in the 1990s, the debate focused on showing a blood oxygenation 25 years. From the early 1990s to late 2000s, over 20 studies
level-​dependent or positron emission tomography response to imagery in the primary
investigated the role of area V1 in imagery3. Most of
visual cortex, following the logic that the primary visual cortex represents visual
information depictively.
these studies were motivated by what is referred to as the
in 2015, Pearson and Kosslyn made the strong claim that the so-​called imagery debate imagery debate, now generally considered to be over21
was over21 and the abundance of evidence that imagery can be depictive, while still (Box 1). However, those studies were not without con­
involving semantic information, is now overwhelming. evidence spans from behavioural troversy; although many did not find significant BOLD
evidence that imagery is represented locally in retinotopic visual and orientation space responses above baseline in the early visual cortex10,22–27,
to functional magnetic resonance imaging voxel-​wise Gabor wavelet models trained on many others did13,28–38. In hindsight, these discrepancies
depictive visual features (perceptual retinotopic location, spatial frequency and can be explained by inter-​study differences in imagery
orientation); see ref.21 for a full discussion. Few public debates have lasted so many tasks, imagery content (for example, a single visual fea­
decades; this unique dialogue adds to the rich and often controversial history of ture versus a complex image), as well as by individual
imagery research.
differences in imagery strength or vividness3,35,39.

www.nature.com/nrn
Reviews

With the advent of multivariate decoding or pre­


dictive data analysis techniques in fMRI, there is now
clear evidence that the content of mental imagery can 3
be decoded from early visual areas, including V1 and V2
(refs38,40–42). It is interesting that this appears to be the
case despite relatively low BOLD amplitude responses. 1
The decoding algorithms used by these approaches can
be trained on visual perception, visual working mem­
ory content and, of course, imagery, and in all cases can 3
accurately decode the content of mental imagery40,42.
2
Further, when these algorithms are trained on perceptual
images and constrained by voxel-​wise models of perception
(the decoding model is based on perceptual information
such as contrast and spatial frequency), imagery can still
be accurately decoded, suggesting imagery in the early
visual cortex is composed of the same visual features as
afferent sensory perception42.
Taken together, the abovementioned brain imaging
work involving the visual cortex suggests there are pat­ Fig. 1 | A top-​down general model of voluntary mental
terns of activity common to perception and imagery that imagery: a reverse hierarchy. The initial mental action to
emerge as early as V1, but become increasingly similar create a mental image ‘begins’ high in the cortical processing
with ascension up the visual processing hierarchy3. This hierarchy , in the frontal cortex (step 1). This triggers a
visual hierarchy trend fits well into the overall model of cascade of neural events, running ‘backwards’, that next
retrieves stored information or memories from more
imagery dynamics (Fig. 1). If voluntary imagery is a top-​
posterior regions such as medial temporal areas (step 2)20,
down, triggered instance of sensory–memory recall that
and sensory and spatial representations of the imagery
uses the visual cortex (and depending on imagery content, content are then formed (steps 3). If the ‘requested’
hippocampal and/or parietal areas), then it naturally fol­ representation involves movement and spatial locations,
lows that higher-​level visual areas (for example, visual area then other areas like the middle temporal area and parietal
3 and fusiform face area) that are physically and/or synap­ lobes would also be involved.
tically closer to the trigger source (frontal and medial tem­
poral lobe), would have stronger or more perception-​like during a resting state scan, when they are typically asked
representations than more distant areas like V1 (Fig. 2). to relax and think about whatever they like, it should not
be surprising that the DMN relates to imagery. Future
Default mode network and imagery work should compare the DMN with measures of pure
The default mode network (DMN) is a networked group visual imagery of abstract features or objects and probe
of brain areas that regularly show up during periods of mind-​wandering imagery content during these resting
non-​task rest, it is largely defined by the functional con­ scans to divulge the role of the DMN in imagery.
nectivity or temporal relationships between activity in
spatially remote areas such as the posterior cingulate Ventral and dorsal streams
cortex, dorsal medial prefrontal cortex and hippocam­ A common way to functionally divide the visual sys­
pus43. However, the DMN also shows similarities with tem is division into the two processing streams that run
networks identified as being active during cognitively ventrally and dorsally. The ventral pathway is associated
demanding tasks44. Interestingly, the networks known with properties of objects and, when areas in this stream
to be involved in reexperiencing the past or creating are damaged, object perception and the ability to vis­
possible future experiences overlap with the DMN45–48 ualize shape are both disrupted. Damage to the dorsal
and has become known for its association with such pathway, by contrast, disrupts the ability to visualize
Voxel-​wise models of processes. One of the few studies to look at conscious locations or spatial transformations14,49. In sum, it seems
perception manipulation, construction and destruction of mental that the data support parallels between perceptual and
Magnetic resonance imaging images showed that multiple areas, including the dorso­ imagery processing regarding these two streams of visual
and functional magnetic lateral prefrontal cortex, posterior parietal cortex, pos­ processing. Indeed, recent work on aphantasia (see later
resonance imaging decoding
methods that are constrained
terior precuneus and occipital cortex act together as a section), suggests that spatial manipulations are normal
by or based on individual voxel network to construct and deconstruct abstract mental in individuals who have no object-​based imagery50.
responses to perception, which images, that is, images that are not representations from
are then used to decode specific episodic memories7. In sum, evidence suggests Involuntary imagery
imagery.
that the DMN is involved in imagery generation or con­ As mentioned above, there are other types of imagery
Spatial transformations struction; however, because most of these studies have that are considered involuntary, for example, those trig­
Transformations in a spatial investigated complex scenes from episodic memory or gered by an association. These images are often referred
domain. future scenarios, it is hard to separate the relationships to as phantom perception2 as they involve sensory qualia
between network elements and temporal and memory without concurrent or direct sensory stimulation.
Qualia
The conscious sense or feeling
components from the isolated act of forming the pure Animal work has demonstrated that, as learning
of something, different from sensory elements of a mental image. Although consider­ occurs between two stimuli, sensory neurons in areas like
detection. ing that many individuals are likely engaging in imagery the middle temporal or inferior temporal cortex begin

Nature Reviews | Neuroscience


Reviews

In sum, much like voluntary imagery, involuntary


Top-down images seem to involve the appropriate, correspon­
imagery signal ding sensory cortices. For example, involuntary motion
Imagery
imagery will involve the middle temporal area, whereas
involuntary colour imagery will involve V1 and V4.

Strong representations
(High-level brain areas)
More overlap What currently remains unknown, is the involvement,
between if any, of higher-​level, non-​sensory areas like the frontal
imagery and and parietal cortices (Fig. 3). Although it seems logical
perception
areas that these areas would not be involved in generating
involuntary imagery, we lack good datasets to show this.

Neural mechanisms of imagery strength


At least since the 1800s, people have wondered why

Strong representations
imagery differs so much from person to person. Now
Less overlap that the imagery debate is resolved21, the mechanisms
between of imagery, how an image is formed and why some
imagery and
perception are stronger than others (both inter-​individually and
areas intra-​individually) remains one of the primary research
Perception questions.
(Low-level brain areas) Recent work has begun to investigate the relation­
Bottom-up ship between V1 surface size and imagery character­
perception istics59. V1 surface size, like imagery, can vary between
individuals substantially60. Research using objective
Fig. 2 | Graphical depiction showing the two streams — bottom-​up perception and perceptual measures of imagery (the binocular rivalry
top-​down voluntary imagery. Voluntary imagery and perception have a greater overlap technique) (Box 2) has shown that the surface size of
in high-​level areas (dark blue) than in lower-​level areas (light blue). This graphical depiction
both V1 and V2, but not V3, negatively predicts the
may well not hold for involuntary imagery.
sensory strength of mental imagery59. In other words,
those with stronger imagery had smaller primary visual
to respond to an absent stimulus as if it were actually cortices. Further, the binocular rivalry technique allows
pre­sent51–53. Nevertheless, despite these data suggesting imagery precision to be tested across a number of visual
that the animal might have a conscious imagery-​like features. In this study, the precision of visual imagery
experience of the absent stimulus, we simply do not know. was measured by the spread, or generalization, of
Related work with humans has demonstrated that imagery across both spatial orientation and retinotopic
colour memory of colour-​specific fruit (for example, an visual space. Both these measures of imagery precision
orange is typically orange; a banana is typically yellow) showed a positive predictive relationship with V1 sur­
can be decoded from the BOLD response in V1 when face size59, much like perception does61. Interestingly,
humans view grey-​scale images54. These brain-​imaging those with the strongest imagery and smallest V1s did
studies are supported by behavioural research suggest­ not have the most precise imagery, suggesting that, as
ing we have a colour experience when viewing such imagery becomes stronger, it also becomes less precise.
grey-​scale colour-​specific images55 (Fig. 3). Other work This relationship between more vivid and stronger
has demonstrated that the perceptual ‘filling in’ of low-​ imagery and a smaller visual cortex is also an emerg­
contrast moving texture patterns leads to activity in V1 ing trend in the clinical literature. Human brain his­
and secondary V2 (ref.56) and, likewise, colour filling or tology shows that the size of V1 and its total number
‘neon colour spreading’ is associated with greater activity of neurons are reduced in schizophrenia compared
in V1 for the corresponding regions of the visual field to normal healthy control brains by around 25%62.
where the illusion is experienced57. This is compared to the overall brain size reduction
Prior expectations about an upcoming visual stim­ in patients with schizophrenia of only around 2%.
ulus can have a strong effect on subsequent sensory Individuals with schizophrenia show enhanced self-​
perception; indeed, fMRI work has demonstrated that reported vividness of mental imagery63 and individuals
a sensory template of the upcoming stimulus is for­ with schizotypal personality disorder show stronger sen­
med in V1 even when the perceptual stimulus is never sory imagery in the objective binocular rivalry imagery
presented58. Interestingly, it remains unknown how paradigm compared to controls64. Likewise, in PTSD,
voluntary or involuntary such a representation is; are patients who report more vivid voluntary self-​initiated
individuals taking up a strategy of using voluntary imagery65 also show signs of reduced visual cortex
imagery to aid the upcoming perceptual task? Or are size66,67. Furthermore, stimulant-​dependent individuals
these representations purely reflexive and involuntary? who demonstrate strong involuntary imagery that plays
Schizotypal personality Are these representations conscious? New work suggests an inductive role in substance dependencies68 also show
disorder that images can form prior to conscious voluntary effort, a reduction in grey matter around the visual cortex69.
A mental disorder suggesting the existance of non-​conscious involuntary It is worth noting, however, that the link between
characterized by social anxiety,
thought disorder, paranoid
images 41
. Fig. 3 shows a proposed overview of some of imagery strength and V1 size is correlational, and so,
ideation, derealization and the types of imagery and their possible overlap in the despite this relationship showing up across both clinical
transient psychosis. visual cortex. and non-​clinical populations, it does not clearly specify a

www.nature.com/nrn
Reviews

functional mechanism. Interestingly, the data suggest a One possible way to conceptualize the imagery net­
reciprocal relationship between V1 and frontal cortex work and characteristics of V1, is that, at least in terms
size, with a smaller V1 predicting larger frontal areas70. of visual imagery, the visual cortex is something akin to
If frontal areas are responsible for the top-​down imagery a ‘representational blackboard’ that can form representa­
signal, then a scenario with larger frontal areas and tions from either the bottom-​up or top-​down inputs77.
smaller V1 might enable more control over the visual The brain is not in a silent state waiting for sensory
cortex (Fig. 4). Moreover, V1 surface area is influenced, stimulation, but always active, showing intrinsic activ­
in part, by genetic differences71–73, suggesting a possible ity dynamics, which emerge as spontaneous or ongoing
indirect genetic contribution to imagery strength. activity80. The degree of this ongoing activity noise in this
In addition to the anatomy of early visual cortex, evi­ ‘representational blackboard’ will impact imagery, and so
dence suggests that cortical activity metrics also predict too will the strength of the top-​down signal (analogous
imagery vividness35,38. Further, recent behavioural work to the strength or contrast of ‘chalk’ in this blackboard
has shown that imagery vividness is not a static trait-​ metaphor). A given individual might have low levels of
like characteristic of imagery, but dynamically changes noise activity in V1, but a weak top-​down signal, and
from moment to moment within an individual59,74–76, and therefore the overall degree of imagery strength, might
these changes are predicted by a network of activity over be weak. Another individual, by contrast, might have a
the whole brain, including the degree of overlap with very strong top-​down signal, but their visual cortex is
perception in the visual system38. much noisier, hence the imagery representation becomes
Some recent data suggest that the excitability of the corrupted (Fig. 4). In this scenario, an individual with
visual cortex might play a role in imagery strength77. both a strong top-​down signal and low noise, or quieter
This work shows correlational evidence that uses trans­ sensory cortex, should have the strongest imagery (bot­
cranial magnetic stimulation-​induced phosphenes and tom left Fig. 4). Presently, this is only a theory, and there
fMRI resting activity as proxies of cortical excitability. are many other clues suggesting imagery might have a
This study shows that causative transcranial direct cur­ complex multi-​component mechanism, as it is clear that
rent stimulation, which alters resting excitability, had a imagery can be affected by many other factors such as
weak effect on imagery strength by either up or down­ memory, hormones81, multiple neurological and mental
regulating it77. These multiple data sources suggest that disorders, and even psychedelics82.
stronger visual imagery is associated with lower resting
activity in the visual cortex. These data, although still Imagery, like a weak form of perception
preliminary, suggest that imagery, along with other expe­ The conscious experience of imagining and perceiving
riences of phantom vision, like synaesthesia78 (which something are clearly very different for almost everyone.
itself is linked to stronger imagery79), might depend on However, evidence from the past 100 years of behavioural
visual cortex excitability. research suggests that visual imagery can have a func­
tional effect on sensory processing akin to a weak form of
visual perception3. For example, both imagining and per­
Association-induced image ceiving oriented lines can have a similar effect on subse­
quent perception83,84. Imagery content can also undergo
different types of learning. Imagining visual content, just
Voluntary Involuntary CS Imagery of US
like perceptual content, can induce visual per­ceptual
(associative) learning, which improves subsequent visual sensitivity to
those specific types of stimuli85. Likewise, the content of
=
visual imagery can undergo associative learning with an
emotional stimulus that transfers to perceptual stimuli in
Top-down Top-down a manner specific to early visual processing86. In addition,
the brightness of imagined stimuli corresponds to pre­
dictable changes in pupil diameter, without concurrent
Lateral sensory stimulation87.
Involuntary There is now substantive evidence that visual imagery
Overlap? (perceptual)
can have a facilitative effect on visual perception of a
relevant visual stimulus74,76,83,84. Indeed, even when
Sensory cortex
representations imagery and perception are separated in time by another
demanding cognitive task, these facilitatory effects
Fig. 3 | Mapping out the different types of visual imagery — voluntary , involuntary remain83. Weak perceptual stimuli (low contrast or lumi­
(associative) and involuntary (local perceptual). The involuntary associative imagery nance) also show this same facilitatory priming effect
would be the product of associative learning. For example, after thousands of co-​occurrences on subsequent perception83,88,89. The energy (strength or
seeing tomatoes as red, a black and white image of a tomato is seen as slightly red due to duration) of a prior stimulus seems to dictate whether
red involuntary imagery; your brain literally fills in the colour. Likewise, the classic case of
that prior stimulus has a facilitatory (priming for weak
conditioning with Pavlov’s dogs, does the sound of the ringing bell induce an image of the
food in the dog’s mind? Here, the speaker symbol, the conditioned stimulus (CS) illustrates images) or suppressive (adaptation for strong images)
this sound-​induced involuntary image, the unconditioned stimulus (US). Perceptual effect on subsequent perception. Likewise, longer
involuntary imagery , or phantom vision, is when the structure of low-​level perceptual brain durations, or epochs, of imagery have a stronger prim­
areas produces involuntary vision like the colour spreading in neon-​colour spreading illusion. ing effect on subsequent perception41,74,83. Hence, the
Adapted with permission from ref.2, Elsevier. degree to which imagery affects subsequent perception

Nature Reviews | Neuroscience


Reviews

has been taken as a measure of the sensory strength or imagery93, and takes researchers one step closer to
visual energy of imagery76 (see Box 2 on measurement being able to recreate the sensory contents of the mind.
techniques). Just like visual perception, visual imagery However, despite the evidence suggesting commonali­
seems to be largely local in retinotopic and orientation ties between weak perception and imagery, the two are
space42,59,79,83,90,91, lending further support to the similarities clearly very different conscious experiences and future
between weak visual perception and visual imagery. work should aim to map out why non-​clinical imagery
A criticism of some imagery research was the lack of is not experienced with the full conscious experience of
methodology to differentiate visual imagery and visual afferent perception.
attention. For example, if an individual imagines a par­
ticular colour while they are performing a perceptual Imagery in normal cognitive function
task involving colour, they will be differentially attending Recent years have produced many publications linking
to the colour they imagine. Hence, any effects of imagery mental imagery to a range of cognitive processes from
and attention will be difficult to separate. Importantly, episodic and visual working memory, spatial navigation,
in some of this research, the effect of prior imagery and reading comprehension to creativity and moral decision-​
prior visual attention can be dissociated in a number of making (Fig. 5). If mental imagery is a sensory simula­
ways such as through the timing of these effects and their tion of events, objects or scenarios in isolation from the
susceptibility to sensory disruption83; this provides fur­ afferent sense organ-​induced versions of these things,
ther evidence that these sensory-​like effects are driven by then how and when do we use imagery in everyday life?
imagery and not attention. In addition, these perceptual
priming effects are linked to the reported imagery vivid­ Memory and imagery
ness on a trial-​by-trial basis74, suggesting the effects are Despite the fact that the fields of mental imagery, visual
coupled to the imagery generation process. working and autobiographical episodic memory have
Brain imaging work also provides evidence that developed independently, evidence suggests that many
imagery can be thought of as a form of top-​down weak people utilize imagery to perform most forms of visual
perception. Multiple studies have now used BOLD acti­ memory tasks94–97. Indeed, in the episodic memory liter­
vation patterns during afferent visual perception to later ature, thinking about the future is referred to as imagin­
decode the contents of mental images42,91,92, suggesting ing the future. Depending on who you are and probably
an overlap in neural representation. Further, deep learn­ how strong your imagery is, the role of imagery across
ing algorithms trained on a limited set of perceptual fea­ different types of memory might seem obvious and self-​
tures can be used to decode untrained features in mental evident. However, the fields of imagery and working
memory have diverged and until recently have remained
largely separate98.
Box 2 | New measurement techniques In regard to visual working memory, when people are
Like dreaming or hallucinations, research into mental imagery has been constrained by asked how they complete such tasks, they typically report
a lack of reliable objective measurement methods. From the early use of questionnaires using two primary strategies. One strategy is to pick
by Galton in the 1800s110, self-​report questionnaires have been the gold standard used out salient features in a test array that the person is
to measure imagery. However, recent years have seen a flurry of new and more objective required to remember and encode them in a pro­positio­
measurement techniques. nal or phonological form, which is then com­pared to
Behavioural techniques the test99. The other strategy commonly des­cribed is the
in 2008, we published the first work showing how you could use a visual illusion, called creation of detailed mental images during the retention
binocular rivalry, to measure imagery. this technique involves randomly cuing an interval, which are then compared to the sub­sequent
individual to imagine a coloured object before a brief rivalry presentation. the content test arrays94,95,99,100. These descriptions are synonymous
of the imagery primes dominance in the rivalry illusion in a manner that reflects the with descriptions of mental imagery and it is likely that
imagery vividness both on a trial-​by-trial and individual differences basis74,83. importantly, these individuals use mental imagery as a mnemonic
this technique works even when a cognitively demanding task is added between the tool to retain visual information. Both behavioural and
imagery period and the rivalry presentation. this technique can be made even more brain imaging work now suggests that sensory imagery
objective, in terms of removing direct subjective reports, by measuring rivalry
representations are used by people who have imagery to
dominance with an embedded probe task138. In this case, rivalry dominance is assessed
using an embedded probe task, where the probe is easier to detect when it is complete some forms of visual working memory
embedded in the dominant rivalry pattern, and then the influence of imagery on rivalry tasks40,94,95,101. Additionally, both imagery and visual
can be determined by the level of probe detection. using such a performance-​based working memory can change perception83,102, and they
dependent variable instead of rivalry dominance reports means that imagery can be show similar capacity functions103,104. However, research
measured without any subjective reports. in addition, such methods can be used to also suggests that not all people use visual imagery
measure imagery of different visual features such as pure colour or motion imagery, or to solve visual working memory tasks, with irrele­
even complex object imagery, using the one dependent measure90,133,138, or even vant visual information impairing only some partic­
compare imagery and synaesthesia using the one common measure79. ipant’s performance on visual working memory tasks.
imaging techniques Specifically, only participants with good imagery appear
recent functional magnetic resonance imaging research has clearly shown that to be affected by irrelevant visual information94,95,105, sug­
imagery content can be objectively investigated using brain imaging40,42,139. what gesting that only they use visual imagery and low-​level
someone imagines can be decoded or predicted based only on the brain’s response to visual regions to perform these tasks. The idea that only
the afferent perceptual versions of that same content. in fact, imagery content can now good imagers use visual imagery, and hence the visual
be decoded with perceptual training data from different object classes93, and other
cortex, to perform visual working memory tasks may
methods like electroencephalography and pupil dynamics can also be used.
help explain much of the current controversy in both the

www.nature.com/nrn
Reviews

Low
Noise level in visual cortex
High Why does it matter that imagery is utilized across
Low such a large range of cognitive processes? We have
Weakest imagery known since Francis Galton’s seminal paper on mental
imagery in 1880 that the spectrum of imagery vivid­
ness spans from aphantasia to hyperphantasia (highly
vivid, almost realistic imagery)110. Accordingly, if many
cognitive processes use imagery, but imagery can vary
so much across the population, then it follows that the
Top-down signal strength

strength of imagery will have a strong knock-​on effect for


how someone performs any dependent tasks. Anything
that might affect imagery strength might also have an
Strongest imagery effect on visual working and episodic memory, reading
comprehension, the veracity of eye witness memory,
moral decisions and maybe even creativity, not to men­
tion dimensions of mental health (Fig. 5). Therefore, one
cannot fully understand any of these dependent com­
pound cognitive processes without taking into account
or understanding the variations in mental imagery
strength. Accordingly, understanding imagery and meas­
uring it accurately holds the potential key to unlocking
High the mysteries of multiple cognitive processes105.
Fig. 4 | Theoretical representation of visual imagery of a square, showing possible
Mental and neurological disorders
interaction between the strength of the top-​down imagery signal and noise in the
visual cortex. A strong top-​down signal and low noise (bottom left) gives the strongest Mental imagery plays a major role in much of psycho­
mental image (square), whereas a high level of neural noise and a weak top-​down pathology, perhaps unsurprisingly given experimental
imagery signal would produce the weakest imagery experience (top right). findings that visual thought produces more emotion than
verbal thought111. Intrusive, affect-​laden mental imagery
causes functional distress across a range of mood dis­
visual working memory modelling and neuroimaging orders, for example, by subserving ruminative and worry
literature105. states112. In depression, individuals have difficulty form­
Likewise, to anyone who has good imagery it is ing positive future imagery113 and imagining suicidal acts
immediately obvious that imagery would be an impor­ may increase the risk of suicide114. Patients with bipolar
tant experiential tool when referencing autobiographi­ disorder show high spontaneous use of imagery and
cal memories or future projections. When I think of my intrusive imagery115,116, and future-​oriented imagery
birthday last year, visual flashes of people sitting around ‘flash forwards’ to suicidal acts115. Involuntary intru­
a table sharing food and chatting involuntarily flash sive visual images are a key component of cravings in
through my mind. Imagery has long been discussed as a addiction117–119 and of flashbacks in PTSD. The realness,
crucial element to autobiographical thinking. However, or ‘nowness’, of intrusive images predicts the severity
the inherent difficulties in measuring imagery are per­ of PTSD symptoms and outcomes120 and the ease with
haps dwarfed by the very personal, bespoke and complex which these intrusions can be triggered through viewing
phenomenology involved in autobiographical memory related images predicts PTSD severity120. An individual’s
measurement. Needless to say, investigating the role of non-​traumatic visual imagery predicts PTSD sympto­
imagery in episodic memory brings many methodological mology, with more vivid imagery being associated with
challenges. more frequent flashbacks65. Intervention research has
Despite a primary reliance on self-​report techniques, also suggested that disrupting the visuospatial sketch­
research suggests that individuals with vivid imagery do pad by playing the game Tetris after viewing traumatic
re-​experience episodes from their life via memory dif­ footage reduces subsequent intrusive imagery121. It has
ferently to those with weak imagery106–109. Data suggest been theorized that playing Tetris occupies the visual
that individuals with vivid imagery report more sensory areas of the brain (or the visuospatial sketchpad or rep­
details both in episodic and future event construction108, resentational blackboard of the mind), and this impairs
and also rate their experience of reliving the event as an individual’s ability to replay the event during memory
more real than those with poor imagery106, while more consolidation.
recent work has shown that object and spatial imagery Both schizophrenia and Parkinson disease have been
predict different dimensions of episodic memory96,109. associated with stronger sensory imagery, measured
Interestingly, people without any imagery (aphantasics), using the objective binocular rivalry technique64,122. In
can still perform visual working memory tasks and seem fact, vivid imagery has been proposed as a trait maker
to have episodic memories of their lives (see section for schizophrenia63. As mentioned above, it is interesting
below on aphantasia). Hence, it would seem that using that both in the normal population and in schizophre­
imagery for such compound cognitive tasks is just one of nia, a smaller V1 is associated with stronger imagery.
many available strategies, underpinning the importance In patients with Parkinson disease, the strength of an
of probing the particular strategy an individual might individual’s visual imagery predicts the severity of their
use for memory tasks. visual hallucinations122.

Nature Reviews | Neuroscience


Reviews

In addition to featuring alongside or as a symptom of small proportion of otherwise healthy people report
the disorder, visual imagery increasingly plays a role in having no visual experience at all when they attempt
evidence-​based psychological treatment. For example, to imagine something. In other words, their minds are
cognitive behavioural therapy often includes ‘imaginal completely blind — no matter how hard they try, they
exposure’, which involves the patient repeatedly imag­ do not have a conscious visual experience of mental
ining a feared object or context until their anxiety level imagery; this phenomenon has only recently been given
subsides123. Imagery rescripting has been somewhat the name congenital aphantasia1. Initially, it was unclear
successful in treating PTSD, social and snake phobias, if aphantasia was more of an issue of imagery reporting,
and a variety of other psychological disorders124. It typi­ in that people with aphantasia might still have func­
cally involves the practice of rescripting the imagery in a tional imagery, but not be aware of it or have a differ­
sequence to a more positive or adaptive outcome. ent criterion for reporting it. However, recent research
As the evidence grows that visual imagery can trigger goes beyond subjective self-​reports of aphantasia and
a larger emotional response than propositional or sym­ has shown that, along with floor scores on imagery
bolic thoughts125, the understanding of imagery both as a questionnaires, people with aphantasia score signifi­
symptom and as a strategic therapeutic treatment grows. cantly lower on the sensory binocular rivalry measure
Clinical research should aim to leverage data and theory of visual imagery50 (Box 2); in other words, the sensory
from fundamental brain research on imagery as soon as strength of their imagery is also lacking, suggesting that
possible, as there are many promising avenues for uti­ aphantasia is more than poor metacognition of visual
lizing or manipulating imagery as a novel therapeutic imagery.
intervention. Interestingly, although people with aphantasia scored
lower than controls on all imagery vividness or content
Extreme differences in visual imagery measures, they actually scored slightly higher than con­
Aphantasia. Since Galton’s seminal paper in the 1800s110, trols on spatial imagery questionnaires50. This suggests
the idea of a category of people whose mind is com­ that, although the ‘what’ or content of imagery typically
pletely blind was largely forgotten until recently1,126. associated with the ventral stream of visual processing
Initially based just on self-​report, it seemed that a is lost, the ‘where’, or spatial properties, associated with
dorsal areas might still be intact. It also suggests that
aphantasia could dissociate along the classic ‘what and
where’ processing pathways in the brain127. Accordingly,
Prospective Eye witness
areas of the brain that process spatial properties, includ­
memory memory ing the hippocampus, may not be the underlying cause
of aphantasia. Other work provides evidence that peo­
Arithmetic ple with aphantasia can perform easy and medium, but
False memory not hard visual working memory tasks128. Likewise,
a case report of two people with aphantasia showed
Navigation that they scored low on ratings of ‘reliving’ their epi­
sodic memories, although they still reported believing
Episodic Mental Visual working
memory imagery memory Moral decisions these memories106. Many individuals with aphantasia
describe visual imagery during dreams1, suggesting that
Sports
involuntary forms of imagery might still be intact.
Although the popular media has shown a fascination
Creativity with aphantasia, it is still early days in terms of scientific
Motor control research. Perhaps the most poignant question surrounds
Reading
the idea that aphantasia could either be just one end of a
Mind wandering
comprehension spectrum of imagery abilities or it could be in a category
all of its own, different to people with very weak imagery.
Further research is needed to shed light on these two
Fig. 5 | Graphical depiction of the cognitive processes related to mental imagery. possibilities.
The cognitive processes shown in the dark blue zone — visual working and episodic The fact that individuals with aphantasia can still per­
memory — are there because reasonable evidence exists that, in people with mental form many daily tasks that non-​aphantasics use men­
imagery (excluding people with aphantasia), they are largely reliant on mental imagery tal imagery for, for example, visual working memory,
for normal functioning and there is a ‘good’ amount of evidence to support this suggests they use a different strategy and brain mech­
relationship94,95. Evidence has shown that those with strong imagery will utilize it as a anisms to do so. Presently, it is unknown what mem­
mnemonic tool to perform visual working memory tasks94,95. This evidence is beyond ory aids they use, perhaps semantic encoding or some
correlational and has used sensory perturbation methodologies (see section on non-​representational geometry or symbols. It is worth
memory)94,95. Likewise, episodic memory research has specifically looked at the rich thinking about the possible implications of this, if one
sensory nature of remembered past experiences as well as the vividness of projecting
was to simply go by performance on a compound task
oneself into possible future episodic experiences96,109. Across a range of different
methodologies, effect sizes and degree of evidence, the cognitive processes shown in like visual working memory, it would be very difficult to
the lighter blue zone have been hypothesized to involve mental imagery , although the differentiate a person with aphantasia and a person with
degree of evidence is less than that for the dark blue zone. The outer lighter blue zone normal mental imagery. However, it is safe to say that
shows moral decisions140, eye witness memory141, false memories142, arithmetic, the underlying neural mechanism used to perform the
navigation143, sports144, reading comprehension145, mind wandering146 and creativity147. task by these two individuals would be quite different.

www.nature.com/nrn
Reviews

Such a scenario underlines the importance of testing as imagery research gains popularity, researchers will
imagery ability when investigating cognitive processes reignite eidetic and hyperphantasic imagery research.
like visual working or episodic memory. Further, this
suggests that using imagery as a cognitive tool is not The future of imagery research
funda­mental to performing other cognitive functions Now that the imagery debate is over21, and we have mul­
and has interesting implications for the way we should tiple new objective methods to investigate imagery, what
theorize about imagery as a cognitive tool and its possible should imagery researchers focus on?
role in evolution. Visual perception is a constructive affair; it involves
both feedforward and feedback signals working closely
Hyperphantasia or eidetic imagery. Hyperphantasia, and interactively together. Hence, isolating the effects of
or what has previously been called eidetic imagery, is bottom-​up feedforward or feedback signals during per­
at the other end of the imagery spectrum — consisting ception is very difficult. Voluntary imagery is perhaps
of strong and vivid imagery. Early in the 20th century, the only pure form of sensory representation that can
the topic of eidetic imagery attracted much attention, be solely due to feedback signals and can occur in com­
commonly described as a highly detailed, almost photo-​ plete sensory isolation (although not always). Hence, it
realistic image experienced directly after seeing the represents a unique window to study the dynamics of
object, but also days or weeks later129–132. Eidetic imagery, feedback signals in the brain and understand the con­
like aphantasia, is only observed in a small percentage structive nature of visual perception — an important
of the population, mainly in children, with frequency step of reductionism to understand the mechanisms
estimates from 0–11% in children129. Unlike afterim­ behind sensory perception. As perception is interactive,
ages, eidetic images remain still while the eye moves, and hence cannot be understood without parsing out the
are experienced in positive colours, projected out into mechanisms of feedback, it can be argued that imagery
space (much like a form of synaesthesia) and individuals is the key to understanding normal visual perception. It
use present, not past tense language, when referring to will be interesting to see how imagery research can be
the image. harnessed to understand visual perception.
Eidetic imagery has been assessed in a number of Several pertinent questions regarding imagery
ways, from verbal descriptions to more objective meth­ remain, including the issue of why imagery rarely feels
ods such as showing individuals random-​dot stereo­ as strong and vivid as afferent sensory perception; the
grams, pictures of hundreds of randomly placed dots, causes underlying aphantasia and the large range of
with those in the centre shifted to give the perception individual differences in the experience of imagery;
of depth when the two images are shown one to each whether there exists a training protocol that might
eye simultaneously; however, for eidetic imagers the improve imagery strength; whether imagery indeed
depth patch could be seen clearly, even when the two induces more activity in visual cortical areas, as opposed
images were shown up to 24 hours apart, by combin­ to being just modulatory; and whether voluntary or
ing the first or eidetic image with the second perceptual involuntary imagery could ever exist unconsciously133.
image130. Because modern day psychophysics, fMRI As many of the new methods to investigate imagery are
and transcranial magnetic stimulation methods have only newly available, it is exciting to think over all the
not been used to investigate eidetic imagery, we do not future imagery research waiting to be performed.
have a lot of data to suggest a possible mechanism or
why it seems more prevalent in children. Hopefully, Published online xx xx xxxx

1. Zeman, A., Dewar, M. & Della Sala, S. Lives without mechanisms for visual working memory. Curr. Opin. 17. Hassabis, D., Kumaran, D., Vann, S. D. & Maguire, E. A.
imagery — congenital aphantasia. Cortex 73, Neurobiol. 15, 175–182 (2005). Patients with hippocampal amnesia cannot imagine
378–380 (2015). 9. Yomogida, Y. Mental visual synthesis is originated in new experiences. Proc. Natl Acad. Sci. USA 104,
This article documents and coins the term the fronto-​temporal network of the left hemisphere. 1726–1731 (2007).
aphantasia, described as the complete lack Cereb. Cortex 14, 1376–1383 (2004). 18. Kreiman, G., Koch, C. & Fried, I. Imagery neurons
of visual imagery ability. 10. Ishai, A., Ungerleider, L. G. & Haxby, J. V. Distributed in the human brain. Nature 408, 357–361 (2000).
2. Pearson, J. & Westbrook, F. Phantom perception: neural systems for the generation of visual images. 19. Maguire, E. A., Vargha-​Khadem, F. & Hassabis, D.
voluntary and involuntary non-​retinal vision. Trends Neuron 28, 979–990 (2000). Imagining fictitious and future experiences: evidence
Cogn. Sci. 19, 278–284 (2015). 11. Goebel, R., Khorram-​Sefat, D., Muckli, L., Hacker, H. from developmental amnesia. Neuropsychologia 48,
This opinion paper proposes a unifying framework & Singer, W. The constructive nature of vision: direct 3187–3192 (2010).
for both voluntary and involuntary imagery. evidence from functional magnetic resonance imaging 20. Kim, S. et al. Sparing of spatial mental imagery in
3. Pearson, J., Naselaris, T., Holmes, E. A. & Kosslyn, S. M. studies of apparent motion and motion imagery. patients with hippocampal lesions. Learn. Mem. 20,
Mental imagery: functional mechanisms and clinical Eur. J. Neurosci. 10, 1563–1573 (1998). 657–663 (2013).
applications. Trends Cogn. Sci. 19, 590–602 12. Mellet, E. et al. Functional anatomy of spatial mental 21. Pearson, J. & Kosslyn, S. M. The heterogeneity of
(2015). imagery generated from verbal instructions. mental representation: ending the imagery debate.
4. Egeth, H. E. & Yantis, S. Visual attention: control, J. Neurosci. 16, 6504–6512 (1996). Proc. Natl Acad. Sci. USA 112, 10089–10092 (2015).
representation, and time course. Annu. Rev. Psychol. 13. O’Craven, K. M. & Kanwisher, N. Mental imagery This paper proposes an end to the ‘imagery debate’
48, 269–297 (1997). of faces and places activates corresponding stimulus- based on the discussed evidence that imagery can
5. Dijkstra, N., Zeidman, P., Ondobaka, S., Gerven, M. A. J. specific brain regions. J. Cogn. Neurosci. 12, be represented in the brain in a depictive manner.
& Friston, K. Distinct top-​down and bottom-​up brain 1013–1023 (2000). 22. D’Esposito, M. et al. A functional MRI study of mental
connectivity during visual perception and imagery. 14. Kosslyn, S. M., Ganis, G. & Thompson, W. L. Neural image generation. Neuropsychologia 35, 725–730
Sci. Rep. 7, 5677 (2017). foundations of imagery. Nat. Rev. Neurosci. 2, (1997).
6. Dentico, D. et al. Reversal of cortical information flow 635–642 (2001). 23. Knauff, M., Kassubek, J., Mulack, T. & Greenlee, M. W.
during visual imagery as compared to visual 15. Hassabis, D., Kumaran, D. & Maguire, E. A. Using Cortical activation evoked by visual mental imagery
perception. Neuroimage 100, 237–243 (2014). imagination to understand the neural basis of episodic as measured by fMRI. Neuroreport 11, 3957–3962
7. Schlegel, A. et al. Network structure and dynamics of memory. J. Neurosci. 27, 14365–14374 (2007). (2000).
the mental workspace. Proc. Natl Acad. Sci. USA 110, 16. Bird, C. M., Capponi, C., King, J. A., Doeller, C. F. 24. Trojano, L. et al. Matching two imagined clocks:
16277–16282 (2013). & Burgess, N. Establishing the boundaries: the the functional anatomy of spatial analysis in the
8. Ranganath, C. & D’Esposito, M. Directing the mind’s hippocampal contribution to imagining scenes. absence of visual stimulation. Cereb. Cortex 10,
eye: prefrontal, inferior and medial temporal J. Neurosci. 30, 11688–11695 (2010). 473–481 (2000).

Nature Reviews | Neuroscience


Reviews

25. Wheeler, M. E., Petersen, S. E. & Buckner, R. L. 47. Hassabis, D. & Maguire, E. A. Deconstructing episodic 72. Winkler, A. M. et al. Cortical thickness or grey matter
Memory’s echo: vivid remembering reactivates memory with construction. Trends Cogn. Sci. 11, volume? The importance of selecting the phenotype
sensory-​specific cortex. Proc. Natl Acad. Sci. USA 97, 299–306 (2007). for imaging genetics studies. Neuroimage 53,
11125 (2000). 48. Gerlach, K. D., Spreng, R. N., Gilmore, A. W. & 1135–1146 (2010).
26. Formisano, E. et al. Tracking the mind’s image in Schacter, D. L. Solving future problems: default 73. Bakken, T. E. et al. Association of common genetic
the brain I: time-​resolved fMRI during visuospatial network and executive activity associated with variants in GPCPD1 with scaling of visual cortical
mental imagery. Neuron 35, 185–194 (2002). goal-​directed mental simulations. Neuroimage 55, surface area in humans. Proc. Natl Acad. Sci. USA
27. Sack, A. T. et al. Tracking the mind’s image in 1816–1824 (2011). 109, 3985–3990 (2012).
the brain II: transcranial magnetic stimulation reveals 49. Levine, D. N., Warach, J. & Farah, M. Two visual 74. Pearson, J., Rademaker, R. L. & Tong, F. Evaluating
parietal asymmetry in visuospatial imagery. Neuron systems in mental imagery. Neurology 35, 1010 the mind’s eye: the metacognition of visual imagery.
35, 195–204 (2002). (1985). Psychol. Sci. 22, 1535–1542 (2011).
28. Le Bihan, D. et al. Activation of human primary visual 50. Keogh, R. & Pearson, J. The blind mind: no sensory 75. Rademaker, R. L. & Pearson, J. Training visual
cortex during visual recall: a magnetic resonance visual imagery in aphantasia. Cortex 105, 53–60 imagery: improvements of metacognition, but not
imaging study. Proc. Natl Acad. Sci. USA 90, (2017). imagery strength. Front. Psychol. 3, 224 (2012).
11802–11805 (1993). 51. Sakai, K. & Miyashita, Y. Neural organization for the 76. Pearson, J. New directions in mental-​imagery research:
29. Sabbah, P. et al. Functional magnetic resonance long-​term memory of paired associates. Nature 354, the binocular-​rivalry technique and decoding fMRI
imaging at 1.5T during sensorimotor and cognitive 152–155 (1991). patterns. Curr. Dir. Psychol. Sci. 23, 178–183 (2014).
task. Eur. Neurol. 35, 131–136 (1995). 52. Messinger, A., Squire, L. R., Zola, S. M. & Albright, T. D. 77. Keogh, R., Bergmann, J. & Pearson, J. Cortical
30. Chen, W. et al. Human primary visual cortex and Neuronal representations of stimulus associations excitability controls the strength of mental imagery.
lateral geniculate nucleus activation during visual develop in the temporal lobe during learning. Preprint at bioRxiv https://www.biorxiv.org/content/
imagery. Neuroreport 9, 3669–3674 (1998). Proc. Natl Acad. Sci. USA 98, 12239–12244 (2001). 10.1101/093690v1 (2016).
31. Ishai, A. Visual imagery of famous faces: effects of 53. Schlack, A. & Albright, T. D. Remembering visual 78. Terhune, D. B., Tai, S., Cowey, A., Popescu, T. &
memory and attention revealed by fMRI. Neuroimage motion: neural correlates of associative plasticity Kadosh, R. C. Enhanced cortical excitability in
17, 1729–1741 (2002). and motion recall in cortical area MT. Neuron 53, grapheme-​color synesthesia and its modulation. Curr.
32. Ganis, G., Thompson, W. L. & Kosslyn, S. M. Brain 881–890 (2007). Biol. 21, 2006–2009 (2011).
areas underlying visual mental imagery and visual 54. Bannert, M. M. & Bartels, A. Decoding the yellow of 79. Chiou, R., Rich, A. N., Rogers, S. & Pearson, J.
perception: an fMRI study. Cogn. Brain Res. 20, a gray banana. Curr. Biol. 23, 2268–2272 (2013). Exploring the functional nature of synaesthetic colour:
226–241 (2004). 55. Hansen, T., Olkkonen, M., Walter, S. & Gegenfurtner, dissociations from colour perception and imagery.
33. Klein, I., Paradis, A. L., Poline, J. B., Kossly, S. M. K. R. Memory modulates color appearance. Cognition 177, 107–121 (2018).
& Le Bihan, D. Transient activity in the human calcarine Nat. Neurosci. 9, 1367–1368 (2006). 80. Arieli, A., Sterkin, A., Grinvald, A. & Aertsen, A.
cortex during visual-​mental imagery: an event-​related 56. Meng, M., Remus, D. A. & Tong, F. Filling-​in of visual Dynamics of ongoing activity: explanation of the large
fMRI study. J. Cogn. Neurosci. 12 (Suppl. 2), 15–23 phantoms in the human brain. Nat. Neurosci. 8, variability in evoked cortical responses. Science 273,
(2000). 1248–1254 (2005). 1868–1871 (1996).
34. Lambert, S., Sampaio, E., Scheiber, C. & Mauss, Y. 57. Sasaki, Y. & Watanabe, T. The primary visual cortex 81. Wassell, J., Rogers, S. L., Felmingam, K. L., Bryant, R. A.
Neural substrates of animal mental imagery: calcarine fills in color. Proc. Natl Acad. Sci. USA 101, & Pearson, J. Biological psychology. Biol. Psychol.
sulcus and dorsal pathway involvement — an fMRI 18251–18256 (2004). 107, 61–68 (2015).
study. Brain Res. 924, 176–183 (2002). 58. Kok, P., Failing, M. F. & de Lange, F. P. Prior 82. Kraehenmann, R. et al. LSD increases primary process
35. Cui, X., Jeter, C. B., Yang, D., Montague, P. R. expectations evoke stimulus templates in the primary thinking via serotonin 2A receptor activation. Front.
& Eagleman, D. M. Vividness of mental imagery: visual cortex. J. Cogn. Neurosci. 26, 1546–1554 Pharmacol. 8, 418–419 (2017).
individual variability can be measured objectively. (2014). 83. Pearson, J., Clifford, C. W. G. & Tong, F. The functional
Vision Res. 47, 474–478 (2007). 59. Bergmann, J., Genc, E., Kohler, A., Singer, W. impact of mental imagery on conscious perception.
36. Amedi, A., Malach, R. & Pascual-​Leone, A. Negative & Pearson, J. Smaller primary visual cortex is Curr. Biol. 18, 982–986 (2008).
BOLD differentiates visual imagery and perception. associated with stronger, but less precise mental This study shows that the content of visual imagery
Neuron 48, 859–872 (2005). imagery. Cereb. Cortex 26, 3838–3850 (2016). can bias or prime subsequent binocular rivalry; this
37. Reddy, L., Tsuchiya, N. & Serre, T. Reading the mind’s This study shows that stronger but less precise paper was the basis for using binocular rivalry as
eye: decoding category information during mental imagery is associated with a smaller primary and a measurement tool for imagery.
imagery. Neuroimage 50, 818–825 (2010). secondary visual cortex. 84. Ishai, A. & Sagi, D. Common mechanisms of visual
38. Dijkstra, N., Bosch, S. E. & van Gerven, M. A. J. 60. Stensaas, S. S., Eddington, D. K. & Dobelle, W. H. The imagery and perception. Science 268, 1772–1774
Vividness of visual imagery depends on the neural topography and variability of the primary visual cortex (1995).
overlap with perception in visual areas. J. Neurosci. in man. J. Neurosurg. 40, 747–755 (1974). 85. Tartaglia, E. M., Bamert, L., Mast, F. W. & Herzog, M. H.
37, 1367–1373 (2017). 61. Song, C., Schwarzkopf, D. S. & Rees, G. Variability Human perceptual learning by mental imagery.
39. Kosslyn, S. M. & Thompson, W. L. When is early in visual cortex size reflects tradeoff between local Curr. Biol. 19, 2081–2085 (2009).
visual cortex activated during visual mental imagery? orientation sensitivity and global orientation This study shows that training with a purely imaged
Psychol. Bull. 129, 723–746 (2003). modulation. Nat. Commun. 4, 1–10 (2013). visual stimulus transfers to improve performance in
40. Albers, A. M., Kok, P., Toni, I., Dijkerman, H. C. 62. Dorph-​Petersen, K.-A., Pierri, J. N., Wu, Q., perceptual tasks.
& de Lange, F. P. Shared representations for working Sampson, A. R. & Lewis, D. A. Primary visual cortex 86. Lewis, D. E., O’Reilly, M. J. & Khuu, S. K. Conditioning
memory and mental imagery in early visual cortex. volume and total neuron number are reduced in the mind’s eye associative learning with voluntary
Curr. Biol. 23, 1427–1431 (2013). schizophrenia. J. Comp. Neurol. 501, 290–301 mental imagery. Clin. Psychol. Sci. 1, 390–400 (2013).
This paper shows that both imagery and visual (2007). 87. Laeng, B. & Sulutvedt, U. The eye pupil adjusts to
working memory can be decoded in the brain 63. Sack, A. T., van de Ven, V. G., Etschenberg, S., Schatz, D. imaginary light. Psychol. Sci. 25, 188–197 (2014).
based on training on either, showing evidence & Linden, D. E. J. Enhanced vividness of mental 88. Brascamp, J. W., Knapen, T. H. J., Kanai, R., van Ee, R.
of a common brain representation. imagery as a trait marker of schizophrenia? Schizophr. & van den Berg, A. V. Flash suppression and flash
41. Koenig-​Robert, R. & Pearson, J. Decoding the Bull. 31, 97–104 (2005). facilitation in binocular rivalry. J. Vis. 7, 12 (2007).
contents and strength of imagery before volitional 64. Maróthi, R. & Kéri, S. Enhanced mental imagery and 89. Tanaka, Y. & Sagi, D. A perceptual memory for low-​
engagement. Sci. Rep. 9, 3504 (2019). intact perceptual organization in schizotypal contrast visual signals. Proc. Natl Acad. Sci. USA 95,
This paper shows that the content and vividness personality disorder. Psychiatry Res. 259, 433–438 12729–12733 (1998).
of a mental image can be decoded in the brain up (2018). 90. Chang, S., Lewis, D. E. & Pearson, J. The functional
to 11 seconds before an individual decides which 65. Morina, N., Leibold, E. & Ehring, T. Vividness effects of color perception and color imagery. J. Vis.
pattern to imagine. of general mental imagery is associated with the 13, 4 (2013).
42. Naselaris, T., Olman, C. A., Stansbury, D. E., Ugurbil, K. occurrence of intrusive memories. J. Behav. Ther. Exp. 91. Slotnick, S. D., Thompson, W. L. & Kosslyn, S. M.
& Gallant, J. L. A voxel-​wise encoding model for early Psychiatry 44, 221–226 (2013). Visual mental imagery induces retinotopically
visual areas decodes mental images of remembered 66. Chao, L. L., Lenoci, M. & Neylan, T. C. Effects of post-​ organized activation of early visual areas. Cereb. Cortex
scenes. Neuroimage 105, 215–228 (2015). traumatic stress disorder on occipital lobe function 15, 1570–1583 (2005).
This study shows that mental imagery content can and structure. Neuroreport 23, 412–419 (2012). 92. Thirion, B. et al. Inverse retinotopy: inferring the visual
be decoded in the early visual cortex when the 67. Tavanti, M. et al. Evidence of diffuse damage in content of images from brain activation patterns.
decoding model is based on depictive perceptual frontal and occipital cortex in the brain of patients Neuroimage 33, 1104–1116 (2006).
features. with post-​traumatic stress disorder. Neurol. Sci. 33, 93. Horikawa, T. & Kamitani, Y. Generic decoding of seen
43. Fox, M. D. et al. The human brain is intrinsically 59–68 (2011). and imagined objects using hierarchical visual
organized into dynamic, anticorrelated functional 68. Kavanagh, D. J., Andrade, J. & May, J. Imaginary features. Nat. Commun. 8, 15037 (2017).
networks. Proc. Natl Acad. Sci. USA 102, 9673–9678 relish and exquisite torture: the elaborated intrusion 94. Keogh, R. & Pearson, J. Mental imagery and visual
(2005). theory of desire. Psychol. Rev. 112, 446–467 working memory. PLOS ONE 6, e29221 (2011).
44. Smith, S. M. et al. Correspondence of the brain’s (2005). 95. Keogh, R. & Pearson, J. The sensory strength of
functional architecture during activation and rest. Proc. 69. Ersche, K. D. et al. Abnormal brain structure voluntary visual imagery predicts visual working
Natl Acad. Sci. USA 106, 13040–13045 (2009). implicated in stimulant drug addiction. Science 335, memory capacity. J. Vis. 14, 7 (2014).
45. Østby, Y. et al. Mental time travel and default-​mode 601–604 (2012). 96. Aydin, C. The differential contributions of visual
network functional connectivity in the developing 70. Song, C., Schwarzkopf, D. S., Kanai, R. & Rees, G. imagery constructs on autobiographical thinking.
brain. Proc. Natl Acad. Sci. USA 109, 16800–16804 Reciprocal anatomical relationship between primary Memory 26, 189–200 (2017).
(2012). sensory and prefrontal cortices in the human brain. 97. Schacter, D. L. et al. The future of memory:
46. Andrews-​Hanna, J. R., Reidler, J. S., Sepulcre, J., J. Neurosci. 31, 9472–9480 (2011). remembering, imagining, and the brain. Neuron 76,
Poulin, R. & Buckner, R. L. Functional-​anatomic 71. Panizzon, M. S. et al. Distinct genetic influences 677–694 (2012).
fractionation of the brain’s default network. Neuron on cortical surface area and cortical thickness. 98. Tong, F. Imagery and visual working memory: one and
65, 550–562 (2010). Cereb. Cortex 19, 2728–2735 (2009). the same? Trends Cogn. Sci. 17, 489–490 (2013).

www.nature.com/nrn
Reviews

99. Berger, G. H. & Gaunitz, S. C. Self-​rated imagery and 116. Holmes, E. A. et al. Mood stability versus mood 135. Kosslyn, S. M. Mental images and the brain.
encoding strategies in visual memory. Br. J. Psychol. instability in bipolar disorder: a possible role for Cogn. Neuropsychol. 22, 333–347 (2005).
70, 21–24 (1979). emotional mental imagery. Behav. Res. Ther. 49, 136. Pylyshyn, Z. W. What the mind’s eye tells the mind’s
100. Harrison, S. A. & Tong, F. Decoding reveals the 707–713 (2011). brain: a critique of mental imagery. Psychol. Bull. 80,
contents of visual working memory in early visual 117. Tiggemann, M. & Kemps, E. The phenomenology of 1–24 (1973).
areas. Nature 458, 632–635 (2009). food cravings: the role of mental imagery. Appetite 45, 137. Pylyshyn, Z. Return of the mental image: are there
101. Borst, G., Ganis, G., Thompson, W. L. & Kosslyn, S. M. 305–313 (2005). really pictures in the brain? Trends Cogn. Sci. 7,
Representations in mental imagery and working 118. Connor, J. P. et al. Addictive behaviors. Addict. Behav. 113–118 (2003).
memory: evidence from different types of visual 39, 721–724 (2014). This review provides an updated summary of the
masks. Mem. Cognit. 40, 204–217 (2011). 119. May, J., Andrade, J., Panabokke, N. & Kavanagh, D. imagery debate.
102. Kang, M.-S., Hong, S. W., Blake, R. & Woodman, G. F. Visuospatial tasks suppress craving for cigarettes. 138. Chang, S. & Pearson, J. The functional effects of prior
Visual working memory contaminates perception. Behav. Res. Ther. 48, 476–485 (2010). motion imagery and motion perception. Cortex 105,
Psychon Bull. Rev. 18, 860–869 (2011). 120. Michael, T., Ehlers, A., Halligan, S. L. & Clark, D. M. 83–96 (2017).
103. Keogh, R. & Pearson, J. The perceptual and Unwanted memories of assault: what intrusion 139. Stokes, M., Thompson, R., Cusack, R. & Duncan, J.
phenomenal capacity of mental imagery. Cognition characteristics are associated with PTSD? Behav. Res. Top-​down activation of shape-​specific population codes
162, 124–132 (2017). Ther. 43, 613–628 (2005). in visual cortex during mental imagery. J. Neurosci.
This study shows a new method to measure the 121. Holmes, E. A., James, E. L., Kilford, E. J. & Deeprose, C. 29, 1565–1572 (2009).
capacity function of visual imagery and shows that Key steps in developing a cognitive vaccine against 140. Amit, E. & Greene, J. D. You see, the ends don’t justify
it is quite limited. traumatic flashbacks: visuospatial tetris versus verbal the means: visual imagery and moral judgment.
104. Luck, S. J. & Vogel, E. K. Visual working memory pub quiz. PLOS ONE 5, e13706 (2010). Psychol. Sci. 23, 861–868 (2012).
capacity: from psychophysics and neurobiology to 122. Shine, J. M. et al. Imagine that: elevated sensory 141. Dobson, M. & Markham, R. Imagery ability and
individual differences. Trends Cogn. Sci. 17, 391–400 strength of mental imagery in individuals with source monitoring: implications for eyewitness
(2013). Parkinson’s disease and visual hallucinations. Proc. R. memory. Br. J. Psychol. 84, 111–118 (1993).
105. Pearson, J. & Keogh, R. Redefining visual working Soc. B 282, 20142047 (2014). 142. Gonsalves, B. et al. Neural evidence that vivid
memory: a cognitive-​strategy, brain-​region approach. 123. Foa, E. B., Steketee, G., Turner, R. M. & Fischer, S. C. imagining can lead to false remembering. Psychol. Sci.
Curr. Dir. Psychol. Sci. 28, 266–273 (2019). Effects of imaginal exposure to feared disasters in 15, 655–660 (2004).
106. Greenberg, D. L. & Knowlton, B. J. The role of visual obsessive-​compulsive checkers. Behav. Res. Ther. 18, 143. Bird, C. M., Bisby, J. A. & Burgess, N. The
imagery in autobiographical memory. Mem. Cognit. 449–455 (1980). hippocampus and spatial constraints on mental
42, 922–934 (2014). 124. Hunt, M. & Fenton, M. Imagery rescripting versus imagery. Front. Hum. Neurosci. 6, 142 (2012).
107. Sheldon, S., Amaral, R. & Levine, B. Individual in vivo exposure in the treatment of snake fear. 144. Jones, L. & Stuth, G. The uses of mental imagery
differences in visual imagery determine how event J. Behav. Ther. Exp. Psychiatry 38, 329–344 (2007). in athletics: an overview. Appl. Prev. Psychol. 6,
information is remembered. Memory 25, 360–369 125. Holmes, E. A. & Mathews, A. Mental imagery and 101–115 (1997).
(2017). emotion: a special relationship? Emotion 5, 489–497 145. Dils, A. T. & Boroditsky, L. Visual motion aftereffect
108. D’Argembeau, A. & Van der Linden, M. Individual (2005). from understanding motion language. Proc. Natl Acad.
differences in the phenomenology of mental time 126. Zeman, A. Z. J. et al. Loss of imagery phenomenology Sci. USA 107, 16396–16400 (2010).
travel: the effect of vivid visual imagery and emotion with intact visuo-​spatial task performance: a case of 146. Christian, B. M., Miles, L. K., Parkinson, C. &
regulation strategies. Conscious Cogn. 15, 342–350 ‘blind imagination’. Neuropsychologia 48, 145–155 Macrae, C. N. Visual perspective and the characteristics
(2006). (2010). of mind wandering. Front. Psychol. 4, 699 (2013).
109. Vannucci, M., Pelagatti, C., Chiorri, C. & Mazzoni, G. 127. Ungerleider, L. G. & Haxby, J. V. ‘What’ and ‘where’ in 147. Palmiero, M., Cardi, V. & Belardinelli, M. O. The role
Visual object imagery and autobiographical memory: the human brain. Curr. Opin. Neurobiol. 4, 157–165 of vividness of visual mental imagery on different
object Imagers are better at remembering their (1994). dimensions of creativity. Creat. Res. J. 23, 372–375
personal past. Memory 24, 455–470 (2015). 128. Jacobs, C., Schwarzkopf, D. S. & Silvanto, J. Visual (2011).
110. Galton, F. Statistics of mental imagery. Mind 5, working memory performance in aphantasia. Cortex
301–318 (1880). 105, 61–73 (2017). Acknowledgements
This paper was the first formal empirical paper 129. Gray, C. R. & Gummerman, K. The enigmatic eidetic The author thanks R. Keogh, R. Koenig-​Robert and A. Dawes
investing imagery vividness, including the first image: a critical examination of methods, data, and for helpful feedback and discussion on this paper. This paper,
report of what is now called aphantasia. theories. Psychol. Bull. 82, 383–407 (1975). and some of the work discussed in it, was supported by
111. Holmes, E. A. & Mathews, A. Mental imagery in 130. Stromeyer, C. F. & Psotka, J. The detailed texture Australian National Health and Medical Research Council
emotion and emotional disorders. Clin. Psychol. Rev. of eidetic images. Nature 225, 346–349 (1970). grants APP1024800, APP1046198 and APP1085404,
30, 349–362 (2010). 131. Haber, R. N. Twenty years of haunting eidetic imagery: a Career Development Fellowship APP1049596 and an
112. Hackmann, A., Bennett-​Levy, J. & Holmes, E. A. where’s the ghost? Behav. Brain Sci. 2, 616–617 Australian Research Council discovery project grant
Oxford Guide to Imagery in Cognitive Therapy (Oxford (1979). DP140101560.
Univ. Press, 2011). 132. Allport, G. W. Eidetic imagery. Br. J. Psychol. 15,
113. Blackwell, S. E. et al. Positive imagery-​based cognitive 99–120 (1924). Competing interests
bias modification as a web-​based treatment tool for 133. Kwok, E. L., Leys, G., Koenig-​Robert, R. & Pearson, J. The author declares no competing interests.
depressed adults: a randomized controlled trial. Clin. Measuring thought-​control failure: sensory
Psychol. Sci. 3, 91–111 (2015). mechanisms and individual differences. Psychol. Sci. Peer review information
114. Crane, C., Shah, D., Barnhofer, T. & Holmes, E. A. 57, 811–821 (2019). Nature Reviews Neuroscience thanks D. Kavanagh, J. Hohwy
Suicidal imagery in a previously depressed community This study shows that, even when people think they and the other, anonymous, reviewer(s) for their contribution
sample. Clin. Psychol. Psychother. 19, 57–69 (2011). have successfully suppressed a mental image, it is to the peer review of this work.
115. Hales, S. A., Deeprose, C., Goodwin, G. M. still actually there and biases subsequent perception
& Holmes, E. A. Cognitions in bipolar affective disorder (a possible candidate for unconscious imagery). Publisher’s note
and unipolar depression: imagining suicide. Bipolar 134. Kosslyn, S. M. Image and Mind (Harvard Univ. Springer Nature remains neutral with regard to jurisdictional
Disord. 13, 651–661 (2011). Press, 1980). claims in published maps and institutional affiliations.

Nature Reviews | Neuroscience

You might also like