You are on page 1of 15

Progress in Brain Research, Vol.

149
ISSN 0079-6123
Copyright ß 2005 Elsevier BV. All rights reserved

CHAPTER 19

Dual routes to action: contributions of the dorsal and


ventral streams to adaptive behavior

Melvyn A. Goodale1,*, Grzegorz Króliczak2 and David A. Westwood3

1
Department of Psychology, University of Western Ontario, London, ON N6A 5C2, Canada
2
Neuroscience Program, Department of Psychology, University of Western Ontario, London, ON N6A 5C2, Canada
3
School of Health and Human Performance, Dalhousie University, Halifax, NS B3H 3J5, Canada

Abstract: More than a decade ago, Goodale and Milner proposed that our perceptual experience of the world depends
on visual processing that is fundamentally distinct from that mediating the moment-to-moment visual control of our
actions. They mapped this distinction between vision-for-perception and vision-for-action onto the two prominent
visual pathways that arise from early visual areas in the primate cerebral cortex: a ventral ‘‘perception’’ pathway
projecting to inferotemporal cortex and a dorsal ‘‘action’’ pathway projecting to posterior parietal cortex. In the years
since these ideas were first put forward, visual neuroscience has advanced rapidly on several fronts. In this chapter,
we examine the perception-action distinction in the light of some of these developments, giving particular emphasis
to the differences in the way the two streams process visual information and the way they interact in the production of
adaptive behavior.

Introduction engender) can affect the world only insofar as they


affect our actions. This basic fact about the function
In the last decade, research into the neural sub- of the brain was highlighted in a recent review by
strates of perception, particularly visual perception, Guillery (2003), in which he observed that perception
has made enormous strides. Much of this progress has and action are ‘‘inexorably linked at all levels, from
been driven by the development of high resolution the peripheral input to the higher cortical areas’’.
neuroimaging in humans, which has not only revealed In fact, it can be argued that the evolution of
a good deal about the topographical organization sensory systems, including vision, was not driven by
of visual areas in the human cerebral cortex, but has the need to perceive the world at all but rather by the
also provided new insights into how our brain enables need to direct movements with respect to that world.
us to perceive, think, and make decisions. In all the After all, a frog does not have to ‘‘perceive’’ the fly;
excitement, however, it is sometimes forgotten that it simply has to catch it. Vision as ‘‘perception’’, in
the ultimate reason we have brains is not so much which some sort of inner representation of the outside
to perceive the world as it is to act upon it. Brains world is constructed, is a relative newcomer on the
evolved to enable us to move — and (eventually) to evolutionary landscape. The emergence of perception,
reproduce. Our percepts (and the thoughts that they however, has enabled animals to carry out complex
cognitive operations on mental representations of
the world — operations that greatly increase the
*Corresponding author. Tel.: þ1-519-661-2070;
Fax: þ1-519-661-3961; E-mail: mgoodale@uwo.ca potential for flexible, adaptive behavior. According

DOI: 10.1016/S0079-6123(05)49019-6 269


270

two kinds of visual processing are separate, both are


Posterior
parietal Pulv embodied in the hardware of the brain. Moreover,
cortex there is a complex but seamless interaction between
Dorsal SC the ventral and the dorsal streams in the production
stream
of adaptive behavior. For example, the selection of
appropriate goal objects depends on the perceptual
V1+ LGNd Retina
machinery of the ventral stream, while the execution
of a goal-directed action is mediated by dedicated
Ventral on-line control systems in the dorsal stream and
stream
Occipito-
associated motor areas. Indeed, as argued later in
temporal this chapter, the integration of processing in the two
cortex
streams goes well beyond this. The dorsal stream may
allow us to reach out and grasp objects with exquisite
ease and precision, but it is trapped in the present.
Fig. 1. The two streams of visual processing in human cerebral
cortex. The retina sends projections to the lateral geniculate Evidence from the behavior of both neurological
nucleus (pars dorsalis) in the thalamus (LGNd), which projects patients and normal observers shows that, by itself,
in turn to primary visual cortex (V1). Within the cerebral the encapsulated visuomotor mechanisms in the
cortex, the ventral stream arises from early visual areas and dorsal stream can deal only with objects that are
projects to regions in the occipito-temporal cortex. The dorsal
visible when the action is being programmed. The
stream also arises from early visual areas but projects instead to
the posterior parietal cortex. The posterior parietal cortex also perceptual machinery in the ventral stream, however,
receives visual input from the superior colliculus (SC) via the allows us to escape the present and bring to bear
pulvinar (Pulv). information from the past — including information
about the function of objects, their intrinsic proper-
ties, and their location with reference to other objects
to a proposal put forward by Goodale and Milner in the world. Ultimately then, both streams contribute
in 1992, the informational requirements and the oper- to the production of goal-directed actions albeit in
ating characteristics of the more recently evolved different ways and on different time scales.
‘‘vision-for-perception’’ system are quite different In this chapter, some of the recent evidence from
from those of the more ancient ‘‘vision-for-action’’ human neuroimaging and monkey neurophysi-
system. Indeed, according to Goodale and Milner ology that speaks to the idea of two complementary
(1992, 2004; Milner and Goodale, 1995), it is this but interacting cortical visual systems have been
duplex nature of vision that drove the emergence reviewed first. Next evidence from a range of behav-
of distinct visual pathways in the primate cerebral ioral studies in normal observers that is consistent
cortex: a dorsal ‘‘action’’ stream, projecting from with the notion that object-directed actions depend
early visual areas and the superior colliculus (via the on the integrated activity of two distinct visual
pulvinar) to the posterior parietal cortex and a ventral systems has been examined.
‘‘perception’’ stream projecting from primary visual
cortex to the temporal lobe (Fig. 1). The dorsal stream Neuropsychology meets neuroimaging
provides flexible and real time control of motor acts
while the ventral stream provides the rich and detailed Patients with lesions in the dorsal stream, particularly
representation of the world required for cognitive in the region of the intraparietal sulcus (IPS) in the
operations such as recognition, identification, and posterior parietal cortex, can have problems using
planning. vision to form their grasp or to direct an aiming
This might sound rather like Cartesian dualism — movement towards objects presented outside foveal
the existence of a conscious mind separate from a vision. This deficit is often described as optic ataxia
reflexive machine. But the division of labour between (Bálint, 1909). Despite their problems with the visual
the two streams has nothing to do with the kind of control of hand and limb movements, many of
dualism that Descartes proposed. Although the these patients can describe the orientation or relative
271

position of the target objects quite accurately (Perenin features and location of the very object they cannot
and Vighetto, 1988). Typically, these patients have acquire.
no difficulty using input from other sensory systems, Quite the opposite pattern of deficits and spared
such as proprioception or audition, to guide their visual abilities has been reported in patients with
movements. In short, their deficit is neither ‘‘purely’’ visual form agnosia, where the brain damage is
visual nor ‘‘purely’’ motor. It is instead a visuomotor concentrated in the ventral stream. The most compel-
deficit. ling example of such a case is patient DF, a young
The nature of the visuomotor deficits observed woman who suffered irreversible brain damage in
following damage to the posterior parietal cortex 1988 as a result of anoxia from carbon monoxide
can vary from patient to patient. Some individuals poisoning (Milner et al., 1991). Even though DF is
with damage to this region are unable to use visual unable to indicate the size, shape, and orientation of
information to control their hand postures but an object, either verbally or manually, she shows
have no difficulty controlling the direction of their normal pre-shaping and rotation of her hand when
grasp; others show the reverse pattern. Some patients reaching out to grasp that object (Goodale et al.,
are unable to foveate a target object, but have no 1991; Milner et al., 1991). The initial MR images of
difficulty directing a well formed grasp in its direc- DF’s brain (Milner et al., 1991), which were acquired
tion; others may show no evidence of an oculomotor just over a year after her accident, suggested that her
deficit but be unable to guide their hand towards an brain damage is largely confined to the ventrolateral
object under visual control. Indeed, depending upon regions of the occipital lobe, in regions that are
the size and locus of the lesion, a patient can demons- now known to be part of the human ventral stream.
trate any combination of these visuomotor deficits This tentative conclusion was confirmed in a recent
(review, see Milner and Goodale, 1995). Different high-resolution structural MRI study (James et al.,
subregions of the posterior parietal cortex, it appears, 2003), which revealed that the lateral occipital com-
are critical for the visual control of different motor plex (LOC), a structure in the ventral stream that
outputs. In fact, neurophysiological studies have has been implicated in object recognition (for review,
shown that there are specialized visuomotor areas see Grill-Spector, 2003; Hasson et al., 2003) is severely
for the control of eye movements, head movements, damaged on both sides of DF’s brain. The damage
reaching, and grasping in the monkey posterior is largely localized to area LO (Malach et al., 1995), in
parietal cortex, with most of these areas located in the more lateral aspect of LOC, leaving much of the
or around the IPS. A similar story is emerging in the fusiform gyrus and the parahippocampal gyrus quite
human neuroimaging literature — separate areas in intact. This sparing of more medial regions of
the IPS and neighboring regions also appear to be LOC and other parts of the ventral stream may help
specialized for different kinds of visuomotor trans- to explain why DF’s perceptual deficit is form specific
formations, and these areas appear to be largely in that she has great difficulty reporting the geome-
homologous with those in the monkey (Culham and trical structure of objects but can still accurately
Kanwisher, 2001). A particular motor act, such as describe their surface properties, such as colour and
reaching out and grasping an object, presumably visual texture.
requires the orchestration of activity in a number of The data from a recent functional MRI study of
these different areas, including those involved in DF also converges nicely on the earlier neuropsycho-
the control of saccades, visual pursuit, reaching logical observations (James et al., 2003). Thus, when
with the limb, and grasping movements of the hands DF was presented with line drawings of common
and fingers. Damage to the posterior parietal cortex objects, where form provided the only cue as to the
could interfere with the function of all or any com- identity of the object, none of LOC, even the regions
bination of these different regions. But again, even in the fusiform gyrus outside the lesion in area
though patients with damage to these dorsal stream LO, was activated. The lack of activation with line
regions might experience a devastating loss in visuo- drawings was mirrored in DF’s poor performance
motor control, they could at the same time continue in identifying the objects in the drawings. Healthy
to describe (and thus perceive) the intrinsic visual control subjects, who of course had no difficulty
272

identifying the drawings, showed robust activation orient their fingers in a precision grip to grasp morsels
in the LOC, particularly in area LO. With coloured of food embedded in small slots placed at different
and greyscale images of common objects, stimuli that orientations — even though their ability to discrimi-
DF identified more accurately than line drawings, DF nate between different orientations is profoundly
did show some ventral-stream activation, particularly impaired (Glickstein et al., 1998). In short, monkeys
in the fusiform gyrus although the activation was with IT lesions appear to have a similar pattern of
more widely distributed than that seen in controls — deficits and spared abilities as DF.
and did not include area LO. It has been suggested that IT cells might also play
In DF’s dorsal stream, the structural MRI revealed a role in the mnemonic coding of visual objects, acting
shrinkage of cortical tissue within the intraparietal as one (albeit important) node in a network that
sulcus (IPS), a region that has been implicated in includes medial temporal structures and prefrontal
visuomotor control (Goodale and Humphrey, 1998; regions (Miyashita and Hayashi, 2000). In fact, sensi-
Culham and Kanwisher, 2001; Cohen and Andersen, tivity to particular objects can be created in ensembles
2002; Simon et al., 2002; Andersen and Buneo, 2003). of IT cells simply by training the animals to dis-
Nevertheless, when DF grasped objects that varied in criminate between different objects (Logothetis et al.,
size and orientation, she displayed relatively normal 1995). There is also evidence for a specialization
activation in the anterior intraparietal sulcus (AIP), within separate regions of the ventral stream for the
an area that has been shown to play a critical role coding of certain categories of objects, such as faces
in the visual control of grasping in both humans and hands, which are of particular social significance
(Binkofski et al., 1998; Culham et al., 2003; Jeannerod to the monkey (Perrett et al., 1995). Finally, recent
and Farne, 2003; Culham, 2004) and monkeys (Taira studies, using a binocular rivalry paradigm, in which
et al., 1990; Sakata and Taira, 1994; Sakata, 2003). competing images are presented at the same time to
Taken together, these findings provide additional different eyes, have shown that cells in IT are tuned
support for the idea that perception and action are to what the monkey reports seeing on a particular
mediated by separate visual pathways in the cerebral trial, not simply to what is present on the two eyes
cortex, and confirm the respective roles of the ventral (Logothetis, 1998). But neurons earlier in the visual
and dorsal visual streams in these functions. system, like area V1, do not show these correlations.
The neurons in this early visual area respond in the
same way no matter what the monkey indicates that it
Evidence from monkey neurophysiology sees. Even in intermediate areas of the ventral stream
such as area V4 the correlations are relatively weak.
A broad range of neurophysiological studies in the These results provide indirect support for the claim
monkey lend considerable support to the distinction that the ventral stream plays a critical role in
outlined in the previous section. Since the pioneering delivering the contents of our conscious percepts
studies of Gross and his colleagues (1972) on the (insofar as activity in the monkey’s inferotemporal
monkey ventral stream, for example, there has been cortex reflects what the monkey indicates that it sees).
a long history of single-unit work showing that cells These and other studies too numerous to cite here
in inferotemporal cortex (IT) and neighbouring lend considerable support to the suggestion that
regions of the superior temporal sulcus are tuned to the object-based descriptions provided by the ventral
specific objects and object features (Logothetis and stream form the basic raw material for visual percep-
Sheinberg, 1996; Tanaka, 2003) — with some cells tion, recognition memory and other long-term repre-
maintaining their selectivity irrespective of viewpoint, sentations of the visual world.
retinal image size, and even color. Moreover, the In sharp contrast to the activity of cells in the
responses of these cells are not affected by the ventral stream, the responses of many cells in the
animal’s motor behavior but are instead sensitive to dorsal stream are dependent on the current motor
the reinforcement history and significance of the behavior of the animal. Over thirty years ago, work in
visual stimuli that drive them. It is important to the alert behaving monkey demonstrated that the
note, however, that monkeys with IT lesions can responses of neurons in the posterior parietal cortex
273

are typically modulated both by visual stimuli and moment-to-moment control of visually guided
by the movements made by the animal (Hyvärinen actions. [Of necessity, this review of the monkey
and Poranen, 1974; Mountcastle et al., 1975). As literature is far from complete. For more details, see
Andersen (1987) puts it, most neurons in this region Andersen and Buneo (2003), Sakata (2003), and
‘‘exhibit both sensory-related and movement-related Tanaka (2003).]
activity’’. Moreover, the motor modulation is quite
specific; some neurons are modulated by visual fixa-
tion, by pursuit eye movements, or by saccades; still The metrics and timing of perception and action
others by visually guided reaching or by the manip-
ulation of objects. Experiments in Andersen’s labora- According to the two visual system model put for-
tory have shown, for example, that visual cells in ward by Goodale and Milner, the dorsal and ventral
the posterior parietal cortex that code the spatial streams both process information about the structure
location of a target for a saccadic eye movement are of objects and about their spatial locations, but they
located in a region (the lateral intraparietal sulcus transform this information into quite different out-
or LIP) that is anatomically distinct from another puts (Goodale and Milner, 1992, 2004; Milner and
region (the socalled parietal reach region or PRR) Goodale, 1995; Goodale and Humphrey, 1998; James
containing cells that code the spatial location of et al., 2002; Ganel and Goodale, 2003). Because the
that same target for a manual aiming movement visuomotor systems of the dorsal stream are respon-
(Snyder et al., 1997; Cohen and Andersen, 2002). sible for the control of highly skilled actions, it is
Experiments in other laboratories have found grasp- imperative that these systems compute the absolute
modulated cells in the anterior intraparietal region of metrics of target objects in a frame of reference
parietal cortex (area AIP) that are sensitive to centered on specific effectors, that is, in egocentric
intrinsic object features, such as size and orientation, coding (Goodale and Humphrey, 1998; Henriques
that determine the posture of the hand and fingers et al., 2002). Indeed, evidence from single-unit studies
during the execution of a grasping movement (Taira of the dorsal stream in the monkey suggests that this
et al., 1990; Sakata and Taira, 1994). Lesions in this is the case, and that the different visuomotor areas
region of the posterior parietal cortex produce deficits in this region may, at least, initially share a common
in the visual control of reaching and grasping similar frame of reference, one that is centered on the eye,
in many respects to those seen in humans following (Cohen and Andersen, 2002). This oculocentric frame
damage to the homologous region (Ettlinger, 1977; of reference may serve as the lingua franca of the
Glickstein et al., 1998). In one study, small reversible posterior parietal cortex, allowing the different visuo-
pharmacological lesions were made directly in area motor areas in this region to coordinate their
AIP in monkey (Gallese et al., 1994). When this activities.
region was inactivated, there was a selective inter- Because observers and goal objects rarely stay in
ference with pre-shaping of the hand as the monkey a static relationship with one another, the required
reached out to grasp an object, a deficit that is coordinates for action are most effectively computed
remarkably similar to that seen in humans with immediately before the movements are initiated;
discrete lesions in the anterior part of the intraparie- i.e., in real time. A corollary of real time visuomotor
tal sulcus, an area thought to be homologous with transformation is that neither the coordinates for
monkey AIP (Binkofski et al., 1998). Finally, it a particular action nor the resulting motor program
should be noted that the posterior parietal cortex is need to be stored in memory — indeed such storage
intimately linked with premotor cortex, the superior could create interference between competing action
colliculus, and pontine nuclei — brain areas that have programs for multiple objects in the visual array, or
been implicated in various aspects of the visual between action programs to the same object following
control of eye, limb, and body movements. In short, a change in the spatial relationship between target
the networks in the dorsal stream have the functional and actor.
properties and interconnections that one might In contrast to the visual control of action, visual
expect to see in a system concerned with the perception has no requirement for absolute metrics
277

1100 information processing bottleneck at the interface


1000 between the two processes.

900

800 Visual illusions: demonstrating a dissociation


Reaction Time (ms)

between perception and action


700
Naming
Grasping A particularly intriguing but controversial line of
600
evidence in support of the perception–action hypoth-
500 esis comes from studies looking at the influence of
perceptual illusions on the control of object-directed
400
actions such as saccades, reaching movements, and
300 manual prehension (Carey, 2001). Early on, it was
shown that the final endpoints of saccadic eye move-
200 ments are insensitive to a dot-in-frame illusion in
Studied Old New which the perception of a target’s location is shifted
Types of objects opposite to the displacement of a large visual
Fig. 3. Reaction time for naming and grasping of studied
frame (Bridgeman et al., 1981; Wong and Mack,
objects and ‘‘old’’ and ‘‘new’’ objects during later testing 1981). This result is consistent with the idea, discussed
(Garofeanu et al., 2004). Reaction times are averaged over all earlier, that visuomotor systems make use of ego-
the different combinations of study and test phases (naming– centric frames of reference (at least in real time)
naming, naming–grasping, grasping–naming, and grasping– whereas perception uses allocentric or scene-based
grasping). Note that there was robust priming of naming:
participants named old objects (ones that they had studied
frames of reference. Recent single-unit studies in the
earlier) faster than new objects. There was no evidence of monkey have shown that prefrontal cortex neurons
visuomotor priming, although participants were faster overall can code both kinds of frames of reference simulta-
during testing than during study. neously when the monkey is performing a dot-in-
frame task, presumably reflecting both dorsal- and
ventral-stream processing (Lebedev et al., 2001).
the objects to be grasped were tools and implements Nearly ten years ago, Aglioti et al. (1995) demon-
— objects that are associated with particular func- strated that the scaling of grip aperture was insensi-
tions and thus particular hand postures. Presumably tive to the Ebbinghaus illusion, a robust perceptual
participants would have had to engage semantic illusion in which a target surrounded by smaller
processing in order to complete the grasping task — circles appears to be larger than the same target
semantic processing that shows robust priming surrounded by larger circles. At the same time, of
effects. Why then were functional grasps not facili- course, grip aperture remained exquisitely sensitive
tated by prior exposure to the prime objects? to real changes in the size of the target object. Grip
Although the answer to this question is not clear, it aperture is refractory to a size-contrast illusion even
seems likely that response selection and the specifica- when the hand and target are occluded during
tion of response kinematics do not proceed in a the action (Haffenden and Goodale, 1998), indicat-
simple serial manner. It is possible that response ing that on-line visual feedback during grasping
selection processes were actually facilitated by repeti- is not required to ‘‘correct’’ an initial perceptual
tion priming, but this advantage might not have been bias induced by the illusion. Again, these findings
observable in the time to initiate the action since suggest that objects are processed differently by per-
the kinematic specification of the response might not ceptual and visuomotor systems, consistent with the
yet have been complete. In other words, response perception–action model (Goodale and Milner, 1992,
selection and response specification might proceed 2004; Milner and Goodale, 1995; Goodale and
in a parallel manner, and there could even be an Humphrey, 1998).
278

A number of recent findings, however, have object size are based on a computation of extent.
challenged the notion that perceptual illusions do According to this view, dissociations between judg-
not impact the control of object-directed actions. ment and action occur because pictorial size illusions
These challenges fall into several categories from affect the perception of extent but not location (Mack
non-replication (Franz et al., 2000), to the contention et al., 1985). Although reasonable, this argument is
that early studies did not adequately match action difficult to separate from Goodale and Milner’s
and perception tasks for various input, attention original proposal (Goodale and Milner, 1992, 2004;
and output demands (Vishton et al., 1999; Bruno, Milner and Goodale, 1995), that the visuomotor
2001; Smeets and Brenner, 2001), or the idea that system computes absolute (i.e., Euclidean) object
action tasks involve multiple stages of processing metrics whereas the perceptual system utilizes scene-
from purely perceptual to more ‘‘automatic’’ visuo- based (i.e., non-Euclidean) metrics.
motor control (Glover and Dixon, 2001; Glover, Glover and colleagues (Glover and Dixon, 2001;
2002, 2004). Most of these challenges can readily be Glover, 2002, 2004) have reported that visual illu-
accommodated within the basic framework of the sions have a larger effect on the early rather than late
perception–action hypothesis, yet each provides stages of action, suggesting that on-line movement
important new insight into the nature of the proces- control is refractory to perception whereas movement
sing mechanisms underlying perception versus action. planning is not. Recent attempts to replicate these
Franz and colleagues (Franz et al., 2000), have findings using conventional tasks and data analyses
failed to replicate the early results of Aglioti et al. have failed (Danckert et al., 2002; Franz, 2003), and
(1995), and have argued that visually guided actions neuropsychological evidence does not support the
and perceptual judgments are mediated by the same contention that the early and late stages of actions
underlying visual processing mechanisms. Such an access different visual processing (Milner et al., 2003).
account, however, cannot explain why the majority Nevertheless, there is good reason to believe that
of illusion studies find evidence for a dissociation perceptual mechanisms are important for the guid-
between perception and action (Carey, 2001). Nor can ance of action in clearly circumscribed situations;
it explain the dissociations observed in patients Glover’s notion of ‘‘action-planning’’ can be easily
with optic ataxia or visual form agnosia — nor for subsumed under this framework.
that matter, the extensive neurophysiological and Two recent lines of evidence have helped to clarify
behavioral work on the ventral and dorsal streams the relation between object perception and object-
in the macaque monkey that supports a distinction directed action in the context of visual illusions. Dyde
between vision-for-perception and vision-for-action and Milner (2002) showed that the orientation of
(Goodale and Milner, 1992, 2004; Milner and the grasping hand is sensitive to a simultaneous
Goodale, 1995; Goodale and Humphrey, 1998). One tilt (ST) illusion — similar to that used by Glover
possible reason that Franz et al. find an effect on and colleagues (Glover and Dixon, 2001), but not a
grasping with the Ebbinghaus illusion is that, depend- rod-and-frame (RF) illusion, even though the two
ing on the particular arrangement of the illusory visual displays have equivalent effects on judgments
display, the visuomotor system can sometimes treat of target orientation. Dyde and Milner (2002), argue
the surrounding disks as obstacles. As a consequence that the sensitivity of action to a perceptual illusion
grip aperture may be affected by the display, not can be understood in terms of the illusion’s presumed
because of a perceived illusion, but because the neural origins. Illusions that presumably arise from
visuomotor system is attempting to avoid having ‘‘early’’ (i.e., area V1, area V2) stages of visual pro-
the fingers collide with an apparent obstacle near the cessing, such as the ST illusion, should affect both
target (Haffenden and Goodale, 2000; Haffenden action and perception since the dorsal and ventral
et al., 2001; de Grave et al., 2004). visual pathways share this input (Milner and Dyde,
Smeets and colleagues (Smeets and Brenner, 2001; 2003). Illusions like the RF that presumably arise
Smeets et al., 2002), have argued that the control from later stages of processing (i.e., in inferotemporal
of grasping is based on the computed locations of cortex) should not affect action, since the dorsal
points on the object’s surface, whereas judgments of stream does not have direct access to this processing.
277

1100 information processing bottleneck at the interface


1000 between the two processes.

900

800 Visual illusions: demonstrating a dissociation


Reaction Time (ms)

between perception and action


700
Naming
Grasping A particularly intriguing but controversial line of
600
evidence in support of the perception–action hypoth-
500 esis comes from studies looking at the influence of
perceptual illusions on the control of object-directed
400
actions such as saccades, reaching movements, and
300 manual prehension (Carey, 2001). Early on, it was
shown that the final endpoints of saccadic eye move-
200 ments are insensitive to a dot-in-frame illusion in
Studied Old New which the perception of a target’s location is shifted
Types of objects opposite to the displacement of a large visual
Fig. 3. Reaction time for naming and grasping of studied
frame (Bridgeman et al., 1981; Wong and Mack,
objects and ‘‘old’’ and ‘‘new’’ objects during later testing 1981). This result is consistent with the idea, discussed
(Garofeanu et al., 2004). Reaction times are averaged over all earlier, that visuomotor systems make use of ego-
the different combinations of study and test phases (naming– centric frames of reference (at least in real time)
naming, naming–grasping, grasping–naming, and grasping– whereas perception uses allocentric or scene-based
grasping). Note that there was robust priming of naming:
participants named old objects (ones that they had studied
frames of reference. Recent single-unit studies in the
earlier) faster than new objects. There was no evidence of monkey have shown that prefrontal cortex neurons
visuomotor priming, although participants were faster overall can code both kinds of frames of reference simulta-
during testing than during study. neously when the monkey is performing a dot-in-
frame task, presumably reflecting both dorsal- and
ventral-stream processing (Lebedev et al., 2001).
the objects to be grasped were tools and implements Nearly ten years ago, Aglioti et al. (1995) demon-
— objects that are associated with particular func- strated that the scaling of grip aperture was insensi-
tions and thus particular hand postures. Presumably tive to the Ebbinghaus illusion, a robust perceptual
participants would have had to engage semantic illusion in which a target surrounded by smaller
processing in order to complete the grasping task — circles appears to be larger than the same target
semantic processing that shows robust priming surrounded by larger circles. At the same time, of
effects. Why then were functional grasps not facili- course, grip aperture remained exquisitely sensitive
tated by prior exposure to the prime objects? to real changes in the size of the target object. Grip
Although the answer to this question is not clear, it aperture is refractory to a size-contrast illusion even
seems likely that response selection and the specifica- when the hand and target are occluded during
tion of response kinematics do not proceed in a the action (Haffenden and Goodale, 1998), indicat-
simple serial manner. It is possible that response ing that on-line visual feedback during grasping
selection processes were actually facilitated by repeti- is not required to ‘‘correct’’ an initial perceptual
tion priming, but this advantage might not have been bias induced by the illusion. Again, these findings
observable in the time to initiate the action since suggest that objects are processed differently by per-
the kinematic specification of the response might not ceptual and visuomotor systems, consistent with the
yet have been complete. In other words, response perception–action model (Goodale and Milner, 1992,
selection and response specification might proceed 2004; Milner and Goodale, 1995; Goodale and
in a parallel manner, and there could even be an Humphrey, 1998).
278

A number of recent findings, however, have object size are based on a computation of extent.
challenged the notion that perceptual illusions do According to this view, dissociations between judg-
not impact the control of object-directed actions. ment and action occur because pictorial size illusions
These challenges fall into several categories from affect the perception of extent but not location (Mack
non-replication (Franz et al., 2000), to the contention et al., 1985). Although reasonable, this argument is
that early studies did not adequately match action difficult to separate from Goodale and Milner’s
and perception tasks for various input, attention original proposal (Goodale and Milner, 1992, 2004;
and output demands (Vishton et al., 1999; Bruno, Milner and Goodale, 1995), that the visuomotor
2001; Smeets and Brenner, 2001), or the idea that system computes absolute (i.e., Euclidean) object
action tasks involve multiple stages of processing metrics whereas the perceptual system utilizes scene-
from purely perceptual to more ‘‘automatic’’ visuo- based (i.e., non-Euclidean) metrics.
motor control (Glover and Dixon, 2001; Glover, Glover and colleagues (Glover and Dixon, 2001;
2002, 2004). Most of these challenges can readily be Glover, 2002, 2004) have reported that visual illu-
accommodated within the basic framework of the sions have a larger effect on the early rather than late
perception–action hypothesis, yet each provides stages of action, suggesting that on-line movement
important new insight into the nature of the proces- control is refractory to perception whereas movement
sing mechanisms underlying perception versus action. planning is not. Recent attempts to replicate these
Franz and colleagues (Franz et al., 2000), have findings using conventional tasks and data analyses
failed to replicate the early results of Aglioti et al. have failed (Danckert et al., 2002; Franz, 2003), and
(1995), and have argued that visually guided actions neuropsychological evidence does not support the
and perceptual judgments are mediated by the same contention that the early and late stages of actions
underlying visual processing mechanisms. Such an access different visual processing (Milner et al., 2003).
account, however, cannot explain why the majority Nevertheless, there is good reason to believe that
of illusion studies find evidence for a dissociation perceptual mechanisms are important for the guid-
between perception and action (Carey, 2001). Nor can ance of action in clearly circumscribed situations;
it explain the dissociations observed in patients Glover’s notion of ‘‘action-planning’’ can be easily
with optic ataxia or visual form agnosia — nor for subsumed under this framework.
that matter, the extensive neurophysiological and Two recent lines of evidence have helped to clarify
behavioral work on the ventral and dorsal streams the relation between object perception and object-
in the macaque monkey that supports a distinction directed action in the context of visual illusions. Dyde
between vision-for-perception and vision-for-action and Milner (2002) showed that the orientation of
(Goodale and Milner, 1992, 2004; Milner and the grasping hand is sensitive to a simultaneous
Goodale, 1995; Goodale and Humphrey, 1998). One tilt (ST) illusion — similar to that used by Glover
possible reason that Franz et al. find an effect on and colleagues (Glover and Dixon, 2001), but not a
grasping with the Ebbinghaus illusion is that, depend- rod-and-frame (RF) illusion, even though the two
ing on the particular arrangement of the illusory visual displays have equivalent effects on judgments
display, the visuomotor system can sometimes treat of target orientation. Dyde and Milner (2002), argue
the surrounding disks as obstacles. As a consequence that the sensitivity of action to a perceptual illusion
grip aperture may be affected by the display, not can be understood in terms of the illusion’s presumed
because of a perceived illusion, but because the neural origins. Illusions that presumably arise from
visuomotor system is attempting to avoid having ‘‘early’’ (i.e., area V1, area V2) stages of visual pro-
the fingers collide with an apparent obstacle near the cessing, such as the ST illusion, should affect both
target (Haffenden and Goodale, 2000; Haffenden action and perception since the dorsal and ventral
et al., 2001; de Grave et al., 2004). visual pathways share this input (Milner and Dyde,
Smeets and colleagues (Smeets and Brenner, 2001; 2003). Illusions like the RF that presumably arise
Smeets et al., 2002), have argued that the control from later stages of processing (i.e., in inferotemporal
of grasping is based on the computed locations of cortex) should not affect action, since the dorsal
points on the object’s surface, whereas judgments of stream does not have direct access to this processing.
279

Similar accounts have been put forward to explain information that allows us to choose goals and plan
the fact that there are reliable directional anisotropies courses of action. When it comes time to implement
in the perception of the direction of motion even a chosen course of action, however, dedicated visuo-
though such anisotropies are not present in smooth motor mechanisms in the dorsal stream are engaged
pursuit eye movements (Churchland et al., 2003), to transform current visual information about the
and the observation that fast reaching movements goal object into a calibrated motor response. But
are sensitive to target mislocalization errors induced actions whose goal is a remembered rather than a
by distant visual motion signals (Whitney et al., visible object must make use of perceptual processing
2003). in the ventral stream.
A number of recent studies have highlighted the But one of the important issues that remain to
importance of timing in determining whether or not be solved is how the two visual streams work together
perceptual illusions will affect action. Thus, percep- in the control of our behavior. For example, once
tual illusions have been shown to influence the control a target has been identified using ventral stream
of actions when the programming of those actions processing, how is this information communicated
is based on a memory of the target stimuli (Wong to the visuomotor systems in the dorsal stream?
and Mack, 1981; Gentilucci et al., 1996; Bridgeman One suggestion has been that the communication
et al., 1997; Rossetti, 1998; Hu and Goodale, 2000; involves the prominent recurrent projections that
Westwood et al., 2000a,b). These findings are con- could convey a focus of activity in the ventral
sistent with the argument developed earlier that the stream back to primary visual cortex and other
control of action after a delay depends upon a early visual areas (Lamme and Roelfsema, 2000).
memory trace of the target object that was originally If a target has been ‘‘flagged’’ on retinotopic maps in
delivered by the perceptual mechanisms in the ventral these early visual areas by recurrent projections, the
stream. Recently, Westwood and Goodale (2003) location of that target can then be relayed to the
found that a size-contrast illusion influenced grip dorsal stream for action. There is certainly evidence
aperture when vision of the target was occluded from single-unit studies that when a monkey pays
at the moment the response was cued; in contrast, attention to a visual stimulus in a particular loca-
the illusion did not have any effect on grip aperture on tion, the activity of neurons corresponding to that
other trials in which target vision was not occluded location is enhanced in early visual areas, including
until the movement was initiated. In other words, primary visual cortex (Super et al., 2001). The actual
if vision was available during the programming of shifting of attention from one stimulus to another
the movement, grip aperture reflected the real not the may involve mechanisms in the dorsal stream,
apparent size of the target. This finding underscores particularly area LIP. This region, which has
once more the idea that the visuomotor networks been shown to be involved in the voluntary control
in the dorsal stream operate in real time and are not of saccadic eye movements to visual targets, has
engaged unless the target object is visible at the exact been implicated in the shifting of attention to bio-
moment the response is required. logically important or salient visual stimuli (Bisley
and Goldberg, 2003). But again it is not clear how
the loop is closed so that attention is shifted to the
Future directions ‘‘right’’ stimulus and remains there. Nevertheless, the
answers to these questions will no doubt emerge
Evidence from a wide range of studies continues to over the next few years as methods and theory-
support and extend the idea that the dorsal and building in visual neuroscience will become more
ventral streams of visual processing play different and more sophisticated. In particular, transcranial
but complementary roles in the control of action. magnetic stimulation (TMS) promises to be a valu-
Perceptual mechanisms in the ventral stream allow us able tool in this endeavor, since it can be used to
to recognize objects and access the semantic knowl- disrupt the transmission of information between
edge necessary to appreciate their causal relations; brain regions in a precisely controlled temporal
as such, these ventral stream mechanisms deliver the manner.
280

References awareness. A study in normal subjects. Brain, 114:


2639–2655.
Aglioti, S., DeSouza, J.F. and Goodale, M.A. (1995) Size- Churchland, A.K., Gardner, J.L., Chou, I., Priebe, N.J. and
contrast illusions deceive the eye but not the hand. Curr. Lisberger, S.G. (2003) Directional anisotropies reveal a
Biol., 5: 679–685. functional segregation of visual motion processing for
Andersen, R.A. (1987) Inferior parietal lobule function in perception and action. Neuron, 37: 1001–1011.
spatial perception and visuomotor integration. In: Cohen, Y.E. and Andersen, R.A. (2002) A common reference
Mountcastle, V.B, Plum, F. and Geiger, S.R. (Eds.), frame for movement plans in the posterior parietal cortex.
Handbook of Physiology Section 1: The Nervous System, Nat. Rev. Neurosci., 3: 553–562.
Volume V: Higher Functions of the Brain, Part 2, Amer. Craighero, L., Fadiga, L., Umilta, C.A. and Rizzolatti, G.
Physiol. Assoc., Bethesda MD, pp. 483–518. (1996) Evidence for visuomotor priming effect. Neuroreport,
Andersen, R.A. and Buneo, C.A. (2003) Sensorimotor integra- 8: 347–349.
tion in posterior parietal cortex. Adv. Neurol., 93: 159–177. Creem, S.H. and Proffitt, D.R. (2001) Grasping objects by their
Bálint, R. (1909) Seelenlämung des ‘‘Schauens’’, optische handles: A necessary interaction between cognition and
Ataxie, räumliche Störung der Aufmerksamkeit. Monatsch. action. J. Exp. Psychol. Hum. Percept. Perform, 27: 218–228.
Psychiatr. Neurolog., 25: 51–81. Culham, J. (2004) Human brain imaging reveals a parietal area
Biederman, I. and Gerhardstein, P.C. (1993) Recognizing specialized for grasping. In: Kanwisher, N. and Duncan, J.
depth-rotated objects: Evidence and conditions for three- (Eds.), Attention and Performance XX. Functional
dimensional viewpoint invariance. J. Exp. Psychol. Hum. Neuroimaging of Visual Cognition, Oxford University
Percept. Perform, 19: 1162–1182. Press, Oxford, pp. 415–436.
Binkofski, F., Dohle, C., Posse, S., Stephan, K.M., Hefter, H., Culham, J.C. and Kanwisher, N.G. (2001) Neuroimaging of
Seitz, R.J. and Freund, H.J. (1998) Human anterior cognitive functions in human parietal cortex. Curr. Opin.
intraparietal area subserves prehension: A combined lesion Neurobiol., 11: 157–163.
and functional MRI activation study. Neurology, 50: Culham, J.C., Danckert, S.L., De Souza, J.F., Gati, J.S.,
1253–1259. Menon, R.S. and Goodale, M.A. (2003) Visually guided
Bisley, J.W. and Goldberg, M.E. (2003) The role of the parietal grasping produces fMRI activation in dorsal but not ventral
cortex in the neural processing of saccadic eye movements. stream brain areas. Exp. Brain Res., 153: 180–189.
Adv. Neurol., 93: 141–157. Danckert, J.A., Sharif, N., Haffenden, A.M., Schiff, K.C. and
Bridgeman, B., Lewis, S., Heit, G. and Nagle, M. (1979) Goodale, M.A. (2002) A temporal analysis of grasping in the
Relation between cognitive and motor-oriented systems of
Ebbinghaus illusion: Planning versus online control. Exp.
visual position perception. J. Exp. Psychol. Hum. Percept.
Brain Res., 144: 275–280.
Perform, 5: 692–700.
de Grave, D.D.J., Biegstraaten, M., Brenner, E. and
Bridgeman, B., Kirch, M. and Sperling, A. (1981) Segregation
Smeets, J.B.J. (2004). The Ebbinghaus figure is more than a
of cognitive and motor aspects of visual function using
size illusion [Abstract]. J. Vision, 4:836a.
induced motion. Percept. Psychophys., 29: 336–342.
Desmurget, M., Epstein, C.M., Turner, R.S., Prablanc, C.,
Bridgeman, B., Peery, S. and Anand, S. (1997) Interaction of
Alexander, G.E. and Grafton, S.T. (1999) Role of the
cognitive and sensorimotor maps of visual space. Percept.
posterior parietal cortex in updating reaching movements to
Psychophys., 59: 456–469.
a visual target. Nat. Neurosci., 2: 563–567.
Brown, L.E., Moore, C.M. and Rosenbaum, D.A. (2002)
Desmurget, M., Grea, H., Grethe, J.S., Prablanc, C.,
Feature-specific perceptual processing dissociates action
from recognition. J. Exp. Psychol. Hum. Percept. Perform, Alexander, G.E. and Grafton, S.T. (2001) Functional
28: 1330–1344. anatomy of nonvisual feedback loops during reaching:
Bruno, N. (2001) When does action resist visual illusions? A positron emission tomography study. J. Neurosci., 21:
Trends Cogn. Sci., 5: 379–382. 2919–2928.
Burr, D.C., Morrone, M.C. and Ross, J. (2001) Separate visual Dubrowski, A. and Carnahan, H. (2002) Action-perception
representations for perception and action revealed by dissociation in response to target acceleration. Vision Res.,
saccadic eye movements. Curr. Biol., 11: 798–802. 42: 1465–1473.
Cant, J.S., Westwood, D.A., Valyear, K.F. and Goodale, M.A. Dyde, R.T. and Milner, A.D. (2002) Two illusions of perceived
(2005) No evidence for visuomotor priming in a visually orientation: One fools all of the people some of the time; the
guided action task. Neuropsychologia, 43: 216–226. other fools all of the people all of the time. Exp. Brain Res.,
Carey, D.P. (2001) Do action systems resist visual illusions? 144: 518–527.
Trends Cogn. Sci., 5: 109–113. Ettlinger, G. (1977) Parietal cortex in visual orientation. In:
Castiello, U., Paulignan, Y. and Jeannerod, M. (1991) Tem- Rose, F.C. (Ed.), Physiological Aspects of Clinical
poral dissociation of motor responses and subjective Neurology, Blackwell, Oxford, pp. 93–100.
281

Fecteau, J.H., Chua, R., Franks, I. and Enns, J.T. (2001) Visual Gross, C.G., Rocha-Miranda, C.E. and Bender, D.B. (1972)
awareness and the on-line modification of action. Can. J. Visual properties of neurons in inferotemporal cortex of the
Exp. Psychol., 55: 104–110. Macaque. J. Neurophysiol., 35: 96–111.
Franz, V.H. (2003). Planning versus online control: dynamic Guillery, R.W. (2003) Branching thalamic afferents link action
illusion effects in grasping? Spat. Vis., 16:211–223.. and perception. J. Neurophysiol., 90: 539–548.
Franz, V.H., Gegenfurtner, K.R., Bulthoff, H.H. and Fahle, M. Haffenden, A.M. and Goodale, M.A. (1998) The effect of
(2000) Grasping visual illusions: No evidence for a dissocia- pictorial illusion on prehension and perception. J. Cogn.
tion between perception and action. Psychol. Sci., 11: 20–25. Neurosci., 10: 122–136.
Gallese, V., Murata, A., Kaseda, M., Niki, N. and Sakata, H. Haffenden, A.M. and Goodale, M.A. (2000) Independent
(1994) Deficit of hand preshaping after muscimol injection in effects of pictorial displays on perception and action.
monkey parietal cortex. Neuroreport, 5: 1525–1529. Vision Res., 40: 1597–1607.
Ganel, T. and Goodale, M.A. (2003) Visual control of action Haffenden, A.M., Schiff, K.C. and Goodale, M.A. (2001)
but not perception requires analytical processing of object The dissociation between perception and action in the
shape. Nature, 426: 664–667. Ebbinghaus illusion: Nonillusory effects of pictorial cues on
Garofeanu, C., Króliczak, G., Goodale, M.A. and Humphrey, grasp. Curr. Biol., 11: 177–181.
G.K. (2004) Naming and grasping common objects: Hasson, U., Harel, M., Levy, I. and Malach, R. (2003) Large-
A priming study. Exp. Brain Res., 159: 55–64. scale mirror-symmetry organization of human occipito-
Gentilucci, M., Chieffi, S., Deprati, E., Saetti, M.C. and Toni, I. temporal object areas. Neuron, 37: 1027–1041.
(1996) Visual illusion and action. Neuropsychologia, 34: Henriques, D.Y., Medendorp, W.P., Khan, A.Z. and
369–376. Crawford, J.D. (2002) Visuomotor transformations for eye-
Glickstein, M., Buchbinder, S. and May 3rd, J.L. (1998) Visual hand coordination. Prog. Brain Res., 140: 329–340.
control of the arm, the wrist and the fingers: Pathways Hu, Y. and Goodale, M.A. (2000) Grasping after a delay
through the brain. Neuropsychologia, 36: 981–1001. shifts size-scaling from absolute to relative metrics. J. Cogn.
Glover, S. (2002) Visual illusions affect planning but not Neurosci., 12: 856–868.
control. Trends Cogn. Sci., 6: 288–292. Hyvärinen, J. and Poranen, A. (1974) Function of the parietal
Glover, S. (2004) Separate visual representations in the associative area 7 as revealed from cellular discharges in alert
planning and control of action. Behav. Brain Sci., 27: 3–78. monkeys. Brain, 97: 673–692.
Glover, S.R. and Dixon, P. (2001) Dynamic illusion effects in James, T.W., Culham, J., Humphrey, G.K., Milner, A.D. and
a reaching task: Evidence for separate visual representations Goodale, M.A. (2003) Ventral occipital lesions impair object
in the planning and control of reaching. J. Exp. Psychol. recognition but not object-directed grasping: An fMRI study.
Hum. Percept. Perform, 27: 560–572. Brain, 126: 2463–2475.
Goodale, M.A., Pelisson, D. and Prablanc, C. (1986) Large James, T.W., Humphrey, G.K., Gati, J.S., Menon, R.S. and
adjustments in visually guided reaching do not depend on Goodale, M.A. (2002) Differential effects of viewpoint on
vision of the hand or perception of target displacement. object-driven activation in dorsal and ventral streams.
Nature, 320: 748–750. Neuron, 35: 793–801.
Goodale, M.A., Milner, A.D., Jakobson, L.S. and Carey, D.P. Janssen, P., Vogels, R. and Orban, G.A. (1999) Macaque
(1991) A neurological dissociation between perceiving objects inferior temporal neurons are selective for disparity-
and grasping them. Nature, 349: 154–156. defined three–dimensional shapes. Proc. Natl. Acad. Sci.,
Goodale, M.A. and Milner, A.D. (1992) Separate visual 96: 8217–8222.
pathways for perception and action. Trends Neurosci., 15: Janssen, P., Vogels, R. and Orban, G.A. (2000) Selectivity for
20–25. 3D shape that reveals distinct areas within macaque inferior
Goodale, M.A., Jakobson, L.S. and Keillor, J.M. (1994) temporal cortex. Science, 288: 2054–2056.
Differences in the visual control of pantomimed and natural Jeannerod, M. and Farne, A. (2003) The visuomotor functions
grasping movements. Neuropsychologia, 32: 1159–1178. of posterior parietal areas. Adv. Neurol., 93: 205–217.
Goodale, M.A. and Humphrey, G.K. (1998) The objects of Kerzel, D. and Gegenfurtner, K.R. (2003) Neuronal processing
action and perception. Cognition., 67: 181–207. delays are compensated in the sensorimotor branch of the
Goodale, M.A. and Milner, A.D. (2004). Sight Unseen: An visual system. Curr. Biol., 13: 1975–1978.
Exploration of Conscious and Unconscious Vision. Oxford: Lamme, V.A. and Roelfsema, P.R. (2000) The distinct modes
Oxford Univ. Press. of vision offered by feedforward and recurrent processing.
Goodale, M.A., Westwood, D.A. and Milner, A.D. (2003) Trends Neurosci., 23: 571–579.
Two distinct modes of control for object-directed action. Le, S., Cardebat, D., Boulanouar, K., Henaff, M.A., Michel,
Prog. Brain Res., 144: 131–144. F., Milner, D., Dijkerman, C., Puel, M. and Demonet, J.F.
Grill-Spector, K. (2003) The neural basis of object perception. (2002) Seeing, since childhood, without ventral stream:
Curr. Opin. Neurobiol., 13: 159–166. a behavioral study. Brain, 125: 58–74.
282

Lebedev, M.A., Douglass, D.K., Moody, S.L. and Wise, S.P. Pascual-Leone, A., Walsh, V. and Rothwell, J. (2000)
(2001) Prefrontal cortex neurons reflecting reports of a visual Transcranial magnetic stimulation in cognitive neuroscience–
illusion. J. Neurophysiol., 85: 1395–1411. virtual lesion, chronometry, and functional connectivity. Curr.
Lee, J.H. and van Donkelaar, P. (2002) Dorsal and ventral Opin. Neurobiol., 10: 232–237.
visual stream contributions to perception-action interactions Perenin, M.-T. and Vighetto, A. (1988) Optic ataxia: A specific
during pointing. Exp. Brain Res., 143: 440–446. disruption in visuomotor mechanisms. I. Different aspects
Leon, M.I. and Shadlen, M.N. (2003) Representation of time of the deficit in reaching for objects. Brain, 111: 643–674.
by neurons in the posterior parietal cortex of the macaque. Perrett, D., Benson, P.J., Hietanen, J.K., Oram, M.W.
Neuron, 38: 317–327. and Dittrich, W.H. (1995) When is a face not a face?
Logothetis, N.K. (1998) Single units and conscious vision. In: Gregory, R., Harris, J., Heard, P. and Rose, D.
Philos. Trans. R Soc. Lond. B Biol. Sci., 353: 1801–1818. (Eds.), The Artful Eye, Oxford University Press, Oxford,
Logothetis, N.K., Pauls, J. and Poggio, T. (1995) Shape U.K., pp. 95–124.
representation in the inferior temporal cortex of monkeys. Pisella, L., Grea, H., Tilikete, C., Vighetto, A., Desmurget, M.,
Curr. Biol., 5: 552–563. Rode, G., Boisson, D. and Rossetti, Y. (2000) An ‘‘automatic
Logothetis, N.K. and Sheinberg, D.L. (1996) Visual object pilot’’ for the hand in human posterior parietal cortex:
recognition. Ann. Rev. Neurosci., 19: 577–621.
Toward reinterpreting optic ataxia. Nat. Neurosci., 3:
Mack, A., Heuer, F., Villardi, K. and Chambers, D. (1985) The
729–736.
dissociation of position and extent in Muller-Lyer figures.
Revol, P., Rossetti, Y., Vighetto, A., Rode, G., Boisson, D. and
Percept. Psychophys., 37: 335–344.
Pisella, L. (2003) Pointing errors in immediate and delayed
Malach, R., Reppas, J.B., Benson, R.R., Kwong, K.K.,
conditions in unilateral optic ataxia. Spat. Vis., 16: 347–364.
Jiang, H., Kennedy, W.A., Ledden, P.J., Brady, T.J.,
Rizzolatti, G. and Matelli, M. (2003) Two different streams
Rosen, B.R. and Tootell, R.B. (1995) Object-related
form the dorsal visual system: Anatomy and function. Exp.
activity revealed by functional magnetic resonance imaging
Brain Res., 153: 146–157.
in human occipital cortex. Proc. Natl. Acad. Sci. USA,
Rossetti, Y., Pisella, L. and Vighetto, A. (2003) Optic ataxia
92: 8135–8139.
revisited: Visually guided action versus immediate visuomo-
Milner, A.D., Perrett, D.I., Johnston, R.S., Benson, P.J.,
tor control. Exp. Brain Res., 153: 171–179.
Jordan, T.R., Heeley, D.W., Bettucci, D., Mortara, F.,
Sakata, H. (2003) The role of the parietal cortex in grasping.
Mutani, R., Terazzi, E. and Davidson, D.L.W. (1991)
Adv. Neurol., 93: 121–139.
Perception and action in ‘‘visual form agnosia’’. Brain, 114:
Sakata, H. and Taira, M. (1994) Parietal control of hand
405–428.
action. Curr. Opin. Neurobiol., 4: 847–856.
Milner, A.D., Dijkerman, H.C., McIntosh, R.D., Pisella, L.
Schacter, D. and Buckner, R. (1998) Priming and the brain.
and Rossetti, Y. (2003) Delayed reaching and grasping
Neuron, 20: 185–195.
in patients with optic ataxia. Prog. Brain Res., 142: 225–242.
Sereno, A.B. and Maunsell, J.H. (1998) Shape selectivity in
Milner, D. and Dyde, R. (2003) Why do some perceptual
illusions affect visually guided action, when others don’t? primate lateral intraparietal cortex. Nature, 395: 500–503.
Trends Cogn. Sci., 7: 10–11. Shadlen, M.N. and Newsome, W.T. (2001) Neural basis of
Milner, A.D. and Goodale, M.A. (1995). The Visual Brain in a perceptual decision in the parietal cortex (area LIP) of the
Action. Oxford Univ Press, Oxford. rhesus monkey. J. Neurophysiol., 86: 1916–1936.
Milner, A.D., Paulignan, Y., Dijkerman, H.C., Michel, F. and Simon, O., Mangin, J.F., Cohen, L., Le Bihan, D. and
Jeannerod, M. (1999) A paradoxical improvement of Dehaene, S. (2002) Topographical layout of hand, eye,
misreaching in optic ataxia: New evidence for two separate calculation, and language-related areas in the human parietal
neural systems for visual localization. Proc. R Soc. Lond. B lobe. Neuron, 33: 475–487.
Biol. Sci., 266: 2225–2229. Smeets, J.B.J. and Brenner, E. (2001). Action beyond our
Milner, A.D., Dijkerman, H.C., Pisella, L., McIntosh, R.D., grasp. Trends Cogn. Sci., 5: 287.
Tilikete, C., Vighetto, A. and Rossetti, Y. (2001) Grasping Smeets, J.B., Brenner, E., de Grave, D.D. and Cuijpers, R.H.
the past. Delay can improve visuomotor performance. Curr. (2002) Illusions in action: Consequences of inconsistent
Biol., 11: 1896–1901. processing of spatial attributes. Exp. Brain. Res., 147:
Miyashita, Y and Hayashi, T. (2000) Neural representation of 135–144.
visual objects: Encoding and top-down activation. Curr. Snyder, L.H., Batista, A.P. and Andersen, R.A. (1997) Coding
Opin. Neurobiol., 10: 187–194. of intention in the posterior parietal cortex. Nature, 386:
Mountcastle, V.B., Lynch, J.C., Georgopoulos, A., Sakata, H. 167–170.
and Acũna, C. (1975) Posterior parietal association cortex of Super, H., Spekreijse, H. and Lamme, V.A. (2001) Two distinct
the monkey: Command functions for operations within modes of sensory processing observed in monkey primary
extrapersonal space. J. Neurophysiol., 38: 871–908. visual cortex(V1). Nat. Neurosci., 4: 304–310.
283

Rossetti, Y. (1998) Implicit short-lived motor representations cal motion perception in humans. Proc. Natl. Acad. Sci.
of space in brain damaged and healthy subjects. Conscious. USA, 98: 11656–11661.
Cogn., 7: 520–558. Vishton, P.M., Rea, J.G., Cutting, J.E. and Nunez,
Taira, M., Mine, S., Georgopoulos, A.P., Murata, A. and L.N. (1999) Comparing effects of the horizontal-
Sakata, H. (1990) Parietal cortex neurons of the monkey vertical illusion on grip scaling and judgment:
related to the visual guidance of hand movement. Exp. Brain Relative versus absolute, not perception versus action.
Res., 83: 29–36. J. Exp. Psychol. Hum. Percept. Perform., 25:
Tanaka, K. (2003) Columns for complex visual object features 1659–1672.
in the inferotemporal cortex: Clustering of cells with similar Westwood, D.A., Chapman, C.D. and Roy, E.A. (2000)
but slightly different stimulus selectivities. Cereb. Cortex, 13: Pantomimed actions may be controlled by the ventral visual
90–99. stream. Exp. Brain Res., 130: 545–548.
Tanaka, K., Saito, H., Fukada, Y. and Moriya, M. (1991) Westwood, D.A., Heath, M. and Roy, E.A. (2000) The effect
Coding visual images of objects in the inferotemporal cortex of a pictorial illusion on closed-loop and open-loop prehen-
of the macaque monkey. J. Neurophysiol., 66: 170–189. sion. Exp. Brain Res., 134: 456–463.
Thompson-Schill, S.L. and Gabrieli, J.D.E. (1999) Priming Westwood, D.A. and Goodale, M.A. (2003) Perceptual
of visual and functional knowledge on a semantic classifica- illusion and the real-time control of action. Spat. Vis., 16:
tion task. J. Exp. Psychol. Learn Mem. Cogn., 25: 41–53. 243–254.
Toth, L.J. and Assad, J.A. (2002) Dynamic coding of Whitney, D., Westwood, D.A. and Goodale, M.A. (2003) The
behaviorally relevant stimuli in parietal cortex. Nature, influence of visual motion on fast reaching movements to
415: 165–168. a stationary object. Nature, 423: 869–873.
Vaina, L.M., Solomon, J., Chowdhury, S., Sinha, P. and Wong, E. and Mack, A. (1981) Saccadic programming and
Belliveau, J.W. (2001) Functional neuroanatomy of biologi- perceived location. Acta Psychol., 48: 123–131.

You might also like