Professional Documents
Culture Documents
Chapter 23
Abstract
In 1992, Goodale and Milner proposed a division of labor in the visual pathways of the primate cerebral
cortex. According to their account, the ventral pathway, which projects to occipitotemporal cortex, con-
structs our visual percepts, while the dorsal pathway, which projects to posterior parietal cortex, mediates
the visual control of action. Although the framing of the two-visual-system hypothesis has not been with-
out controversy, it is clear that vision for action and vision for perception have distinct computational
requirements, and significant support for the proposed neuroanatomic division has continued to emerge
over the last two decades from human neuropsychology, neuroimaging, behavioral psychophysics, and
monkey neurophysiology. In this chapter, we review much of this evidence, with a particular focus on
recent findings from human neuroimaging and monkey neurophysiology, demonstrating a specialized role
for parietal cortex in visually guided behavior. But even though the available evidence suggests that ded-
icated circuits mediate action and perception, in order to produce adaptive goal-directed behavior there
must be a close coupling and seamless integration of information processing across these two systems.
We discuss such ventral–dorsal-stream interactions and argue that the two pathways play different, yet
complementary, roles in the production of skilled behavior.
1
Abbreviations used in the chapter are listed at the end of the chapter before References section.
*Correspondence to: Melvyn A. Goodale, Department of Psychology, Brain and Mind Institute, University of Western Ontario,
London, Ontario, Canada N6A 5B7. Tel: +1-519-661-2070, E-mail: mgoodale@uwo.ca
450 J.P. GALLIVAN AND M.A. GOODALE
adjunct to visual perception, it is only relatively recently respect to the particular effectors being used to perform
in the august history of vision science that researchers the action). In fact, very often such computations would
have turned their attention to the role of vision in the pro- be counterproductive because our viewpoint with respect
gramming and control of our actions, particularly the to objects, as noted above, rarely remains the same from
movements of our hands and limbs. One reason why one moment to the next. Instead, it changes constantly as
the visual control of action has been ignored for so long we move through our environment, even though our per-
is the prevalent belief that the same visual representation ceptual representations of those objects typically show
that enables us to perceive our environment also guides constancy; i.e., we continue to see them as having the
our actions in that environment. Indeed, visual percep- same size, shape, and location even though our view-
tion is so directly linked to our conscious experience that point might change dramatically.
it is difficult to imagine that a separate visual system Indeed, for the purposes of perception, one can argue
might underlie our interactions with our surroundings. that it would be better to encode the size, orientation, and
As we will outline in this chapter, however, evidence location of objects relative to others in the scene, even
from a broad range of studies shows that vision is not though the projection of the images of those objects on
a unitary system. Rather, the control of skilled actions our retinas will vary as we move around. Such a
depends on visual processes and neural mechanisms that scene-based frame of reference permits a perceptual rep-
are quite separate from those mediating perception and resentation of objects that transcends particular view-
awareness. points, and at the same time preserves information
about their spatial relationships (as well as their relative
sizes and orientations) as the observer moves around. To
DIFFERENCES IN THE
do this, some of the brain networks underlying percep-
COMPUTATIONAL REQUIREMENTS
tion might use an array of viewer-centered representa-
FOR VISUOMOTOR CONTROL AND
tions of the same object; others might use canonical
VISUAL PERCEPTION
representations; still others might be truly “object-
To understand why the visual mechanisms mediating the centered” (Riesenhuber and Poggio, 2000; for a discus-
control of action are different from those mediating per- sion of these issues, see Biederman, 2000; Hummel,
ception, it is first necessary to consider differences in 2013). But whatever the particular coding might be, it
their computational requirements, i.e., differences in is the identity of the object, not its disposition with
the way in which visual input is transformed for perform- respect to the observer, that is of primary concern to
ing an action versus the way in which it is transformed for the perceptual system. The products of perception, like
constructing a percept. The visual information required object recognition and identity, also need to be available
for the guidance of skilled actions must reflect the real over a much longer timescale than the visual information
metrics of the world and be effector-specific. In the case used in the control of action. Thus, by working with per-
of grasping, for example, the location and disposition of ceptual representations that are object- or scene-based,
the goal object must be computed with respect to the we are able to maintain the constancies of size, shape,
hand, or, at the very least, be selected from learned color, lightness, and relative location, over time and
“look-up tables” that link neurons coding a particular across different viewing conditions.
set of visual inputs with neurons that code the desired
state of the grasping hand (for discussion of these issues,
TWO VISUAL SYSTEMS
see Thaler and Goodale, 2010; Goodale, 2011). More-
over, the time at which these computations are performed In 1992 Goodale and Milner suggested that these differ-
is equally critical. Actors and goal objects rarely stay in a ences in the required computations for visual perception
static relationship with one another and, as a conse- and the visual control of action led to the emergence of
quence, the location and disposition of a target object separate visual pathways in the primate cerebral cortex:
with respect to the limb can change radically from a ventral visual stream projecting from early visual areas
moment to moment. In order to deal with these constantly to inferotemporal cortex that mediates our perception of
changing situations, “just-in-time” computations are the world, and a dorsal visual stream projecting to the
required: the required coordinates for action need to be posterior parietal cortex (PPC), that mediates the visual
computed at the very moment the movements are per- control of action (Fig. 23.1). According to their two-
formed and dynamically updated in an “online” fashion visual-systems account of visual function, the identifica-
as the movement unfolds. tion and selection of goal objects and an appropriate
In contrast to visuomotor control, visual perception course of action depend on the perceptual machinery
does not need to deal with the absolute size of objects of the ventral stream and associated cognitive modules
or their egocentric locations (i.e., their locations with in the temporal and frontal lobes, whereas the execution
THE DORSAL “ACTION” PATHWAY 451
the role of the dorsal stream in the visual control of
action, but will also touch on some of the contributions
of the ventral stream. But first, we briefly review the early
work on neurologic patients that drove the initial concep-
tion of the two-visual-systems model.
Fig. 23.2. Difference in brain damage and preserved function between an optic ataxic and visual form agnosic patient. Brain
images (top) highlight lesion differences between patient R.V., an individual with optic ataxia (left; from Goodale MA,
Meenan JP, Bulthoff HH, et al. (1994) Separate neural pathways for the visual analysis of object shape in perception and prehen-
sion. Curr Biol 4: 604–610), and patient D.F., an individual with visual form agnosia (right; from James TW, Culham J, Humphrey
GK, et al. (2003) Ventral occipital lesions impair object recognition but not object-directed grasping: an fMRI study. Brain 126:
2463–2475, with permission from Oxford University Press). Pink coloring highlights the lesioned areas in each individual. The
graphs (bottom) show the size of the aperture between the index finger and thumb during object-directed grasping and manual
estimates of object width for R.V. (left) and D.F. (right). The left panel shows that R.V. was able to indicate the size of the objects
reasonably well (individual trials marked as open diamonds), but her maximum grip aperture in flight did not show appropriate
object scaling. She simply opened her hand as wide as possible on every trial. In contrast, the right panel shows that D.F. exhibited
excellent grip scaling, opening her hand wider for the 50-mm-wide object than for the 25-mm-wide object. D.F.’s manual estimates
of the width of the two objects, however, were grossly inaccurate and showed enormous variability from trial to trial.
damage consistent with hypoxia, most of the damage hand opens wider midflight for wider objects than it does
early on was evident in ventrolateral regions of the occip- for narrower ones, just like it does in people with normal
ital cortex, with V1 remaining largely spared (Fig. 23.2). vision (Fig. 23.2). Similarly, she rotates her hand and
More recent high-resolution MRI scans confirmed wrist appropriately when she reaches out to grasp objects
this damage, but revealed that her ventral-stream lesions in different orientations, and she places her fingers cor-
are focused in a region of the lateral occipital cortex (area rectly on the surface of objects with different shapes.
LO), that we now know is involved in the visual recog- At the same time, she is quite unable to distinguish
nition of objects, particularly their geometric structure between any of these objects when they are presented
(James et al., 2003). Even though DF’s “low-level” to her in simple discrimination tests. She even fails in
visual abilities are reasonably intact, she can no longer manual matching tasks in which she is asked to show
recognize everyday objects or the faces of her friends how wide an object is by opening her index finger and
and relatives; nor can she identify even the simplest of thumb a corresponding amount.
geometric shapes. (If an object is placed in her hand, DF’s spared visuomotor skills are not limited to grasp-
of course, she has no trouble identifying it by touch.) ing. She can step over obstacles during locomotion as well
Remarkably, however, DF shows strikingly accurate as control subjects, even though her perceptual judgments
guidance of her hand movements when she attempts to about the height of those obstacles are far from normal.
pick up the very objects she cannot identify. Thus, when Contrary to what would be predicted from the “what vs.
she reaches out to grasp objects of different widths, her where” hypothesis (Ungerleider and Mishkin, 1982),
THE DORSAL “ACTION” PATHWAY 453
a profound loss of form perception coexists in DF with a and/or grasping movements to objects whose form and
preserved ability to use form in guiding a broad range of orientation they can perceive. This double dissociation
actions. Such a dissociation, of course, is consistent with is consistent with the division of labor between percep-
the idea that there are separate neural pathways for trans- tion and action first proposed by Goodale and Milner
forming incoming visual information for the perceptual (1992). While the aforementioned patient work does well
representation of the world versus for the control of in describing the consequences of damage to the separate
action. Presumably it is the former and not the latter that pathways for perception and action, some of the most
is compromised in DF (for more details, see Goodale convincing evidence for the perception–action proposal
and Milner, 2004; Milner and Goodale, 2006). It appears has come from neurophysiologic studies of the dorsal
that the selective damage to area LO has disrupted DF’s and ventral streams in nonhuman primates and functional
ability to perceive the form of objects. These lesions have MRI (fMRI) studies in the human. In the following sec-
not interfered with her ability to use visual information tions, we briefly review the functional organization of the
about form to shape her hand when she reaches out and visuomotor control networks in the primate brain, focus-
grasps objects – presumably because the visuomotor net- ing largely on the dorsal stream.
works in her dorsal stream that mediate grasping are largely
spared, with damage restricted to the most posterior part
FUNCTIONAL ORGANIZATION OF THE
of the parieto-occipital cortex (Whitwell et al., 2014).
DORSAL PATHWAY IN HUMANS AND
Since the original work on DF, other patients with
NONHUMAN PRIMATES
ventral-stream damage have been identified who show
strikingly similar dissociations between vision for per- Although there has been much debate about the precise
ception and vision for action. Patient SB, who suffered nature of the underlying computations, the roles of pri-
severe bilateral damage to his ventral stream early in life, mary and secondary motor areas in frontal cortex in
shows remarkably preserved visuomotor skills (he plays the generation of movement have been well established
table tennis and can ride a motorcycle) despite having for more than a century (Fritsch and Hitzig, 1870; Ferrier,
profound deficits in his ability to identify objects, faces, 1876, 1890; Sherrington, 1906; Penfield and Boldrey,
colors, visual texture, and words (Le et al., 2002; 1937; see Graziano, 2009, for a detailed review). By
Dijkerman et al., 2004). comparison, the contributions of the dorsal stream to
Recently, another patient, who sustained bilateral movement control, and those of the PPC in particular,
damage to the ventral stream following a stroke, was have been a topic of investigation only relatively recently
tested on several of the same tests that were given to (Mountcastle et al., 1975; Mountcastle, 1976). This
DF more than a decade ago. Remarkably, this new patient was in part due to the historic assessment of the PPC
(JS) behaved almost identically to DF. In other words, as a purely sensory association area, a designation
despite his inability to perceive the shape and orientation grounded in its anatomic location at the boundaries of
of objects, he was able to use these same object features the primary visual, auditory, and somatosensory cortical
to program and control grasping movements directed areas (Critchley, 1953; see Chapter 7). Consistent with this
towards those objects (Karnath et al., 2009). idea, the PPC has been well characterized by its multi-
Finally, it is worth noting that if one reads the early sensory functional properties. For example, the anterior
clinical reports of patients with visual form agnosia, regions of the parietal cortex respond to tactile stimulation
one can find a number of examples of what appears to and exhibit somatosensory responses (Mountcastle, 1957;
be spared visuomotor skills in the face of massive deficits see Chapter 4) whereas the posterior regions show a vari-
in form perception. Campion (1987), for example, ety of neural response properties linked to visuospatial
reports that patient RC, who showed a profound visual attention (Ungerleider and Mishkin, 1982; Colby and
form agnosia after carbon monoxide poisoning, “could Goldberg, 1999; Husain and Nachev, 2007). However,
negotiate obstacles in the room, reach out to shake hands it is now widely accepted, based on neurophysiologic
and manipulate objects or [pick up] a cup of coffee.” findings in nonhuman primates, patient work in humans,
Taken together, the pattern of visual deficits and and more recently, human fMRI studies, that the PPC
spared abilities in DF (and in SB, JS, and other patients is indeed selectively involved in processes related to
with visual form agnosia) is in many ways the mirror movement planning and control (Mountcastle et al.,
image of that observed in the optic ataxia patients 1975; Andersen et al., 1997, 2014; Kalaska et al., 1997;
described earlier. Indeed, DF, who has damage in her Culham and Valyear, 2006; Gallivan and Culham, 2015).
ventral stream, can reach out and grasp objects whose The PPC in both humans and nonhuman primates
form and orientation she does not perceive, whereas consists of a mosaic of specialized subregions, each of
patients with optic ataxia, who have damage in their dor- which has been shown to be involved in the planning
sal stream, are unable to use vision to guide their reaching and control of specific bodily effectors (Culham et al.,
454 J.P. GALLIVAN AND M.A. GOODALE
2006; see Chapter 8, Fig. 8.8). First in awake, behaving Luppino, 2000; Tanne-Gariepy et al., 2002), the PPC
monkeys with neurophysiologic recording techniques has been putatively subdivided into two parallel proces-
and then later in humans with neuroimaging methods, sing streams for prehension: (1) a dorsolateral circuit
these areas were identified by their activation selectivity involving interconnections between CIP, AIP, and
for movements of the hand (anterior intraparietal area PMv, thought to be specialized for object grasping and
(AIP) in monkeys and AIP sulcus (aIPS) in humans), manipulation; and (2) a dorsomedial circuit involving
arm (visual area 6 (V6A) and medial intraparietal area interconnections between V6A, MIP, and PMd, thought
(MIP) in monkeys and superior parieto-occipital cortex to be specialized for reaching and online corrections
(SPOC) and anterior precuneus (aPCu) in humans), eyes during movement (Galletti et al., 2003; Johnson and
(lateral intraparietal area (LIP) in monkeys and parietal Grafton, 2003; Rizzolatti and Matelli, 2003; Grafton,
eye fields (PEF) in humans), and head (ventral intrapar- 2010; Fig. 23.4). (A separate, third pathway, involving
ietal area (VIP) in monkeys, and VIP sulcus (VIPs) in interconnections between LIP and FEF, has been shown
humans) (Gallivan and Culham, 2015; reviewed in to be involved in the preparation of eye movements.)
Culham and Valyear, 2006). Whereas the anatomic divisions proposed by this dorsal
Mirroring these putative subdivisions in the PPC, parallel pathway view are not in dispute, the extent to
there are similar functional specializations in the motor which they actually support separable functional circuits
areas of the frontal cortex – an organization that reflects for grasping and reaching is still a matter of some debate.
reciprocal interconnections between the parietal and A recent wealth of evidence demonstrates that macaque
frontal cortex (Johnson et al., 1996; Shipp et al., 1998; V6A, an area presumed to be primarily involved in reach-
Matelli and Luppino, 2000; Andersen and Buneo, ing, also exhibits a wide range of grasp-selective neuronal
2002; Tanne-Gariepy et al., 2002). Although not an properties (Fattori et al., 2009, 2010, 2012), and neur-
exhaustive list, these frontal areas include the ventral pre- oimaging experiments in humans have bolstered these
motor cortex (PMv), involved in hand movements, the observations (Cavina-Pratesi et al., 2010; Gallivan et al.,
dorsal premotor cortex (PMd), involved in arm move- 2011b; Monaco et al., 2011; Gutteling et al., 2015).
ments, and the frontal eye fields (FEF) involved in eye Nevertheless, the connectivity of the dorsolateral cir-
movements (Weinrich and Wise, 1982; Bruce and cuit does appear to indicate a more specialized role in
Goldberg, 1985; Rizzolatti et al., 1988). In addition, object grasping. Area AIP, for example, exhibits promi-
the medial surface of frontal cortex contains secondary nent interconnections with inferotemporal cortex (Borra
motor areas, such as the supplementary motor area et al., 2008). This presumably provides a direct access
(SMA), the pre-supplementary motor area (pre-SMA), route through which perceptual information about object
and the cingulate motor zones (discussed elsewhere; properties (e.g., surface texture, compliance) can be
see Dum and Strick, 2002; Amiez and Petrides, 2014). shared with the dorsal-stream brain structures that use
All of these frontal areas, in addition to receiving projec- this information for visually guided grasping, particu-
tions from the PPC and exhibiting connectivity with one larly for the final phase when the required grip and load
another, send direct projections to the primary motor cor- forces are critical.
tex (M1), the main source of descending motor com- Furthermore, the dorsolateral pathway lies directly
mands to the spinal cord (Porter and Lemon, 1993), as adjacent to, and is interconnected with, the inferior pari-
well as to the spinal cord directly (Dum and Strick, etal lobule (IPL: Borra et al., 2008), a brain region
1991, 1996, 2002; Boudrias et al., 2009). that, in monkeys, has been shown to represent the
Importantly, the PPC, in contrast to regions in the higher-level goals of motor acts in which grasping is
frontal lobe, has considerably fewer direct anatomic pro- embedded (Fogassi et al., 2005; Rozzi et al., 2008;
jections to the spinal structures (less than one-fifth the Bonini et al., 2011) and, in humans, it is an area that
number of connections; see Murray and Coulter, 1981; has undergone considerable cortical expansion through
Toyoshima and Sakai, 1982), suggesting that the dorsal evolution (Van Essen and Dierker, 2007). It is perhaps
stream largely exerts its influence over motor output not surprising then that the IPL has been heavily impli-
through its projections to frontal cortical regions. This cated in higher-order human-related behaviors such as
pattern of connections suggests that the PPC is more hand gestures and tool use (Johnson-Frey, 2004; see
likely to be involved in the earlier stages of sensorimotor Chapters 17 and 25), language processing (Davis and
transformations for action, at a level that is more Johnsrude, 2003), and action understanding (see
abstractly removed from the precise muscle commands Chapter 28). In the next section, we provide a more
needed to achieve the desired actions (Fig. 23.3). detailed discussion of each of the purported functional
Based on patterns of anatomic connectivity in mon- subdivisions of human and monkey PPC, and attempt to
keys and the response properties of neurons in the differ- link each to a specialized role in visuospatial processing
ent areas involved (Johnson et al., 1996; Matelli and for action.
THE DORSAL “ACTION” PATHWAY 455
Fig. 23.3. Schematic representation of action-related areas of parietal and premotor cortex shown on the cortical surface of the
human (left) and macaque monkey (right) brain. The cortical surfaces (dorsal, lateral, and medial views) have been partially
inflated to reveal regions within the sulci while preserving a sense of curvature, and are based on the PALS-B12 template human
brain (left: Van Essen, 2005) and the F99 template macaque brain (right: Van Essen, 2004). Brain areas are color-coded according
to the legend at the bottom and are an approximation based on general consensus from human neuroimaging (left) and macaque
neurophysiology (right). For legibility, functionally defined regions have been grouped into the most well-established regions
implicated in hand and eye movements (note that the schematic is not intended to veridically show the extent and overlap of acti-
vation). Areas coded with the same color in parietal and premotor cortex within each species indicate direct connectivity and sim-
ilar functional specializations. Areas coded with the same color across species suggest possible functional homologies. White
dashed lines indicate major sulci. Sulci acronyms: AS, arcuate sulcus; Ces, central sulcus; CiS, cingulate sulcus; IFS, inferior fron-
tal sulcus; IPS, intraparietal sulcus; LuS, lunate sulcus; PoCes, postcentral sulcus; POS, parieto-occipital sulcus; PrCes, precentral
sulcus; PS, principal sulcus; SFS, superior frontal sulcus. Areal acronyms: AIP, anterior intraparietal area; aIPS, anterior intrapar-
ietal sulcus; APCu, anterior precuneus; CIP, caudal intraparietal area; FEF, frontal eye fields; LIP, lateral intraparietal area; MIP,
medial intraparietal area; mIPS, medial intraparietal sulcus; PEF, parietal eye fields; pIPS/cIPS, posterior or caudal intraparietal
sulcus; PMd, dorsal premotor cortex; PMv, ventral premotor cortex; SPOC, superior parieto-occipital cortex; VIP, ventral intra-
parietal area; vIPS, ventral intraparietal sulcus.
Fig. 23.5. Demonstration of the size–weight illusion (SWI). (A) Size-weight stimuli. Subjects lift the large and small objects
(equal in weight) by grasping a handle using a precision grip (between thumb and index finger). The handle is equipped with
two force-torque sensors that can be quickly moved from object to object. A light-sensitive diode, embedded into the lifting plat-
form, records object lift-off. (B) Fingertip force records for a representative individual. Grip force (in newtons), load force (LF),
grip and load force rates, and light-sensitive diode recorded in the initial (left) and later (right) lifts of each object. This subject lifted
the large object (blue traces) and then the small object (red traces), in an alternating fashion. In all trials, subjects grasped the object
and increased grip and load force together until lift-off occurred (signaled by the light diode). In the initial trials (left), peak grip and
load force rates were scaled to object size whereas in the later trials (right), the peak force rates were statistically indistinguishable
for the two objects (i.e., appropriately scaled to the equally weighted objects). Vertical lines indicate object lift-off. (C) Lift param-
eters, averaged across subjects. Grip force rate and load force rate are plotted as a function of trial number. Each dot represents an
average of 20 subjects (vertical lines are standard errors). Curves were fitted for each object to provide a visual impression of the
force adaptation over trials. (D) Heaviness rating, plotted as a ratio of the small-to-heavy object. Participants indicated, on a
10-point scale, the perceived heaviness of the two objects throughout the duration of testing. A positive score indicates the smaller
object as being perceived heavier. (Data kindly provided by Randy Flanagan and modified from Flanagan and Beltzner (2000),
with permission from Nature Publishing Group.)
460 J.P. GALLIVAN AND M.A. GOODALE
through the fingertip forces used when lifting. This dem- stream (in conjunction with related circuits in premotor
onstrates that the well-learned priors serving the sensori- cortex, basal ganglia, cerebellum, and brainstem) are then
motor system are not hard-wired or crystallized during activated to transform the visual information about the
development, but can be gradually modified through cup into the appropriate coordinates and motor commands
the experience of lifting objects (Flanagan et al., 2008). for the desired action (i.e., in the metaphor above, the
Although the brain mechanisms that support the dis- dorsal stream would be the semiautonomous robot). This
sociation between force estimation (for lifting) and per- means that in many instances a flagged object in the scene
ceived heaviness remain poorly understood, fMRI work will be processed in parallel by both ventral and dorsal
has suggested the left PMv as playing a role in estimating stream mechanisms – each transforming the visual infor-
object density based on size and weight (Chouinard et al., mation in the array for different purposes. In other situa-
2009), a factor thought to be important in driving the SWI tions, however, where the visual stimuli are particularly
(Grandy and Westwood, 2006; Buckingham, 2014). salient, visuomotor mechanisms in the dorsal stream
Taken together, this elegant work on object lifting pro- can operate without any immediate supervision by the
vides support for the dual, but not mutually exclusive, ventral stream’s perceptual mechanisms.
proposition that: (1) the control of object manipulation Of course, the tele-assistance metaphor does not cap-
requires access to ventral visual pathway resources (such ture the entire interaction between the dorsal and ventral
as computations about size and material); and (2) like streams that must occur in a natural reach-to-grasp
other action–perception dissociations, the sensorimotor movement. Although the dorsal stream might be able
system can often operate independently of the cogni- to provide most of the metric computations required
tive/perceptual system. to guide the hand towards the goal object, the ventral
stream clearly plays a pivotal role in selecting the
appropriate hand posture (in the case of tools, for exam-
CONCLUDING REMARKS
ple) and in determining the required grip and load
When Goodale and Milner (1992) first proposed the idea forces for interacting with the object once contact is
of a separate vision-for-action system in the dorsal made. In short, the two streams play different but com-
stream, the emphasis was on the independence of this plementary roles in the production of skilled and adap-
system from vision for perception in the ventral stream. tive actions.
But, even in the original conception, it was understood
that the two systems would have to work closely together ACKNOWLEDGMENTS
in the generation of purposive (and adaptive) behavior.
J.P.G. was supported by a Canadian Institutes of Health
Indeed, as noted earlier, in light of the pressures of natural
Research (CIHR) fellowship and M.A.G. was supported
selection, if the computations of the ventral stream did
by CIHR, the Natural Sciences and Engineering
not in some way assist in the selection of our actions
Research Council of Canada, and the Canada Research
(and help the organism survive) then it is unlikely to have
Chairs program.
ever evolved.
One way to think about the interaction between the
ABBREVIATIONS
two streams (an interaction that capitalizes on the comple-
mentary differences in their computational constraints) is AIP, anterior intraparietal area; aIPS, anterior intraparie-
in terms of a tele-assistance metaphor borrowed from tal sulcus; aPCu, anterior precuneus; CIP, caudal
robotics engineering (Goodale and Humphrey, 1998). intraparietal area; FEF, frontal eye fields; fMRI,
In tele-assistance, a human operator, who has identified functional magnetic resonance imaging; IPL, inferior
a goal object and decided what to do with it, communi- parietal lobule; IPS, intraparietal sulcus; LIP, lateral
cates with a semiautonomous robot that actually performs intraparietal area; LO, lateral occipital area; M1,
the required motor act on the flagged goal object (Pook primary motor cortex; MIP, medial intraparietal area;
and Ballard, 1996). In terms of this tele-assistance meta- MRI, magnetic resonance imaging; MWI, material
phor, the perceptual-cognitive system in the ventral weight illusion; OTC, occipitotemporal cortex; PEF,
stream, with its rich and detailed representations of the parietal eye fields; pIPS, posterior intraparietal sulcus;
visual scene (and links with cognitive systems), would PMd, dorsal premotor cortex; PMv, ventral premotor
be the human operator. Processes in the ventral stream cortex; PPC, posterior parietal cortex; pre-SMA, pre-
participate in the identification of a particular goal and supplementary motor area; SPOC, superior parieto-
then flag the relevant object in the scene, perhaps by occipital sulcus; SMA, supplementary motor area;
means of an attention-like process. Once a particular goal SWI, size weight illusion; +V6A, visual area 6; VIP,
object, such as a wine glass on the dinner table, has been ventral intraparietal area; VIPs, ventral intraparietal
flagged, dedicated visuomotor networks in the dorsal sulcus.
THE DORSAL “ACTION” PATHWAY 461
REFERENCES Bisley JW, Goldberg ME (2003). Neuronal activity in the lat-
eral intraparietal area and spatial attention. Science 299:
Amedi A, Malach R, Hendler T et al. (2001). Visuo-haptic 81–86.
object-related activation in the ventral visual pathway. Bonini L, Serventi FU, Simone L et al. (2011). Grasping
Nat Neurosci 4: 324–330. neurons of monkey parietal and premotor cortices encode
Amiez C, Petrides M (2014). Neuroimaging evidence of the action goals at distinct levels of abstraction during complex
anatomo-functional organization of the human cingulate action sequences. J Neurosci 31: 5876–5886.
motor areas. Cereb Cortex 24: 563–578. Borra E, Belmalih A, Calzavara R et al. (2008). Cortical con-
Andersen RA, Buneo CA (2002). Intentional maps in posterior nections of the macaque anterior intraparietal (AIP) area.
parietal cortex. Annu Rev Neurosci 25: 189–220. Cereb Cortex 18: 1094–1111.
Andersen RA, Cui H (2009). Intention, action planning, and Boudrias MH, McPherson RL, Frost SB et al. (2009).
decision making in parietal-frontal circuits. Neuron 63: Output properties and organization of the forelimb repre-
568–583. sentation of motor areas on the lateral aspect of the
Andersen RA, Snyder LH, Bradley DC et al. (1997). hemisphere in rhesus macaques. Cereb Cortex 20:
Multimodal representation of space in the posterior parietal 169–186.
cortex and its use in planning movements. Annu Rev Brenner E, Smeets JB (1996). Size illusion influences how we
Neurosci 20: 303–330. lift but not how we grasp an object. Exp Brain Res 111:
Andersen RA, Hwang EJ, Mulliken GH (2010). Cognitive neu- 473–476.
ral prosthetics. Annu Rev Psychol 61: 169–190: C161-163. Bruce CJ, Goldberg ME (1985). Primate frontal eye fields. I.
Andersen RA, Andersen KN, Hwang EJ et al. (2014). Optic Single neurons discharging before saccades. J Neurophysiol
ataxia: from Balint’s syndrome to the parietal reach region. 53: 603–635.
Neuron 81: 967–983. Buckingham G (2014). Getting a grip on heaviness perception:
Ansari D (2008). Effects of development and enculturation on a review of weight illusions and their probable causes. Exp
number representation in the brain. Nat Rev Neurosci 9: Brain Res 232: 1623–1629.
278–291. Buckingham G, Cant JS, Goodale MA (2009). Living in a
Astafiev SV, Shulman GL, Stanley CM et al. (2003). material world: how visual cues to material properties
Functional organization of human intraparietal and frontal affect the way that we lift objects and perceive their weight.
cortex for attending, looking, and pointing. J Neurosci 23: J Neurophysiol 102: 3111–3118.
4689–4699. Calton JL, Dickinson AR, Snyder LH (2002). Non-spatial,
Balint R (1909). Seelenhammung des ‘Schauens’, optische motor-specific activation in posterior parietal cortex. Nat
Ataxie, ra€umliche St€orungen des Aufmersamkeit. Neurosci 5: 580–588.
Monastchrift f€ur Psychiatrie und Neurologie 25: 51–81. Caminiti R, Johnson PB, Urbano A (1990). Making arm
Battaglini PP, Muzur A, Galletti C et al. (2002). Effects of movements within different parts of space: dynamic
lesions to area V6A in monkeys. Exp Brain Res 144: aspects in the primate motor cortex. J Neurosci 10:
419–422. 2039–2058.
Baugh LA, Kao M, Johansson RS et al. (2012). Material evidence: Campion J (1987). Apperceptive agnosia: The specification
interaction of well-learned priors and sensorimotor memory and description of constructs. In: IGWHMJ Riddoch
when lifting objects. J Neurophysiol 108: 1262–1269. (Ed.), Visual object processing: a cognitive neuropsycho-
Baumann MA, Fluet MC, Scherberger H (2009). Context- logical approach, Erlbaum, London.
specific grasp movement representation in the macaque Cant JS, Goodale MA (2007). Attention to form or surface
anterior intraparietal area. J Neurosci 29: 6436–6448. properties modulates different regions of human occipito-
Begliomini C, Wall MB, Smith AT et al. (2007). Differential temporal cortex. Cereb Cortex 17: 713–731.
cortical activity for precision and whole-hand visually Cant JS, Goodale MA (2011). Scratching beneath the surface:
guided grasping in humans. Eur J Neurosci 25: 1245–1252. new insights into the functional properties of the lateral
Bernier PM, Grafton ST (2010). Human posterior parietal cor- occipital area and parahippocampal place area.
tex flexibly determines reference frames for reaching based J Neurosci 31: 8248–8258.
on sensory context. Neuron 68: 776–788. Cavina-Pratesi C, Monaco S, Fattori P et al. (2010). Functional
Beurze SM, de Lange FP, Toni I et al. (2007). Integration of magnetic resonance imaging reveals the neural substrates
target and effector information in the human brain during of arm transport and grip formation in reach-to-grasp
reach planning. J Neurophysiol 97: 188–199. actions in humans. J Neurosci 30: 10306–10323.
Beurze SM, de Lange FP, Toni I et al. (2009). Spatial and Charpentier A (1891). Analyse experimentale: de quelques
effector processing in the human parietofrontal network elements de la sensation de poids. Arch Physiol Norm
for reaches and saccades. J Neurophysiol 101: 3053–3062. Pathol 3.
Biederman I (2000). Recognizing depth-rotated objects: a Chouinard PA, Large ME, Chang EC et al. (2009). Dissociable
review of recent research and theory. Spat Vis 13: 241–253. neural mechanisms for determining the perceived heavi-
Binkofski F, Dohle C, Posse S et al. (1998). Human anterior ness of objects and the predicted weight of objects during
intraparietal area subserves prehension: a combined lesion lifting: an fMRI investigation of the size-weight illusion.
and functional MRI activation study. Neurology 50: Neuroimage 44: 200–212.
1253–1259.
462 J.P. GALLIVAN AND M.A. GOODALE
Christopoulos VN, Bonaiuto J, Kagan I et al. (2015). Fattori P, Raos V, Breveglieri R et al. (2010). The dorsomedial
Inactivation of parietal reach region affects reaching but pathway is not just for reaching: grasping neurons in the
not saccade choices in internally guided decisions. medial parieto-occipital cortex of the macaque monkey.
J Neurosci 35: 11719–11728. J Neurosci 30: 342–349.
Ciavarro M, Ambrosini E, Tosoni A et al. (2013). rTMS of Fattori P, Breveglieri R, Raos V et al. (2012). Vision for action
medial parieto-occipital cortex interferes with attentional in the macaque medial posterior parietal cortex. J Neurosci
reorienting during attention and reaching tasks. J Cogn 32: 3221–3234.
Neurosci 25: 1453–1462. Fattori P, Breveglieri R, Bosco A et al. (2017). Vision for pre-
Clower DM, Hoffman JM, Votaw JR et al. (1996). Role of pos- hension in the medial parietal cortex. Cereb Cortex 27:
terior parietal cortex in the recalibration of visually guided 1149–1163.
reaching. Nature 383: 618–621. Ferrier D (1876). Functions of the Brain, Smith, Elder,
Colby CL, Goldberg ME (1999). Space and attention in pari- London.
etal cortex. Annu Rev Neurosci 22: 319–349. Ferrier D (1890). Cerebral localisation, Smith, Elder, London.
Cole KJ (2008). Lifting a familiar object: visual size analysis, Filimon F, Nelson JD, Huang RS et al. (2009). Multiple pari-
not memory for object weight, scales lift force. Exp Brain etal reach regions in humans: cortical representations for
Res 188: 551–557. visual and proprioceptive feedback during on-line reach-
Connolly JD, Andersen RA, Goodale MA (2003). FMRI ing. J Neurosci 29: 2961–2971.
evidence for a ‘parietal reach region’ in the human brain. Flanagan JR, Beltzner MA (2000). Independence of perceptual
Exp Brain Res 153: 140–145. and sensorimotor predictions in the size-weight illusion.
Constantin AG, Wang H, Martinez-Trujillo JC et al. (2007). Nat Neurosci 3: 737–741.
Frames of reference for gaze saccades evoked during stim- Flanagan JR, Bowman MC, Johansson RS (2006). Control
ulation of lateral intraparietal cortex. J Neurophysiol 98: strategies in object manipulation tasks. Curr Opin
696–709. Neurobiol 16: 650–659.
Critchley M (1953). The parietal lobes, Arnold, London. Flanagan JR, Bittner JP, Johansson RS (2008). Experience
Cui H, Andersen RA (2007). Posterior parietal cortex encodes can change distinct size-weight priors engaged in
autonomously selected motor plans. Neuron 56: 552–559. lifting objects and judging their weights. Curr Biol 18:
Culham JC, Valyear KF (2006). Human parietal cortex in 1742–1747.
action. Curr Opin Neurobiol 16: 205–212. Flourney T (1894). De l’influence de la perception visuelle des
Culham JC, Danckert SL, DeSouza JF et al. (2003). Visually corps sur leur poids apparent. L’Annee Psychologique 1:
guided grasping produces fMRI activation in dorsal but 198–208.
not ventral stream brain areas. Exp Brain Res 153: Fogassi L, Ferrari PF, Gesierich B et al. (2005). Parietal lobe:
180–189. from action organization to intention understanding.
Culham JC, Cavina-Pratesi C, Singhal A (2006). The role of Science 308: 662–667.
parietal cortex in visuomotor control: what have we learned Freedman DJ, Assad JA (2006). Experience-dependent repre-
from neuroimaging? Neuropsychologia 44: 2668–2684. sentation of visual categories in parietal cortex. Nature 443:
Davis MH, Johnsrude IS (2003). Hierarchical processing in 85–88.
spoken language comprehension. J Neurosci 23: Frey SH, Vinton D, Norlund R et al. (2005). Cortical topogra-
3423–3431. phy of human anterior intraparietal cortex active during
de Lafuente V, Jazayeri M, Shadlen MN (2015). visually guided grasping. Brain Res Cogn Brain Res 23:
Representation of accumulating evidence for a decision 397–405.
in two parietal areas. J Neurosci 35: 4306–4318. Fritsch GT, Hitzig E (1870). On the electrical excitability of
Dijkerman HC, Le S, Demonet JF et al. (2004). Visuomotor the cerebrum, Springfield, IL, Charles C. Thomas.
performance in a patient with visual agnosia due to an early Gallese V, Murata A, Kaseda M et al. (1994). Deficit of hand
lesion. Brain Res Cogn Brain Res 20: 12–25. preshaping after muscimol injection in monkey parietal
Dum RP, Strick PL (1991). The origin of corticospinal projec- cortex. Neuroreport 5: 1525–1529.
tions from the premotor areas in the frontal lobe. J Neurosci Galletti C, Kutz DF, Gamberini M et al. (2003). Role of the
11: 667–689. medial parieto-occipital cortex in the control of reaching
Dum RP, Strick PL (1996). Spinal cord terminations of the and grasping movements. Exp Brain Res 153: 158–170.
medial wall motor areas in macaque monkeys. J Neurosci Gallivan JP, Culham JC (2015). Neural coding within human
16: 6513–6525. brain areas involved in actions. Curr Opin Neurobiol 33:
Dum RP, Strick PL (2002). Motor areas in the frontal lobe of 141–149.
the primate. Physiol Behav 77: 677–682. Gallivan JP, McLean DA, Smith FW et al. (2011a). Decoding
Ellis RR, Lederman SJ (1999). The material-weight illusion effector-dependent and effector-independent movement
revisited. Percept Psychophys 61: 1564–1576. intentions from human parieto-frontal brain activity.
Fattori P, Breveglieri R, Marzocchi N et al. (2009). Hand ori- J Neurosci 31: 17149–17168.
entation during reach-to-grasp movements modulates neu- Gallivan JP, McLean DA, Valyear KF et al. (2011b). Decoding
ronal activity in the medial posterior parietal area V6A. action intentions from preparatory brain activity in human
J Neurosci 29: 1928–1936. parieto-frontal networks. J Neurosci 31: 9599–9610.
THE DORSAL “ACTION” PATHWAY 463
Gallivan JP, McLean DA, Flanagan JR et al. (2013). Where Gutteling TP, Petridou N, Dumoulin SO et al. (2015). Action
one hand meets the other: limb-specific and action- preparation shapes processing in early visual cortex.
dependent movement plans decoded from preparatory sig- J Neurosci 35: 6472–6480.
nals in single human frontoparietal brain areas. J Neurosci Hagler Jr DJ, Riecke L, Sereno MI (2007). Parietal and supe-
33: 1991–2008. rior frontal visuospatial maps activated by pointing and
Gallivan JP, Cant JS, Goodale MA et al. (2014). saccades. Neuroimage 35: 1562–1577.
Representation of object weight in human ventral visual Harshfield SP, DeHardt DC (1970). Weight judgment as a
cortex. Curr Biol 24: 1866–1873. function of apparent density of objects. Psychonom Sci
Gold JI, Shadlen MN (2007). The neural basis of decision mak- 20: 365–366.
ing. Annu Rev Neurosci 30: 535–574. Heed T, Beurze SM, Toni I et al. (2011). Functional rather than
Goodale MA (2011). Transforming vision into action. Vision effector-specific organization of human posterior parietal
Res 51: 1567–1587. cortex. J Neurosci 31: 3066–3076.
Goodale MA, Humphrey GK (1998). The objects of action and Hubbard EM, Piazza M, Pinel P et al. (2005). Interactions
perception. Cognition 67: 181–207. between number and space in parietal cortex. Nat Rev
Goodale MA, Milner AD (1992). Separate visual pathways for Neurosci 6: 435–448.
perception and action. Trends Neurosci 15: 20–25. Hummel JE (2013). Object recognition. In: Oxford handbook
Goodale MA, Milner AD (2004). Sight unseen: an exploration of cognitive psychology. Oxford, England. Oxford
of conscious and unconscious vision, Oxford University University Press.
Press, Oxford. Husain M, Nachev P (2007). Space and the parietal cortex.
Goodale MA, Milner AD, Jakobson LS et al. (1991). Trends Cogn Sci 11: 30–36.
A neurological dissociation between perceiving objects Hutchison RM, Culham JC, Flanagan JR et al. (2015).
and grasping them. Nature 349: 154–156. Functional subdivisions of medial parieto-occipital cortex
Goodale MA, Meenan JP, Bulthoff HH et al. (1994). in humans and nonhuman primates using resting-state
Separate neural pathways for the visual analysis of object fMRI. Neuroimage 116: 10–29.
shape in perception and prehension. Curr Biol 4: 604–610. Hwang EJ, Hauschild M, Wilke M et al. (2012). Inactivation of
Gordon AM, Forssberg H, Johansson RS et al. (1991a). the parietal reach region causes optic ataxia, impairing
Integration of sensory information during the programming reaches but not saccades. Neuron 76: 1021–1029.
of precision grip: comments on the contributions of size Jackson SR, Shaw A (2000). The Ponzo illusion affects grip-
cues. Exp Brain Res 85: 226–229. force but not grip-aperture scaling during prehension
Gordon AM, Forssberg H, Johansson RS et al. (1991b). Visual movements. J Exp Psychol Hum Percept Perform 26:
size cues in the programming of manipulative forces during 418–423.
precision grip. Exp Brain Res 83: 477–482. Jakobson LS, Archibald YM, Carey DP et al. (1991). A kinematic
Gordon AM, Westling G, Cole KJ et al. (1993). Memory repre- analysis of reaching and grasping movements in a patient
sentations underlying motor commands used during mani- recovering from optic ataxia. Neuropsychologia 29: 803–809.
pulation of common and novel objects. J Neurophysiol 69: James TW, Culham J, Humphrey GK et al. (2003). Ventral
1789–1796. occipital lesions impair object recognition but not
Graf AB, Andersen RA (2014). Inferring eye position object-directed grasping: an fMRI study. Brain 126:
from populations of lateral intraparietal neurons. Elife 3: 2463–2475.
e02813. James TW, Stevenson RA, Kim S et al. (2011). Shape from
Graf AB, Andersen RA (2015). Predicting oculomotor behav- sound: evidence for a shape operator in the lateral occipital
iour from correlated populations of posterior parietal neu- cortex. Neuropsychologia 49: 1807–1815.
rons. Nat Commun 6: 6024. Janssen P, Scherberger H (2015). Visual guidance in control of
Grafton ST (2010). The cognitive neuroscience of prehension: grasping. Annu Rev Neurosci 38: 69–86.
recent developments. Exp Brain Res 204: 475–491. Jazayeri M, Shadlen MN (2010). Temporal context calibrates
Grandy MS, Westwood DA (2006). Opposite perceptual and interval timing. Nat Neurosci 13: 1020–1026.
sensorimotor responses to a size-weight illusion. Jazayeri M, Shadlen MN (2015). A neural mechanism for sens-
J Neurophysiol 95: 3887–3892. ing and reproducing a time interval. Curr Biol 25:
Graziano MS (2009). The intelligent movement machine: an 2599–2609.
ethological perspective on the primate motor system, Johansson RS, Flanagan JR (2009). Coding and use of tactile
Oxford University Press, New York. signals from the fingertips in object manipulation tasks. Nat
Grefkes C, Fink GR (2005). The functional organization of the Rev Neurosci 10: 345–359.
intraparietal sulcus in humans and monkeys. J Anat 207: Johansson RS, Westling G (1988). Coordinated isometric mus-
3–17. cle commands adequately and erroneously programmed for
Gregoriou GG, Borra E, Matelli M et al. (2006). Architectonic the weight during lifting task with precision grip. Exp Brain
organization of the inferior parietal convexity of the Res 71: 59–71.
macaque monkey. J Comp Neurol 496: 422–451. Johnson SH, Grafton ST (2003). From ‘acting on’ to ‘acting
Grill-Spector K, Malach R (2004). The human visual cortex. with’: the functional anatomy of object-oriented action
Annu Rev Neurosci 27: 649–677. schemata. Prog Brain Res 142: 127–139.
464 J.P. GALLIVAN AND M.A. GOODALE
Johnson PB, Ferraina S, Bianchi L et al. (1996). Cortical net- Monaco S, Cavina-Pratesi C, Sedda A et al. (2011). Functional
works for visual reaching: physiological and anatomical magnetic resonance adaptation reveals the involvement of
organization of frontal and parietal lobe arm regions. the dorsomedial stream in hand orientation for grasping.
Cereb Cortex 6: 102–119. J Neurophysiol 106: 2248–2263.
Johnson-Frey SH (2004). The neural bases of complex tool use Mountcastle VB (1957). Modaility and topographic properties
in humans. Trends Cogn Sci 8: 71–78. of single neurons of cat’s somatic sensory cortex.
Kalaska JF, Scott SH, Cisek P et al. (1997). Cortical control of J Neurophysiol 20: 408–434.
reaching movements. Curr Opin Neurobiol 7: 849–859. Mountcastle VB (1976). The world around us: neural com-
Karnath HO, Perenin MT (2005). Cortical control of visually mand function for selective attention. Neurosci Res
guided reaching: evidence from patients with optic ataxia. Program Bull 14 (suppl): 1–47.
Cereb Cortex 15: 1561–1569. Mountcastle VB, Lynch JC, Georgopoulos A et al. (1975).
Karnath HO, Ruter J, Mandler A et al. (2009). The anatomy of Posterior parietal association cortex of the monkey: com-
object recognition – visual form agnosia caused by medial mand functions for operations within extrapersonal space.
occipitotemporal stroke. J Neurosci 29: 5854–5862. J Neurophysiol 38: 871–908.
Katsuyama N, Yamashita A, Sawada K et al. (2010). Mulliken GH, Musallam S, Andersen RA (2008). Forward
Functional and histological properties of caudal intraparie- estimation of movement state in posterior parietal cortex.
tal area of macaque monkey. Neuroscience 167: 1–10. Proc Natl Acad Sci U S A 105: 8170–8177.
Konen CS, Mruczek RE, Montora JL et al. (2013). Functional Murata A, Gallese V, Luppino G et al. (2000). Selectivity for
organization of human posterior parietal cortex: grasping- the shape, size, and orientation of objects for grasping in
and reaching-related activations relative to topographically neurons of monkey parietal area AIP. J Neurophysiol 83:
organized cortex. J Neurophysiol 109: 2897–2908. 2580–2601.
Konkle T, Oliva A (2012). A real-world size organization of Murray EA, Coulter JD (1981). Organization of corticospinal
object responses in occipitotemporal cortex. Neuron 74: neurons in the monkey. J Comp Neurol 195: 339–365.
1114–1124. Murray DJ, Ellis RR, Bandomir CA et al. (1999). Charpentier
Le S, Cardebat D, Boulanouar K et al. (2002). Seeing, since (1891) on the size-weight illusion. Percept Psychophys 61:
childhood, without ventral stream: a behavioural study. 1681–1685.
Brain 125: 58–74. Musallam S, Corneil BD, Greger B et al. (2004). Cognitive
Leone FT, Heed T, Toni I et al. (2014). Understanding effector control signals for neural prosthetics. Science 305: 258–262.
selectivity in human posterior parietal cortex by combining Nieder A, Dehaene S (2009). Representation of number in the
information patterns and activation measures. J Neurosci brain. Annu Rev Neurosci 32: 185–208.
34: 7102–7112. Nyssen R, Bourdon J (1955). Contribution to the study of the
Levy I, Schluppeck D, Heeger DJ et al. (2007). Specificity of size-weight illusion by the method of P. Koseleff. Acta
human cortical areas for reaches and saccades. J Neurosci Psychol 11: 467–474.
27: 4687–4696. Penfield W, Boldrey E (1937). Somatic motor and sensory rep-
Linden JF, Grunewald A, Andersen RA (1999). Responses to resentation in the cerebral cortex of man as studied by elec-
auditory stimuli in macaque lateral intraparietal area. II. trical stimulation. Brain 60: 389–443.
Behavioral modulation. J Neurophysiol 82: 343–358. Perenin MT, Vighetto A (1988). Optic ataxia: a specific dis-
Logothetis NK, Pauls J, Augath M et al. (2001). ruption in visuomotor mechanisms. I. Different aspects
Neurophysiological investigation of the basis of the of the deficit in reaching for objects. Brain 111: 643–674.
fMRI signal. Nature 412: 150–157. Pesaran B, Nelson MJ, Andersen RA (2006). Dorsal premotor
Margulies DS, Vincent JL, Kelly C et al. (2009). Precuneus neurons encode the relative position of the hand, eye, and
shares intrinsic functional architecture in humans and mon- goal during reach planning. Neuron 51: 125–134.
keys. Proc Natl Acad Sci U S A 106: 20069–20074. Pitzalis S, Sereno M, Committeri G et al. (2006). A possible
Mars RB, Jbabdi S, Sallet J et al. (2011). Diffusion-weighted human homologue of the macaque V6A. J Vis 6: 536a.
imaging tractography-based parcellation of the human Pook PK, Ballard DH (1996). Deictic human/robot interaction.
parietal cortex and comparison with human and macaque Robotics and Autonomous Systems 18: 259–269.
resting-state functional connectivity. J Neurosci 31: Porter R, Lemon RN (1993). Corticospinal function and volun-
4087–4100. tary movement, Clarendon Press, Oxford, UK.
Matelli M, Luppino G (2000). Parietofrontal circuits: parallel Prado J, Clavagnier S, Otzenberger H et al. (2005). Two cor-
channels for sensory-motor integrations. Adv Neurol 84: tical systems for reaching in central and peripheral vision.
51–61. Neuron 48: 849–858.
McIntosh RD, Schenk T (2009). Two visual streams for per- Premereur E, Janssen P, Vanduffel W (2015). Effector speci-
ception and action: current trends. Neuropsychologia 47: ficity in macaque frontal and parietal cortex. J Neurosci 35:
1391–1396. 3446–3459.
Milner AD, Goodale MA (2006). The visual brain in action, Rice NJ, Tunik E, Grafton ST (2006). The anterior intraparietal
Oxford University Press, Oxford. sulcus mediates grasp execution, independent of require-
Milner AD, Goodale MA (2008). Two visual systems ment to update: new insights from transcranial magnetic
re-viewed. Neuropsychologia 46: 774–785. stimulation. J Neurosci 26: 8176–8182.
THE DORSAL “ACTION” PATHWAY 465
Riesenhuber M, Poggio T (2000). Models of object recogni- Srivastava S, Orban GA, De Maziere PA et al. (2009).
tion. Nat Neurosci 3 (Suppl): 1199–1204. A distinct representation of three-dimensional shape in
Rizzolatti G, Matelli M (2003). Two different streams form the macaque anterior intraparietal area: fast, metric, and
dorsal visual system: anatomy and functions. Exp Brain coarse. J Neurosci 29: 10613–10626.
Res 153: 146–157. Stoet G, Snyder LH (2004). Single neurons in posterior parietal
Rizzolatti G, Camarda R, Fogassi L et al. (1988). Functional cortex of monkeys encode cognitive set. Neuron 42:
organization of inferior area 6 in the macaque monkey. 1003–1012.
II. Area F5 and the control of distal movements. Exp Szczepanski SM, Konen CS, Kastner S (2010). Mechanisms of
Brain Res 71: 491–507. spatial attention control in frontal and parietal cortex.
Rosenberg A, Cowan NJ, Angelaki DE (2013). The visual rep- J Neurosci 30: 148–160.
resentation of 3D object orientation in parietal cortex. Taira M, Mine S, Georgopoulos AP et al. (1990). Parietal cor-
J Neurosci 33: 19352–19361. tex neurons of the monkey related to the visual guidance of
Rossetti Y, Rode G, Pisella L et al. (1998). Prism adaptation to hand movement. Exp Brain Res 83: 29–36.
a rightward optical deviation rehabilitates left hemispatial Tanne-Gariepy J, Rouiller EM, Boussaoud D (2002). Parietal
neglect. Nature 395: 166–169. inputs to dorsal versus ventral premotor areas in the
Rozzi S, Ferrari PF, Bonini L et al. (2008). Functional organi- macaque monkey: evidence for largely segregated visuo-
zation of inferior parietal lobule convexity in the motor pathways. Exp Brain Res 145: 91–103.
macaque monkey: electrophysiological characterization Thaler L, Goodale MA (2010). Beyond distance and direction:
of motor, sensory and mirror responses and their correla- the brain represents target locations non-metrically. J Vis
tion with cytoarchitectonic areas. Eur J Neurosci 28: 10: 1–27.
1569–1588. Theys T, Srivastava S, van Loon J et al. (2012). Selectivity for
Saber GT, Pestilli F, Curtis CE (2015). Saccade planning three-dimensional contours and surfaces in the anterior
evokes topographically specific activity in the dorsal and intraparietal area. J Neurophysiol 107: 995–1008.
ventral streams. J Neurosci 35: 245–252. Thier P, Andersen RA (1996). Electrical microstimulation
Sakata H, Taira M, Kusunoki M et al. (1997). The TINS lec- suggests two different forms of representation of head-
ture. The parietal association cortex in depth perception centered space in the intraparietal sulcus of rhesus mon-
and visual control of hand action. Trends Neurosci 20: keys. Proc Natl Acad Sci U S A 93: 4962–4967.
350–357. Thier P, Andersen RA (1998). Electrical microstimulation dis-
Sakata H, Taira M, Kusunoki M et al. (1998). Neural coding of tinguishes distinct saccade-related areas in the posterior
3D features of objects for hand action in the parietal cortex parietal cortex. J Neurophysiol 80: 1713–1735.
of the monkey. Philos Trans R Soc Lond B Biol Sci 353: Tosoni A, Pitzalis S, Committeri G et al. (2015). Resting-state
1363–1373. connectivity and functional specialization in human
Schenk T, McIntosh RD (2010). Do we have independent medial parieto-occipital cortex. Brain Struct Funct 220:
visual streams for perception and action? Cogn Neurosci 3307–3321.
1: 52–62. Toyoshima K, Sakai H (1982). Exact cortical extent of the ori-
Scheperjans F, Eickhoff SB, Homke L et al. (2008a). gin of the corticospinal tract (CST) and the quantitative
Probabilistic maps, morphometry, and variability of contribution to the CST in different cytoarchitectonic
cytoarchitectonic areas in the human superior parietal cor- areas. A study with horseradish peroxidase in the monkey.
tex. Cereb Cortex 18: 2141–2157. J Hirnforsch 23: 257–269.
Scheperjans F, Hermann K, Eickhoff SB et al. (2008b). Tsao DY, Vanduffel W, Sasaki Y et al. (2003). Stereopsis acti-
Observer-independent cytoarchitectonic mapping of the vates V3A and caudal intraparietal areas in macaques and
human superior parietal cortex. Cereb Cortex 18: 846–867. humans. Neuron 39: 555–568.
Seashore CE (1899). Some psychological statistics. II. The Tsutsui K, Jiang M, Yara K et al. (2001). Integration of
material weight illusition. Univ Iowa Stud Psychol 2: perspective and disparity cues in surface-orientation-
36–46. selective neurons of area CIP. J Neurophysiol 86:
Sereno AB, Maunsell JH (1998). Shape selectivity in primate 2856–2867.
lateral intraparietal cortex. Nature 395: 500–503. Tsutsui K, Sakata H, Naganuma T et al. (2002). Neural corre-
Shadmehr R, Wise SP (Eds.), (2005). The computation lates for perception of 3D surface orientation from texture
neurobiology of reaching and pointing. MIT Press, gradient. Science 298: 409–412.
Cambridge, MA. Tunik E, Frey SH, Grafton ST (2005). Virtual lesions of the
Sherrington CS (1906). The integrative action of the nervous anterior intraparietal area disrupt goal-dependent on-line
system, Yale University Press, New Haven, CT. adjustments of grasp. Nat Neurosci 8: 505–511.
Shipp S, Blanton M, Zeki S (1998). A visual somatomotor Ungerleider LG, Mishkin M (1982). Two cortical visual sys-
pathway through superior parietal cortex in the macaque tems. In: DJ Ingle, MA Goodale, RJW Mansfield (Eds.),
monkey: cortical connections of V6 and V6A. Eur Analysis of visual behavior. MIT Press, Cambridge, MA.
J Neurosci 10: 3171–3193. Van Essen DC (2004). Surface-based approaches to spatial
Snyder LH, Batista AP, Andersen RA (1997). Coding of inten- localization and registration in primate cerebral cortex.
tion in the posterior parietal cortex. Nature 386: 167–170. Neuroimage 23 (Suppl 1): S97–S107.
466 J.P. GALLIVAN AND M.A. GOODALE
Van Essen DC (2005). A population-average, landmark- and Whitwell RL, Milner AD, Goodale MA (2014). The two
surface-based (PALS) atlas of human cerebral cortex. visual systems hypothesis: new challenges and in-
Neuroimage 28: 635–662. sights from visual form agnosic patient DF. Front Neurol
Van Essen DC, Dierker DL (2007). Surface-based and proba- 5: 255.
bilistic atlases of primate cerebral cortex. Neuron 56: Wojciulik E, Kanwisher N (1999). The generality of
209–225. parietal involvement in visual attention. Neuron 23:
Vesia M, Prime SL, Yan X et al. (2010). Specificity of human 747–764.
parietal saccade and reach regions during transcranial mag- Wolfe HK (1898). Some effects of size on judgements of
netic stimulation. J Neurosci 30: 13053–13065. weight. Psychol Rev 5: 25–54.
Walsh V (2003). A theory of magnitude: common cortical met- Wolpert DM, Flanagan JR (2001). Motor prediction. Curr Biol
rics of time, space and quantity. Trends Cogn Sci 7: 483–488. 11: R729–R732.
Weinrich M, Wise SP (1982). The premotor cortex of the mon- Wolpert DM, Goodbody SJ, Husain M (1998). Maintaining
key. J Neurosci 2: 1329–1345. internal representations: the role of the human superior
Weinrich M, Wise SP, Mauritz KH (1984). A neurophysiological parietal lobe. Nat Neurosci 1: 529–533.
study of the premotor cortex in the rhesus monkey. Brain 107: Xu Y, Chun MM (2006). Dissociable neural mechanisms sup-
385–414. porting visual short-term memory for objects. Nature 440:
Weisberg J, van Turennout M, Martin A (2007). A neural sys- 91–95.
tem for learning about object function. Cereb Cortex 17: Xu Y, Chun MM (2009). Selecting and perceiving multiple
513–521. visual objects. Trends Cogn Sci 13: 167–174.