You are on page 1of 10

HIPPOCAMPUS 27:570–579 (2017)

A Scientific Theory of Ars Memoriae: Spatial View Cells in a


Continuous Attractor Network With Linked Items
Edmund T. Rolls *

ABSTRACT: The art of memory (ars memoriae) used since classical day by associating each step in the argument with a
times includes using a well-known scene to associate each view or part location in a spatial scene through which their memo-
of the scene with a different item in a speech. This memory technique
is also known as the “method of loci.” The new theory is proposed that
ry could progress from one end to the other during
this type of memory is implemented in the CA3 region of the hippocam- the speech to recall each item in the correct order
pus where there are spatial view cells in primates that allow a particu- (Yates, 1992). The procedure is also known as the
lar view to be associated with a particular object in an event or “method of loci.” Phrases such as “in the first place,”
episodic memory. Given that the CA3 cells with their extensive recur- “in the second place,” probably refer to this method.
rent collateral system connecting different CA3 cells, and associative
synaptic modifiability, form an autoassociation or attractor network, Empirical work has demonstrated that the method of
the spatial view cells with their approximately Gaussian view fields loci is efficacious (De Beni and Cornoldi, 1985; Moe
become linked in a continuous attractor network. As the view space is and De Beni, 2005).
traversed continuously (e.g., by self-motion or imagined self-motion Why is ars memoriae so successful in helping to
across the scene), the views are therefore successively recalled in the remember complex series of points, or arguments, or
correct order, with no view missing, and with low interference between
the items to be recalled. Given that each spatial view has been associat- people, or objects? The aim of this article is to pro-
ed with a different discrete item, the items are recalled in the correct vide a scientific theory of why ars memoriae is very
order, with none missing. This is the first neuroscience theory of ars effective. I develop the theory by describing first the
memoriae. The theory provides a foundation for understanding how a empirical and theoretical foundations for the theory
key feature of ars memoriae, the ability to use a spatial scene to encode (Empirical Foundations—Spatial View Cells in the
a sequence of items to be remembered, is implemented. V C 2017 Wiley

Periodicals, Inc.
Primate Hippocampus section; and Theoretical Foun-
dations—A Theory of the Hippocampal CA3 System
KEY WORDS: memory method of loci; spatial view cells; place cells; as an Object-Spatial View Memory System section),
attractor network; object-place memory; episodic memory and then I present the theory (The Theory of Ars
Memoriae section).

INTRODUCTION EMPIRICAL FOUNDATIONS—SPATIAL


VIEW CELLS IN THE PRIMATE
Simonides of Ceos lived to tell the story of how when a banquet hall
HIPPOCAMPUS
collapsed in an earthquake, he could identify all the victims by recalling
from each place at the table who had been sitting there (Cicero, 55 We can start with the well-known place cells dis-
BC). This way of remembering items was developed into what has covered in the rat hippocampus by O’Keefe and col-
become known as ars memoriae by Roman senators, who presented the leagues (O’Keefe and Dostrovsky, 1971; O’Keefe,
steps of a complex legal argument in a speech that might last a whole 1990), and which were recognized in the award of the
Nobel prize in 2015 to John O’Keefe, and to Edvard
and May-Britt Moser for the discovery of entorhinal
Oxford Centre for Computational Neuroscience, Oxford, UK; and
cortex grid cells, which fire to repeated places in the
University of Warwick, Department of Computer Science, Coventry, environment as the rat traverses the places (Hafting
UK et al., 2005; Moser et al., 2014). Unfortunately these
Grant sponsor: UK Medical Research Council; Human Frontier Science rat place and grid cells will not easily help to explain
Program Grants; EEC BRAIN Grant; MRC Oxford Interdisciplinary the memory of items in a spatial scene when a human
Research Centre in Cognitive Neuroscience; Oxford McDonnell-Pew
Centre in Cognitive Neuroscience.
is in one place moving the eyes across the whole spa-
*Correspondence to: Professor E. T. Rolls, Department of Computer tial scene, for no place or grid cells would be altering
Science, Oxford Centre for Computational Neuroscience, University of their firing if the subject was not moving, and the
Warwick, Coventry, Oxford, United Kingdom. subject was staying at one place.
E-mail: Edmund.Rolls@oxcns.org More promising are the hippocampal spatial view
Accepted for publication 23 January 2017.
DOI 10.1002/hipo.22713
cells which respond when a macaque is stationary at
Published online 8 February 2017 in Wiley Online Library one place, but respond when the monkey looks at one
(wileyonlinelibrary.com). point in a spatial scene (Rolls et al., 1989, 1997,

C 2017 WILEY PERIODICALS, INC.


V
ARS MEMORIAE AND SPATIAL VIEW CELLS 571

FIGURE 1. Examples of the firing of a hippocampal spatial range of spatial locations was viewed. (b) A similar representation
view cell when the monkey was walking around the laboratory. (a) of the same three recording sessions as in (a), but modified to indi-
The firing of the cell is indicated by the spots in the outer set of cate more fully the range of places when the cell fired at more than
four rectangles, each of which represents one of the walls of the 12 spikes/s, to indicate that this is not a place cell, but a spatial
room. There is one spot in the outer rectangle for each action view cell. The triangle indicates the current position of the monkey.
potential. The base of the wall is towards the centre of each rectan- The same data are shown in the inner and outer rectangles, and
gle. The positions on the walls fixated during the recording sessions each dot represents one action potential. c1–c4 are cups in which
are indicated by points in the inner set of four rectangles, each of food may be found. T1 and T2 are trolleys at fixed positions within
which also represents a wall of the room. The central square is a the space within which the monkey can walk freely. The four walls
plan view of the room, with a triangle printed every 250 ms to of the room are situated 1–3 mm from the 3 3 3 m2 space in
indicate the position of the monkey, thus showing that many differ- which the monkey can walk, and are part of a rich laboratory envi-
ent places were visited during the recording sessions. A spot is ronment with windows, door, apparatus and so forth (After
printed every 250 ms in the inner rectangles to show that a wide Georges-Francois, Rolls, and Robertson, 1999.)

1998; Feigenbaum and Rolls, 1991; Rolls and O’Mara, 1995; separate the effects of spatial view and place in a factorial
Robertson et al., 1998; Georges-François et al., 1999; Rolls design in which spatial view is one factor, and the second is
and Xiang, 2006) (see example of a typical spatial view neuron the place where the actor is located.
in Fig. 1). Each hippocampal neuron responds to a different Now these spatial view cells do appear to be involved in
spatial view, that is when a different part of the spatial scene is memory, for in a task in which the location in the scene where
looked at (Rolls et al., 1998). Each spatial view cell has an an object was seen must be remembered, some macaque hippo-
approximately Gaussian shape of its spatial view field, with the campal neurons respond to the place in the scene where the
peak of activity at one point in a scene, and gradually decreas- object is shown, some to the object, and some to a combina-
ing the further away from its peak is fixated (Rolls et al., 1997, tion of the two (Rolls et al., 2005). Moreover, some of these
1998; Robertson et al., 1998; Georges-François et al., 1999). neurons respond in a one-trial object-place memory task when
Provided that the monkey is looking at a given part of the a place in a scene is recalled from an object, or when an object
scene, the exact place where the monkey is has little effect is recalled from a place (Rolls and Xiang, 2006). Primate hip-
(Rolls et al., 1997, 1998; Robertson et al., 1998; Georges- pocampal neurons also associate spatial view with the reward
François et al., 1999). That is, the neurons encode spatial view, available at a viewed location (Rolls and Xiang, 2005).
not place. Many of these spatial view neurons respond when a For clarification, the evidence on spatial view cells in pri-
scene is being remembered, for example when the scene is mates is that this is a representation provided in the primate
obscured with curtains and the lights are turned off (Robertson hippocampus that has not been found in the rat hippocampus;
et al., 1998), or when a position in a spatial scene is recalled but also it has been made clear that the primate hippocampal
from an object, or vice versa (Rolls and Xiang, 2006). The spatial view representation may not be entirely independent of
presence of spatial view cells in the macaque hippocampus that the place where the primate is located. For example, in a popu-
respond to landmarks being viewed has recently been con- lation of hippocampal spatial view cells in which spatial view
firmed during a virtual reality spatial navigation task (Wirth versus place encoding was carefully analyzed by measuring the
et al., 2017), though it was not possible in that study to fully information provided when the firing was measured in several

Hippocampus
572 ROLLS

FIGURE 2. Forward connections (solid lines) from areas of excitatory neurons in the pathways. Abbreviations—D: deep pyra-
cerebral association neocortex via the parahippocampal gyrus and midal cells. DG: dentate granule cells. F: forward inputs to areas
perirhinal cortex, and entorhinal cortex, to the hippocampus; and of the association cortex from preceding cortical areas in the hier-
backprojections (dashed lines) via the hippocampal CA1 pyrami- archy. mf: mossy fibres. PHG: parahippocampal gyrus and perirhi-
dal cells, subiculum, and parahippocampal gyrus to the neocortex. nal cortex. pp: perforant path. rc: recurrent collateral of the CA3
There is great convergence in the forward connections down to hippocampal pyramidal cells. S: Superficial pyramidal cells. 2:
the single network implemented in the CA3 pyramidal cells; and pyramidal cells in layer 2 of the entorhinal cortex. 3: pyramidal
great divergence again in the backprojections. Left: block diagram. cells in layer 3 of the entorhinal cortex. The thick lines above the
Right: more detailed representation of some of the principal cell bodies represent the dendrites.

places each with several very similar spatial views (a sine qua provided in both cases that the monkey was looking at the
non for any such investigation), the information in a popula- table (Robertson et al., 1998). Thus a primate spatial view cell
tion of cells about spatial view was 0.327 bits, and about place can respond to a spatial view or landmark when the primate is
was 0.026 bits, using rigorous Shannon information theoretic at the place of the landmark (Rolls et al., 1997; Robertson
measures of the stimulus-specific information (Georges-François et al., 1998).
et al., 1999). Thus the encoding of spatial view by primate
hippocampal neurons is not entirely independent of the encod-
ing of place. In addition, at least some primate hippocampal
spatial view cells do have their spatial view firing modulated by
the place where the macaque is located (Rolls and O’Mara, THEORETICAL FOUNDATIONS—A THEORY OF
1995). Further, I note that if there is a cell responding to the THE HIPPOCAMPAL CA3 SYSTEM AS AN
spatial view of, for example a landmark such as a trolley, table OBJECT-SPATIAL VIEW MEMORY SYSTEM
or cup in the testing environment, then that spatial view cell
will fire when the primate is at the place of that landmark, Figure 2 shows how object representations, from for example
provided of course that when at that place the landmark still the temporal lobes, are brought together with spatial represen-
looks similar to its appearance from other places (Rolls et al., tations, from for example the parietal lobe, in especially the
1997; Robertson et al., 1998). An example is provided in Fig- CA3 hippocampal recurrent collateral network. This network
ure 1 of Robertson et al (1998), in which a neuron responded potentially allows objects to be associated with places (Rolls,
to a landmark, a table (T2) when the monkey was distant 1989a, 1990, 2016; Rolls and Treves, 1994; Treves and Rolls,
from the table, and when the monkey was at the table, 1994; Rolls and Kesner, 2006; Kesner and Rolls, 2015).

Hippocampus
ARS MEMORIAE AND SPATIAL VIEW CELLS 573

using the strengthened synapses; or a place can be recalled


from the object.
More formally, many of the synapses in the hippocampus
show associative modification as shown by long-term potentia-
tion, and this synaptic modification appears to be involved in
learning (see Lynch, 2004; Morris, 2003; Morris et al., 2003;
Nakazawa et al., 2003, 2004; Andersen et al., 2007; Wang and
Morris, 2010; Jackson, 2013). The architecture of an autoasso-
ciation network is shown in Figure 3, and the learning rule is
as shown in Eq. (1) below (Rolls and Treves, 1998; Rolls,
2016). The operation and properties of autoassociation or
attractor networks have been described in detail elsewhere
(Hopfield, 1982; Hertz et al., 1991; Treves and Rolls, 1991;
Samsonovich and McNaughton, 1997; Rolls and Treves, 1998;
Rolls, 2008, 2016). Neuronal network software to illustrate the
properties of attractor networks is available (Rolls, 2016) (see
http://www.oxcns.org).
FIGURE 3. The architecture of a continuous attractor neural The hypothesis is that because the CA3 operates effectively
network (CANN). The architecture is the same as that of a discrete as a single autoassociation network, it can allow arbitrary asso-
attractor neural network. During learning, external inputs ei with ciations between inputs originating from very different parts of
Gaussian spatial fields force the output neurons to fire with rates
the cerebral cortex to be formed. These might involve associa-
ri, the recurrent collaterals produce the same rates rj as the presyn-
aptic inputs to the neurons, and, the synapses wij become associa- tions between information originating in the temporal visual
tively modified. Many different inputs each corresponding to a cortex about the presence of an object, and information origi-
different spatial representation are applied during learning, and nating in the parietal cortex about where it is. I note that
the synapses between every pair of neurons come to represent the although there is some spatial gradient in the CA3 recurrent
distance between the positions represented by each pair of neu-
rons. The neurons shown are excitatory, and inhibitory neurons connections, so that the connectivity is not fully uniform (Ishi-
maintain the average firing so that once the neurons that corre- zuka et al., 1990; Witter, 2007), nevertheless the network will
spond to one part of the space are firing, they keep each other fir- still have the properties of a single interconnected autoassocia-
ing by the excitatory synaptic connections between them, to tion network allowing associations between arbitrary neurons
provide a packet or bubble of neuronal activity, as illustrated in to be formed, given the presence of many long-range connec-
Figure 4. Because of the Gaussian spatial response profile of each
neuron, the space defined is continuous. A continuous attractor tions which overlap from different CA3 cells. It is very interest-
network need not have local connectivity, but the global connec- ing indeed that in primates (macaques), the associational
tivity illustrated in Figure 3. It is the associations between nearby projections from CA3 to CA3 travel extensively along the lon-
positions and the repeated trajectories in the same order through gitudinal axis, and overall the radial, transverse, and longitudi-
the space that result in a continuous attractor as a result of the
nal gradients of CA3 fiber distribution, clear in the rat, are
associative learning between co-active neurons, with nearby posi-
tions in the space not represented necessarily by nearby neurons much more subtle in the nonhuman primate brain (Kondo
in the continuous attractor (Rolls, 2016). Thus as the space is tra- et al., 2009). The implication is that in primates, the CA3 net-
versed from one end to the other, the bubble of activity moves work operates even more as a single network than in rodents.
continuously through the space. A fundamental property of the autoassociation model of the
CA3 recurrent collateral network is that the recall can be sym-
The Functional Architecture of the CA3 metric, that is, the whole of the memory can be retrieved from
Recurrent Collateral Network any part. For example, in an object-place autoassociation mem-
A quantitative theory has been developed of how the hippo- ory, an object could be recalled from a place retrieval cue, and
campus helps to implement episodic memory, for example the vice versa (Rolls, 2016).
memory of a particular scene with people or objects in it
(Rolls, 1987, 1989a,b, 1990, 1996, 2008, 2016; Treves and Continuous Spatial Patterns and CA3
Rolls, 1992; Treves and Rolls, 1994; Rolls et al., 2002; Rolls Representations
and Stringer, 2005; Rolls and Kesner, 2006; Kesner and Rolls, The fact that spatial patterns, which imply continuous repre-
2015). Within this theory, the CA3 pyramidal cell to CA3 sentations of space such as those provided by spatial view cells
pyramidal cell recurrent collateral system which is highly devel- in primates and place cells in rodents, are represented in the
oped in primates (Kondo et al., 2009) provides the basis for an hippocampus has led to the application of continuous attractor
autoassociation or attractor network. In such a network, a par- models to help understand hippocampal function (Zhang,
ticular object activating a small subset of neurons becomes 1996; Samsonovich and McNaughton, 1997; Stringer et al.,
associated with a particular place by associative synaptic modi- 2002a,b; Rolls and Stringer, 2005). This has been necessary,
fication. Later, presentation of the object can recall the place because space is inherently continuous, the firing of place and

Hippocampus
574 ROLLS

packet of actively firing neurons relatively constant, and to help


to ensure that there is only one activity packet. Continuous
attractor networks can be thought of as very similar to autoas-
sociation or discrete attractor networks (Rolls, 2016), and have
the same architecture, as illustrated in Figure 3. The main dif-
ference is that the patterns stored in a CANN are continuous
patterns, with each neuron having broadly tuned firing which
decreases with for example a Gaussian function as the distance
from the optimal firing location of the neuron is varied, and
with different neurons having tuning that overlaps throughout
the space. Such tuning is illustrated in Figure 4. For compari-
son, autoassociation networks normally have discrete (separate)
patterns (each pattern implemented by the firing of a particular
subset of the neurons), with no continuous distribution of the
patterns throughout the space (see Fig. 4). A consequent differ-
ence is that the CANN can maintain its firing at any location
FIGURE 4. The types of firing patterns stored in continuous in the trained continuous space, whereas a discrete attractor or
attractor networks are illustrated for the patterns present on neu- autoassociation network moves its population of active neurons
rons 1–1,000 for Memory 1 (when the firing is that produced toward one of the previously learned attractor states, and thus
when the spatial state represented is that for location 300), and implements the recall of a particular previously learned pattern
for Memory 2 (when the firing is that produced when the spatial
from an incomplete or noisy (distorted) version of one of the
state represented is that for location 500). The continuous nature
of the spatial representation results from the fact that each neuron previously learned patterns.
has a Gaussian firing rate that peaks at its optimal location. This Evidence that there is a continuous attractor network in
particular mixed network also contains discrete representations CA3 includes the following. In rats, hippocampal place cells
that consist of discrete subsets of active binary firing rate neurons show different place fields in different environments with
in the range 1,001–1,500. The firing of these latter neurons can
remapping between different environments (Muller and Kubie,
be thought of as representing the discrete events that occur at the
location. Continuous attractor networks by definition contain only 1987; Lee et al., 2004; Wills et al., 2005; Leutgeb and Leut-
continuous representations, but this particular network can store geb, 2007; Alme et al., 2014), consistent with the theory that
mixed continuous and discrete representations, and is illustrated the places for one environment are mapped into one continu-
to show the difference of the firing patterns normally stored in ous spatial chart or configuration, and for another environment
separate continuous attractor and discrete attractor networks. For
into another continuous spatial chart (Battaglia and Treves,
this particular mixed network, during learning, Memory 1 is
stored in the synaptic weights, then Memory 2, and so forth, and 1998). Further, in rats that are placed in an environment that
each memory contains part that is continuously distributed to rep- is ambiguous between two different environments, hippocam-
resent physical space, and part that represents a discrete event or pal CA3 place cells sometimes respond as if the animal was in
object. one environment, and sometimes as if the animal was in the
second environment (Jezek et al., 2011). Rather than sliding
spatial view cells is approximately Gaussian as a function of the through a continuum of intermediate activity states, the CA3
distance away from the preferred spatial location, because these network undergoes a short period of competitive flickering
cells have spatially overlapping fields, and because the theory is between preformed representations of the past and present
that these cells in CA3 are connected by Hebb-modifiable syn- environment before settling on the latter. The place cells can
apses (Rolls, 2008, 2016; Kesner and Rolls, 2015). even flicker stochastically between representing one and then
A “continuous attractor” neural network (CANN) can main- the other environment in different theta cycles (Jezek et al.,
tain the firing of its neurons to represent any location along a 2011). Thus there is considerable evidence supporting the
continuous physical dimension such as spatial position, head attractor theory of CA3 operation (McNaughton and Morris,
direction, and so forth (Amari, 1977; Battaglia and Treves, 1987; Rolls, 1987; Rolls, 1989a; Kesner and Rolls, 2015).
1998; Stringer and Rolls, 2002; Stringer et al., 2002a,b, 2004, So far we have said that the neurons in the continuous
2005; Rolls and Stringer, 2005; Rolls, 2016). It uses excitatory attractor network are connected to each other by synaptic
recurrent collateral connections between the neurons (as are weights wij that are a simple function, for example Gaussian,
present in CA3) to reflect the distance between the neurons in of the distance between the states of the agent in the physical
the state space of the animal (e.g., place or spatial view). These world (e.g., place, spatial view etc) represented by the neurons.
networks can maintain the bubble or bump of neural activity In many simulations, the weights are set by formula to have
constant for long periods wherever it is started to represent the weights with these appropriate Gaussian values. However,
current state (spatial view, place, etc) of the animal, and are Stringer et al. (2002b) showed how the appropriate synaptic
likely to be involved in many aspects of spatial processing and weights could be set up by learning. They started with the fact
memory, including spatial vision (Rolls, 2016). Global inhibi- that since the neurons have broad tuning that may be Gaussian
tion is used to keep the number of neurons in a bubble or in shape, nearby neurons in the state space will have

Hippocampus
ARS MEMORIAE AND SPATIAL VIEW CELLS 575

overlapping spatial fields, and will thus be co-active to a degree Path integration can be implemented in recurrent attractor net-
that depends on the distance between them. They postulated works as described elsewhere for hippocampal CA3 (Samsono-
that therefore the synaptic weights could be set up by associa- vich and McNaughton, 1997; Stringer and Rolls, 2002;
tive learning based on the co-activity of the neurons produced Stringer et al., 2002a,b;, 2004; Rolls and Stringer, 2005; Kes-
by external stimuli as the animal moved in the state space. For ner and Rolls, 2015; Rolls, 2016 ) and for the entorhinal cor-
example, during learning spatial view cells are forced to fire by tex (Giocomo et al., 2011; Zilli, 2012). In our approach, the
visual cues in the environment that produce Gaussian firing as movement signal, in this case eye position and head direction,
a function of the spatial view from an optimal spatial view for are used as inputs to the spatial view continuous attractor net-
each neuron. The learning rule is simply that the weights wij work, with the appropriate synaptic strengths set up by self-
from spatial view neuron j with firing rate rj to spatial view organizing learning (Stringer et al., 2005). The effect is that
neuron i with firing rate ri are updated according to an associa- there can be a steady trajectory through the space of spatial
tive (Hebb) rule that is consistent with findings from long- views, and potentially remembered spatial views, produced by
term potentiation head and eye movements (Stringer et al., 2005).

dwij 5kri rj (1)

where dwij is the change of synaptic weight and k is the learn- THE THEORY OF ARS MEMORIAE
ing rate constant. During the learning phase, the firing rate ri
of each spatial view neuron i might be the following Gaussian The Theory
function of the distance of the spatial view from the optimal
firing view of the neuron Building on the above evidence, I now describe a theory,
which uses the above components, of how it is that attaching
ri 5e 2s
2
=2r2
; (2) items to different parts of a remembered but familiar scene
provides a good strategy to remember the order of the items.
where s is the difference between the spatial view x (in degrees) An essential feature of the proposal comes from the way in
of the agent and the spatial view xi for neuron i, and r is the which a smooth continuous trajectory through a space can be pro-
standard deviation. Stringer et al. (2002b) showed that after duced by a small input that pushes one through the space, in the
training at all positions in the space, the synaptic connections way described above for spatial view cells (Stringer et al., 2005).
develop strengths that are an almost Gaussian function of the Because the spatial view fields have overlapping approximately
distance between the cells in the space. This shows how cells Gaussian receptive fields, when the pushing input moves one in a
such as spatial view cells could be associated together in CA3 certain direction, say left to right, across the scene, the firing of a
to form a continuous attractor network. set of spatial view cells for one view in the scene automatically
recruits the next set of spatial view cells for the next view in the
Combined Continuous and Discrete Memory scene. That is, the continuous attractor network effectively
Representations in the Same (e.g., CA3) embodies the structure of the space, that is the order of the differ-
Network, and Episodic Memory ent views in the scene, because cells that represent the same view in
the space (even though not topologically together in the CANN)
Space is continuous, and object representations are discrete.
have strong synaptic connections between each other, and fairly
If these representations are to be combined in for example an
strong connections only with other neurons in the network that
object-place memory, then we need to understand the opera-
represent nearby views in the scene. That is the effect of the learn-
tion of networks that combine these representations. It has
ing mechanism described above. Therefore as we move from one
now been shown that attractor networks can store both contin-
part of the scene to another sliding across the continuous space, the
uous patterns and discrete patterns (as illustrated in Fig. 4),
CANN automatically “looks up” the next adjacent spatial view.
and can thus be used to store for example the location in (con-
Thus the order of the spatial views is implicit in the structure of the
tinuous, physical) space (e.g., the place “out there” in a room
CANN. Which spatial view is next to another is what is encoded in
represented by spatial view cells) where an object (a discrete
the CANN, which effectively represents the distances between the
item) is present (Rolls et al., 2002).
spatial views in the strengths of the synapses between the neurons.
The proposal is that ars memoriae takes advantage of this
Idiothetic Update by Path Integration
spatial structure and order, with a different item or object asso-
We have considered how spatial representations could be ciated with each spatial view in the scene, in exactly the way
stored in continuous attractor networks, and how the activity that our research indicates happens for object-place associations
can be maintained at any location in the state space in a form in hippocampal CA3. Thus as the person sweeps continuously
of short- term memory when the external (e.g., visual) input is from one spatial view in a scene to another, the correct items
removed. However, many networks with spatial representations are recalled in the correct order. One strategy is thus to start at
in the brain can be updated by internal, self-motion (i.e., idiot- the left of the scene, and then imagine moving one’s view con-
hetic), cues even when there is no external (e.g., visual) input. tinuously from the left to the right. After one space has been

Hippocampus
576 ROLLS

traversed, in ars memoriae sometimes a different space, for recurrent collaterals onto any one CA3 neuron (Treves and
example another room, is continuously traversed next, allowing Rolls, 1991; Rolls, 2016). We have shown that with a sparse
the objects or arguments linked by object-place learning to representation, the number of memories that can be stored is
each view in the next room to be recalled in the correct order in the order of the number of recurrent collateral connections
(Yates, 1992). onto any one neuron (Treves and Rolls, 1991, 1994; Rolls and
The capacity of the proposed combined continuous and dis- Treves, 1994), which is in the order of 12,000 in the rat. If the
crete attractor network in hippocampal CA3 is sufficient to limit on the capacity of an attractor network is exceeded, then
implement ars memoriae with many different discrete points to the ability to recall memories from the network will be very
be remembered when traversing a continuous space. For exam- degraded (Hopfield, 1982; Amit, 1989). For this reason, and
ple, in the simulations of continuous and discrete items associ- given that new episodic memories are being formed, some
ated together in a single attractor network, 1,000 neurons were form of forgetting is required in the hippocampus, and there
devoted to the continuous attractor representation in the single are several possible mechanisms (Rolls, 2016).
network (with the standard deviation r of the Gaussian con- One mechanism is decay of synaptic strength. The simple
nectivity supporting the packet of activity 55 neurons), 500 forgetting mechanism is just an exponential decay of the synap-
neurons were devoted to the discrete attractor representation in tic value back to its baseline, which may be exponential in
the same attractor network, and it was shown that with 10 dif- time or in the number of learning changes incurred (Nadal
ferent place-object associations stored in the network, the recall et al., 1986). Another form of forgetting is implemented by
of each of the 10 objects from each of the 10 places was per- setting limits to the range allowed for each synaptic strength or
fect (Rolls et al., 2002). More details are provided elsewhere weight (Parisi, 1986). A third mechanism for forgetting is over-
(Rolls et al., 2002) of just how exact the recall of an object is writing of previously stored memories, which will happen as a
from the spatial position retrieval cue. Further, it has been result of heterosynaptic long-term depression. If a postsynaptic
shown that in the rat CA3, it should be possible to store neuron is activated during the formation of a new memory,
approximately 100 different charts, with each chart of a differ- then any inactive synaptic inputs, from other memories, will
ent environment having many different positions represented become weaker, and effect termed heterosynaptic long-term
in the continuous map for any one environment (Battaglia and depression, and this will tend to weaken previously stored
Treves, 1998). Thus the capacity of the system proposed in the memories, and thus gradual forgetting of old memories occurs
theory would be sufficient for ars memoriae. (Rolls, 2008, 2016).
This sweeping in a continuous trajectory through a CANN These neural mechanisms contribute to allowing new items
state space can be produced by eye and head movements, for a different speech or occasion to be added onto a well-
which can move the bubble of activity continuously across the memorized scene, which was used in the practice of ars memo-
continuous attractor space from one position in the space to riae (Cicero, 55 BC; Yates, 1992). This is the new scientific
another (Stringer et al., 2005). We have shown that this can theory of ars memoriae proposed in this article. Indeed, this is
occur for some hippocampal cells in the primate, when the the first scientific theory of ars memoriae based on knowledge
eyes and/or head move in conditions when the views them- about the firing of hippocampal neurons in primates, and on
selves cannot be seen, so that effectively a remembered position an understanding of continuous attractor networks and how a
in the spatial view space is being recalled (Robertson et al., position in such a continuous attractor network can be associ-
1998). The only difference is that for ars memoriae, it is possi- ated with an object (Rolls, 2016).
ble that the eyes and head do not actually have to be moved
(though they may move!), but that one just thinks of moving
across the scene to the next position in the spatial view space.
DISCUSSION
Similarly, it is just possible that the same theory would apply
to a place cell representation, if one were to assume that each
The power of the mechanism described here that it is pro-
object or step of the argument was associated with a different
posed underlies ars memoriae (the art of memory) is that space
place, and it was possible to traverse the imagined places in a
is inherently continuous, and when mapped into a continuous
continuous spatial sequence.
attractor network in a brain region such as the hippocampus
where there are spatial view neurons with approximately Gauss-
Forgetting the Previous Day’s Items, and
ian receptive fields, the proximity of different views of a spatial
Producing a New Order for Different Items
scene is represented by the strengths of the synaptic weights
The CA3 network is a single network, in that the recurrent between the neurons. Thus when the bubble or packet of neu-
collaterals reach throughout the CA3 region, and make synap- ronal activity in the CANN moves, whether by idiothetic (self-
tic contacts with other CA3 neurons in all parts of the CA3 motion) input, or by moving in thought from one view of a
region (Kondo et al., 2009). This architecture enables any scene in say a clockwise direction, then the next adjacent view
object to be associated with any spatial view/place (Rolls, in the scene is automatically retrieved from the network. In this
1989a,; Kesner and Rolls, 2015). However, the capacity of an way, a set of views can be recalled in the correct order. If each view
autoassociation net is limited, mainly by the number of is associated with a different discrete item (e.g., an object or

Hippocampus
ARS MEMORIAE AND SPATIAL VIEW CELLS 577

thought), then the items are retrieved in the correct order, and In ars memoriae, an extended argument (or series of points to
moreover, none is forgotten. It is this order inherent in the spatial be made) may be implemented by associating the first set of
representation in the brain that helps to provide the system with its items with the different views of say a first room in a building,
power. The items themselves have no order, for each item or object then moving to a second room and associating further items
is represented just by a randomly chosen set of neurons, that is, by with each view in that room, and so forth. The theory accounts
a discrete representation in which each item is uncorrelated with for that well, for the different rooms are linked of course by
the other items, as illustrated in Figure 4. their proximity, and the last view in one room can become asso-
The mechanism as described was implemented with spatial ciated with the first view in a second room, all followed in a sys-
view cells with Gaussian receptive fields. The exact shape of tematic order (e.g., left to right, or clockwise) in ars memoriae.
the receptive field does not matter, provided that it has a peak Also, for ars memoriae, a prediction is that it is likely to be
at the centre of the view field, and a decreasing firing rate as useful to utilize scenes that are distant from an observer, for
one moves away from the view at which a neuron has its peak then the views in the scene are linked continuously as one scans
firing rate. The reason is that the continuous attractor network steadily across the scene from a single place (from which one
just learns proximity in its synaptic strengths by an overlap of might be giving a lecture or speech). A scene with an object in
firing, and the exact shape of the overlap does not matter. The the middle around which the observer walks produces sudden
view fields of spatial view neurons do have the required proper- and unsystematic changes in the views and the relations between
ties (Rolls et al., 1997, 1998; Robertson et al., 1998; Georges- the views, and is likely to be less efficient for ars memoriae.
François et al., 1999). Indeed, when analysing the properties of spatial view cells, we
This is a new theory, and it is new in a number of ways. did not have a landmark in the middle of the room, because it
First, no previous theory has used as a foundation the spatial has no relatively fixed spatial relation to other landmarks when
view cells present in primates. These are an essential component walking around any central landmark. A second prediction is
of the theory, for a human can stand in one place, and remem- therefore that the neural encoding of such landmarks that do
ber a series of locations in a scene “out there in space,” each not bear a fixed relation to other landmarks may be different
one of which is associated with a different object or event. That from the continuous attractor mechanism described in this arti-
is an important aspect of ars memoriae, and how it is used, for cle. Such central “landmarks” (such as Nelson’s column in Tra-
example to deliver a speech when standing in one place. This
falgar Square around which one can walk) may be treated more
function could not naturally be performed by rat place cells
like objects, and associated only transiently with the relatively
(O’Keefe and Dostrovsky, 1971; O’Keefe, 1990; Andersen
fixed and distant scene landmarks when viewed from a particular
et al., 2007; Hartley et al., 2014), for the place where the
place. The point here is that the relationship of a central land-
human is located while learning the scene-object associations, or
mark in a space does not have a fixed relationship to the distant
later recalling them, is not changing. Second, no previous theo-
fixed elements of a scene, as one moves round a central land-
ry of ars memoriae that I know has used a continuous attractor
mark. Indeed, it is part of the theory of hippocampal function
network to help account for the retrieval of the items (objects
that it is best suited to incorporate allocentric spatial relations,
or events) in the correct order. A continuous attractor network
for then the elements of a scene or a series of places do have a
is an important component of the present theory, because it
provides for a continuously linked set of spatial locations that is fixed relationship to each other, and can therefore be learned in
formed in the continuous attractor network. The network, a continuous attractor network (Kesner and Rolls, 2015; Rolls,
because of the inherent continuity of space, and of the way that 1989a; Rolls, 1990; Rolls, 1996; Rolls, 2016; Rolls and Kesner,
spatial proximity operates in a continuous attractor network, 2006; Rolls and Treves, 1994; Treves and Rolls, 1994).
results in a continuous trajectory through the state space during The theory described here is, as far as I know, the first neu-
recall, “automatically” (i.e., mechanistically) leading to the items roscience theory of ars memoriae, an art that has been of inter-
being recalled in the correct order. Thus the continuous attrac- est to scholars since classical times more than two thousand
tor network is an important part of the new theory. Third, an years ago (Yates, 1992). The theory provides a foundation for
essential component of the theory is that the system, as impli- understanding how a key feature of ars memoriae, the ability to
cated in the primate hippocampus, is a memory system, with use a spatial scene to encode a sequence of items to be remem-
spatial to object, or time to object, associations being impor- bered, is implemented. The theory also provides an interesting
tant. These associations are implemented by the firing of pri- example of cross-fertilization between the fields of classics and
mate hippocampal spatial view cells, as shown by object-spatial the arts, and neuroscience.
view neurons and reward-spatial view neurons. Fourth, I know
of no other neuroscience theory of ars memoriae based on a
fundamental neurophysiological analysis of the relevant proper-
ties of neurons involved in memory, and of the computational REFERENCES
neuroscience of how these neurons could implement memory
(Kesner and Rolls, 2015; Rolls, 1989a; Rolls, 1990; Rolls, Alme CB, Miao C, Jezek K, Treves A, Moser EI, Moser MB. 2014.
1996; Rolls, 2016; Rolls and Kesner, 2006; Rolls and Treves, Place cells in the hippocampus: Eleven maps for eleven rooms.
1994; Treves and Rolls, 1994). Proc Natl Acad Sci USA 111:18428–18435.

Hippocampus
578 ROLLS

Amari S. 1977. Dynamics of pattern formation in lateral-inhibition Muller RU, Kubie JL. 1987. The effects of changes in the environ-
type neural fields. Biol Cybernet 27:77–87. ment on the spatial firing of hippocampal complex-spike cells.
Amit DJ. 1989. Modeling Brain Function. Cambridge: Cambridge J Neurosci 7:1951–1968.
University Press. Nadal JP, Toulouse G, Changeux JP, Dehaene S. 1986. Networks of
Andersen P, Morris RGM, Amaral DG, Bliss TVP, O’Keefe J. 2007. formal neurons and memory palimpsests. EPL (Europhys Lett) 1:
The Hippocampus Book. London: Oxford University Press. 535.
Battaglia FP, Treves A. 1998. Attractor neural networks storing multi- Nakazawa K, Sun LD, Quirk MC, Rondi-Reig L, Wilson MA,
ple space representations: A model for hippocampal place fields. Tonegawa S. 2003. Hippocampal CA3 NMDA receptors are cru-
Phys Rev E 58:7738–7753. cial for memory acquisition of one-time experience. Neuron 38:
Cicero MT. 55 BC. De Oratore II. Rome: Cicero. 305–315.
De Beni R, Cornoldi C. 1985. Effects of the mnemotechnique of loci Nakazawa K, McHugh TJ, Wilson MA, Tonegawa S. 2004. NMDA
in the memorization of concrete words. Acta Psychol 60:11–24. receptors, place cells and hippocampal spatial memory. Nat Rev
Feigenbaum JD, Rolls ET. 1991. Allocentric and egocentric spatial Neurosci 5:361–372.
information processing in the hippocampal formation of the O’Keefe J. 1990. A computational theory of the hippocampal cogni-
behaving primate. Psychobiology 19:21–40. tive map. Prog Brain Res 83:301–312.
Georges-François P, Rolls ET, Robertson RG. 1999. Spatial view cells O’Keefe J, Dostrovsky J. 1971. The hippocampus as a spatial map:
in the primate hippocampus: Allocentric view not head direction Preliminary evidence from unit activity in the freely moving rat.
or eye position or place. Cereb Cortex 9:197–212. Brain Res 34:171–175.
Giocomo LM, Moser MB, Moser EI. 2011. Computational models of Parisi G. 1986. A memory which forgets. J Phys A Math Gen 19:
grid cells. Neuron 71:589–603. L617.
Hafting T, Fyhn M, Molden S, Moser MB, Moser EI. 2005. Micro- Robertson RG, Rolls ET, Georges-François P. 1998. Spatial view cells
structure of a spatial map in the entorhinal cortex. Nature 436: in the primate hippocampus: Effects of removal of view details.
801–806. J Neurophysiol 79:1145–1156.
Hartley T, Lever C, Burgess N, O’Keefe J. 2014. Space in the brain: Rolls ET. 1987. Information representation, processing and storage in
How the hippocampal formation supports spatial cognition. Philos the brain: Analysis at the single neuron level. In: Changeux J-P,
Trans R Soc Lond B Biol Sci 369:20120510. Konishi M, editors. The Neural and Molecular Bases of Learning.
Hertz J, Krogh A, Palmer RG. 1991. An Introduction to the Theory Chichester: Wiley. pp 503–540.
of Neural Computation. Wokingham: Addison-Wesley. Rolls ET. 1989a. Functions of neuronal networks in the hippocampus
Hopfield JJ. 1982. Neural networks and physical systems with emer-
and neocortex in memory. In: Byrne JH, Berry WO, editors. Neu-
gent collective computational abilities. Proc Natl Acad Sci USA
ral Models of Plasticity: Experimental and Theoretical Approaches.
79:2554–2558.
San Diego: Academic Press. pp 240–265.
Ishizuka N, Weber J, Amaral DG. 1990. Organization of intrahippo-
Rolls ET. 1989b. Parallel distributed processing in the brain: Implica-
campal projections originating from CA3 pyramidal cells in the
tions of the functional architecture of neuronal networks in the
rat. J Comp Neurol 295:580–623.
Jackson MB. 2013. Recall of spatial patterns stored in a hippocampal hippocampus. In: Morris RGM, editor. Parallel Distributed Proc-
slice by long-term potentiation. J Neurophysiol 110:2511–2519. essing: Implications for Psychology and Neurobiology. Oxford:
Jezek K, Henriksen EJ, Treves A, Moser EI, Moser MB. 2011. Theta- Oxford University Press. pp 286–308.
paced flickering between place-cell maps in the hippocampus. Rolls ET. 1990. Theoretical and neurophysiological analysis of the
Nature 478:246–249. functions of the primate hippocampus in memory. Cold Spring
Kesner RP, Rolls ET. 2015. A computational theory of hippocampal Harbor Symp Quantitative Biol 55:995–1006.
function, and tests of the theory: New developments. Neurosci Rolls ET. 1996. A theory of hippocampal function in memory. Hip-
Biobehav Rev 48:92–147. pocampus 6:601–620.
Kondo H, Lavenex P, Amaral DG. 2009. Intrinsic connections of the Rolls ET. 2008. Memory, Attention, and Decision-Making: A Unify-
macaque monkey hippocampal formation: II. CA3 connections. ing Computational Neuroscience Approach. Oxford: Oxford Uni-
J Comp Neurol 515:349–377. versity Press.
Lee I, Yoganarasimha D, Rao G, Knierim JJ. 2004. Comparison of Rolls ET. 2013. A quantitative theory of the functions of the hippo-
population coherence of place cells in hippocampal subfields CA1 campal CA3 network in memory. Front Cell Neurosci 7:98.
and CA3. Nature 430:456–459. Rolls ET. 2016. Cerebral Cortex: Principles of Operation. Oxford:
Leutgeb S, Leutgeb JK. 2007. Pattern separation, pattern completion, Oxford University Press.
and new neuronal codes within a continuous CA3 map. Learn Rolls ET, Kesner RP. 2006. A computational theory of hippocampal
Mem 14:745–757. function, and empirical tests of the theory. Prog Neurobiol 79:1–
Lynch MA. 2004. Long-term potentiation and memory. Physiol Rev 48.
84:87–136. Rolls ET, O’Mara SM. 1995. View-responsive neurons in the primate
McNaughton BL, Morris RGM. 1987. Hippocampal synaptic hippocampal complex. Hippocampus 5:409–424.
enhancement and information storage within a distributed memory Rolls ET, Stringer SM. 2005. Spatial view cells in the hippocampus,
system. Trends Neurosci 10:408–415. and their idiothetic update based on place and head direction.
Moe A, De Beni R. 2005. Stressing the efficacy of the loci method: Neural Networks 18:1229–1241.
Oral presentation and the subject-generation of the loci pathway Rolls ET, Treves A. 1994. Neural networks in the brain involved in
with expository passages. Appl Cogn Psychol 19:95–106. memory and recall. Prog Brain Res 102:335–341.
Morris RG. 2003. Long-term potentiation and memory. Philos Trans Rolls ET, Treves A. 1998. Neural Networks and Brain Function.
R Soc Lond B Biol Sci 358:643–647. Oxford: Oxford University Press.
Morris RG, Moser EI, Riedel G, Martin SJ, Sandin J, Day M, Rolls ET, Xiang J-Z. 2005. Reward-spatial view representations and
O’Carroll C. 2003. Elements of a neurobiological theory of the learning in the hippocampus. J Neurosci 25:6167–6174.
hippocampus: the role of activity-dependent synaptic plasticity in Rolls ET, Xiang J-Z. 2006. Spatial view cells in the primate hippo-
memory. Philos Trans R Soc Lond B Biol Sci 358:773–786. campus, and memory recall. Rev Neurosci 17:175–200.
Moser EI, Moser MB, Roudi Y. 2014. Network mechanisms of grid Rolls ET, Miyashita Y, Cahusac PMB, Kesner RP, Niki H,
cells. Philos Trans R Soc Lond B Biol Sci 369:20120511. Feigenbaum J, Bach L. 1989. Hippocampal neurons in the

Hippocampus
ARS MEMORIAE AND SPATIAL VIEW CELLS 579

monkey with activity related to the place in which a stimulus is Stringer SM, Rolls ET, Trappenberg TP. 2005. Self-organizing contin-
shown. J Neurosci 9:1835–1845. uous attractor network models of hippocampal spatial view cells.
Rolls ET, Robertson RG, Georges-François P. 1997. Spatial view cells Neurobiol Learn Mem 83:79–92.
in the primate hippocampus. Eur J Neurosci 9:1789–1794. Treves A, Rolls ET. 1991. What determines the capacity of autoasso-
Rolls ET, Treves A, Robertson RG, Georges-François P, Panzeri S. ciative memories in the brain? Network 2:371–397.
1998. Information about spatial view in an ensemble of primate Treves A, Rolls ET. 1992. Computational constraints suggest the need
hippocampal cells. J Neurophysiol 79:1797–1813. for two distinct input systems to the hippocampal CA3 network.
Rolls ET, Stringer SM, Trappenberg TP. 2002. A unified model of Hippocampus 2:189–199.
spatial and episodic memory. Proc R Soc Lond B 269:1087–1093. Treves A, Rolls ET. 1994. A computational analysis of the role of the
Rolls ET, Xiang J-Z, Franco L. 2005. Object, space and object-space hippocampus in memory. Hippocampus 4:374–391.
representations in the primate hippocampus. J Neurophysiol 94: Wang SH, Morris RG. 2010. Hippocampal–neocortical interactions in
833–844. memory formation, consolidation, and reconsolidation. Annu Rev
Samsonovich A, McNaughton BL. 1997. Path integration and cogni- Psychol 61:49–79. C1-4.
tive mapping in a continuous attractor neural network model. Wills TJ, Lever C, Cacucci F, Burgess N, O’Keefe J. 2005. Attractor
J Neurosci 17:5900–5920. dynamics in the hippocampal representation of the local environ-
Stringer SM, Rolls ET. 2002. Invariant object recognition in the visual sys- ment. Science 308:873–876.
tem with novel views of 3D objects. Neural Comput 14:2585–2596. Wirth W, Baraduc P, Plante A, Pinede S, Duhamel J-R. 2017. Gaze-
Stringer SM, Rolls ET, Trappenberg TP, Araujo IET. 2002a. Self-orga- informed, task-situated representation of space in primate hippo-
nizing continuous attractor networks and path integration. Two- campus during virtual navigation. PLoS Biol. in press.
dimensional models of place cells. Network Comput Neural Syst Witter MP. 2007. Intrinsic and extrinsic wiring of CA3: Indications
13:429–446. for connectional heterogeneity. Learn Mem 14:705–713.
Stringer SM, Trappenberg TP, Rolls ET, Araujo IET. 2002b. Self-orga- Yates FA. 1992. The Art of Memory. Chicago, IL.: University of Chi-
nizing continuous attractor networks and path integration: One- cago Press.
dimensional models of head direction cells. Network Comput Zhang K. 1996. Representation of spatial orientation by the intrinsic
Neural Syst 13:217–242. dynamics of the head-direction cell ensemble: A theory. J Neurosci
Stringer SM, Rolls ET, Trappenberg TP. 2004. Self-organising contin- 16:2112–2126.
uous attractor networks with multiple activity packets, and the rep- Zilli EA. 2012. Models of grid cell spatial firing published 2005-
resentation of space. Neural Networks 17:5–27. 2011. Front Neural Circ 6:16.

Hippocampus

You might also like