You are on page 1of 20

REVIEWS

The neural bases for timing


of durations
Albert Tsao1 ✉, S. Aryana Yousefzadeh 2
, Warren H. Meck2, May-Britt Moser 3

and Edvard I. Moser 3 ✉


Abstract | Durations are defined by a beginning and an end, and a major distinction is drawn
between durations that start in the present and end in the future (‘prospective timing’) and
durations that start in the past and end either in the past or the present (‘retrospective timing’).
Different psychological processes are thought to be engaged in each of these cases. The former is
thought to engage a clock-like mechanism that accurately tracks the continuing passage of time,
whereas the latter is thought to engage a reconstructive process that utilizes both temporal and
non-temporal information from the memory of past events. We propose that, from a biological
perspective, these two forms of duration estimation are supported by computational processes
that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing
is effectively carried out in a single step where the ongoing dynamics of population activity directly
serve as the computation of duration, whereas retrospective timing is carried out in two steps: the
initial generation of population state dynamics through the process of event segmentation and
the subsequent computation of duration utilizing the memory of those dynamics.

Prospective timing
How the brain naturally perceives and retains time clock, which generates an explicit linear metrical rep-
The estimation of an ongoing has been the focus of many studies over the past few resentation of time that can be used for estimation of
duration in the present moment. decades1–8. As time is composed of the two concepts duration11–13. Early models proposed that the internal
of order and duration9,10, this question may be divided clock would be implemented through a pacemaker–
Events
into separate questions of how the brain perceives and accumulator mechanism11–13 in which pulses gener-
The basic units of organization
for experience, defined remembers either order or duration. In this Review, we ated by a central pacemaker would be integrated by an
primarily as perceived time focus on duration, and more specifically on whether the accumulator to generate estimates of time. However,
intervals whose beginnings processes for perceiving ongoing duration in the pres- outside the circadian system14,15, evidence for biological
and ends are clearly defined.
ent moment (prospective timing) are the same as those implementation of such a mechanism has been miss-
Retrospective timing
used for estimating duration based on memory of past ing. Subsequently, it has been proposed that the internal
The estimation of duration events (retrospective timing) (Box 1 and Fig. 1). The most clock is implemented through coincidence detection
based on memory of past basic requirement for timing is that each moment in of oscillatory activity patterns16–18, but, even though
events. time can be uniquely represented, and current evidence changes in oscillatory activity have been correlated to
suggests that both types of timing achieve this require- timing behaviour19–21, evidence of coincidence detection
1
Department of Biology, ment through population-level representations of time. has also been missing.
Stanford University,
However, how these representations arise and how they Although pacemaker–accumulator models are intu-
Stanford, CA, USA.
are subsequently used for estimating duration may differ itively familiar owing to their similarity to physical
2
Department of Psychology
and Neuroscience, Duke
substantially, and we examine and discuss the evidence clocks, a regular pacemaker is not actually needed for
University, Durham, NC, USA. for this. We also discuss a number of potentially impor- the purpose of timing duration22. Instead, time can be
3
Centre for Neural tant ways in which these two types of timing and their encoded through changes in neural population activity
Computation, Kavli Institute mechanisms might interact, although investigation of over time, or population state dynamics, as long as each
for Systems Neuroscience, these interactions still remains preliminary. moment in physical time corresponds to a unique popu­
Norwegian University of lation activity pattern. This type of timing mechanism
Science and Technology,
Trondheim, Norway.
Prospective timing has sometimes been referred to as a ‘population clock’, and
✉e-mail: at7@stanford.edu; The main computational goal for prospective timing it does not necessarily need to generate a linear metri-
edvard.moser@ntnu.no is to accurately track elapsed time within an ongoing cal representation of time23,24. Additionally, it subsumes
https://doi.org/10.1038/ interval. Consequently, a major class of models for pro- the pacemaker–accumulator mechanism into a single
s41583-022-00623-3 spective timing is based on the concept of an internal process — change in neural activity25. In the following

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

Box 1 | Terminology at least several minutes. The lower bound of 1 s reflects


the distinction between subsecond and suprasecond
In this Review, we use the terms ‘prospective timing’ and ‘retrospective timing’ timing mechanisms50–54, although there is not a strict
as shorthand for duration estimated from ongoing events and duration estimated boundary between the two as they overlap within the
from the memory of past events, respectively. Although usage of these terms is well range of roughly 0.5–1 s (refs.52,55). Indeed, potentially
established160,161,334, there are a few points to clarify regarding their usage. First,
reflecting this overlap, neural trajectories encoding dura-
retrospective timing is operationally defined as the estimation of a duration when
subjects are unaware beforehand that they will estimate the duration, whereas tions several hundred milliseconds long have also been
prospective timing is defined as estimation of duration when subjects are aware observed, with no apparent difference from trajectories
beforehand161. The logic of this operational definition is that, particularly during encoding longer durations30,43,56. The upper bound of
prospective timing, subjects have the opportunity to explicitly track the passage several minutes was established by a recent study record-
of time. Thus, in the case where estimation occurs after the duration has ended but ing neural activity while rats engaged in a task where
subjects are already aware beforehand that they will eventually estimate duration, they had to obtain a reward within a 3-s window that
this would still be considered prospective timing. Second, ‘prospective timing’ and occurred every 5 or 8 min. Stable neural trajectories in
‘retrospective timing’ refer specifically to the estimation of duration, even though the form of sequential activity were observed in both the
timing encompasses temporal order in addition to duration. Whether there exists hippocampus and the striatum spanning the entirety of
a similar distinction between temporal order based on ongoing events as opposed
the minutes-long intervals. Task performance was also
to memory of past events is unclear. Finally, ‘prospective timing’ overlaps with
other commonly used terms such as ‘interval timing’ and ‘reward timing’, whereas dependent on hippocampal activity57, consistent with a
‘retrospective timing’ partially overlaps with ‘episodic timing’, and each has also been growing number of studies suggesting that for durations
referred to as ‘experienced duration’ and ‘remembered duration’, respectively335. of tens of seconds and longer, the hippocampus may play
a central role58–61. Whether stable neural trajectories are
able to encode even longer durations beyond several
subsections, we discuss how prospective timing is car- minutes and whether there exists a maximum limit
ried out using population state dynamics, primarily remain to be determined.
focusing on a number of recent studies that have actu- Neural trajectories reflect the activity of single neu-
ally observed population state dynamics by recording rons exhibiting a range of different activity patterns,
from single neurons in animals engaged in duration some of which contain clear correlations with time.
estimation tasks. One of the most common time-related activity patterns
observed in single cells is ramping activity, where a neu-
Explicit prospective timing ron monotonically increases its firing in a linear man-
Prospective timing can occur either explicitly or implic- ner, often across the entirety of an interval22,29,31,34,39,46,62–68
itly26–28. During explicit timing, subjects are aware that they (Fig. 3a,b). Neurons exhibiting unimodal peak activity at
should specifically attend to the passage of time in order specific moments within the ongoing duration are also
to either perceive a duration defined by external sen- commonly observed30,32,35,36,38,48,69–73 (Fig. 3c). Across a
sory events (‘sensory timing’) or time their own action population of such neurons, their progressive activa-
(‘motor timing’). Recent studies recording single-cell tions form a sequence of activity that can span an inter-
activity from brain areas involved in prospective timing val. In addition to these two specific types of single-cell
provide evidence that during both sensory timing29–33 activity pattern, neural trajectories are also made up
and motor timing34–42, as well as combined sensorimo- of neurons exhibiting more complex activity patterns,
tor timing43,44, neural population activity evolves in a ranging from non-monotonic ramping activity, which
stereotyped way across a series of population activity still exhibits clear correlations with time, to patterns
states, defining a stable ‘neural trajectory’ which provides which exhibit no obvious relation to time but are never-
Population clock
significant and reliable temporal information (Fig. 2). theless stable across repeated trials29,37,43,46,74–76 (Fig. 3a,b).
The encoding of temporal Moreover, inactivation of brain areas exhibiting trajecto- Whether ramping activity and sequential activity play
information through changes ries negatively impacts duration estimation30,35,39,43,45, and special roles within prospective timing remains to be
in neural population activity trial-to-trial variability of trajectories has been observed determined, although recent computational work sug-
over time.
to be correlated with animals’ time estimates30,35,37,38,40, gests that sequential activity may be a particularly effec-
Explicit timing together suggesting a causal link from trajectories to tive representation of time for downstream readout36.
Prospective timing in which duration estimation. Beyond the timing of a single dura- For the purpose of defining a stable trajectory capable
subjects are aware that tion, neural trajectories have also been observed during of supporting prospective timing however, the only
they should attend to the the timing of multiple durations within more complex requirements placed on single-cell activity patterns
passage of time to either
estimate a duration defined
temporal structures, such as rhythmic sequences46–49. are that some subpopulation exhibits stable repeatable
by external events or generate For example, using a task in which monkeys had to tap patterns, and that across individual moments in time,
a timed action. at fixed intervals between 450 and 1,000 ms according overall population activity states are different. There is
to a metronome, Merchant and colleagues observed no requirement for single-cell activity patterns to encode
Neural trajectory
that over the course of the tapping rhythm, neural significant temporal information themselves.
A sequence of population
states over time which trajectories evolved in a circular pattern with interval
describe the evolution of duration effectively being encoded by the radius of the Implicit prospective timing
neural population activity. trajectory47,49, providing an intuitive illustration of how Prospective timing can also occur implicitly, in the
neural trajectories can function as population clocks for absence of any overt timing behaviour at all26–28,77–79
Implicit timing
Prospective timing in which
prospective timing. (implicit timing). Just as in motor timing, where subjects
no overt timing behaviour Neural trajectories are capable of encoding tempo- learn to predict when to initiate an action relative to
is required. ral information for durations spanning roughly 1 s to an external cue, in a similar manner subjects may also

www.nature.com/nrn

0123456789();:
Reviews

learn to predict when external events will happen within Because the learning of temporal expectation can
a stable and repeated temporal structure (‘temporal occur in the absence of explicit timing behaviour, any task
expectation’), allowing more efficient and accurate which contains a stable temporal structure may poten-
processing of task-related information26,77–80. As with tially engage it. Indeed, animal studies recording from
sensory and motor timing, there is also evidence that neural populations often use behavioural paradigms that
neural trajectories can encode such learned temporal contain a stable temporal structure but lack overt timing
expectations. Recording from the premotor cortex of behaviour, and a growing number of studies have now
monkeys during a detection task for a mechanical stim- observed stable neural trajectories defined by the tempo-
ulus that would occur within a fixed temporal window ral structure of these tasks, which appear to encode the
which was unannounced, Carnevale et al. observed passage of time63,71,72,86,87. Illustrative of this is the obser-
that neural population activity evolved in a manner vation of hippocampal time cells during fixed delay peri-
reflecting this window of expectation81. Specifically, ods within the stable temporal structure of trial-based
the distance between the neural trajectory and an esti- non-timing tasks such as the delayed match-to-sample
mated decision threshold within neural state space was task6,69,70,88. During this delay period, time cells individu-
reduced during the window of expectation. The impact ally fire at specific moments of time such that the overall
of temporal expectation can also extend to sensory population of these cells tiles the entire interval, and this
representations82–85. In the visual cortex of monkeys sequence of activity defines a stable neural trajectory
trained to detect a stimulus change whose likelihood (Fig. 3c). Although these sequences are observed during
of occurring followed a fixed temporal pattern, neu- tasks that lack any explicit timing behaviour that would
ral responses become modulated by this pattern82. necessitate a representation of time, control analyses and
Similarly, in the primary auditory cortex of rats trained experiments demonstrate that this sequential activity is
to discriminate a target sound that occurred with high not simply due to obvious time-correlated variables such
probability during a specific period within a trial, sin- as animal movement70,89,90, and suggest that it is in fact a
gle neurons exhibit increasingly enhanced frequency representation of the passage of time.
tuning as this period of high expectation approaches, The apparent ubiquity of stable trajectories observed
as well as enhanced tuning during the period itself 83. in non-timing tasks across a wide range of brain areas87,91,92
raises the possibility that the presence of stable trajec-
a Prospective timing b Retrospective timing tories and the ability to decode temporal information
accurately do not necessarily imply that this temporal
Physical time Physical time
information is used by the brain86,93. Although this may
Present Present be true in many cases, the fact that temporal expectation
moment moment acts on internal representations means that its effects on
Elapsed duration
behaviour may be subtler, and determining whether or
how particular representations of time are actually used
by the brain may require closer examination, similar to
Stable temporal structure Duration can be measured between
defining an interval any pair of past events what has been shown recently in the separate context of
motor learning94. As an example, recent studies by Heys
Reference point (past event) Reference points (all past events) and colleagues demonstrated that sequential activity is
End of duration present in the medial entorhinal cortex (MEC) of mice
engaged in a motor timing task95, but inactivation of the
MEC impacts behaviour only if inactivation occurrs dur-
ing the initial learning of the task, resulting in delayed
acquisition of the motor timing behaviour96. Thus, the
apparent use of MEC sequential activity may be limited
Perceived time

Perceived time

to the initial learning phase only. For motor timing tasks


in general, the initial learning of when to generate timed
Reference
event responses poses a particular challenge, as the range of
times with which a subject may respond is vast. However,
if subjects are able to form hypotheses about when to
act97,98 — temporal expectations related to learning —
this would effectively restrict the time window within
Physical time Physical time
which learning of motor timing occurs and allow more
efficient learning. Sequential activity in the MEC may
Fig. 1 | Prospective and retrospective timing. a | During prospective timing, the time serve this purpose, and such a role may generalize to
point being measured from (‘reference point’) is established beforehand, allowing the other temporal associations as well99,100. To be effective,
physical passage of time to be explicitly tracked (top). Prospective timing estimates temporal expectations guiding learning would have to
are relatively accurate but follow the scalar property, exhibiting increased variability
be generated at a much faster rate than the motor learn-
(grey shading) as physical duration increases (bottom). b | By contrast, retrospective
timing reflects the physical passage of time indirectly through the event structure of ing itself, and sequential activity in the MEC has in fact
experience, which occurs across time (top). Unlike for prospective timing, which is in been observed to arise immediately following exposure to
relation to a fixed reference event, the time points defining the interval to be estimated new environments95. Human functional imaging exper-
are freely chosen from past events. Retrospective timing estimates can be more variable iments suggest that the hippocampus may also play a
and less accurate (bottom). similar role in guiding the learning of prospective timing

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

a b
Cell 1 T3 Cell 1
T1 T2 T3
T1

Firing rate

Firing rate

Firing rate

Dim 2
Cell 2 Cell 2 Dimensionality
Cell 3 reduction
1 2 3 1 2 3 1 2 3
...
Cell no. Cell no. Cell no.
T2 Cell 3 Cell N Dim 1

c
Sensory timing Motor timing Temporal expectation
Stimulus start Stimulus end Interval start Interval end Interval start Cue

Duration 1 Duration 1
Duration 2 Duration 2
Duration 3 Duration 3
Elapsed time
Elapsed time Elapsed time

Expectation-
related
internal state

Stimulus
Dim 2

Dim 2

Dim 2
end Interval end

Stimulus start Interval start Interval start

Dim 1 Dim 1 Dim 1

d Reward
Production epoch
tp 1,000
Estimation epoch
ts
800
–0.15 0 0.15

tp (ms)
Go
(tp –ts) / ts
640
Set

Ready Ready Set 480

Time
480 640 800 480 640 800
ts (ms) ts (ms)

e Set + 200 ms
Ready 1
800
0
PC3
–1
–1
Set
Set
0 –1
PC3 PC2
0 480 0
PC1
1
1 Go
–1
0 1
1 –1 0
PC1
PC2
Estimation epoch (sensory timing) Production epoch (motor timing)

behaviours101, and hippocampal time cells also show fast Neural trajectories as a mechanism
adaptation to new temporal contexts70,102. More gener- Although similar time-varying population activity is
ally, the fact that sequential activity is observed across observed across sensory timing, motor timing and tem-
a wide range of brain areas under similar experimental poral expectation, this does not necessarily mean that
conditions may reflect the role of sequential activity as the way in which these activity patterns are subsequently
a general scaffold for supporting subsequent learning of used for time estimation is also shared across all three
time-related responses36,103. types of prospective timing. Indeed, sensory timing

www.nature.com/nrn

0123456789();:
Reviews

◀ Fig. 2 | Neural trajectories during prospective timing. a | The activity of a population of reflective of different durations can be observed at both
neurons, or population state, at a given moment can be depicted as a point within a state the population level and the single-cell level (Figs. 2c,e
space where each axis corresponds to the firing rate of a specific neuron. In this example, and 3b). Finally, for temporal expectation, the learned
there are three neurons, so the state space is three-dimensional. As the firing rates of the period of expectation is reflected through a shift in
three neurons change across time, so does the population state, tracing out a trajectory,
popu­lation state that reflects the predictable external
in this case spanning three time points (T1, T2 and T3). b | For a population consisting
of N cells, the state space is N-dimensional. Dimensionality reduction can be used
temporal structure82–85. Thus, as with motor timing,
to reduce noise and to project data onto specific subspaces, and often it is helpful to trajectory speed plays a central role in the timing of
apply dimensionality reduction techniques to more easily identify important features of expectation as it determines when this shift is reached.
neural trajectories. In this cartoon example, dimensionality reduction reveals a simpler It is important to note that for all three types of pro-
trajectory within a two-dimensional space. c | Different trajectory features are used for spective timing, estimation using neural trajectories
sensory timing, motor timing and temporal expectation. For sensory timing of different implies that the terminal state of a trajectory directly
durations (indicated by different shades of grey), a common trajectory progresses at a serves as the duration estimate — the computation of the
constant speed (starting at a common population state and reaching a common duration is carried out by the population state dynamics
intermediate state over the same amount of elapsed physical time, indicated in blue) that lead to a specific terminal state105. In other words, the
but stops at different terminal states for specific durations (indicated by different shades
evolution of activity along a neural trajectory is itself
of red). For motor timing of different durations (indicated by different shades of grey),
a common trajectory progresses at different speeds (starting at a common population the estimation process. If this is the case, then speed-
state and reaching different intermediate population states over the same amount of ing up or slowing down of population state dynamics
elapsed physical time, indicated in blue) to reach a common terminal state (different should have a predictable impact on timing. The fact
durations indicated by different shades of red). For temporal expectation, a trajectory that trial-to-trial fluctuations in trajectory speed are
begins to evolve following the start of a fixed temporal structure, and reaches a specific correlated with trial-to-trial behavioural variability
state in accordance with this temporal structure. In the illustrated example, the temporal suggests this30, but two studies have taken a somewhat
structure is defined by a cue which occurs at a fixed interval following a start signal, and more direct approach by controlling the temperature
the trajectory reaches a particular set of states (indicated in purple) at the time of the of brain areas which are involved in prospective timing
cue. This expectation-related internal state may then be reflected in an altered response and exhibit stable neural trajectories. Xu et al. found
criterion or modulation of sensory representations, for example. d | Left, structure of
that cooling the medial prefrontal cortex (which pre-
‘ready, set, go’ sensorimotor timing task. Monkeys are presented with a sample interval ts,
which they reproduce as tp through the timing of a motor action. Top centre, reward
sumably slowed down population state dynamics) of
(green shading) is a function of the relative error between ts and tp. Bottom centre, the set rats engaged in a motor timing task resulted in longer
of sample intervals used. Right, behaviour from an example monkey illustrating that response times37. Similarly, Monteiro et al. bidirection-
animals are able to carry out both sensory timing and motor timing accurately in order ally manipulated the temperature of the striatum in rats
to reproduce presented intervals. Dots indicate individual trials, and circles indicate engaged in an interval categorization task, and found
average tp per ts. e | Neural trajectories during estimation (left) and production (right) that duration judgments were shorter when the temper-
epochs, based on activity recorded from the dorsomedial frontal cortex. These two sets ature was increased (presumably speeding up population
of trajectories illustrate how prospective timing is accomplished through population state dynamics) and vice versa106. Although these studies
state dynamics: specific durations are associated either with specific population states provide support for the idea that prospective timing is
along the trajectory (estimation epoch) or specific trajectory speeds (production epoch).
carried out through population state dynamics, more
Triangles indicate ‘ready’, circles indicate ‘set’, squares indicate ‘go’ and small circles
indicate neural states at 40-ms increments. Dim, dimension; PC, principal component.
precise manipulations are still needed.
Parts d and e adapted with permission from ref.56, Elsevier. During sensory timing, because durations are
defined by external input, it is possible for the estimation
of duration to be separated from the duration itself. This
differs in a basic way from both motor timing and tem- raises the possibility of a separate, cognitively different
poral expectation in that the end of a duration during type of sensory timing. If metrical representations of
sensory timing is defined by an external event rather specific moments in physical time corresponding to the
than being internally determined23. Thus, the terminal start and end of the duration are generated and main-
state of a neural trajectory during sensory timing is dic- tained in memory, it would be possible to alternatively
tated by external input, whereas it would be internally determine duration through temporal arithmetic of
generated during motor timing or temporal expectation. these representations, rather than through population
Experimental observations are consistent with this state dynamics. This version of sensory timing would
difference between sensory timing versus motor timing also differ from sensory timing in which estimation is
and temporal expectation. In sensory and motor tim- carried out through population state dynamics but then
ing tasks where multiple durations are discriminated stored in working memory in order to guide behav-
or generated, the way in which the different durations iour at a later time point. Neurons encoding specific
are encoded differs. During discrimination of different moments in physical time have been observed, and
durations for sensory timing, neural population activity often do appear to reflect a metrical representation of
evolves along a common trajectory for all of the dura- time72,107, while neurons encoding the difference between
tions but reaches different terminal states corresponding two durations have also been observed108, suggesting that
to specific physical durations29–31,56 (Fig. 2c,e). In contrast, the brain is capable of carrying out arithmetic operations
during generation of an action at different durations for on abstract temporal quantities. Nevertheless, direct evi-
motor timing, a similar trajectory evolves for all dura- dence for estimation of duration through temporal arith-
tions, reaching a common terminal state that triggers metic remains to be observed. Moreover, in an interval
action, and the durations are instead represented by categorization task where monkeys had to categorize
the speed at which the trajectory evolves35,39,40,43,44,56,104 durations as belonging to either long or short categories,
(Fig. 2c,e). As a result, temporal scaling of activity patterns neural recordings reveal that the task is solved through

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

a Sensory timing c
Interval start Interval end Ramping Sequential activity

Cell 1 Cell 3 Cell 1

Firing rate
Cell 2 Cell 4
Cell 2

Firing rate
b Motor timing Ramping
Cell 3
Cell 1 Cell 3
Firing rate

Cell 2 Cell 4 Cell 4

Time (s) Time (s) Time (s)

Fig. 3 | single-cell activity underlying stable neural trajectories during prospective timing. a | During sensory timing,
single-cell activity evolves along the same pattern for different durations, reaching different end points dependent
on the specific duration (two example durations shown here). Grey traces show evolution of activity over the shorter
duration, and black traces show the continued evolution of activity for the longer duration. Activity patterns can be
complex and non-monotonic, as illustrated by the two example cells in the left column, or ramping, as illustrated by the
two example cells in the right column. b | During motor timing, single-cell activity exhibits temporal scaling, or stretching
of responses for longer durations (black trace compared with grey trace). This scaling occurs both for cells with complex
non-monotonic activity patterns, as illustrated by the two example cells in the left column, and for cells with ramping
activity, as illustrated in by the two example cells in the right column. c | In addition to ramping activity and more complex
non-monotonic activity patterns (as in parts a and b), single cells (four examples are shown here) can also exhibit peak
activity at specific points in time within an interval such that as a population, their peak activity defines a sequence which
spans the interval (indicated by the diagonal arrow).

population dynamics akin to motor timing rather than not only encode significant temporal information but
comparison of abstract representations of duration that are also capable of supporting temporal expectation115.
would be generated by temporal arithmetic31. Thus, the In further support of the apparent capability of local
use of abstract arithmetic operations for sensory timing recurrent circuits to generate stable trajectories support-
may be limited to specific conditions109. ing prospective timing, in vitro studies using stimula-
tion following fixed temporal patterns have found that
How stable neural trajectories arise local circuits are capable of learning these structures and
Computational insights. What are the key factors that generating stable trajectories119,120.
shape population state dynamics into stable neural Beyond illustrating that recurrent networks lacking
trajectories capable of supporting prospective timing? specialized structure are generally capable of performing
Computational studies using recurrent neural networks to prospective timing tasks and that they do so using activ-
reproduce prospective timing behaviours suggest that ity patterns similar to those which have been observed
the generation of stable trajectories can arise simply experimentally, these recurrent network models may
through interaction between recurrent dynamics within also provide additional insights into the mechanisms
a local circuit and external sensory input related to the for sensory and motor timing. A key consideration for
duration110–112. Specifically, recurrent networks lacking sensory timing is how external input is able to influence
any specialized structure113 can recapitulate both exper- the ongoing progression of the trajectory121. Within a
imentally observed timing behaviour and neural activity recurrent network, if recurrent synaptic weights are suf-
patterns at single-cell and population levels when trained ficiently weak, the network’s ability to propagate activity
to perform prospective timing tasks. For sensory timing through recurrent dynamics will be limited, and pro-
tasks, recurrent networks generate population activity gression of the trajectory will predominantly be driven
which evolves along a common trajectory to reach spe- by external input. Models based on state-dependent
cific terminal states for specific durations31,114–116. For networks 122 demonstrate that networks with weak
motor timing tasks, recurrent networks produce specific recurrent weights are in fact capable of performing sen-
Recurrent neural networks durations by modulating the speed at which a common sory timing on the subsecond timescale52,122,123. In the
Neural networks in which each
unit can receive input from
trajectory evolves43,115,117,118. For temporal expectation, case where recurrent weights are not sufficiently weak,
other units in the network recurrent networks trained on non-timing tasks with however, and the network is able to generate a trajec-
in addition to external input. fixed temporal structures generate trajectories which tory on its own, progression of the trajectory can still be

www.nature.com/nrn

0123456789();:
Reviews

influenced by external input as long as the input is suffi- distribution may also occur across different functionally
ciently strong114. For motor timing, a central question is defined subpopulations of neurons (or subspaces) within
how trajectory speed modulation occurs. Speed modu- a single area such that within-area interactions between
lation begins with the influence of duration input on the specific subpopulations of neurons may also play a role
network that determines which duration should be pro- in the generation of stable trajectories43.
duced. Assuming that duration input is transient, recur- Interactions with neuromodulatory systems also play
rent network models suggest that the influence of this a critical role in prospective timing. Manipulation of
input may occur in a population activity subspace which dopaminergic signalling, in particular, has been shown to
is orthogonal to the subspace within which the sub­ generate shifts in duration estimates, which suggest that
sequent recurrent dynamics that drive evolution of the dopaminergic neurons may control the speed at which
motor timing trajectory play out43. When duration input neural trajectories evolve125,137–141. Consistent with this,
is assumed to be tonic, a similar separation of recurrent direct recordings of dopaminergic neuron activity in the
dynamics and input into orthogonal subspaces is also substantia nigra pars compacta show that their popu­
observed117. Recurrent network models also suggest that lation activity is correlated with animals’ estimates of
within the recurrent dynamics that drive evolution of duration142,143. Additionally, optogenetic manipulation
the trajectory, the speed at which the trajectory evolves of the activity of these dopaminergic neurons shifts
may be due to the interaction of duration input with the animals’ duration estimates in a manner consistent with
nonlinear activation functions of single neurons43. control over the speed of trajectories: increased dopa-
minergic activity drives overestimation of time and vice
Experimental insights. Although local circuits may be versa142,143. Beyond control of the speed at which trajec-
capable of generating stable trajectories, experimental tories evolve, dopaminergic signalling may also have a
observations demonstrate that interareal interactions substantial influence on the initial formation of trajec-
also play an important role in the generation of stable tories through its role in reinforcement learning142,144–147.
trajectories. Human functional MRI studies consis­ In addition to the dopaminergic pathways, cholinergic
tently observe that networks of multiple brain areas are pathways have also been shown to play an important role
activated during prospective timing tasks2,124–128, and in prospective timing. Disruption of cholinergic signalling
specific areas within these networks are often engaged has a substantial impact on timing behaviour125,137,140,148,
during particular phases of a given task129–133. Thus, the but this effect typically lags by several sessions following
generation of stable trajectories may arise in part through the start of the manipulation, suggesting that its effect
interaction between multiple brain areas playing differ- is related to memory of the learned intervals and their
ent complementary roles2,125. Single-unit recordings from trajectories, rather than the ongoing evolution of trajec-
animals are beginning to provide more detailed insight tories in the present moment. Additionally, cholinergic
into what this interaction may look like. Corticostriatal input has been shown to be necessary and sufficient
interactions, in particular, may play an important role in for learning of reward timing intervals in the primary
prospective timing17,76,125, and several studies recording visual cortex149,150. Overall, a key question that remains
from both the striatum and the cortex during the same regarding the generation of stable trajectories is whether
timing task32,36,38,39,134 have observed dissociations which there exist any general principles spanning sensory tim-
suggest that the striatum may act to refine cortical tra- ing, motor timing and temporal expectation, or whether
jectories representing the passage of time135,136. In motor this process is instead better understood in terms of the
timing tasks and sensory timing tasks, respectively, the specific individual contexts in which it occurs.
striatum was found to have greater temporal informa- As we continue to learn more about how stable tra-
tion than the orbitofrontal cortex38 or the medial prefron- jectories arise, one question which may be informative is
tal cortex32. For the dorsolateral striatum in particular, whether stable trajectories arise specifically for the pur-
activity was observed to be more sequential than that pose of timing, or instead for some other function which
in either the secondary motor cortex36 or the medial occurs across time4,151. It has long been debated whether
prefrontal cortex32, suggesting that refinement within timing is supported by a dedicated central clock or dis-
the dorsolateral striatum may in part be reflected in the tributed local representations of time2,5,124,125,152,153, and,
generation of trajectories which are primarily defined by if timing is supported by distributed local representa-
sequential activity of cells which fire at specific moments tions of time reflecting the inherent temporal nature of
in time within a duration136. Consistent with this, in a many different brain functions152,154, then understand-
model trained to generate timed responses using activ- ing these functions themselves may also inform us about
ity patterns from either the dorsolateral striatum or sec- how representations of time arise. For an area such as
ondary motor cortex as input, striatal input in the form the motor cortex where the temporal nature of motor
of sequential activity allowed more consistent timing action is inherent, understanding how population state
behaviour36. However, given that both the striatum and dynamics underlie motor action may be in large part the
the cortex are composed of distinct areas involved in same as understanding motor timing. A similar overlap
different functions, whether such refinement of cortical may also exist for areas such as the striatum and the fron-
representations of time is a general function that the stri- tal cortex which are involved in reward prediction146,147,
atum carries out on the different cortical inputs it receives given that stable temporal structures are what allow
still remains to be determined. Interactions across areas reward prediction to occur. But time is also present in
may reflect the distribution of different computational less obvious functions, as illustrated by the example of
roles across separate populations of neurons, and similar path integration, carried out in part by the hippocampus

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

and the MEC. Path integration is a process defined by estimation was approximately 15 s, and consisted only of
movement over time, and the computations generating the time it took to ask participants to make the estimate,
a representation of elapsed distance may also support limiting the potential for poor memory recall to impact
the estimation of elapsed time in several ways. First, an retrospective estimates. Subsequent variations of this par-
explicit representation of both elapsed distance and aver- adigm across a wide range of conditions have consis­tently
age velocity over a period of time can be used to directly observed that prospective estimates are longer and tend
estimate elapsed time. Elapsed distance by itself may also to be less variable161,162. Second, acting on the hypo­thesis
directly serve as a rough estimate of elapsed time without that prospective and retrospective timing engage different
any additional computation. Second, the central com- cognitive processes, a number of studies have examined
putation for path integration and for estimating elapsed the effects of manipulating different cognitive varia-
time is similar — counting steps for path integration, bles and observed dissociations between prospective
and counting units of time for elapsed time — such that timing and retrospective timing161,163. For example, Block
the mechanisms which allow path integration to occur et al. modulated participants’ cognitive load by presenting
may also support estimation of elapsed time155. Finally, them with a list of words which they either simply had to
a central behaviour supported by path integration — pay attention to (low-load condition) or had to name an
homing — shares substantial similarities with the pro- associated action for (high-load condition). Prospective
cess of prospective timing. In each case, either elapsed estimates of how long the list presentation lasted under
time or distance is tracked with respect to a fixed tem- the high-load condition were significantly shorter than
poral or physical landmark, which is set at the start of the prospective estimates under the low-load condition,
behaviour. Although it remains unclear for both homing while retrospective estimates were unaffected by task
and tracking of elapsed time how reference points are difficulty and cognitive load164. This dissociation is likely
set156,157, the similarity of the computational goal in each to reflect the importance attention to the passage of time
case raises the possibility that they may share a similar plays for prospective timing specifically165.
mechanism. Beyond the computational overlap between
prospective timing and path integration, path integration Immediate and remote retrospective timing
also occurs on longer timescales than the time-related Just as prospective timing is separated into different types
functions of other areas such as the motor cortex or (implicit timing, explicit timing and sensory, motor or
the striatum. Thus, the hippocampus and other areas temporal expectation), retrospective timing is also likely
involved in path integration offer an existing solution to encompass more than one type, particularly since the
to the challenge of estimating duration across different timescales that it encompasses span a few seconds to dec-
timescales, specifically for longer durations. ades. However, systematic examination of retrospective
timing across different timescales to identify these poten-
Retrospective timing tially different types remains to be done. Nevertheless,
The major difference between prospective timing and one separate distinction that has been drawn within
retrospective timing is that in prospective timing, the start retrospective timing is between immediate estimation
of the interval is set beforehand, allowing active tracking of (when estimation directly follows the interval) and
the ongoing passage of time (Fig. 1). In contrast, retro­ remote estimation (when estimation is separated by some
spective timing can be computed only from memory of delay from the interval). Estimates made immediately fol-
the interval and events occurring within it158,159, and the lowing the interval are shorter than those made following
main computational goal for retrospective timing is a delay166–171, and this effect is true across a wide range of
the conversion of memory representations into a duration interval lengths (from tens of seconds to 15 min) as well
value. In this way, it is similar to the special instance of as delay lengths (from seconds to 1 month). Although it
sensory timing in which the estimation process is sepa- seems plausible that this difference may in part be due to
rated in time from the interval being timed. However, for the respective involvement of either short-term memory
this particular form of sensory timing, it is still possible to (for immediate estimation) or long-term memory (for
generate an explicit representation of the ongoing passage remote estimation), it still remains to be determined
of time and use memory of this explicit temporal infor- whether this difference may be attributed to specific
mation to estimate duration, whereas such a possibility memory processes (for example, memory encoding or
does not exist during retrospective timing. More impor- memory recall). Several studies additionally show that
tantly, a large number of human behavioural experiments the length of the delay has an impact on retrospective
explicitly comparing prospective timing and retrospective timing166,167,170, but a more detailed understanding of
timing have established that they generate significantly this interaction is also lacking. Because the categori-
different duration estimates for the same physical time zation of retrospective timing is currently very limited
intervals, strongly suggesting that different mechanisms and does not clearly suggest any mechanistic differences
underlie each type of timing. First, in a foundational between immediate estimation and remote estimation,
study by Hicks et al., participants estimated either pro- for the purposes of our discussion, we do not distinguish
spectively (asked before the interval) or retrospectively between different types of retrospective timing.
(asked following the interval) a 42-s duration during
which they dealt a deck of cards160. The average pro- Retrospective timing and events
spective duration estimate was 42.25 s, while the average A simple mechanism for retrospective timing would
retro­spective duration estimate was 32.28 s. The temporal be to directly encode explicit temporal information
delay between the end of the interval and retrospective (for example, timestamps in physical time) during the

www.nature.com/nrn

0123456789();:
Reviews

initial experience of an interval, such that the time of instead reflected the substantial influence that the event
an event could be directly recalled from memory rather structure of the experience (defined by high-priority
than having to be estimated from the contents of mem- events) had on retrospective timing. Similarly, additional
ory later. Although this does happen in some circum- studies have shown that manipulating event structure
stances, the normal mechanism for retrospective timing more indirectly through changes in context impact the
is instead a reconstructive process that brings together estimated duration. For example, if a basic sequence of
and utilizes temporal information from a number of dif- events such as the presentation of a list of words occurs
ferent sources158,171–178. This point is clearly demonstrated within a changing context, the estimated duration will
by several studies which observed that retrospective be longer than for the same sequence of events within
duration estimates for both public and autobiographi- a constant context. In these studies, context spanned a
cal events have similar accuracy regardless of whether wide range, from environmental190–192 to cognitive164,193
participants actually remember the events or do not to emotional190,194,195, and the increase in estimated dura-
remember them158,173,174. If temporal information was tion may be interpreted as reflecting the more complex
directly retrieved from memory, then duration estimates event structure of the experiment. Thus, the event struc-
would necessarily be less accurate for events which ture of ongoing experience has a defining influence on
were not remembered. Instead, these results suggest retrospective timing.
that duration can be actively computed using temporal
information inferred from the events which constitute Neural event trajectories
an experience179, even in the extreme case when the The close relation between event structure and retro-
experience is not one’s own. In addition to this infer- spective timing suggests that the neural mechanisms
ential construction of temporal information, retrospec- underlying the perception of events may also play a
tive timing can also draw on certain explicit forms of critical role in retrospective timing. Human behavioural
temporal information, such as temporal landmarks and experiments196,197 and functional imaging experiments198
temporal schema. Temporal landmarks are events for examining the process by which events are perceived
which temporal information is explicitly attached, such have established that continuous ongoing experience is
as birthdays or flashbulb memories177, and can aid recon- segmented into discrete events183,199. Subsequent stored
struction in a manner similar to how physical landmarks representations of these discrete events within long-term
reduce error during path integration. Temporal infor- memory may thus serve as the basis for retrospective
mation for these particular memories may be retained timing. Consistent with this, both human behavioural
over time because of their centrality to the experience180. experiments196,200–206 and human functional imaging
Temporal schema are general temporal structures within experiments207–210 demonstrate that the temporal units
experience158. These can be defined by temporal features, defined during initial online segmentation of an experi-
as in the days of the week or the seasons, but they can ence have a substantial influence on the structure of sub-
also be defined by non-temporal features, such as the sequent long-term memory for that experience, while
progression through grade levels of primary school181,182. the event boundaries determined during initial seg-
The events making up an experience also provide a mentation subsequently serve as anchors for long-term
natural source of temporal information, as they both memory211,212. Moreover, ongoing experience is in fact
occur across time and define intervals of time. Here we simultaneously segmented into events on multiple
adopt the definition of ‘event’ provided by Zacks and timescales183,213–216 such that the stored representations
Tversky183 in the context of event segmentation theory: of all segmented events would be able to flexibly sup-
“a segment of time at a given location that is conceived port time estimation across the full range of timescales
by an observer to have a beginning and an end.” Many present within episodic memory.
studies have shown that retrospective time estimates Returning to the idea from prospective timing that
are correlated with the number of remembered events neural population activity can be used to encode the
from the timed interval159,184–189. Moreover, manipulat- passage of physical time as long as each moment in time
ing the event structure of an experiment (for example, corresponds to a unique neural population activity state,
by showing a sequence of stimuli in either random or assuming events serve as the basis for retrospective tim-
fixed order) impacts the subsequent estimated dura- ing, it may likewise be the case that neural population
tion of the experiment159,184–188. In an illustrative study activity can be used for retrospective timing if each event
Event segmentation by Poynter, participants were presented with a list con- within continuous ongoing experience is represented by
The parcellation of continuous
ongoing experience into
sisting of 27 unrelated words and three high-priority a unique neural population state. Accurate retrospective
discrete events. events (last names of US presidents) that they were timing across a series of events would then depend on
instructed to pay particular attention to186. High-priority population activity evolving along a trajectory composed
Event trajectory events were either placed as the first three items of the of sufficiently distinct population states for each event.
A neural trajectory defined
list (unsegmented condition) or otherwise distributed We refer to such a trajectory defined through the pro-
through the process of event
segmentation. approximately evenly across the list (segmented con- cess of event segmentation as a neural ‘event trajectory’
dition). Participants’ retrospective estimates for seg- (Fig. 4a) . Many models of episodic memory propose
Contextual drift mented intervals were longer than their retrospective the existence of a similar time-varying temporal con-
A dynamic in which estimates for unsegmented intervals. Notably, there text signal, often referred to as ‘contextual drift’, which
representations of context
gradually change over time, as
were no differences in recall or recognition across the would allow different episodes of experience to be
a natural result of time-varying two conditions, indicating that the difference in duration linked together and organized by temporal order217–220.
inputs. estimates was not caused by differences in memory but Neural event trajectories do not necessarily have to

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

a Encoding of ongoing Evidence for event trajectories


experience into memory
Human functional imaging. A number of human func-
Event
tional imaging experiments provide evidence that event
1 trajectories occur and influence retrospective timing.

Dimension 1
2 Jenkins and Ranganath presented participants with
3
4 a sequence of objects and subsequently asked them in a
5
surprise test afterwards to indicate when specific objects
Physical time
had appeared during the overall sequence223. They found
that in the prefrontal cortex, neural population states
Dimension 2 became increasingly dissimilar as the experiment pro-
gressed. Moreover, the dissimilarity between a given
b B1 W1 W2 B2 B3 W3 B4 W4 B5 B6 W5 W6 object and temporally adjacent objects was greater for
250 s those objects whose time of occurrence was accurately
trials estimated. Thus, if the initial presentation of each object
is taken as a discrete event, accurate retrospective timing
Black walls White walls
Population state for 10 s bin was dependent on the representation of each event being
Mean state for 250 s trial
B1 B6 W1 W6 sufficiently distinct. Using a similar paradigm, Ezzyat
and Davachi presented participants with sequences
LEC CA3 MEC
100 of visual objects placed over a background that either
100 remained constant or changed within a sequence,
50 thus defining a putative event boundary209. After each
sequence, participants were asked to judge whether two
LD2

0 0 0
of the objects from the sequence were close together or
far apart in time. Whether the two objects spanned an
–50
–100 event boundary was variable, but the actual temporal
–100 distance was kept constant. Similar to the findings of
–100 0 100 –50 0 50 –50 0 50 Jenkins and Ranganath, population states in both the
LD1 LD1 LD1 hippocampus and object-selective visual cortex were less
Fig. 4 | Neural event trajectories encode event structure of experience. a | An event similar across pairs that were judged as far apart (Fig. 5a).
structure occurring across continuous physical time is encoded by discretized Taking a more naturalistic approach, Nielson et al. used
representations in neural population state space reflecting event segmentation. Left, participants’ own individual memories of autobiograph-
a sequence of events occurs across physical time. Each block corresponds to a constant ical events to examine the relationship between neural
interval of physical time, different-coloured blocks correspond to different events and activity during remote recall of these events and the
shading of blocks corresponds to the progression of a given event across physical time. actual physical durations between them when they were
Right, the neural population states evoked during the sequence of events. Each dot originally experienced224. For a month, participants wore
corresponds to the population state defined over a constant interval of physical time, a smartphone that would take photographs and record
different-coloured dots correspond to different events and shading of dots corresponds the time and location at regular intervals. At the end
to the progression of a given event across physical time. Arrows illustrate the progression
of the month, participants were imaged while recalling
of the event trajectory, with shading indicating the progression of physical time. Neural
population activity is shown in a two-dimensional population activity space. Discretized experiences cued by logged photographs. Once again,
representations arise in part through the greater rate of change of population states the amount of time separating two events when they
around event boundaries, which may be driven by a combination of changes in the were originally experienced was correlated with how
external environment as well as internal states. The event trajectory defined across different their respective population states were during
the overall sequence of events can be used for retrospective timing. b | Visualization subsequent recall (Fig. 5b). This correlation was present
of dimensionality-reduced population activity in the lateral entorhinal cortex (LEC), in the hippocampus but only for events which the par-
hippocampus (CA3) and the medial entorhinal cortex (MEC) allows observation of event ticipants could recall and was altogether absent from the
trajectories. Dimensionality reduction was performed by means of linear discriminant primary visual cortex, probably reflecting the fact that
analysis. Axes correspond to the first two linear discriminants (LD1 and LD2). During these population states are generated through episodic
a session rats foraged freely in an environment whose wall colour switched between
memory recall.
black and white over 12 trials, each approximately 250 s long, interleaved with intertrial
periods outside the environment. The generation of distinct population states for The aforementioned studies each involved behav-
each individual trial period in the LEC but not CA3 may reflect event segmentation iours that do not necessarily engage retrospective timing
on different timescales in each respective area. Panel b reprinted from ref.241, specifically but are still at the very least closely related.
Springer Nature Limited. Lositsky et al. combined functional imaging with an
explicit retrospective timing task. Participants first lis-
tened to a 25-min long story and then were asked to make
evolve gradually221 and are separate222 from ‘representa- estimates of how much time spanned different pairs of
tional drift’, which is not driven by the event structure of clips from the story225. Consistent with findings of the
ongoing experience. Finally, just as how a linear metri- other studies using simpler stimuli, larger changes in
cal representation is not required for neural trajectories population state during the initial encoding of the story
supporting prospective timing, event trajectories also do subsequently resulted in more accurate duration esti-
not imply a literal timestamping of events such that the mates. However, because the event structure of the story
specific population state associated with a given event was more complex and in part subjective, Lositsky et al.
directly indicates when it happened in physical time. could also examine whether the perceived event

www.nature.com/nrn

0123456789();:
Reviews

structures of individual participants were correlated with link across event perception, event trajectories and
their retrospective duration estimates. Lositsky et al. retrospective timing altogether.
asked participants to mark event boundaries, and found There have been very few computational models for
that the number of marked boundaries was in fact retrospective timing226, but recent work from Fountas et al.
correlated with duration estimates, providing a direct demonstrates that an event-based model for retrospective

a Encoding Left hippocampus b

Changing scene
(event boundary)
4s 6
5

Neural distance
4
Constant scene
Physical 3
time 2
0.10 1
P < 0.025

Pattern correlation (z)


0
1 day 1 week 1 month
0.05
Temporal distance test log10(time)
Rate temporal proximity:
0.00
‘Close’ ‘Far’

Very close/close/far/very far –0.05

c
Encoding of ongoing Reinstatement of population Convert neural distances into
experience into memory states from memory subjective duration estimates

d1 d1
Dimension 2

Dimension 2

d2
d2

Dimension 1 Dimension 1

Fig. 5 | relation between duration estimates and event trajectories. a | Left, structure of associative encoding
task. During an initial encoding phase, human participants were presented with multiple sequences of four images
consisting of a face or object simulus placed over a scene, which either remained constant or changed after two images,
thus defining an event boundary. Subsequently, they were presented with a pair of items (face or object) from the
encoding phase and asked to judge how close together in time they appeared during encoding, using a scale of ‘very
close’, ‘close’, ‘far’ and ‘very far’. Temporal distance estimates reflected subjective time estimates, as object pairs were
always separated by a constant physical temporal distance. Right, with use of functional MRI, hippocampal activity
was measured during the encoding phase. Similarity of population states was lower for pairs judged to be temporally
far apart than for pairs judged to be close in time, demonstrating that subjective estimates of time are related to
population states arising during initial encoding of experience. b | Measurement of the similarity of neural population
states during recall of past events occurring over a time span of 1 month (using human functional imaging) reveals that
population states for events become increasingly more separated with increased temporal distance. Thus, retrospective
timing based on population states from reinstated event trajectories is, in principle, capable of being accurate with
respect to the actual physical duration. Each individual blue dot indicates the neural distance for a pair of events, black
lines indicate regressions for individual participants of neural distance against the logarithm of physical temporal
distance and the red line indicates the average of these regressions across participants. c | During retrospective timing,
population states from an event trajectory arising during the initial encoding of experience (left) are reinstated (centre)
and subjective duration is estimated by a process in which some feature defined across the reinstated population states
(for example, distance in population state space) is converted into units of physical time (right). Left, each coloured
circle corresponds to the population state defined across a constant amount of physical time, such that events which
span longer intervals of physical time correspond to a greater number of circles and the shading of circles indicates the
progression of physical time across an individual event. Arrows illustrate the progression of the event trajectory, with
shading indicating the progression of physical time. Centre, each circle corresponds to the recalled population state
for a given event. The dashed lines indicate potential durations that could be estimated between pairs of events, and
the solid lines indicate the two specific durations (d1 and d2) which are being estimated and compared. Part a adapted
with permission from ref.209, Elsevier. Part b adapted with permission from ref.224, PNAS.

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

timing is able to reproduce key features of human retro- taken an alternative approach to understanding retro-
spective timing227. Behavioural data for retrospective tim- spective timing, studying it in the context of episodic
ing were generated by presenting participants with a video memory and focusing on the medial temporal lobe. The
of a natural scene and then asking them to estimate its medial temporal lobe has long been a point of focus for
duration. The same video was then presented to a neural studies of episodic memory using single-cell recordings
network trained to perform image classification, and the in animals242–245, and the results from human functional
frame-by-frame unit activations were recorded across dif- imaging studies209,223,225,246,247 provide evidence that the
ferent layers of the network to simulate event trajectories mechanisms for retrospective timing not only involve
across different brain areas, as might be measured by func- structures within the medial temporal lobe but are also
tional imaging. The number of salient events (defined as likely to overlap with the mechanisms for event segmen-
events poorly predicted by a generative model) was then tation and episodic memory. However, this approach
used to generate a duration estimate. Using this compu- does make a critical assumption that the representation
tational approach (previously proposed by Roseboom of time used for retrospective timing is present regard-
et al.228) to explicitly test the relation between events and less of whether animals actually engage in explicit retro-
the estimated duration of an experience, Fountas et al. spective timing. This is in part justified by the fact that
found that the model not only generated accurate duration retrospective timing occurs, by definition, without initial
estimates but also recapitulated several well-established explicit awareness of the importance of tracking time
human estimation biases, including the judgement of and is inherently post hoc.
scenes with more events as longer than scenes with fewer As a starting point for understanding the dynamics
events, despite both being of the same physical duration. of event trajectories in more detail, a number of studies
have examined how population states in the hippocam-
Single-cell recordings. Single-cell recordings from pus and the entorhinal cortex change over time as ani-
animals may allow us to gain a more detailed mecha- mals explore a constant environment236–238,240,241,248–250.
nistic understanding of event trajectory dynamics and Establishing the general paradigm for these studies,
the underlying process for event segmentation within the Mankin et al. recorded from both CA1 and CA3 while
context of retrospective timing. However, whereas many animals freely foraged within an open field environment.
well-established experimental paradigms exist for stud- The temporal structure of the experiment was such that
ying prospective timing in animals, experimental para- animals would forage for four 10-min trials, once in the
digms for retrospective timing are still at a more nascent morning and once in the afternoon six hours later, and
stage229–231. Retrospective timing is ideally studied using a animals would repeat this temporal structure daily for up
one-shot paradigm in which subjects are completely una- to a month. Within CA1, Mankin et al. observed that the
ware of the timing task until after the stimulus duration correlation between pairs of population vectors defined
has been presented, thus ensuring that no attention can at different time points decreased as a function of tem-
be explicitly focused on the passage of time and the influ- poral distance, reflecting the evolution of CA1 activity
ence of processes for estimating present duration can be along an event trajectory where events were defined by
minimized. This is challenging in animal experiments the trial structure of the experiment. Given that the same
due to the inability to directly ask animals to make time temporal structure was repeated across days, animals
estimations232 — in the vast majority of experimental par- could potentially have learned this structure implicitly
adigms, animals must learn how to respond over repeated through temporal expectation processes, generating a
trials, and in doing so may also learn to pay attention to neural trajectory that would similarly exhibit continuous
the passage of time. Nevertheless, a number of studies change over a day. However, when looking across days,
have established behavioural paradigms which capture Mankin et al. found that event trajectories continued to
a key element of retrospective timing in that animals evolve such that population states across days could also
cannot predict when to begin timing or what specific be easily differentiated, suggesting that at least in CA1,
temporal features to pay attention to a priori229–231,233–235. individual days of the same repeated experimental struc-
One paradigm, first developed using scrub jays229, is to ture were treated as unique. Other studies using similar
associate different temporal characteristics with specific experimental paradigms with fixed temporal structures
food items (for example, different types of food that spoil and free foraging repeated across days have also observed
at different durations). Animals are allowed to forage for event trajectories continue to evolve across days, while
this food and are observed to see whether they make failing to observe repeated stable neural trajectories
use of this temporal information across different time corresponding to the repeated temporal structures112,241.
points. Because the foraging time points occur at inter- Across the hippocampal subfields, event trajectories
vals determined by the experimenter, the animals cannot evolve at different rates. The rate of evolution is fastest
pre-emptively time their behaviour such that they explic- in CA2, allowing time points separated by a few hours
itly attend to the passage of time. Additionally, both the to be easily distinguished237, whereas the rate of evolu-
longer time intervals used in these experiments, span- tion is slower in CA1, allowing time points separated
ning up to multiple days, and the engagement of animals’ by a day to be easily distinguished237,238. In CA3 and
natural foraging strategies, allowing them to learn the the dentate gyrus, population states across days remain
task across relatively few trials, may limit the likelihood largely constant237,238,240,248, suggesting that the repeated
that animals learn to track time explicitly for the task. experiments across days may not be clearly differenti-
Given the close link between retrospective timing ated as separate events. However, there is evidence that
and episodic memory, many animal studies236–241 have evolution of event trajectories in the dentate gyrus may

www.nature.com/nrn

0123456789();:
Reviews

occur on much longer timescales such that time points How neural event trajectories arise
separated by several weeks become distinguishable240. The substantial influence of event structure on retrospec-
The hippocampus receives most of its cortical input tive timing implies that part of understanding the mech-
from the entorhinal cortex, which comprises a medial anisms for retrospective timing involves understanding
subdivision and a lateral subdivision251, and event trajec- the mechanisms for how events are segmented. Existing
tories have also been observed in the lateral entorhinal work suggests that event boundaries arise either as part
cortex241 (LEC) but not the MEC236,241 (Fig. 4b), which of an active process of perception in which violations of
does not differentiate between repeated experiences internal predictive models of the current ongoing event
within the same physical environment. The rate of evolu- define event boundaries259,260 or as an inherent property
tion in the LEC is faster than that in CA2 such that time of the context within which experience occurs211,261,262
points separated by minutes are easily distinguishable241, (for example, entering a new room generates an event
and this difference suggests that the entorhinal cortex boundary201). Recent functional imaging experiments
and hippocampus may each represent experience on a by Baldassano et al. demonstrate that activity patterns
different timescale. across the brain reflect the segmentation of ongoing
Single-cell recordings have also observed several experience into discrete chunks at different timescales213.
neural correlates of event segmentation. Event bound- In lower-order sensory areas, these chunks were only a
aries are the defining feature of event segmentation, few seconds long, whereas in higher-order areas, such
and beginning with the initial study of event segmenta- as the angular gyrus, these chunks could be more than
tion using human functional imaging by Zacks et al.198, 1 min long. Importantly, the shorter-timescale event
numerous studies have observed increased activity boundaries from lower-order areas aligned with the
around event boundaries198,213,252–254. Single-cell record- longer-timescale event boundaries of higher-order
ings from both rats241,255 and humans256 have similarly areas, suggesting that across the cortical processing hier-
observed altered population state dynamics follow- archy, shorter-timescale chunks are bound together to
ing event boundaries, as population states change at a form longer-timescale chunks, which eventually reach
much greater rate immediately following event bound- the level of discrete events defining the narrative level
aries (Fig. 4b). Whereas in human experiments event of episodic experience213,214,263. Consistent with this,
boundaries can be directly reported, event boundaries Baldassano et al. also observed that human-annotated
in experiments using rats require the assumption that event boundaries most closely matched event bound-
a sufficiently salient change, such as being physically aries defined by activity from higher-order areas, while
transferred between environments, is perceived as an the degree of matching also increased across the pro-
event boundary. In one study where event boundaries cessing hierarchy. Earlier in the processing hierarchy,
were defined more subtly by unannounced rule shifts, segmentation of ongoing experience may largely be due
hippocampal representations for these event boundaries to the temporal structure of the external environment
were not observed257. Representation of event bounda- and the sensory stimuli it provides, while increasing
ries extends down to the single-cell level, as cells which timescales across the hierarchy of sensory areas may
specifically fire following event boundaries have been reflect the formation of bound sensory representations
observed in both rats255 and humans256. Recording from for external stimuli such as objects and scenes. At the
the hippocampus, parahippocampal gyrus and amygdala level of the medial temporal lobe, these representations
of human patients, Zheng et al. presented participants across different sensory streams may then be integrated
with a number of different video clips which had no to generate a multimodal representation of ongoing
boundaries (one continuous video shot), soft bound- experience whose temporal structure may then be
aries (cuts to a new scene in the same video) or hard refined in higher-order areas.
boundaries (cuts to a new scene in a different video) and The initial generation of a multimodal representation
found cells which responded immediately after either of experience may occur in the LEC, which has been
hard boundaries alone, or hard and soft boundaries. In proposed to encode the experiential content of epi-
addition to cells with activity tied to event boundaries, sodic memories264, and both anatomical and functional
cells potentially representing event identify have also data suggest this possibility. Anatomically, the LEC is
been observed. Sun et al. trained animals to run four one of the major hubs for cortical input across the entire
laps around a track in order to receive a reward at a fixed brain, receiving input from an extremely diverse range
reward site258, and found that many place cells in CA1 of cortical structures265–268, and is the primary structure
maintained the same firing location for each lap but through which integrated multimodal information may
modulated their firing rate depending on the lap num- reach the hippocampus251,266,269,270. Functionally, LEC
ber. Thus, separate events corresponding to separate neurons generally respond to a wide range of stimuli
laps were encoded by single units through differences and associations241,271–282, consistent with a role in bind-
in the firing rate. In addition to the aforementioned cells, ing multimodal representations, and many LEC cells
which show transient increases in activity, cells with encode information about external features, both sen-
ramping activity set to event boundaries have also been sory and non-sensory, within an egocentric reference
observed241; although these cells exhibit time-varying frame282, which episodic memory is typically perceived
activity, they do not appear to be the primary driver through. Notably, data from two human functional
of event trajectories, as clear differentiation of indi- imaging studies suggest that entorhinal cortex activity225
vidual events is still possible when they are removed and LEC activity specifically247 during the initial encod-
from analysis. ing of ongoing experience may be particularly important

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

for later retrospective timing. This may be due to the different environments experienced within the same day
initial representation of ongoing experience generated is larger than the amount by which they change across
within the LEC being used as a default source of tempo- 2 weeks within the same environment294.
ral information. Downstream of the LEC, the functions Psychological models of memory for time have pro-
of pattern separation and pattern completion carried vided a number of different hypotheses about how tem-
out by the hippocampal subfields283 may serve as nat- poral information may be stored and used158,219,226,295,296.
ural mechanisms for segmentation of entorhinal input Among these, a temporal context model based on the
into episodic events. The fact that hippocampal activ- Laplace transform of event history is of particular impor-
ity has often been observed at the end of events may tance, offering a potentially simple explanation for how
reflect a combination of this process and consolidation event trajectories can be used to estimate duration297–299.
mechanisms for encoding these events into long-term In this model, each individual event generates a sequence
memory213,253,284–287. Importantly, all of these processes for of activity within a specific subpopulation of cells
event segmentation and the storage of event representa- such that a representation of the event persists across
tions in long-term memory define the major source of the amount of physical time that the sequence takes.
temporal information for retrospective timing. Individual cells within this sequence receive input from a
set of leaky integrators, and the time at which they fire is
How neural event trajectories are used determined by the time constants of these inputs. When
Although we know a good deal about the dynamics multiple events occur close together in time, they gener-
of hippocampal population activity during the initial ate multiple different sequences across the overall popu­
encoding of experiences, how these dynamics may lation which may or may not overlap with each other
subsequently be used to actually estimate retrospective depending on the temporal distance between the events.
duration remains essentially unknown, in large part Altogether then, these sequences provide a readout of
owing to a lack of experiments directly examining this recent events and their temporal history.
question. As a starting point, however, it seems unlikely Most importantly with regard to retrospective timing,
that the mechanisms for the actual estimation process because a common set of time constants defines how the
during retrospective timing would be exactly the same sequence of activity for any event progresses in physical
as those observed during prospective timing. The most time, a temporal metric is defined by the distribution
salient difference between retrospective timing and pro- of these time constants. Thus, specific population states
spective timing is that the estimation of duration is a (corresponding to specific events) across the overall
process separate from the initial encoding of events popu­lation define specific moments in physical time, and
defining the duration (outside certain instances of sen- the magnitude of differences in population state approxi-
sory timing which also contain this separation). Because mates durations in physical time. Extension of the model
of this separation, population state dynamics during to describe specifically how retrospective timing may be
the initial experience offer only limited insight into the carried out still remains to be done, but in broad terms,
subsequent estimation process even though they may estimation could be accomplished by counting the num-
form the basis for subsequent duration estimation — ber of changes in population state, similar to evidence
retrospective estimation of duration cannot be described accumulation processes22, by comparison of population
simply in terms of the terminal state of a trajectory or the states (for example, through repetition suppression of
speed at which a trajectory progresses. Indeed, even if match enhancement mechanisms300) or by some means
the trajectory corresponding to an interval were recalled of converting the output of a pattern separation function
and replayed in a temporally compressed manner, as has into a magnitude. Notably, the model is able to reproduce
been observed in the hippocampus in other non-temporal behavioural phenomena observed during free memory
contexts288, the trajectory’s speed or terminal state alone recall (recency and contiguity effects)297,298, bolstering its
would not be sufficient — either of these features would relevance to memory for time. Additionally, in terms of
still need to be converted into a duration value. being biologically realistic, it uses representations which
If we assume that neural event trajectories during ini- effectively take the form of experimentally observed
tial encoding of an experience are recalled253,256,284,286,289–293 time cells69,70 and ramping temporal context cells88,241,301,
and used for subsequent estimation of retrospective although it should be noted that whether time cells actu-
duration, then understanding the estimation process ally encode past event history still remains to be fully ver-
becomes a question of how event trajectories can be ified, as time cells within existing experiments could also
used to generate a duration magnitude (Fig. 5c). This be explained in terms of prospective timing mechanisms.
process would be straightforward if event trajectories Although evidence from human functional imaging
within the hippocampus progressed in a linear manner, demonstrates that temporal information about duration
as suggested by initial observations238: the difference may be present within the hippocampus302,303, the actual
between population states at the start and the end of computation of duration may ultimately be performed
an interval would directly correlate with physical dura- outside the hippocampus304,305. We have focused on how
tion. However, because event trajectories are driven by duration may be estimated from event trajectories, but
representations of ongoing events and can often exhibit there is also a role within retrospective timing for tem-
abrupt nonlinear changes due to non-temporal fac- poral landmarks and schema, particularly in cases where
tors, they are likely to be unsuitable as a linear metric events are not contiguous and span multiple experiences.
of physical time. Illustrating this point, the amount by How these different types of temporal information are
which hippocampal population states change across two together used in the estimation process still remains to be

www.nature.com/nrn

0123456789();:
Reviews

understood, and overall our understanding of the mech- of subsequent repeated experiences with the same
anisms for actual estimation of retrospective duration sequence of events builds on the recalled trajectory of
still remain very limited, but experiments examining the initial experience, but the stable temporal structure
these questions are beginning to be conducted306,307. allows learning and memory consolidation mechanisms
to shape the neural trajectory to evolve in a reproducible
Neural event trajectories and order manner which can support prospective timing. Several
Although we have focused solely on the estimation of studies provide observations consistent with this sce-
duration, timing based on memory of past events also nario. In experiments recording from ensembles of
encompasses the temporal order of events, which has single neurons in human patients, the population states
been a larger focus of study211,308–310. Within episodic observed during initial experience are in part reinstated
memory, it is notably temporal order which plays during subsequent recall256,289,291. Separately, Tsao et al.
the critical role in defining the narrative structure of observed that when animals switched between free for-
experience311 — the relative duration of events and the aging behaviour in an open field and temporally struc-
temporal distance between them are often secondary — tured lap running in a maze, the same population of LEC
and evidence from a number of studies210,246,256,309,312–315 neurons could generate unique event trajectories dur-
suggests that temporal information related to order is ing free foraging and repeated stable trajectories during
also drawn from event trajectories and is influenced by stereotyped lap running241. Human functional imaging
the process of event segmentation. The hippocampus in studies provide similar evidence that the entorhinal cor-
particular may play an important role in this process, as tex is capable of generating both event trajectories dur-
the ubiquity with which it generates sequential activity, ing episodic experience225 and stable trajectories during
including in non-spatial contexts316–320, suggests an intrin- repeated experience of a fixed event structure323. Thus,
sic capability for representing order93. In one of the first the activity of a population of entorhinal neurons would,
studies observing event trajectories, Manns et al. recorded in principle, be able to transform from an initially unique
from the hippocampus of rats engaged in an odour trajectory shaped by a single experience into a repeata-
sequence memory task in which rats were presented in ble trajectory determined by the stable temporal features
each trial with a sequences of five odours and had to indi- of that experience (that is, similar to hippocampal time
cate which of two test odours from the sequence occurred cells), although such a transformation still remains to be
earlier314. In trials where rats accurately judged order, the directly observed through time-lapse recordings.
population states for odours which were farther apart in Second, the repeated experience of stable temporal
the initial sequence were less similar (that is, their rep- structures can lead to not just the learning of stable
resentations were more distinct), while this effect was neural trajectories supporting prospective timing but
not present in trials where rats incorrectly judged order. also temporal schema. Over extended periods in which
Similarly, the event boundary-responsive cells recorded multiple experiences are framed within a constant tem-
from human patients by Zheng et al. were also predictive poral structure, a temporal schema can arise as this
of subsequent order memory, as they exhibited signif- structure is extracted from the different experiences.
icantly reduced activity in trials where temporal order The fact that childrens’ ability to estimate duration
was incorrectly remembered256. Using a paradigm similar using memory of past events develops gradually181,182,
to that used by Manns et al., Cox et al. presented mice progressing on a timescale from a single day to months
with a single sequence of five odours and then tested to years as children gain more and more experience
them with two of the odours, taking advantage of the with stable temporal structures of increasing length,
animals’ natural instinct to explore the odour presented may be related to this process. The use of temporal
earlier in the sequence more and thereby removing the schema within retrospective timing may explain how
need for a trained behavioural response315. Inactivation of subjective duration estimates for different groups of
CA3 and the LEC but not the MEC impacted encoding events spanning the same physical duration may vastly
of temporal order, again suggesting that in addition to differ324, and human functional imaging studies are now
the hippocampus, the LEC may also play a key role in the beginning to examine how temporal schema are formed
representation of events and driving the evolution of and used313,325–329. Temporal schema may also structure
event trajectories. abstract representations of time, thus allowing mental
time travel. In a recent study, human participants first
Interaction between timing mechanisms learned a list of events and their dates, and then on indi-
Although prospective timing and retrospective timing vidual trials imagined themselves at a specific timepoint
may arise through different mechanisms, they are not in the past, present or future and were asked whether
entirely isolated from each other. Within the context of a particular event from the learned list was before or
learning and memory consolidation, each may influence after this imagined position. Magnetoencephalographic
the other. First, the learning of temporal structure for recordings from participants revealed increased activ-
prospective timing may in certain instances reflect the ity in medial temporal lobe structures throughout the
transformation of temporal information within episodic trial, during both the initial imagined self-projection
memory into semantic knowledge321,322. In this case, the in time and the subsequent determination of temporal
first experience of a sequence of events with stable tem- order330,331. Such mental time travel has been proposed
poral structure generates a trajectory through popu­lation to require an allocentric-to-egocentric conversion332, and
activity space which reflects the salient features of the the allocentric representation of time supporting this
experience that drive event segmentation. The encoding may be built up through temporal schema.

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

Finally, going backwards from prospective timing is encoded within neural event trajectories, which are
to retrospective timing, learned temporal schema may a result of the event segmentation process. The sub-
directly influence the processes underlying event seg- sequent ways in which these two representations of
mentation and the online processing of experience. temporal information are used to generate duration
Recent work provides evidence that learning temporal estimates are relatively distinct. Prospective dura-
structure through repeated viewings of a video clip can tion is directly embedded within the evolution of the
shift neural activity initially tied to event boundaries for- stable trajectories, as features defined by the evolution
wards in time such that event boundaries are anticipated of these trajectories are associated with specific dura-
by neural activity333. In a similar fashion, it may be possi- tions, whereas retrospective duration must be sep-
ble for existing temporal schema to alter neural activity arately computed using reinstated population states
online in anticipation of future events. from event trajectories. Although the mechanisms for
prospective and retrospective timing are distinct, the
Conclusions two separate representations of temporal information
In this Review, we have focused on how temporal infor- arising from them — stable trajectories and event
mation is represented and used during prospective and trajectories — are likely to interact bidirectionally with
retrospective timing. For prospective timing, temporal each other.
information is encoded within stable neural trajectories,
whereas for retrospective timing, temporal information Published online xx xx xxxx

1. Buhusi, C. V. & Meck, W. H. What makes us tick? self-generated brain dynamics. Cereb. Cortex 29, 39. Emmons, E. B. et al. Rodent medial frontal control
Functional and neural mechanisms of interval timing. 4366–4380 (2018). of temporal processing in the dorsomedial striatum.
Nat. Rev. Neurosci. 6, 755–765 (2005). 22. Balcı, F. & Simen, P. A decision model of timing. J. Neurosci. 37, 8718–8733 (2017).
2. Merchant, H., Harrington, D. L. & Meck, W. H. Curr. Opin. Behav. Sci. 8, 94–101 (2016). 40. Maimon, G. & Assad, J. A. A cognitive signal for
Neural basis of the perception and estimation of time. 23. Buonomano, D. V. & Laje, R. Population clocks: motor the proactive timing of action in macaque LIP.
Annu. Rev. Neurosci. 36, 313–336 (2013). timing with neural dynamics. Trends Cogn. Sci. 14, Nat. Neurosci. 9, 948–955 (2006).
3. Grondin, S. Timing and time perception: a review 520–527 (2010). 41. Churchland, M. M. et al. Neural population dynamics
of recent behavioral and neuroscience findings and 24. Buonomano, D. V. & Mauk, M. D. Neural network during reaching. Nature 487, 51–56 (2012).
theoretical directions. Atten. Percept. Psychophys. model of the cerebellum: temporal discrimination 42. Modi, M. N., Dhawale, A. K. & Bhalla, U. S. CA1 cell
72, 561–582 (2010). and the timing of motor responses. Neural Comput. activity sequences emerge after reorganization of
4. Gibbon, J., Malapani, C., Dale, C. L. & Gallistel, C. R. 6, 38–55 (1994). network correlation structure during associative
Toward a neurobiology of temporal cognition: 25. Remington, E. D., Egger, S. W., Narain, D., Wang, J. learning. Elife 3, e01982 (2014).
advances and challenges. Curr. Opin. Neurobiol. 7, & Jazayeri, M. A dynamical systems perspective on 43. Wang, J., Narain, D., Hosseini, E. A. & Jazayeri, M.
170–184 (1997). flexible motor timing. Trends Cogn. Sci. 22, 938–952 Flexible timing by temporal scaling of cortical
5. Ivry, R. B. & Schlerf, J. E. Dedicated and intrinsic (2018). responses. Nat. Neurosci. 21, 102–110 (2018).
models of time perception. Trends Cogn. Sci. 12, 26. Coull, J. T. & Nobre, A. C. Dissociating explicit timing This study demonstrates that motor timing can
273–280 (2008). from temporal expectation with fMRI. Curr. Opin. be carried out by controlling the speed at which
6. Eichenbaum, H. Time cells in the hippocampus: a new Neurobiol. 18, 137–144 (2008). neural trajectories evolve, which is reflected in the
dimension for mapping memories. Nat. Rev. Neurosci. 27. Zelaznik, H. N., Spencer, R. M. C. & Ivry, R. B. temporal scaling of single-unit responses. Recurrent
15, 732–744 (2014). Dissociation of explicit and implicit timing in repetitive neural networks trained to perform the same timing
7. Gallistel, C. R. The Organization of Learning (The MIT tapping and drawing movements. J. Exp. Psychol. task also reach the same solution for controlling the
Press, 1990). Hum. Percept. Perform. 28, 575–588 (2002). speed at which population activity evolves.
8. Teki, S., Gu, B. M. & Meck, W. H. The persistence 28. Ivry, R. B., Spencer, R. M., Zelaznik, H. N. & 44. Egger, S. W., Remington, E. D., Chang, C.-J. &
of memory: how the brain encodes time in memory. Diedrichsen, J. The cerebellum and event timing. Jazayeri, M. Internal models of sensorimotor
Curr. Opin. Behav. Sci. 17, 178–185 (2017). Ann. N. Y. Acad. Sci. 978, 302–317 (2002). integration regulate cortical dynamics. Nat. Neurosci.
9. Fraisse, P. The Psychology of Time (Harper & Row, 29. Kim, J., Ghim, J.-W., Lee, J. H. & Jung, M. W. Neural 22, 1871–1882 (2019).
1963). correlates of interval timing in rodent prefrontal 45. Kim, J., Jung, A. H., Byun, J., Jo, S. & Jung, M. W.
10. Fraisse, P. Perception and estimation of time. cortex. J. Neurosci. 33, 13834–13847 (2013). Inactivation of medial prefrontal cortex impairs time
Annu. Rev. Psychol. 35, 1–37 (1984). This study demonstrates that sensory timing can interval discrimination in rats. Front. Behav. Neurosci.
11. Creelman, C. D. Human discrimination of auditory be carried out by evolution of a common neural 3, 38 (2009).
duration. J. Acoust. Soc. Am. 34, 582–593 (1962). trajectory reaching different terminal states for 46. Merchant, H., Zarco, W., Pérez, O., Prado, L. &
12. Treisman, M. Temporal discrimination and the different physical durations. Bartolo, R. Measuring time with different neural
indifference interval: implications for a model 30. Gouvêa, T. S. et al. Striatal dynamics explain duration chronometers during a synchronization-continuation
of the “internal clock”. Psychol. Monogr. Gen. Appl. judgments. Elife 4, e11386 (2015). task. Proc. Natl Acad. Sci. USA 108, 19784–19789
77, 1–31 (1963). 31. Mendoza, G., Méndez, J. C., Pérez, O., Prado, L. & (2011).
13. Gibbon, J., Church, R. M. & Meck, W. H. Scalar timing Merchant, H. Neural basis for categorical boundaries 47. Gámez, J., Mendoza, G., Prado, L., Betancourt, A. &
in memory. Ann. N. Y. Acad. Sci. 423, 52–77 (1984). in the primate pre-SMA during relative categorization Merchant, H. The amplitude in periodic neural state
14. Reppert, S. M. & Weaver, D. R. Coordination of circadian of time intervals. Nat. Commun. 9, 1098 (2018). trajectories underlies the tempo of rhythmic tapping.
timing in mammals. Nature 418, 935–941 (2002). 32. Kim, J., Kim, D. & Jung, M. W. Distinct dynamics PLoS Biol. 17, e3000054 (2019).
15. Welsh, D. K., Logothetis, D. E., Meister, M. & of striatal and prefrontal neural activity during 48. Crowe, D. A., Zarco, W., Bartolo, R. & Merchant, H.
Reppert, S. M. Individual neurons dissociated from temporal discrimination. Front. Integr. Neurosci. Dynamic representation of the temporal and
rat suprachiasmatic nucleus express independently 12, 34 (2018). sequential structure of rhythmic movements in the
phased circadian firing rhythms. Neuron 14, 697–706 33. Shimbo, A., Izawa, E.-I. & Fujisawa, S. Scalable primate medial premotor cortex. J. Neurosci. 34,
(1995). representation of time in the hippocampus. Sci. Adv. 11972 (2014).
16. Miall, C. The storage of time intervals using oscillating 7, eabd7013 (2021). 49. Merchant, H. et al. Sensorimotor neural dynamics during
neurons. Neural Comput. 1, 359–371 (1989). 34. Mita, A., Mushiake, H., Shima, K., Matsuzaka, Y. isochronous tapping in the medial premotor cortex of
17. Matell, M. S. & Meck, W. H. Cortico-striatal circuits & Tanji, J. Interval time coding by neurons in the the macaque. Eur. J. Neurosci. 41, 586–602 (2015).
and interval timing: coincidence detection of oscillatory presupplementary and supplementary motor areas. 50. Lewis, P. A. & Miall, R. C. Distinct systems for automatic
processes. Brain Res. Cogn. Brain Res. 21, 139–170 Nat. Neurosci. 12, 502–507 (2009). and cognitively controlled time measurement: evidence
(2004). 35. Mello, G. B., Soares, S. & Paton, J. J. A scalable from neuroimaging. Curr. Opin. Neurobiol. 13,
18. Gu, B. M., van Rijn, H. & Meck, W. H. Oscillatory population code for time in the striatum. Curr. Biol. 250–255 (2003).
multiplexing of neural population codes for interval 25, 1113–1122 (2015). 51. Rammsayer, T. H. Neuropharmacological evidence
timing and working memory. Neurosci. Biobehav. Rev. 36. Zhou, S., Masmanidis, S. C. & Buonomano, D. V. for different timing mechanisms in humans. Q. J. Exp.
48, 160–185 (2015). Neural sequences as an optimal dynamical regime for Psychol. B 52, 273–286 (1999).
19. Bartolo, R., Prado, L. & Merchant, H. Information the readout of time. Neuron https://doi.org/10.1016/ 52. Karmarkar, U. R. & Buonomano, D. V. Timing in the
processing in the primate basal ganglia during j.neuron.2020.08.020 (2020). absence of clocks: encoding time in neural network
sensory-guided and internally driven rhythmic tapping. 37. Xu, M., Zhang, S. Y., Dan, Y. & Poo, M. M. states. Neuron 53, 427–438 (2007).
J. Neurosci. 34, 3910 (2014). Representation of interval timing by temporally This study provides the first empirical evidence,
20. Kononowicz, T. W. & Rijn, H. V. Single trial beta scalable firing patterns in rat prefrontal cortex. in the form of behavioural results based on
oscillations index time estimation. Neuropsychologia Proc. Natl Acad. Sci. USA 111, 480–485 (2014). predictions from a state-dependent network, that
75, 381–389 (2015). 38. Bakhurin, K. I. et al. Differential encoding of time by timing may be carried out through non-metrical
21. Kononowicz, T. W., Roger, C. & van Wassenhove, V. prefrontal and striatal network dynamics. J. Neurosci. changes in neural population activity, as opposed
Temporal metacognition as the decoding of 37, 854 (2017). to a dedicated internal clock.

www.nature.com/nrn

0123456789();:
Reviews

53. Rammsayer, T. H. & Lima, S. D. Duration discrimination to spatial locations and to time intervals as revealed 100. Kitamura, T. et al. Island cells control temporal
of filled and empty auditory intervals: cognitive by both PET and fMRI. J. Neurosci. 18, 7426 (1998). association memory. Science 343, 896–901 (2014).
and perceptual factors. Percept. Psychophys. 50, This study provides the first insights into the 101. Polti, I., Nau, M., Kaplan, R., van Wassenhove, V. &
565–574 (1991). neural mechanisms for temporal expectation, Doeller, C. F. Rapid encoding of task regularities in
54. Spencer, R. M. C., Karmarkar, U. & Ivry, R. B. demonstrating that a network of brain areas is the human hippocampus guides sensorimotor timing.
Evaluating dedicated and intrinsic models of temporal involved in temporal expectation, and differs from bioRxiv https://doi.org/10.1101/2021.08.03.454928
encoding by varying context. Philos. Trans. R. Soc. the network of brain areas involved in spatial (2022).
Lond. B Biol. Sci. 364, 1853–1863 (2009). attention. 102. Taxidis, J. et al. Differential emergence and stability
55. Rammsayer, T. H., Borter, N. & Troche, S. J. 78. Nobre, A. C. & van Ede, F. Anticipated moments: of sensory and temporal representations in
Visual-auditory differences in duration discrimination temporal structure in attention. Nat. Rev. Neurosci. context-specific hippocampal sequences. Neuron
of intervals in the subsecond and second range. 19, 34–48 (2018). https://doi.org/10.1016/j.neuron.2020.08.028
Front. Psychol. https://doi.org/10.3389/ 79. Nobre, A. C., Correa, A. & Coull, J. T. The hazards of (2020).
fpsyg.2015.01626 (2015). time. Curr. Opin. Neurobiol. 17, 465–470 (2007). 103. Buzsáki, G. & Llinás, R. Space and time in the brain.
56. Sohn, H., Narain, D., Meirhaeghe, N. & Jazayeri, M. 80. Miniussi, C., Wilding, E. L., Coull, J. T. & Nobre, A. C. Science 358, 482 (2017).
Bayesian computation through cortical latent Orienting attention in time. Modulation of brain 104. Remington, E. D., Narain, D., Hosseini, E. A. &
dynamics. Neuron 103, 934–947.e935 (2019). potentials. Brain 122, 1507–1518 (1999). Jazayeri, M. Flexible sensorimotor computations
57. Shikano, Y., Ikegaya, Y. & Sasaki, T. Minute-encoding 81. Carnevale, F., de Lafuente, V., Romo, R., Barak, O. through rapid reconfiguration of cortical dynamics.
neurons in hippocampal-striatal circuits. Curr. Biol. & Parga, N. Dynamic control of response criterion in Neuron 98, 1005–1019.e1005 (2018).
https://doi.org/10.1016/j.cub.2021.01.032 (2021). premotor cortex during perceptual detection under 105. Driscoll, L. N., Golub, M. D. & Sussillo, D. Computation
58. Jacobs, N. S., Allen, T. A., Nguyen, N. & Fortin, N. J. temporal uncertainty. Neuron 86, 1067–1077 (2015). through cortical dynamics. Neuron 98, 873–875
Critical role of the hippocampus in memory for This study demonstrates neural trajectories (2018).
elapsed time. J. Neurosci. 33, 13888 (2013). evolving in a manner reflecting the influence of 106. Monteiro, T. et al. Using temperature to analyse the
59. Meck, W. H., Church, R. M. & Matell, M. S. temporal expectation, with neural population neural basis of a latent temporal decision. bioRxiv
Hippocampus, time, and memory–a retrospective activity moving closer to a decision threshold https://doi.org/10.1101/2020.08.24.251827
analysis. Behav. Neurosci. 127, 642–654 (2013). during the appropriate time window. (2021).
60. Palombo, D. J., Keane, M. M. & Verfaellie, M. Does 82. Ghose, G. M. & Maunsell, J. H. R. Attentional 107. Cao, R., Bladon, J. H., Charczynski, S. J.,
the hippocampus keep track of time? Hippocampus modulation in visual cortex depends on task timing. Hasselmo, M. E. & Howard, M. W. Internally
26, 372–379 (2016). Nature 419, 616–620 (2002). generated time in the rodent hippocampus is
61. Sabariego, M. et al. In the temporal organization This study demonstrates that the activity of logarithmically compressed. bioRxiv https://doi.org/
of episodic memory, the hippocampus supports the individual neurons can be modulated by temporal 10.1101/2021.10.25.465750 (2021).
experience of elapsed time. Hippocampus 31, 46–55 expectation, following the temporal structure of the 108. Genovesio, A., Tsujimoto, S. & Wise, S. P. Feature-
(2021). hazard rate for when a target stimulus might occur. and order-based timing representations in the frontal
62. Narayanan, N. S. Ramping activity is a cortical 83. Jaramillo, S. & Zador, A. M. The auditory cortex cortex. Neuron 63, 254–266 (2009).
mechanism of temporal control of action. Curr. Opin. mediates the perceptual effects of acoustic temporal 109. Meck, W. H. & Church, R. M. Abstraction of temporal
Behav. Sci. 8, 226–230 (2016). expectation. Nat. Neurosci. 14, 246–251 (2011). attributes. J. Exp. Psychol. Anim. Behav. Process. 8,
63. Komura, Y. et al. Retrospective and prospective coding 84. Janssen, P. & Shadlen, M. N. A representation of 226–243 (1982).
for predicted reward in the sensory thalamus. Nature the hazard rate of elapsed time in macaque area LIP. 110. Buonomano, D. V. A learning rule for the emergence
412, 546–549 (2001). Nat. Neurosci. 8, 234–241 (2005). of stable dynamics and timing in recurrent networks.
64. Parker, K. L., Alberico, S. L., Miller, A. D. & 85. Anderson, B. & Sheinberg, D. L. Effects of temporal J. Neurophysiol. 94, 2275–2283 (2005).
Narayanan, N. S. Prefrontal D1 dopamine signaling context and temporal expectancy on neural activity 111. Liu, J. K. & Buonomano, D. V. Embedding multiple
is necessary for temporal expectation during reaction in inferior temporal cortex. Neuropsychologia 46, trajectories in simulated recurrent neural networks
time performance. Neuroscience 255, 246–254 947–957 (2008). in a self-organizing manner. J. Neurosci. 29, 13172
(2013). 86. Toso, A., Reinartz, S., Pulecchi, F. & Diamond, M. E. (2009).
65. Lebedev, M. A., O’Doherty, J. E. & Nicolelis, M. A. L. Time coding in rat dorsolateral striatum. Neuron 109, 112. Itskov, V., Curto, C., Pastalkova, E. & Buzsáki, G.
Decoding of temporal intervals from cortical 3663–3673.e3666 (2021). Cell assembly sequences arising from spike threshold
ensemble activity. J. Neurophysiol. 99, 166–186 87. Kobak, D. et al. Demixed principal component analysis adaptation keep track of time in the hippocampus.
(2008). of neural population data. Elife https://doi.org/10.7554/ J. Neurosci. 31, 2828 (2011).
66. Tanaka, M. Cognitive signals in the primate motor eLife.10989 (2016). 113. Rajan, K., Harvey, C. D. & Tank, D. W. Recurrent
thalamus predict saccade timing. J. Neurosci. 27, 88. Umbach, G. et al. Time cells in the human network models of sequence generation and memory.
12109 (2007). hippocampus and entorhinal cortex support episodic Neuron 90, 128–142 (2016).
67. Jazayeri, M. & Shadlen, M. N. A neural mechanism memory. Proc. Natl Acad. Sci. USA 117, 28463 114. Goudar, V. & Buonomano, D. V. Encoding sensory
for sensing and reproducing a time interval. Curr. Biol. (2020). and motor patterns as time-invariant trajectories in
25, 2599–2609 (2015). 89. Kraus, B. J., Robinson, R. J. II, White, J. A., recurrent neural networks. Elife https://doi.org/10.7554/
68. Kunimatsu, J., Suzuki, T. W., Ohmae, S. & Tanaka, M. Eichenbaum, H. & Hasselmo, M. E. Hippocampal eLife.31134 (2018).
Different contributions of preparatory activity in the “time cells”: time versus path integration. Neuron 78, 115. Bi, Z. & Zhou, C. Understanding the computation of
basal ganglia and cerebellum for self-timing. Elife 7, 1090–1101 (2013). time using neural network models. Proc. Natl Acad.
e35676 (2018). 90. MacDonald, C. J., Carrow, S., Place, R. & Sci. USA 117, 10530 (2020).
69. Pastalkova, E., Itskov, V., Amarasingham, A. & Eichenbaum, H. Distinct hippocampal time cell 116. Pérez, O. & Merchant, H. The synaptic properties
Buzsáki, G. Internally generated cell assembly sequences represent odor memories in immobilized of cells define the hallmarks of interval timing in
sequences in the rat hippocampus. Science 321, rats. J. Neurosci. 33, 14607–14616 (2013). a recurrent neural network. J. Neurosci. 38, 4186
1322–1327 (2008). 91. Cueva Christopher, J. et al. Low-dimensional dynamics (2018).
This article demonstrates sequential activity in the for working memory and time encoding. Proc. Natl 117. Hardy, N. F., Goudar, V., Romero-Sosa, J. L. &
hippocampus which spans a delay period in which Acad. Sci. USA 117, 23021–23032 (2020). Buonomano, D. V. A model of temporal scaling
animals run in a fixed location. 92. Koay, S. A., Charles, A. S., Thiberge, S. Y., Brody, C. D. correctly predicts that motor timing improves with
70. MacDonald, C. J., Lepage, K. Q., Eden, U. T. & & Tank, D. W. Sequential and efficient neural-population speed. Nat. Commun. 9, 4732 (2018).
Eichenbaum, H. Hippocampal “time cells” bridge the coding of complex task information. Neuron 110, 118. Laje, R. & Buonomano, D. V. Robust timing and
gap in memory for discontiguous events. Neuron 71, 328–349.e311 (2022). motor patterns by taming chaos in recurrent neural
737–749 (2011). 93. Buzsáki, G. & Tingley, D. Space and time: the networks. Nat. Neurosci. 16, 925–933 (2013).
71. Jin, D. Z., Fujii, N. & Graybiel, A. M. Neural hippocampus as a sequence generator. Trends Cogn. Sci. This study demonstrates that recurrent neural
representation of time in cortico-basal ganglia 22, 853–869 (2018). networks are able to generate stable trajectories
circuits. Proc. Natl Acad. Sci. USA 106, 19156 94. Kawai, R. et al. Motor cortex is required for learning capable of carrying out motor timing.
(2009). but not for executing a motor skill. Neuron 86, 119. Goel, A. & Buonomano, D. V. Temporal interval
72. Tiganj, Z., Jung, M. W., Kim, J. & Howard, M. W. 800–812 (2015). learning in cortical cultures is encoded in intrinsic
Sequential firing codes for time in rodent medial 95. Heys, J. G. & Dombeck, D. A. Evidence for a subcircuit network dynamics. Neuron 91, 320–327 (2016).
prefrontal cortex. Cereb. Cortex 27, 5663–5671 in medial entorhinal cortex representing elapsed time 120. Johnson, H. A., Goel, A. & Buonomano, D. V.
(2017). during immobility. Nat. Neurosci. 21, 1574–1582 Neural dynamics of in vitro cortical networks reflects
73. Murakami, M., Vicente, M. I., Costa, G. M. & (2018). experienced temporal patterns. Nat. Neurosci. 13,
Mainen, Z. F. Neural antecedents of self-initiated 96. Heys, J. G., Wu, Z., Allegra Mascaro, A. L. & 917–919 (2010).
actions in secondary motor cortex. Nat. Neurosci. Dombeck, D. A. Inactivation of the medial entorhinal 121. Ahrens, M. B. & Sahani, M. Observers exploit
17, 1574–1582 (2014). cortex selectively disrupts learning of interval timing. stochastic models of sensory change to help judge
74. Namboodiri, V. M. K., Huertas, M. A., Monk, K. J., Cell Rep. 32, 108163 (2020). the passage of time. Curr. Biol. 21, 200–206 (2011).
Shouval, H. Z. & Hussain Shuler, M. G. Visually cued 97. Leong, Y. C., Radulescu, A., Daniel, R., DeWoskin, V. 122. Buonomano, D. V. & Maass, W. State-dependent
action timing in the primary visual cortex. Neuron 86, & Niv, Y. Dynamic interaction between reinforcement computations: spatiotemporal processing in
319–330 (2015). learning and attention in multidimensional cortical networks. Nat. Rev. Neurosci. 10, 113–125
75. Shuler, M. G. & Bear, M. F. Reward timing in the environments. Neuron 93, 451–463 (2017). (2009).
primary visual cortex. Science 311, 1606 (2006). 98. Radulescu, A., Niv, Y. & Ballard, I. Holistic 123. Buonomano, D. V. & Merzenich, M. M. Temporal
76. Matell, M. S., Meck, W. H. & Nicolelis, M. A. reinforcement learning: the role of structure and information transformed into a spatial code by a
Interval timing and the encoding of signal duration attention. Trends Cogn. Sci. 23, 278–292 (2019). neural network with realistic properties. Science 267,
by ensembles of cortical and striatal neurons. 99. Suh, J., Rivest, A. J., Nakashiba, T., Tominaga, T. & 1028–1030 (1995).
Behav. Neurosci. 117, 760–773 (2003). Tonegawa, S. Entorhinal cortex layer III input to the 124. Wiener, M., Turkeltaub, P. & Coslett, H. B. The image
77. Coull, J. T. & Nobre, A. C. Where and when to pay hippocampus is crucial for temporal association of time: a voxel-wise meta-analysis. Neuroimage 49,
attention: the neural systems for directing attention memory. Science 334, 1415–1420 (2011). 1728–1740 (2010).

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

125. Coull, J. T., Cheng, R. K. & Meck, W. H. 152. Paton, J. J. & Buonomano, D. V. The neural basis of 179. Friedman, W. J. Time in autobiographical memory.
Neuroanatomical and neurochemical substrates of timing: distributed mechanisms for diverse functions. Soc. Cogn. 22, 591–605 (2004).
timing. Neuropsychopharmacology 36, 3–25 (2011). Neuron 98, 687–705 (2018). 180. Shum, M. S. The role of temporal landmarks in
126. Rao, S. M. et al. Distributed neural systems underlying 153. van Rijn, H., Gu, B. M. & Meck, W. H. Dedicated autobiographical memory processes. Psychol. Bull.
the timing of movements. J. Neurosci. 17, 5528 clock/timing-circuit theories of time perception and 124, 423–442 (1998).
(1997). timed performance. Adv. Exp. Med. Biol. 829, 75–99 181. Friedman, W. J. The development of children’s
127. Coull, J. T., Vidal, F., Nazarian, B. & Macar, F. (2014). memory for the time of past events. Child. Dev. 62,
Functional anatomy of the attentional modulation 154. Wiener, M., Matell, M. & Coslett, H. Multiple 139–155 (1991).
of time estimation. Science 303, 1506–1508 mechanisms for temporal processing. Front. Integr. 182. Friedman, W. J. in Time, Action and Cognition: Towards
(2004). Neurosci. https://doi.org/10.3389/fnint.2011.00031 Bridging the Gap: 66 (NATO Science Series D, 66)
128. Stevens, M. C., Kiehl, K. A., Pearlson, G. & (2011). (eds. Macar, F., Pouthas, V. & Friedman, W. J.)
Calhoun, V. D. Functional neural circuits for mental 155. Issa, J. B., Tocker, G., Hasselmo, M. E., Heys, J. G. & 165–172 (Springer, 1992).
timekeeping. Hum. Brain Mapp. 28, 394–408 (2007). Dombeck, D. A. Navigating through time: a spatial 183. Zacks, J. M. & Tversky, B. Event structure in perception
129. Coull, J. T., Nazarian, B. & Vidal, F. Timing, storage, navigation perspective on how the brain may encode and conception. Psychol. Bull. 127, 3–21 (2001).
and comparison of stimulus duration engage discrete time. Annu. Rev. Neurosci. https://doi.org/10.1146/ 184. Zakay, D., Tsal, Y., Moses, M. & Shahar, I. The role of
anatomical components of a perceptual timing annurev-neuro-101419-011117 (2020). segmentation in prospective and retrospective time
network. J. Cogn. Neurosci. 20, 2185–2197 (2008). 156. Bausenhart, K. M., Bratzke, D. & Ulrich, R. Formation estimation processes. Mem. Cogn. 22, 344–351
130. Harrington, D. L. et al. Neural representation of interval and representation of temporal reference information. (1994).
encoding and decision making. Cogn. Brain Res. 21, Curr. Opin. Behav. Sci. 8, 46–52 (2016). 185. Poynter, D. in Time and Human Cognition: A Life-Span
193–205 (2004). 157. Savelli, F. & Knierim, J. J. Origin and role of path Perspective (eds. Levin, I. & Zakay, D.) 305–331
131. Harrington, D. L., Zimbelman, J. L., Hinton, S. C. & integration in the cognitive representations of the (North-Holland, 1989).
Rao, S. M. Neural modulation of temporal encoding, hippocampus: computational insights into open 186. Poynter, W. D. Duration judgment and the segmentation
maintenance, and decision processes. Cereb. Cortex questions. J. Exp. Biol. 222, jeb188912 (2019). of experience. Mem. Cogn. 11, 77–82 (1983).
20, 1274–1285 (2010). 158. Friedman, W. J. Memory for the time of past events. 187. Poynter, W. D. & Homa, D. Duration judgment and
132. Pouthas, V. et al. Neural network involved in time Psychol. Bull. 113, 44–66 (1993). the experience of change. Percept. Psychophys. 33,
perception: an fMRI study comparing long and short 159. Ornstein, R. E. On the Experience of Time (Penguin, 548–560 (1983).
interval estimation. Hum. Brain Mapp. 25, 433–441 1969). 188. Boltz, M. G. Effects of event structure on retrospective
(2005). 160. Hicks, R. E., Miller, G. W. & Kinsbourne, M. duration judgments. Percept. Psychophys. 57,
133. Rao, S. M., Mayer, A. R. & Harrington, D. L. Prospective and retrospective judgments of time 1080–1096 (1995).
The evolution of brain activation during temporal as a function of amount of information processed. 189. Predebon, J. Organization of stimulus events and
processing. Nat. Neurosci. 4, 317–323 (2001). Am. J. Psychol. 89, 719–730 (1976). remembered apparent duration. Aust. J. Psychol. 36,
134. Emmons, E. et al. Temporal learning among prefrontal 161. Block, R. A. & Zakay, D. Prospective and retrospective 161–169 (1984).
and striatal ensembles. Cereb. Cortex Commun. 1, duration judgments: a meta-analytic review. Psychon. 190. Block, R. A. Temporal judgments and contextual
tgaa058 (2020). Bull. Rev. 4, 184–197 (1997). change. J. Exp. Psychol. Learn. Mem. Cogn. 8,
135. Athalye, V. R., Carmena, J. M. & Costa, R. M. 162. Tobin, S., Bisson, N. & Grondin, S. An ecological 530–544 (1982).
Neural reinforcement: re-entering and refining approach to prospective and retrospective timing of 191. Block, R. A. Remembered duration: imagery processes
neural dynamics leading to desirable outcomes. long durations: a study involving gamers. PLoS ONE 5, and contextual encoding. Acta Psychol. 62, 103–122
Curr. Opin. Neurobiol. 60, 145–154 (2020). e9271 (2010). (1986).
136. Murray, J. M. & Escola, G. S. Learning multiple 163. Block, R. A., Hancock, P. A. & Zakay, D. How cognitive 192. Faber, M. & Gennari, S. P. In search of lost time:
variable-speed sequences in striatum via cortical load affects duration judgments: a meta-analytic reconstructing the unfolding of events from memory.
tutoring. Elife https://doi.org/10.7554/eLife.26084 review. Acta Psychol. 134, 330–343 (2010). Cognition 143, 193–202 (2015).
(2017). 164. Block, R. A. in Time, Action and Cognition: Towards 193. Block, R. A. & Reed, M. A. Remembered duration:
137. Meck, W. H. Neuropharmacology of timing and time Bridging the Gap: 66 (NATO Science Series D, 66) evidence for a contextual-change hypothesis.
perception. Brain Res. Cogn. Brain Res. 3, 227–242 (eds. Macar, F., Pouthas, V. & Friedman, W. J.) J. Exp. Psychol. Hum. Learn. Mem. 4, 656–665
(1996). 141–152 (Springer, 1992). (1978).
138. Agostino, P. V. & Cheng, R.-K. Contributions of 165. Polti, I., Martin, B. & van Wassenhove, V. The effect 194. Kellaris, J. J. & Kent, R. J. The influence of music on
dopaminergic signaling to timing accuracy and of attention and working memory on the estimation of consumers’ temporal perceptions: Does time fly when
precision. Curr. Opin. Behav. Sci. 8, 153–160 (2016). elapsed time. Sci. Rep. 8, 6690 (2018). you’re having fun. J. Consum. Psychol. 1, 365–376
139. Maricq, A. V., Roberts, S. & Church, R. M. 166. Zakay, D. & Fallach, E. Immediate and remote time (1992).
Methamphetamine and time estimation. J. Exp. estimation — a comparison. Acta Psychol. 57, 69–81 195. Pollatos, O., Laubrock, J. & Wittmann, M. Interoceptive
Psychol. Anim. Behav. Process. 7, 18–30 (1981). (1984). focus shapes the experience of time. PLoS ONE 9,
140. Meck, W. H. Selective adjustment of the speed of 167. Grondin, S., Laflamme, V., Bisson, N. & Désautels, F. e86934 (2014).
internal clock and memory processes. J. Exp. Psychol. The delay before recall changes the remembered 196. Newtson, D. & Engquist, G. The perceptual
Anim. Behav. Process. 9, 171–201 (1983). duration of 15-minute video sequences. Appl. Cogn. organization of ongoing behavior. J. Exp. Soc. Psychol.
141. Meck, W. H. Affinity for the dopamine D2 receptor Psychol. 28, 677–684 (2014). 12, 436–450 (1976).
predicts neuroleptic potency in decreasing the speed 168. Pedri, S. & Hesketh, B. Time perception: effects of task 197. Newtson, D., Engquist, G. A. & Bois, J. The objective
of an internal clock. Pharmacol. Biochem. Behav. 25, speed and delay. Percept. Mot. Skills 76, 599–608 basis of behavior units. J. Pers. Soc. Psychol. 35,
1185–1189 (1986). (1993). 847–862 (1977).
142. Soares, S., Atallah, B. V. & Paton, J. J. Midbrain 169. Vitulli, W. F. & Crimmins, K. A. Immediate versus 198. Zacks, J. M. et al. Human brain activity time-locked
dopamine neurons control judgment of time. Science remote judgements: delay of response and rate to perceptual event boundaries. Nat. Neurosci. 4,
354, 1273 (2016). of stimulus presentation in time estimation. 651–655 (2001).
143. Howard, C. D., Li, H., Geddes, C. E. & Jin, X. Dynamic Percept. Mot. Skills 86, 19–22 (1998). This study provides the first demonstration
nigrostriatal dopamine biases action selection. Neuron 170. Vitulli, W. F. & Shepard, H. A. Time estimation: of neural activity changes related to event
93, 1436–1450.e1438 (2017). effects of cognitive task, presentation rate, and delay. segmentation.
144. Daw, N. D., Courville, A. C. & Touretzky, D. S. Percept. Mot. Skills 83, 1387–1394 (1996). 199. Kurby, C. A. & Zacks, J. M. Segmentation in the
Representation and timing in theories of the dopamine 171. Loftus, E. F., Schooler, J. W., Boone, S. M. & Kline, D. perception and memory of events. Trends Cogn. Sci.
system. Neural Comput. 18, 1637–1677 (2006). Time went by so slowly: overestimation of event 12, 72–79 (2008).
145. Gershman, S. J., Moustafa, A. A. & Ludvig, E. A. duration by males and females. Appl. Cogn. Psychol. 200. DuBrow, S. & Davachi, L. The influence of context
Time representation in reinforcement learning models 1, 3–13 (1987). boundaries on memory for the sequential order
of the basal ganglia. Front. Comput. Neurosci. 7, 194 172. Brown, N. R. Organization of public events in of events. J. Exp. Psychol. Gen. 142, 1277–1286
(2014). long-term memory. J. Exp. Psychol. Gen. 119, (2013).
146. Mikhael, J. G. & Gershman, S. J. Adapting the 297–314 (1990). 201. Horner, A. J., Bisby, J. A., Wang, A., Bogus, K. &
flow of time with dopamine. J. Neurophysiol. 121, 173. Burt, C. D. B. Reconstruction of the duration of Burgess, N. The role of spatial boundaries in shaping
1748–1760 (2019). autobiographical events. Mem. Cogn. 20, 124–132 long-term event representations. Cognition 154,
147. Petter, E. A., Gershman, S. J. & Meck, W. H. Integrating (1992). 151–164 (2016).
models of interval timing and reinforcement learning. 174. Burt, C. D. B. & Kemp, S. Retrospective duration 202. Sargent, J. Q. et al. Event segmentation ability
Trends Cogn. Sci. 22, 911–922 (2018). estimation of public events. Mem. Cogn. 19, uniquely predicts event memory. Cognition 129,
148. Meck, W. H. & Church, R. M. Cholinergic modulation 252–262 (1991). 241–255 (2013).
of the content of temporal memory. Behav. Neurosci. 175. Gibbons, J. A. & Thompson, C. P. Using a calendar 203. Swallow, K. M., Zacks, J. M. & Abrams, R. A. Event
101, 457–464 (1987). in event dating. Appl. Cogn. Psychol. 15, 33–44 boundaries in perception affect memory encoding
149. Chubykin, A. A., Roach, E. B., Bear, M. F. & (2001). and updating. J. Exp. Psychol. Gen. 138, 236–257
Shuler, M. G. H. A cholinergic mechanism for reward 176. Larsen, S. F. & Thompson, C. P. Reconstructive (2009).
timing within primary visual cortex. Neuron 77, memory in the dating of personal and public news 204. Gold, D. A., Zacks, J. M. & Flores, S. Effects of cues
723–735 (2013). events. Mem. Cogn. 23, 780–790 (1995). to event segmentation on subsequent memory.
150. Liu, C.-H. et al. Selective activation of a putative 177. Loftus, E. F. & Marburger, W. Since the eruption Cogn. Res. Princ. Implic. 2, 1 (2017).
reinforcement signal conditions cued interval timing of Mt. St. Helens, has anyone beaten you up? 205. Flores, S., Bailey, H. R., Eisenberg, M. L. & Zacks, J. M.
in primary visual cortex. Curr. Biol. 25, 1551–1561 Improving the accuracy of retrospective reports Event segmentation improves event memory up to one
(2015). with landmarkevents. Mem. Cogn. 11, 114–120 month later. J. Exp. Psychol. Learn. Mem. Cogn. 43,
151. van Wassenhove, V., Herbst, S. K. & Kononowicz, T. W. (1983). 1183–1202 (2017).
in Magnetoencephalography: From Signals to Dynamic 178. Yarmey, A. D. Retrospective duration estimations 206. Schwan, S. & Garsoffky, B. The cognitive representation
Cortical Networks (eds Selma S. & Cheryl J. A.) for variant and invariant events in field situations. of filmic event summaries. Appl. Cogn. Psychol. 18,
855–905 (Springer International Publishing, 2019). Appl. Cogn. Psychol. 14, 45–57 (2000). 37–55 (2004).

www.nature.com/nrn

0123456789();:
Reviews

207. DuBrow, S. & Davachi, L. Temporal binding within and 229. Clayton, N. S. & Dickinson, A. Episodic-like memory between trial epochs. Hippocampus 30, 582–595
across events. Neurobiol. Learn. Mem. 134, 107–114 during cache recovery by scrub jays. Nature 395, (2020).
(2016). 272–274 (1998). 256. Zheng, J. et al. Neurons detect cognitive boundaries
208. Ezzyat, Y. & Davachi, L. What constitutes an episode 230. Fetterman, J. G. & Killeen, P. R. Prospective and to structure episodic memories in humans.
in episodic memory? Psychol. Sci. 22, 243–252 retrospective timing by pigeons. Learn. Behav. 38, Nat. Neurosci. 25, 358–368 (2022).
(2011). 119–125 (2010). This study demonstrates in humans that single
209. Ezzyat, Y. & Davachi, L. Similarity breeds proximity: 231. Babb, S. J. & Crystal, J. D. Episodic-like memory in the cells can encode event boundaries, that the
pattern similarity within and across contexts is related rat. Curr. Biol. 16, 1317–1321 (2006). evolution of event trajectories is influenced by
to later mnemonic judgments of temporal proximity. 232. Roberts, W. A. & Feeney, M. C. The comparative study event boundaries, and that both the activity of
Neuron 81, 1179–1189 (2014). of mental time travel. Trends Cogn. Sci. 13, 271–277 cells encoding event boundaries and the dynamics
210. Hsieh, L. T., Gruber, M. J., Jenkins, L. J. & (2009). of event trajectories are each correlated with
Ranganath, C. Hippocampal activity patterns carry 233. Wang, L. et al. Fallacious reversal of event-order discrimination of temporal order.
information about objects in temporal context. during recall reveals memory reconstruction in 257. Bladon, J. H., Sheehan, D. J., De Freitas, C. S. &
Neuron 81, 1165–1178 (2014). rhesus monkeys. Behav. Brain Res. 394, 112830 Howard, M. W. In a temporally segmented experience
211. Clewett, D., DuBrow, S. & Davachi, L. Transcending (2020). hippocampal neurons represent temporally drifting
time in the brain: how event memories are constructed 234. Roberts, W. A. et al. Episodic-like memory in rats: context but not discrete segments. J. Neurosci. 39,
from experience. Hippocampus 29, 162–183 is it based on when or how long ago? Science 320, 6936 (2019).
(2019). 113 (2008). 258. Sun, C., Yang, W., Martin, J. & Tonegawa, S.
212. Radvansky, G. A. & Zacks, J. M. Event boundaries 235. Zhou, W. & Crystal, J. D. Evidence for remembering Hippocampal neurons represent events as
in memory and cognition. Curr. Opin. Behav. Sci. 17, when events occurred in a rodent model of episodic transferable units of experience. Nat. Neurosci. 23,
133–140 (2017). memory. Proc. Natl Acad. Sci. USA 106, 9525 651–663 (2020).
213. Baldassano, C. et al. Discovering event structure in (2009). 259. Reynolds, J. R., Zacks, J. M. & Braver, T. S.
continuous narrative perception and memory. Neuron 236. Diehl, G. W., Hon, O. J., Leutgeb, S. & Leutgeb, J. K. A computational model of event segmentation from
95, 709–721.e705 (2017). Stability of medial entorhinal cortex representations perceptual prediction. Cogn. Sci. 31, 613–643
This study demonstrates that event segmentation over time. Hippocampus 29, 284–302 (2019). (2007).
occurs in a hierarchical manner across the brain, 237. Mankin, E. A., Diehl, G. W., Sparks, F. T., Leutgeb, S. 260. Zacks, J. M., Speer, N. K., Swallow, K. M., Braver, T. S.
with early sensory areas segmenting events on & Leutgeb, J. K. Hippocampal CA2 activity patterns & Reynolds, J. R. Event perception: a mind-brain
short timescales and higher-order areas such as change over time to a larger extent than between perspective. Psychol. Bull. 133, 273–293 (2007).
the hippocampus segmenting events on longer spatial contexts. Neuron 85, 190–201 (2015). 261. Schapiro, A. C., Rogers, T. T., Cordova, N. I.,
timescales which approximately correspond to 238. Mankin, E. A. et al. Neuronal code for extended time Turk-Browne, N. B. & Botvinick, M. M. Neural
the timescale of the perceived narrative structure in the hippocampus. Proc. Natl Acad. Sci. USA 109, representations of events arise from temporal
of events. 19462 (2012). community structure. Nat. Neurosci. 16, 486–492
214. Hasson, U., Yang, E., Vallines, I., Heeger, D. J. & This study demonstrates that the evolution of event (2013).
Rubin, N. A hierarchy of temporal receptive windows trajectories can occur over the timescale of days 262. Clewett, D. & Davachi, L. The ebb and flow of
in human cortex. J. Neurosci. 28, 2539 (2008). and at different rates within the hippocampal experience determines the temporal structure
215. Lerner, Y., Honey, C. J., Silbert, L. J. & Hasson, U. subfields (CA1 and CA3). of memory. Curr. Opin. Behav. Sci. 17, 186–193
Topographic mapping of a hierarchy of temporal 239. Mau, W. et al. The same hippocampal CA1 population (2017).
receptive windows using a narrated story. J. Neurosci. simultaneously codes temporal information over 263. Hasson, U., Chen, J. & Honey, C. J. Hierarchical
31, 2906 (2011). multiple timescales. Curr. Biol. 28, 1499–1508.e1494 process memory: memory as an integral component
216. Zacks, J. M., Tversky, B. & Iyer, G. Perceiving, (2018). of information processing. Trends Cogn. Sci. 19,
remembering, and communicating structure in events. 240. Rangel, L. M. et al. Temporally selective contextual 304–313 (2015).
J. Exp. Psychol. Gen. 130, 29–58 (2001). encoding in the dentate gyrus of the hippocampus. 264. Knierim, J. J., Neunuebel, J. P. & Deshmukh, S. S.
217. Bower, G. H. Stimulus-sampling theory of encoding Nat. Commun. 5, 3181 (2014). Functional correlates of the lateral and medial
variability. Coding Process. Hum. Mem. 3, 85–123 241. Tsao, A. et al. Integrating time from experience in the entorhinal cortex: objects, path integration and
(1972). lateral entorhinal cortex. Nature 561, 57–62 (2018). local-global reference frames. Philos. Trans. R. Soc.
218. Estes, W. K. Statistical theory of distributional This study demonstrates that event trajectories in Lond. B Biol. Sci. 369, 20130369 (2013).
phenomena in learning. Psychol. Rev. 62, 369–377 the LEC evolve in a manner reflecting the content 265. Bota, M., Sporns, O. & Swanson, L. W. Architecture
(1955). of ongoing experience, including learned temporal of the cerebral cortical association connectome
219. Howard, M. W. & Kahana, M. J. A distributed structures, and suggests that the LEC may play a underlying cognition. Proc. Natl Acad. Sci. Usa. 112,
representation of temporal context. J. Math. Psychol. central role in the generation of event trajectories. E2093–E2101 (2015).
46, 269–299 (2002). 242. Eichenbaum, H. On the integration of space, time, and 266. Burwell, R. D. & Amaral, D. G. Cortical afferents of
220. Mensink, G.-J. & Raaijmakers, J. G. A model memory. Neuron 95, 1007–1018 (2017). the perirhinal, postrhinal, and entorhinal cortices
for interference and forgetting. Psychol. Rev. 95, 243. Moser, M.-B., Rowland, D. C. & Moser, E. I. Place cells, of the rat. J. Comp. Neurol. 398, 179–205 (1998).
434–455 (1988). grid cells, and memory. Cold Spring Harb. Perspect. Biol. 267. Doan, T. P., Lagartos-Donate, M. J., Nilssen, E. S.,
221. DuBrow, S., Rouhani, N., Niv, Y. & Norman, K. A. 7, a021808 (2015). Ohara, S. & Witter, M. P. Convergent projections
Does mental context drift or shift. Curr. Opin. 244. Buzsáki, G. & Moser, E. I. Memory, navigation and from perirhinal and postrhinal cortices suggest
Behav. Sci. 17, 141–146 (2017). theta rhythm in the hippocampal-entorhinal system. a multisensory nature of lateral, but not medial,
222. Rule, M. E., O’Leary, T. & Harvey, C. D. Causes and Nat. Neurosci. 16, 130–138 (2013). entorhinal cortex. Cell Rep. 29, 617–627.e617 (2019).
consequences of representational drift. Curr. Opin. 245. Josselyn, S. A. & Tonegawa, S. Memory engrams: 268. Zingg, B. et al. Neural networks of the mouse
Neurobiol. 58, 141–147 (2019). recalling the past and imagining the future. Science neocortex. Cell 156, 1096–1111 (2014).
223. Jenkins, L. J. & Ranganath, C. Prefrontal and medial 367, eaaw4325 (2020). 269. Burwell, R. D. The parahippocampal region:
temporal lobe activity at encoding predicts temporal 246. Jenkins, L. J. & Ranganath, C. Distinct neural corticocortical connectivity. Ann. N. Y. Acad. Sci. 911,
context memory. J. Neurosci. 30, 15558–15565 mechanisms for remembering when an event 25–42 (2000).
(2010). occurred. Hippocampus 26, 554–559 (2016). 270. Nilssen, E. S., Doan, T. P., Nigro, M. J., Ohara, S. &
This study provides the first link between evolution 247. Montchal, M. E., Reagh, Z. M. & Yassa, M. A. Precise Witter, M. P. Neurons and networks in the entorhinal
of event trajectories and estimation of temporal temporal memories are supported by the lateral cortex: A reappraisal of the lateral and medial
distance in humans, demonstrating that when the entorhinal cortex in humans. Nat. Neurosci. 22, entorhinal subdivisions mediating parallel cortical
neural activity patterns for different objects within 284–288 (2019). pathways. Hippocampus 29, 1238–1254 (2019).
an overall sequence of objects were more distinct 248. Hainmueller, T. & Bartos, M. Parallel emergence 271. Deshmukh, S. S. & Knierim, J. J. Representation
from each other, estimates for when a specific of stable and dynamic memory engrams in the of non-spatial and spatial information in the lateral
object was shown were more accurate. hippocampus. Nature 558, 292–296 (2018). entorhinal cortex. Front. Behav. Neurosci. 5, 69–69
224. Nielson, D. M., Smith, T. A., Sreekumar, V., Dennis, S. 249. Hyman, J. M., Ma, L., Balaguer-Ballester, E., (2011).
& Sederberg, P. B. Human hippocampus represents Durstewitz, D. & Seamans, J. K. Contextual encoding 272. Hargreaves, E. L., Rao, G., Lee, I. & Knierim, J. J.
space and time during retrieval of real-world memories. by ensembles of medial prefrontal cortex neurons. Major dissociation between medial and lateral
Proc. Natl Acad. Sci. USA 112, 11078 (2015). Proc. Natl Acad. Sci. USA 109, 5086 (2012). entorhinal input to dorsal hippocampus. Science 308,
225. Lositsky, O. et al. Neural pattern change during 250. Ziv, Y. et al. Long-term dynamics of CA1 hippocampal 1792–1794 (2005).
encoding of a narrative predicts retrospective duration place codes. Nat. Neurosci. 16, 264–266 (2013). 273. Igarashi, K. M., Lu, L., Colgin, L. L., Moser, M.-B. &
estimates. Elife 5, e16070 (2016). 251. Cappaert, N. L. M., van Strien, N. M. & Witter, M. P. Moser, E. I. Coordination of entorhinal–hippocampal
This study experimentally demonstrates that Hippocampal formation. in The Rat Nervous System, ensemble activity during associative learning. Nature
changes in neural activity patterns measured using 511–573 (Academic Press, 2015). 510, 143–147 (2014).
functional MRI — particularly in the entorhinal 252. Speer, N. K., Zacks, J. M. & Reynolds, J. R. Human 274. Keene, C. S. et al. Complementary functional
cortex — are correlated with retrospective duration brain activity time-locked to narrative event organization of neuronal activity patterns in the
estimates. boundaries. Psychol. Sci. 18, 449–455 (2007). perirhinal, lateral entorhinal, and medial entorhinal
226. Block, R. A. & Zakay, D. in Time and Mind 253. Ben-Yakov, A., Eshel, N. & Dudai, Y. Hippocampal cortices. J. Neurosci. 36, 3660–3675 (2016).
(ed. Helfrich, H.) Ch. 9, 171–195 (Hogrefe & Huber, immediate poststimulus activity in the encoding of 275. Leitner, F. C. et al. Spatially segregated feedforward
1996). consecutive naturalistic episodes. J. Exp. Psychol. Gen. and feedback neurons support differential
227. Fountas, Z. et al. A predictive processing model of 142, 1255–1263 (2013). odor processing in the lateral entorhinal cortex.
episodic memory and time perception. Neural Comput. 254. Magliano, J. P. & Zacks, J. M. The impact of continuity Nat. Neurosci. 19, 935–944 (2016).
34, 1501–1544 (2022). editing in narrative film on event segmentation. 276. Pilkiw, M. et al. Phasic and tonic neuron ensemble
228. Roseboom, W. et al. Activity in perceptual classification Cogn. Sci. 35, 1489–1517 (2011). codes for stimulus-environment conjunctions in
networks as a basis for human subjective time 255. Bulkin, D. A., Sinclair, D. G., Law, L. M. & Smith, D. M. the lateral entorhinal cortex. Elife https://doi.org/
perception. Nat. Commun. 10, 267 (2019). Hippocampal state transitions at the boundaries 10.7554/eLife.28611 (2017).

NATuRe RevIeWS | Neuroscience

0123456789();:
Reviews

277. Tsao, A., Moser, M. B. & Moser, E. I. Traces of 300. Engel, T. A. & Wang, X.-J. Same or different? A neural markers on subjective feelings of elapsed time.
experience in the lateral entorhinal cortex. Curr. Biol. circuit mechanism of similarity-based pattern match Psychol. Sci. 21, 133–139 (2010).
23, 399–405 (2013). decision making. J. Neurosci. 31, 6982 (2011). 325. Baldassano, C., Hasson, U. & Norman, K. A.
278. Yoganarasimha, D., Rao, G. & Knierim, J. J. Lateral 301. Bright, I. M. et al. A temporal record of the past with Representation of real-world event schemas during
entorhinal neurons are not spatially selective in a spectrum of time constants in the monkey entorhinal narrative perception. J. Neurosci. https://doi.org/
cue-rich environments. Hippocampus 21, 1363–1374 cortex. Proc. Natl Acad. Sci. USA 117, 20274 (2020). 10.1523/JNEUROSCI.0251-18.2018 (2018).
(2011). 302. Thavabalasingam, S., O’Neil, E. B. & Lee, A. C. H. 326. Morton, N. W., Schlichting, M. L. & Preston, A. R.
279. Bitzenhofer, S. H., Westeinde, E. A., Zhang, H. B. Multivoxel pattern similarity suggests the integration Representations of common event structure in medial
& Isaacson, J. S. Rapid odor processing by layer 2 of temporal duration in hippocampal event sequence temporal lobe and frontoparietal cortex support
subcircuits in lateral entorhinal cortex. Elife representations. Neuroimage 178, 136–146 (2018). efficient inference. Proc. Natl Acad. Sci. USA
https://doi.org/10.7554/eLife.75065 (2022). 303. Thavabalasingam, S., O’Neil, E. B., Tay, J., Nestor, A. https://doi.org/10.1073/pnas.1912338117 (2020).
280. Lee, J. Y. et al. Dopamine facilitates associative & Lee, A. C. H. Evidence for the incorporation of 327. Pudhiyidath, A., Roome, H. E., Coughlin, C., Nguyen, K. V.
memory encoding in the entorhinal cortex. Nature temporal duration information in human hippocampal & Preston, A. R. Developmental differences in
598, 321–326 (2021). long-term memory sequence representations. temporal schema acquisition impact reasoning
281. Suter, E. E., Weiss, C. & Disterhoft, J. F. Differential Proc. Natl Acad. Sci. USA 116, 6407–6414 (2019). decisions. Cogn. Neuropsychol. 37, 25–45 (2020).
responsivity of neurons in perirhinal cortex, 304. Foudil, S.-A., Kwok, S. C. & Macaluso, E. 328. Roach, N. W., McGraw, P. V., Whitaker, D. J. &
lateral entorhinal cortex, and dentate gyrus during Context-dependent coding of temporal distance Heron, J. Generalization of prior information for rapid
time-bridging learning. Hippocampus 29, 511–526 between cinematic events in the human precuneus. Bayesian time estimation. Proc. Natl Acad. Sci. USA
(2019). J. Neurosci. 40, 2129 (2020). 114, 412 (2017).
282. Wang, C. et al. Egocentric coding of external items in 305. Kwok, S. C., Shallice, T. & Macaluso, E. Functional 329. Bellmund, J. L. S., Deuker, L., Montijn, N. D. &
the lateral entorhinal cortex. Science 362, 945 (2018). anatomy of temporal organisation and domain-specificity Doeller, C. F. Structuring time: The hippocampus
283. Knierim, J. J. & Neunuebel, J. P. Tracking the flow of episodic memory retrieval. Neuropsychologia 50, constructs sequence memories that generalize
of hippocampal computation: pattern separation, 2943–2955 (2012). temporal relations across experiences. bioRxiv
pattern completion, and attractor dynamics. 306. Cohn-Sheehy, B. I. et al. The hippocampus constructs https://doi.org/10.1101/2021.04.23.440002 (2021).
Neurobiol. Learn. Mem. 129, 38–49 (2016). narrative memories across distant events. Curr. Biol. 330. Gauthier, B., Pestke, K. & van Wassenhove, V. Building
284. Ben-Yakov, A. & Henson, R. N. The hippocampal 31, 4935–4945.e4937 (2021). the arrow of time… over time: a sequence of brain
film editor: sensitivity and specificity to event 307. Azizi, L., Polti, I. & van Wassenhove, V. Episodic timing: activity mapping imagined events in time and space.
boundaries in continuous experience. J. Neurosci. how spontaneous alpha clocks, retrospectively. bioRxiv Cereb. Cortex 29, 4398–4414 (2019).
38, 10057–10068 (2018). https://doi.org/10.1101/2021.10.01.462732 (2021). 331. Gauthier, B., Prabhu, P., Kotegar, K. A. &
285. Sols, I., DuBrow, S., Davachi, L. & Fuentemilla, L. 308. Cohn-Sheehy, B. I. & Ranganath, C. Time regained: van Wassenhove, V. Hippocampal contribution
Event boundaries trigger rapid memory reinstatement how the human brain constructs memory for time. to ordinal psychological time in the human brain.
of the prior events to promote their representation in Curr. Opin. Behav. Sci. 17, 169–177 (2017). J. Cogn. Neurosci. 32, 2071–2086 (2020).
long-term memory. Curr. Biol. 27, 3499–3504.e3494 309. Davachi, L. & DuBrow, S. How the hippocampus 332. Gauthier, B. & van Wassenhove, V. Cognitive mapping
(2017). preserves order: the role of prediction and context. in mental time travel and mental space navigation.
286. Silva, M., Baldassano, C. & Fuentemilla, L. Rapid Trends Cogn. Sci. 19, 92–99 (2015). Cognition 154, 55–68 (2016).
memory reactivation at movie event boundaries 310. Ranganath, C. & Hsieh, L.-T. The hippocampus: 333. Lee, C. S., Aly, M. & Baldassano, C. Anticipation
promotes episodic encoding. J. Neurosci. 39, 8538 a special place for time. Ann. N. Y. Acad. Sci. 1369, of temporally structured events in the brain. Elife
(2019). 93–110 (2016). https://doi.org/10.7554/eLife.64972 (2021).
287. Tambini, A. & Davachi, L. Awake reactivation of prior 311. Tulving, E. Elements of Episodic Memory (Oxford 334. Block, R. A., Grondin, S. & Zakay, D. in Timing
experiences consolidates memories and biases University Press, 1983). and Time Perception: Procedures, Measures &
cognition. Trends Cogn. Sci. 23, 876–890 (2019). 312. DuBrow, S. & Davachi, L. Temporal memory is Applications (eds Vatakis, A., Balcı, F., Di Luca, M.
288. Carr, M. F., Jadhav, S. P. & Frank, L. M. Hippocampal shaped by encoding stability and intervening item & Correa, Á.) 32–51 (Brill, 2018).
replay in the awake state: a potential substrate for reactivation. J. Neurosci. 34, 13998 (2014). 335. Block, R. A. Memory and the experience of duration
memory consolidation and retrieval. Nat. Neurosci. 313. Hsieh, L.-T. & Ranganath, C. Cortical and subcortical in retrospect. Mem. Cogn. 2, 153–160 (1974).
14, 147–153 (2011). contributions to sequence retrieval: Schematic coding
289. Folkerts, S., Rutishauser, U. & Howard, M. W. of temporal context in the neocortical recollection Acknowledgements
Human episodic memory retrieval is accompanied by network. NeuroImage 121, 78–90 (2015). The authors dedicate this Review to the memory of Warren H.
a neural contiguity effect. J. Neurosci. 38, 4200–4211 314. Manns, J. R., Howard, M. W. & Eichenbaum, H. Meck. Sadly, Warren passed away in 2020 before they could
(2018). Gradual changes in hippocampal activity support complete the writing of this Review. However, it was first pro-
290. Gelbard-Sagiv, H., Mukamel, R., Harel, M., Malach, R. remembering the order of events. Neuron 56, posed by him as an opportunity to bring together two fields
& Fried, I. Internally generated reactivation of single 530–540 (2007). of time research which have long been isolated from each
neurons in human hippocampus during free recall. This study provides the first experimental other, and the authors are honoured and grateful to continue
Science 322, 96 (2008). observation of evolving event trajectories in the this work in his memory. The authors thank V. van
291. Howard, M. W., Viskontas, I. V., Shankar, K. H. & hippocampus, and demonstrates a correlation Wassenhove for discussion and comments on the manuscript.
Fried, I. Ensembles of human MTL neurons “jump between the rate of drift and accuracy in The work was supported by a Synergy Grant from the
back in time” in response to a repeated stimulus. determining temporal order of events. European Research Council to E.I.M. (‘KILONEURONS’, grant
Hippocampus 22, 1833–1847 (2012). 315. Cox, B. M. et al. Acquisition of temporal order requires agreement number 951319), an RCN FRIPRO grant to E.I.M.
292. Manning, J. R., Polyn, S. M., Baltuch, G. H., Litt, B. an intact CA3 commissural/associational (C/A) feedback (grant number 286225), a Centre of Excellence scheme grant
& Kahana, M. J. Oscillatory patterns in temporal lobe system in mice. Commun. Biol. 2, 251 (2019). to M.-B.M. and E.I.M. from the Research Council of Norway
reveal context reinstatement during memory search. 316. Aronov, D., Nevers, R. & Tank, D. W. Mapping of a (Centre for Neural Computation, grant number 223262), the
Proc. Natl Acad. Sci. USA 108, 12893 (2011). non-spatial dimension by the hippocampal–entorhinal Kavli Foundation (M.-B.M. and E.I.M.), and a direct contribu-
293. Miller, J. F. et al. Neural activity in human circuit. Nature 543, 719–722 (2017). tion to M.-B.M. and E.I.M. from the Ministry of Education and
hippocampal formation reveals the spatial context 317. Terada, S., Sakurai, Y., Nakahara, H. & Fujisawa, S. Research of Norway.
of retrieved memories. Science 342, 1111 (2013). Temporal and rate coding for discrete event sequences
294. Rubin, A., Geva, N., Sheintuch, L. & Ziv, Y. in the hippocampus. Neuron 94, 1248–1262.e1244 Author contributions
Hippocampal ensemble dynamics timestamp events (2017). All authors contributed to the manuscript.
in long-term memory. Elife 4, e12247 (2015). 318. Allen, T. A., Salz, D. M., McKenzie, S. & Fortin, N. J.
295. Block, R. Models of psychological time. in Cognitive Nonspatial sequence coding in CA1 neurons. Competing interests
Models of Psychological Time (Ed. Block, R. A.) 1–35 J. Neurosci. 36, 1547–1563 (2016). The authors declare no competing financial interests.
(Lawrence Erlbaum Associates, 1990). 319. Shahbaba, B. et al. Hippocampal ensembles represent
296. Howard, M. W. in The New Handbook of Mathematical sequential relationships among an extended sequence Peer review information
Psychology (eds. Ashby,F. G., Colonius,H. & Dzhafarov, E.) of nonspatial events. Nat. Commun. 13, 787 (2022). Nature Reviews Neuroscience thanks Y.-J. Lin and the other
Vol. 3 (Cambridge Univ. Press, in the press). 320. Schuck, N. W. & Niv, Y. Sequential replay of nonspatial anonymous reviewers for their contribution to the peer review
297. Howard, M. W., Shankar, K. H., Aue, W. R. & task states in the human hippocampus. Science 364, of this work.
Criss, A. H. A distributed representation of internal eaaw5181 (2019).
time. Psychol. Rev. 122, 24–53 (2015). 321. Coull, J. T. & Droit-Volet, S. Explicit understanding Publisher’s note
298. Shankar, K. H. & Howard, M. W. A scale-invariant of duration develops implicitly through action. Springer Nature remains neutral with regard to jurisdictional
internal representation of time. Neural Comput. 24, Trends Cogn. Sci. 22, 923–937 (2018). claims in published maps and institutional affiliations.
134–193 (2012). 322. Faber, M. & Gennari, S. P. Effects of learned episodic
299. Howard, M. W. et al. A unified mathematical event structure on prospective duration judgments. Springer Nature or its licensor holds exclusive rights to this
framework for coding time, space, and sequences in J. Exp. Psychol. Learn. Mem. Cogn. 43, 1203 (2017). article under a publishing agreement with the author(s) or
the hippocampal region. J. Neurosci. 34, 4692–4707 323. Bellmund, J. L., Deuker, L. & Doeller, C. F. Mapping other rightsholder(s); author self-archiving of the accepted
(2014). sequence structure in the human lateral entorhinal manuscript version of this article is solely governed by the
This study describes a biologically plausible cortex. Elife 8, e45333 (2019). terms of such publishing agreement and applicable law.
computational model which in principle is capable 324. Zauberman, G., Levav, J., Diehl, K. & Bhargave, R.
of carrying out retrospective timing. 1995 feels so close yet so far: the effect of event © Springer Nature Limited 2022

www.nature.com/nrn

0123456789();:

You might also like