You are on page 1of 3

Trends in Neurosciences

References
1. Kleinfeld, D. et al. (2019) Can one concurrently record
stimuli for neuroscientists. But first, complex relations among agents. Within a
electrical spikes from every neuron in a mammalian what is a narrative? narrative, humans often do not find it difficult
brain? Neuron 103, 1005–1015
2. Campbell, P.K. et al. (1990) A 100 electrode intracortical
to understand embedded mental states
array: structural variability. Biomed. Sci. Instrum. 26, 161–165
Working Definition of Narratives for (and – depending on the story and the
3. Patel, P.R. et al. (2016) Chronicin vivostability assessment of car-
bon fiber microelectrode arrays. J. Neural Eng. 13, 066002 Neuroscientific Research storyteller – may even enjoy it). Not only
4. Scholvin, J. et al. (2016) Close-packed silicon microelec-
trodes for scalable spatially oversampled neural recording.
Here, we define narrative loosely as a does narrative context lighten cognitive
IEEE Trans. Biomed. Eng. 63, 120–130 discourse unit that includes events and load, it points us toward what our minds
5. Buzsaki, G. et al. (2015) Tools for probing local circuits:
high-density silicon probes combined with optogenetics.
one or more characters. The information are good at.
Neuron 86, 92–105 contained in a narrative evolves such that
6. Jun, J.J. et al. (2017) Fully integrated silicon probes for high-
density recording of neural activity. Nature 551, 232–236
our understanding of a given event often
Narratives Simulate Reality
7. Chung, J.E. et al. (2019) High-density, long-lasting, and depends on other events in the narrative.
multi-region electrophysiological recordings using polymer Narratives reflect the real world. Narratives
electrode arrays. Neuron 101, 21–31.e5
Spoken and written stories, movies, and
describe events and social interactions
8. Wei, X. et al. (2018) Nanofabricated ultraflexible electrode arrays ‘storified’ journalism are paradigmatic exam-
for high-density intracortical recording. Adv. Sci. 5, 1700625 that, although we know are not necessarily
9. Xie, C. et al. (2015) Three-dimensional macroporous
ples of narratives.
real, can feel very realistic. Indeed, a core
nanoelectronic networks as minimally invasive brain
probes. Nat. Mater. 14, 1286 function of narratives is to provide a simula-
10. Obaid, A. et al. (2020) Massively parallel microwire arrays A Case for Narratives as Essential tion of reality [3]. This means that narratives
integrated with CMOS chips for neural recording. Sci.
Adv. 6, eaay2789 Stimuli in Neuroscience can be used to study a whole host of neural
Narratives Make Cognition Easier processes that cognitive neuroscientists
Jerome Bruner [1] famously argued that are interested in; using narratives has al-
Forum the ‘narrative mode’ is the way in which ready been extremely fruitful in some
humans most easily receive and transmit domains.
information. Presenting information within
Narratives for a narrative context lightens cognitive For example, since events described in
Neuroscience load. A great example of this is the embed- narratives mimic real-world experiences,
ding of multiple mental states. Humans narratives have been fundamental to our
Roel M. Willems,1,2,3,* find this difficult outside of a narrative con- understanding of how the brain struc-
Samuel A. Nastase,4,* and text but do it effortlessly within a narrative. tures events during perception and in
Branka Milivojevic1,* Consider this example: memory [4]. In a seminal study [5], narra-
‘I know that Ann believes that Peter suspects tives were used to reveal a cortical pro-
People organize and convey their
cessing hierarchy of temporal receptive
that Mary realizes that Bill understood that Will
thoughts according to narratives. is a sailor.’ windows. As experiences unfold, incom-
However, neuroscientists are often re- ing information is structured into hierar-
Figuring out who thinks what about whom
luctant to incorporate narrative stimuli chies [5] based on event segmentation
is difficult in this sentence. This fits well
into their experiments. We argue that at multiple, nested timescales (Figure 1)
with a literature showing that humans find
narratives deserve wider adoption in [6].
it challenging to process multiple recur-
human neuroscience because they sively embedded mental states. A narrative
tap into the brain’s native machinery However, unlike reality, narratives can
context turns this finding upside down. An
for representing the world and provide condense experiences by ‘editing
analysis of Shakespeare’s Othello, for in-
rich variability for testing hypotheses. out’ events (and conversely, they can
stance, shows that the state of affairs in
expand the duration and detail of
the play at a given point can be described
events). Furthermore, editing enables
like this [2]:
Neuroscientists tell stories about the us to reveal factors that guide the
brain. They rarely, however, use stories ‘The audience believe that Iago intends that organization of event representations
Othello imagines that Desdemona thinks that
to understand the brain. Narratives in memory, such as simultaneous
Cassio is adorable.’
are the human brain’s way of consoli- representation of event information in
dating and conveying the temporally- This state of affairs is hard to understand the hippocampus at multiple temporal
evolving world we live in. Here we pres- outside of a narrative context but much resolutions – spanning several events [7]
ent four related reasons why stories less so within the original play. Narrative and even entire storylines lasting well
(i.e., narratives) are a critical class of structure provides a scaffold for representing over an hour [8].

Trends in Neurosciences, May 2020, Vol. 43, No. 5 271


Trends in Neurosciences

However, using narratives to study cognition


does not mean that we lose all experimental
control. Narratives can be developed or
edited to feature the relevant conditions nec-
essary for addressing the experimental ques-
tions of interest. One study, for example,
investigated event integration by using
short, tightly controlled five-event narratives
[7].

Even with relatively well-controlled narra-


tives, as in this example, narrative stimuli,
unlike traditional experimental stimuli,
often comprise many superimposed,
intercorrelated variables (Figure 1). This
Trends in Neurosciences
apparent lack of experimental control
Figure 1. Narratives Comprise Many Layers of Nested Features. These features can for instance include
(from bottom to top in the schematic): phonemes, words, sentences, social interactions, actions, characters, events,
presents both challenges and opportuni-
and narrative context. As such, narrative stimuli allow researchers to study a variety of cognitive and perceptual ties (Box 1). On the one hand, a narrative
processes. Gradually emerging narrative context can modulate processing of individual embedded features; this stimulus may have lower efficiency than a
kind of contextual modulation is absent from more traditional paradigms comprising strictly controlled and traditional experimental manipulation for
decontextualized stimuli. By leveraging narrative stimuli and computational models, neural mechanisms underlying
cognitive processes for each feature of interest can be isolated during naturalistic experience. This approach can
testing a particular hypothesis if the rele-
allow researchers to take a step toward generalizing their findings beyond the laboratory setting and can advance vant conditions occur infrequently in
our understanding of how different cognitive processes interact during real-world experience. more naturalistic narrative contexts [9].
On the other hand, exploiting naturally
Narratives Feature Rich Variation stripped of temporal dynamics (e.g., by ran- occurring variation embedded in narra-
In many ways, narratives are the antithesis of domizing trial order). These characteristics tive stimuli will tend to yield more general-
classical experimental stimuli, which are de- have likely contributed to the slow adoption izable results. For instance, one study
liberately controlled, decontextualized, and of narratives in neuroscience research. modeled word-by-word predictability in
a narrative to better understand the
Box 1. In Defense of Narratives: Rebuttals to Common Arguments against the Use of Narratives neural basis of prediction during natural
in Neuroscience
language comprehension [10]. Another
'Narratives are not well controlled’: Critics may argue that, experimentally, narratives often contain many con-
benefit of narrative stimuli is that their
founding variables, making interpretation more difficult. Response: Narratives can be constructed or edited to
emphasize a particular variable of interest. Furthermore, the ‘uncontrolled’ nature of narratives can be turned richness can be used to simultaneously
to an advantage. Respecting the statistical regularities of naturalistic contexts yields more ecologically valid re- evaluate, and compare, multiple hypothe-
sults and allows research to evaluate the relative contributions of different variables (see Figure 1 in main text). ses. This allows researchers to better
'Narratives are difficult to analyze’: The seemingly ‘uncontrolled’ nature of narratives may make data analysis
assess the relative contributions of different
seem daunting. Response: Researchers have begun to develop methods for accommodating the richness of variables or features to neural responses
narrative stimuli. For example, methods for model comparison and variance partitioning allow researchers to under naturalistic conditions. Using modern
evaluate the relative contributions of different features to neural responses [9]. Analytic tools can be shared computational models, researchers have
online (e.g., https://brainiak.org/) to facilitate adoption in the community [6,11].
turned this to their advantage, for example,
'Narratives are confounded with time’: Narratives require integration of information over time, making it impossi- for disentangling the neural machinery
ble to decouple any given event from past events. Response: Although narratives defy certain principles of supporting perceptual and semantic pro-
experimental design (e.g., repeated exposure, trial averaging), we argue that this is a feature – not a bug – of
cessing [9,10]. Further, narratives are well
narrative stimuli. Temporal context is a fundamental feature of cognition and paradigms that deliberately decon-
textualize stimuli do so at the expense of ecological validity. suited to investigating both commonalities
across participants [11] as well as idiosyn-
'Narratives are too esoteric’: Some researchers regard narratives as largely outside the scope of human cratic variation [12].
neuroscience, seeing them as ‘niche’ or ‘contrived’ stimuli with poor generalizability. Response: Narratives
often simulate the real world and are a naturally engaging stimulus. Indeed, narratives are constructed to
interest the audience, making them optimal stimulants of the human mind. If the narrative mode is one of Narratives Promote Data Reuse
the cornerstones of human thought and communication, narratives should be considered an important As a unifying stimulus across many domains
experimental vehicle for understanding human cognition.
of cognition, each narrative stimulus can

272 Trends in Neurosciences, May 2020, Vol. 43, No. 5


Trends in Neurosciences

4
Princeton Neuroscience Institute, Princeton University,
inform multiple research questions [9]. Outlooks Princeton, NJ, USA
Hypotheses developed for one narrative Early adopters of narratives for neurosci-
stimulus can often be validated on other ence research have introduced methods *Correspondence:
r.willems@donders.ru.nl (R.M. Willems),
narrative stimuli. For example, brain re- for stimulus development, data analysis, snastase@princeton.edu (S.A. Nastase), and
sponses to a spoken story stimulus like computational modeling, and sharing large b.milivojevic@donders.ru.nl (B. Milivojevic).

‘Pie Man’ by Jim O’Grady (https:// datasets. However, some challenges still https://doi.org/10.1016/j.tins.2020.03.003

themoth.org/stories/pie-man) can be used remain for a more complete acceptance of © 2020 Elsevier Ltd. All rights reserved.
to evaluate and compare models of spec- narratives in neuroscience research;
tral, articulatory, and semantic content, namely, we need to more fully integrate References
models of event segmentation, as well as knowledge from other fields, including the 1. Bruner, J.S. (1986) Actual Minds, Possible Worlds,
Harvard University Press
methods for functional network estimation humanities, in order to develop more com- 2. V a n D u i j n , M . J . e t a l . ( 2 0 1 5 ) W h e n n a r r a t i v e
(Figure 1) [6,9,11]. This high reuse value plete models of how the brain processes in- takes over: the representation of embedded
mindstates in Shakespeare’s Othello. Lang.
makes narrative paradigms an efficient formation presented within narrative Lit. 2 4, 1 48 –1 6 6
FAIR (findable, accessible, interoperable, context, and how narrative context modu- 3. Mar, R.A. and Oatley, K. (2008) The function of fiction is
the abstraction and simulation of social experience.
and reusable) research strategy (https:// lates prior knowledge to form a nuanced in- Perspect. Psychol. Sci. 3, 173–192
fair-research.org) with clear utility for open terpretation of ongoing experience. What’s 4. Z a c k s , J . M . e t a l . ( 2 0 0 7 ) E v e n t p e r c e p t i o n : a
mind‐brain perspective. Psychol. Bull. 133,
science. more, narratives are a critical component 27 3– 29 3
5. Hasson, U. et al. (2008) A hierarchy of temporal recep-
of education, communication, and
tive windows in human cortex. J. Neurosci. 28,
The release and curation of public bench- policymaking, and better understanding of 2539–2550
mark datasets holds tremendous benefits 6. Baldassano, C. et al. (2018) Representation of real-world event
the neural mechanisms underlying narrative schemas during narrative perception. J. Neurosci. 38,
for both neuroscience and other fields processing will likely have wide societal 9689–9699
(e.g., machine learning). The recently re- 7. Collin, S.H.P. et al. (2015) Memory hierarchies map onto
ramifications. the hippocampal long axis in humans. Nat. Neurosci. 18,
leased ‘Narratives’ data collection [13] 1562–1564
collates functional magnetic resonance Acknowledgments 8. Milivojevic, B. et al. (2016) Coding of event nodes and
narrative context in the hippocampus. J. Neurosci. 36,
imaging (fMRI) responses from over 300 R.M.W. was supported by a grant from The Netherlands 12412–12424
subjects (comprising over 750 functional Organization for Scientific Research (NWO Vidi 276-89- 9. Hamilton, L.S. and Huth, A.G. (2020) The revolution will
not be controlled: natural stimuli in speech neuroscience.
scans) spanning 28 different spoken 007). S.A.N. was supported by the National Institute of Lang. Cogn. Neurosci. Published online July 22, 2018.
Mental Health under award number R01MH112566. https://doi.org/10.1080/23273798.2018.1499946
narratives of varying length. The publication
B.M. was supported by The Netherlands Organization 10. Willems, R.M. et al. (2016) Prediction during natural
of large neuroimaging datasets, acquired for Scientific Research ‘Language in Interaction’ Gravita- language comprehension. Cereb. Cortex 26,
while participants engage with narratives, tion grant (024.001.006). 2506–2516
11. Nastase, S.A. et al. (2019) Measuring shared responses
opens up the possibility of leveraging large across subjects using intersubject correlation. Soc.
samples to validate models across subjects Cogn. Affect. Neurosci. 14, 667–685
1
Donders Institute for Brain, Cognition and Behaviour, Radboud 12. Nijhof, A.D. and Willems, R.M. (2015) Simulating fiction: in-
and stimuli. We hope to see an increasing University, Nijmegen, The Netherlands dividual differences in literature comprehension revealed
number of public neuroscience datasets 2Centre for Language Studies, Radboud University, Nijmegen, with fMRI. PLoS One 10, e0116492
The Netherlands 13. Nastase, S.A. et al. (2019) Narratives: fMRI data for evaluating
capitalizing on the richness of narrative para- 3Max Planck Institute for Psycholinguistics, Nijmegen, models of naturalistic language comprehension. OpenNeuro
digms in the coming years. The Netherlands https://doi.org/10.18112/openneuro.ds002345.v1.0.1

Trends in Neurosciences, May 2020, Vol. 43, No. 5 273

You might also like