Professional Documents
Culture Documents
doi: 10.1093/cercor/bhz277
Advance Access Publication Date:
Original Article
Abstract
During normal visual behavior, individuals scan the environment through a series of saccades and fixations. At each
fixation, the phase of ongoing rhythmic neural oscillations is reset, thereby increasing efficiency of subsequent visual
processing. This phase-reset is ref lected in the generation of a fixation-related potential (FRP). Here, we evaluate the
integrity of theta phase-reset/FRP generation and Guided Visual Search task in schizophrenia. Subjects performed serial
and parallel versions of the task. An initial study (15 healthy controls (HC)/15 schizophrenia patients (SCZ)) investigated
behavioral performance parametrically across stimulus features and set-sizes. A subsequent study (25-HC/25-SCZ)
evaluated integrity of search-related FRP generation relative to search performance and evaluated visual span size as an
index of parafoveal processing. Search times were significantly increased for patients versus controls across all conditions.
Furthermore, significantly, deficits were observed for fixation-related theta phase-reset across conditions, that fully
predicted impaired reduced visual span and search performance and correlated with impaired visual components of
neurocognitive processing. By contrast, overall search strategy was similar between groups. Deficits in theta phase-reset
mechanisms are increasingly documented across sensory modalities in schizophrenia. Here, we demonstrate that deficits
in fixation-related theta phase-reset during naturalistic visual processing underlie impaired efficiency of early visual
function in schizophrenia.
Key words: eye movements, fixation-related potential (FRP), intertrial coherence, visual search
Introduction
function as demonstrated using behavioral, functional mag-
Schizophrenia is associated with deficits in early sensory netic resonance imaging, and neurophysiological approaches
processing that contribute to higher-order disabilities (reviewed (Martinez et al. 2012; Bedwell et al. 2013; Gracitelli et al. 2013;
in Javitt (2015) and Javitt and Freedman (2015)). In the visual Leonard et al. 2014; Kim et al. 2015; Martinez et al. 2015). These
system, patients show consistent deficits in magnocellular deficits, moreover, interrelate with impairments in higher-order
© The Author(s) 2020. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permission@oup.com
2 Cerebral Cortex, 2020, Vol. 00, No. 00
visual functions including perceptual closure, visual working to study FRPs in active sensing as the subject is required to fixate
memory, and face emotion recognition (Doniger et al. 2002; on a series of similar stimuli while they search for the target,
Butler et al. 2009; Dias et al. 2011). thus providing many fixations per trial.
To date, the vast majority of physiological studies of visual Here, we used distractor stimuli that differed in either
processing in schizophrenia have utilized stimuli presented orientation-alone (feature-search) or a conjunction of both
while subjects fixate on a single spot (“central fixation”). By contrast and orientation (conjunction-search) (Fig. 1A). In the
contrast, in natural vision, individuals continually move their feature (parallel) search condition, all stimuli were low-contrast,
eyes to seek out relevant information through a series of and target stimuli differed only in orientation (vertical vs.
∗P < 0.05; ∗∗P < 0.01. Missing data from: a 5 patients from PS, 7 patients from NS; b 1 patient NS; c 1 patient PS, 1 patient and 1 control NS; d 1 control NS; e 4 controls and
8 patients PS; f 3 controls and 1 patient PS; g 5 patients NS; and one control in PS for all.
In the Neurophysiology study (NS) conjunction search, 192 to 1024 × 768 pixels). Stimuli presentation was programmed and
search-fields were presented in blocks of 48 each, with a 5-min controlled by Experiment Builder, and the experiment ran either
rest between blocks. A set-size of 48 stimuli with half at low- an Eyelink 1000 system, with tower configuration (SR Research
(40%) contrast (Shen et al. 2000) was used across search-fields. Ltd, Canada), or a remote eye-tracking system using monopolar
For feature search, 288 search-fields were presented as the task pupil-tracking at 1000 Hz (500 Hz for the NS). Head movement
was faster. was minimized by use of a chinrest.
Before each block of trials, an instruction screen prompted
the participant to look for the lower contrast vertical stimulus.
Eye Movements
Subjects responded by pressing a button on a Sidewinder Plug
Search fields were presented on a monitor distant 57 cm from & Play Gamepad (Microsoft Corporation). A 9-point calibration
the subject’s eyes (Iiyama Vision Master Pro 512 cathode ray tube procedure and validation procedure was performed at the begin-
(CRT) monitor, refresh rate of 85 Hz, and a screen resolution set ning of the task and was repeated following any breaks.
4 Cerebral Cortex, 2020, Vol. 00, No. 00
A drift correction was applied while the subjects fixated on Statistical Analysis
a dot in the center of the screen, followed by a reminder screen
Data were analyzed with SPSS (v24, IBM). RT data were log-
indicating the contrast of the upcoming target. The trial ended
transformed. Behavioral data were analyzed by mixed model
when the subject fixated on the target and pressed a button on
regression (MMRM) with factors of group and task, and with con-
the controller, or timed out after 30 s. To lessen random guessing,
trast and density as covariates. Follow-up rmANOVA were per-
the system would only accept a response as correct if a fixation
formed by task to assess linear effects FRP data were analyzed
had been made within a 3◦ window around the target, within 2 s
by rmMANOVA across fixation types (random, prefinal, final).
of the button press.
Neurophysiology
Results
Subjects were tested in an electrically shielded, darkened room.
Electroencephalography (EEG) data were recorded continuously
Behavioral Pilot Study
using an ANT/“Duke” layout Waveguard electrode cap with 64 An omnibus test across both tasks and all contrasts/set-sizes
equidistant scalp electrodes, which increases sampling of occip- showed a highly significant main effect of group (F1,36.9 = 16.2,
ital regions (Supplementary Fig. S1) and the ANT recording sys- P = 0.0003, d = 1.33). As expected, there were highly signifi-
tem (ANT Neuro, Einschede, Netherlands) with a sampling rate cant main effects of contrast (F1,12 300 = 82.2, P < 0.0001) and
of 1024 Hz. Impedances were maintained below 10 kΩ. Data were set-size (F1,12 300 = 135.5, P < 0.0001), as well as significant
processed offline in MATLAB (Mathworks) using the EEGlab and task X contrast (F1,12 000 = 103.9, P < 0.0001), task X set-size
ERPLAB Toolboxes (Delorme and Makeig 2004; Lopez-Calderon (F1,12 300 = 77.3, P < 0.0001) and task X contrast X set-size
and Luck 2014). (F1,12 000 = 43.9, P < 0.0001) interactions. However, the group X
Processing steps included bandpass filtering (0.1–80 Hz), contrast (F1,12 300 = 0.37, P = 0.54), group X set-size (F1,12 300 = 2.67,
nearest-neighbor bad channel interpolation, and independent P = 0.10) and group X contrast X set-size (F1,12 300 = 1.15, P = 0.28)
component analysis (ICA)-based eye-movement correction. interactions were all nonsignificant.
In general, the number of sweeps surviving artifact rejection The group X task interaction was also significant (F1,12 300 = 7.16,
was higher for patients than controls, reflecting the increased P = 0.007), although higher-order interactions involving group
number of fixations needed per search-field for target detection were not (all P > 0.2). Separate analyses were, therefore,
(Supplementary Table S1). performed for serial and parallel tasks independently. The main
To minimize remaining eye-movement contributions to FRP effect of group was independently significant for both the serial
analyses, data were re-referenced to linked mastoids. Epochs (F1,37.9 = 6.72, P = 0.013) and parallel (F1,38.5 = 16.7, P = 0.0002).
(−200–600 ms) were indexed by fixation onset, and data in any Group X contrast effects were not significant for either task
electrode channel (excluding Electrooculography (EOG)) with a alone (both P > 0.1). The group X set-size effect was not signifi-
change in amplitude greater than 120 µV during a 200 ms time cant in the serial search condition (F1,8126 = 0.13, P = 0.7) (Fig. 1B),
window were excluded from averaging. but was significant in the orientation-alone parallel-search
Epochs were categorized into “random-search” (i.e., all fix- condition (F1,4146 = 4.25, P = 0.039). Similar effects were observed
ations preceding the prefinal), “prefinal”, and “final” fixations in the contrast-alone condition (Supplementary Fig. S2A).
for each search-field, and averaged. Time frequency (TF) mea- In follow-up analyses, a significant between group difference
sures included evoked amplitude, intertrial coherence (ITC), and was observed for fixation number (F1,47 = 4.08, P = 0.049) but
single-trial amplitude, and were calculated using 3-cycle and not for fixation duration (F1,32.4 = 0.05, P = 0.83) across tasks.
6-cycle Morlet wavelet convolution for frequencies below and These effects were further confirmed in an rmANOVA incor-
above 25 Hz, respectively. porating mean subject data from the serial search task alone
Before statistical analysis, data were baseline corrected rela- (Supplementary Fig. S2B,C).
tive to a −150 to −50 ms prefixation interval. An occipitoparietal Distractor ratio: Across groups, decreasing the ratio of high-
ROI was defined based upon cross-group topographic maps to low-contrast distractors from 50 to 20% significantly reduced
(Supplementary Fig. S1), and included electrodes POz, Pz, CPz, search time (F2,27 = 52.2, P < 0.0001), with no significant main
PO3, PO4, P1, and P2. Predetermined theta (4–8 Hz), delta (0.5– effect of group (F1,28 = 1.82, P = 0.19) or group X ratio interaction
3.5 Hz) and gamma (25–60 Hz) frequency bands were used in the (F1,28 = 0.13, P = 0.88) (Supplementary Fig. S3).
analyses. FRP-related P1 (P1f ) and P300 (P300f ) amplitudes were
measured from 85 to 135 ms and 150 to 300 ms postfixation,
Neurophysiology Study
respectively. Corresponding TF Integration windows were −50–
150 ms (theta) and 150–300 ms (delta). For gamma, separate win- Serial Search
dows of −50–0 ms (prefixation gamma) and 0–150 (postfixation As in the behavioral PS, patients required a significantly greater
gamma) were used. amount of time per search-field to detect the targets (F1,47 = 7.39,
Fixation-Related Potentials and Visual Search in Schizophrenia Dias et al. 5
P = 0.009, d = 0.80) (Fig. 2A), again reflecting a significant increase primarily to an increase in theta activity and the P3f component
in the number of fixations per search-field (F1,47 = 7.62, P = 0.008, primarily to an increase in delta (1–4 Hz) activity. An omnibus
d = 0.81) (Fig. 2B) with no significant difference in fixation dura- test across all 3 components and all fixation types showed
tion (F1,47 = 0.95, P = 0.34) (Fig. 2C). both a highly significant main effect of group (F1,47 = 11.2,
As predicted, prefinal fixation distance—defined as the dis- P = 0.002, d = 0.98) and a significant component X group
tance between the last fixation before target detection and interaction (F2,46 = 4.72, P = 0.014, d = 0.63). Follow-up analyses
the center of the target—was significantly smaller in patients were, therefore, conducted for each component individually to
versus controls (F1,47 = 7.84, P = 0.008, d = 0.80) (Fig. 2D), reflecting resolve the interaction.
a smaller visual span. In turn, the increase in prefinal dis- Prefixation activity/gamma: The amplitude of the
tance strongly predicted mean time per search-field both across prefixation gamma was not significantly different between
groups (Fig. 2E) and in patients alone (r = −.75, P < 0.001). Fol- groups (F1,47 = 0.01, P = 0.92). Both the main effect of fix-
lowing covariation for prefinal distance, neither the mean time ation type (F2,46 = 2.07, P = 0.14) and the fixation X group
per search-field (F1,46 = 1.71, P = 0.2) nor the number of fixations interaction (F2,46 = 0.26, P = 0.77) were also nonsignificant
(F1,46 = 1.34, P = 0.25) remained significant across groups. (Supplementary Table S2).
P1f /theta: Across all fixation types, both P1 amplitude
FRP Analyses (F1,47 = 6.67, P = 0.013, d = 0.75) (Supplementary Table S2) and
FRPs to all fixation types included an initial biphasic wave underlying theta activity (F1,47 = 13.3, P = 0.001, d = 1.08) were
that preceded fixation onset, followed by a biphasic N1f /P1f significantly reduced in patients versus controls across fixation
component response between 0 and 150 ms. An additional P3f types. The main effect of fixation type (F2,46 = 0.95, P = 0.39) and
component occurred between 150 and 300 ms for prefinal and the fixation-type X group interaction (F2,46 = 0.27, P = 0.77) were
final fixations only (Fig. 3A). As opposed to standard visual nonsignificant (Fig. 4A). For correlational analyses, therefore,
ERP (Martinez et al. 2018), FRPs both occur earlier and involve theta amplitudes were combined across the three fixation types.
phase-reset to a greater degree, suggesting different underlying In single-trial TF analyses, the between-group difference
processes (Supplementary Fig. S4). in theta ITC was highly significant (F1,47 = 20.1, P < 0.0001,
In TF analyses (Fig. 3B–D), the prefixation activity corre- d = 1.32) (Fig. 4B). Across groups, the main effect of fixation type
sponded primarily to an increase in gamma activity immedi- was significant with somewhat lower ITC to prefinal or final
ately preceding fixation. By contrast, the N1f /P1f corresponded versus random-search fixations (F1,47 = 6.19, P = 0.016). However,
6 Cerebral Cortex, 2020, Vol. 00, No. 00
Figure 4. Mean (SEM) FRP-related values from the serial search task as a function of fixation type across groups. (A) Evoked Theta amplitude (corresponding to P1f ).
(B) Theta ITC. (C) Single-trial theta amplitude. (D) Evoked delta-amplitude (corresponding to P3f ). (E) Correlation between evoked theta amplitude and search time in
patients. (F) Correlation between evoked theta amplitude and prefinal fixation distance in patients.
the fixation type X group interaction was nonsignificant although to a lesser degree. As with ITC, there was a signif-
(F2,46 = 0.92, P = 0.4). icant main effect of fixation type (F2,46 = 4.06, P = 0.02), with
The between-group difference in single-trial theta amplitude lower single-trial amplitude to random-search fixations than
was also significant (F1,47 = 4.32, P = 0.04, d = 0.61) (Fig. 4C), prefinal/final (F1,47 = 8.30, P = 0.006). Between-group differences
Fixation-Related Potentials and Visual Search in Schizophrenia Dias et al. 7
in theta ITC remained strongly significant even following (F1,47 = 238.9, P < 0.0001). By contrast, the group X task interaction
covariation for amplitude changes (all P < 0.001). was nonsignificant (F1,47 = 2.43, P = 0.13).
P3f /delta: For both P3f- and evoked delta-amplitude, there was FRP: In the parallel-search task, because of the limited
a significant stepwise increase from random-search to prefinal number of saccades/fixations per search-field, FRPs were only
to final fixation. Although the P3f did not significantly discrimi- resolved to prefinal and target fixations (Supplementary Fig. S6).
nate between groups (F1,47 = 1.47, P = 0.23), delta evoked ampli- As in the serial search task, a prominent P1f component
tude was significantly reduced in patients vs. controls across was observed, and was reduced in schizophrenia (F1,47 = 4.03,
all fixation types (F1,47 = 4.73, P = 0.035) (Fig. 4D). The fixation P = 0.05). In TF analyses, reductions were observed in both
significant following control for multiple comparisons. All other et al. 2011). Once the decrease in size of the visual “spotlight”
correlations to either symptoms or medication dosage were (visual span) during search was considered, increased search
nonsignificant. times on this task were no longer significant.
At the neurophysiological level, the reduced visual span was
Discussion associated with reduced FRP generation over posterior visual
cortex (Fig. 3). Consistent with primate studies, the human FRP
Deficits in auditory and visual sensory processing in schizophre- response corresponded specifically to a phase-reset of ongo-
nia have become increasingly appreciated over recent years ing theta-rhythms with little alteration in single-trial power
(Javitt 2009; Javitt and Freedman 2015). Nevertheless, the degree (Rajkai et al. 2008). Overall, these findings are consistent with
to which these affect naturalistic functions remains to be a model in which impaired visual active sensing—as reflected
determined. Here, we used a visual Guided-Search task com- in reduced FRP—leads to narrowing of the visual span which,
bined with eye-tracking and EEG to investigate contributions in turn, drives behavioral impairment (Fig. 4E,F). These findings
of visual active sensing to behavioral disturbance. Although also converge with a growing body of literature suggesting theta
visual Guided Search has been endorsed as an informative response abnormalities in schizophrenia across both auditory
paradigm for investigating neural mechanisms underlying (Lee et al. 2017; Javitt et al. 2018) and visual (Martinez et al.
attentional allocation and sensory processing impairments 2015) sensory systems, and support prior studies demonstrating
in schizophrenia (Nuechterlein et al. 2009), to our knowledge, reduced stimulus-related processing during visual search versus
this is the first study to utilize combined eye-tracking and nonsearch tasks in schizophrenia (Davenport et al. 2006; Van-
neurophysiological measures to investigate underlying neural Meerten et al. 2016).
mechanisms. By contrast to the deficits in FRP and visual span, the
As expected, patients showed substantially increased search slope of the RT increase as a function of set-size did not
times compared to controls in both the serial- and parallel- differ significantly between groups (Fig. 1B). Furthermore,
search versions of the task (VanMeerten et al. 2016). In both patients and controls fixated on similar areas of search-
cases, the increased search time was associated with an increase fields (Supplementary Fig. S7), and both groups equivalently
in the number—but not duration—of fixations per search-field, “oversampled” the low- versus high-contrast distractors (Fig. 5E).
which in turn was associated with a markedly (P = 0.008) reduced In addition, both groups showed similar effects of distractor
distance, over which targets could be detected in peripheral ratio manipulation (Supplementary Fig. S3), consistent with a
(parafoveal) vision relative to the point of fixation (Elahipanah prior report (Elahipanah et al. 2008).
Fixation-Related Potentials and Visual Search in Schizophrenia Dias et al. 9
Prior studies of visual search in schizophrenia have yielded was diminished disproportionately to P3f with no significant
mixed results in the “target present” condition such as used here between group difference in accuracy and no prolongation of P3f
(Mori et al. 1996; Fuller et al. 2006; Gold et al. 2007; Tanaka et al. latency.
2007), potentially related to methodological issues. For example, Present findings converge with recent suggestions that
in prior studies between-group differences may also have been theta-phase significantly modulates local gain within sensory
driven in part by use of raw, rather than log-transformed RT data, regions (Fiebelkorn and Kastner 2019) and contributes to
which are inherently right-skewed. Also, different stimuli were integration versus segregation of visual information (Wutz
used across studies. Here, stimulus contrast was detectable from et al. 2016), as well as with recent findings of impaired
misattribution errors in schizophrenia. Prog Neuropsychophar- Javitt DC. 2015. Neurophysiological models for new treatment
macol Biol Psychiatry. 44:88–93. development in schizophrenia: early sensory approaches.
Butler PD, Abeles IY, Weiskopf NG, Tambini A, Jalbrzikowski M, Ann N Y Acad Sci. 1344:92–104.
Legatt ME, Zemon V, Loughead J, Gur RC, Javitt DC. 2009. Javitt DC, Freedman R. 2015. Sensory processing dysfunction
Sensory contributions to impaired emotion processing in in the personal experience and neuronal machinery of
schizophrenia. Schizophr Bull. 35:1095–1107. schizophrenia. Am J Psychiatry. 172:17–31.
Concha-Miranda M, Rios J, Bou J, Valdes JL, Maldonado PE. 2019. Javitt DC, Lee M, Kantrowitz JT, Martinez A. 2018. Mismatch neg-
Timing is of the essence: improvement in perception during ativity as a biomarker of theta band oscillatory dysfunction
Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen Shen J, Reingold EM, Pomplun M. 2000. Distractor ratio influ-
JD, Essock S, Fenton WS, Frese FJ 3rd, Gold JM et al. 2008. The ences patterns of eye movements during visual search.
MATRICS consensus cognitive battery, part 1: test selection, Perception. 29:241–250.
reliability, and validity. Am J Psychiatry. 165:203–213. Tanaka G, Mori S, Inadomi H, Hamada Y, Ohta Y, Ozawa H. 2007.
Nuechterlein KH, Luck SJ, Lustig C, Sarter M. 2009. CNTRICS Clear distinction between preattentive and attentive process
final task selection: control of attention. Schizophr Bull. 35: in schizophrenia by visual search performance. Psychiatry Res.
182–196. 149:25–31.
Poletti M, Rucci M, Carrasco M. 2017. Selective attention within Treisman A. 1982. Perceptual grouping and attention in visual