You are on page 1of 17

Clinical Neurophysiology 148 (2023) 76–92

Contents lists available at ScienceDirect

Clinical Neurophysiology
journal homepage: www.elsevier.com/locate/clinph

Mismatch negativity as a marker of music perception in individual


cochlear implant users: A spike density component analysis study
Niels Trusbak Haumann a,⇑, Bjørn Petersen a, Anne Sofie Friis Andersen a, Kathleen F. Faulkner b,
Elvira Brattico a, Peter Vuust a
a
Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus/Aalborg, Universitetsbyen 3, 8000 Aarhus C, Denmark
b
Oticon Medical, Kongebakken 9, 2765 Smørum, Denmark

h i g h l i g h t s

 MMN measurements predict individual cochlear implant (CI) users’ behavioral music perception.
 MMN is detected in fewer CI users when sound deviants are of smaller magnitude.
 New spike density component analysis method enables more accurate diagnostics than preceding state-of-the-art.

a r t i c l e i n f o a b s t r a c t

Article history: Objective: Ninety percent of cochlear implant (CI) users are interested in improving their music percep-
Accepted 24 January 2023 tion. However, only few objective behavioral and neurophysiological tests have been developed for trac-
Available online ing the development of music discrimination skills in CI users. In this study, we aimed to obtain an
accurate individual mismatch negativity (MMN) marker that could predict behavioral auditory discrim-
Keywords: ination thresholds.
EEG
Methods: We measured the individual MMN response to four magnitudes of deviations in four different
Audiology
Music
musical features (intensity, pitch, timbre, and rhythm) in a rare sample of experienced CI users and a con-
Cochlear implants (CI) trol sample of normally hearing participants. We applied a recently developed spike density component
MMN analysis (SCA), which can suppress confounding alpha waves, and contrasted it with previously proposed
SCA methods.
Results: Statistically detected individual MMN predicted attentive sound discrimination ability with high
accuracy: for CI users 89.2% (278/312 cases) and for controls 90.5% (384/424 cases). As expected, MMN
was detected for fewer CI users when the sound deviants were of smaller magnitude.
Conclusions: The findings support the use of MMN responses in individual CI users as a diagnostic tool for
testing music perception.
Significance: For CI users, the new SCA method provided more accurate and replicable diagnostic detec-
tions than preceding state-of-the-art.
Ó 2023 International Federation of Clinical Neurophysiology. Published by Elsevier B.V. This is an open
access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).

1. Introduction often heightens the perceived quality of life, even with only resid-
ual hearing abilities (Dritsakis et al., 2017, Fuller et al., 2022,
A main goal for 30–37 % of cochlear implant (CI) users is to Lassaletta et al., 2007). Indeed, a study showed that 90 % of CI users
restore abilities to listen to music with the CI device (Kohlberg are interested in rehabilitative programs for improving their music
et al., 2014, Migirov et al., 2009). However, for CI users, music per- experience (Gfeller et al., 2019). Also, music stimuli can be applied
ception and enjoyment from music is more challenged and varied to test general aspects of listeners’ sound discrimination ability by
than in normally hearing individuals, despite music is a factor that using stimuli that most people find enjoyable (Dritsakis et al.,
2017, Lassaletta et al., 2007). Therefore, it is pertinent to identify
accurate diagnostic tools for testing the individual variation in CI
⇑ Corresponding author at: Center for Music in the Brain, Department of Clinical
users’ music perception (Hahne et al., 2016, Koelsch et al., 2004,
Medicine, Aarhus University and The Royal Academy of Music, Aarhus/Aalborg,
Universitetsbyen 3, 8000 Aarhus C, Denmark.
Petersen et al., 2020, Petersen et al., 2015, Sandmann et al., 2010,
E-mail address: niels.haumann@clin.au.dk (N.T. Haumann). Timm et al., 2014, Torppa et al., 2012).

https://doi.org/10.1016/j.clinph.2023.01.015
1388-2457/Ó 2023 International Federation of Clinical Neurophysiology. Published by Elsevier B.V.
This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

Electrophysiological tests on auditory brain function provide oped for investigating MMN responses to sound differences in
relatively fast, objective, and non-invasive measures to comple- spectral-temporal features presented in a musical context. With
ment behavioral tests and questionnaires. They are especially the latest development of the MuMuFe CI paradigm, statistically
advantageous when verbal or written tests cannot be adopted such significant MMN responses were successfully obtained in a group
as for infants and young children (Cone-Wesson, 2003, Gibson of CI users for all tested features (intensity, pitch, timbre, rhythm)
et al., 2009, Gilley et al., 2008, Golding et al., 2007, Näätänen on at least one out of four deviant magnitude levels (Petersen et al.,
et al., 2012, Näätänen et al., 2017, Nelson et al., 2008, Ponton 2020). These findings support that MMN is a promising marker of
et al., 2000, Sharma et al., 2002, Silva et al., 2017, Skoe and music discrimination in CI users.
Kraus, 2010, Wang et al., 2015, Zhang et al., 2011). Among those The last 30 years of research on MMN responses in individual
tests, the Wave V component of the auditory brainstem response listeners has, however, not reached sufficient accuracy for clinical
(ABR) can be applied to predict the pure tone hearing threshold application (Bishop and Hardiman, 2010, Dalebout and Fox, 2001,
at specific frequencies (Gibson et al., 2009, Skoe and Kraus, 2010, Escera and Grau, 1996, McGee et al., 1997, Näätänen et al., 2017,
Wang et al., 2015). However, when ABR tests are conducted with Paukkunen et al., 2011, Pekkonen et al., 1995, Uwer and von
a hearing aid or CI device switched on, the sound stimulus is lim- Suchodoletz, 2000) despite of the implementation of paradigms
ited to a duration of only a few milliseconds, to avoid overlap aimed at clinical practice such as the multi-feature versions. For
between the electrical stimulation artifact from the hearing device instance, the least accurate MMN detection performance has been
and the measured wave V occurring at a latency of approximately 5 observed with visual inspection by EEG experts, where confound-
milliseconds. ing cortical sources, such as alpha waves, have been mistakenly
Cortical auditory evoked potentials (CAEPs), such as the audi- identified as MMN in 63 % cases when no MMN was present
tory thalamo-cortical P1 component, are becoming popular mea- (McGee et al., 1997), which means that more than every second
sures for testing hearing thresholds for temporally-spectrally patient would incorrectly pass MMN testing without existing
complex sounds, which are relevant in everyday language learning sound discrimination problems being identified. Proposals have
and understanding (Gilley et al., 2008, Mehta et al., 2019, Sharma been made to improve the accuracy of the individual MMN analy-
et al., 2002, Silva et al., 2017). The electrical stimulation artifacts sis (Bishop and Hardiman, 2010, Dalebout and Fox, 2001, Kalyakin
from the hearing device can be supressed from the measures of et al., 2009, McGee et al., 1997, Näätänen et al., 2017, Ponton et al.,
the CAEPs, e.g., by means of independent component analysis 1997, Rahne et al., 2008, Torppa et al., 2012). The most accurate
(ICA) (Gilley et al., 2006). A limitation of the P1 test is that it is cur- results have been achieved with individual-level statistics, with
rently uncertain whether it can be applied to test listeners’ ability 88.2 % correct detections of MMN absence for indiscriminable
to distinguish between sounds, which is an important prerequisite sounds and 82.4 % correct detections of MMN presence for discrim-
for understanding their meaning. Indeed, everyday sounds in inable sounds (Bishop and Hardiman, 2010). A main challenge with
music and language consist of continuous acoustical feature tran- measurement of individual evoked responses is the confounding
sitions, which the listener must be able to hear, discriminate, and cortical sources (Scharf et al., 2022), such as alpha waves, which
learn (Iverson et al., 2006, Loizou et al., 1998, Shestakova et al., also interfere with the individual MMN measurements
2004). (Haumann et al., 2020).
For testing auditory discrimination in a clinical context, various In this study, we test whether the issues specified above,
CAEP responses have been considered, such as the thalamo-cortical which all limit the accuracy of the individual MMN and its pre-
middle latency Nb and Pb responses (Althen et al., 2016) and the dictive value in assessing the individual music discrimination
cortical long latency P1 (Gilley et al., 2005, Munivrana and skills in CI users, might be overcome by our very recently
Mildner, 2013), N1 (Finke et al., 2016, Munivrana and Mildner, method that allows decomposing the overlapping large-scale
2013, Sandmann et al., 2015, Zhang et al., 2011), P2 (Han et al., cortical activity with spike density component analysis (SCA)
2016, Munivrana and Mildner, 2013, Zhang et al., 2011), mismatch (Haumann et al., 2020). Empirical and simulation studies have
negativity (MMN) (Näätänen et al., 2012, Näätänen et al., 2017, consistently confirmed that SCA is accurate in separating large-
Ponton et al., 2000), P300 (Alniacik and Akdas, 2019, Finke et al., scale bioelectromagnetic cortical activity into sparse temporal
2015, Groenen et al., 2001, Munivrana and Mildner, 2013, Van shapes with distinct scalp topographies from both adults
Yper et al., 2020), and N400 responses (Kallioinen et al., 2016). (Haumann et al., 2020) and children (Bruzzone et al., 2021). Pre-
Among these, the MMN is a promising candidate, because the audi- vious studies on normally hearing young adults and computer-
tory MMN generally reflects discrimination ability for sounds – simulated EEG (Haumann et al., 2020) have shown that SCA is
either verbal, non-verbal, or musical – in health, pathology, and more accurate than spatial principal component analysis (PCA)
across the lifespan (Näätänen et al., 2017). Also, the MMN response and ICA in isolating individual MMN from confounding cortical
does not require the listener to attend to the auditory stimuli or to interfering sources, such as alpha waves.
perform a demanding task, which makes MMN suitable also for In sum, the aim of the present study is to obtain accurate indi-
infants and young children in addition to adults. The auditory vidual markers of central auditory function in CI users that could
MMN is an automatic brain response to an infrequent and rare predict their individual behavioral music discrimination thresh-
sound after a repeated and more expected standard one olds. We hypothesized that statistical detection of the individual
(Näätänen et al., 2017). The acoustical difference between the stan- MMN response would predict individual behavioral music discrim-
dard and deviant sound must be above the just-noticeably differ- ination ability. This was followed up with supplementary assess-
ence threshold to evoke an MMN (Näätänen et al., 2017, Rahne ments of the validity and precision of the hypothesized MMN-
et al., 2014). behavior relationship. Also, since smaller deviant magnitudes
For CI users, the MMN has been recorded to study even residual should extend below the discrimination thresholds of individual
discrimination of spoken language (Kraus et al., 1993, Lonka et al., listeners, we tested whether MMN was detected in fewer individ-
2004, Singh et al., 2004), and musical sounds (Hahne et al., 2016, uals when the deviant magnitudes were smaller. Moreover, we
Koelsch et al., 2004, Lonka et al., 2013, Petersen et al., 2020, assumed that the common dissimilarity between CI users and NH
Petersen et al., 2015, Rahne et al., 2014, Sandmann et al., 2010, groups might be observed for pitch that is most technically chal-
Timm et al., 2014, Torppa et al., 2018, Torppa et al., 2014, Torppa lenging in CI listening. All these findings were obtained with a
et al., 2012, Wable et al., 2000, Zhang et al., 2013). The musical new SCA statistics procedure, therefore, it was relevant to prove
multi-feature (MuMuFe) paradigm (Vuust et al., 2011) was devel- that each option in this new procedure was optimal in terms of
77
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

accuracy and replicability (see the Methods section and Appen- three semitones (–16 % Hz) (L), two semitones (–11 % Hz) (M), or
dices for further details). one semitone (–6% Hz) (S). Timbre deviants were created with an
exchange of a regular piano sound to a guitar (XL), trumpet (L),
2. Methods blues piano (M), or bright piano (S) sound. Finally, rhythm deviants
were inserted as earlier onsets of the third note by 155 ms (XL),
2.1. Participants 103 ms (L), 52 ms (M), or 26 ms (S), (while at the same time short-
ening the second note to avoid sound overlap and lengthening the
This study is based on a re-analysis of 312 cases of averaged third note accordingly to avoid a silent gap).
MMN waveforms from repeatedly measured cochlear implant The sixteen deviants occurred with equal probability (6 %) on
(CI) users and 424 cases from normally hearing controls, previously the third tone in the repeated melody. All deviant tones and
introduced in Petersen et al. (2020). A group of eleven experienced changes of key occurred in a pseudo-randomized order, where
older CI users with an average of 7.0 years CI experience (range 1– the same deviant or key was not repeated consecutively. (The
14 years) and average age of 56.1 years (range 34–77 years) (nine change of key occurred after three repetitions of each of the 16
women) participated in the study. Nine CI users had a high CI out- deviant conditions, and the first tone at each key change was
come with reported ability to speak on the phone (for individual excluded from subsequent analysis.) To reduce the required EEG
details, see Table 1). The average duration of deafness prior to recording time by 50 %, the so-called ‘‘no-standard” paradigm uses
receiving the CI was 23.6 years (range 0 to 56), nine had one CI a common and well-tested procedure of applying the repeated
implant in an ear (unilateral implant) and two in both ears (bilat- tones 1, 2, and 4 in the Alberti Bass pattern as standard tones, as
eral), and six used the left ear for testing whereas five used the an alternative to standard tones on the third tone in every second
right ear. Four CI users in addition used a hearing aid in the ear tone-pattern, with either option resulting in similar MMN differ-
opposite to the ear with the implant. As a control group partici- ence waveforms (e.g., Bonetti et al., 2017, Kliuchko et al., 2019,
pated fourteen older participants with normal hearing and an aver- Kliuchko et al., 2016, Pakarinen et al., 2010). In total there was
age age of 63.4 years (range 56–77), similar to the age of the CI 2304 stimulus trains (i.e., groupings of four tones) and 48 key
group. None of the participants had an academic background in changes.
music, and they reported not to be professional or amateur musi-
cians and to have less than 5 years formal singing or instrument 2.3. EEG procedure
training. The study was conducted in accordance with the Helsinki
declaration and approved by the Research Ethics Committee of the The experiment was conducted at the EEG lab facilities of Aar-
Central Denmark Region. All participants provided written hus University Hospital. EEG was recorded at a sampling rate of
informed consent. 1000 Hz in an electrically and acoustically shielded room with a
BrainAmp amplifier system (Brain Products, Gilching, Germany).
2.2. Stimuli Electrodes were placed in a 32-electrode cap according to the
international 10/20 system. It was ensured that electrode impe-
The cochlear implant musical multi-feature (CI MuMuFe) mis- dances were < 25 kX. An electrooculogram (EOG) was recorded
match negativity (MMN) paradigm (Petersen et al., 2020) was with electrodes beside and above the left eye. FCz was applied as
based on a four-tone Alberti bass melody played in four different an initial reference electrode. The auditory stimuli were played
keys (C, Eb, Gb, and A) (listen to an excerpt of the stimuli in the in mono at a 44.1 kHz sampling rate. During EEG recordings partic-
Supplementary Material audio file). It contained tones in the mid- ipants were instructed to ignore the auditory stimuli and focus on
dle register range from Ab3 (208 Hz) to E5 (659 Hz). All tones had a a movie in which the audio was muted. For all participants, the
duration of 200 ms (except rhythm deviants), a rise and fall time of sound level was individually adjusted to a comfortable level from
18 ms, and were followed by a silent interstimulus interval of 5 ms. a defined starting point of 65 dB SPL. The total EEG recording time
MMN responses to tones were tested on four fundamental features was approximately 35 min.
in music: intensity, pitch, timbre, and rhythm. Deviant tones evok-
ing MMN for each sound feature were inserted at the third tone in 2.4. EEG preprocessing
the Alberti Bass pattern with one out of four deviant magnitudes:
extra-large (XL), large (L), medium (M), or small (S). MMN to inten- The EEG data were preprocessed as in Petersen et al. (2020) by
sity deviants were created by decreasing the intensity of the tone using the FieldTrip Toolbox for Matlab (Oostenveld et al., 2011) for
by 12 (XL), 9 (L), 6 (M), or 3 (S) decibels (dB). Pitch deviants were 1 Hz high-pass, 25 Hz lowpass filtering, independent component
inserted by lowering the pitch by eight semitones (–37 % Hz) (XL), analysis (ICA) for suppression of eye movement and cochlear

Table 1
Demographic and clinical characteristics of the 11 experienced cochlear implant (CI) users. Hearing aid: the participant wears a hearing aid on the ear contralateral to the
implanted ear. Telephone ability: the participant reports ability to communicate via telephone via CI only or both CI and hearing aid. This table is reproduced from Petersen et al.
(2020). Information about the type of CI device has been added when available.

Group Age at project Duration of deafness prior CI experience Number of Side of implant used Type of CI device Hearing Telephone
ID start (years) to CI (years) (years) implants for tests used for tests aid ability
CI01 65–70 32 7 1 L Cochlear, Kanso Yes Yes
CI02 45–50 36 10 1 L Cochlear, N5 CP810 No Yes
CI03 50–55 20 5 1 R Cochlear, N6 CP910 No Yes
CI04 55–60 17 9 2 R Cochlear, N6 CP910 No Yes
CI05 60–65 56 4 1 L Cochlear, N6 CP920 No Yes
CI06 60–65 10 14 2 L Cochlear, N5 No Yes
CI07 45–50 17 7 1 R Cochlear, N6 CP920 Yes Yes
CI08 65–70 55 8 1 R Cochlear, N6 CP920 No No
CI09 75–80 8 4 1 L Cochlear No No
CI10 35–40 9 1 1 R Cochlear Yes Yes
CI11 35–40 0 8 1 L Cochlear Yes Yes
Mean 56.1 23.6 7.0

78
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

implant (CI) artifacts, and re-referencing the channel waveforms to automatically determined by an SCA statistics algorithm described
the average reference across channels. The individual EEG data was below.
segmented into 144 trials for each of the 16 types of deviant tones
and 6288 standard tone trials. Moreover, 16 ‘‘false deviant” wave- 2.6.1. Spike density component analysis (SCA) decomposition
forms contrasting the 16 true deviant conditions were extracted As a first step, in order to suppress confounding alpha waves
based on carefully matched subsets of the standard trials, which disturbing the MMN waveform, the individual averaged difference
contain representative residual EEG noise and no MMN for indis- waveforms were decomposed into spike density component anal-
tinguishable repeated standard tones (cf. Bishop and Hardiman, ysis (SCA) components (Haumann et al., 2020) (Fig. 1 A) (FieldTrip
2010) (see Appendix A for further details). For the individual- compatible Matlab functions for SCA decomposition and SCA
level spike density component analysis (SCA) statistics no baseline statistics are available at https://github.com/nielsthaumann/sca).
correction was applied by default. Instead, we applied a spatiotem- SCA is a type of fast, automatic, non-supervised machine learning
poral SCA filter, which attenuates all other components than the method, which optimizes a model predicting the individual bio-
tested component, and thereby also suppresses any interfering electromagnetic activity of large-scale cortical neural assemblies
components occurring before or after the sound onsets. Remaining from individual EEG or MEG measurements. SCA implements a
noisy trials exceeding -/+ 100 lV were automatically rejected. constraint based on the assumption that the bioelectromagnetic
After the trial rejections, for the CI users, there were on average source of a ‘‘spike density”, or neural current, generated in a
143.5 deviant trials (range: 136–144) and 6244.3 standard trials large-scale cortical neural assembly (10,000 neurons) approxi-
(range: 6049–6288), and for the normally hearing, on average mates a Gaussian shape over time (the term ‘‘spike density” is
143.6 deviant trials (range: 135–144) and 6252.7 standard trials derived from the ‘‘spike train” concept for describing the peristim-
(range: 6048–6288) (all reported deviant trials includes ‘‘false ulus time histograms measured on single neurons). It was verified
deviant” trials). Finally, the average standard trials were subtracted that the Gaussian temporal shapes explain most variance in scalp-
from the average deviant (or ‘‘false deviant”) trials to isolate the recorded EEG and MEG, whereas sine, gamma, and asymmetrical
individual MMN (or ‘‘false MMN”) difference waveforms Gaussian halves shapes explained significantly less variance, and
(Näätänen et al., 2017). We followed a common procedure of ana- it was confirmed that the Gaussian shapes specifically modeled
lysing difference waveforms at the individual level for automatized most of the neural activity originating within the scalp and could
MMN detection (Bishop and Hardiman, 2010, McGee et al., 1997) not model non-neural external signals, such as eye movement arti-
by subtracting the mean standard waveform across trials from facts (Haumann et al., 2020). It should also be noted that the SCA
each deviant trial to isolate the individual MMN at the single method assumes that the signal of interest (i.e., the MMN) shows
trial-level. one or more peaks in time at a signal-to-interference-and-noise
ratio larger than 1 (i.e., in at least one electrode at one time point
2.5. Behavioral auditory discrimination test the MMN should have larger amplitude compared to confounding
alpha waves) (Haumann et al., 2020). These assumptions seem
In addition to the individual MMN testing, all participants com- realistic in the present study for the separation of MMN from con-
pleted a three-alternative forced choice test, where the task was to founding alpha waves in pre-processed averaged EEG waveforms,
identify which one out of sets of three melodic patterns contained because the EEG is time-locked at tone stimulus onsets and
a sound deviant (Petersen et al., 2020). This test resulted in scores thereby confounding alpha waves are partially distributed in phase
of 0 %, 17 %, 33 %, 50 %, 67 %, 83 %, or 100 % correct answers (with and suppressed in amplitude.
chance level at 33.3 %), where higher scores reflect more reliable
sound discrimination. This behavioral test reflects the sound dis-
2.6.2. Region of interest constraints
crimination ability for the same music parameters and levels of
To ensure that the individual pre-attentive MMN was detected,
magnitude as presented in the MMN paradigm measured with
and not other clearly differing responses such as following P3(a,b)
EEG.
responses, and also to ensure fast computational processing of the
statistical analyses, we applied region of interest (ROI) constraints
2.6. Individual-level EEG statistics
(Bruzzone et al., 2021). Only SCA components with a negative peak
in the frontal half of the EEG channels within a relevant MMN
For clinical applications, it would be important to statistically
latency range were tested statistically (Fig. 1B). Since the MMN
determine whether the individual MMN can be interpreted as ab-
latency is more varied in patients, older listeners, and children than
sent (i.e., either absence or presence interpretation in, e.g., Carter
in normally hearing young adults, it is common to apply a rela-
et al., 2010, Golding et al., 2007), because this can indicate a hear-
tively broad individual MMN latency time-window ranging
ing impairment and a need to refer a patient to further testing or
approximately between 0–450 ms in clinical individual MMN liter-
treatment (cf. Kuki et al., 2013, Schmidt et al., 2001). If the individ-
ature (Dalebout and Fox, 2001, Escera and Grau, 1996, McGee et al.,
ual MMN is interpreted as absent for a sound deviance that would
1997, Näätänen et al., 2017, Ponton et al., 1997, Taylor et al., 2017).
trigger a measureable MMN in a normally hearing population (e.g.,
Here we constrained the MMN peak latency to between 75–
MMN to a pitch deviant at a level of 8 semitones difference), then
300 ms.
the individual MMN could be applied as a diagnostic tool
indicating an auditory discrimination disorder (e.g., impaired pitch
discrimination). Statistical detection of individual MMN pres- 2.6.3. Trial-level spatiotemporal SCA filter
ence would be less clinically important because it means that a The inter-trial variance originating from interfering SCA compo-
patient would pass MMN diagnostics, indicating an ability to dis- nents and EEG channel noise was reduced by using the SCA compo-
tinguish between specific sounds. Therefore, we define the test nent as a spatiotemporal filter (cf. Li et al., 2008) (Fig. 1C). The
sensitivity as the percentage correct interpretation of individual spatiotemporal filter was applied to each trial by multiplying the
MMN absence for indistinguishable sounds (cf. Kuki et al., 2013, trial by the tested SCA component to obtain a weighted average,
Schmidt et al., 2001). We define the test specificity as the percent- which reduced signals unrelated to the tested SCA component:
pffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi
age correct detection of individual MMN presence for distinguish- trialf ¼ sgnðtrialW i xi ÞÞ  jtrialW i xi j (1)where trialf is the fil-
able sounds (cf. Kuki et al., 2013, Schmidt et al., 2001). Whether the tered multichannel trial waveform, trial is the multichannel trial
individual MMN was interpreted as either absent or present was waveform, Wi is the component channel weights, and xi is the com-
79
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

p< p p

Fig. 1. Overview of the steps in the spike density component analysis (SCA) statistics procedure. (A) Single-participant EEG difference waveforms decomposed into neural
activity with independent scalp distributions (left) and time-courses (right). (B) Constraining the peak electrodes, polarity, and latency reveals candidate MMN components.
(C) The spatiotemporal filter (black color) efficiently focuses the across-trial EEG variance on an MMN candidate component to be statistically tested (interquartile range
shown in shaded color; comparison to no filtering shown in blue color). (D) Across-trial amplitude histograms. (E) An automatic detection of an SCA component clearly
representative of individual-level MMN (shown with shaded 99% confidence intervals uncorrected for multiple testing).

80
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

ponent waveform. The formula ensured that the tested SCA com- 2017, Golz et al., 2016, Perez-Valero et al., 2021). The advantage
ponent amplitude was always positive-valued. (Also, filtering an of this procedure is that the evaluations reflect the performance
ideal trial waveform without cross-trial variance, trial = Wi xi, of the individual-level MMN test on more deviant features and
results in the same (positive-valued) output as the input, trialf=| magnitudes, as well as on measures from different participants,
trial|.) Since the SCA component amplitude is always positive- which is relevant for clinical applications with individual CI users
valued after the spatiotemporal filtering, an area measure was where consistent individual-level results are important.
derived for each trial simply as the summed amplitude over all
channels and time samples (for more details, see Appendix B). 2.7.1. MMN as a marker of auditory discrimination thresholds in
The distribution of area measures across trials was then submitted individual CI users
to individual-level SCA statistics. 2.7.1.1. Diagnostic accuracy. The diagnostic accuracy was analyzed
with a receiver operating characteristic (ROC) curve based on vary-
2.6.4. Individual-level SCA statistics ing the p-threshold on 100 equal logarithmic steps from 10-34 to 1.
In previous work, the SCA components were considered signif- The test sensitivity in the ROC analysis was based on the ‘‘false
icant, if they correlated with a specific template, e.g., a grand- MMN” with indistinguishable sounds. The sensitivity was defined
average template (Haumann et al., 2020). However, the template as the percentage correct retainment of the null-hypothesis, mean-
match method assumed that the individual latency or topography ing that there was no individual MMN, and indicating inability to
did not deviate significantly from the specific template, which is discriminate between the sounds. Also, an individual should be
violated in heterogenous samples, particularly in developmental able to pass the MMN testing with an outcome that does not moti-
or clinical samples. These limitations were solved by proposing vate for treatment. This is indicated by the test specificity, which
that each SCA component could be statistically tested based on was estimated as the percentage correct individual MMN detec-
the individual-level trial distribution (Bruzzone et al., 2021). For tions for the cases where the individual study participants scored
the present study, we solved two remaining issues. First, we intro- above chance level on the behavioral sound discrimination test.
duce a simple and standardized significance p-threshold, instead of The balanced accuracy was calculated as the sum of the sensitivity
a first significance threshold for SCA component correlation with and specificity divided by two. The area under the curve for the
sub-averages, and a second significance threshold for determining sensitivity and specificity was compared to the random chance
SCA component consistency across sub-averages (Bruzzone et al., level diagnostic outcome with the Wilcoxon statistic as imple-
2021). Second, we increase the computational speed by applying mented in SPSS (Coelho and Braga, 2015). The ROC curves were
one statistical test on each SCA component, instead of previous visualized with bias-corrected and accelerated 95 % confidence
100 statistical tests for each SCA component’s correlation with intervals with the Matlab function fitglm (using the binomial distri-
100 sub-averages. For statistical inference, the distribution of the bution logistic regression option) and the Matlab function per-
SCA component area measures across trials was tested with a fcurve (applying 1000 bootstrap permutations).
one-sample t-test (Fig. 1D). If the t-test resulted in a p-value smal-
ler than the p-threshold, then the null-hypothesis that the SCA 2.7.1.2. Validity. Supplementary to the main hypothesis on diag-
component is part of the error distribution centred on the baseline nostic accuracy, the validity and precision of the individual
at 0 lV was rejected (Fig. 1E), otherwise, the null-hypothesis was MMN-behavior relationships were further assessed. Initial inspec-
retained. tion suggested that the assumption of a continuous (linear or non-
To verify the effects of choosing the proposed optimal SCA linear) relationship between the individual MMN peak amplitude
statistics on the diagnostic accuracy and the control of the replica- measured within the region of interest (defined above) and the
bility of the individual-level results, the tailoring of the individual- behavioral hit rate was violated. Therefore, it was considered inap-
level SCA statistics was compared to common nonoptimal options. propriate to model a unit-wise change in the MMN amplitude in
Choosing common but nonoptimal options led to significantly lV per change in the behavioral score in percentage hit rate.
lower diagnostic accuracy and lower control of the replicability Instead, we tested whether the individual MMN amplitude was
of the individual-level results (all methodological comparisons lower when the behavioral discrimination was not detected (at
and results are explained in detail in Appendix C). chance level or lower) compared to detected (above chance level).
Finally, the state-of-the-art ‘‘t-cluster” method was tested. For Due to unequal sample-sizes, this comparison was tested with the
valid comparison with SCA statistics, the same ROI constraints Welch’s test. A comparison was also made with the Welch’s test to
(section 2.6.2) were applied for t-clusters as for SCA statistics. At assess whether the individual MMN peak latency measured within
each time sample, one-sample t-tests were conducted across trials, the region of interest (defined above) was longer for absent than
and the t-cluster p-values were obtained as the maximum p-value detected behavioral discrimination. Further, the behavioral hit rate
over 32 ms consecutive time samples (8 at 250 Hz) (Bishop and might be lower when the individual MMN was not detected com-
Hardiman, 2010). If the p-value remained smaller than the p- pared to detected, also assessed with the Welch’s test.
threshold across 32 ms consecutive time samples, the t-cluster The above assessments pointed towards the common observa-
was interpreted as significant, otherwise non-significant (Bishop tion that the individual MMN can be detected when behavioral dis-
and Hardiman, 2010). crimination is absent (Näätänen et al., 2017), and behavioral
detection can also be present when individual MMN is not
2.7. Statistical evaluation of the prediction of behavioral auditory detected (Bishop and Hardiman, 2010). It was investigated
discrimination based on the individual MMN whether the common occasional MMN-behavior dissociations
might indicate different discrimination thresholds between the
All subsequent statistical analyses were conducted with the MMN and behavioral tests. This assumption was tested with Pear-
IBM SPSS v27 software package (IBM, Armonk, New York, USA). son’s chi-squared tests comparing the percentage of individual
The CI and the NH groups were investigated separately. As is com- MMN detections against behavioral detections for each group
mon in classification studies where the EEG is applied to predict a and each stimulus condition.
certain behavioral outcome, the repeated measures for the 16
stimulus conditions from each participant were treated as inde- 2.7.1.3. Precision. To further clarify the reason of the occasional
pendent observations, where each observation depends on noise MMN-behavior dissociations, logistic regression was applied to
in the EEG trials and in the behavioral tests (e.g., Amin et al., test a measurement error hypothesis: that the percentage missing
81
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

individual MMN or behavioral detections would increase when the method compared to the state-of-the-art ‘‘t-cluster” method
deviant magnitudes decrease. I.e., when the deviant magnitude (Bishop and Hardiman, 2010).
approaches the individual discrimination threshold more measure-
ment errors would be expected, which would be indicated by more
3. Results
frequent incongruent individual MMN compared with behavioral
test outcomes (where either individual MMN or behavioral dis-
3.1. MMN as a marker of auditory discrimination thresholds in
crimination is detected but not both). Finally, it was evaluated
individual cochlear implant users
whether the MMN and behavioral tests were equally precise. This
was assessed with the Mann-Whitney U test for inferring whether
The behavioral discrimination thresholds were predicted with
the number of missing individual MMN in comparison to behav-
high accuracy by the individual MMN detections, and the discrim-
ioral detections were equally distributed over the deviant
ination thresholds estimated with the pre-attentive individual
magnitudes.
MMN and attentive behavioral tests were similar (Fig. 2). Occa-
sional differences between the individual MMN and behavioral
2.7.1.4. Correlation with music appreciation and clinical factors. Rela-
results did not indicate functional differences and were mainly
tionships between the individual MMN amplitude and latency at
explainable by measurement errors (Fig. 2B-C). For the adult expe-
the Fz electrode and music appreciation and clinical factors were
rienced cochlear implant (CI) users and normally hearing (NH) con-
explored with Pearson’s product moment correlations. Statistical
trols the occasional measurements errors were similar between
inferences were derived for the following expected relational
the individual MMN and the behavioral tests. This suggests that
directions: higher individual MMN amplitude and faster individual
the individual MMN is an accurate marker of auditory discrimina-
MMN latency for more rated enjoyment of music, hours of music
tion thresholds.
listening, and knowledge of music, higher rated quality of musical
sounds with the CI, younger age, fewer years of deafness prior to
the CI implantation, and more years of CI experience. Each of the 3.1.1. Diagnostic accuracy
16 MMNs (four features at four magnitudes) were tested for each The individual CI users’ ability (or inability) to discriminate
individual CI users. The results were not corrected for multiple between the tones was predicted with high accuracy by the statis-
comparisons and only regarded as non-conclusive inspiration for tically significant (or nonsignificant) individual MMN. The ROC
future studies. analysis showed that the automatic individual MMN detection is
a highly accurate marker of individual CI users’ auditory discrimi-
2.7.2. Music discrimination thresholds for individual experienced CI nation ability (Fig. 2A), AUC = 0.96 (95 % CI: [0.94, 0.98]), and is sig-
users nificantly more accurate than the 50 % chance level (AUC = 0.50),
To further substantiate the main hypothesis on the relationship p <.001. Based on the ROC analysis, we recommend applying a the-
between individual MMN and behavioral discrimination, we veri- oretically expected confidence level of 99 % for the sensitivity (see
fied that the individual music discrimination threshold was passed the Appendix D, Figure D1), which for the CI users resulted in an
when the deviant magnitudes decreased. For all features, logistic empirical observed test sensitivity of 93.2 % (164/176), specificity
regression was applied to test whether the percentage of individu- of 85.3 % (116/136), and balanced accuracy (BAC) of 89.2 %. This
als showing individual MMN decreased as expected when the devi- individual MMN detection threshold p <.01 is applied for all subse-
ant magnitude decreased. A significant result indicated that the quent results. Similar findings were observed for the NH controls:
deviant magnitude crossed from above to below the individual’s AUC = 0.95 (95 % CI: [0.93, 0.97]), the comparison to chance level
discrimination threshold. shows a significant difference, p <.001, and the empirical test sen-
Additionally, we attempted to replicate the common group- sitivity was 91.1 % (204/224), specificity 90.0 % (180/200), and BAC
level findings of similar intensity, timbre, and rhythm, but not 90.5 %. In the following sections, results of supplementary assess-
pitch discrimination, between individual CI users and normally ments are reported on the validity and precision of the individual
hearing. The percentage individuals showing MMN at each deviant MMN-behavior relationship.
magnitude was compared between the CI and normally hearing
groups. Since the expected cell count tended to be less than 5 in 3.1.2. Validity
the contingency tables, the Fisher’s exact test was applied for the Relationships between MMN detection and behavioral detection:
group comparisons instead of the Pearson’s chi-squared test. Bon- When the behavioral test indicated ability to discriminate between
ferroni correction at p =.05/4 = 0.0125 was applied to interpret the the tones compared to no discrimination ability, the group-average
significance of the planned group comparisons with tests on each MMN amplitude was significantly higher at the Fz electrode in the
of the four deviant magnitudes. CI users, Mdiff = –0.25 lV, 95 %CI: [–0.47, –0.03], t(84.6) = –2.3,
p =.026, d = –0.4, and the NH controls, Mdiff = –0.33 lV, 95 %CI:
2.7.3. SCA statistics compared with preceding state-of-the-art [–0.61, –0.04], t(32.3) = –2.3, p =.026, d = –0.4 (Fig. 2B). When
Finally, it was assessed whether SCA statistics showed higher the individual MMN was detected compared to interpreted as
diagnostic accuracy compared to the preceding state-of-the-art. absent, the group-average behavioral hit rate showed a tendency
For signal-to-interference-and-noise ratios (SNIRs) in the range of of higher scores for the CI users, Mdiff=+11.2 %, 95 %CI: [–1.0,
approximately 1–10, the SCA method is known to show higher 23.4], t(38.5) = 1.9, p =.072, d = 0.4, and was significantly higher
gains in accuracy at lower SNIRs (Haumann et al., 2020). Therefore, for the NH controls, Mdiff=+18.4 %, 95 %CI:[6.5, 30.2], t(28.8) = 3.2,
for each individual MMN test, a SNIR measure was estimated based p =.004, d = 0.8 (Fig. 2B). These results further substantiates that
on the highest valued t-statistic from the t-tests applied in the SCA the individual MMN is a valid marker of behavioral auditory
statistics procedure. This SNIR estimate is a unitless quantity discrimination.
reflecting the mean amplitude divided by the standard error of Similar MMN and behavioral discrimination thresholds: A relevant
the mean amplitude across trials. With the Welch’ test it was question was whether the typical, occasional double dissociations
investigated whether the SNIR was lower in the CI users compared between the individual MMN and behavioral test outcomes
to the NH. For the CI and NH groups, by applying the Wilcoxon test (Fig. 2B) were caused by functional differences in the underlying
on the ROC areas under the curves it was tested whether the diag- auditory discrimination ability. When comparing the total number
nostic accuracy was higher with the proposed SCA statistics of discrimination detections achieved with the MMN to the behav-
82
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

83
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

Table 2
Percentage individuals with MMN detected and behavioral discrimination. Percentage individual MMN detections in the CI user group and the normally hearing (NH) group is
shown for each deviant feature and deviant magnitude, indicated by statistically significant spike density component analysis (SCA) components within the ROI at p <.01 (with
Benjamini-Yekutieli False Discovery Rate correction for multiple SCA component testing). ns. means no significant SCA components within the region of interest. Also is shown the
percentage individuals with behavioral discrimination, based on individual scores above chance level (>33 % correct).

Deviant feature Deviant magnitude Individual CI users Individual NH controls


MMN detected Behavioral discrimination MMN detected Behavioral discrimination
Intensity XL 100 % 64 % 100 % 100 %
L 82 % 64 % 86 % 79 %
M 73 % 27 % 71 % 71 %
S 64 % 27 % 50 % 43 %
Pitch XL 91 % 73 % 100 % 100 %
L 100 % 91 % 93 % 100 %
M 73 % 82 % 86 % 100 %
S 55 % 73 % 100 % 100 %
Timbre XL 100 % 100 % 93 % 100 %
L 82 % 100 % 86 % 100 %
M 55 % 82 % 86 % 91 %
S 91 % 91 % 86 % 79 %
Rhythm XL 91 % 100 % 100 % 100 %
L 100 % 91 % 100 % 100 %
M 91 % 100 % 93 % 100 %
S 100 % 73 % 93 % 64 %

ioral tests (Table 2) for each group, deviant feature, and deviant r = 0.31, which suggests that the MMN and behavioral tests were
magnitude, no significant differences were found between the similarly precise.
MMN and behavioral tests (Appendix D, Table D2). These results
suggest that the individual MMN and behavioral tests reflect sim- 3.1.4. Exploratory correlations with music appreciation and clinical
ilar auditory discrimination thresholds. factors
No relationship between MMN latency and behavioral detection: With regards to music appreciation, CI users providing higher
When the behavioral test showed ability to discriminate between ratings of enjoyment of listening to music tended to show faster
the tones compared to no discrimination ability, the group- individual MMN latency for the S (1-semitone) pitch deviant (scat-
average MMN peak latency did not differ significantly for the CI ter plots are shown in Appendix D, Figure D2), r(6) = –0.91, p =.011.
users, Mdiff = –11 ms, 95 %CI: [–30, 8], t(44.4)=, p =.239, d = –0.3, Also, CI users providing higher ratings of sound quality tended to
and only showed a weak tendency for the NH controls in the oppo- show higher individual MMN amplitudes (i.e., more negativity at
site than expected (slowing instead of speeding up) direction, Fz) for the S (bright piano), r(11) = –0.77, p =.006, and the XL (gui-
Mdiff=+23 ms, 95 %CI: [1, 46], t(21.2) = 2.2, p =.043, d = 0.6. tar), r(11) = –0.69, p =.019, timbre deviants (Appendix D,
Figure D2).
With respect to clinical factors, fewer years of deafness prior the
3.1.3. Precision CI implantation tended to be related to higher individual MMN
Behavioral detections were occasionally missing when individ- amplitude, r(11) = 0.68, p =.020, and faster individual MMN
ual MMN was detected above the ‘‘false MMN” detection rate latency, r(11) = 0.65, p =.031, for the L rhythm deviant (Appendix
(Fig. 2B). Vice versa, occasionally (on average 14.7 % (20/136) cases D, Figure D3).
for CI users and 10.0 % (20/200) cases for NH controls), individual No additional significant correlations were observed between
MMN was missing when behavioral discrimination was detected individual MMN amplitude or latency and music appreciation
above chance level (Fig. 2B). As expected from the measurement and clinical factors. The p-values concerning music appreciation
error hypothesis, lower deviant magnitudes were significantly and clinical factors were not corrected for multiple comparisons,
related to a higher percentage of missing behavioral or MMN and the observed significant tendencies should be interpreted with
detections (Fig. 2C) in both CI users, model v2(1) = 9.8, p =.002, caution.
R2N = 0.08, exp(b) = 1.6, 95 %CI: [1.2, 2.2], p =.002, and NH controls,
model v2(1) = 16.9, p <.001, R2N = 0.12, exp(b) = 2.0, 95 %CI: [1.4, 3.2. Music discrimination thresholds for individual experienced CI
2.9], p <.001.The highest number of missing discrimination ability users
detections occurred at the S (small) deviant magnitude in both CI
users and NH (Fig. 2C) (for further details, see Appendix D, For the experienced CI users, the tested intensity and pitch devi-
Table D1). The deviant magnitudes where detections were gener- ant magnitudes were crossing 50 %-64 % of the participants’ dis-
ally missing were not significantly different between MMN and crimination thresholds, whereas the tested small timbre and
behavioral tests (Fig. 2C) for the CI users, U = 348.0, n = 52, rhythm deviants remained above most (91 %-100 %) of the experi-
p =.580, r = 0.08, and the NH controls, U = 124.5, n = 39, p =.065, enced CI participants’ discrimination thresholds (Table 2). As
3
Fig. 2. MMN as a marker of auditory discrimination thresholds in individual cochlear implant users. Results are shown for cochlear implant (CI) users and normally
hearing (NH). (A: Diagnostic accuracy) The ROC curves show the sensitivity (% correct individual MMN-based automatic diagnosis of ‘‘discrimination inability” for the
repeated tones) and specificity (% correct individual MMN-based automatic diagnosis of ‘‘discrimination ability” when attentive discrimination was above chance level)
across varied p-thresholds. The diagonal line indicates the 50 % chance level, and the shaded error areas the 95 % bias-corrected and accelerated bootstrap confidence
intervals. (B: Validity) Relationships between peak MMN amplitude in lV at the Fz electrode (measured within the region of interest) and attentive hit rate in %. The
horizontal dashed line marks the 33 % chance level for the attentive behavioral test. Error bars indicate the 95 % confidence intervals, and individual cases are marked by grey
circles. (C: Precision) Comparisons between the % observations with missing attentive detections when MMN is detected and missing MMN detections when attentive
discrimination is detected. Error bars indicate the 95 % confidence intervals, and individual cases are marked by grey circles. Significance levels: *** p <.001, ** p <.01, * p <.05, y
p <.10.

84
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

expected, the experienced CI users showed similar music discrim- (Table 3) (Bonferroni corrected significance level for the four
ination thresholds compared to NH controls, except for the pitch planned comparisons: p =.05/4 = 0.0125). This means that, accord-
discrimination thresholds that were higher for the experienced CI ing to the individual MMN results, the experienced CI users’ pitch
users in comparison to the NH (Table 2). discrimination thresholds were often between 1–2 semitones for
pitch decrease (between 6 % and 11 % decrease in Hz), whereas
3.2.1. Intensity determining the discrimination thresholds for the NH required
All experienced CI users showed significant individual MMN smaller intervals than the smallest tested 1 semitone pitch
responses to the extra-large (XL) intensity deviant (Table 2). Low- decrease. The behavioral discrimination test showed similar ten-
ering the intensity deviant magnitude resulted in a significant dencies, which, however, did not reach statistical significance
decay in the percentage individual CI users showing MMN, model (Appendix E, Table E1).
v2(1) = 5.0, p =.025, R2N = 0.17, exp(b) = 0.44, 95 %CI: [0.20, 0.97],
p =.042. 3.2.3. Timbre
Similar findings were observed for the NH control group All experienced CI users showed significant individual MMN
(Table 2). All NH showed individual MMN to the XL intensity devi- responses to the XL timbre deviant (Table 2). Lowering the timbre
ant. Lowering the intensity deviant magnitude resulted in a signif- deviant magnitude did not result in a significant decay in the per-
icant decay in the percentage individual NH with MMN detected, centage of individual CI users with MMN detection, model
model v2(1) = 11.7, p <.001, R2N = 0.29, exp(b) = 0.32, 95 %CI: v2(1) = 1.1, p =.291, R2N = 0.04, exp(b) = 0.69, 95 %CI: [0.34, 1.40],
[0.15, 0.69], p =.004. p =.302.
Comparisons between the experienced CI and NH groups Among the NH controls, 93 % showed individual MMN to the XL
showed that the percentage individual MMN detection was the timbre deviant (Table 2). Lowering the timbre deviant magnitude
same for the XL intensity deviant and not significantly different did not result in a significant decay in the percentage of individual
at the large (L), medium (M), and small (S) deviant magnitudes NH with MMN detection, model v2(1) = 0.3, p =.587, R2N = 0.01, exp
(Table 3) (Bonferroni corrected significance level for the four (b) = 0.82, 95 %CI: [0.40, 1.68], p =.589.
planned comparisons: p =.05/4 = 0.0125). This means that experi- Comparisons between the experienced CI and NH control
enced CI users and NH controls have similar intensity discrimina- groups showed that the percentage of individual MMN detection
tion thresholds according to the individual MMN results. The was not significantly different at the XL, L, M, and S deviant mag-
individual MMN results were consistent with the behavioral test nitudes (Table 3) (Bonferroni corrected significance level for the
results (Appendix E, Table E1). four planned comparisons: p =.05/4 = 0.0125). The individual
MMN results were consistent with the behavioral test results
3.2.2. Pitch (Appendix E, Table E1).
Among the experienced CI users, 91 % showed significant indi-
vidual MMN responses to the XL pitch deviant (Table 2). Lowering 3.2.4. Rhythm
the pitch deviant magnitude resulted in a significant decay in the Among the experienced CI users, 91 % showed significant indi-
percentage individual CI users with MMN detected, model vidual MMN responses to the XL rhythm deviant (Table 2). Lower-
v2(1) = 6.8, p =.009, R2N = 0.23, exp(b) = 0.37, 95 %CI: [0.16, 0.87], ing the rhythm deviant magnitude did not result in a significant
p =.022. decay in the percentage individual CI users showing MMN, model
All NH showed individual MMN to the XL intensity deviant v2(1) = 0.4, p =.512, R2N = 0.03, exp(b) = 1.55, 95 %CI: [0.40, 6.09],
(Table 2). Lowering the pitch deviant magnitude did not result in p =.528.
a significant decay in the percentage individual NH with MMN Similar findings were observed for the NH control group
detected, model v2(1) = 0.1, p =.790, R2N = 0.00, exp(b) = 0.87, (Table 2). All NH showed MMN to the XL rhythm deviant. Lowering
95 %CI: [0.30, 2.48], p =.791. the rhythm deviant magnitude did not result in a significant decay
Comparisons between the experienced CI and NH control in the percentage individual NH showing MMN, model v2(1) = 1.9,
groups showed that the percentage of individual MMN detection p =.173, R2N = 0.12, exp(b) = 0.35, 95 %CI: [0.6, 2.2], p =.256.
was not significantly different at the XL, L, and M deviant magni- Comparisons between the experienced CI and NH control
tudes, though, at the S deviant magnitude, significantly fewer CI groups showed that the percentage of individual MMN detection
users (55 %) than NH controls (100 %) showed individual MMN was not significantly different at the XL, the same at the L deviant,

Table 3
Comparisons between the percentage of cochlear implant and normally hearing individual MMN detections. Showing the Pearson’s chi-squared test results. The p-values are
corrected with Fisher’s exact test. ** indicates statistically significant difference between the cochlear implant and normally hearing groups at p <.01.

Feature Magnitude n df v2 p u
Intensity XL 25 1 0.0 1.000 0.00
L 25 1 0.1 1.000 0.05
M 25 1 0.0 1.000 0.01
S 25 1 0.5 0.689 0.14
Pitch XL 25 1 1.3 0.440 0.23
L 25 1 0.8 1.000 0.18
M 25 1 0.6 0.623 0.16
S 25 1 8.0 0.009** 0.56**
Timbre XL 25 1 0.8 1.000 0.18
L 25 1 0.1 1.000 0.05
M 25 1 3.0 0.177 0.35
S 25 1 0.2 1.000 0.08
Rhythm XL 25 1 1.3 0.440 0.23
L 25 1 0.0 1.000 0.00
M 25 1 0.0 1.000 0.03
S 25 1 0.8 1.000 0.18

85
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

Fig. 3. Grand-average difference waveforms with spike density component analysis (SCA) statistics. Difference waveforms shown for the cochlear implant (CI) users and
normally hearing (NH) groups for each deviant feature and magnitude. Vertical axes indicate voltage in lV, horizontal axes peristimulus time in milliseconds. Shaded colors
indicate group-level bootstrap 95 % confidence intervals, and thin lines depict the individual-level waveforms of significant SCA component(s) (projected and mixed onto the
EEG channels). Group-average topographies at the peak latency (measured within the region of interest) are shown above the waveforms; cold colors indicate negative and
warm colors positive voltages between –4 to + 4 lV. * (p <.05) and ** (p <.01) indicate that MMN was detected in significantly fewer individuals when the deviant magnitude
was lowered.

86
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

and not significantly different at the M and S deviant magnitudes which showed higher diagnostic accuracy (BAC = 89.2 %) compared
(Table 3) (Bonferroni corrected significance level for the four to the preceding state-of-the-art on individual-level EEG statistics
planned comparisons: p =.05/4 = 0.0125). The individual MMN methods (BAC = 70.8 %-85.3 %) (Bishop and Hardiman, 2010,
results were consistent with the behavioral test results (Appendix McGee et al., 1997).
E, Table E1). Altogether, the improved accuracy in measuring individual
MMN responses opens new avenues for testing the progress of
the individual CI user with rehabilitation interventions, such as
3.3. SCA statistics compared with preceding state-of-the-art
the effects of music training even suggesting improved speech pro-
cessing in pediatric CI users related to music training (Petersen
The proposed SCA statistics was more accurate than the preced-
et al., 2015, Torppa et al., 2018).
ing state-of-the-art. The initial individual MMN signal-to-noise-
and-interference ratio (SNIR) was significantly lower in the CI users
4.1. MMN as a marker of auditory discrimination thresholds in
(average peak SNIR = 4.3) than in the NH controls (average peak
individual cochlear implant users
SNIR = 5.0), Mdiff = –0.7, 95 %CI: [–1.2, –0.3], t(253.9) = –3.1,
p =.002, d = –0.4. As expected, for the CI users with relatively low
4.1.1. Functional relationship between MMN and behavioral
SNIR, the SCA statistics led to significantly higher diagnostic accu-
discrimination thresholds
racy (balanced accuracy (BAC) = 89.2 %) in comparison to the state-
The behavioral testing of sound discrimination is based on
of-the-art ‘‘t-cluster” method (BAC = 86.1 %) (Fig. 2A), area under
slower attentive responses compared to the individual MMN, and
the curve difference (AUCdiff) = 0.02 (95 % CI: [0.01, 0.03]),
contextual information for sounds both preceding and succeeding
p <.001, d = 0.3. Also, as expected for the already high SNIRs of
the deviant sound can influence the behavioral response. By con-
the NH controls, the proposed SCA statistics showed similarly high
trast, the individual MMN response is a faster, automatic, preatten-
accuracy (BAC = 90.5 %) in comparison to the ‘‘t-cluster” method
tive, neural response compared to the behavioral response, and the
(BAC = 91.0 %), AUCdiff = –0.00 (95 % CI: [–0.01, 0.00]), p =.466,
individual MMN follows immediately after the onset of the deviant
d = –0.0.
sound (Näätänen et al., 2017). Despite these differences in process-
Furthermore, the SCA components succeeded in modeling med-
ing stages, the present results did not suggest functional differ-
ian 99.87 % (range: 70.75 %-99.98 %) of the variance in the CI users’
ences between the individual MMN detection and the behavioral
individual EEG waveforms. Similarly, the SCA components mod-
discrimination. While evidence for a correspondence between the
eled median 99.86 % (range: 85.09 %-99.99 %) of the variance in
MMN and behavioral auditory discrimination exists for groups of
the NH controls’ individual EEG waveforms. This shows that the
CI listeners (e.g., Rahne et al., 2014), we are not aware of previous
modeling performance of the SCA method was similarly high for
studies showing a direct relationship between MMN and behav-
individual CI users and NH. (More details on individual-level and
ioral sound discrimination ability at the individual level in both
group-level MMN topographies and waveforms before and after
normally hearing listeners and CI users. Moreover, the individual
applying SCA statistics are available in Fig. 3 and Appendix E, Fig-
discrimination thresholds were similar, regardless of whether they
ure E1, Figure E2, Figure E3, Figure E4, Figure E5, and Figure E6.)
were estimated with the MMN or a behavioral test. These findings
mutually support that the individual MMN is an accurate marker of
4. Discussion auditory discrimination thresholds in individual CI users. The find-
ings also suggest that incongruent MMN and behavioral outcomes
In this study, we investigated whether the statistical detection are not always explainable by functional differences, also, mea-
of individual MMN responses is an accurate neurobiological mar- surement errors near the discrimination thresholds and
ker of behavioral individual music discrimination thresholds of suprathreshold ceiling effects on the behavioral hit rates should
cochlear implant (CI) users. Automatic MMN detections for indi- be taken into consideration.
vidual CI users showed a high diagnostic balanced accuracy
(BAC) of 89.2 % and a similarly high BAC of 90.5 % for normally 4.1.2. The influence of measurement errors on MMN and behavioral
hearing (NH) controls. For each deviant magnitude and feature, tests
the number of participants showing no MMN detection and no We observed that the individual MMN and behavioral test
behavioral discrimination above chance level did not differ signif- results were more disturbed by measurement errors at the smaller
icantly within the CI and the NH groups, suggesting that the sound deviant magnitudes near the discrimination thresholds compared
discrimination thresholds estimated with the individual MMN and to the larger deviant magnitudes well above the discrimination
the behavioral tests were similar. Also, there was lower congru- thresholds. For the here tested adult CI user and NH groups we
ency between the MMN and behavioral test results for smaller found that the measurement errors were similar, regardless of
deviant magnitudes. Though, for each deviant magnitude, auditory whether the MMN or the behavioral tests were applied. Though,
feature, and participant group, there were no significant differ- the sources of the measurement errors are known to differ
ences between the number of participants with missing MMN between the MMN and the behavioral test. While the individual
(when behavioral discrimination was detected) compared to the MMN is mainly masked by neural interferences from ongoing
number of participants with missing behavioral discrimination background brain processes (e.g., Haumann et al., 2020), the
(when MMN was detected), suggesting that the MMN and behav- behavioral test is typically confounded by attentive, cognitive, or
ioral tests were equally precise for estimating the individual sound motoric disabilities (e.g., Norrix, 2015). Infants and children are
discrimination thresholds. These findings are particularly promis- known to elicit measurable MMN responses to deviant sounds
ing, e.g., for applying the individual MMN to test the development (Fellman and Huotilainen, 2006, Torppa et al., 2012), whereas mea-
of individual pediatric CI users, who can complete MMN tests surement errors seem to be more limiting behavioral testing of
(Torppa et al., 2018, Torppa et al., 2014, Torppa et al., 2012) but infants and children (Kuki et al., 2013, Norrix, 2015) compared
commonly experience difficulties with completing behavioral tests to, e.g., the adult groups in the present study. A study found that
(e.g., Kuki et al., 2013, Kumari et al., 2016). All these findings were behavioral observation audiometry testing for infants reached a
partly achieved with an optimized, semi-automatic, and easy to sensitivity of 94.2 % but only a specificity of 67.7 % (with auditory
inspect (by suppressing interfering cortical signals from the EEG brainstem response applied as the correct reference test). This
images) spike density component analysis (SCA) statistics method, means that approximately every third infant was incorrectly diag-
87
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

nosed as having a hearing disorder, due to measurement errors in ferences, and inefficient auditory processing of the 1-semitone dif-
the behavioral test (Kuki et al., 2013). One advantage of the indi- ferences limits CI users ability to perceive musical moods or
vidual MMN is that it is measurable without requiring the atten- emotions, which are part of the enjoyment of music listening
tive, cognitive, or behavioral abilities needed for behavioral (Caldwell et al., 2015). Moreover, we observed that individual CI
testing (Näätänen et al., 2017). Thereby, the individual MMN could users with higher MMN amplitude for the bright piano and guitar
potentially facilitate better auditory discrimination tests for CI timbre deviants might predict higher ratings of the perceived qual-
users with attentional, cognitive, or motor impairments. Moreover, ity of musical sounds. Furthermore, our findings suggested that
the individual MMN might be considered more ecologically valid earlier CI implantation after the severe hearing loss might lead to
than behavioral testing, because the MMN indicates that sound higher individual MMN amplitude and faster individual MMN
discrimination ability has been established at an auditory process- latency for the large –103 ms rhythm deviant (that occurs maxi-
ing level where attentive and cognitive effort is minimal, which is mally out of phase in between the 205 ms tone stimulus onset
an important aspect for diagnostics of hearing performance in real- asynchrony and shows the average highest rhythm MMN ampli-
istic listening situations, in which minimization of required atten- tude in the experienced CI users (Petersen et al., 2020)). It should
tion and cognitive effort is desirable (Faulkner and Pisoni, 2013, be mentioned that these relationships were not observed in previ-
Perreau et al., 2017). Another potential advantage might be a pos- ous group analysis on the same EEG data when the new SCA statis-
sibly higher sensitivity of the individual MMN to listening effort tics method was not applied (Petersen et al., 2020). The
than behavioral measures. For instance, if the fast early-stage replicability of these uncorrected exploratory relationships
MMN is missing for a deviant stimulus, suggesting that the audi- between individual MMN and music appreciation and clinical fac-
tory discrimination has not been established pre-attentively, tors would need to be further tested in future studies before any
behavioral discrimination might still be detected based on slower conclusions can be drawn.
later-stage auditory processes requiring more listening effort.
4.2. Music discrimination thresholds for individual experienced
4.1.3. Suprathreshold ceiling effects on behavioral hit rates but not on cochlear implant users
MMN amplitudes
In the present study we investigated binary diagnostic out- For the first time, we estimated music discrimination thresh-
comes, where the individual MMN was either detected or not, olds for experienced individual cochlear implant (CI) users based
and we found that the individual MMN detection was significantly on individual MMN detections.
related to sound discrimination being present or not. An outstand-
ing question is whether CI users perceive larger deviant magni-
4.2.1. Intensity
tudes as larger compared to smaller deviant magnitudes, and
As expected, MMN was detected in fewer individual CI users
whether these perceptual magnitude differences might be
and normally hearing (NH) participants when the intensity deviant
reflected by the individual MMN amplitudes. For this purpose,
magnitudes were smaller, which supports the validity of the indi-
the traditional application of behavioral hit rate measures in
vidual MMN as a marker of music discrimination thresholds. The
MMN studies (Bishop and Hardiman, 2010, Petersen et al., 2015,
neural discrimination thresholds for the intensity differences were
Ponton et al., 2000, Rahne et al., 2014, Sandmann et al., 2010,
similar between the individual experienced CI users and the NH
Timm et al., 2014, Torppa et al., 2018) might maintain a validity
controls. This suggests that, despite the dynamical range is limited
issue, because the hit rate indicates the probability of perceiving
with CI (Petersen et al., 2020), the individual experienced CI users
a difference, and it has a noticeable ceiling effect for suprathresh-
detected the dynamical changes between –3 to –12 dB in the music
old stimuli (due to the ‘‘S”-shaped relationship between the devi-
stimuli equally well compared to the NH controls.
ant magnitude and the discrimination probability) (Grondin,
2016). By contrast, the MMN amplitude increases continuously
for deviant magnitudes above the discrimination threshold 4.2.2. Pitch
(Näätänen et al., 2017). In a group-level analysis on the same data- For the pitch differences, also, MMN was detected in fewer indi-
set analysed in the present study (Petersen et al., 2020), vidual CI users when the deviant magnitudes were smaller, which
suprathreshold ceiling effects were evident in behavioral hit rates, again supports the validity of the individual MMN as a marker of
whereas the MMN amplitudes continued increasing for deviant music discrimination thresholds in individual CI users. The individ-
magnitudes above the discrimination threshold (especially for ual CI users showed neural ability to detect the XL, L, and M pitch
the NH pitch, timbre, and rhythm results). Also, the suprathreshold deviants comparable to the NH. However, only 55 % (6/11) of the
ceiling effect appears to be present in the individual-level results experienced CI users showed individual significant MMN for the
(compare Fig. 3 to Appendix Table D1). In future studies, a behav- small pitch deviant of 1 semitone decrease (-6% in Hz), whereas
ioral measure of perceptual magnitude, e.g., a Likert or visual ana- significant individual MMN was detected in all (14/14) NH for this
logue scale, might be more comparable to the MMN amplitudes small pitch deviant. This is in line with previous research showing
than hit rates. As such, the individual MMN amplitude might be that pitch perception with CI is limited and varied across individu-
applied as a more linear objective estimate of perceived magnitude als compared to NH (Jiam et al., 2019, Oxenham, 2008), and this
of sound differences compared to behavioral hit rates. finding further supports the validity of the individual MMN as a
marker of music discrimination thresholds in CI listening.
4.1.4. Exploratory correlations with music appreciation and clinical
factors 4.2.3. Timbre
The rated enjoyment of music and quality of life of CI users have For the timbre feature, all individual experienced CI users and
been found to be related to the rated sound quality achieved with NH showed comparable ability to detect the differences in tone
the CI (Dritsakis et al., 2017, Fuller et al., 2022, Lassaletta et al., color, or sound quality. These findings are more promising than a
2007). Our exploratory findings at the neural level suggested that recent behavioral study showing overall lower music instrument
CI users with higher ratings of enjoyment of listening to music timbre discrimination in experienced CI users than NH (Jiam
might be predicted by faster individual MMN latencies for the 1- et al., 2019), which might, though, be partly explained by the rela-
semitone pitch deviant. This is in line with previous findings that tive simplicity in detecting whether the sound differed in timbre
moods or emotions in music are often conveyed by 1-semitone dif- (compared to the more complex task of identifying the correct
88
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

image of a playing instrument among 16 possible music ity. We recommend that the automatic statistical diagnostics is fol-
instruments). lowed up by visual confirmation. Since the amplitude range of
spurious ‘‘false MMN” detections was relatively low, tests resulting
4.2.4. Rhythm in low individual MMN amplitudes might be followed up by
For the rhythm feature, most experienced CI users (93 %, 10/11) retesting.
showed significant individual MMN for even the smallest 26 ms
rhythm deviant, which was comparable to the NH individual 4.3.3. N1 or MMN?
MMN detections (100 %, 14/14). This is consistent with previous Subtracting the average standard response will include the dif-
findings suggesting that perception of relatively simple rhythmical ference in N1 between the deviant and standard responses. This
structure is comparable between CI and NH (Innes-Brown et al., ensures that the N1 will not directly be present in the difference
2013, Jiam and Limb, 2019). wave, assuming the N1 does not differ between the standard and
deviation tones. However, if there is a disinhibition of the N1 at
4.3. Limitations the deviant tones, this would result in an N1 disinhibition
response, which some considers also to be a subcomponent of
4.3.1. Clinical feasibility the MMN (Gu et al., 2018, May and Tiitinen, 2004). Regardless of
The musical stimuli of the CI MuMuFe paradigm might be con- these theoretical distinctions, the present findings suggested that
sidered relatively complex for clinical settings. Though, first, the in practice these early latency negative fronto-central evoked
MMN paradigm applies a task-free, passive listening procedure responses could accurately predict behavioral music discrimina-
that is less challenging, even for paediatric patients (Torppa tion ability.
et al., 2018, Torppa et al., 2014, Torppa et al., 2012), compared to
auditory judgment tests and questionnaires (e.g., Kuki et al., 4.3.4. Opposite diagnostical and statistical terminology for CAEP tests
2013, Kumari et al., 2016). Also, faster few-minutes shortened ver- In this study, and all other studies on cortical auditory evoked
sions of the full paradigm could be adopted, e.g., by testing only potential tests of sound detection and discrimination ability, there
particularly challenging deviants for an individual CI user, such is an opposition between the diagnostical and statistical definitions
as pitch deviants of specific magnitudes. Second, a majority of ‘‘sensitivity” and ‘‘specificity”. To avoid contradiction with the
(90 %) of CI users report they are interested in improving their common clinical terminology, we think it makes most sense to
music perception skills (Gfeller et al., 2019), suggesting that music apply the diagnostical definition. Diagnostic ‘‘sensitivity” means
is a particularly engaging type of stimulus for testing auditory per- individual MMN absence or retaining the null-hypothesis, because
ception, and objective tests are required to trace the development ‘‘sensitivity” indicates the abnormality or disease detection, which
of the music perception skills. Third, cross-over relationships is the lack of discrimination indicated by the individual MMN
between music and language perception abilities have been absence or retainment of the null-hypothesis. Diagnostic ‘‘speci-
reported (for reviews, see Besson et al., 2018, Jancke, 2012, Kraus ficity” means that individual MMN was present, or the rejection
and Slater, 2015, Patel, 2003, Torppa and Huotilainen, 2019), sug- of the null-hypothesis, which means the test was passed without
gesting that the testing of music perception abilities can indicate indication of abnormality. Since diagnostic ‘‘sensitivity” is more
more general traits of auditory perception shared with language important than ‘‘specificity”, it is important to keep the correct
perception. Fourth, the application of more complex but naturalis- diagnostic definition to avoid confusion from the clinical perspec-
tic stimuli has the benefit of increasing the ecological validity in tive. This is, nevertheless, the opposite of the common statistical
the testing of the CI users’ auditory perception of complex sounds, definition, where ‘‘sensitivity” would mean the null-hypothesis
which can be more challenging than the perception of simpler was rejected or individual MMN detection, and ‘‘specificity” would
sounds (Jiam and Limb, 2020). A fifth point is that music stimuli mean the null-hypothesis was retained or individual MMN
are by nature often repetitive (Huron, 2013), and repetitiveness absence.
is a wanted prerequisite for the measurement of mismatch-
negativity (MMN) responses to auditory deviants (Näätänen
et al., 2017). 5. Conclusion
Moreover, there are ongoing improvements in EEG recording
with CI users, e.g., a recent feasibility study showed that cortical We investigated the feasibility of applying the individual MMN
auditory evoked responses (CAEPs) can be recorded directly with as a marker of musical sound discrimination thresholds in individ-
electrodes built into the receiver and the cochlear array on the con- ual cochlear implant (CI) users. We introduced an optimized spike
tralateral CI device to the ear of stimulation (resulting in CAEP sig- density component analysis (SCA) statistics method to improve the
nals of comparable quality to conventional scalp recordings with accuracy of the individual MMN detections. Our findings showed
Fz and mastoid electrodes), thus making it unnecessary to prepare that the automatically detected individual MMN correctly pre-
electrodes located on the scalp prior to the measurements (Attias dicted the sound discrimination ability for CI users and normally
et al., 2022). hearing (NH) in approximately 9/10 cases. Moreover, the individ-
Finally, developments are currently being made towards auto- ual MMN findings suggested that adult CI users can reach similar
matic suppression of CI artifacts in clinical EEG data (for a review, music discrimination abilities for intensity, timbre, and rhythm
see Intartaglia et al., 2022). Despite the complexity of the features compared to NH after sustained CI experience (average
individual-level statistics, the individual MMN can already be 7 years). In conclusion, the individual MMN can be applied as an
detected automatically as shown here and elsewhere (Bishop and accurate diagnostic marker for assessing music discrimination in
Hardiman, 2010, McGee et al., 1997). CI users, which is especially beneficial for individuals for whom
MMN measurements are feasible but behavioral testing is limited,
4.3.2. Auditory diagnostics and screening such as pediatric CI users.
The results did not approach 100 % (>99 %) sensitivity, which
suggests that the individual MMN is not recommendable for Author contributions
large-scale universal screening for general auditory deficits.
Though, the approximately 90 % accuracy of the individual MMN NTH wrote the first manuscript draft, preprocessed the EEG
is high and desirable for diagnostics on music discrimination abil- data, designed and programmed the SCA statistics method, and
89
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

conducted the individual- and group-level analyses. BP, EB, PV, and Bruzzone SEP, Haumann NT, Kliuchko M, Vuust P, Brattico E. Applying Spike-density
component analysis for high-accuracy auditory event-related potentials in
contributed to the conception and design of the study. BP and AA
children. Clin Neurophysiol 2021;132(8):1887–96. https://doi.org/10.1016/
conceived the paradigm and the behavioral test and created the j.clinph.2021.05.007.
stimuli. AA organized and carried out the recruitment and tests. Caldwell M, Rankin SK, Jiradejvong P, Carver C, Limb CJ. Cochlear implant users rely
KFF contributed with participant recruitments and manuscript on tempo rather than on pitch information during perception of musical
emotion. Cochlear Implants Int 2015;16(sup3):S114–20. https://doi.org/
revisions. PV contributed with funding and manuscript revisions. 10.1179/1467010015Z.000000000265.
All authors contributed to manuscript revisions and read and Carter L, Golding M, Dillon H, Seymour J. The detection of infant cortical auditory
approved the manuscript. evoked potentials (CAEPs) using statistical and visual detection techniques. J
Am Acad Audiol 2010;21(5):347–56. https://doi.org/10.3766/jaaa.21.5.6.
Coelho S, Braga AC. Performance evaluation of two software for analysis through
Funding ROC curves: Comp2ROC vs SPSS. In: Computational Science and Its Applications
– ICCSA 2015. Cham. doi: https://doi.org/10.1007/978-3-319-21407-8_11:
Springer International Publishing; 2015. p. 144-56. https://doi.org/10.1007/
NTHs contributions to the project were partly funded by the 978-3-319-21407-8_11.
Oticon Medical, Denmark, and partly by the Danish National Cone-Wesson B. Electrophysiologic assessment of hearing in infants: compound
nerve action potential, auditory brainstem response, and auditory steady state
Research Foundation’s Center for Music in the Brain (DNRF117). response. Volta Rev 2003;103(4):253–79.
Dalebout SD, Fox LG. Reliability of the mismatch negativity in the responses of
Declaration of Competing Interest individual listeners. J Am Acad Audiol 2001;12(5):245–53. https://doi.org/
10.1111/j.1469-8986.2007.00610.x.
Dritsakis G, van Besouw RM, A om.. Impact of music on the quality of life of cochlear
The authors declare that they have no known competing finan- implant users: a focus group study. Cochlear Implants Int 2017;18(4):207–15.
cial interests or personal relationships that could have appeared https://doi.org/10.1080/14670100.2017.1303892.
Escera C, Grau C. Short-term replicability of the mismatch negativity.
to influence the work reported in this paper. Electroencephalogr Clin Neurophysiol 1996;100(6):549–54. https://doi.org/
10.1016/s0168-5597(96)95633-6.
Faulkner KF, Pisoni DB. Some observations about cochlear implants: challenges and
Acknowledgments
future directions. Neuroscience Discovery 2013;1(1):9. https://doi.org/10.7243/
2052-6946-1-9.
The authors wish to thank all the participants for their unre- Fellman V, Huotilainen M. Cortical auditory event-related potentials in newborn
stricted commitment. We wish to thank Oticon Medical, Denmark, infants. Semin Fetal Neonatal Med 2006;11(6):452–8. https://doi.org/10.1016/j.
siny.2006.07.004.
and the Danish National Research Foundation who funded this Finke M, Büchner A, Ruigendijk E, Meyer M, Sandmann P. On the relationship
research. The authors thank MD Hanne Owen and CI coordinator between auditory cognition and speech intelligibility in cochlear implant users:
Minna Sandahl from the Clinic of Audiology at Aarhus University An ERP study. Neuropsychologia 2016;87:169–81. https://doi.org/10.1016/j.
neuropsychologia.2016.05.019.
Hospital and the Danish CI organization for assistance with recruit- Finke M, Sandmann P, Kopp B, Lenarz T, Buchner A. Auditory distraction transmitted
ment. Special thanks to Dora Grauballe, Center for Functionally by a cochlear implant alters allocation of attentional resources. Front Neurosci
Integrative Neuroscience, for invaluable and unconditioned help 2015;9:68. https://doi.org/10.3389/fnins.2015.00068.
Fuller C, Free R, Maat B, Baskent D. Self-reported music perception is related to
with bookings and management of laboratory facilities and to quality of life and self-reported hearing abilities in cochlear implant users.
research assistants Alberte Seeberg and Monica Ipsen for perfectly Cochlear Implants Int 2022;23:1–10. https://doi.org/10.1080/
managing participant communication and data collection. Also, we 14670100.2021.1948716.
Gfeller K, Driscoll V, Schwalje A. Adult cochlear implant recipients’ perspectives on
thank Franck Michel for the important spare processer CI program- experiences with music in everyday life: a multifaceted and dynamic
ming, direct sound delivery to the CI via cable, and information phenomenon. Front Neurosci 2019;13:1229. https://doi.org/10.3389/
about the CI participants. A final thanks to Dr., MD, Therese Ovesen fnins.2019.01229.
Gibson WP, Sanli H, Psarros C. The use of intra-operative electrical auditory
for her great role in the initial phase of the project.
brainstem responses to predict the speech perception outcome after cochlear
implantation. Cochlear Implants Int 2009;10(sup1):53–7. https://doi.org/
10.1179/cim.2009.10.Supplement-1.53.
Appendix A. Supplementary material
Gilley PM, Sharma A, Dorman M, Finley CC, Panch AS, Martin K. Minimization of
cochlear implant stimulus artifact in cortical auditory evoked potentials. Clin
Supplementary data to this article can be found online at Neurophysiol 2006;117(8):1772–82. https://doi.org/10.1016/
https://doi.org/10.1016/j.clinph.2023.01.015. j.clinph.2006.04.018.
Gilley PM, Sharma A, Dorman M, Martin K. Developmental changes in refractoriness
of the cortical auditory evoked potential. Clin Neurophysiol 2005;116
References (3):648–57. https://doi.org/10.1016/j.clinph.2004.09.009.
Gilley PM, Sharma A, Dorman MF. Cortical reorganization in children with cochlear
implants. Brain Res 2008;1239:56–65. https://doi.org/10.1016/j.
Alniacik A, Akdas F. The effects of adaptive directional microphone on auditory
brainres.2008.08.026.
evoked cortical P300 response and speech performance in cochlear implant
Golding M, Pearce W, Seymour J, Cooper A, Ching T, Dillon H. The relationship
users. Int J Audiol 2019;58(12):861–8. https://doi.org/10.1080/
between obligatory cortical auditory evoked potentials (CAEPs) and functional
14992027.2019.1637028.
measures in young infants. J Am Acad Audiol 2007;18(2):117–25. https://doi.
Althen H, Huotilainen M, Grimm S, Escera C. Middle latency response correlates of
org/10.3766/jaaa.18.2.4.
single and double deviant stimuli in a multi-feature paradigm. Clin
Golz M, Sommer D, Krajewski J. Prediction of immediately occurring microsleep
Neurophysiol 2016;127(1):388–96. https://doi.org/10.1016/
events from brain electric signals. Curr Dir Biomed Eng 2016;2(1):149–53.
j.clinph.2015.04.058.
https://doi.org/10.1515/cdbme-2016-0035.
Amin HU, Mumtaz W, Subhani AR, Saad MNM, Malik AS. Classification of EEG
Groenen PA, Beynon AJ, Snik AF, van den Broek P. Speech-evoked cortical potentials
signals based on pattern recognition approach. Front Comput Neurosc
and speech recognition in cochlear implant users. Scand Audiol 2001;30
2017;11:103. https://doi.org/10.3389/fncom.2017.00103.
(1):31–40. https://doi.org/10.1080/010503901750069554.
Attias J, HabibAllah S, Tarigoppula VSA, Glick H, Chen C, Kanthaiah K, et al. Cortical
Grondin S, Chapter 1.. Psychophysics. In: Psychology of Perception. Cham: Springer
auditory evoked potentials recorded directly through the cochlear implant in
International Publishing; 2016. p. 1–16. https://doi.org/10.1007/978-3-319-
cochlear implant recipients: a feasibility study. Ear Hear 2022;43(5):1426–36.
31791-5_1.
https://doi.org/10.1097/Aud.0000000000001212.
Gu F, Wong L, Chen F, Huang W-T, Wang L, Hu AX. Lateral inhibition is a neural
Besson M, Dittinger E, Barbaroux M. How music training influences language
mechanism underlying mismatch negativity. Neuroscience 2018;385:38–46.
processing: Evidence against informationnal encapsulation. Ann Psychol
https://doi.org/10.1016/j.neuroscience.2018.06.009.
2018;118(3):273–88. https://doi.org/10.3917/anpsy1.183.0273.
Hahne A, Mainka A, Leuner A, Murbe D. Adult cochlear implant users are able to
Bishop DVM, Hardiman MJ. Measurement of mismatch negativity in individuals: A
discriminate basic tonal features in musical patterns: evidence from event-
study using single-trial analysis. Psychophysiology 2010;47(4):697–705.
related potentials. Otol Neurotol 2016;37(9):e360–8. https://doi.org/10.1097/
https://doi.org/10.1111/j.1469-8986.2009.00970.x.
MAO.0000000000001067.
Bonetti L, Haumann NT, Vuust P, Kliuchko M, Brattico E. Risk of depression enhances
Han J-H, Zhang F, Kadis DS, Houston LM, Samy RN, Smith ML, et al. Auditory cortical
auditory Pitch discrimination in the brain as indexed by the mismatch
activity to different voice onset times in cochlear implant users. Clin
negativity. Clin Neurophysiol 2017;128(10):1923–36. https://doi.org/10.1016/
j.clinph.2017.07.004.

90
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

Neurophysiol 2016;127(2):1603–17. https://doi.org/10.1016/ McGee T, Kraus N, Nicol T. Is it really a mismatch negativity? An assessment of
j.clinph.2015.10.049. methods for determining response validity in individual subjects.
Haumann NT, Hansen B, Huotilainen M, Vuust P, Brattico E. Applying stochastic Electroencephalogr clin neurophysiol/Evoked Potentials Section 1997;104
spike train theory for high-accuracy human MEG/EEG. J Neurosci Meth 2020. (4):359–68. https://doi.org/10.1016/S0168-5597(97)00024-5.
https://doi.org/10.1016/j.jneumeth.2020.108743 108743. Mehta K, Mahon M, Watkin P, Marriage J, Vickers D. A qualitative review of parents’
Huron D. A psychological approach to musical form: the habituation-fluency theory perspectives on the value of CAEP recording in influencing their acceptance of
of repetition. Curr Musicol 2013;96:7–35. https://doi.org/10.7916/cm. hearing devices for their child. Int J Audiol 2019:1–7. https://doi.org/10.1080/
v0i96.5312. 14992027.2019.1592250.
Innes-Brown H, Marozeau JP, Storey CM, Blamey PJ. Tone, rhythm, and Migirov L, Kronenberg J, Henkin Y. Self-reported listening habits and enjoyment of
timbre perception in school-age children using cochlear implants and music among adult cochlear implant recipients. Ann Otol Rhinol Laryngol
hearing aids. J Am Acad Audiol 2013;24(09):789–806. https://doi.org/ 2009;118(5):350–5. https://doi.org/10.1177/F000348940911800506.
10.3766/jaaa.24.9.4. Munivrana B, Mildner V. Cortical auditory evoked potentials in unsuccessful
Intartaglia B, Zeitnouni AG, Lehmann A. Recording EEG in cochlear implant users: cochlear implant users. Clin Linguist Phon 2013;27(6–7):472–83. https://doi.
guidelines for experimental design and data analysis for optimizing signal org/10.3109/02699206.2013.771214.
quality and minimizing artifacts. J Neurosci Meth 2022:375. https://doi.org/ Näätänen R, Kujala T, Escera C, Baldeweg T, Kreegipuu K, Carlson S, et al. The
10.1016/j.jneumeth.2022.109592. mismatch negativity (MMN)–a unique window to disturbed central auditory
Iverson P, Smith CA, Evans BG. Vowel recognition via cochlear implants and noise processing in ageing and different clinical conditions. Clin Neurophysiol
vocoders: effects of formant movement and duration. J Acoust Soc Am 2006;120 2012;123(3):424–58. https://doi.org/10.1016/j.clinph.2011.09.020.
(6):3998–4006. https://doi.org/10.1121/1.2372453. Näätänen R, Petersen B, Torppa R, Lonka E, Vuust P. The MMN as a viable and
Jancke L. The relationship between music and language. Front Psychol 2012;3. objective marker of auditory development in CI users. Hearing Res
ARTN 123. https://doi.org/10.3389/fpsyg.2012.00123. 2017;353:57–75. https://doi.org/10.1016/j.heares.2017.07.007.
Jiam NT, Deroche ML, Jiradejvong P, Limb CJ. A randomized controlled crossover Nelson HD, Bougatsos C, Nygren P, Force USPST. Universal newborn hearing
study of the impact of online music training on pitch and timbre perception in screening: systematic review to update the 2001 US Preventive Services Task
cochlear implant users. J Assoc Res Otolaryngol 2019;20(3):247–62. https://doi. Force Recommendation. Pediatrics 2008;122(1):e266–76. https://doi.org/
org/10.1007/s10162-018-00704-0. 10.1542/peds.2007-1422.
Jiam NT, Limb C. Music perception and training for pediatric cochlear implant users. Norrix LW. Hearing thresholds, minimum response levels, and cross-check
Expert Rev Med Devic 2020;17(11):1193–205. https://doi.org/10.1080/ measures in pediatric audiology. Am J Audiol 2015;24(2):137–44. https://doi.
17434440.2020.1841628. org/10.1044/2015_AJA-14-0095.
Jiam NT, Limb CJ. Rhythm processing in cochlear implant-mediated music Oostenveld R, Fries P, Maris E, Schoffelen JM. FieldTrip: open source software for
perception. Ann N Y Acad Sci 2019;1453(1):22–8. https://doi.org/10.1111/ advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput
nyas.14130. Intel Neurosc 2011. https://doi.org/10.1155/2011/156869.
Kallioinen P, Olofsson J, Nakeva von Mentzer C, Lindgren M, Ors M, Sahlen BS, et al. Oxenham AJ. Pitch perception and auditory stream segregation: implications for
Semantic processing in deaf and hard-of-hearing children: large N400 hearing loss and cochlear implants. Trends Amplif 2008;12(4):316–31. https://
mismatch effects in brain responses, despite poor semantic ability. Front doi.org/10.1177/1084713808325881.
Psychol 2016;7:1146. https://doi.org/10.3389/fpsyg.2016.01146. Pakarinen S, Huotilainen M, Naatanen R. The mismatch negativity (MMN) with no
Kalyakin I, González N, Ivannikov A, Lyytinen H. Extraction of the mismatch standard stimulus. Clin Neurophysiol 2010;121(7):1043–50. https://doi.org/
negativity elicited by sound duration decrements: a comparison of three 10.1016/j.clinph.2010.02.009.
procedures. Data Knowl Eng 2009;68(12):1411–26. https://doi.org/10.1016/ Patel AD. Language, music, syntax and the brain. Nat Neurosci 2003;6(7):674–81.
j.datak.2009.07.004. https://doi.org/10.1038/nn1082.
Kliuchko M, Brattico E, Gold BP, Tervaniemi M, Bogert B, Toiviainen P, et al. Paukkunen AK, Leminen M, Sepponen R. The effect of measurement error on the
Fractionating auditory priors: A neural dissociation between active and passive test–retest reliability of repeated mismatch negativity measurements. Clin
experience of musical sounds. PLoS One 2019;14(5):e0216499. Neurophysiol 2011;122(11):2195–202. https://doi.org/10.1016/
Kliuchko M, Heinonen-Guzejev M, Vuust P, Tervaniemi M, Brattico E. A window into j.clinph.2011.04.004.
the brain mechanisms associated with noise sensitivity. Sci Rep-Uk 2016:6. Pekkonen E, Rinne T, Näätänen R. Variability and replicability of the mismatch
https://doi.org/10.1038/srep39236. negativity. Electroencephalogr Clin Neurophysiol 1995;96(6):546–54. https://
Koelsch S, Wittfoth M, Wolf A, Müller J, Hahne A. Music perception in cochlear doi.org/10.1016/0013-4694(95)00148-r.
implant users: an event-related potential study. Clin Neurophysiol 2004;115 Perez-Valero E, Lopez-Gordo MA, Vaquero-Blasco MA. EEG-based multi-level stress
(4):966–72. https://doi.org/10.1016/j.clinph.2003.11.032. classification with and without smoothing filter. Biomed Signal Process Control
Kohlberg G, Spitzer JB, Mancuso D, Lalwani AK. Does cochlear implantation restore 2021;69. https://doi.org/10.1016/j.bspc.2021.102881 102881.
music appreciation? Laryngoscope 2014;124(3):587–8. https://doi.org/ Perreau AE, Wu YH, Tatge B, Irwin D, Corts D. Listening effort measured in adults
10.1002/lary.24171. with normal hearing and cochlear implants. J Am Acad Audiol 2017;28
Kraus N, Micco AG, Koch DB, McGee T, Carrell T, Sharma A, et al. The mismatch (8):685–97. https://doi.org/10.3766/jaaa.16014.
negativity cortical evoked potential elicited by speech in cochlear-implant Petersen B, Andersen ASF, Haumann NT, Højlund A, Dietz M, Michel F, et al. The CI
users. Hearing Res 1993;65(1–2):118–24. https://doi.org/10.1016/0378-5955 MuMuFe - a new MMN paradigm for measuring music discrimination in electric
(93)90206-G. hearing. Front Neurosci 2020. https://doi.org/10.3389/fnins.2020.00002.
Kraus N, Slater J. Music and language: relations and disconnections. Handb Clin Petersen B, Weed E, Sandmann P, Brattico E, Hansen M, Sorensen SD, et al. Brain
Neurol 2015;129:207–22. https://doi.org/10.1016/B978-0-444-62630-1.00012- responses to musical feature changes in adolescent cochlear implant users.
3. Front Hum Neurosci 2015;9:7. https://doi.org/10.3389/fnhum.2015.00007.
Kuki S, Chadha S, Dhingra S, Gulati A. The role of current audiological tests in the Ponton C, Eggermont J, Don M, Waring M, Kwong B, Cunningham J, et al. Maturation
early diagnosis of hearing impairment in infant. Indian J Otolaryngol Head Neck of the mismatch negativity: effects of profound deafness and cochlear implant
Surg 2013;65(3):244–50. https://doi.org/10.1007/s12070-012-0558-x. use. Audiol Neurotol 2000;5(3–4):167–85. https://doi.org/10.1159/000013878.
Kumari R, Chakraborty P, Jain R, Kumar D. Auditory assessment of children with Ponton CW, Don M, Eggermont JJ, Kwong B. Integrated mismatch negativity
severe hearing loss using behavioural observation audiometry and brainstem (MMNi): a noise-free representation of evoked responses allowing single-point
evoked response audiometry. Int J Res Med Sci 2016;4(7):1. https://doi.org/ distribution-free statistical tests. Electroencephalogr Clin Neurophysiol
10.18203/2320-6012.ijrms20161967. 1997;104(2):143–50. https://doi.org/10.1016/s0168-5597(97)96104-9.
Lassaletta L, Castro A, Bastarrica M, Pérez-Mora R, Madero R, De Sarriá J, et al. Does Rahne T, Plontke SK, Wagner L. Mismatch negativity (MMN) objectively reflects
music perception have an impact on quality of life following cochlear timbre discrimination thresholds in normal-hearing listeners and cochlear
implantation? Acta Oto-Laryngol 2007;127(7):682–6. https://doi.org/10.1080/ implant users. Brain Res 2014;1586:143–51. https://doi.org/10.1016/j.
00016480601002112. brainres.2014.08.045.
Li R, Principe JC, Bradley M, Ferrari V. A spatiotemporal filtering methodology for Rahne T, von Specht H, Mühler R. Sorted averaging—application to auditory event-
single-trial ERP component estimation. Ieee T Bio-Med Eng 2008;56(1):83–92. related responses. J Neurosci Meth 2008;172(1):74–8. https://doi.org/10.1016/j.
https://doi.org/10.1109/TBME.2008.2002153. jneumeth.2008.04.006.
Loizou PC, Dorman MF, Powell V. The recognition of vowels produced by men, Sandmann P, Kegel A, Eichele T, Dillier N, Lai W, Bendixen A, et al.
women, boys, and girls by cochlear implant patients using a six-channel CIS Neurophysiological evidence of impaired musical sound perception in
processor. J Acoust Soc Am 1998;103(2):1141–9. https://doi.org/10.1121/ cochlear-implant users. Clin Neurophysiol 2010;121(12):2070–82. https://doi.
1.421248. org/10.1016/j.clinph.2010.04.032.
Lonka E, Kujala T, Lehtokoski A, Johansson R, Rimmanen S, Alho K, et al. Mismatch Sandmann P, Plotz K, Hauthal N, de Vos M, Schonfeld R, Debener S. Rapid bilateral
negativity brain response as an index of speech perception recovery in cochlear- improvement in auditory cortex activity in postlingually deafened adults
implant recipients. Audiol Neurotol 2004;9(3):160–2. https://doi.org/10.1159/ following cochlear implantation. Clin Neurophysiol 2015;126(3):594–607.
000077265. https://doi.org/10.1016/j.clinph.2014.06.029.
Lonka E, Relander-Syrjanen K, Johansson R, Näätänen R, Alho K, Kujala T. The Scharf F, Widmann A, Bonmassar C, Wetzel N. A tutorial on the use of temporal
mismatch negativity (MMN) brain response to sound frequency changes in principal component analysis in developmental ERP research–opportunities
adult cochlear implant recipients: a follow-up study. Acta Otolaryngol and challenges. Dev Cogn Neurosci 2022;101072. https://doi.org/10.1016/j.
2013;133(8):853–7. https://doi.org/10.3109/00016489.2013.780293. dcn.2022.101072.
May P, Tiitinen H. The MMN is a derivative of the auditory N100 response. Neurol Schmidt RJ, Sataloff RT, Newman J, Spiegel JR, Myers DL. The sensitivity of auditory
Clin Neurophysiol 2004;20:1–5. brainstem response testing for the diagnosis of acoustic neuromas. Arch

91
N.T. Haumann, Bjørn Petersen, A.S. Friis Andersen et al. Clinical Neurophysiology 148 (2023) 76–92

Otolaryngol Head Neck Surg 2001;127(1):19–22. https://doi.org/10.1001/ cochlear implants. Front Psychol 2014;5:1389. https://doi.org/10.3389/
archotol.127.1.19. fpsyg.2014.01389.
Sharma A, Dorman MF, Spahr AJ. Rapid development of cortical auditory evoked Torppa R, Salo E, Makkonen T, Loimo H, Pykalainen J, Lipsanen J, et al. Cortical
potentials after early cochlear implantation. Neuroreport 2002;13(10):1365–8. processing of musical sounds in children with Cochlear Implants. Clin
https://doi.org/10.1097/00001756-200207190-00030. Neurophysiol 2012;123(10):1966–79. https://doi.org/10.1016/
Shestakova A, Brattico E, Soloviev A, Klucharev V, Huotilainen M. Orderly cortical j.clinph.2012.03.008.
representation of vowel categories presented by multiple exemplars. Brain Res Uwer R, von Suchodoletz W. Stability of mismatch negativities in children. Clin
Cogn Brain Res 2004;21(3):342–50. https://doi.org/10.1016/j. Neurophysiol 2000;111(1):45–52. https://doi.org/10.1016/s1388-2457(99)
cogbrainres.2004.06.011. 00204-7.
Silva LAF, Couto MIV, Magliaro FC, Tsuji RK, Bento RF, de Carvalho ACM, et al. Van Yper LN, Dhooge IJ, Vermeire K, De Vel EF, Beynon AJ. The P300 auditory event-
Cortical maturation in children with cochlear implants: Correlation between related potential as a method to assess the benefit of contralateral hearing aid
electrophysiological and behavioral measurement. PLoS One 2017;12(2): use in bimodal listeners: a proof-of-concept. Int J Audiol 2020;59(1):73–80.
e0171177. https://doi.org/10.1080/14992027.2019.1656346.
Singh S, Liasis A, Rajput K, Towell A, Luxon L. Event-related potentials in pediatric Vuust P, Brattico E, Glerean E, Seppänen M, Pakarinen S, Tervaniemi M, et al. New
cochlear implant patients. Ear Hear 2004;25(6):598–610. https://doi.org/ fast mismatch negativity paradigm for determining the neural prerequisites for
10.1097/00003446-200412000-00008. musical ability. Cortex 2011;47(9):1091–8. https://doi.org/10.1016/
Skoe E, Kraus N. Auditory brainstem response to complex sounds: a tutorial. Ear j.cortex.2011.04.026.
Hear 2010;31(3):302–24. https://doi.org/10.1097/FAUD.0b013e3181cdb272. Wable J, van den Abbeele T, Gallego S, Frachet B. Mismatch negativity: a tool for the
Taylor JA, Matthews N, Michie PT, Rosa MJ, Garrido MI. Auditory prediction errors as assessment of stimuli discrimination in cochlear implant subjects. Clin
individual biomarkers of schizophrenia. NeuroImage Clin 2017;15:264–73. Neurophysiol 2000;111(4):743–51. https://doi.org/10.1016/s1388-2457(99)
https://doi.org/10.1016/j.nicl.2017.04.027. 00298-9.
Timm L, Vuust P, Brattico E, Agrawal D, Debener S, Büchner A, et al. Residual neural Wang Y, Pan T, Deshpande SB, Ma F. The relationship between EABR and auditory
processing of musical sound features in adult cochlear implant users. Front performance and speech intelligibility outcomes in pediatric cochlear implant
Hum Neurosci 2014;8:181. https://doi.org/10.3389/fnhum.2014.00181. recipients. Am J Audiol 2015;24(2):226–34. https://doi.org/10.1044/2015_AJA-
Torppa R, Faulkner A, Kujala T, Huotilainen M, Lipsanen J. Developmental links 14-0023.
between speech perception in noise, singing, and cortical processing of music in Zhang F, Benson C, Fu QJ. Cortical encoding of pitch contour changes in cochlear
children with cochlear implants. Music Percept 2018;36(2):156–74. https://doi. implant users: a mismatch negativity study. Audiol Neuro Otol 2013;18
org/10.1525/mp.2018.36.2.156. (5):275–88. https://doi.org/10.1159/000351802.
Torppa R, Huotilainen M. Why and how music can be used to rehabilitate and Zhang FW, Hammer T, Banks HL, Benson C, Xiang J, Fu QJ. Mismatch negativity and
develop speech and language skills in hearing-impaired children. Hearing Res adaptation measures of the late auditory evoked potential in cochlear implant
2019;380:108–22. https://doi.org/10.1016/j.heares.2019.06.003. users. Hearing Res 2011;275(1–2):17–29. https://doi.org/10.1016/
Torppa R, Huotilainen M, Leminen M, Lipsanen J, Tervaniemi M. Interplay between j.heares.2010.11.007.
singing and cortical processing of music: a longitudinal study in children with

92

You might also like