Professional Documents
Culture Documents
237
Parncutt, R., & Sattmann, S. (Eds.) (2018). Proceedings of ICMPC15/ESCOM10. Graz, Austria: Centre for Systematic Musicology,
University of Graz.
238
Parncutt, R., & Sattmann, S. (Eds.) (2018). Proceedings of ICMPC15/ESCOM10. Graz, Austria: Centre for Systematic Musicology,
University of Graz.
Average Correct
0.9
responses as 3 (“very sure”) were excluded from the study. We Confidence 3
also excluded one participant from Experiment 1 who 0.8
performed around chance level (.54) but rated all his 158 0.7
responses as 3. We took this as an indication that those 0.6
participants were not using the 3-point confidence rating scale 0.5
as they should have. Silence Nonsense Nondiatonic Diatonic
syllables Sequences Sequences
Experiment 1: 2AFC Test
Participants performed above chance level in silence Figure 4. Average correct recognition by confidence across
(M=.67, SD=.08, t(15)=8.44, p<.001), nonsense syllables groups.
(M=.63, SD=.12, t(19)=5.00, p<.001), nondiatonic (M=.61, We also tested the effect of number of melodic direction
SD=.09, t(17)=5.29, p<.001) and diatonic (M=.58, SD=.09, changes on performance. A 4 (number of direction changes) x
t(17)=3.70, p<.01) conditions. 4 (groups) mixed ANOVA showed that number of melodic
direction changes had a main effect on performance,
1 F(3,204)=2.94, p<.05, ηp2=.04. In particular, participants
Average Correct
0.9
Figure 3. Average correct recognition across groups. Error bars Nondiatonic Sequences
0.8 Diatonic Sequences
(as in all remaining graphs) indicate standard errors.
0.7
A one-way ANOVA revealed a significant effect for type
of retention interval, F(3,68)=3.02, p<.05, ηp2=.12. A Tukey’s 0.6
HSD post-hoc test showed that recognition performance was 0.5
significantly higher for the silence condition than diatonic 1 0 2 3
sequences condition, p<.05 (Fig. 3). Number of Direction Changes
Although many participants stated written or verbally that Figure 5. Average correct recognition by number of melodic
the experiment lasted quite long, no fatigue or practice effects direction changes across groups.
were observed. We calculated performances for the first and
A 4 (serial position of the changed tone) x 4 (groups) mixed
second half of the trials. A 2 (order) x 4 (group) mixed ANOVA
ANOVA revealed a main effect for serial position (F(3,
showed that order had neither a main nor an interactive effect
204)=19.29, p<.001, ηp2=.22) but no interaction effect (p>.10).
on performance, p>.101.
Taylor and Pembrook (1983) found that note repetition did Planned comparisons at an overall a-level of .05 confirmed the
not change recall performance. Our findings confirmed their expected J-shaped curve (recency > primacy > center): changes
results. A 2 (repetition) x 4 (group) mixed ANOVA revealed in the last tone were detected better than changes in the second
neither a main nor an interactive effect for note repetition, all tone; changes in the second tone were detected better than
ps>.10. changes in the middle (third and fourth) tones (Fig. 6).
The lure items contained a tone that was one diatonic tone
1
higher than the target in half of the trials or lower in the other Silence
Average Correct
half of the trials. A 2 (repetition) x 4 (group) mixed ANOVA 0.9 Nonsense Syllables
revealed a marginal main effect for type of lure, indicating 0.8 Nondiatonic Sequences
slightly better performance with lures that had a one diatonic Diatonic Sequences
0.7
tone up deviation (p=.06).
Participants had a metacognitive understanding of the task. 0.6
We calculated average performances for low, moderate and 0.5
high confidence trials (Fig. 4). A 3 (confidence) x 4 (group) 2 3 4 5
mixed ANOVA showed that performances differed between Position of changed note
different levels of confidences, F(1.37,93.21)=14.60, p<.001, Figure 6. Average correct recognition based on position of
ηp2=.18. Post-hoc analyses revealed that participants’ changed note within 5-tone sequence across groups.
1
We also found no main effect for order when splitting trials into three blocks.
239
Parncutt, R., & Sattmann, S. (Eds.) (2018). Proceedings of ICMPC15/ESCOM10. Graz, Austria: Centre for Systematic Musicology,
University of Graz.
In 60 trials, lure melodies differed from target melodies at those without, p=.07. Participants performed equally well in
a note of melodic direction change (see Fig. 1 as opposed to Fig. trials where the lure item contained a higher or lower tone,
2). Note that it is conceptually wrong to talk about the melody’s p>.10. None of these 2 x 4 mixed ANOVAs revealed an
direction at the 1st and the 5th tones. Dyson and Watkins (1984) interaction effect with type of retention interval.
coined these notes as “corners” and the remainders as “slopes”. A 4 (number of melodic direction changes) x 4 (groups)
A 2 (change at “corner” or “slope”) x 4 (groups) ANOVA ANOVA showed that number of direction changes had a
showed that participants were better at detecting note changes significant effect, F(2.55,137.41)=2.89, p<.05, ηp2=.05.
at “corners” than “slopes” (F(1,68)=12.50, p<.01, ηp2=.16). No Participants were better in discriminating melodies that had
interaction was observed, p>.10 (Fig. 7). either no or two direction changes compared to melodies with
three direction changes, p<.05. No interaction was found,
1 p>.10 (Fig. 9). We also did not find any performance difference
Changed tone is at "corner" between ascending and descending sequences, p>.10.
0.9
Average Correct
0.3
Nonsense Syllables (N=16) Nonsense Syllables
0.2 0.8 Nondiatonic Sequences
Nondiatonic Sequences (N=14)
0.1 Diatonic Sequences
Diatonic Sequences (N=14)
0 0.6
0 0.2 0.4 0.6 0.8 1
False Alarm Rate 0.4
240
Parncutt, R., & Sattmann, S. (Eds.) (2018). Proceedings of ICMPC15/ESCOM10. Graz, Austria: Centre for Systematic Musicology,
University of Graz.
We conducted a 2 (change at “corner” note or “slope”) x 4 stimuli would affect short-term recognition performances as
(groups) ANOVA to see whether the contour-wise position of predicted by Baddeley’s (2000) working memory model as
the changed note had an effect on correct rejection performance. opposed to Berz’ (1995) model. We will start with a summary
Participants performed better when the change occurred at a of our main findings regarding our first goal then move on to
“corner” note, F(1,54)=6.34, p<.05, ηp2=.11. No interaction the next two points.
was found, p>.10 (Fig. 11). Listeners showed above chance short-term recognition after
listening to isochronous, diatonic, 5-tone melodies which were
1 Changed tone is at "corner" tested against same-contour lures with minute one-diatonic-
Correct Rejection Rate
241
Parncutt, R., & Sattmann, S. (Eds.) (2018). Proceedings of ICMPC15/ESCOM10. Graz, Austria: Centre for Systematic Musicology,
University of Graz.
characteristics-curve of MAUC=.92). In all other studies, more on the quality of their initial encoding. In that sense, it is
Dowling and colleagues used transposed targets only, to worth looking at which features in such an otherwise very
exclude any “help” from pitch memory. When using transposed homogenous set of targets and lures still help listeners in their
targets only, musically trained and untrained participants discrimination performance. We plan to do an analysis on the
dropped to chance performance in a same-different task best and worst discriminated melodies to see whether we can
(Dowling, 1978). Above chance performance in discriminating detect certain shared saliency increasing or decreasing features.
transposed targets against transposed same-contour lures was If we cannot find such shared characteristics we might think
obtained in later studies with 7-tone sequences when changing that at least the ones with top discriminability might be tone
two instead of a single note in a continuous-running-memory sequences reminiscent of sections of well-known tunes which
task (e. g., Dowling, 1991; Dowling, Kwak, & Andrews, 1995; can be found out by asking our or a new group of participants
also cf. Dewitt & Crowder, 1986). However, because there are to rate those top and worst tunes based on criteria such as
many parametric differences between their studies and ours (e. “sounds well-known”, “reminds me of tune X”.
g., their tone sequences had only small pitch intervals, all their Another interesting and quite “single” study in the short-
ending notes were twice as long, their pauses between two term recognition literature for melodies is Mikumo’s (1992)
consecutive melodies were 7-sec long, and their shortest where she looked at the effects of different types of intervening
unfilled delays between study and test were 7 s, and 12 s and stimuli in a same-different recognition task. Among others, she
more if filled with intervening melodies), caution is needed found that with tonal (rather than atonal) 6-tone sequences,
when comparing our results. The most major difference is that musically less trained participants performed significantly
in all of the Dowling studies, contour change versus pitch- better when there was a silent 12-sec delay between the
interval-change-only are pitted against each other. When standard and comparison stimulus than when the delay was
exposed to both types of lures, listeners showed an interesting filled with another melody or with shadowing tasks. In her
trend of ever improving recognition sensitivity with same- setup, where targets were untransposed and melodies were
contour lures the longer the delay (filled with other melodies) played at a slow rate (1 s per note), same-contour melodies
between exposure and test. In contrast, our main interest was to triggered high false alarms when collapsed over interference
look specifically at the “resolution” of one’s exact short-term conditions. Despite its discrepancies from ours, this study could
memory representation of isochronous tone sequences as used have been an interesting first study to look at the differential
by Taylor and Pembrook (1983). This is why we intentionally effects of melodic versus nonsense syllabic interference in
allowed for the use of pitch memory as it would occur in a short-term recognition memory for isochronous melodies.
natural setting. We made it impossible for participants to use However, since intervening nonsense syllables were shadowed
any contour-based proxies to differentiate targets from lures, whereas intervening tone sequences were not, we are unable to
and instead, forced them to attend to exact pitch interval make clear inferences with respect to the vulnerability of a
information, which they were indeed able to do beyond chance, melody representation to verbal versus musical interference.
despite being musically untrained. Byron and Stevens (2006) Any detrimental effect in the nonsense syllable condition could
found similar sensitivity to same-contour pitch interval changes have been due to the motor process of shadowing rather than
with non-isochronous 8-note sequences (derived from nonsense syllables per se. We believe that our study provides a
unknown folk tunes) and a silent 2-sec delay between exposure unique opportunity to look at the differential effects of
and test in a same/different task with musically untrained intervening verbal (nonsense syllables) versus musical
participants. Their participants could detect differences in pitch (diatonic or nondiatonic) stimuli on short-term memory
interval magnitude with same contours even in transposition performance in melody recognition. This, in turn, may allow us
hinting at some pitch interval magnitude retention independent to compare the predictions of Baddeley’s (2000) working
of contour information 3 . Cuddy and Cohen (1976) found memory model which proposes that the phonological loop is
evidence for similar pitch interval extraction even for 3-tone responsible for the processing of both verbal and musical
sequences in a 2AFC task with a 2-sec unfilled retention material and Berz’ (1995) proposal of a separate “slave system”
interval. for musical material only. Interestingly, when using a 2AFC
The question of what makes a melody more discriminable is test, our findings seem more in line with Baddeley’s model
beautifully addressed in Harrison, Musil, and Müllensiefen (though we see a trend for a stepwise worsening when going
(2016) who modeled responses from same/different tests from nonsense syllables to non-diatonic to diatonic intervening
looking at a large range of melodic (and rhythmic) features. In sequences). But when using a same/different test, our findings
their model, melody complexity is defined on the basis of seem more in line with Berz’ model. In a same/different test
number of notes (the more notes, the higher the working setup, we were also able to observe a general depression of the
memory load) as well as contour and pitch interval related J-shaped serial position curve and a curbing of its recency
aspects (also cf. Cuddy, Cohen, & Mewhort, 1981). Since our section for the intervening melodic sequence groups only.
study controlled for a variety of melodic aspects we believe that Last but not least, we found some differences in overall
an assessment of our corpus would render a rather stable performance as well as in the effects of our variables on
complexity level caused by the fact that all melodies had to be performance depending on whether participants were tested
discriminated against contour-wise same and pitch interval- with a 2AFC or a same/different test. The same/different test
wise very similar lures. Given that listeners received little help led to a bias to say “same” which was likely driven by the high
from lure dissimilarity, their recognition responses had to rely similarity between target and lures. Given that we used exactly
3
But unlike our minute one-diatonic pitch interval changes at test, theirs
pitted “step” changes against “leap” (>3 semitones) changes.
242
Parncutt, R., & Sattmann, S. (Eds.) (2018). Proceedings of ICMPC15/ESCOM10. Graz, Austria: Centre for Systematic Musicology,
University of Graz.
the same stimulus corpus, this shows that the particular way of Dowling, W. J. (1991). Tonal strength and melody recognition after
testing directly affected the decision making process which, in long and short delays. Perception & Psychophysics, 50(4), 305-
turn, affected the results (cf. Jang, Wixted, Huber, 2009). 313.
Benassi-Werke et al. (2010) showed that when using a forward Dowling, W. J., & Bartlett, J. C. (1981). The importance of interval
information in long-term memory for melodies.
melodic span test, which is a relatively bias-free test due to Psychomusicology: A Journal of Research in Music Cognition,
being recall instead of recognition, musically untrained 1(1), 30.
listeners had an average span of 5.9 notes for diatonic Dowling, W. J., & Fujitani, D. S. (1971). Contour, interval, and pitch
sequences with max. four semitone leaps, and 4.9 notes for recognition in memory for melodies. The Journal of the
those with unrestricted pitch intervals. This confirms that even Acoustical Society of America, 49(2B), 524-531.
in the more challenging same/different setup our listeners were Dowling, W. J., Kwak, S., & Andrews, M. W. (1995). The time course
dealing with a task that was fully within their short-term of recognition of novel melodies. Perception & Psychophysics,
memory capacity for tunes. In other words, it is unlikely to 57(2), 136-149.
Dyson, M. C., & Watkins, A. J. (1984). A figural approach to the role
think that their inferior performance in the same/different setup
of melodic contour in melody recognition. Perception &
was due to capacity limits. psychophysics, 35(5), 477-488.
In conclusion, we believe that further work has to be done Harrison, P. M., Musil, J. J., & Müllensiefen, D. (2016). Modelling
on the instantaneous resolution of short-term memory melodic discrimination tests: descriptive and explanatory
representations for melodies. Given the extensive amount of approaches. Journal of New Music Research, 45(3), 265-280.
research on visual-spatial short-term and working memory Jang, Y., Wixted, J. T., & Huber, D. E. (2009). Testing signal-
representations (e. g., Luck & Vogel, 2013; Sligte, detection models of yes/no and two-alternative forced-choice
Vandenbrouke, Sholte, & Lamme, 2010), we think the musical recognition memory. Journal of Experimental Psychology:
domain has to follow suit. This will also provide us with a better General, 138(2), 291.
understanding of how musical material is processed in Luck, S. J., & Vogel, E. K. (2013). Visual working memory capacity:
from psychophysics and neurobiology to individual differences.
immediate memory and which models better predict observed Trends in cognitive sciences, 17(8), 391-400.
findings. Certainly, future research also has to look at short- Mikumo, M. (1992). Encoding strategies for tonal and atonal melodies.
term memory for melodies with rhythmic elements, such as the Music Perception: An Interdisciplinary Journal, 10(1), 73-81.
ones used by Byron & Stevens (2006; also cf. Byron, 2008). Ortmann, O. (1933). Some tonal determinants of melodic memory.
Journal of Educational Psychology, 24(6), 454.
Pembrook, R. G. (1987). The effect of vocalization on melodic
References memory conservation. Journal of Research in Music Education,
Baddeley, A. (2000). The episodic buffer: a new component of 35(3), 155-169.
working memory? Trends in cognitive sciences, 4(11), 417-423. Schulze, K., Dowling, W. J., & Tillmann, B. (2012). Working memory
Benassi-Werke, M. E., Queiroz, M., Germano, N. G., & Oliveira, M. for tonal and atonal sequences during a forward and a backward
G. M. (2012). Melodic memory and its dependence on familiarity recognition task. Music Perception: An Interdisciplinary Journal,
and difficulty. In S. Serafin (Ed.) Proceedings of the 7th Sound 29(3), 255-267.
and Music Computing Conference (pp. 1-8). Spain: Universitat Sligte, I. G., Vandenbroucke, A. R., Scholte, H. S., & Lamme, V.
Pompeu Fabra. (2010). Detailed sensory memory, sloppy working memory.
Berz, W. L. (1995). Working memory in music: A theoretical model. Frontiers in psychology, 1, 175.
Music Perception: An Interdisciplinary Journal, 12(3), 353-364. Taylor, J. A., & Pembrook, R. G. (1983). Strategies in memory for
Byron, T. (2008). The processing of pitch and temporal information in short melodies: An extension of Otto Ortmann's 1933 study.
relational memory for melodies. (Unpublished doctoral Psychomusicology: A Journal of Research in Music Cognition,
dissertation). University of Western Sidney, Penrith, New South 3(1), 16-35.
Wales, Australia. Trehub, S. E., Unyk, A. M., & Trainor, L. J. (1993). Maternal singing
Byron, T., & Stevens, C. (2006). Steps and leaps in human memory in cross-cultural perspective. Infant behavior and development,
for melodies: The effect of pitch interval magnitude in a melodic 16(3), 285-295.
contour discrimination task. In M. Baroni, A. R. Addessi, R.
Caterina, M. Costa (Eds.) Proceedings of the 9th International
Conference on Music Perception and Cognition (ICMPC9),
Bologna, Italy.
Cuddy, L. L., & Cohen, A. J. (1976). Recognition of transposed
melodic sequences. The Quarterly Journal of Experimental
Psychology, 28(2), 255-270.
Cuddy, L. L., Cohen, A. J., & Mewhort, D. J. K. (1981). Perception of
structure in short melodic sequences. Journal of Experimental
Psychology: Human Perception and Performance, 7(4), 869.
Deutsch, D. (1970). Tones and numbers: Specificity of interference in
immediate memory. Science, 168(3939), 1604-1605.
Dewitt, L. A., & Crowder, R. G. (1986). Recognition of novel
melodies after brief delays. Music Perception: An
Interdisciplinary Journal, 3(3), 259-274.
Dowling, W. J. (1973). The perception of interleaved melodies.
Cognitive psychology, 5(3), 322-337.
Dowling, W. J. (1978). Scale and contour: Two components of a
theory of memory for melodies. Psychological review, 85(4), 341.
243