You are on page 1of 13

l

Research Article
Music & Science
Volume 4: 1–13
Gaze Analysis of Pianists’ Sight-reading: © The Author(s) 2021
DOI: 10.1177/20592043211061106

Comparison Between Expert Pianists journals.sagepub.com/home/mns

and Students Training to Be Pianists

Kyoko Imai-Matsumura1 and Megumi Mutou2

Abstract
One of the most important skills for a pianist is sight-reading, which is the ability to read an unknown music score and play
it. In recent years, research has analysed eye movement during sight-reading. However, the definition of sight-reading has
varied. In addition, the participants enlisted as experts in most studies have been music college students. The present
study aimed to compare eye movements during sight-reading between experts, teachers at a music college and pianists,
and non-experts, music college students studying to become pianists, using an eye tracker. Using easy and difficult music
scores for two-handed playing, we investigated whether there were differences in the number of eye fixations, fixation
duration, and eye-hand span. The definition of sight-reading in this study is to read a novel music score once without
playing the piano, and then to play it while looking at the music score. The results showed that the higher the piano per-
formance rating, the longer the eye-hand span. Areas of interest (AOIs) were defined every two rows, including a treble
and bass staff in each music score. We conducted a two-factor repeated measures ANOVA (group × AOI) for each
dependent variable to analyse fixation count and fixation duration per eye fixation. There was a significant interaction
for the fixation count between groups and AOIs both without and with performance in the difficult score. In experts,
the number of eye fixations on the difficult part of difficult score increased compared with other part both without
and with performances. By contrast, there was a significant interaction for the duration per eye fixation between groups
and AOIs in easy score with performance. The duration per eye fixation in experts was shorter than that in non-experts
in the easy score with performance. These results suggest that experts get information through short gaze fixations.

Keywords
pianist, piano performance, sight-reading, eye-hand span, gaze fixation count, gaze fixation duration

Submission date: 4 January 2021; Acceptance date: 1 November 2021

Introduction performance skills (Krampe & Ericsson, 1996).


Therefore, it is thought that pianists’ excellent performance
The transcendental performance techniques, finger move- techniques are not an innate talent but the result of practice
ments, and expressive power of pianists have attracted the accumulated since early childhood. For example, pianists
hearts of many audiences worldwide. To play the piano,
need to set goals, learn techniques, repeat practices, memo-
pianists must move their right and left hands separately, rize music scores, and correct mistakes with enormous
while moving 10 fingers at high speed for a long and diffi- effort and concentration (Lehmann & Ericsson, 1997).
cult piece of music (Schlaug et al., 1995). While playing the
piano, pianists pre-read the score (Rayner & Pollatsek,
1
1997; Truitt et al., 1997), process the score information in Graduate School of Education, Bukkyo University, Kita-ku, Kyoko, Japan
2
the brain (Meinz & Hambrick, 2010), and in some cases, Kobe City YUSEI Special Needs School, Kobe, Japan
press the pedal with their foot (Shaffer, 1984).
Corresponding author:
Furthermore, the music score must be memorized for a Kyoko Imai-Matsumura, Department of Education, Bukkyo University, 96
concert (Schulze et al., 2010). Immeasurable practice is Murasakinokitahananobocho, Kita-ku, Kyoto 603-8301, Japan.
required for the process of acquiring these excellent piano Email: k-matsumura@bukkyo-u.ac.jp

Creative Commons Non Commercial CC BY-NC: This article is distributed under the terms of the Creative Commons
Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use,
reproduction and distribution of the work without further permission provided the original work is attributed as specified
on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).
2 Music & Science

Sight-reading Required for Pianists distinguished between sight-reading without piano perfor-
mance and sight-reading with piano performance.
One of the most important skills needed by pianists is the
ability to read music correctly. Sight-reading is considered
particularly important. Sloboda (1974) collected 10 subjects Gaze Analysis in Reading Music
of approximately equivalent age and musical experience, As mentioned earlier, sight-reading ability is necessary to
covering a wide range of sight-reading ability. Each become an expert pianist, and research is needed to identify
music score slide was displayed twice during the experi- the mechanism of this ability. Visual processing is one such
ment, once being switched off early in the piece, and area of research. When we read, look at a scene, or search
once later in the piece. Subjects started playing a piece as for an object, we continually make eye movements called
soon as the material was displayed, and their speed was saccades. Between the saccades, our eyes remain relatively
regulated by a metronome which started sounding a few still during fixations. New information is acquired only
seconds before the slide was displayed. When the slide during fixations (Rayner, 1998). When pianists are learning
was switched off subjects simply continued playing until a new score and utilising sight-reading, their eyes are
they could not remember any more notes, and it was focused not on every single note, but rather on the score,
observed that subjects tended to stare at the blank screen and are instantaneously reading the notes around it (Truitt
in the seconds following the cut-off as though they were et al., 1997). Therefore, it is possible to quantify
still “seeing” the music. As a simple measure of sight-reading ability from the movement of the line of
sight-reading ability, the number of mistakes made prior sight during the time the pianist is reading the score.
to the slide being switched off was recorded for each Visual gaze studies have several weaknesses in their
subject. The best sight-reader made only three mistakes in methods. For example, the gaze measuring device used in
the whole series; the worst made 73 mistakes. one study was a video camera attached to the head during
In sight-reading, pianists must ascertain many things such the performance, which restricted the performer’s actions
as tempo, time signature, tonality, and the composition of (Salvucci & Anderson, 2001). In addition, various defini-
songs in a short time just before playing, and then perform tions and measurements, such as those of sight-reading or
accurately without stopping. Furthermore, it is a skill that is eye-hand span, have resulted in different scores on the
invaluable for repetiteurs and accompanists, and an especially gaze measure, making it difficult to compare these studies.
useful skill-set for piano teachers, performers, and musicians Studies on eye movement in music reading have been
(Arthur et al., 2016). Sight-reading consists of extracting reviewed by Madell and Héébert (2008) and Puurtinen
visual information from a score to perform by simultaneous (2018a). In contrast to similar research on text reading,
motor responses as in playing or singing, relying on auditory research on the eye movements used to read music is rela-
feedback (Drai-Zerbib et al., 2012). Expert musicians can tively undeveloped (Madell & Héébert, 2008). This is
hear in their mind what they read from a score and visually because music reading usually requires either sung or instru-
represent the music that they are listening to. mental production, both of which involve head movements
Many music researchers have mentioned sight-reading, but that are hardly comparable to reading text aloud and can
there is no clear definition. Some describe sight-reading as introduce measurement problems (Madell & Héébert,
occurring only the first time an unfamiliar piece of music is 2008). In recent years, with the development of eye trackers,
played, whereas others consider that familiarisation with a it has become possible to analyse gaze without restraining the
piece before playing it also constitutes a sight-reading task head, and problems related to accuracy of measurement or
(Lehmann & McArthur, 2002). Puurtinen (2018a) defined methodology are getting solved. However, there are still
sight-reading as reading a music score during a music perfor- few studies focusing on statistical gaze analysis in music.
mance at first sight. In some studies, sight-reading tasks were Waters et al. (1997) devised the pattern-matching test to
performed with no preview of the music score (Ahken et al., measure sight-reading ability, and administered it to eight
2012; Hadley et al., 2018; Huovinen et al., 2018; Penttinen full-time music students, eight psychology students who
& Huovinen, 2011; Rosemann et al., 2016). However, in had passed an examination in a monophonic instrument,
others, sight-reading was defined as performing a music and eight non-musicians. At the same time, eye movements
score after reading it silently (Drai-Zerbib et al., 2012). To while reading music were measured and compared among
specify sight-reading, it is important to make a distinction the three groups. In this task, the participants were shown
between performance tasks and tasks where music notation two music scores composed of 10 notes (2 bars of 5 notes
is only read and not performed in any way (Puurtinen, 2018b). each) presented on the screen of a computer monitor. The
The studies above suggest that sight-reading can be original melodies were randomly assigned to the same
broadly divided into two categories: with and without perfor- pitch difference and duration difference conditions. The
mance. Although sight-reading is based on the requirement participants were required to compare the stimuli as
that the musician is playing or singing the music score for quickly and accurately as possible and press one of the
the first time, it is necessary to understand both sight-reading two response buttons to register their decision (same/differ-
without performance just before the actual performance and ent). The researchers found that the more experienced musi-
sight-reading with performance. Therefore, in this study, we cians were able to perform the comparisons with fewer and
Imai-Matsumura and Mutou 3

shorter glances between the patterns. Based on the results, that a skilled player displays a larger eye-hand span
they suggested that skilled sight-reading was associated (Furneaux & Land, 1999; Gilman & Underwood, 2003;
with the ability to rapidly perceive notes or groups of Truitt et al., 1997). These results suggest that expert pianists
notes in the score. have a longer eye-hand span than non-expert pianists, which
In recent years, Hadley et al. (2018) conducted experi- results in different eye movements during sight-reading.
ments to investigate how proficient pianists comprehend
pitch relationships in music score when they first encounter
it by tracking their eyes while they read and played single Research Questions and Study Purpose
line melodies. The melodies were either congruent or anom- This study aimed to clarify eye movements during
alous, with the anomaly involving one bar being shifted in sight-reading by teachers who are active pianists at the
pitch to alter the implied harmonic structure. Twenty-four highest level of a music college. In previous studies, most
active pianists who had nine or more years of formal of the proficient pianists examined have been music
musical tuition participated in these experiments. The mel- majors, and there have been few studies on more experienced
odies were all 8 bars long, played with the right hand on the and advanced pianists. Moreover, most sight-reading studies
piano, and the left eye movement was measured. The fourth have used simple music scores with fewer bars and only one
bar with the pitch change (target bar), the third bar before hand. We wanted to compare the differences in gaze and
the target (pre-target bar), and the fifth bar after the target eye-hand span in a situation similar to that in which pianists
(post-target bar) were used as areas of interest (AOIs) to and aspiring pianists actually perform sight-reading. The
analyse the gaze. It was observed that participants were music scores used were also actual, two-handed music
more likely to have rapid disruption in their eye movements scores with two different difficulty levels. It is conceivable
in the anomalous condition than in the congruent condition. that a score with more bars would show eye movements
Furthermore, as predicted in the exploratory analysis of that more closely resemble the actual reading situation.
pupil dilation, in the post-target bar, mean pupil size was In eye gaze research, the number and duration of gaze
significantly greater in the anomalous condition than in fixation is measured. The former is known to be related to
the congruent condition. interest and concerns (Yamamoto & Imai-Matsumura,
2013), whereas the latter is related to gathering information
from the gaze object (Hutton & Nolte, 2011; Uzzaman &
Eye-hand Span Joordens, 2011). Arthur et al. (2016) used these measures
Eye-hand span is a known characteristic of the eye move- to examine eye movement during sight-reading, but the
ments of a performer. This measure could be defined as the eye movement was for a short score of four bars played
number of notes between the note being played, and the with the right hand only. In addition, they used a type of
note being fixated on (Rayner, 1998; Rayner & Pollatsek, eye tracker that held the heads in place. Therefore, this
1997; Weaver, 1943). Sloboda (1974) showed that when per- study aimed to analyse the number of eye fixations, fixation
formers played the piano while reading the score, their eyes duration, and eye-hand span of pianists and aspiring pia-
tended to see the note of the score ahead of the sound corre- nists in both easy and difficult musical scores using a
sponding to the part of the score being played, indicating that monitor-type eye tracker that does not restrict the head
they were using a skill called prefetching. Eye-hand span was and can be used for normal performance. In previous
measured by the number of notes between the hand and eye studies, the definition of expert pianists varied. However,
position. In an early study on eye-hand span, pianists read a in this study, experts were defined as teachers at a music
score that they had not seen before, following which they college who were also pianists, and non-experts were
were tested to see how well they had memorized the score. defined as music college students studying to become pia-
Pianists with a high sight-reading ability were able to play nists. To the best of our knowledge, the study of eye move-
6–7 notes whereas those with a low sight-reading ability ments during sight-reading in expert and non-expert
could play only 3–4 notes (Goolsby, 1994; Sloboda, 1984). pianists, as defined in this study, has not been seen before.
Furthermore, in Furneaux and Land’s (1999) research, Based on the above, the following hypotheses were
eye-hand span, measured by the note index rather than the developed and examined for the eye movements of expert
time index, was shown to be related to the professional com- and non-expert pianists during sight-reading.
petence of sight-reading. (1) The duration of an eye fixation on a music score in
There are several factors that influence eye-hand span. For experts will be shorter than that in non-experts because
example, Sloboda (1984) demonstrated that eye-hand span is the processing speed of sight-reading is thought to be
not a constant and unchanged scale, rather it becomes larger faster for experts. (2) For the difficult part of the difficult
or smaller depending on the musical structure. Other studies music score, the number of eye fixations will increase com-
show that eye-hand span is influenced by expertise (Truitt pared with other part because the sight-readers care about
et al., 1997) and skill level (Furneaux & Land, 1999; these notes. This tendency will be stronger in experts than
Sloboda, 1974; Truitt et al., 1997). In addition, it is influ- in non-experts. (3) Eye-hand span will be longer in
enced by the tempo (Furneaux & Land, 1999) and complex- experts than in non-experts. (4) The piano performance in
ity of the score (Rayner & Pollatsek, 1997), which suggests experts during sight-reading will be rated higher than that
4 Music & Science

of the non-experts. (5) The higher the evaluation score of the in this study were not beginners, but those who have
piano performance, the longer the eye-hand span will be. trained in playing the piano for many years.

Musical Materials
Method
We prepared two double-line music scores for the participants:
Participants easy and difficult (Figure 1). Scores were selected from a Sight
At a music college in Japan, candidates for participation were Playing Workbook within the YAMAHA music ability test
informed in writing about the purpose of this research, details system. This system ranges between grade 13 (the easiest)
of their participation, and ethical considerations. We and grade 2 (the most difficult). The grade 1 scores have not
explained to the candidates that they had the right to refuse been created. This system is used in more than 30 countries.
to participate in the study, that participation was voluntary, We have received permission from YAMAHA for the use
and that non-participation would not have any negative con- and publication of this score in this study.
sequences. Forty-one people agreed in writing to participate. In this study, a grade 5 music score (16 bars) was
The participants included 23 teachers (6 males, 17 included as the easy score and a grade 3 music score (30
females) and 18 students (2 males, 16 females) majoring in bars) was included as the difficult score for playing the
piano at a music university. In addition to teaching students piano with both hands. The tempo of the easy score was
how to play the piano at college, the teachers also performed moderate and that of the difficult score was allegretto. We
at concerts as pianists. In this study, we called the teachers confirmed that all the participants did not know both the
experts and the students non-experts. The average age of music scores after their performance.
the experts was 49.0 years (SD: 9.9, range: 30–65 years)
and that of the non-experts was 22.4 years (SD: 3.8, range:
19–32 years). The average piano playing experience of the Apparatus
experts was 45.6 years (SD: 10.1, range: 27–62 years) and We used the Tobii 17-inch display eye tracker (Tobii T120).
that of the non-experts was 19.4 years (SD: 4.3, range: 14– By using this eye tracker, the gaze of both eyes can be mea-
30 years). The t-test results showed a significant difference sured without restraining the head. The sampling rate was 120
between the experts’ and non-experts’ average piano Hz. The resolution in the display was set to 1024 × 768 pixels.
playing experience (t (39) = 10.20, p < .001), with the We placed a piano (CASIO privia PX-150 electronic piano
experts having significantly longer years of experience than with 88 keys) in front of the display, which was set to the
the non-experts. However, even the non-experts had an correct height for playing the piano. The computer operating
average of 19.4 years of experience, with one of them the eye tracker was being controlled by an experimenter; it
having 30 years of experience. Therefore, the non-experts was set aside from the display and separated by a partition.

Figure 1. Musical scores as shown on the screen of an eye tracker.


Imai-Matsumura and Mutou 5

Procedure with the same procedure. Eye movements in all participants


were recorded with the eye tracker. The order of the condi-
Calibration, measurement, and analysis were performed
tions was performed in the same order for each participant.
using the application software Tobii Studio. The eye
For all participants, the order of the conditions was the
tracker was calibrated for each participant using a 5-point
same: 30 s of reading without playing, checking the
calibration, wherein each participant followed the location
tempo with a metronome, and then playing while looking
of a red dot shown on the screen with both eyes. If the cal-
at the music score. The piano performances were recorded
ibration was not correct, instructions appear on the screen to
on a sound recorder for the evaluation of the performances.
try again. We followed the instructions and did it again.
After the calibration, the following instruction was shown
on the display screen of the eye tracker. ‘Please sight-read
the music score on the display for one minute. During the Measurements
sight-reading, do not make any vocal sound or touch the
piano.’ Then, eye gaze recording started. At the beginning, Gaze Analysis
a fixation cross was shown on the centre of the display In this study, we defined fixation as having a gaze standing
screen for three seconds to fixate the participant’s gaze fol- within a radius of 35 pixels according to the default setting
lowed by the music score on the screen. Each participant of Tobii Studio. AOIs were defined every two rows, includ-
watched the easy music score on the display screen for 60 ing a treble and bass staff in each music score (Figure 2).
s (sight-reading without piano performance). Each AOI was defined using the Tobii Studio AOI tool,
After that, the experimenter showed the participants the used to draw an outline of the target. All AOIs were rectan-
tempo with a metronome and asked them to play the piano gular and had the same size. The area of each AOI for the
at that tempo. A fixation cross was shown on the centre of easy music score was 15.01% of the score area, and the
the display screen for three seconds to fixate the partici- area of each AOI for the difficult music score was
pant’s gaze, followed once again, by the display of the 15.85% of the score area. In Tobii Studio, the total
easy music score. Participants played the piano while number and duration of eye fixations to the AOI during
watching the music score (sight-reading with piano perfor- each sight reading are measured. However, the gaze fixation
mance) and their gazes were measured. The playing time duration increases as the number of gaze fixations increases.
varied among participants. At the end of the performance, Therefore, we divided the duration of fixations by the
the experimenter ended the gaze measurement. number of fixations to obtain the fixation duration per fixa-
After the participants had performed the easy music tion. In other words, it shows how long the gaze fixation
score task, they performed the difficult music score task lasted for one eye fixation.

Figure 2. AOIs in musical scores.


6 Music & Science

Computation of the Eye-hand Span non-experts on both the easy and difficult music scores.
The effect sizes were large for both music scores.
Tobii Studio can record eye movements and sound on a
music score as a video. We made video recordings of all
subjects’ eye movements and piano sounds. The eye-hand Eye Gaze on Music Scores During Sight-reading
span was measured by playing back the video. When the
subject played the first beat of each bar in the played
Without Piano Performance
video, the video was stopped, and the position of the sub- Examples of Eye Movements Based on the Scores of Experts
ject’s gaze at that time was counted as the number of and Non-experts. The gaze plots of an expert having a
beats from the first beat of each bar. For each subject, the high piano performance rating during sight-reading
number of beats of eye-hand displacement for all 16 mea- without piano performance are shown in Figure 3. The
sures in the easy score and all 30 measures in the difficult gaze plots of a non-expert having a low piano performance
score were examined, and the average value was calculated rating during sight-reading without piano performance are
for each music score. In this study, the eye-hand span was shown in Figure 4. The circles in the figures show the eye
shown as the number of beats of displacement between the gaze fixation, and the larger the circle, the longer the eye
eyes and hands. gaze fixation. The numbers in the circles indicate the
order of the fixation. Both the figures show the 60-s gaze
plots of the participants’ sight-reading of music scores
Evaluation of Performance they have never seen before.
In Figure 3, the gaze of the expert proceeded from the
To determine the level of each participant’s performance,
beginning in order, with a constant number and duration
two pianists who were not participating in the experiment
of gaze fixation from the beginning to the end of the
were asked to evaluate each participant’s recorded piano
score, in both the easy and difficult music scores.
performance. The contents of the evaluation were as
Particularly, for the easy score, the expert read to the end
follows: the number of mistakes in sound, beat, and
of the score within a determined time and then returned to
rhythm; tempo; quality of sound; and accent of sound.
the beginning. By contrast, Figure 4 showed that the non-
The maximum score was 50 points. The average of the eval-
expert did not read in any particular order, and neither the
uation scores of the two evaluators was obtained.
number nor the duration of gaze fixation was constant for
the non-expert in either the easy or difficult music scores.
Statistical Processing
SPSS Statistics version 25 was used for statistical process- Fixation Count. In the easy music score, there was no signifi-
ing. An independent sample t-test was conducted to cant interaction for the fixation count between groups and
compare the performance scores and eye-hand spans of AOI (F (2.68, 104.46) = . 539, p = .637); however, in the dif-
the experts and non-experts. We conducted two-way ficult music score, there was a significant interaction for the
repeated measures ANOVA (group × AOI) for each depen- fixation count between groups and AOI, and the effect size
dent variable to analyse fixation count and duration per eye was moderate (F (3.47, 135.19) = 2.630, p = .045, η2 = .10).
fixation on each music score. If the interaction was signifi- The result of the simple main effect test showed that the fix-
cant, a simple main effect test was conducted. ation count was significantly larger in experts (M = 10.87, SD
= 7.90) than in non-experts (M = 3.56, SD = 5.83) in AOI 5
(p = .002). Multiple comparisons of the fixation count in
Results experts showed that the fixation count in AOI 1, 2, 3 or 4
was significantly larger than that in AOI 6, and the fixation
Evaluation of the Performances of Experts count in AOI 2 was significantly larger than that in AOI 4
and Non-experts or 5; whereas multiple comparisons of the fixation count in
Table 1 shows the mean (M ) and standard deviation (SD) of non-experts showed that the fixation count in AOI 1, 2 or 3
the performance skill scores out of the perfect score of 50 was significantly larger than that in AOI 5 or 6, and the fixa-
for both groups by two professional pianists. The perfor- tion count in AOI 2 or 3 was significantly larger than that in
mance score was significantly higher for experts than for AOI 4 (Table 2).

Table 1. Performance Scores in Experts and Non-experts. Fixation Length per Eye Fixation. In this study, we calculated
the time per gaze fixation, because fixation length is
Expert Non-expert
affected by fixation count. There was no significant interac-
M SD M SD t p d tion for the fixation length per fixation count between
groups and AOI in the easy music score (F (2.39, 93.31)
Easy score 36.0 8.2 25.9 9.1 3.37 .001 1.20
= .399, p = .708) or the difficult music score (F (3.53,
Difficult score 26.7 13.5 16.0 9.4 2.87 .005 0.92
137.46) = 2.176, p = .083) (Table 3).
Imai-Matsumura and Mutou 7

Figure 3. Gaze plots of an expert having high performance rating during sight-reading without piano performance. The circles in the
figures show the eye gaze fixation, and the larger the circle, the longer the eye gaze fixation. The numbers in the circles indicate the
order of the fixation.

Figure 4. Gaze plots of a non-expert having low performance rating during sight-reading without piano performance. The circles in
the figures show the eye gaze fixation, and the larger the circle, the longer the eye gaze fixation. The numbers in the circles indicate the
order of the fixation.
8 Music & Science

Table 2. Fixation Counts in Each AOI During Sight-reading Without Piano Performance.

Fixation count AOI 1 AOI 2 AOI 3 AOI 4 AOI 5 AOI 6 F p η2 Multiple comparison

Easy score Expert 38.83 40.8 39.09 27.04 31.35 .539 .637
(17.10) (22.3) (10.63) (9.95) (11.82)
Non-expert 39.33 32.33 32.67 20.67 26.83
(14.29) (14.99) (14.63) (8.51) (12.58)
Difficult score Expert 17.17 21.43 17.09 14.00 10.87 6.52 2.630 .045* .10 AOI 1**,2***,3*,4* > AOI 6
(9.25) (10.85) (7.68) (7.37) (7.90) (10.34) AOI 2 > AOI 4*,5**
Non-expert 16.89 21.67 21.83 9.50 3.56 3.56 AOI 1,2,3 > AOI 5,6*** AOI
(4.93) (11.47) (15.32) (9.28) (5.83) (6.56) 2,3 > AOI 4***
F n.s. n.s. n.s. n.s. 10.80** n.s.
*p < .05, **p < .01, ***p < .001.
Note: The numbers in the table are average values (standard deviation).

Eye Gaze on Music Scores During Sight-reading With length per fixation count between groups and AOI (F
Piano Performance (1.40, 54.56) = 1.856, p = . 176).
Fixation Count. In the easy music score, there was no signif-
icant interaction for the fixation count between groups and Eye-hand Span
AOI (F (2.79, 108.63) = 1.972, p = .127); however, in the
Table 6 shows the mean and standard deviation of the
difficult music score, there was a significant interaction
eye-hand span of the experts and non-experts on the easy
for the fixation count between groups and AOIs (F (3.39,
and difficult music scores. The eye-hand span was signifi-
132.03) = 2.913, p = . 031, η2 = .06). A simple principal
cantly larger in experts than in non-experts on both the
effect test found that experts had a significantly larger fixa-
easy and difficult music score. The effect sizes were large
tion count than non-experts in AOI 1 (p = .025), AOI 2 (p =
for both the easy and the difficult music scores. These
.050), AOI 5 (p = .007), and AOI 6 (p = .013). There was
results indicate that the experts were able to look further
no significant difference in the fixation count of experts
ahead in the music sheet than the non-experts.
and non-experts in AOI 3 and 4. Multiple comparisons
We examined the relationship between eye-hand span
for the fixation count showed that the fixation count in
and performance evaluation scores. The correlation coeffi-
AOI 2 was significantly larger than that in AOI 3 or 4 in
cients between eye-hand span and performance evaluation
experts and showed that the fixation count in AOI 3 was
scores were calculated, controlling for age, gender, and
significantly larger than that in AOI 4 in non-experts
teacher/student. The partial correlation coefficients
(Table 4).
between the eye-hand span and the performance evaluation
scores in the easy and difficult music scores were r = .635
Fixation Length per Eye Fixation. In the easy music score, (p < .001) and r = .685 (p < .001), respectively, indicating
there was a significant interaction for the fixation length a strong correlation. In other words, it is clear that the
per fixation count between groups and AOI (F (3.28, more proficient the player, the larger the eye-hand span.
127.73) = 4.796, p = .003, η2 = .07). A simple main effect
test found that the fixation length per fixation count in
experts was significantly shorter than that in non-experts Discussion
in AOI 3 (p = .050), AOI 4 (p = .039), and AOI 5 (p = This study aimed to compare the number of eye fixations, fix-
.005). Multiple comparisons for the fixation length per fix- ation duration, and eye-hand span between experts and non-
ation count in non-experts showed that the fixation length experts during sight-reading on easy and difficult musical
per fixation count in AOI 1 was significantly longer than scores using a monitor-type eye tracker. Our sight-reading
that in AOI 2, 3, 4 or 5 (Table 5). In the difficult music consisted of two stages: one without playing the music, fol-
score, there was no significant interaction for the fixation lowed by sight-reading with a piano performance. We

Table 3. Fixation Duration per Fixation in Each AOI During Sight-reading Without Piano Performance.

Fixation duration per fixation AOI 1 AOI 2 AOI 3 AOI 4 AOI 5 AOI 6 F p

Easy score Expert .332 (.091) .318 (.083) .314 (.101) .303 (.081) .334 (.097) .399 .708
Non-expert .370 (.108) .327 (.083) .357 (.091) .360 (.155) .369 (.181)
Difficult score Expert .507 (.262) .515 (.208) .478 (.222) .456 (.199) .309 (.198) .181 (.181) 2.176 .083
Non-expert .527 (.197) .587 (.219) .492 (.216) .472 (.149) .141 (.230) .095 (.158)
Note: The numbers in the table are average values (standard deviation).
Imai-Matsumura and Mutou 9

Table 4. Fixation Counts in Each AOI During Sight-reading With Piano Performance.

Multiple
Fixation count AOI 1 AOI 2 AOI 3 AOI 4 AOI 5 AOI 6 F p η2 comparison

Easy score Expert 22.61 24.77 26.56 18.91 27.96 1.972 .127
(7.63) (7.50) (8.21) (6.15) (9.18)
Non-expert 25.26 23.44 22.58 17.22 23.82
(7.99) (8.92) (5.35) (4.52) (6.26)
Difficult score Expert 16.13 19.66 14.02 12.54 15.44 15.85 2.913 .031* .06 AOI 2 > AOI 3,4***
(7.94) (7.85) (4.01) (4.14) (4.00) (6.40)
Non-expert 11.25 15.03 15.27 11.28 11.64 11.06 AOI 3 > AOI 4**
(4.53) (6.49) (7.09) (5.53) (4.51) (4.98)
F 5.40* 4.09* n.s. n.s. 8.12** 6.86*
*p < .05, **p < .01, ***p < .001.
Note: The numbers in the table are average values (standard deviation).

Table 5. Fixation Duration per Fixation in Each AOI During Sight-reading With Piano Performance.

Fixation duration per Multiple


fixation AOI 1 AOI 2 AOI 3 AOI 4 AOI 5 AOI 6 F p η2 comparison

Easy score Expert .310 .311 .336 .349 .339 4.796 .003** .07
(.081) (.101) (.117) (.130) (.122)
Non-expert .294 .398 .415 .439 .476 AOI
(.102) (.183) (.131) (.141) (.174) 2**,3,4,5*** >
AOI 1
F n.s. n.s. 4.10* 4.57* 8.76**
Difficult score Expert .416 .518 .624 .707 .506 .436 1.856 .176
(.192) (.251) (.321) (.467) (.237) (.299)
Non-expert .682 1.012 .893 1.103 1.344 1.178
(.532) (.950) (.817) (.779) (2.121) (1.713)
*p < .05, **p < .01, ***p < .001.
Note: The numbers in the table are average values (standard deviation).

analysed the eye movements during both stages of score, and their eye-hand span using an eye tracker. Our
sight-reading. Five hypotheses were tested. The duration of participants included teachers at a music university as the
an eye fixation differed between experts and non-experts experts and students majoring in piano from the same uni-
only in the easy music score when accompanied by a piano versity as the non-experts. Specifically, we used easy (16
performance. Hypothesis (1) was partially supported, and bars) and difficult music scores (30 bars), focused on view-
the duration of an eye fixation on a music score in experts points of the music score by proficiency degree, and exam-
was shorter than that in non-experts in the easy music score ined whether there was a difference in eye fixation.
with piano performance. Hypothesis (2) that the number of Importantly, two other pianists evaluated the individual per-
eye fixations on the difficult part of the difficult music formances of the experts and non-experts in this study to
score increased compared with other part in experts without ensure that the experts had better playing skills than the
and with performances was supported. All hypotheses regard- non-experts. The results showed that the experts had signif-
ing eye-hand span were supported. That is, the eye-hand span icantly higher performance scores than the non-experts. The
was longer in experts than in non-experts and the piano per- results also indicated that the eye-hand span in experts was
formance in experts during sight-reading was rated higher significantly greater than that in non-experts. Previous
than that of the non-experts. Furthermore, the higher the studies have shown that experienced sight-reading players
piano performance rating, the longer the eye-hand span.

Table 6. Eye-hand Span in Experts and Non-experts.


Performance Skill Scores and Eye-hand Spans of the Expert Non-expert
Experts and Non-experts M SD M SD t p d
In this research, we aimed to compare and examine the
Easy score 1.96 0.75 1.04 0.40 4.65 <.001 1.52
sight-reading ability of pianists by measuring the movement
Difficult score 1.50 0.94 0.66 0.49 3.42 .001 1.11
of their line of sight at the time of their reading the music
10 Music & Science

exhibit greater eye-hand span (Furneaux & Land, 1999; 6. By contrast, the fixation counts of the experts were sig-
Gilman & Underwood, 2003; Truitt et al., 1997). nificantly lower for AOI 6 than for AOIs 1–4, indicating
Furthermore, in the research by Rayner and Pollatsek that the reading progressed with a constant frequency of
(1997), the size of the eye-hand span was found to be eye movement except for AOI6. In addition, both the
inversely correlated with the complexity of the score, indi- experts and non-experts had most fixation counts for AOI
cating that the eye-hand span is larger for easier scores. This 2, which was the most difficult part of the music score.
was true in this study as well, where the eye-hand span More fixation counts are indicative of a strong interest in
beats were significantly larger in the easy music score. and awareness of the gaze target (Yamamoto &
The effect of performance tempo on the eye-hand span Imai-Matsumura, 2013). These results suggest that both
has also been shown (Furneaux & Land, 1999; Rosemann experts and non-experts pay more attention to the notes in
et al., 2016), wherein eye-hand span has been seen to AOI 2 than to other parts of the music score.
increase at a slow tempo and decrease at a fast tempo. In
this study, the larger eye-hand span in the easy score was
considered to be because the specified tempo was slower Eye Movements During Sight-reading With
than the tempo in the difficult score. Piano Performance
Furthermore, we found that there was a strong correlation
During sight-reading with piano performance, in the easy
between eye-hand span and performance evaluation scores
music score, there was a significant interaction in the duration
for both easy and difficult scores, that is, the larger the
per fixation, but not in the fixation counts between experts and
eye-hand span, the better the piano performance. Hence,
non-experts. The duration per fixation was significantly longer
the size of the eye-hand span is related to sight-reading
in the non-experts than in the experts while playing the piano.
achievement and the performance technique score. Thus,
That is, it is suggested that the non-expert took a long time to
the results of this research show that skilled piano players
read the information from the score. This may be because pia-
display a bigger eye-hand span (Furneaux & Land, 1999;
nists who are not good at sight-reading tend to search for infor-
Gilman & Underwood, 2003; Truitt et al., 1997). This may
mation written on the score (Goolsby, 1994). There was no
mean that excellent pianists have a larger eye-hand span
significant difference in the duration per fixation of the
because of their superior information processing speed in
experts’ AOIs 1–5, indicating that the time to get information
the brain (Jäncke et al., 1997; Jäncke et al., 2000). Such
from each AOI was almost the same.
eye-hand span can be developed through years of practice
In the difficult music score, there was a significant inter-
and training (Rosemann et al., 2016).
action in the fixation counts, but not in the duration per fix-
ation between experts and non-experts. The experts had the
most fixation counts for AOI 2, which was the most difficult
Eye Movements During Sight-reading Without Piano part of the music score. However, non-experts showed an
Performance increase in the number of fixations to AOI 2 during
sight-reading without piano performance but did not show
During sight-reading without piano performance, in the
an increase in the number of fixations to AOI 2 with
easy music score, there was no significant interaction in
piano performance. These findings suggest that the
the fixation counts nor duration per fixation between
experts were aware of AOI 2, which is a difficult part of a
experts and non-experts. The non-experts in this study are
difficult score, with or without piano performance. In addi-
piano students who aspire to become pianists, so they
tion, experts gazed at AOI 2 significantly more frequently
have had many years of experience in playing the piano
than non-experts during piano performance. This result sup-
since childhood. Even though they are non-experts, they
ports a previous study employing eye tracking that indi-
can be considered highly skilled in sight-reading. This
cated that experts gaze more repeatedly at valuable clues
may be the reason why the easy score did not show a signif-
than beginners (Wolff et al., 2016).
icant difference between experts and non-experts.
The duration per fixation of experts during the
In the difficult music score, there were no significant
sight-reading with piano performance is longer for the difficult
interactions in the durations per fixation between experts
score than for the easy score, indicating that the experts needed
and non-experts. However, there were significant interac-
to read more information for the difficult score than for the
tions in the fixation counts between experts and non-
easy score. The duration per fixation increased for non-experts
experts. The experts had significantly greater fixation
as well. The SD of the duration per fixation was larger for non-
counts at AOI 5 of the music score. As the time for
experts, indicating that there were large individual differences.
reading the music score in the sight-reading without piano
performance condition was limited, it is likely that the non-
experts took longer to extract information about the first Difference Between Eye Movements With and
half of the music score and had difficulty moving on to
the second half. This can be seen from the fact that the Without Piano Performance During Sight-reading
number of fixations for AOIs 1–3 of the non-experts is sig- The present study aimed to compare eye movements during
nificantly higher than the number of fixations for AOIs 5, sight-reading between experts and non-experts. Although
Imai-Matsumura and Mutou 11

not for this purpose, based on the results of this study, we movements. In addition, using an easy (16 bars) and a dif-
will also discuss the differences in eye movements with ficult (30 bars) music score for two-handed playing, we
and without piano playing during sight-reading. investigated whether there were differences in the number
of eye fixations, fixation duration, and eye-hand span
Fixation Count. In both experts and non-experts, the fixation between experts and non-experts. Our goal was to investi-
count decreased with piano playing in both the easy and dif- gate eye movements during sight-reading under conditions
ficult music scores. However, in the difficult music score, similar to those experienced by real pianists. As a result, our
the fixation counts of AOI 4, 5, and 6 at the end of the hypotheses were largely supported, and we obtained the fol-
score decreased for both experts and non-experts during lowing results.
sight-reading without piano performance. In sight-reading (1) The duration of an eye fixation on a music score in
without piano performance, time was limited. Therefore, experts was shorter than that in non-experts in the easy
the non-experts could not read the last part of the music music score with piano performance. (2) The number of
score sufficiently. During the performance, the fixation eye fixations on the difficult part of the difficult music
count did not decrease because the non-experts could score increased compared with other part in experts
gaze at the end of the music score. The number of eye fix- without and with performances. (3) Eye-hand span was
ations on the difficult part of the difficult music score in longer in expert than in non-experts. (4) The piano perfor-
experts increased compared with other part both without mance during sight-reading was rated higher for experts
and with piano performance, though that in non-experts than for non-experts. (5) The higher the evaluation score
increased only without piano performance. These results of the piano performance, the longer the eye-hand span was.
suggest that, especially in sight-reading with piano
playing, non-experts were not able to read the score to the Acknowledgments
end within a certain period of time or were not sufficiently The authors thank Prof. Satoshi Inagaki, Ms. Marie Amamoto and
able to direct their gaze to the difficult part of the difficult their collaborators in SOAI University for their participation in our
music score. research.

Fixation Duration per Fixation. In the easy music score, Action Editor
experts showed similar duration per fixation for both with
Elaine King, University of Hull, School of Arts.
and without piano performance. By contrast, that for non-
experts increased more without piano performance than
with piano performance. In the difficult music score, both Peer Review
experts and non-experts showed an increase in the fixation Two anonymous reviewers.
duration per fixation without piano performance than with
piano performance. The difference in duration per fixation Author Contributions
between with and without piano performances was espe- MM and KI-M researched literature and conceived the study. MM
cially large for non-experts. was involved in participant recruitment and data analysis. KM-I
The finding that it took more time to read the music score was involved in study design, gaining ethical approval, data anal-
with performance is thought to be because of the necessity ysis and writing.
for obtaining accurate information about the score to
perform. However, experts did not increase the duration Declaration of Conflicting Interests
per fixation in the easy music score even when playing. The authors declared no potential conflicts of interest with respect
This may indicate that the easy music score did not to the research, authorship, and/or publication of this article.
require more time to read. By contrast, the duration per fix-
ation of the non-experts was longer than that of the experts, Funding
and increased significantly with piano performance, sug-
The authors received no financial support for the research,
gesting that the non-experts required more time to read authorship and/or publication of this article.
the music score.
ORCID iD
Conclusion Kyoko Imai-Matsumura https://orcid.org/0000-0001-6966-
4698
This study aimed to compare eye movements during
sight-reading between experts and non-experts. The novel
aspect of this study is that it is designed considering the lim- References
itations of previous studies. As such, it includes piano Ahken, S., Comeau, G., Hébert, S., & Balasubramaniam, R.
teachers who were both teachers at a music college and pia- (2012). Eye movement patterns during the processing of
nists as the experts and music college students studying to musical and linguistic syntactic incongruities.
become pianists as non-experts, and makes use of an eye- Psychomusicology: Music, Mind & Brain, 22(1), 18–25.
tracking instrument that does not restrict the performers’ https://doi.org/10.1037/a0026751
12 Music & Science

Arthur, P., Khuu, S., & Blom, D. (2016). Music sight-reading Meinz, E. J., & Hambrick, D. Z. (2010). Deliberate practice is nec-
expertise, visually disrupted score and eye movements. essary but not sufficient to explain individual differences in
Journal of Eye Movement Research, 9(7), 1–11. https://doi. piano sight-reading skill: The role of working memory capac-
org/10.16910/jemr.9.7.1 ity. Psychological Science, 21(7), 914–919. https://doi.org/10.
Drai-Zerbib, V., Baccino, T., & Bigand, E. (2012). Sight-reading 1177/0956797610373933
expertise: Cross-modality integration investigated using eye Penttinen, M., & Huovinen, E. (2011). The early development of
tracking. Psychology of Music, 40(2), 216–235. https://doi. sight-reading skills in adulthood: A study of eye movements.
org/10.1177/0305735610394710 Journal of Research in Music Education, 59(2), 196–220.
Furneaux, S., & Land, M. F. (1999). The effects of skill on the https://doi.org/10.1177/0022429411405339
eye-hand span during musical sight-reading. Proceedings Puurtinen, M. (2018a). Eye on music reading: A methodological
of the Royal Society of London, Series B: Biological review of studies from 1994 to 2017. Journal of Eye
Sciences, 266(1436), 2435–2440. https://doi.org/10.1098/rspb. Movement Research, 11(2), 1–16. https://doi.org/10.16910/
1999.0943 jemr.11.2.2
Gilman, E., & Underwood, G. (2003). Restricting the field of view Puurtinen, M. (2018b). Learning on the job: Rethinks and realiza-
to investigate the perceptual spans of pianists. Visual tions about eye tracking in music-reading studies. Frontline
Cognition, 10(2), 201–232. https://doi.org/10.1080/713756679 Learning Research, 6(3), 148–161. https://doi.org/10.14786/
Goolsby, T. W. (1994). Eye movement in music reading: Effects flr.v6i3.380
of reading ability, notational complexity, and encounters. Rayner, K. (1998). Eye movements in reading and information pro-
Music Perception, 12(1), 77–96. https://doi.org/10.2307/ cessing: 20 years of research. Psychological Bulletin, 124(3),
40285756 372–422. https://doi.org/10.1037/0033-2909.124.3.372
Hadley, L. V., Sturt, P., Eerola, T., & Pickering, M. J. (2018). Rayner, K., & Pollatsek, A. (1997). Eye movements, the eye-hand
Incremental comprehension of pitch relationships in written span, and the perceptual span during sight-reading of music.
music: Evidence from eye movements. The Quarterly Current Directions in Psychological Science, 6(2), 49–53.
Journal of Experimental Psychology, 71(1), 211–219. https:// https://doi.org/10.1111/1467-8721.ep11512647
doi.org10.1080/17470218.2017.1307861 Rosemann, S., Altenmüller, E., & Fahle, M. (2016). The art of
Huovinen, E., Ylitalo, A. K., & Puurtinen, M. (2018). Early attrac- sight-reading: Influence of practice, playing tempo, complexity
tion in temporally controlled sight reading of music. Journal of and cognitive skills on the eye-hand span in pianists.
Psychology of Music, 44(4), 658–673. https://doi.org/10.
Eye Movement Research, 11(2), 3. https://doi.org/10.16910/
1177/0305735615585398
jemr.11.2.3
Salvucci, D. D., & Anderson, J. R. (2001). Automated eye-
Hutton, S. B., & Nolte, S. (2011). The effect of gaze cues on atten-
movement protocol analysis. Human-Computer Interaction,
tion to print advertisements. Applied Cognitive Psychology,
16(1), 39–86. https://doi.org/10.1207/S15327051HCI1601_2
25(6), 887–892. https://doi.org/10.1002/acp.1763
Schlaug, G., Jäncke, L., Huang, Y., Staiger, J. F., & Steinmetz, H.
Jäncke, L., Schlaug, G., & Steinmetz, H. (1997). Hand skill asym-
(1995). Increased corpus callosum size in musicians.
metry in professional musicians. Brain and Cognition, 34(3),
Neuropsychologia, 33(8), 1047–1055. https://doi.org/10.
424–432. https://doi.org/10.1006/brcg.1997.0922
1016/0028-3932(95)00045-5
Jäncke, L., Shah, N. J., & Peters, M. (2000). Cortical activations in
Schulze, K., Mueller, K., & Koelsch, S. (2010). Neural correlates
primary and secondary motor areas for complex bimanual
of strategy use during auditory working memory in musicians
movements in professional pianists. Cognitive Brain
and non-musicians. European Journal of Neuroscience, 33(1),
Research, 10(1–2), 177–183. https://doi.org/10.1016/S0926-
189–196. https://doi.org/10.1111/j.1460-9568.2010.07470.x
6410(00)00028-8
Shaffer, L. H. (1984). Timing in solo and duet piano perfor-
Krampe, R. T., & Ericsson, K. A. (1996). Maintaining excellence: mances. The Quarterly Journal of Experimental Psychology,
Deliberate practice and elite performance in young and older pia- 36(4), 577–595. https://doi.org/10.1080/14640748408402180
nists. Journal of Experimental Psychology. General, 125(4), Sloboda, J. A. (1974). The eye-hand span: An approach to the
331–359. https://doi.org/10.1037/0096-3445.125.4.331 study of sight-reading. Psychology of Music, 2(2), 4–10.
Lehmann, A. C., & Ericsson, K. A. (1997). Research on expert per- https://doi.org/10.1177/030573567422001
formance and deliberate practice: Implications for the education Sloboda, J. A. (1984). Experimental studies of music reading: A
of amateur musicians and music students. Psychomusicology, review. Music Perception, 2(2), 222–236. https://doi.org/10.
16(1–2), 40–58. https://doi.org/10.1037/h0094068 2307/40285292
Lehmann, A., & McArthur, V. (2002). Sight-reading. In Truitt, F. E., Clifton, C.Jr., Pollatsek, A., & Rayner, K. (1997). The
R. Parncutt & G. McPherson (Eds.), The science & psychology perceptual span and eye-hand span in sight reading music.
of music performance: Creative strategies for teaching and Visual Cognition, 4(2), 143–161. https://doi.org/10.1080/
learning (pp. 135–150). Oxford University Press. https://doi. 713756756
org/10.1093/acprof:oso/9780195138108.001.0001 Uzzaman, S., & Joordens, S. (2011). The eyes know what
Madell, J., & Héébert, S. (2008). Eye movements and music you are thinking: Eye movements as an objective
reading: Where do we look next? Music Perception, 26(2), measure of mind wandering. Consciousness and Cognition,
157–170. https://doi.org/10.1525/mp.2008.26.2.157 20(4), 1882–1886. https://doi.org/10.1016/j.concog.2011.09.010
Imai-Matsumura and Mutou 13

Waters, A. J., Underwood, G., & Findlay, J. M. (1997). Studying Wolff, C. E., Jarodzka, H., van der Bogert, N., & Boshuizen, H. (2016).
expertise in music reading: Use of a pattern-matching para- Teacher vision: Expert and novice teachers’ perception of problem-
digm. Perception & Psychophysics, 59(4), 477–488. https:// atic classroom management scenes. Instructional Science, 44(3),
doi.org/10.3758/BF03211857 243–265. https://doi.org/10.1007/s11251-016-9367-z
Weaver, H. E. (1943). A survey of visual processes in Yamamoto, T., & Imai-Matsumura, K. (2013). Teacher’s gaze and
reading differently constructed musical selections. awareness of student’s behavior: Using an eye tracker.
Psychological Monographs, 55(1), 1–30. https://doi.org/ Comprehensive Psychology, 2, 01.IT.2.6. https://doi.org/10.
10.1037/h0093537 2466/01.IT.2.6

You might also like