Professional Documents
Culture Documents
ACUSTICA
DOI 10.3813/AAA.918303
1)
2)
3)
School of Science and Technology, Meiji University, 1-1-1, Higashimita, Kawasaki, Kanagawa 214-8571,
Japan. uenok@isc.meiji.ac.jp
Center for Advanced Science and Innovation, Osaka University, Japan
Graduate School of Science and Technology, Kumamoto University, Japan
Summary
This study aimed to investigate the notion that musicians adjust their performance to suit the acoustics of concert
halls. First, a schematic model was developed to provide a basis for the investigation. Second, a performance
experiment was conducted: musicians performed under dierent acoustic conditions simulated in an anechoic
room. The performances were recorded, and the musicians were interviewed about the technical details of the
adjustments that they made to suit the acoustics. The results showed how expert musicians adapted their performances to the acoustics. Third, as a pilot study to examine if dierences could be objectively identied, a
listening test and acoustic analysis were conducted on a recorded violin performance. The study conrmed that
dierences could indeed be objectively identied, at least in terms of the tempo and extent of vibrato.
PACS no. 43.55.Hy
1. Introduction
In concert hall acoustics, many studies conventionally assume that the music source signals generated by performers are constant, regardless of the halls acoustics.
However, among professional performing musicians, it is
quite commonly held that they must consciously or unconsciously adjust their performance to suit to the acoustics to
convey their interpretation to the audience [1, 2]. Hence,
we may naturally suppose that the performance varies with
the acoustics. This supposition raises the question that the
conclusions of studies based on the conventional assumption (as stated above) might not be fully valid for the room
acoustics in actual concerts. To understand the role played
by the room acoustics during concert performances, we
also need to properly understand the eect of the acoustics on the performer.
Musicians subjective evaluation of stage acoustics has
been studied by several researchers [3, 4, 5, 6, 7, 8, 9, 10].
These studies mainly aimed to identify a one-on-one relationship between musicians evaluations and room acoustic parameters, without considering how the musicians adjusted their performance to the acoustics. Those studies
have provided useful knowledge to assist acoustic design
of stage enclosures. However, their subjective evaluation
of the acoustics is probably inuenced by the way musicians adapt their performance to the acoustics. This might
provide another perspective on acoustic design for concert
performances.
The adjustment of human action to specic acoustic environments has previously been investigated in terms of
voice production. Lombard noted that speakers tend to increase their vocal intensity in the presence of noise [11], a
phenomenon which has become well-known as the Lombard eect. Recently, Kob et al. [12] and Brunskog et al.
[13] reported that voice production by school teachers was
inuenced by room acoustics, on the basis of studies carried out in classrooms. Ternstrm showed that the acoustical environment changed the voice quality of boys choirs
by analyzing long-time average spectra [14]. These studies
support the existence of automatic feedback: that human
action reexively changes in some environments.
Musicians adjust their performance according to how
they imagine the music might be heard by the audience
[15]. Meyer described examples of modied performances
under dierent room acoustics [16]. Bolzinger and Risset
found that piano performances were adapted to dierent
room acoustic conditions by analyzing MIDI outputs [17].
They also presented a model illustrating the circulative
feedback system between the player and the room. These
adjustments in performance do not stem solely from general automatic human feedback but from acquired techniques relating to professional skills that musicians have
developed. In the study of concert hall acoustics for mu-
505
ACUSTICA
Performer
Personal skill
Performing experience
Listener
Perception of
hall acoustics
Perception of
hall acoustics
Perception of
musical expression
Auditory
sensation
Perception of
musical expression
Acquired feedback
Common feedback
Perform
actions
Auditory
sensation
Dry Source
IRAudience
506
Imagination of musical
sound in audience area
Image of performance
Characteristics of hall,
preferences, etc
Instr.
P.c.
R.
VN
OB
FL1
FL2
Violin
Oboe
Flute
Flute
31
25
20
45
100120
70
1012
7
BR
Singer
Solo
Orchestra
Solo, Chamber music
Orchestra (retired),
Chamber music
Opera (Bass baritone)
14
60
Explication of Figure 1 is as follows: a listener passively receives the music convolved by room impulse response. There is no feedback from a listener to the music
source. On the contrary, a performer listens to the sound
and produces it at the same time. Two types of circulative feedback system can be assumed here. One is a common feedback system that is generally observed in humans as an automatic response. The other is an acquired
feedback system which is related to the performers specic skill formed by his performance experience. In the
acquired feedback system, a performer perceives musical
expression and hall acoustics from auditory sensation, creates an imagination of how the music would sound in the
audience area, forms an image of the performance to be
played, and controls his/her performing actions. The ac-
Vol. 96 (2010)
Table II. Musicians comments on the adjustments that they make in their daily performances.
VN
OB
FL1
FL2
BR
Depending on the particular hall, I adjust (1) the depth of vibrato, (2) pressure, speed, and returning of bowing, (3) the
length of the bow, and (4) the strength with which I hold the strings with my left-hand ngers; then I gauge the sound in
terms of reverberation. When in a less reverberant room I try to enhance the sonority of sound in the instrument. When I
adjust the depth of vibrato, this depends not only on the reverberation level but also on the perceived size of the room. In a
room with excessive reverberation. I reduce the vibrato to compensate. However, in a larger room, I produce the full sonority
of the violin sound by reducing the bowing pressure and use of normal vibrato.
In a room with little reverberation, I relax the lips and allow the reeds to fully vibrate. In a reverberant room, I suppress
the sonority and vibration of the instrument. When the room sound is harder, I cut the high-frequency components of the
harmonics by increasing the area where my lips touch the reeds and softening the vibration. In terms of dynamics, I soften
the notes in a reverberant room and strengthen them in a room with less reverberation.
Depending on the level of reverberation in a room, I adjust the music tempo, articulation, and the length of notes. I do
not make many adjustments to the vibrato. In a room with less reverberation, I ensure that the soft notes are not too soft;
however, in a room with strong reverberation, I sometimes make the notes only barely audible. When playing a quick-tempo
piece in an extremely reverberant room, I slow down the tempo.
I do not have any means to adjust a switch in my mind and body in order to suit the reverberation of a room. Hence, I rely
on repeated rehearsals to adapt my playing. Regarding the setting of the tempo, I slow it down in a reverberant room and
quicken it in a room with minimal reverberation. Regarding the volume of sound, I tend to disregard that in a reverberant
room.
Since singers require their vocal cords to perform, I would strain my vocal cords if I exercised them according to the acoustic
conditions. Hence, I always choose to maintain the form without being inuenced by the surroundings. However, I may
adapt while performing and adjust my singing unconsciously, even though I actually do not intend to change it. I change
both the tempo and my enunciation. Also, the more reverberant the room is, the slower the music tempo becomes. If the
room is very reverberant, I try to vocalize the consonants more clearly.
3. Performance experiment
The performance experiment was conducted to investigate
the ways technical adjustments were made to a performance and to record music signals for the purpose of making an objective examination on the change of the performance. In this study, a laboratory experiment technique in
which the acoustic conditions can be changed freely and
quickly without changing sight was used in order to focus
on the changes of performance generated by room acoustic
conditions.
3.1. Sound eld simulation system
To simulate actual sound elds in an anechoic room with
three-dimensional information, a 6-channel sound eld
simulation system was employed. In this system, sound
elds are recorded through a microphone system consisting of six unidirectional microphones and reproduced
through six loudspeakers in an anechoic room [18]. Applying this system to the subjective experiment on musicians,
the sound of a musical instrument played by the subject
(dry music signal) is picked up by a microphone and convolved with the directional impulse responses measured on
the stage of a real concert hall in six orthogonal directions
[7].
Figure 2a shows the arrangement of the sound source
and the microphone for the measurement of room impulse
responses at the players position onstage. This arrangement was determined by simplifying the geometrical relationship between a player and his/her musical instrument. A dodecahedral omnidirectional loudspeaker system is located at a representative position onstage. A unidirectional microphone is located at a point close to the
507
300 mm
Mic. Amp
Amp
300 mm
Directional Mic.
(for
( 6 directions)
ACUSTICA
Omnidirectional
Omnidirectional
Loudspeaker
Loudspeaker
Directional
Mic.
1200 mm
2000 mm
-time Convolver
Convolver
Real-time
Real
(YamahaSREV1,
SREV1,66ch.)
(Yamaha
FrequencyEqualizer
Frequency
Equalizer
Audience
Area
PowerAmp.
Power
Amp. (6 ch.)
Loudspeakers
Loudspeakers
(6 ch.)
(b)
(a)
In anechoic room
Figure 2. Block diagram of the sound eld simulation system. (a) Measurement on stage, (b) Sound eld simulation in an anechoic
room.
Table III. Original room acoustic conditions simulated in an anechoic room for the performance experiment. *1: Reverberation time
(T60 ) measured in the audience area; *2: Reverberation time (T60 ) measured at a performers position on stage; *3: The energy level of
the early reections (10100 ms) relative to that of the direct sound; *4: The energy level of the reverberation (after 100 ms) relative to
that of the direct sound; *5: The energy of the early reections and reverberation (after 10 ms) relative to that of the direct sound, *6:
Room gain which indicates the energy of entire impulse response relative to that of the direct sound [13]. *2, *3, *4, *5, *6: Calculated
for the impulse responses measured by an omni-directional microphone set at the conguration shown in Figure 2 (1). The Learly and
Llate values correspond to STearly and STlate , respectively, except that those are 7 dB smaller than ST values because of the dierence of
the distance between the sound source and the microphone. The GRG values are also smaller than originally dened values because of
the dierence of the distance.
Room
Volume
Stage
Seats
RTA1
RTS2
L3
early
L4
late
L5
all
6
GRG
Features
AE
HS
HM
HL
CH
343
1660
14800
22776
13333
44
200
290
300
1521
2020
0.0
1.4
1.4
2.4
3.1
0.0
1.2
1.7
2.2
2.7
-14.3
-20.9
-21.9
-16.2
-17.3
-22.7
-18.8
-17.3
-12.5
-18.7
-17.1
-13.7
0.00
0.24
0.06
0.08
0.18
sound source, and the directional impulse response is measured six times by rotating the microphone in 90-degree
increments. These measurements were conducted using
the swept-sine technique.
The simulated sound eld was constructed in an anechoic room (see Figure 2b). For the dry music signal,
the sound from the subjects instrument was picked up
by a unidirectional microphone (Sony, C48) set at a point
close to the subject. The signal was convolved with the
6-channel directional impulse response signals for a duration of 2.7 s using a 6-channel real-time digital convolution
system. The direct sound from the sound source and the
sound reected from the stage oor were excluded from
the directional impulse response signals. The convolved
signals were reproduced through six loudspeakers (TANNOY, T12) arranged on a spherical surface with a radius
of 2 m (see Figure 2b).
The reproducibility of the simulation system has been
studied from both physical and subjective aspects [7].
3.2. Methods
Table III lists the ve room acoustic conditions that were
presented to the musicians in the performance experiment:
508
Vol. 96 (2010)
Table IV. Examples of the musicians comments on their performance under each acoustic condition.
VN
OB
AE
Since the sounds disappear the moment the note ends, I play
to create resonance. I maintain normal tempo and reduce the
intervals between notes. Also, I adjust the intervals between
phrases as well as the length and speed of the notes with
staccato.
HM
I feel that the reverberation quality of the room is moderate. Therefore, there is nothing I especially need to do. The
vibrato is relatively shallower and faster; deeper vibrato is
not required. The tempo at which Gavotte is played can be a
little faster.
CH
509
ACUSTICA
Tempo
Length of notes,
Interval between notes
Vibrato
Dynamics, Agogics
Attack, Pronunciation
End of phrase, Breathing
Support in body, Form
Tuning
Harmonics
VN
OB
FL1
FL2
BR
players who consciously adjusted their performance according to the room acoustics, vibrato and dynamics were
the most common attributes mentioned.
To detail the particular adjustments made by the subjects in each condition, Table VI summarizes their comments on tempo, length of notes, vibrato, and other aspects which were frequently referred to. With regard to
the length of notes, (also referred to as intervals), all comments indicated a common tendency: longer notes in less
reverberant rooms and shorter ones in more reverberant
rooms. In terms of tempo, the following adjustment was
made by all musicians in the excessively reverberant condition (CH): slow down the tempo. However, in the
moderate condition (HS), there were contradictory adjustments: VN, faster and FL1, a little slower. Concerning vibrato, comments made by the three players varied
in CH: FL1, shallower and ner, VN, moderately, and
OB, slower and deeper. Under some conditions, a common tendency was not evident, partly because the verbal
expressions were dicult to compare. Still, two or more
musicians made the following comments in AE, HM, and
CH, respectively: by creating sonority inside the instrument, adjustment is not necessary, and by suppressing
the sonority of the instrument.
510
Vol. 96 (2010)
Table VII. Attributes for the dierence between the pairs as described by the six listeners. The numbers denote the number of subjects
who commented. *1: The following number of listeners pointed out each attribute and order of the dierence: >: 46 listeners, : 23
listeners.
Tendency in comments1
Attributes
Main expressions
Ave Maria
Gavotte
Tempo
Length of notes
Vibrato
Dynamics
Dynamic, Expressive,
Romantic, Heavy
condition
Judgment of dissimilarity
: clearly different
: subtly different
: not different at all
HS
HL
CH
AE
HS
Upper line: Ave Maria
Lower line: Gavotte
HL
tify the music tempo of a recording, performance duration, (dened as the time from the onset of the rst played
note to the onset of the nal note), was measured. The results were transformed to the tempo scale in units of beats
per second. In order to compare the results of two music pieces, the tempo was normalized by the mean tempo
of each music piece, called n-Tempo. Total materials included 30 phrases (Ave Maria: 5 room conditions 3 trials; Gavotte: 5 room conditions 3 trials).
The extent of vibrato was analyzed for ve long notes
taken from the recordings of Ave Maria. The vibrato is
one of the important ornaments of violin performance and
it can be quantied by the quasi-periodic uctuations of
the fundamental frequency (F0 ) and amplitude. In this experiment, the uctuations of F0 were analyzed by tracking contours using the autocorrelation function (integration interval: 20 ms, moving step: 4 ms, time window: rectangular). The resulting F0 contours were low-pass ltered
at 10 Hz to extract a periodic frequency uctuation of F0
ranging from 4 to 8 Hz. Figure 5 shows examples of the
measured relative F0 contours of a long note. Here, 100
cents denotes one semitone. The uctuation of F0 for the
room condition HM was observed to be larger than that for
the room condition HS.
Based on the F0 contours, the extent of vibrato was
quantied as follows. First, the amplitude of the wave for
each cycle of uctuation of F0 was determined by Prames
strategy [19] where three adjacent peaks of a F0 waveform were used to calculate. The amplitude values were
obtained for each semi-cycle of a F0 waveform. Next, the
segment in which the calculated amplitude values exceed
10 cents was dened as the body of vibrato. The threshold of 10 cents was determined by inspecting the vibrato
511
ACUSTICA
12
**
**
**
**
n-Tempo [%]
Room
Note Number
85**
91**
59**
73**
97**
25**
AE
HS
4.2.2. Results
Figure 6 shows the distribution of n-Tempo for Ave Maria
and Gavotte. Each error bar indicates the fastest and the
slowest performance within three trials performed under
each room acoustic condition. The mean n-Tempo for Ave
Maria ranged between 9.3% (CH) and +3.4% (HM),
while n-Tempo for Gavotte ranged between 4.6% (CH)
and +7.0% (HS). Table VIII shows the result of a oneway ANOVA test, setting room conditions as a factor, inputting 15 data of n-Tempo (5 room conditions 3 trials)
for each music piece. The result shows that the main effects of room conditions (room) were highly signicant.
Moreover, pair-wise comparisons between the ve room
conditions were conducted by Tukey HSD tests. Signicant pairs were marked in Figure 6. It can be seen that,
for Ave Maria, the n-Tempo of the room condition CH
512
HL
CH
Room
**
-9
Ave Maria
**
**
Gavotte
-12
**
40
F0 V E [+-cents]
**
waveform, and then the mean value of the amplitude values for the body of vibrato was calculated for each note.
This mean value, denoted as F0 V E, indicates the vibrato extent calculated from F0 contours. The analysis
was conducted on 75 notes (5 notes 3 trials 5 room
conditions).
The sound level, equivalent continuous A-weighted
sound pressure level, was calculated from the recordings
of three trials for each of two music pieces. In order to
compare the results of two music pieces, the sound level
was normalized by the mean sound level of each music piece, called relative sound level. Total materials included 30 phrases (Ave Maria: 5 room conditions 3 trials; Gavotte: 5 room conditions 3 trials).
HM
-3
-6
Table VIII. Eect size ( ) [%] of the factors from the result of
ANOVA. The statistical signicance of each eect is indicated
by asterisks (**: 1% signicant level).
**
**
**
**
**
**
**
30
20
10
AE
HS
HM
Room
HL
CH
was signicantly slower than for the others and the dierence between the conditions, except for CH, were not signicant. For Gavotte, more pairs (seven pairs out of ten)
exhibited signicant dierence. These results concur well
with the listening experiment, where dierences of tempo
were mainly mentioned for Gavotte.
Figure 7 shows the results of the analysis of F0 V E.
Each error bar indicates the standard deviation. The mean
value of F0 V E for each room condition ranged between
19 cents (HS) and 30 cents (AE). To test for results
signicance, a two-way ANOVA, setting room conditions
and note number as factors, inputting 75 data of F0 V E (5
room conditions 5 notes 3 trials) was performed. The
result shows that the eect of room was highly significant (see Table VIII). Again, pair-wise comparisons between the ve room conditions were conducted by Tukey
**
Ave Maria
Gavotte
1
0
-1
AE
HM
Room
HS
5. Discussion
HL
CH
-2
-3
**
-4
**
**
-5
**
**
Ave Maria
Gavotte
Vol. 96 (2010)
RTS
L1
early
L1
late
L1
all
GRG
0.19
-0.21
-0.73
-0.18
-0.82
-0.40
-0.84
-0.33
-0.48
-0.59
Table X summarizes the results for the case study of musician VN obtained by three approaches; subjective reports
observed in the performance experiment, the attributes detected by listening experiment, and physical dierences
obtained by acoustic analysis. It can be seen that the order of clear or signicant dierences were the same for
the three approaches. These results indicate that the violinist consciously controlled her performance to suit room
acoustic conditions and the dierence in performed music
signals between the acoustic conditions can be objectively
detected.
Figure 4 shows that the perceived dissimilarity between
the performances recorded under two extreme conditions
(AE and CH) was relatively small. This is reasonable because both the dierence in tempo and extent of vibrato
between the performances (AE and CH) were also relatively small (see Figures 6 and 7).
With regard to the relationship between the change of
the music signals and room acoustic parameters, it was
found that the tempo roughly correlated to the values of
reverberation time: slower tempo in conditions of longer
reverberation, except for the condition AE. This relationship between tempo and reverberation time, including the
exception observed in AE, coincides with Meyers indication [16]. As for vibrato, no clear relationship between vibrato extent and the rooms acoustic parameters was noted.
5.2. Validity of the experimental method
Experimental conditions
Although there are some advantages for a eld experiment
in real halls as discussed in [3], there are some advantages
for this study in having a synthetic sound eld that enables
quick changes of room acoustic conditions. In the past,
the acoustic conditions created by the synthetic sound eld
were restricted because sound quality or delity was limited [3]. However, the sound eld simulation system used
in this study provided room acoustic conditions on a stage
by using the convolution technique in real time. From a
subjective aspect, musicians obtained real and natural impressions as if they were playing in a real, physical concert
hall environment [7]. Thus, we can claim that the experimental conditions provided a realistic situation.
A parametric investigation into acoustic factors that
have a dominant eect on the musicians performance remains to be done. This could be part of a future study
that utilizes parametrically synthesized room impulse responses. In addition, it should be noted that this study
did not provide any visual information of the room which
513
ACUSTICA
Table X. Comparison of results for VN1. 1 : ordered by the following comments; HS: faster, HM: normal, CH: slow; 2 : ordered by the
following comments; AE: deeper, CH: moderate, HL: modest, HS: as small as possible; 3 : The following number of listeners pointed
out the attribute and order for the dierence; >: 46, : 23; 4 : The dierences between pairs are signicant at the following level; :
1%, >: 5%, : no signicance.
Subjective report
Listening experiment3
Acoustic analysis4
(HS, AE) CH
HS > HL > (CH, AE)
AE > HL HS, AE CH
HM HS HL AE CH
HS HL HM AE CH
AE HM CH > HL HS
6. Conclusions
This study investigated the adjustment of performances to
room acoustics on the basis of a schematic model designed
514
to represent the feedback system of a performer in various physical room acoustic conditions. We employed a
high-delity sound eld simulation, explorative interviews
with performing musicians, and an objective evaluation of
the recorded music signal through a listening test and an
acoustic analysis so that we could systematically explore
the inuence of room acoustics on a musicians performance.
Based on the interviews with the musicians, it was inferred that they adjusted their performance to room acoustics, at least subjectively. It was also observed from the
listening experiment that there are perceivable dierences
between the performed music signals depending on the
acoustic conditions of the recordings. The attributes that
the listeners identied for the variations in the performed
music pieces were mostly in accordance with those identied in the players subjective report. Acoustic analysis for
the musical tempo, the extent of vibrato, and sound level
also demonstrated that the dierences in music performed
under various acoustic conditions were statistically significant.
In this study we have demonstrated the existence of
a circulative system of feedback between performer and
room acoustic conditions, which relates to an acquired
skill of the performing musician. Studying this interactive
model in the context of concert hall acoustics might contribute to a better understanding of the musicians requirements of concert hall acoustics. If we know more about
the adjustment that expert musicians need to make, this
could be useful for learners aiming to develop the skill
necessary to perform in concert halls. More detailed results of acoustic analysis and discussion on the dierences
between musicians have partly been reported [20, 21] and
will be presented in a future paper for further investigation.
Acknowledgement
The authors thank all the musicians who participated in
this study for their willing cooperation. Also, this work
was supported in part by the Sound Technology Promotion Foundation. The part of this work was presented at
the 19th International Congress on Acoustics (2007).
References
[1] M. Senju: Concert hall acoustics from a players standpoint.
J. Acoust. Soc. Am. 100 (1996) 2837.
[2] T. Tsutsumi: The relationship between music and the concert hall. J. Temporal Des. Arch. Environ. 6 (2006) 7881
(http://www.jtdweb.org/).
Vol. 96 (2010)
515