Auditory Models - Part 2

Space Perception
Up to now: stationary sound sources on a horizontal plane
interaural time differences (ITD)
interaural level differences (ILD)
Further considerations
non-stationary sounds, e.g. onsets
higher levels of perception later
time-intensity trading (ITD ILD)
elevation
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.1
Time-Intensity Trading
Subjective investigations of sensitivity
with low frequency tones
time image 1s/dB
intensity image 20s/dB
with clicks
time image 2 . . . 32s/dB
intensity image 80 . . . 150s/dB
sound samples:
https://mustelid.physiol.ox.ac.uk/drupal/?q=topics/time-intensity-trading
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.2
Angles
median plane
frontal plane
horizontal plane
back
front
elevation
azimuth
d
i
s
t
a
n
c
e
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.3
ILD
azimuth
e
l
e
v
a
t
i
o
n
interaural level difference at 700Hz interaural level difference at 11kHz
dB dB
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.4
ITD
azimuth
ms
interaural time difference
e
l
e
v
a
t
i
o
n
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.5
Cone of Confusion
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.6
Space Perception
Other factors inuencing direction dependency
frequency dependency of diffraction
pinna shape
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.7
Inuence of the Pinna
Multiple reections with different delays
direction dependent impulse response / transfer function
dB
pinna gain measured on the median plane
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.8
HRIR and HRTF
More general:
head related impulse responses (HRIR)
head related transfer functions (HRTF)
If distance is not too small
distance attenuation
HRIR and HRTF shapes depend on azimuth and elevation
angles
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.9
Models for Recording
Dummy head
good average pinna shape required
varying levels of detail
In-ear microphone (original head)
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.10
Models for Reproduction
Types of HRIRs / HRTFs
averaged
dummy head
individually measured
Playback via headphones / earphones
advantage: easy feeding to the ears
disadvantage: space rotates with the head
head tracker helps
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.11
Models for Reproduction
Playback via loudspeakers / loudspeaker arrays
advantage: spatial setup is xed
disadvantage: cross talk cancellation necessary
depends on head position
head tracker helps
Wave eld synthesis
advantage: multiple listeners,
no headphones
disadvantage: many loudspeakers required
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.12
HRIR / HRTF measurement
Example from IRCAM (www.ircam.fr)
control of azimuth and elevation
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.13
HRIR / HRTF measurement
anechoic chamber, chair on turntable
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.14
HRIR / HRTF measurement
microphone mounting
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.15
HRIR / HRTF measurement
Measurement signals
impulses
advantage: direct measurement of impulse responses
disadvantage: low signal to noise ratio
white noise / pseudo random signal
advantage: impulse response can be obtained from cross-correlation
disadvantage: nonlinearities lead to cross-products
sweep
advantage: no cross-products
disadvantage: more processing required
Example: 8192 points logarithmic sweep
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.16
HRIR / HRTF measurement
Post-processing
diffuse eld equalization for playback via headphones
windowing
Results:
raw HRIR
compensated HRIR
raw HRTF
compensated HRTF
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.17
HRIR / HRTF measurement
Sample HRIRs from IRCAM
elevation azimuth
0 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
60 -90 -60 -30 0 30 60 90
75 -60 0 60
90 0
-45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.18
HRIR / HRTF measurement
Sample HRTFs from IRCAM
elevation azimuth
0 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
60 -90 -60 -30 0 30 60 90
75 -60 0 60
90 0
-45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.19
HRIR / HRTF measurement
Group delays of HRIRs from IRCAM
elevation azimuth
0 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
60 -90 -60 -30 0 30 60 90
75 -60 0 60
90 0
-45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.20
HRIR / HRTF measurement
Group delay differences in HRIRs from IRCAM
elevation azimuth
0 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
60 -90 -60 -30 0 30 60 90
75 -60 0 60
90 0
-45 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-30 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
-15 -90 -75 -60 -45 -30 -15 0 15 30 45 60 75 90
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.21
HRIR / HRTF application
Interpolation
use functions from nearest angle pairs
direct interpolation (linear combination) of HRIRs or HRTFs
is not useful!
more complex interpolation schemes required, e.g.
convert FIR to low order IIR lter
assign matching poles and zeroes
interpolate positions of poles and zeroes
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.22
Examples / Experiments
Time-intensity trading:
https://mustelid.physiol.ox.ac.uk/drupal/?q=topics/time-intensity-trading
Demo sounds from IRCAM:
http://recherche.ircam.fr/equipes/salles/listen/sounds.html
Sample dummy head recordings from IRT (STAX
Raumklang-CD)
part 1 part 2 part 3
Recording with in-ear microphone (Soundman OKM II)
AudioLabs
Bernd Edler, Auditory Models - SS 2014 - Page 2.23