You are on page 1of 8

Sinusoidal plus Residual Synthesis

X. Serra

Index

Sinusoidal magnitude-only synthesis Sinusoidal magnitude and phase synthesis Oscillator banks Inverse-FFT synthesis Noise generation Filter structures Inverse-FFT noise synthesis Integration of sinusoidal and residual synthesis
X. Serra 2

Magnitude-only synthesis
original sound

magnitude-only synthesis
l l 1 ( m) = A l 1 + ( A A ) m A S

( m) = l 1 +
Rl

l l 1 ) ( m S
l r

( m) = (l 1) + r ( m) r r

s l ( m) =
X. Serra

(m ) cos[ (m )] A
l r r =1

Magnitude and phase synthesis


original sound x( n) synthesized sound with phase matching s (n)

r (t ) = r ( )d + r (0) + r
t 0

r (t ) : instantaneous radian frequency, r (0) : initial phase value, r : fixed phase offset.
X. Serra 4

Oscillator bank

X. Serra

(...oscillator bank)

Wave Table S/N ratio (dB) S/N ratio (dB) Length Truncation Rounding 32 64 128 256 512 1,024 2,048 4,096 8,192 16,384 32,768 19 25 31 37 43 49 55 61 67 73 79 25 31 37 43 49 55 61 67 73 79 85

S/N ratio (dB) Interpolation 48 60 72 84 96 108 120 132 144 156 168

X. Serra

Inverse-FFT synthesis

sine-wave

FFT with Blackman-Harris 92dB

magnitude spectrum

phase spectrum
X. Serra 7

(... inverse-FFT synthesis)

Magnitude transform of a Blackman-Harris 92 dB


X. Serra 8

(... inverse-FFT synthesis)


Ae j Ae j Ae j Ae j

- radians

0 area to be filled

radians

mid frequencies

Ae j

Ae j

Ae j

Ae j

- radians

0 area to be filled

radians

low frequencies
X. Serra 9

(...inverse-FFT synthesis)

Generate 9 samples of a Blackman-Harris92dB at the right frequency, amplitude and phase

Add spectral sines to FFT buffer (size 256). Compute IFFT. Apply synthesis window (divide by BlackmanHarris-92dB and multiply by Triangular window).

Overlap-add frames (hop-size 128).


X. Serra 10

Noise generation

Algorithms for random number generation

White noise, other types of noises Gaussian noise

X. Serra

11

Filter structures

direct form structure

lattice structure

X. Serra

12

IFFT synthesis
spectral magnitude approximation of residual random spectral phase

synthesized sound

synthesized sound with window


X. Serra 13

Integration with sinusoidal synthesis


magnitud frequency phase

convolution for each partial * + Blackman-Harris 92 dB * convolution for the whole spectrum IFFT synthesis window Synthesized sound

Residual spectrum
X. Serra 14

Spectral synthesis
sine frequencies sine magnitudes sine phases spectral sine generation magnitude spectrum polar to rectangular conversion spectral data (ex: reverberation)

phase spectrum

window generation synthesis window

complex spectrum

IFFT

sound

spectral data

spectral residual generation

magnitude spectrum polar to rectangular conversion

phase spectrum

X. Serra

15