Optimum Noise Filtering

Overview of Noise Filtering

Introduction: The goal of noise filtering is to extract the signal of interest from
random noise.
Important factors:
o Signal information
o Noise information
o Signal-to-noise (S/N) ratio
o Distortion
o Implementation
Signal information:
o Deterministic signalsThe signal of interest is known. The goal is to detect the
signal with the presence of noise. For examples: Radar or sonar echoes,
tracking device signals, and digital signals
o Random signalsOnly the statistical properties of the signal of interest are
known. The goal is to detect and/or estimate the signal with the presence of
noise. For examples: Radio signals, image data, and seismic signals.
Noise information:
o White noise The spectrum of white noise is constant. This assumption is
appropriate for many kinds of noise phenomena. White noise can be handled
easily but sometimes this assumption oversimplifies the problem.
o Band-limited white noise The spectrum of band-limited white noise is
constant within a specified frequency band and is zero outside the band.
Unlike a white noise process, a band-limited white noise process has finite
energy, a requirement that must be satisfied for any physical process.
o 1/f noise The spectrum of 1/f noise is proportional to 1/f

. As a result, the
1/f noise process mainly produces noise components at low frequencies.
o Other noise types Man-make noise, atmospheric disturbances, and

White noise
Low-pass white
noise

Band-pass white
noise

1/f noise
Signal-to-noise (S/N) ratio:
o Maximizing signal energy To maximize received signal energy we need to
increase the gain (decrease the loss) at the frequency bands where the signal
of interest is strong compare to noise.
o Minimizing noise energy To minimize received noise energy we need to
decrease the gain (increase the loss) at the frequency bands where the signal
of interest is weak compare to noise. For example, the gain should be 0 (loss =
) at frequencies where the signal energy is negligible.
o The gain should be zero (the loss should be infinite) outside the signal
frequency band.
Distortion:
o Maximum S/N ratio usually requires the system to have a non-uniform
frequency response.
o Non-uniform frequency responses introduce distortion because signal
components at different frequencies are amplified (attenuated) differently.
o A practical system has to consider the trade-offs between noise and distortion.
Implementation:
o A physical system cannot provide infinite energy an all-pass filter is
impossible to build.
o A physical system must be casual discontinuities in the response spectrum
cannot be realized.
o A physical system must be stable RHP poles are not allowed.
Matched Filters
Introduction: When the signal of interest is known and the goal is to detect its
presence, a matched filter is used to maximize the S/N ratio of the detection process.
Basic principles:
o Background noise is assumed to be white noise or band-limited white noise
with the noise bandwidth encompasses the entire signal spectrum.
o The signal of interest is deterministic.
o Background noise is assumed to be additive: Input = signal + noise

h(t)
n(t)
s(t)
y(t)
y
o
(t)
o If the frequency response of the filter matches the frequency spectrum of the
signal, the S/N ratio is maximized.
At frequencies where the signal is strong, the system gain should also
be high to enhance the difference between the signal and the noise.
At frequencies where the signal is weak, the system gain should also
be low to de-emphasize the noise energy at these frequencies.
At frequencies where the signal energy is negligible, the system gain
should be zero to filter out the out-of-band noise.
o Because of the non-uniform frequency response, the filter output is distorted.
o This technique is ideal for signal detection since in this case only the signal
energy (with respect to noise), not the actual shape, is.
o This technique is not useful if the shape of the signal waveform is unknown.
Mathematical details:
o From linear system theory the output is obtained from the convolution
integral:
) ( ) ( ) ( ) ( ) ( ) (
) ( ) ( ) ( ) ( ) (
t n t s d t n h d t s h
d t y h d y t h t y
o o
o
+ +

For a white noise input with unity magnitude the S/N ratio at t = T is:

1
]
1

1
]
1

1
]
1

d h
d T s d h
d h
d T s h
T n E
T s
N S
o
o
T
) (
) ( ) (
) (
) ( ) (
)] ( [
) (
) / (
2
2 2
2
2
2
2
2
Note: The inequality is the direct result of the Schwarz inequality. The
equality holds if the following is true:

d T s d h ) ( ) (
2 2
, which means:

d T s N S
T
) (
max
) / (
2
,
2
.
o In general, the following filter response can maximize the S/N ratio if the
autocorrelation function (or the auto-spectrum) of the input noise is known:
process. noise the of um autospectr the is ) ( and period, n observatio
the is constant, arbitary an is where
2
) (
) (
) (
f S
T
T f j
e
f S
f S
f H
nn
nn

1
]
1

o For white noise process, the impulse response of the matched filter is:
0 for ) ( ) ( t t T s t h

t
T 0
h(t) s(t)
Numerical examples:
o Rectangular pulses:
N
n
n
100 200
5
0
5
20 log N_F
n
n
1 10 100
20
0
20
S
n
n
100 200
5
0
5
20 log S_F
n
n
1 10 100
40
20
0
T
n
n
100 200
5
0
5
20 log T_F
n
n
1 10 100
20
0
h0
n
n
100 200
5
0
5
20 log H0
n
n
1 10 100
40
20
0
out
n
2
n 20
100 200
0
200
400
20 log out_F
n
n
1 10 100
0
20
40
Noise Noise Spectrum
Signal Signal Spectrum
S + N Spectrum
Frequency Response
Output Spectrum
Signal + Noise
Impulse Response
Output
o Saw-tooth pulses:
Shape
n
0 n W < ( ) n W 20 > ( ) if
n W
20
otherwise
N
n
n
100 200
5
0
5
20 log N_F
n
n
1 10 100
20
0
20
S
n
n
100 200
5
0
5
20 log S_F
n
n
1 10 100
40
20
0
T
n
S
n
N
n
T
n
n
100 200
5
0
5
20 log T_F
n
n
1 10 100
20
0
h
m n ,
0 n m < ( ) n m 20 > ( ) if
n m
20
otherwise
h0
n
h
900 1000 n ,
h0
n
n
100 200
5
0
5
20 log H0
n
n
1 10 100
40
20
0
out
n
2
n 20
100 200
0
50
100
20 log out_F
n
n
1 10 100
0
20
40
Noise
Noise Spectrum
Signal Signal Spectrum
S + N Spectrum
Frequency Response
Output Spectrum
Signal + Noise
Impulse Response
Output
Examples:
o White noise process:

'

otherwise 0
for
) (
2 1
) ( 2
) (
2 1
2
) (
2 1
1
) ( 0 for
0
T t
t T -
e
df
f j
t T f -j
e
t h
f j
T f -j
e
f H
f j
f S t
-t
e s(t)

o Realistic low-pass noise:

[ ]
) ( 2 cos
constant
4 1
) ( 2 ) ( 2
4 1
2
) (
) (
4 1
2
} { ) (
)] ( ) ( [ , 0 )] ( [
) ( ) (
2
} 2 cos { ) (
0 for ) (
) (
2 cos ) (
2 2 2 2
*
1
2 2
t T f
f
A t T f
e
t T f
e
f
A
T f j
e
f S
f S
F h
f
e F f S
e t n t n E t n E
f f f f
A
t f A F f S
T t t n
t s
t f A t y
C
C C
nn
nn
C C c
C

1
]
1

+

+

'

+
+ +
+

Radar echo detection:
Matched filter implementation
X

Matched filter

T
0
s(t)
y(t) y
o
(t)
Matched
filter
Detector
Display

+
T T T
o
d s y d T T s y d T h y t y
0 0 0
) ( ) ( ) ( ) ( ) ( ) ( ) (
Wiener Filters
Introduction: The matched filter technique requires the exact knowledge of the signal
and thus is used for detection only. If we need to reconstruct a signal with minimum
distortion and only the statistical properties of the signal is available, the Wiener filter
technique can be used for this purpose (signal estimation).
Basic principles:
o The filter that minimizes the mean-square error (minimum distortion) has the
following transfer function H( f ).
) ( ) (
) (
) (
) (
) (
f S f S
f S
f S
f S
f H
nn ss
ss
yy
ss
+

o It is called the Wiener filter. More information on optimum filtering can be
found in Cooper; Probabilistic Methods of Signal and System Analysis, 2
nd

edition, p. 402-411.
o The above transfer function can be implemented numerically for pre-recorded
data but is not physically realizable because it is non-casual. The following
steps convert the non-casual Wiener filter into a casual one.
1) Express S
yy
( f ) as a product of two factors:
) ( ) ( ) ( ) ( ) ( f A f A f S f S f S
yy yy nn ss yy
+
+
where
) ( f A
yy
+
has all of the LHP poles and zeros and
) ( f A
yy

has all
of the RHP poles and zeros. Split the poles and zeros on the j axis
evenly to both planes.
2) Use partial fraction expansion:
) ( ) (
) (
) (
f B f B
f A
f S
yy
ys +

+
where ) ( f B
+
has all of the LHP poles and zeros and ) ( f B

has all
of the RHP poles and zeros. Split the poles and zeros on the j axis
evenly to both planes.
Note: if n(t) and s(t) are uncorrelated,
( ) ( ) f S f S
ss ys

3) The transfer function of the casual Wiener filter is given by:

+
+
+
+
df e
f A
f B
t h
f A
f B
f H
t f j
yy yy
2
) (
) (
) (
) (
) (
) (
Example:
1)
0
) ( N S e t R
nn
t
ss


) (
4 1
2
} 2 { )} ( { ) (
2 2
f S
f
e F t R F f S
ys
t
ss ss

+

j
For a non-casual filter:
( )
( ) ( ) [ ]

yy yy yy
nn ss
ss
S
f N
S
N f
f
S
f S f S
f S
f H
2
0 0
2 2
2 2
) 2 ( 1 2 1
1
4 1 2
4 1 2
) ( ) (
) (
) (

+ +

+ +
+

Step 1:
( ) [ ]
( ) ( ) ( ) ( )
( ) ( ) ( ) ( )
f j
f j N N N
f A
f j
f j N N N
f A
f j f j
f j N N f j N N N
f
f N N N
N
f
f S f S S
yy yy
nn ss yy

2 1
2 2
) ( ,
2 1
2 2
) (
) 2 1 )( 2 1 (
2 2 2 2
) 2 ( 1
) 2 ( 2
4 1
2
) ( ) (
0 0 0 0 0 0
0 0 0 0 0
2
2
0 0 0
0 2 2

+
+ +

+
+ + +

+
+ +
+
+
+
+
Step 2:
( )
( ) ( ) ( )
[ ]
( ) ( ) ( )
( ) ( ) ( )
( ) ( )
( )
( )
( ) ( ) ( )
( ) ( )
( )
( ) ( ) ( ) ( )
( ) f j N N
N N N
f B
f j
N N N
f B
f j N N f j
N N N
f j N N f j N N N f A
f S
K
N N f j
K
N N f j N N
K
f j N N
K
f j
K
N f j f j N N N
f j f j N N N
f j f j
f j f j N N N
f
f A
f S
f A
f S
yy
ys
N N f j
f j
yy
ss
yy
ys

2 2
1 2
) ( ,
2 1
1 2
) (
2 2
1
2 1
1
1 2
2 2
1
2 1
1
2 1
2
) (
) (
2 1
1
2 1
1
,
1 2
1
2 2
1
2 2 2 1
2
) 2 1 ( 2 2
2
2 1 2 2
) 2 1 )( 2 1 ( 2
2 1 2 2
4 1 2
) (
) (
) (
) (
0 0
0 0 0 0 0 0
0 0
0 0 0
0 0 0 0 0
1
0 0 2 2
2
0 0
1 2
0 0
1
0 0
2 1
0 0 0 0
0 0 0
0 0 0
2 2
0 0
+
+

+
+

,
_

+
+
+
+

,
_

+
+
+ + +

+ +

+ +

,
_

+
+
+

+ +

+
+

+
+

+

+


Step 3:
( ) ( ) ( )
( ) ( ) ( )
( )
( )
[ ] ( ) ( ) ( ) ( ) [ ] ) ( 2 exp 1 2 ) ( ) ( ) (
2 2
1 2
2 1 2 2
2 1 1 2
) (
) (
) (
0 0 0 0
2
0
0 0
0 0
0 0 0
0 0 0
0
t u t N N N N df e f A f B t h
f j N N
N N
f j f j N N N
f j N N N
f A
f B
f H
t f j
yy
yy
+ +
+ +
+

+ + +
+ +

+ +
+
+

Appendix: Noise Suppression (Paul Packebush; How to keep instruments accurate inside
hot, noisy PCs; EDN, 4-13, 2000, p. 189)
Introduction:
o PCs are less expensive and more powerful now.
o They are being used in more and more measurement and control systems.
o Often, the instruments are actually inside the PC.
o Within a PCs hot, noisy environment accurate measurements of low voltage
and high-frequency signals are difficult to make.
o Both data-acquisition cards as well as digital components present problems.
o Instrumentation designers usually have no control components, chassis,
power supplies, and other plug-in peripherals create an unpredictable
environment.
Identifying the major sources of troubles:
o Temperature variation: 5 to 15C higher than the ambient temperature.
Power supply dissipation
Reduced airflow
Hot CPU & Peripherals
o EM fields: EM emission from other devices
Radiated EMI: Propagated through space
Conducted EMI: Conducted through ground or power buses
Video systems and power supplies are the worst.
Video systems: Video cards, cables, and monitors.
Monitors: Radiated EMI from the fly-back dc/dc converters presents
both high- and low-frequency interferenceHorizontal scan (15.74
KHz to 80 KHz) and vertical scan (40 to 80 Hz).
o Power buses management (ground): Small radiated EMI but large conducted
EMISwitching noise to the power buses/ground.
Power bus management: The supply voltages in a PC are often too unstable for
sensitive measurements.
o High-frequency noise from other parts
o Line voltage fluctuations
o Power supply architecture
High voltages for analog functions (t 15V)
Low voltages for digital subsystems (t 5V)
dc/dc boost converter (5V to t 20V)
Linear regulator (t 20V to both analog and digital voltages)
o Recommendations:
Linear regulators remove low-frequency noise.
Since boost converters usually operate in the 100 KHz range, a simple
LPF between the converter and the linear regulator can remove high-
frequency noise from the power supply.
Power supply decoupling:
o Bulk capacitor: Large value tantalum devices.
o Parallel capacitor: A tantalum capacitor has an equivalent series resistance
(ESR) of 0.5 to 1 at high frequencies a ceramic capacitor, because of its
negligibly low ESR, connected in parallel often provides better decoupling.
o Local capacitor: It provides a low-impedance path to ground for power line ac
noise. A local capacitor should be as close as possible to the ICs power-input
pin in order to minimize the coupling area between it and the IC pin.
o A typical bypass circuit:
Digital/analog interface:
o When digital-control signals are passed to analog components, switching
noise from the digital circuit supply can be spread to the analog circuits.
o Although digital circuits are often immune from the switching noise, analog
circuits can be adversely affected by it.
o Buffering the digital-control signal: A clean (heavily filtered) 5V rail is used
exclusively to power the buffers.
Grounding:
o Poorly designed grounding schemes: Ground loops and series injection
o Good grounding structures:
Separate ground planes for the voltage source
Single-point connections among the planes.
o If this is not possible:
No more than one connection between the analog and the digital areas.
No more than one connection between the boost converter and the
digital areas.
o More grounding tips:
The best place to join the analog and the digital ground planes is at the
A/D converter since it is where the measured analog data are
converted to digital signals.
Place the power supplies within the ground planes of the circuits they
power to confine the returning currents.
Interference: Potential difference between ground planes
o A small inductor between ground plane helps.
o The bulk capacitor discussed above forms an LC LPF with Q = (1/R) (L/C)
1/2

For flat response, Q < 0.707
For a 100 F with ESR = 0.5 , L = 12.5 H.
Wire size (current requirement)
Analog Digital
Boost
Converter
In high-frequency (high-speed) lines signal return through the least
inductive path (least loop area), which is usually the path directly
under the signal trace.
Do not disturb the return flow or the return current may travel in an
unexpected path and causes ground loop noise.
EMI shielding:
o EMI in PCs (monitors, video cards, other plug-in peripherals) in the form of
magnetic fields is usually beyond our control.
o Shielding: Cost usually prohibits shielding the entire instrument.
o Shielding materials used must work at both high and low frequencies.
o Shielding effectiveness: reflective capability (conductivity) and absorption
capability (permeability).
o Steel and nickel both make good shields.
Shielding effectiveness:
o Absorption loss
R R
f t A 34 . 3 where t is the thickness of the shield, f
is the frequency,
R
is the relative conductivity, and
R
is the relative
permeability. For examples, A = 100, 100, and 1000 db for a 0.76 mm thick
steel shield at 100, 10K, and 1 MHz, respectively.
o To avoid current loops a good shield must provide a current path and should
be grounded at only one point.
o Because a ground is mainly needed for the protection of sensitive analog
systems, it should be grounded to the digital ground plane.
o Ideally, PCB should have shields on both sides.
o A single shield on the circuit side and ground planes on or within the PCB are
usually enough.
Proper circuit layout: Shielding is a quick and easy way to reduce EMI. However,
there is no substitute for proper circuit layout.
o Eliminate/minimize large current loop
o Place components as close together as possible
o Avoid long leads
o Use ground planes
Temperature:
o 5 to 15 C hotter inside
o Reduced air flow
o Temperature gradient (change of T)
o On-board reference for calibration