Earth Science Systems, LLC

Blind Source Separation

for Passive Imaging
(part II)

Chuck Oden
Colorado School of Mines
Department of Geophysics
CWP Seminar III
Spring 2008
 Shallow Passive Imaging
• Passive seismic/radar
– Lossy media (no coda waves)
– Classical coda interferometry doesn’t work
– Few sensors (F-K filters impractical)
• Blind Source Separation (BSS)
– Virtual source method works (I think) if we
only have one source
 Classical Interferometry
RX1

Spurious RX2

correlation
events only
cancel with
equi-
partitioned
energy
Single Source – Virtual Source
RX1

RX2

One source
gives one
event per
reflector
(single
scattering)
 Independent Random Sources
0.6

0.4

0.2

31 Hz 0

0.2

1 Hz 0.4

0.6

0.8
1 .10 1.2 .10 1.4 .10 1.6 .10 1.8 .10 2 .10 2.2 .10 2.4 .10 2.6 .10 2.8 .10 3 .10 3.2 .10 3.4 .10
4 4 4 4 4 4 4 4 4 4 4 4 4
0 2000 4000 6000 8000

0.6

0.4

15 Hz
0.2

0.5 Hz
0

0.2

32 k
0.4
Samps 0 2000 4000 6000 8000 1 .10
4
1.2 .10
4
1.4 .10
4
1.6 .10
4
1.8 .10
4
2 .10
4
2.2 .10
4
2.4 .10
4
2.6 .10
4
2.8 .10
4
3 .10
4
3.2 .10
4
3.4 .10
4

at 4 ms
 2D Model
• Source gathers
• Travel times from path length (susynlv)
• Amplitudes from 1/r2
• Constant velocity
• Direct wave ignored
 Impulse Response

Time Sample Source 2

Number
(4 ms sample Source 1
rate)

Receiver
 Common Source Gathers

x10
 Common Source Gathers

x10
 Blind Source Separation
N L
xm (t ) = ∑∑ an ,m sn (t − l∆t )
n =1 l

X(ω ) = A(ω ) ⋅ S(ω )

Y(ω ) = W (ω ) ⋅ X(ω )

• Y = S (with some scaling and permutation)

• A = W-1 (with some scaling and permutation)
• Convolutive rather than instantaneous mixture
 ICA Method of Murata et al., 2001
• Convolutive mixture
• Solves frequency domain permutation
• Paper
– De-correlation + auto-covariance
– Batch processing
• Code
– De-correlation + non-stationary variance
– Online algorithm
– Undocumented processing parameters
Finding W: Non-stationary Sources
0.3

0.2

0.1

0.1

0.2

0.3
1 .10 1.2 .10 1.4 .10 1.6 .10 1.8 .10 2 .10 2.2 .10 2.4 .10 2.6 .10 2.8 .10 3 .10 3.2 .10 3.4 .10
4 4 4 4 4 4 4 4 4 4 4 4 4
0 2000 4000 6000 8000

http://www.umanitoba.ca/faculties/arts/linguistics/russell/138/sec4/specgram.htm

Spectrogram
Finding W: Non-stationary Sources
• Sources
– Stationary over short periods
– Non-stationary over long periods
– Example: AM modulation
• Only requires second order statistics
• De-correlate at all times: intersection of
solution sets
W∈C n×n
Independent Components
 Independent Random Sources
0.6

0.4

0.2

31 Hz 0

0.2

1 Hz 0.4

0.6

0.8
1 .10 1.2 .10 1.4 .10 1.6 .10 1.8 .10 2 .10 2.2 .10 2.4 .10 2.6 .10 2.8 .10 3 .10 3.2 .10 3.4 .10
4 4 4 4 4 4 4 4 4 4 4 4 4
0 2000 4000 6000 8000

0.6

0.4

15 Hz
0.2

0.5 Hz
0

0.2

32 k
0.4
Samps 0 2000 4000 6000 8000 1 .10
4
1.2 .10
4
1.4 .10
4
1.6 .10
4
1.8 .10
4
2 .10
4
2.2 .10
4
2.4 .10
4
2.6 .10
4
2.8 .10
4
3 .10
4
3.2 .10
4
3.4 .10
4

at 4 ms
XCorr of ICs and Sources
Correlated Sections
Impulse Response
Impulse Response
 Impulse Response

Time Sample Source 2

Number
(20 µs Source 1
sample rate)

Receiver
Caveats, Notes, and Observations
• Training data were already fairly well separated
• Objective functions and processing algorithms
can have a lot of knobs to adjust
• Different process parameters improved S/N of
one IC, and decreased S/N on other
• Desire full rank, well conditioned mixing matrix
• S/N ratio of 20 or 30 dB typical for ICs
• Source separation may only be effective when
the mixed source amplitudes are similar
Caveats, Notes, and Observations
• Expect better performance because there
is more than enough information to solve
• Need to write ICA code to draw concrete
conclusions
 Key Points
• An ICA decomposition method can be
tailored for many types of data
• The virtual source method may work well
with a passive wave field from a single
source in lossy media
• ICA is beginning to mature
• Many research opportunities
Adapted from Murata et al., 2001
 ICA
• Can be used with multidimensional data
sets
– Source location
– Receiver location
– Polarization
– Time/Frequency
– Mode (P, S, etc.)
 Separable Sources
• Physical sources
• Passive emissions
• Ambient noise
• ???Exploding reflectors??? (common source,
random reflector position)

• These are almost always independent

• They are often uncorrelated/incoherent in time
and space
• May be correlated in frequency and polarization
Tailor for Source Characteristics
• Impulsive sources (teleseismic,
microseismic, construction, etc.)
• Wide band sources (ambient seismic
noise, ocean waves, wind, cars, trucks,
trains, etc.)
• Narrow band sources (radio broadcasts)

• Sources must have sufficient duration or

repetition to characterize statistically
Incorporating Additional Information
• Inverse formulation allows additional
constraints
– Plane or parabolic arrivals
– Geometry
– Seismic scene analysis (statistics about
sources and mixing process)
– Sparseness in time/frequency
 Scatter Plot
0.3

0.2

0.1
Channel 2

0.0

-0.1

-0.2

-0.3

-0.3 -0.2 -0.1 0.0 0.1 0.2 0.3

Channel 1
 Final Step: Imaging
• Results are source selection filters in time,
space, frequency, and polarization
• Use space/time source selection filters
together with known sensor locations to
map source in image space
 Super-Resolution Imaging
• MUSIC (Multiple Signal Classification)
• Image using null space, or portion of
eigen-spectrum that is not focused on
scatterer
• Decompose the measured scattering
matrix (the data collected by the array)
• Perform an eigen value decomposition
• Separate signal space from null space
• Image using null space
• Yongxia
• Acoustic wave propagation in 6-type statistic medium
• While seismic wave velocity show large-scale deterministic
geological structures in the earth, the ubiquitous micro-fractures
often cause small-scale random variations. Although the earth which
seismic waves travel through act as a low pass filter and smooth out
some such small indterministic components, those statistic features
exist in the subsurface. Six types of statistic media are frequently
used in seismology such as Gaussian, Exponential, self-similar,
white noise, Flicker noise and Brown noise. I compare different
statistic models with seismic recordings with finite-difference
methods. The results show that various statistical models in
amplitude, energy and frequency will cause different synthetic
seismograms.