DIP15 Mixed Pixels Sp14

Mixed Pixels
Endmembers
&
Spectral Unmixing
CEE 615: Digital Image Processing ©W.D. Philpot, Spring 2014 Mixed Pixel Analysis 1
Mixed Pixels and Spectral Unmixing
Spectral Mixtures
TYPES of MIXTURES
Areal Aggregate Intimate
• Areal Sand
• Aggregate Clay
• Intimate Pixel 1 Pixel 2 Pixel 3
50/50 mixtures of sand and clay
Linear mixing models (areal and aggregate)
Page 1
1
TYPES of MIXTURES
Areal mixture – where the various Areal Aggregate Intimate
materials are physically separated
into discrete areas within the
pixel. In this case the reflectance
properties of the materials are Pixel 1 Pixel 2 Pixel 3
independent of one another and 50/50 mixtures of sand and clay
will mix additively. Sand
Clay
Example: a pixel spanning the

boundary between a wooded area
and a plowed field.
Single pixel

Aggregate mixture – materials TYPES of MIXTURES
are intermixed, but are locally
aggregated.
Example: a pixel covering a Pixel 3

Pixel 1 Pixel 2
portion of a tennis court. The 50/50 mixtures of sand and clay
bound lines and the colored Sand
asphalt are physically separate Clay
and reflect nearly
independently of one another
even though the features are
much smaller than the size of
the pixel.
Single pixel
Page 2
2
Intimate mixture – materials are TYPES of MIXTURES
intermixed, on a scale small
enough that the reflectance of
the combined materials cannot
be assumed to be a linear Pixel 3
Pixel 1 Pixel 2
combination of the individual 50/50 mixtures of sand and clay
reflectances Sand
Clay
Example 1: a pixel covering an
area where sediments from two
distinct mineral sources are
mixing.
Single pixel

Intimate mixture TYPES of MIXTURES
Example 2: a pixel in an orchard

where the pixel is a mixture of
the reflectance of the Pixel 3
Pixel 1 Pixel 2
individual trees and the 50/50 mixtures of sand and clay
background grass & soil. Light Sand
reflecting from the understory Clay
is very likely to interact with
the tree canopy before being
detected. Similarly, light that
transmits through the canopy is
likely to interact with the
understory before being
detected. Single pixel
Page 3
3
Mixed Pixels and Spectral Unmixing (cont’d)
N
R   fi Ri
i 1
Where:
– R is the effective reflectance of the mixed pixel,
– Ri is the reflectance of the ith material (end member),
– fi is the spatial fraction covered by the ith material, and
– N is the number of materials in the pixel.
Since L = mR + b
(i.e., radiance is a linear function of Reflectance
N N N
L   f i Li  f i (mRi  b)  m fi Ri  b f i  mR  b
i 1 i 1 i 1
where Li is the radiance from a pure pixel of

material/end member i.
Page 4
4
If
we can claim to know the spectral reflectance or
radiance for the (pure) materials potentially in each
pixel (i.e., the end members)
And if
The materials can be considered to mix linearly
Then
we can write M simultaneous linear equations in N
unknowns (i.e., the fractions are the only unknowns).
Mixed pixel analysis
Page 5
5
Spectral Mixture Analysis
• Consider linear mixing of 3
end members in 2 bands.
• All combinations of these lie 2
along lines connecting the 3
end members in spectral
Band 2
space (no matter how many
bands).
• All combinations lie within 1
the area defined by the
Band 1
outermost pair-wise
combinations of end
members.
Spectral Mixture Analysis (cont’d)

A ternary diagram maps space to a linear combination of end
member fractions in a geometric representation with 100% of end
members at the extremes.
• Mixtures of 2 end members lie along the solid lines
• Mixtures of more than 2 in the interior.
2
A geometric mixture model with 4 2 @ 50%; 1 @ 25%; 3 @ 25%
end members would be a pyramid
with 3 sides and a base having end
members at each apex.
1 0.5 3
Page 6
6
SHADOW
In order to account for brightness variations due to solar
illumination effects and mixed pixels containing shadows, a
shadow end member may be introduced. The shadow end
member typically is assigned the spectral reflectance
expected from a dark shadow element. Ideally this would
be a zero reflectance point (a dark object).
In cases where shade fractions are needed, but not of
interest, the shade fraction can be redistributed to the other
fractions. i.e., Each fraction is increased according to
௙ೞ೓ೌ೏೐
݂௜ᇱ ൌ ݂௜ +
ேିଵ
• In general, to avoid over-fitting the end member model, a

smaller number of end members is preferred.
• Adding more end members to the model will always reduce

the residual error, but often amounts to trying to fit
information to the noise.
• Because it is difficult to isolate “pure” end members (i.e., true

extremes), it is often reasonable to allow fractions slightly
less than zero or greater than one. For this reason, the partially
constrained model is often most appropriate.
Page 7
7
E1
Band 2
requires
less than
End member concepts E3
0% of E2
E2
– End members are assumed to
be spectral extrema requires more
than 100% of E2
representing spectrally
idealized examples of a land Band 1
cover type.
– All combinations of end members must lie inside of a
convex hull made up of the end members.
– End member fractions may have values greater than 1
and less than zero.
Linked Models
Rather than try to unmix a complex image simultaneously with

many possible end members, it is often desirable to unmix on a
smaller number of end members in a localized region and then
link the solutions together.
We can use masks to avoid unmixing the same area more than
once.
Page 8
8
Residual Error
• Use error vectors as a means of analyzing fraction
maps
• The error vector for each pixel is the vector
comprised of the difference between the image
radiance (reflectance) vector and the vector predicted
by the fraction model.
  
e  L  EF
• Make a map of the magnitude of the errors as an
indication of locations where the model is inadequate
• Compare the spectral shape of the error to the
spectral features of interest.
Residual Error (cont’d)
• The Forested Wetland class is modeled as a combination of green leaf

reflectance and 56% shade.
• The difference between the measured and the modeled spectra is the residual
error.
Page 9
9
Residual Error (cont’d)
• If a target material is only represented by a small
number of pixels, it may be more effective to leave it
out of the end member analysis and just look closely
at the error vectors.
• An error may be spectrally localized to characteristic
features in the target material.
• What is an end member and what use are end
member maps.
– Fraction maps
– Associations as end members
– Combining fractions to form associations
– Class maps with transition classes
Truth Fraction Maps

Labels
Fractions
Page 10
10

DIP15 Mixed Pixels Sp14

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

DIP15 Mixed Pixels Sp14

Uploaded by

Copyright:

Available Formats

Mixed Pixels

Mixed Pixels and Spectral Unmixing

• Intimate Pixel 1 Pixel 2 Pixel 3

50/50 mixtures of sand and clay

Linear mixing models (areal and aggregate)

Example: a pixel spanning the

Mixed Pixels and Spectral Unmixing

Example: a pixel covering a Pixel 3

Mixed Pixels and Spectral Unmixing

Example 2: a pixel in an orchard

Mixed Pixels and Spectral Unmixing (cont’d)

where Li is the radiance from a pure pixel of

Mixed pixel analysis

Spectral Mixture Analysis (cont’d)

Mixed Pixels and Spectral Unmixing (cont’d)

• In general, to avoid over-fitting the end member model, a

• Adding more end members to the model will always reduce

• Because it is difficult to isolate “pure” end members (i.e., true

Rather than try to unmix a complex image simultaneously with

Residual Error (cont’d)

• The Forested Wetland class is modeled as a combination of green leaf

Truth Fraction Maps

You might also like