Overview

1. 2. 3. Key ideas for wavelets (5 min) Key ideas for 2nd generation wavelets Targeted problems: 1. wavelets on a surface, with irregular samples 2. noisy samples 3. how to ll a sparse region 4. cross section is not a closed curve issue

Key ideas for wavelets

1. 2. 3. 4. 5. Multiresolution analysis Scaling function and wavelet function analysis (wavelet transform) and synthesis (inv. wave. transform) What makes a good wavelet? Smoothness and vanishing moments natural approach for smoothing and estimation

Wavelets: multiresolution analysis

approximate function using linear combination of a simple scaling function. Scaling function is local in space and frequency

If the resolution isnt high enough, recruit miniature versions of the same function! (not exactly what happens in 2nd gen case)

Wavelets: multiresolution analysis

(bottom 3 guys are actually shifted over more)

If the resolution isnt high enough, recruit miniature versions of the same function! (not exactly what happens in 2nd gen case)

Wavelets: multiresolution analysis

Resolution 0

Resolution 1

Resolution 2

If the resolution isnt high enough, recruit miniature versions of the same function! (not exactly what happens in 2nd gen case)

Wavelets: multiresolution analysis

Resolution 0

Resolution 1 multiresolution analysis!

Resolution 2

If the resolution isnt high enough, recruit miniature versions of the same function! (not exactly what happens in 2nd gen case)

Wavelets: multiresolution analysis

Resolution 0 V0

Resolution 1 V1

Resolution 2 V2 the function space spanned by each set V_inf = L2(R)

Wavelets: scaling functions and wavelet functions

Why do we need these V0

When we have these? V1

Wavelets: scaling functions and wavelet functions

These are a little redundant V0 V1

Wavelets: scaling functions and wavelet functions

introduce wavelet functions that have SAME resolution, but are orthogonal to scaling functions. Combine them, and you go to the next highest resolution

V0

W0

V1

scaling functions

wavelet functions

NEXT resolution scaling functions

Wavelets: scaling functions and wavelet functions

Wavelets: scaling functions and wavelet functions

We saw: V0 + W0 = V1

Wavelets: scaling functions and wavelet functions

We saw: V0 + W0 = V1 W0 is orthogonal to V0. Whats orthogonal to V1? W1.

Wavelets: scaling functions and wavelet functions

We saw: V0 + W0 = V1 W0 is orthogonal to V0. Whats orthogonal to V1? W1. V1 + W1 = V2

Wavelets: scaling functions and wavelet functions

We saw: V0 + W0 = V1 W0 is orthogonal to V0. Whats orthogonal to V1? W1. V1 + W1 = V2 V0 + W0 + W1 = V2

Wavelets: scaling functions and wavelet functions

We saw: V0 + W0 = V1 W0 is orthogonal to V0. Whats orthogonal to V1? W1. V1 + W1 = V2 V0 + W0 + W1 = V2 V0 + W0 + W1 + W2 + ... W = V all functions!
inf inf

L2(R)

Wavelets: scaling functions and wavelet functions

We saw: V0 + W0 = V1 W0 is orthogonal to V0. Whats orthogonal to V1? W1. V1 + W1 = V2 V0 + W0 + W1 = V2 V0 + W0 + W1 + W2 + ... W = V all functions!
inf inf

L2(R)

Wavelets: analysis and synthesis

Wavelets: analysis and synthesis

Analysis (wavelet transform)

We have samples from f. How do we nd these alphas and betas? Two dramatically different ways:

classical signal detection way fast, recursive procedure

Wavelets: analysis and synthesis

Analysis (wavelet transform)

We have samples from f. How do we nd these alphas and betas? Two dramatically different ways:

classical signal detection way fast, recursive procedure

Synthesis (inverse)

We have alphas and betas, how do we get samples from f back? Well, the formula above shows an obvious way to do it, but we want FAST way

Wavelets: analysis and synthesis

Analysis (wavelet transform): We have f. How do we nd these alphas and betas? For each scaling/wavelet function, convolve it with your target function f. The result is your alpha/beta value.

Wavelets: analysis and synthesis

Analysis (wavelet transform): We have f. How do we nd these alphas and betas? Fast recursive procedure. (provides no intuitive connection to shape of scaling/wavelet function)

3 STEPS: SPLIT PREDICT UPDATE (this is also known as the lifting procedure)

Wavelets: smoothness and vanishing moments

Wavelets: smoothness and vanishing moments

wavelets need to be localized in space and frequency

Wavelets: smoothness and vanishing moments

wavelets need to be localized in space and frequency localized in space = compact support

Wavelets: smoothness and vanishing moments

wavelets need to be localized in space and frequency localized in space = compact support note how they all decay to their left and right

Wavelets: smoothness and vanishing moments

wavelets need to be localized in space and frequency localized in space = compact support note how they all decay to their left and right We want wavelets to decay in frequency too

Wavelets: smoothness and vanishing moments

wavelets need to be localized in space and frequency localized in space = compact support note how they all decay to their left and right We want wavelets to decay in frequency too smoothness = decay at high frequencies

Wavelets: smoothness and vanishing moments

wavelets need to be localized in space and frequency localized in space = compact support note how they all decay to their left and right We want wavelets to decay in frequency too smoothness = decay at high frequencies vanishing moments = decay at low frequencies (give explanation of this?)

Wavelets: smoothness and vanishing moments

wavelets need to be localized in space and frequency localized in space = compact support note how they all decay to their left and right We want wavelets to decay in frequency too smoothness = decay at high frequencies vanishing moments = decay at low frequencies (give explanation of this?) lifting scheme increases smoothness and vanishing moments

Wavelets: natural approach to smoothing

just throw away coefcients at higher levels of resolution! nonlinear thresholding procedure Adapting to Unknown Smoothness via Wavelet Shrinkage Donoho and Johnstone (1995) 2510 citations Adaptive Bayesian Wavelet Shrinkage Chipman, Kolaczyk, McCulloch (1997) 434 citations Wavelet Shrinkage for Nonequispaced Samples Cai and Brown (1998) 82 citations

Key ideas for 2nd generation wavelets

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
DIFFERENT

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions

2.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation:

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation: start with scaling function, nd a recursive procedure for wavelet transform

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation: start with scaling function, nd a recursive procedure for wavelet transform

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation: start with scaling function, nd a recursive procedure for wavelet transform 2nd generation:

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation: start with scaling function, nd a recursive procedure for wavelet transform 2nd generation: start with recursive procedure, no need to explicitly know scaling function

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation: start with scaling function, nd a recursive procedure for wavelet transform 2nd generation: start with recursive procedure, no need to explicitly know scaling function (however, you can still observe it using cascade algorithm)

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation: start with scaling function, nd a recursive procedure for wavelet transform 2nd generation: start with recursive procedure, no need to explicitly know scaling function (however, you can still observe it using cascade algorithm)

2. 3.

Key ideas for 2nd generation wavelets

SAME 1. We still have different levels of resolution 2. Wavelets can still be smooth, have vanishing moments, compact support 3. Wavelet transform is still a recursive procedure
1. DIFFERENT scaling functions and wavelets are not just rescaled or translated versions of each other wavelets are not strictly orthogonal to scaling functions We can handle irregular samples or wavelets dened on surfaces
1st generation: start with scaling function, nd a recursive procedure for wavelet transform 2nd generation: start with recursive procedure, no need to explicitly know scaling function (however, you can still observe it using cascade algorithm)

2. 3.

1. scaling functions and wavelets are not just rescaled or translated versions of each other

wavelets and scaling functions are purely dened by renement relations coarser scaling function is a linear combination of ner scaling function coarser wavelet is a linear combination of ner scaling function

Targeted problems
1. 2. 3. 4. wavelets on a surface, with irregular samples noisy samples how to ll a sparse region cross section is not a closed curve issue

Wavelets on a surface, with regular samples

R3

S2

Rx Ry

projection perform 3 spherical wavelet transforms

Rz

Wavelets on a surface, with regular samples

R3

S2

Rx Ry

enforce regular samples during projection process? perform 3 spherical wavelet transforms

Rz

Wavelets on a surface, with regular samples

Spherical wavelets: efciently representing functions on a sphere Schroder and Sweldens 556 citations

Wavelets on a surface, with irregular samples

Dont even project onto sphere. Work directly from point mesh that you have.
How to get the initial triangular mesh from irregular points? We need to respect topology

COARSIFY: Hoppes Progressive Mesh (PM) = edge collapses (downsampling), vertex splits (upsampling) each step in coarsication uses: Guskovs non-uniform subdivision scheme (minimize divided difference ~ gradient) COMPUTE WAVELET COEFFICIENTS: Burt Adelson pyramid Multiresolution Signal Processing for Meshes

Guskov, Sweldens, Schroder

How to ll a sparse region

Guskovs non-uniform subdivision scheme Use nearest, local points to insert a new point that minimizes bumpiness of surface

Bayesian wavelet references

Noise Removal via Bayesian wavelet coring (well cited)

Simoncelli, Adelson Chipman, Kolaczyk, McCulloch Abramovich, Amato, Angelini Brown, Fearn,Vannucci Ruggeri,Vidakovic Huerta classical wavelets only

Adaptive Bayesian Wavelet Shrinkage (well cited) On Optimality of Bayesian Wavelet Estimators Bayesian wavelet regression on curves with application to a spectroscopic calibration problem Bayesian Modeling in the Wavelet Domain (review) Bayesian wavelet shrinkage (review) Wavelets, Approximation and Statistical Applications (book)