Explore Ebooks
Categories
Explore Audiobooks
Categories
Explore Magazines
Categories
Explore Documents
Categories
Medical Imaging
Spring 2007
Instructor
Dr. May Wang
Point of Contact
Todd Stokes
Project Report
Stephen David
Conover McCann
Overview
Problem
Solution
Methodology
Implementation
Results
What is PillCam?
Wireless Capsule
Endoscopy (WCE)
Non-invasive
Low Complication Rate
Out Patient
Potentially End-to-End
Good diagnosis and
first look
http://www.nch.org/about/tech.shtml
Problem
Diagnosis Takes a Long Time
Where are we? What are we looking at?
Hours required to review video
3D Modeling
Ranking
Methodology
Symmetry
Finding the “Center” of the Image
Rotational Symmetry
Adapted from Johansson et. al, “Detecting
Rotational Symmetries using
Normalized Convolution.”
Only looking for standard circular rotational
symmetry (no other basis functions).
Johansson, Bjorn; Knutsson, Hans; Granlund, Gosta. “Detecting Rotational Symmetries using Normalized
Convolution.” International Conference on Pattern Recognition (ICPR), vol 3: p. 3500.
Rotational Symmetry
Transform image
intensities into axial
and radial
components.
Try to find a center
point that minimizes
variance in one
transform and
maximizes it in the
other.
Nominal Results
Methodology
Curvature
Extracting the Shape of the Image
Curvature Overview
A B C D
Process
1. Threshold
2. Extract Curvature
3. Histogram
4. Compare
Thresholding
Global average of intensity
Simple but effective
Sample results:
1
I ij = ( R + G + B )
3
T = Avg ( I ij )
Curvature Extraction
Curvature Equations (Osher and Sethien)
NormGrad = ∇ X φ 2 + ∇Y φ 2
1 where normGrad > 0.75 * max(normGrad )
wij =
0 elsewhere
2 2
∇ Xφ ∇Y φ
kappa = wij ∇X + ∇Y
NormGrad NormGrad
1
C =
kappa
50
100
150
200
250
50 100 150 200 250
Base Test Case
Curvature Histogram
100
90
50 150
50
80
100 100 70
100
Count
60
150 150
50
50
200 200 40
30
250
250
50 100 150 200 250 0
50 100 150 200 250 0 50 100 150 200
Curvature
Bad
Better
Masked
Best
Dilated
& Masked
Histogram
2D Curvature Reduced 1D Array
Reduced to 100 bin histogram
Count is divided by # pixels for scaling
Curvature Histogram
150
100
Count
50
0
0 50 100 150 200
Curvature
Comparison
Sum of the squares difference in
histogramed values 0:10:1000:
N
Comparison Score = ∑ ( Bin A [n] − BinB [n])
2
n =1
Score - Min(Score)
Comparison Score Normalized =
Max( Score ) − Min( Score)
Methodology
Color
Overview
HSI Histogram
Sum Power Compare
Methodology # Metrics
3D Modeling
Overview
3D OBJ Model interpolated from MRI slices
Basic lighting and flat color texturing
Smoothed Surface Normals
The surface normal at
a given vertex is the
average of the
surface normals of the
polygons meeting at
the vertex.
Methodology
Summary
Final Rationale: How does all this work together?
Implementation
Implementation Overview
Completely Java
OpenGL and JOGL
30 files
3,000 SLOC
Class Diagram - Model
Modules
Single Color
Sum of
Normalize
Image Load
Squares
Curvature Present
Score All
Results
3D Model
Navigation Symmetry Distance
Tracks
Rendering
1 2
3 4
Results II: Search for Image from Independent Frame
1 2
3 4
Results III: Search for Image from 3D Model
1 2
3 4
5
Results IV: Bad Results
1 2
3 4
Summary
Metrics perform well
Need deformable model
Review time is improved
Questions?