neural net with eigen images

© All Rights Reserved

21 views

neural net with eigen images

© All Rights Reserved

- REAL_TIME_FACE_RECOGNITION_SYSTEM_USING_2_article.pdf
- catpca
- v22-25
- pca-mds
- ddagarc.pdf
- A Music Visual Interface via Emotion Detection Supervisor
- CISP2008Manuscript
- eecon03
- Pca Basic Ideas
- Determination of Multipath Security Using Efficient Pattern Matching
- paper2
- A DCT Based Local Feature Extraction Algorithm for Palm Print Recognition
- Electronic Nose for Black Tea Quality Evaluation Using Kernel Based Clustering Approach
- 9231_s07_qp_1
- Jigsaw Solver
- Bucchi et al 2014 editado.docx
- Mathematics (Introduction to Linear Algebra)
- Moi G., Houghton P.J.
- Bazzucchi Campolmi Zatti
- De RealEigenvalues

You are on page 1of 29

n Unitary transforms

n Karhunen-Love transform and eigenimages

n Sirovich and Kirby method

n Eigenfaces for gender recognition

n Fisher linear discrimant analysis

n Fisherimages and varying illumination

n Fisherfaces vs. eigenfaces

Unitary transforms

!

n Sort pixels f [x,y] of an image into column vector f of length N

n Calculate N transform coefficients

c = Af

where A is a matrix of size NxN

n The transform A is unitary, iff

A 1 = *T

A

A

H

Hermitian conjugate

Energy conservation with unitary transforms

n For any unitary transform c = Af we obtain

2 H H H 2

c = c c = f A Af = f

coordinate system (and, possibly, sign flips)

n Vector length is conserved.

n Energy (mean squared vector length) is conserved.

Energy distribution for unitary transforms

n Energy is conserved, but, in general, unevenly distributed among coefficients.

n Autocorrelation matrix

H H H

Rcc = E cc = E Af f A = AR ff A H

i,i

Eigenmatrix of the autocorrelation matrix

Definition: eigenmatrix of autocorrelation matrix Rff

l is unitary

l The columns of form a set of eigenvectors of Rff, i.e.,

$ 0 '

0

& )

& 1 )

=& )

& ! )

&% 0 N 1 )(

Karhunen-Love transform

n Unitary transform with matrix

A= H

Rcc = AR ff A = R ff = =

H H H

n Energy concentration property:

l No other unitary transform packs as much energy into the first J coefficients.

l Mean squared approximation error by keeping only first J coefficients is minimized.

l Holds for any J.

Illustration of energy concentration

f2 cos sin c2

A=

sin cos

After KLT:

Strongly correlated

uncorrelated samples,

samples,

equal energies f1 c1 most of the energy in

first coefficient

Basis images and eigenimages

n For any transform, the inverse transform

! 1 !

f =A c

can be interpreted in terms of the superposition of columns of A-1 (basis images)

n For the KL transform, the basis images are the eigenvectors of the

autocorrelation matrix Rff and are called eigenimages.

n If energy concentration works well, only a limited number of eigenimages is

needed to approximate a set of images with small error. These eigenimages

span an optimal linear subspace of dimensionality J.

Eigenimages for recognition

n To recognize complex patterns (e.g., faces), large portions of an image have to

be considered

n High dimensionality of image space means high computational burden for

many recognition techniques

Example: nearest-neigbor search requires pairwise comparison with every image in a database

n Transform c = Wf

can reduce dimensionality from N to J by representing the

image by J coefficients

n Idea: tailor a KLT to a specific set of training images

representative of the recognition task

to preserve the salient features

Eigenimages for recognition

f c

W

f

+

f -

Rejection

Normalization Projection Similarity

1

New Face measure

!T !

Image (e.g., c pk* )

f

p1

Class of most k*

similar pk

!

pK Recognition

Mean Face Result

Database of Similarity

Eigenface Matching

Coefficients

Computing eigenimages from a training set

n How to obtain NxN covariance matrix?

! ! !

,

l Use training set 1 2 ,, L+1

(each column vector represents one image)

l Let be the mean image of all L+1 training images

! "! ! "! ! "! ! "!

1 2 (

l Define training set matrix S = , , ,, ,

3 L )

L ! "! ! "! H

and calculate scatter matrix R =

l=1

( )(

l l ) = SS H

If L < N, scatter matrix R is rank-deficient

Problem 2: Finding eigenvectors of an NxN matrix.

from a small training set L << N ?

Sirovich and Kirby algorithm

n Instead of eigenvectors of SS H , consider the eigenvectors of S H S, i.e.,

H

S Svi = i vi

n Premultiply both sides by S

! !

=

SS H Svi = i Svi

n By inspection, we find that Svi are eigenvectors of SS H

l Compute the LxL matrix SHS

l Compute L eigenvectors vi of SHS

l Compute eigenimages corresponding to the L0 L largest eigenvalues

as a linear combination of training images Svi

L. Sirovich and M. Kirby, "Low-dimensional procedure for the characterization of human faces,"

Journal of the Optical Society of America A, 4(3), pp. 519-524, 1987.

Example: eigenfaces

n The first 8 eigenfaces obtained from a training set of 100 male and 100 female

training images

Mean Face

n Can be used for face recognition by nearest-neighbor search in 8-d face space.

Gender recognition using eigenfaces

Nearest neighbor search face space

Fisher linear discriminant analysis

n Eigenimage method maximizes scatter within the linear subspace over the

entire image set regardless of classification task

W

( ( ))

n Fisher linear discriminant analysis (1936): maximize between-class scatter, while

minimizing within-class scatter

!"

! !" !"! !"

( )( )

c H

RB = N i i i

( )

i=1

det WR W H

B

Wopt = arg max

( )

Samples

Mean in class i

W det WRW W H in class i

( )( )

c H

RW = l i l i

i=1 Class(i)

l

Fisher linear discriminant analysis (cont.)

!"

!

n Solution: Generalized eigenvectors wi corresponding to the

J largest eigenvalues {i | i = 1,2,..., J }, i.e.

!"

! !"

!

RB wi = i RW wi , i = 1,2,..., J

!"

! !"

!

n solve eigen-problem on this: R 1

W (

RB wi = i wi , i = 1,2,..., J )

n Problem: within-class scatter matrix Rw at most of rank L-1 (for L images total

in all classes combined), hence usually singular.

n Apply KLT first to reduce dimensionality of feature space to L-1 (or less),

proceed with Fisher LDA in lower-dimensional space

Eigenimages vs. Fisherimages

2-d example: f2

a 1-d subspace, then perform

classification.

f1

Eigenimages vs. Fisherimages

2-d example: f2 KLT

a 1-d subspace, then perform

classification.

maximum energy, but

f1

the 2 classes are no

longer distinguishable.

Eigenimages vs. Fisherimages

2-d example: f2 KLT

a 1-d subspace, then perform

classification.

maximum energy, but

f1

the 2 classes are no

longer distinguishable.

Fisher LDA separates the

classes by choosing

a better 1-d subspace.

Fisher LDA

Fisherimages and varying iIllumination

Differences due to varying illumination can be

much larger than differences among faces!

Fisherimages and varying iIllumination

n All images of same Lambertian surface with different

illumination (without shadows) lie in a 3d linear subspace

n Single point source at infinity Light source

intensity

surface !

normal n ! !T !

l

light source

( )

f ( x, y ) = a ( x, y ) l n ( x, y ) L

direction

Surface

albedo

still in same 3d linear subspace, due to linear superposition

of each contribution to image

n Fisherimages can eliminate within-class scatter

Side Note: Photometric Stereo!

observed normalized

intensity! lighting direction!

N

L I = L N

albedo! normalized

(constant)! surface normal!

[Woodham 1980]!

Side Note: Photometric Stereo!

N Nx

L

I = Lx Ly Lz N y

N

z

[Woodham 1980]!

Side Note: Photometric Stereo!

L( 2 ) L(1) N

N

I (1) L (1)

L(1)

L(1) L ( 3) x y z

x

(2) L(2) Ny

I = L(2) L(2)

x y z

I (3)

Lx

(3)

L (3)

L(3)

N z

y z

=! I =! L

1

assume albedo is constant, invert matrix! N=L I [Woodham 1980]!

input! Side Note: Photometric Stereo!

[Woodham 1980]!

Fisherface trained to recognize gender

! ! !

1 2

Female face samples

Fisherface

Gender recognition using 1st Fisherface

Gender recognition using 1st eigenface

Person identification with Fisherfaces and eigenfaces

40 classes

10 images per class

- REAL_TIME_FACE_RECOGNITION_SYSTEM_USING_2_article.pdfUploaded byfarfarfifi3
- catpcaUploaded byRodito Acol
- v22-25Uploaded byajaybhatia
- pca-mdsUploaded byAmur Al-Manji
- ddagarc.pdfUploaded byArvind Adimoolam
- A Music Visual Interface via Emotion Detection SupervisorUploaded byInternational Organization of Scientific Research (IOSR)
- CISP2008ManuscriptUploaded byGenaro Méndez
- eecon03Uploaded byElaya Raja
- Pca Basic IdeasUploaded byNur Hamizah
- Determination of Multipath Security Using Efficient Pattern MatchingUploaded byijcsis
- paper2Uploaded byVarun Bhardwaj
- A DCT Based Local Feature Extraction Algorithm for Palm Print RecognitionUploaded byIJSTR Research Publication
- Electronic Nose for Black Tea Quality Evaluation Using Kernel Based Clustering ApproachUploaded byAI Coordinator - CSC Journals
- 9231_s07_qp_1Uploaded bySwarnapali Liyanage
- Jigsaw SolverUploaded bySatyaki Chakraborty
- Bucchi et al 2014 editado.docxUploaded byGiancarlo Rienzi
- Mathematics (Introduction to Linear Algebra)Uploaded byshilpajoseph
- Moi G., Houghton P.J.Uploaded byJoshua Johnson
- Bazzucchi Campolmi ZattiUploaded byFilippoPippoCampolmi
- De RealEigenvaluesUploaded bySangramjit Sarkar
- Happiness Expression Recognition at Different Age ConditionsUploaded byIJMTER
- BRMT3-EyeSpy.docxUploaded bysudurocks
- CV -Computer Eng.1.pdfUploaded byChandan Kumar Banerjee
- Differential Equations - Review _ Eigenvalues & EigenvectorsUploaded byJustin Hofman
- 2006 - Schroeder et al. - corrección espectro solar.pdfUploaded bytrujillomadrigal
- Exercise 3Uploaded byAnant Saxena
- 847e5b07a34274931587ca133db78c16fd03Uploaded byReza Zulfahmi
- ECG SignalUploaded bySneha Singh
- Python for Multivariate AnalysisUploaded byEmmanuelDasi
- Bottom – up and top – down forces structuring consumer communities in an experimental grasslandUploaded byGenesis Milena Romero

- Integral inequalities Constantin P. NiculescuUploaded byRamya Datta
- Math spec 2Uploaded byQa Sim
- Developing Data Products Course NotesUploaded byQa Sim
- Developing Data Products Course NotesUploaded byLeonard Leong
- Wcsd2013 Yan Et AlUploaded byQa Sim
- HousePricePrediction PosterUploaded byQa Sim
- StanfordUploaded byQa Sim
- calcgpaUploaded bynjansowjet
- CH7m.pdfUploaded byQa Sim
- Advt_No_6_2016Uploaded byWaqas Ayub
- WAPDA PakistanUploaded byQa Sim
- Character Certificate Format by Gazetted OfficerUploaded bypratik_raj0810
- 3_expon_form.pdfUploaded byQa Sim

- Java SwingUploaded byDaniel Burlacu
- 11 Years AIEEE Chapterwise by MTGUploaded byShreesha Rao
- bpc5_ch09-05Uploaded byMuhammad Asad Ali
- 4.99 SHELL99 Linear Layered Structural Shell (UP19980821Uploaded byRavi Khandelwal
- QuaternionUploaded byaldrin_math
- Music AlgorithmUploaded byYahia
- AUTO_L7_2012 Control Lecture NoteUploaded byfutureprog
- Unifying the Theory of Mutual Coupling Compensation in Antenna ArraysUploaded bySamir Yadav
- ANSYS and Cable Stayed BridgeUploaded byZain Oo
- Microsoft Sample Interview QuestionsUploaded bySangram
- Assignment 4Uploaded byUday Karri
- Psa RecordUploaded byMurugesan Arumugam
- 1st-sem-B.Tech_(1)Uploaded byZuZumon deka
- Jacob Benesty, Jingdong Chen - Optimal Time-Domain Noise Reduction FiltersUploaded byMoises Tinte
- eadschsyll (1)Uploaded bydngkgf7097
- 60052Uploaded byuranub
- Traditional Gap Analysis TemplateUploaded byMile Veljovic
- BSL Lab ManualUploaded byKranthi Kumar Reddy
- Developing of a Finite Element Program Incorporating Advanced Element Types-ThesisUploaded byConcepción de Puentes
- partIIUploaded byfouzia1
- PARADIGMS FOR THE HIGH-LEVEL MUSICAL CONTROL OF DIGITAL SIGNAL PROCESSINGUploaded byTaller Ciclo
- (SSNMF) Semi-Supervised Nonnegative Matrix FactorizationUploaded byprabhakaran
- Introduction to LabVIEW Math ScriptUploaded byLucian Sarmas
- Automatic Time SteppingUploaded byaerosanth
- MTH603 Final Term Solved MCQsUploaded byMuhammad Asif Butt Mohsini
- Singapore Math Government Secondary Curriculum - 2007Uploaded byDennis Ashendorf
- CandesRombergTao_revisedNov2005Uploaded byalmedeiroshotmail
- Incremental DesignUploaded byVinith Krishnan
- CAE (1)Uploaded bydsd
- MatricesAsFunctionsUnderMultiplication.pdfUploaded byMagicfreak216

## Much more than documents.

Discover everything Scribd has to offer, including books and audiobooks from major publishers.

Cancel anytime.