D TM V NHN DNG KHUN MT NGI BNG

EIGENFACES
Tng hp & v d: L Hong Thanh

I. NG DNG NHN DNG REGCONITION

nh khun mt (nh
th) c kch thc

Chuyn thnh

Vector
2

N x1

N xN

Vn ny sinh khi nhn dng l s chiu qu ln (N2) lm cch no tm ra

khng gian vi s chiu t hn??

tng chnh (ci ny quan trng, c k ko lc ng):

Mc tiu ca phng php PCA l gim s chiu ca 1 tp vector sao cho vn
m bo c ti a thng tin quan trng nht . Tc Feature extraction (gi k
thuc tnh mi) ch khng phi Feature selection (gi li k thuc tnh nguyn
gc ban u).
Vector x ban u
c N chiu

Khng gian N chiu vi

h c s v1, v2,,vn

nh x tuyn
tnh T cn tm
(php chiu)

Vector y ch cn K

Khng gian K chiu (K<<N)

vi h c s u1, u2,,un

Tt nhin, khi loi b 1 s thnh phn ca x thu c y th s gy ra sai s

(li) !!
Phng php PCA s c gng tm php bin i tuyn tnh T tha: y = T.x
sao cho trung bnh bnh phng li (MSE) l b nht.
Cch tm c T:
Gi M l vector trung bnh ca tt c cc vector x trong tp mu.
Gi ma trn hip phng sai ca cc phn t x trong tp mu l C. C c
tnh theo cng thc sau:

Ngi ta chng minh c rng:

Nu T l ma trn m hng, mi hng l 1 vector ring ca C, ng thi m

vector ring ny phi ng vi m tr ring ln nht. Khi T chnh l php
bin i tha MSE nh nht.
Ni tm li, phng php PCA quy v vic i tm tr ring (eigenvalues) v
vector ring (eigenvectors) ca ma trn hip phng sai C ca tp mu X.
Sau , ta ch gi li K vector ring ng vi K tr ring ln nht lm c s
cho khng gian mi ny.

I.1. Tnh ton cc Eigenfaces

Bc 1:
S dng cc nh khun mt I1, I2, In (tp cc khun mt hun luyn) vi khun
mt phi chnh din & tt c nh phi cng kch thc.

Bc 2:
Biu din mi nh Ii thnh vector

V d: n gin ta gi s ch c 4 nh trong tp hun luyn (kch thc 3x3).

Ta tnh ton c:

Bc 3:
Tnh vector khun mt trung bnh theo cng thc:
C th ta c:

Bc 4:
Tr vector khun mt trung bnh:

C th ta c:

3421

Bc 5:
Tnh ma trn hip phng sai (covariance) C:

1/M

C s c kch thc N2xN2

Trong :

A s c kch thc l N2xM

C th ta c:

A=
Ma trn A kch
thc N2xM (9x4)
to bi ghp cc
lm cc ct

T ta d dng tnh c ma trn hip phng sai C, kt qu nh sau:

C=

Ma trn C kch thc N2x N2

(9x9). Qu ln !!

Bc 6:
Tnh cc Eigenvector ui (vector ring) ca ma trn vung A.AT (C c kch thc
N2xN2).
Ma trn ny c kch thc qu ln khng kh thi phi khn kho i ng
vng !!
Bc 6.1:
Xt ma trn AT.A (ch ma trn ny ch c kch thc l MxM)
C th ta c:

AT.A =

Kch thc MxM

(4x4). Gim hn !!

Bc 6.2:
Tnh cc vector ring vi (eigenvectors) ca ma trn vung AT.A ny.
Tips: V cch tm tr ring (eigenvalues) & vector ring (eigenvectors) c th
xem li Ton cao cp Tp 1 i s v Hnh hc Gii tch. Tuy nhin, cch

ny khng kh thi khi lp trnh !! Phi dng Phng php lp (thut ton QR)
tm.
y ta s tm c 4 tr ring ca ma trn AT.A, tuy nhin ta s sp xp li
theo th t gim dn, v ch ly cc tr ring non-zero. Kt qu ta c 3 tr
ring (t tnh ra 3 vector ring tng ng):

v1

Cc eigenvector ca
AT.A tng ng vi
cc eigenvalues. Kch
thc Mx1

v3

v2

Cc eigenvalues
ca AT.A.

Sau khi tnh c cc vector vi (c kch thc l Mx1), ta s d dng suy ra

c cc vector ring ui (kch thc N2x1) mong mun cn tm, theo cng thc:
(*)

u1

u2

Ch nn chun ha cc vector ui (

Cc eigenvector ca
ma trn hip phng
sai C (AT.A) cn phi
tm. Kch thc N2x1

u3

ui 1 ),

i
ngha l: ui u
i

Sau khi chun ha ta thu c cc vector ui cui cng nh sau:

u1

u2

u3

Thnh qu cui cng!! y

chnh l cc vector c s
ca khng gian mi. Ta gi
cc vector ny l cc

EIGENFACES

Ta rt ra c cc ch sau (theo TON HC):

Ma trn A.AT c th c n N2 tr ring (mi tr ring s ng vi v s
vector ring n c gi l khng gian ring ng vi tr ring no
).
Ma trn AT.A c th c n M tr ring.
M tr ring ca ma trn AT.A (km vi cc vector ring tng ng), s
ng vi M tr ring ln nht ca A.AT (ci ny quan trng bi ta ang
i tm cc hng bin thin quan trng nht).
Bc 6.3:
Tnh M vector ring ui tt nht ca A.AT theo cng thc (*)
Bc 7:
Ch gi li K vector ring trong s M vector ni trn (ng vi K tr ring ln nht),
tt nhin K<<N2.
C 2 cch xc nh K.
Cch 1:
- Sp xp theo th t dy gim dn cc eigenvalues tm c.
- Theo di s bin thin ca dy trn, khi khng cn bin thin (hoc xp
x bng khng) th lc ta chn K.

Cch 2:
Chn K theo cng thc sau:

N(Alpaydin)

I.2. Biu din cc khun mt c sn (tp hun luyn)

vo trong khng gian vector ny
Mi khun mt i trong tp hun luyn c th c biu din li l 1 t hp
tuyn tnh ca K vector ring ln nht:
Trong :
Ta thng nht gi cc vector ring ui l cc EIGENFACES (khun mt
ring). Nh vy, by gi, mi khun mt hun luyn i s c biu din trong
khng gian mi l 1 vector nh sau:

u1T . i

C th ta c:

i
y l cc vector (nh khun
mt
gc
Tht ra, y
chnh
l ban u)

Kch thc
vector ang
ny chlm:
Xem hnh sau hiu r hn nhng g mnh
cn
l
Kx1
TA ca vector

Chiu ccvo trong khng gian khun mt

ta c cc vector . Ta ca trong
khng gian ny l vector

T
u2 . i
u T .
3 i

u T .
K i

y l cc vector c s ca
khng gian khun mt (c
gi l EIGENFACE)

Hnh ny t thc hn. Tht ra n khng tht ST vi t chc d liu, ch l m

, hnh
t cho D HNH DUNG. V d: Eigenface c kthc N2x1, hnh ca
eigenfaces.

Khun mt c th
biu din l t hp
tuyn tnh ca cc
vector c s

Cc wj ca vector i (y
chnh l ta trong
khng gian khun mt )

Cc Eigenface (vector
c s ui ca khng
gian khun mt)

Din gii hnh hc ca phng php PCA (tm cc eigenvalue/vectors):

PCA chiu d liu theo hng m d liu khc nhau nhiu nht.
Gc
hng
chnh l ny
c xc nh bng cc eigenvectors ca ma trn hip
ta
Cc
Trc di nht m ch hng
phng sai (covariance matrix).
bin thin quan trng nht
ca d liu (c variance
phng sai - cao nht).
y chnh l hng ca
Eigenvector
ng
vi
eigenvalues ln nht.
Mt Ellipsoid nh ngha
bi covariance matrix (cc
sample vector tp trung
ch yu trong ny)

V d d hiu v kh nng ti sao PCA li c th gim c chiu d liu:

y1

x2
Bin i (chiu)

x1
Vector ch cn 1 chiu,
trong khng gian vi c
s l y1

Vector 2 chiu, trong

khng gian vi cc c
s l x1, x2

I.3. Nhn dng khun mt bng cc EIGENFACES

Cho 1 nh khun mt cha bit l ai (tt nhin cng phi ging tp mu
chnh din & cng kch thc). Ch , giai on nhn dng ny ging ht giai
on biu din nh khun mt trong tp mu. Ta thc hin ln lt cc bc
sau:

u1T .

Bc 1:

Chun ha :

u .
u T .
3

Bc 2:
Biu din thnh nh sau:

T
2

u T .
K

Bc 3:
Tm:
Tc ta tm khun mt th l trong tp mu c khong cch gn nht vi khun
mt cn nhn dng.
Bc 4:
Nu er < Tr (Tr l 1 ngng chp nhn c no ):
Tc nh khun mt cn xc nh gn vi nh ca ngi th
mu. Khi , ta kt lun chnh l khun mt ca ngi th l.

l trong tp

Ch :
Ta c th s dng khong cch Euclid tnh e r. Tuy nhin, ngi ta chng
mnh c rng, kt qu s tt hn nu dng khong cch Mahalanobis:

II. NG DNG D TM DETECTION

Tht ra, y khng ng ngha l detection, m ch l xc nh xem c phi l
nh mt ngi (hay ch l nh phong cnh) hay khng m thi.
Bc 1:
Bc 2:
Tnh

Bc 3:
Tnh

Bc 4:

Nu ed < Td (1 ngng no chp nhn c):

Tc nh cn xc nh c khong cch gn vi khng gian khun mt. Khi
, ta kt lun chnh l nh khun mt ngi (ch khng phi nh cnh
vt !!).
----------------------------------------C 1 ti liu (Slides ca Pradeep Buddharaju) cp n vic tnh ngng nh
sau:

c = maxj,k {||pj-pk||}; j,k = 1,,m

Tc l c bng khong cch ln nht gia 2 khun mt bt k.
Ngng ny s c dng thay cho c Td v Tr

III. NHC IM CA EIGENFACES

Trong nhng trng hp sau, PCA Eigenfaces s nhn dng sai:
1. Khc nhau v iu kin nh sng

2. Khc nhau v iu b (nghing u chng hn)

3. Cm xc (ci to, h ming)