Professional Documents
Culture Documents
ti:
Trn Th Hng
Nguyn nh Khnh
MC LC:
trang
Li m u3
1. Chng I:
Kin thc chun b
1.1 Ma trn4
1.2 Ma trn trc giao.5
1.3 Vec t ring Gi tr ring.6
1.4 Chun ca vec t.7
1.5 Chun ca ma trn...8
1.6 Hng ca ma trn.9
1.7 Vt ca ma trn9
2. Chng II: Khai trin SVD ca ma trn
2.1 nh l 111
2.2 inh l 212
2.3 nh l 314
2.4 nh l 415
2.5 nh l 516
2.6 nh l 617
2.7 nh l 719
2.8 nh l 821
2.9 nh l 924
2.10 nh l 10..25
3. Chng III: ng dng trong x l im nh.( S dng Matlab)
3.1 Phn tch SVD trong x l nh.30
3.2 S dng Matlab trong x l nh31
4. Kt lun...34
5. Ti liu tham kho...34
Li m u:
thng
nm 2012
a11
a
21
A =
a1n
a2 n
amn
K
K
a12
a22
M M O
am1 am 2 K
hoc
a11
a
21
A=
K
K
a12
a22
M M O
am1 am 2 K
hoc
a1n
a2 n
M
amn
ij mxn
A=
Trong aij l phn t ca ma trn nm trn dng i, ct j,
i 1, 2,..., m, j 1, 2,..., n.
0
M
0
1
M
0
K
K
O
K
c) Ma trn ng cho
nh ngha 3: Ma trn ng cho l ma trn vung c cc phn t nm trn
ng cho chnh khc 0, mi phn t nm ngoi ng cho chnh bng 0.
Ma trn ng cho c dng
a11
0
D=
0 K
a22 K
d) Ma trn dng, ct
Ma trn dng c dng:
X=
a1 ,
M O
0 L
a2 , K
0
0
ann
an
Ma trn ct c dng:
Y=
a1
a2
M
an
e) Ma trn chuyn v
nh ngha 4: Ma trn AT ca ma trn A c cc dng l cc ct ca ma
trn A (gi nguyn th t) gi l ma trn chuyn v ca ma trn A.
AT =
a11 a21
a12 a22
M M
a1n am 2
K
K
O
K
am1
am 2
M
amn
aij
a
k 1
ik
1, i=j
0, i j
.a jk ij
ij
AT A I 1 A 1
d)
Ta c:
an1 am 2
A=
Khi :
a thc bc n ca bin
a1n
a2 n
M
ann
:
a11
a21
M
an1
K
K
O
K
K
K
O
K
a12
a22
M
am 2
a1n
a2 n
M
ann
+ a0
(A- .I)
x1
M
x2
0
M
(1)
c v s nghim.
Khng gian ca h (1) gi l khng gian con ring ca ma trn
A tng ng vi gi tr ring .
ca ma trn A ng vi gi tr ring .
Cc c s to thnh mt c s ca khng gian ring (tc l cc
vec t to thnh h nghim c bn ca h (1)) gi l cc vec t
c xc nh l mt
a)
x 0
x x
b)
vi mi
x y x y
c)
Chun Euclide:
Chun Euclide ca vec t x c xc nh nh sau:
x
1
2
5. Chun ca ma trn
m n
, chun ca A k hiu
l mt
a)
A 0
A A
b)
vi mi
A B A B
c)
- Chun F (Frobeneous):
A aij
Cho
mxn
aij2
i 1 j 1
m
1
2
12 22 ( 2) 2 (1) 2 12 32
20
- Chun 2 ca ma trn:
Chun 2 ca ma trn A l cn bc 2 ca gi tr ring ln nht ca ma trn
AT.A
6. Hng ca ma trn
nh ngha 9: (nh thc con ca ma trn)
A aij mxn
Xt ma trn
T A ta ly cc phn t trn giao ca s dng v
s ct th ma trn thu c gi l ma trn vung con cp s ca A vi s l s
s min m, n
nguyn dng v
.
nh thc ca ma trn con c gi l nh thc con cp s ca ma trn A.
K hiu:
Di1ji12j....2 ....is js
gi l nh thc con cp s ca A.
7.
nu
nu
rank ( Bnxl ) n
rank (Cmxn ) n
Vt ca ma trn
10
Am n
T
bt k, khi mi gi tr ring ca ma trn A A u
khng m.
CHNG MINH:
T
Gi l gi tr ring ca ma trn A A v v l vec t ring tng ng. D
thy:
2
Av ( Av)T ( Av) vT AT Av
T
Do l gi tr ring ca ma trn A A :
T
( A A I). v = 0
AT A
T
v A
Av =
2
Av
.v = I v = v
2
v = v =
0.
T
Nh ta chng minh trn mi gi tr ring ca A A u khng m.
NH L 2
= i
Av
= i
Vi mi ma trn
T
Vi U v V l cc ma trn trc giao. Ma trn c xy dng:
m n
D r r 0
0
0
vi D =
1 0
0 r
CHNG MINH:
T nh l 1 th ma trn A c cc gi tr k d
do
1
r:
2 . r > 0 v r +1 =
r +2
i
r
= i
> 0,
i=0 ,i>r
=0
T
- Ma trn V c xy dng da trn cc vc t ring ca ma trn A A .
C th: V = [
v1
vn
Vi cc
vi
(i : 1
r ) l cc gi tr k d ca ma trn
. t
ui
u1
(i = 1, , r ). T ta xy dng c ma trn U = [
1
= i
um
(m > r).
Vi cc ma trn U, , V c xc nh nh trn th ta s chng minh:
A = U. .VT
<=> A V = U
Ta c: A v i = i ui vi i = 1, ., r
Ta c:
vi
A v i = 0 vi i = r +1, r + 2, , n
= 0 vi i = r +1, r + 2, , n
v1
[A
v1
vn
[A
v1
vr
; 0,0,00]
r ur
;0,0,00]
= [
u1
AV = A [
1 u1
...
vn
um
D r r 0
0
0
=U
V d 2:
1 1 0
0 0 1
Gii:
13
T
Ta tm cc gi tr ring ca ma trn A A .
1 0
1 0
0 1
A A
Ta c
1 1 0
0 0 1
1 1 0
1 1 0
0 0 1
T
Gii phng trnh det (A- .I) = 0 ta c cc gi tr ring ca ma trn A A
= 2,
Vi mi gi tr ring
= 1,
i
= 0.
I)x = 0 ta c cc vec t
ring tng ng l:
v1
1/ 2
1/ 2
0
v2
=
1/ 2
Ta c ma trn VT =
v3
1/ 2
0
1/ 2 1/ 2
Cc gi tr k d ca ma trn A l
1/ 2
1/ 2
1
0
2,
= 1,
=0
2 0 0
0 1 0
T ta c ma trn
0
0
1
Tm ma trn U:
14
1
i
ui
Av
u1 =
u2 =
U=
1/ 2
1/ 2
1 1 1 0
0
2 0 0 1
0
1 1 1 0
0
1 0 0 1
1
1
0
0
1
1 0
0 1
A=
1 1 0
0 0 1
= U.
1 0
0 1
1/ 2 1/ 2 0
0
0
1
2 0 0
0 1 0 1/ 2 1/ 2 0
v T1 +..+ r
ur
vr
Vi
ui
vi
l cc gi tr c ni n nh l 2.
CHNG MINH:
15
Ta c:
T
U. . V =[ u1 ... um ]
u1
=[
...
D r r 0
0
0
= [ u1 ... ur ]
t Ur =
ur , ur +1 u m
D r r 0
0
0
u1 , u2 ,..., ur
= [ u1 ... ur ]
][ ]
v1T
M
vT
Tr
vr 1
M
T
vn
1 0 v1
0 r v Tr
[]
T
+ [ ur +1 ... um
v r +1
] [ 0 ] T
vn
v1 , v2 ,..., vr
, Vr =
] []
v T1
v Tn
][ ]
T
1 0 v1
0 r v Tr
[]
= Ur . D. Vr
=[
1 u1
r ur
v1
T
vr
1 u1
T
v 1 +..+ r
ur
vr
16
NH L 4
T
ca A.
Khi :
Rank (A) = r.
CHNG MINH:
Theo tnh cht ca hng ma trn th:
I r r
I r r
=r
)=r
T
Rank (A) = rank (U. . V ) =rank(Ur. D.VrT) (xem nh l 3)
NH L 5:
, r
Vi AF l chun Frobeneous ca ma trn A v 1 , 2 , .
> 0 l cc
gi tr k d ca A.
Khi :
AF =
++
2
1
2
r
CHNG MINH:
u tin ta chng minh tnh cht sau:
17
Qm m
Am n
= AF vi
l ma trn trc giao v
l ma trn bt
QAF
k.
2
Ta c: QAF
= [ Q a1 ; .; Qan ]F
= Qa1E
= a 1E
++ QanE
+.+ a nE
2
= AF
Xt ma trn
AF
Amn
T
bt k vi SVD ca n l U. . V :
T
= U . . V F
T
= .V F
T T
T
T
= ( . V ) F = V . F = F
2
2
= 1 + + r
AF =
++
2
1
2
r
Am n
bt k th A c gi l ma trn nghch o ca A nu ma
A A A
=A
(1)
18
+
+
A A A
= A
( A A T = A A
+ A
A
= A A
(2)
(3)
(4)
A=U . .V T
th ma trn V. .
+
l ma trn nghch
o m rng ca v
+
D
Trong
0
1/ 1 L
M O
M
K 1/ n
0
CHNG MINH:
+
+
T
T
T
Tnh cht 1: A A A = U. . V . V. . U . U. . V
+
T
= U. . I . . I . . V
T
= U. . V
=A
Tnh cht 2:
+
+
A A A
+
+
T
T
T
= V. . U . U. . V . V. . U
19
+
+
T
= V. . . . U
+
= V. .
+
A
+ . U T
= ( U . .V T .V . T
+
Tnh cht 3: ( A A T
+ .U
= ( U . . T
T
U
= ( T
+ U
. ( U . . T
+
T
= U . ( . T . U
Mt khc:
+
A A
+ .U
U . .
T
+ . U
T
U . .V .V .
+ .U T
U . .
= ( A A T
Tnh cht 4:
+ A
A
+ .U T .U . . V T
V .
+ . . V
V .
20
V
= ( T
+ V
. ( V . . T
+
T
= V . ( . T . V
+ .V T
V . .
=
+ A
A
Mt khc:
+ .U T .U . . V T
V .
+ . . V T
V .
+ A
A
V d:
1 1 0
0 0 1
VT
A = U.
+
A
= V.
=
+
+
D
Trong
1/ 2 1/ 2 0
1 0 2 0 0
0
0
1
0 1
0 1 0
1/ 2 1/ 2 0
vi
0
1/ 1 L
M O
M
0
K 1/ n
21
+
A
= V.
1/ 2 0 1/ 2 1/ 2 0
1/ 2 0
1 0
1
1/ 2 0
1/ 2 0 1/ 2 0
0 1
0
0 1
1
0 0
0
T
v 1 +..+ r
1 u1
T
= 1 u1 v 1 +..+
Ak
Rank (
ur
Ak
vr
k uk v k
(k<r)
)=k
CHNG MINH:
Ta vit
Ak
v di dng:
Ak
1 v1
k v k
,.. ,
u1
u 2
K
u
k
Ta c:
T
T
1
Li c:
u2T
urT
Ir
22
u1
u 2
K
T
u u
1
r
Ir
Nn
u1
u 2
K
u
k
rank
u1
u 2
K
u
k
u2T
urT
Ik
[T]
= rank
=k
(1)
T
T
T
Xt rank ( 1 v 1 , 2 v 2 ,.., k v k )
T
1
Ta c:
v2T
T
1
vnT
v2T
vnT
T
1 1
1v2T K
v2 K
vk
1vnT v1 v 2 K
vk
Ik
1
2
...
k
Ik
23
1 0
0 2
...
...
=
1 0
0 2
...
...
Do
Rank
0
... ...
0 k
0
0
... ...
0 k
0
= rank
v2 K
vk
=k
T
T
T
rank ( 1 v 1 , 2 v 2 ,.. , k v k ) = k
T (1), (2) ta c:
(2)
Ak
rank ) = k
NH L 8:
r
Gi s A l ma trn c
m n
rank ( A) r
Khi vi mi ma trn B c c
mn
A i ui viT
i 1
, ta c
|| A B ||2F || A ||2F i2
i 1
B Ak i ui viT
Du bng xy ra khi
i 1
CHNG MINH:
24
Gi s A l ma trn c
m n
rank ( A) r
1 k r
Khi vi vc t bt k,
A i ui viT
i 1
ta c:
k
i 1
i 1
(*)
CHNG MINH:
Theo khai trin k d SVD ca ma trn
ta c
i 1
i 1
i 1
Do
(ui )
l c s trc chun nn
r
i 1
i 1
(v
i k 1
T
i
x) 2
Mt khc,
k
k 2 (viT x )2 k 2
i 1
i k 1
i 1
i 1
Do ,
k2
(v
i k 1
T
i
x) 2 k 2 || x ||2 k 2 (viT x) 2
i 1
25
Vy
k
i 1
i 1
(b c chng minh)
Tr li chng minh nh l 8:
k
Gi s ma trn
( x1 , x2 ,..., xm )
B xi yiT
( y1 , y2 ,..., yn )
l h trc giao,
Ta bit rng
i 1
, trong
l h trc chun.
, do tnh
i 1
k
i 1
k
i 1
k
i 1
k
i 1
i 1
i 1
i 1
xi ( x y A ) Ayi ( x y A ) Ayi y AT
i 1
k
T
i
T
i
T
i
i 1
T
i
i 1
T
i
( xi Ayi )( x y A ) Ayi y A
T
i
i 1
k
T
i
T
i
i 1
i 1
i 1
i 1
i 1
i 1
Vy
k
i 1
i 1
(*)
26
|| Ay ||
Tip theo ta nh gi v s hng
i 1
i 1
i 1
trn ta c
, ly tng theo ch s ta c bt
ng thc
k
(viT y j )2 k2 (viT y j ) 2
j 1
j 1 i 1
i 1
k
k
2
2
2
T
2
k k ( i k )(vi y j )
j 1 i 1
k
k
k2 ( i2 k2 )(viT y j )2
i 1
j 1
k
k
k2 ( i2 k2 ) (viT y j ) 2
i 1
j 1
|| Ay ||
(v
Mt khc,
j 1
T
i
k k2
2
i
j 1
, vi
k
( yi )
cc ct l cc vc-t
|| Ay ||
. Vy ta c
j 1
i 1
2
k
c
k
i 1
i 1
B Ak i ui viT
Khi
i 1
A Ak
, ta c
i k 1
ui viT
v ly chun ta c
27
|| A Ak ||2
i k 1
i 1
i 1
i 1
i2 i2 i2 || A ||2F i2 .
NH L 9:
r
Gi s A l ma trn c
m n
rank ( A) r
.Khi vi mi ma trn B c c
mn
A i ui viT
i 1
, ta c
|| A B ||2 k 1.
k
B Ak i ui viT
i 1
Du bng xy ra khi
CHNG MINH:
<
k +1
Cr
W th Bw = 0.
.V rank(B)
) m vi w
Do vi mi w W th Aw = (A B)w v:
Aw
= ( AB ) w
AB
< k +1w
2.
k+1w
(**) c xy dng
28
vec t w '
thuc c hai
Aw' <
V Aw'
k+1
k+1
k +1
AA k
D thy vi B = Ak th
= k +1 .
NH L 10
Cho h: Ax = b vi A l ma trn bt k.
Vi x = x =
+ b
A th
CHNG MINH:
Xt ma trn A bt k c rank (A) = r v phn tch SVD ca n l
A=U . .V T
T
( A = V. . U )
T
T
t y = V x v c = U b
29
Ta vit y v c di dng: y =
y1
y
2
v c =
c1
c
2
2
2
2
T
Ta c Axb = b Ax = U (bAx)
T
T
= U (bU . .V . x )
T
(do U l ma trn trc giao)
U T bU T U . . V T . x
2
2
2
= c y =
2
=
2
b Ax
min khi:
c1 Dy1 0 y1 D 1.c1
D 1.c1
y2
x Vy V
y2
Vi mi gi tr
x
=V
D 1.c1
2
th Axb vn t gi tr nh nht
ta s chng minh
Vi x bt k khc
D thy:
D 1.c1
y '2
Mt khc:
th x =
min:
=V
=V
D 1.c1
=V
(pcm)
D 1 0 c1
0 0 c2
30
T
+
+ .V
= V . .c = V . .b
+
A b
3 x1
4x
1
x2
2 x2
3 x2
3
6
(*)
Khi gii bng phng php c bn th phng trnh cho v nghim. Chng ta p
dng nh l 10 tm nghim tt nht c th c ca h cho.
H (*)
Ax = b vi
1 1
A 3 2
4 3
v b=
2
3
6
ATA =
1 1
1 3 4
3 2
1 2 3 4 3
25 19
19 25
= 44, v
) = 0, ta tm c cc gi tr ring
Gii h:
(A A -
1 I
ca ATA:
=6
Ta c cc gi tr k d ca ma trn A ln lt l
)x = 0 ta c v1 =
44
, v
1/ 2
1/ 2
31
1/ 2
(ATA
V=
2 I
1
88
1
88
)x = 0 ta c v1 =
1
12
12
1/ 2
1/ 2
VT =
1/ 2
1/ 2
1/ 2
Tm ma trn U:
1
i
ui
Av
u1 =
1 1
1
3 2
44
4 3
1/ 2
1/ 2
1 1
1/
2
1
3 2
6
1/ 2
3 3
u2 =
88
8
88
7
88
1
12
12
32
U=
44
12
1
12
2
88
5
88
7
88
12
1
12
2
88
5
88
7
88
44
1/ 2
1/ 2
1/ 2
1/ 2
A=
1/ 2
1/ 2
1/ 2
1/ 2
1
44
0
2
88
0
5
88
1
12
7
88
12
A+ =
2
88
88
1
88
1
88
1
12
12
1 5
12 88
1 5
12 88
2
88
5
88
1
12
7
88
12
1 7
12 88
1 7
12 88
33
+ b
2
88
88
61 3
88 4
61 3
88 4
1 5
12 88
1 5
12 88
1 7
12 88
1 7
12 88
2
3
6
127
88
88
34
v T1 +..+ r
ur
v Tr
vi gi tr k < r bt k
th
Ak=
1 u1
T
v 1 +..+ k
uk
vk
nh c chng minh nh l 8
36
imshow(Q,[])
K= 20
K= 50
K=100
37
nh hiu chnh
nh sai s
K=5
K = 10
K= 15
38
KT LUN:
Khai trin SVD l dng khai trin c bn v c tnh ng dng cao ca ma trn cn
c tm hiu v nghin cu rng ri. Nhm thc hin ti hi vng qua nhng g
trnh by cc chng bn c c th nm c cc kin thc c bn v ma
trn, tng quan v khai trin SVD, cch khai trin SVD cng cc tnh cht (cc
nh l) quan trng lin quan n khai trin SVD. Bn cnh , nhm cng gii
thiu mt ng dng th v ca SVD trong phn tch nh trn c s l thuyt trnh
by. Mt iu tt yu, trong qu trnh thc hin ti d c gng nhng cng
khng th trnh c sai st mong thy c v bn c b qua.
39
40