Professional Documents
Culture Documents
Bai Giang Ly Thuyet Thong Tin @CanthoU
Bai Giang Ly Thuyet Thong Tin @CanthoU
MC LC
GII THIU TNG QUAN.............................................................................................................6
1. MC CH ...........................................................................................................................6
2. YU CU .............................................................................................................................6
3. NI DUNG CT LI...........................................................................................................7
4. KT THC TIN QUYT ..................................................................................................7
5. TI LIU THAM KHO.....................................................................................................8
6. PHNG PHP HC TP.................................................................................................8
CHNG 1: GII THIU ...............................................................................................................9
1. Mc tiu.................................................................................................................................9
2. i tng nghin cu............................................................................................................9
3. M hnh l thuyt thng tin theo quan im Shannon ........................................................10
4. Lng tin bit v cha bit .................................................................................................10
5. V d v lng tin bit v cha bit ....................................................................................10
6. nh l c s ca k thut truyn tin ..................................................................................11
7. M t trng thi truyn tin c nhiu ....................................................................................11
8. Minh ha k thut gim nhiu.............................................................................................12
9. Chi ph phi tr cho k thut gim nhiu ............................................................................13
10.
Khi nim v dung lng knh truyn ............................................................................13
11.
Vn sinh m ................................................................................................................13
12.
Vn gii m.................................................................................................................13
CHNG 2: O LNG TIN ...............................................................................................15
BI 2.1: ENTROPY .......................................................................................................................15
1. Mc tiu...............................................................................................................................15
2. V d v entropy..................................................................................................................15
3. Nhn xt v o lng tin ................................................................................................15
4. Khi nim entropy ...............................................................................................................16
5. Entropy ca mt s kin......................................................................................................16
6. Entropy ca mt phn phi .................................................................................................16
7. nh l dng gii tch ca Entropy......................................................................................16
8. V d minh ha ....................................................................................................................17
9. Bi ton v cy tm kim nh phn-t vn ...................................................................17
10.
Bi ton v cy tm kim nh phn - Din gii................................................................17
11.
Bi tp .............................................................................................................................18
BI 2.2: CC TNH CHT CA ENTROPY .............................................................................19
1. Mc tiu: .............................................................................................................................19
2. Cc tnh cht c bn ca Entropy........................................................................................19
3. Minh ha tnh cht 1 v 2....................................................................................................19
4. Minh ha tnh cht 3 v 4....................................................................................................19
5. nh l cc i ca entropy ................................................................................................20
6. Chng minh nh l cc i ca Entropy............................................................................20
7. Bi tp .................................................................................................................................21
BI 2.3: ENTROPY CA NHIU BIN .....................................................................................22
1. Mc tiu...............................................................................................................................22
2. nh ngha Entropy ca nhiu bin.....................................................................................22
3. V d Entropy ca nhiu bin..............................................................................................22
4. nh ngha Entropy c iu kin.........................................................................................22
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
MC CH
Gio trnh ny s cung cp cho ngi c nhng khi kin thc c bn ca l thuyt thng tin
nh: do lng tin (Measure of Information), Sinh m tch c (Decypherable Coding),
Knh truyn tin ri rc khng nh (Discrete Memoryless Channel) v Sa li trn knh truyn
(Error Correcting Codings).
Lin quan n o lng tin, gio trnh s trnh by cc khi nim c bn v thng tin,
entropy, mt s cng thc, tnh cht, cc nh l quan trng ca entropy v cch tnh
lng tin.
V knh truyn tin ri rc khng nh, gio trnh s gii thiu m hnh knh truyn theo
2 kha cnh vt l v ton hc. Cc khi nim v dung lng knh truyn, phn lp knh
truyn, nh l v dung lng knh truyn, cng nh cc khi nim trong k thut truyn
tin v phng php xy dng lc gii m ti u cng c trnh by trong mn hc
ny.
YU CU
Sau khi hc xong mn ny, sinh vin phi c c nhng kh nng sau:
Hiu cc khi nim v v thng tin, Entropy, Entropy ca mt phn phi, Entropy ca
nhiu phn phi, Entropy c iu kin, o lng tin. Vn dng gii quyt cc bi ton
v xc nh lng tin.
Bit khi nim v m tch c, m khng tch c, bng m ti u. Hiu nh l Kraft
(1949), nh l Shannon (1948), nh l sinh m Huffman v phng php sinh m
Huffman. Vn dng sinh bng m tch c ti u, nhn bit c bng m nh th
no l bng m ti u v c th vn dng vit cc chng trnh sinh m, gii m (hay
vit chng trnh nn v gii nn). T y, cc sinh vin c th t nghin cu cc loi
bng m khc vn dng cho vic m ha v bo mt thng tin mt cch hiu qu.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
Bit cc khi nim v knh truyn tin ri rc khng nh, dung lng knh truyn v phn
lp knh truyn. Hiu nh l v dung lng knh truyn, phng php xy dng lc
gii m ti u v cch tnh xc sut truyn sai trn knh truyn.
Bit cc khi nim v khong cch Hamming, nguyn l khong cch Hamming, cc nh
l v Cn Hamming, phng php kim tra chn l, cc lc sa li, Bng m
Hamming v Bng m xoay vng.
Vn dng cc kin thc hc c thit k mt h thng truyn nhn d liu vi quy
trnh c bn: m ha, gii m v bo mt thng tin.
L thuyt thng tin cng l mt trong cc mn hc kh ca ngnh Cng ngh thng tin v n
i hi ngi hc phi c kin thc c bn v ton v xc sut thng k. Do , i hi ngi
hc phi t b sung cc kin thc c bn v ton v xc sut thng k cho mnh (nu thiu),
tham gia lp hc y v lm cc bi tp theo yu cu ca mn hc th mi tip thu kin
thc mn hc mt cch hiu qu.
NI DUNG CT LI
Gio trnh gm 5 chng c trnh by trong 45 tit ging cho sinh vin chuyn ngnh Cng
ngh thng tin, trong c khong 30 tit l thuyt v 15 tit bi tp m gio vin s hng dn
cho sinh vin trn lp.
Chng 1: Gii thiu. Chng ny trnh by cc ni dung c tnh tng quan v mn hc bao
gm: cc i tng nghin cu, m hnh l thuyt thng tin theo quan im ca nh ton hc
Shannon, khi nim v lng tin bit v cha bit, nh l c bn ca k thut truyn tin.
Chng 2: o lng tin. Chng ny trnh by cc vn c bn v entropy, cc tnh cht
ca entropy, entropy ca nhiu bin, entropy c iu kin, cc nh l v quan h gia cc
entropy v lng tin ca mt s kin.
Chng 3: Sinh m tch c. Ni dung chnh ca chng ny bao gm cc khi nim v m
tch c, quan h gia m tch c v di m, tnh ti u ca di m.
Chng 4: Knh truyn. Cc ni dung c trnh by trong chng ny bao gm khi nim v
knh truyn tin ri rc khng nh, cc m hnh truyn tin kha cnh vt l v ton hc, dung
lng trn knh truyn, phn lp cc knh truyn. Phng php xy dng lc gii m ti u
v cch tnh xc sut truyn sai cng c gii thiu trong chng ny.
Chng 5: Sa li. Chng ny trnh by cc ni dung ct li sau: khi nim v khong cch
Hamming, nguyn l khong cch nh nht Hamming, b v t sa li v nh l Cn
Hamming. Chng ny cng gii thiu v b m kim tra chn l, phng php kim tra chn l,
lc sa li ti u, m Hamming v m xoay vng.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
PHNG PHP HC TP
phc v cho mc tiu nng cao kh nng t hc tp v t nghin cu ca sinh vin, gio trnh
ny c bin son cng vi cc gio trnh khc thuc chuyn ngnh Cng ngh thng tin ca
Khoa Cng ngh thng tin v Truyn thng i Hc Cn Th theo d n ASVIET002CNTT
Tng cng hiu qu o to v nng lc o to ca sinh vin khoa Cng ngh Thng tini hc Cn Th. Chng ti c gng trnh by gio trnh ny mt cch c h thng cc ni
dung theo b cc cc chng ng vi cc khi kin thc nu trn, mi chng c c trnh
by theo b cc ca cc bi hc v mi bi hc gii thiu n ngi hc mt vn no trong
s cc vn ca mt khi kin thc tng ng vi mt chng. Khi hc xong cc bi hc ca
mt chng, ngi hc s c mt khi kin thc cn thit tng ng cho mn hc. Ni dung ca
cc bi hc u c a vo cc v d ngi hc d hiu, ty theo tng vn m ngi hc
cn phi hc v nghin cu trong thi lng t 1 n 2 tit t hc cho mt bi hc trong mt
chng. Nh vy, hc tt mn hc ny, trc ht sinh vin cn phi:
Vic cho ra i mt gio trnh vi nhng mc ch nh trn l khng n gin khi kh nng v
kinh nghim ca ngi son cn c hn, nhiu khi nim, thut ng dng trong gio trnh cha
c nh ngha mt cch chnh thng. V vy gio trnh ny chc khng trnh khi nhng khim
khuyt, rt mong nhn c s gp ca cc ng nghip v ngi c.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
i tng nghin cu
L thuyt thng k v thng tin c xy dng trn hai hng khc nhau bi hai nh ton hc
Shannon (1948) v Wiener (1949). L thuyt thng tin nghin cu qu trnh x l tn hiu nh
sau:
u vo (input): nhn tn hiu t mt lnh vc c th, tc l tn hiu xut hin theo cc k hiu
(symbol) t mt tp hp cho trc v theo phn phi xc sut bit.
Tn hiu c truyn i trn knh truyn (channel) v c th b nhiu cng theo mt phn phi
xc sut no . Knh truyn c th c hiu di hai ngha:
Di ngha vt l: knh truyn l mt h thng truyn tn hiu (dy dn, mch, sng, ...) v gy
nhiu ty thao cht lng ca h thng.
Di ngha ton hc: knh truyn l cc phn phi xc sut xc nh trn lp cc tn hiu ang xt
u nhn tn hiu (output).
u ra (output): dng li tn hiu chn tht nht c th c so vi tn hiu u vo.
Shannon xy dng m hnh l thuyt thng tin trn c s gii quyt bi ton: sinh m di ti
u khi nhn tn hiu u vo. Tn ti u c xt trn 3 yu t sau:
Phn phi xc sut ca s xut hin ca cc tn hiu.
Tnh duy nht ca m v cho php t iu chnh m sai nu c vi chnh xc cao nht. Gii m
ng thi t ng iu chnh m hoc xc nh on m truyn sai.
Trong kh , Wiener li nghin cu phng php x l tn hiu u ra: c lng ti u chui
tn hiu so vi chnh n khi nhn u vo khng qua qu trnh sinh m. Nh vy phng php
Wiener c p dng trong nhng trng hp con ngi khng kim sot c qu trnh truyn
tn hiu. Mn x l tn hiu cp n vn ny.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
M ha
Knh
Gii m
Nhn
Nhiu
B ch ci
B ch ci
Din gii:
-
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
10
1
0.5
2
0.5
0
0.25
1
0.5
2
0.25
0
0
1
0
2
1
ng
Ngun
M ha
ng
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
1
11
S truyn tin:
Bit truyn
0
Tuyn lp 3 ln
000
000
000
000
000
000
000
000
111
111
111
111
111
111
111
111
Nhn 3 bit
000
001
010
100
101
011
110
111
000
001
010
100
011
110
111
111
Gii m
0
0
0
0
1
1
1
1
0
0
0
0
1
1
1
1
Tht vy:
Gi s Xi xc nh gi tr ng hay sai ca bit th i nhn c cui knh truyn vi Xi =1 nu
bit th i nhn c l sai v Xi =0 nu bit th i nhn c l ng. Theo gi thit ban u ca
knh truyn th phn phi xc sut ca Xi c dng Bernoulli b(1/4):
Xi
P
1
3/4
0
1/4
Gi Y ={X1 + X2 + X3 } l tng s bit nhn sai sau 3 ln truyn lp cho 1 bit. Trong trng hp
ny Y tun theo phn phi Nh thc B(p,n), vi p=1/4 (xc sut truyn sai mt bit) v q =3/4 (xc
sut truyn ng 1 bit):
Y ~ B(i,n) hay
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
12
p (Y = i ) = C ni . p i q n i
Trong : C ni =
n!
i!( n i )!
Vn sinh m
T k thut truyn tin trn cho ta thy qu trnh sinh m v gii m c m t nh sau: mt n
v thng tin nhn c u vo s c gn cho mt k hiu trong b k hiu sinh m. Mt k
hiu m c gn n ln lp li (da vo dung lng ca knh truyn, ta c th xc nh c n).
Thit b sinh m (Coding device/ Encoder) s thc hin qu trnh sinh m.
Nh vy, mt n v thng tin t ngun pht tin s c thit b sinh m gn cho mt dy n k
hiu m. Dy k hiu m ca 1 n v thng tin c gi l mt t m (Code word). Trong trng
hp tng qut, ngi ta c th gn mt khi k t m cho mt khi thng tin no v c gi
l mt t m.
Vn gii m
cui knh truyn, mt thit b gii m (Decoding device/ Decoder) s thc hin qu trnh ngc
li nh sau: kim tra dy k hiu m quyt nh gii m v mt t m v a n v dng khi
tin ban u.
V d:
Khi tin ban u
: 01010101
Khi k hiu m u truyn (lp 3 ln): 000111000111000111000111.
Khi k hiu m u nhn
: 001110100111011001000111
Khi tin nhn c cui cng
: 01011001 (sai 2 bit so vi khi tin ban u)
Do lm sao ua khi tin nhn c v khi tin ban u 01010101, y chnh l cng vic
ca b gii m (Decoder).
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
13
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
14
BI 2.1: ENTROPY
Mc tiu
Sau khi hon tt bi hc ny bn c th:
- Hiu c cc khi nim Entropy,
- Bit Entropy ca mt s kin v Entropy ca mt phn phi,
- Hiu nh l dng gii tch ca Entropy,
- Bit Bi ton v cy tm kim nh phn v
- Lm kin thc c s hiu v hc tt cc bi hc tip theo.
V d v entropy
Trc ht, ta cn tm hiu mt v d v khi nim do ca mt lng tin da vo cc s kin
hay cc phn phi xc sut ngu nhin nh sau:
Xt 2 BNN X v Y c phn phi sau:
X={1, 2, 3, 4, 5} c phn phi u hay p(X=i) = 1/5.
Y={1, 2} cng c phn phi u hay p(Y=i) = 1/2.
Bn thn X v Y u mang mt lng tin v thng tin v X v Y cha bit do chng l ngu
nhin. Do , X hay Y u c mt lng tin khng chc chn v lng tin chc chn, tng ca 2
lng tin ny l khng i v thc t n bng bao nhiu th ta cha th bit. Lng tin khng chc
chn ca X (hay Y) c gi l Entropy.
Tuy nhin, nu X v Y c tng quan nhau th X cng c mt phn lng tin khng chc chn
thng qua lng tin bit ca Y (hay thng tin v Y c bit). Trong trng hp ny, mt
phn lng tin khng chc chn ca thng qua lng tin bit ca Y c gi l Entropy c
iu kin.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
15
Entropy ca mt s kin
Gi s c mt s kin A c xc sut xut hin l p. Khi , ta ni A c mt lng khng chc
chn c o bi hm s h(p) vi p [0,1]. Hm h(p) c gi l Entropy nu n tho 2 tiu
ton hc sau:
Tin 01: h(p) l hm lin tc khng m v n iu gim.
Tin 02: nu A v B l hai s kin c lp nhau, c xc sut xut hin ln lt l pA v pB. Khi
, p(A,B) = pA.pB nhng h(A,B) = h(pA) + h(pB).
x1
p1
x2
p2
x3
p3
xM
pM
H ( X ) = p i h( pi )
i =1
C = const >0
C s logarithm l bt k.
B : h(p)=-Clog(p).
Trng hp C=1 v c s logarithm = 2 th n v tnh l bit.
Khi :
h(p)=-log2(p) (vt: bit) v
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
16
V d minh ha
Nu s kin A c xc sut xut hin l 1/2 th h(A)=h(1/2)= -log(1/2) = 1 (bit)
Xt BNN X c phn phi sau:
X
P
x1
x2
1/2 1/4
x3
1/4
x2
0,3
x3
0,2
x4
0,15
x5
0,15
x1
Yes
No
x2
No
Yes
x3
X=x1?
X=x1/x2?
X=x3?
No
X=x4?
Yes
x4
No
x5
17
Sinh vin t cho thm 1 hay 2 s tm kim khc v t din gii tng t - xem nh bi tp.
Bi tp
Tnh H(X) vi phn phi sau:
X
P
x1
x2
1/3 1/3
x3
1/3
x1
x2
1/6 2/6
x3
1/6
x4
2/6
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
18
+ (p r +1 + p r + 2 + + p M )H(
pr +1
i=r +1 pi
M
,...,
pM
i=r +1 pi
M
log
,...,
log
= M
log
=
M
m
M
M
M
M
M
M
M
M M
1
= log M l hm n iu tng
M
x1
10%
x2
20%
x3
25%
x4
25%
x5
15%
x6
5%
Ta c th gom cc s kin x1, x2, x3 li thnh mt s kin mi l x123 c xc sut xut hin
l 55%, gom s kin x5 v x6 li thnh s kin x56 c xc sut 20%.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
19
x123
55%
x4
25%
X56
20%
nh l cc i ca entropy
nh l: H(p1, p2, ,pM) log(M)
Trong : ng thc xy ra khi v ch khi p1== pM= 1/M
B : cho 2 b {p1, p2, ,pM} v {q1, q2,,qM} l cc b s dng bt k v
M
i =1
i =1
pi = qi
M
i =1
i =1
i =1
i =1
i =1
i =1
(1)
(2)
i =1
i =1
p i log 2 pi pi log 2
M
1
= log 2 M pi = log 2 M
M
i =1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
20
Bi tp
Bi 1: Cho 2 bin ngu nhin X, Y c lp nhau c phn phi sau:
X
P
x1
1/2
x2
1/2
Y
P
y1
1/4
y2
1/4
y3
1/4
y4
1/4
x1
10%
x2
20%
x3
25%
x4
25%
x5
15%
x6
5%
Ta c th gom cc s kin x1, x2, x3 li thnh mt s kin mi l x123 c xc sut xut hin l 55%,
gom s kin x5 v x6 li thnh s kin x56 c xc sut 20%.
Ta c mt nhin ngu nhin mi X* c phn phi sau:
X*
P
x123
55%
x4
25%
x56
20%
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
21
H(X, Y) = p ( xi , y j ) log 2 p ( xi , y j )
i =1 j =1
Hay
M
H(X, Y) = p ij log 2 p ij
i =1 j =1
p( x ,..., x
1
) log 2 p ( x1 , x 2 ,..., x n )
X 1 ,L, X n
0
0.5
Y
P
0
0.25
1
0.5
1
0.5
2
0.25
Tnh H(X,Y).
- Lp phn phi ca P(X,Y)
X,Y
P(X,Y)
X=0,Y=0
0.125
X=0,Y=1
0.25
X=0,Y=2
0.125
X=1,Y=0
0.125
X=1,Y=1
0.25
X=1,Y=2
0.125
H (Y / X = xi ) = p ( y j / xi ) log p ( y j / xi )
j =1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
22
H (Y / X ) = p ( xi ) H (Y / X = xi )
i =1
V d Entropy c iu kin
Xt bin ngu nhin X v bin ngu nhin Y c tng quan nhau. Cc phn phi nh sau:
X
P
1 .
0.5
2
0.5
0
0.25
1
0.5
2
0.25
Y/X=2
P
0
0
1
0
2
1
P ( xi ) = p ( xi , y j )
j =1
M
P ( y i ) = p ( xi , y j )
i =1
i =1
i =1 j =1
H ( X ) = p ( xi ) log 2 p ( xi ) = p ( xi , y j ) log 2 p ( xi )
L
H (Y ) = p ( y j ) log 2 p ( y j ) = p ( xi , y j ) log 2 p ( y j )
j =1
i =1 j =1
H ( X ) + H (Y ) = p ( xi , y j )[log 2 p ( xi ) + log 2 p ( y j )]
i =1 j =1
M
H ( X ) + H (Y ) = p ( xi , y j )[log 2 p ( xi ) p ( y j )] (1)
i =1 j =1
t qij =p(xi)p(yj)
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
23
p ij log 2 q ij p ij log 2 p ij
i =1 j = i
(2)
i =1 j =1
(3)
i =1 j =1
H qu:
H(X1, , Xn) H(X1)++H(Xn)
H(X1,Xn; Y1,,Yn) H(X1,Xn)+ H(Y1,,Yn)
H(X, Y) = - p ( xi , y j ) log 2 p ( xi , y j )
i =1 j =1
M
= - p ( xi , y j ) log 2 [ p ( xi ). p ( y j / xi )]
i =1 j =1
M
= p ( xi , y j ) log 2 p ( xi ) p ( xi , y j ) log 2 p ( y j / xi )
i =1 j =1
i =1 j =1
= H(X) + H(Y/X)
Tng t ta c: H(X,Y)=H(Y)+H(X/Y)
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
24
H(Y)
H(X/Y)
H(Y/X)
Bi tp
Xt BNN X v BNN Y c tng quan nhau. Cc phn phi nh sau:
X
1 .
2
P
0.5
0.5
Phn phi ca Y c iu kin X:
Y/X=1
0
P
0.25
Y/X=2
P
0
0
1
0.5
2
0.25
1
0
2
1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
25
Yu cu ca bi ton
Ta xt v d v mt ngi t chc tr chi may ri khch quan vi vic tung mt ng tin c
u hnh khng c u hnh. Nu ngi chi chn mt khng c u hnh th thng khi kt
qu tung ng tin l khng c u hnh, nguc li th thua. Tuy nhin ngi t chc chi c th
n gian bng cch s dng 2 ng tin Tht- Gi khc nhau sau:
+ ng tin loi 1 (hay ng tin tht): ng cht c 1 mt c u hnh.
+ ng tin loi 2 (hay ng tin gi ): ng cht, mi mt u c 1 u hnh.
Mc d ngi t chc chi c th n gian nhng qu trnh trao i 2 ng tin cho nhau l ngu
nhiu, vy liu ngi t chc chi c th n gian hon ton c khng? Hay lng tin bit v
cha bit ca s kin ly mt ng tin t 2 ng tin ni trn c hiu nh th no?
Ta th xt mt trng hp sau: nu ngi t chc chi ly ngu nhin 1 ng tin v sau thc
hin vic tung ng tin ly c 2 ln. Qua 2 ln tung ng tin, ta m c s u hnh xut
hin. Da vo s u hnh xut hin, ta c th phn on c ngi t chc chi ly c
ng tin no.
Chng hn: Nu s u hnh m c sau 2 ln tng l 1 th ng tin ly c l ng tin
tht, ngc li nu s u hnh m c l 2 th ng tin ly c c th l tht hay cng c
th l gi. Nh vy, ta nhn c mt phn thng tin v loi ng tin qua s u hnh m
c sau 2 ln tung. Ta c th tnh c lng tin bng bao nhiu? (Vic tnh lng tin ny s
c tho lun sau).
1
0.5
2
0.5
0
0.25
1
0.5
2
0.25
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
26
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
27
t vn bi ton
Ta xt v d v mt ngi t chc tr chi may ri khch quan vi vic tung mt ng tin c
u hnh khng c u hnh. Nu ngi chi chn mt khng c u hnh th thng khi kt
qu tung ng tin l khng c u hnh, nguc li th thua. Tuy nhin ngi t chc chi c th
n gian bng cch s dng 2 ng tin Tht- Gi khc nhau sau:
+ ng tin loi 1 (hay ng tin tht): ng cht c 1 mt c u hnh.
+ ng tin loi 2 (hay ng tin gi ): ng cht, mi mt u c 1 u hnh.
Mc d ngi t chi c th n gian nhng qu trnh trao i 2 ng tin cho nhau l ngu
nhiu, vy liu ngi t chc chi c th n gian hon ton c khng? Ta th xt mt trng
hp sau: nu ngi chi ly ngu nhin 1 ng tin v sau thc hin vic tung ng tin ly
c 2 ln. Qua 2 ln tung ng tin, ta m c s u hnh xut hin. Da vo s u hnh
xut hin, hy tnh lng tin v loi ng tin ly c l bao nhiu?
1
0.5
2
0.5
0
0.25
1
0.5
2
0.25
0
0
1
0
2
1
28
Bi tp
1. Thc hin mt php th con xc sc ng cht ng thi vi mt ng tin cng ng cht.
Trong , con xc sc c cc mt im t 1 n 6, ng tin mt mt c u hnh v mt kia
khng c u hnh. Trc tin th con xc sc, nu s im 4 th tung ng tin mt ln, ngc
li th tung ng tin hai ln. Tnh lng tin v s im con xc sc khi bit thng tin v s u
hnh m c.
2. Ngi ta thc hin mt kho st trn cc sinh vin i hc v mi quan h gia kh nng hc
tp vi s hu phng tin i li v tinh thn i hu. Kt qu cho thy:
Trong tng s sinh vin c 3/4 sinh vin hon thnh chng trnh hc v 1/4 khng hon thnh.
Trong s sinh vin hon thnh chng trnh hc, 10% c xe con. Ngc li, trong s sinh vin
khng hon thnh chng trnh hc c ti 50% c xe con.
Tt c sinh vin c xe con u tham gia hi i hu sinh vin. Trong s sinh vin khng c xe con
(k c hon thnh hay khng hon thnh kha hc) th 40% sinh vin tham gia hi i hu sinh
vin.
a. Tm thng tin v trng thi hc tp ca sinh vin khi bit iu kin v phng tin i li ca
h.
b. Tm thng tin v tnh trng hc tp ca sinh vin khi bit tinh thn i hu ca h.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
29
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
30
t vn bi ton sinh m
Gi s ngun tin X xut hin v c ghi li thng qua mt thit b c bit. Chng hn nh nh
c ghi li bng my nh, m thanh c ghi li bng my ghi m, Qua knh truyn, nhng
thng tin ny cn phi c m ha cho ph hp. c th m ha ngi ta cn mt bng ch ci
gm cc ch ci quy nh trc (chng hn bng ch ci la tinh, bng m nh phn, ). Mi gi
tr ca X sau c m di dng mt dy hu hn cc ch ci v ta gi dy hu hn cc ch
ci gn cho mt gi tr ca x l mt t m.
Ta xt BNN X={x1, x2, ,xn} c phn phi {p1, p2, , pn} c quan st lin tc v c lp. Dy
cc gi tr nhn c gi l thng bo (Message) c dng xi1xi2xin. Tp hp A={a1, a2, , an} l
tp hp k t m (Code Characters) hay l bng ch ci (Code Alphabet) dng sinh m. Mt
gi tr xi X c gn bi mt dy hu hn cc k t m c gi l t m (Code word). Tp
hp gm tt c cc t m gn cho tt c cc gi tr ca X c gi l b m hay bng m (Code).
Cc t m phi khc nhau tng i mt.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
31
pn
i =1
Min
Bng m tch c
Bng m tch c l bng m m khi m ha thng bo Msg ta s nhn c dy cc t m ws,
v khi gii m dy cc t m ws th ta ch nhn c mt thng bo duy nht l Msg ban u.
V d: Xt bin ngu nhin X={x1, x2} c bng m tng ng W={w1=0, w2=01}.
Phng php gii m c s dng nh sau: ch gii m khi no nhn c on m vi
di bng di ca t m di nht.
Gi s dy m nhn c (cn gii m) l: 0010000101001.
S dng phng php gii m trn ta nhn c duy nht dy thng bo gc:
x1x2x1x1x1x2x2x1x2.
C th chi tit ha cc bc gii m dy t m trn nh sau:
Nhn c on 00 -> Gii ra x1 , cn li 0.
Nhn tip 1 ->01 -> Gii ra x2.
Nhn tip 00
-> Gii ra x1, cn li 0.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
32
Gii thut:
Bc khi to: Gn tp hp S0=W.
Bc 1: xc nh tp hp S1 t S0:
- Khi to S1={}
- Vi wi, wj S0, ta xt: nu wi=wjA (wj l tin t ca wi) hoc wj=wi A (wi l tin t
ca wj) th thm A (phn hu t) vo S1.
Bc k: xc nh tp hp Sk (k2) t tp hp S0 v Sk-1:
- Khi to: Sk={}
- Vi wi S0 v vj Sk-1, ta xt: nu wi=vjA (vj l tin t ca wi) hoc vj=wi A (wi l
tin t ca vj) th thm A (phn hu t) vo Sk.
iu kin dng vng lp:
Nu Sk={} th dng v kt lun bng m tch c (k1).
Nu tn ti t m wi trong Sk hay Sk S0 th dng v kt lun bng m khng tch
c.
Nu Sk=St<k th dng v kt lun bng m tch c (k1).
Bi ton 1- yu cu
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
33
34
Bi tp
1. Hy cho bit bng m sau c phi l bng m tch c hay khng?
W={w1=00, w2=01, w3=0010, w4=0111, w5=0110}
2. Hy ly v d mt bng m tch c, v chng minh n l bng m tch c.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
35
nh l Kraftn(1949).
Gi X={x1, x2,, xM} l bin ngu nhin cha cc gi tr cn truyn c phn phi l P={p1, p2,
, pM}.
A={a1, a2,,aD} l b k t sinh m c D ch ci (D c gi l c s sinh m).
Gi tr xi c m ha thnh t m wi c di l ni.
t N={n1, n2,,nM} l tp hp di cc t m.
nh l (Kraft- 1949):
iu kin cn v tn ti bng m tc thi vi di N={n1,n2,,nM} l
M
ni
i =1
8
2
2
2
i =1
=> Tn ti bng m tc thi.
1
1
1
5
+ 1 + 2 = >1
1
4
2
2
2
i =1
=> Khng tn ti bng m tc thi.
ngh: sinh vin tm hiu ni dung tip theo v tr li gii thch 2 v d trn.
ni
nh ngha cy bc D c k.
nh ngha: Cy bc D c k l cy c h thng nt, cnh tha iu kin:
- T 1 nt c s cnh i ra khng vt qu D hay mt nt c khng qu D nt con.
- Nt cui cng (Nt l) cch nt gc khng vt qu k cnh.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
36
Vn sinh m cho cy bc D c k
Sinh m cho cc nt ca cy bc D c K (tr nt gc):
n gin ha: mi nt (tr nt gc) c k hiu bi dy k hiu ca nt cha lm tin t +
mt k t b sung ly t tp hp {0, 1, 2, , D-1} thay cho bng ch ci A={a1, a2, , aD}.
V d 1: Cy bc D=2 c k=3
00
0
01
V d 2: Cy bc D=3 c k=2.
000
01
010
02
1
110
10
11
100
101
11
00
001
011
10
12
2
111
20
21
22
Tnh cht:
+ Cc nt (tr nt gc) ca cy u c m ha t bng ch ci {0, 1, 2,, D-1}
+ Mi nt ( m ha) c m ca nt k trc l tin t.
+ Tng s cc nt l bng Dk = tng s cc m tc thi c th c.
ni
i =1
37
nM n1
ni
+D
nM n1
+L+ D
nM n M
= D
nM ni
nM
= tng s nt l.
i =1
1 (pcm)
i =1
ni
i =1
Th tc to m tc thi:
Xt N={n1, n2, ,nM} v c s sinh m l D:
Bc 1: Ta xp th t n1 n2 nM, xy dng cy bc D c k=nM v sinh m cho cc nt .
Bc 2: Chn nt bt k trn cy c di n1 gn cho t m w1 v xa tt c cc nt k sau n.
Bc 3: Lp li cc bc 2 i vi vic chn cc t m cn li w2, , wM ng vi n2, , nM.
=> Bng m W={w1, w2, , wM} l bng m tc thi.
V d minh ha nh l Kraft
V d 1: Xt bng m tha M=3, D=2, n1=1, n2=2, n3=3. Vy ta kim tra xem c to c bng
m tc thi hay khng?
3
7
n
Ta c 2 i = 2 1 + 2 2 + 2 3 = < 1
8
i =1
=> W= {w1, w2, w3} l bng m tc thi
Ta Xy dng bng m nh sau:
000
00
001
w1= 0
010
01
011
1
100
w2=10
101
110
11
w3=
111
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
38
Bi tp
1. Tm 1 bng m tch c tha tnh cht D = 2, k = 4?
2. Tm tt c cc bng m tch c tha tnh cht D=2, k=3?
3. Hy ch ra bng m sau y l bng m khng tch c:
W={w1=00, w2=1, w3=100, w4=110, w5=111}
4. Hy tm mt bng m nh phn tch c c t nht 5 t m tha iu kin
M
ni
=1
i =1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
39
BI 3.3: TNH TI U CA DI M
Mc tiu
Sau khi hon tt bi hc ny bn c th:
- Hiu nh l Shannon (1948),
- Bit c cc tiu chun nh gi bng m ti u tuyt i v bng m ti u tng i,
- iu kin nhn bit mt bng m ti u,
- Hiu nh l Huffman,
- Bit Phng php sinh m Huffman,
- Vn dng phng php sinh m Huffman sinh m Huffman cho mt thng bo,
- Vn dng phng php sinh m Huffman vit chng trnh nn.
nh l Shannon (1948)
Pht biu nh l:
M
Khi n
H(X )
log 2 D
ni
=1
i =1
H (X )
. Nu m
log 2 D
khng tch c di trung bnh ca n c th nh hn cn di. Nu m tch c khng ti
u th di ca n s ln hn nhiu so vi cn di, cn nu m tch c ti u th di
trung bnh ca n gn vi cn di.
Bi ton t ra s l tm phng php xy dng bng m tch c ti u.
Ch :
H D (X) = pi log D pi
H ( X ) pi log 2 pi
=
log 2 D
log 2 D
l entropy ca X vi c s D.
(X ) =
Bng m ti u tuyt i
nh l: Bng m c gi l ti u tuyt i khi n =
H (X )
hay pi = D ni
D
log 2
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
40
00
001
0
010
01
w1
011
10
1
w2
11
100
101
w3
111 w4
110
Bng m ti u tng i
nh l: Bng m c gi l ti u tng i khi:
H(X )
H (X )
n<
+1
log 2 D
log 2 D
nh l Huffman
nh l: Gi s X c phn phi xc sut vi th t gim dn sau:
X
P
x1
p1
x2
p2
xM
pM
x1
P1
x2
p2
x*M-2 x*M-1,M
p*M-2 p*M-1,M
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
41
x1
p1
x2
p2
xM
pM
Th tc li (D=2):
Khi to: t M0=M
Bc 1:
- t x M 0 1, M 0 = {x M 0 1 , x M 0 } c xc sut p M 0 1, M 0 = p M 0 1 + p M
wM 0 = wM 0 1,M 0 +"1"
Gim M0: M0=M0-1, vng lp kt thc khi M0=2
(Ch : trong trng hp tng qut, vong lp kt thc khi M0 D.)
Th tc tin:
i ngc li so vi th tc li ng thi xc nh t m mi bc t s lu vt th tc
li.
Minh ha phng php sinh m Huffman
V d 1: sinh bng m nh phn Huffman cho X c phn phi sau:
X
P
x1 x2
x3 x4
x5 x6
0.3 0.25 0.2 0.1 0.1 0.05
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
42
Bc 3
Bc 4
Bc 5
X P
X P
X
P
X
P
X
P
x1 0.3
x1 0.3
x1 0.3 x23 0.45
x1564 0.55
x2 0.25
x2 0.25
x564 0.25
x1
0.3 0 x23
x3 0.2
x3 02
x2 0,25 0
x564 0.25 1
x4 0.1
x56 0.15 0 x3 0.2
1
x5 0.1 0 x4 0.1
1
x6 0.05 1
Th tc tin:
Bc 1
Bc 2
X W
x1564 0
x23
1
X W
x23
1
x1
00
x564 01
Bc 3
X
W
x1
00
x564 01
x2
10
x3
11
Bc 4
X
W
x1
x2
x3
x56
x4
0
0.45
Bc 5
X W
00
x1
10
x2
11
x3
010
x4
011
x5
x6
00 = w1
10 = w2
11 = w3
011 = w4
0100 = w5
0101 = w6
0
01
0100=w5
0101=w6
10=w2
011=w
Bi tp
x1 x2
0.4 0.3
x3 x4
0.2 0.1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
43
y1 y2
0.3 0.2
y3 y4 y5
y6
y7
y8 y9
0.2 0.1 0.05 0.05 0.04 0.03 0.03
3. Cho on vn bn thoi the thi thoi thi the thoi thi the. Tm bng m nh phn Huffman
dng m ha on vn bn trn.
4. Thay tng k t trong on vn bn trn thnh mt t m, ct tng on 8 bits i thnh
s thp phn. Cho bit dy s thp phn kt qu.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
44
Gii thiu
Trc ht, ta c th hiu khi nim knh truyn ri rc v khng nh bi hc ny nh sau: khi
nim truyn ri rc y l truyn tun t cc k t c lp nhau (hay truyn tng k t mt),
cn khi nim khng nh y l ch xt mi quan h gia k t truyn v k t nhn c
tng ng, khng xt n mi quan h gia k t nhn c vi k t nhn c trc .
Khi nim v mt knh truyn ri rc da vo phn b xc sut ca tn hiu ra ph thuc vo tn
hiu vo v trng thi ca knh truyn c chun ha bi Feinstein (1958) v Wolfowitz
(1961). Dung lng knh (Channel Capacity) c xc nh chnh xc nh Muroya (1953) v
Fano (1961). Gii thut v chng trnh tnh dung lng knh c vit bi Eisenberg (1963).
nh l c bn v truyn tin ch ra rng vi dung lng knh cho trc lun c th tm ra mt
phng php truyn tin vi lng tin nh hn dung lng knh v t sai s nh hn sai s cho
php bt k. nh l c bn v truyn tin c Feinstein (1954, 1958) kho st. Cc nh khoa
hc Blackwell, Breinan (1958, 1959) v Thomasian (1961) ln lt chnh l t chun tt
hn. Trong cc ni dung tip theo ca bi hc, cc bn s tm hiu v m hnh knh truyn tin ri
rc khng nh khia cnh vt l v ton hc. c bit m hnh ton hc s ch ra cch xc nh
phn phi u ra da vo phn phi u vo.
M hnh vt l
Mt thng bo c cu to t cc k hiu ca mt bng ch ci u truyn (input) v c
truyn trn knh. Thng bo c nhn cui knh (hay u nhn-output) v c gii m theo
bng ch ci u truyn. Mt khc, tng k t u nhn c th quan h vi cc k t u
nhn trc , cc k t u truyn v trng thi ca knh truyn. n gin, y chng ta
ch xt m hnh vt l nh sau:
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
45
u truyn
Knh truyn
u nhn
P(e)
nhiu
X
Cc qui c:
- X: l bin ngu nhin c gi tr cn truyn u truyn.
- Y: l bin ngu nhin cha gi tr c th nhn c u nhn.
- X: l bng ch ci sinh m u truyn.
- Y: l bng ch ci gii m u nhn.
- X, Y, X, Y: u hu hn v ri rc.
- Truyn ri rc tng k t v nhn cng ri rc tng k t.
- K t nhn sau khng ph thuc vo k t nhn trc.
M hnh ton hc
Ta gi:
- X={x1, x2, , xM} l b k t sinh m u truyn (input).
- Y={y1, y2,,yL} l b k t gii m u nhn (output).
- Bin ngu nhin X ly gi tr ( m ha) trn X v c phn phi p(X=xi)=p(xi) vi
i=1,..,M.
- Bin ngu nhin Y ly gi tr (gii m) trn Y v c phn phi xc sut c iu kin:
P(Y=yj/X=xi)=p(yj/xi)=pij vi j=1,..,L.
Gi A=||pij|| l ma trn truyn tin hay m hnh truyn tin ca knh truyn ri rc khng nh.
Vi i= 1, M , j= 1, L v pij = p(Y=yj/X=xi) = p(yj/xi) l xc sut nhn c gi tr yj khi truyn
gi tr xi.
Tnh phn phi u nhn:
M
Ta c: p(Y=yj) = p(yj) = p( xi ). p ( y j / xi )
i =1
p(yj) = p ( xi ). p ( y j / xi )
i =1
M
= p ( xi ). pij
i =1
Vy p(yj)= PX .Aj
(1)
(2)
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
46
47
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
48
u truyn
x1
u nhn
y1
Nhm B1
yk
x2
yk+1
Nhm B2
yh
xM
yt
Nhm BM
yL
c trng ca knh truyn khng mt tin l H(X/Y)=0. C ngha l lng tin cha bit v X khi
nhn Y l bng 0 hay ta c th hiu khi nhn c Y th ta hon ton c th bit v X.
Dung lng: C=log2M (Sinh vin t chng minh, xem nh bi tp)
Knh truyn xc nh
M hnh: t tp hp cc gi tr c th truyn u truyn c phn thnh L nhm Bj tng ng
vi cc gi tr c th nhn c yj u nhn v xc sut nhn yj vi iu kin truyn xi l
p(Y=yj/X=xi Bj)=1 (M>L).
u truyn
u nhn
x1
Nhm B1
y1
xk
xk+1
Nhm B2
y2
xh
xt
Nhm BL
yL
xL
c trng: ca knh truyn xc nh l H(Y/X)=0. C ngha l lng tin cha bit v Y khi
truyn X bng 0 hay khi truyn X th ta bit s nhn c Y.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
49
xM
xM
c trng: H(X/Y)=H(Y/X)=0.
Dung lng: C=log2L=log2M (Sinh vin t chng minh, xem nh bi tp)
V d: ma trn truyn tin ca knh truyn khng nhiu vi M=L=3:
x1 1 0 0
x 2 0 1 0
A=
x3 0 0 1
y1 y 2 y 3
A=
1
y2
y3
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
50
Do :
L
P (Y = y j ) = P(Y = y j , X = xi )
i =1
= P( X = xi )P(Y = y j / X = xi ) =
i =1
1
M
P
i =1
ij
1
qi
M
T A ta nhn thy:
p11 ...
A = ... ...
p
M 1 ...
Do
= A
p1L
+ hang
= A
+ cot
i =i
i =i
=> M = L qi => qi =
M
L
1 M 1
=> P (Y = y j ) =
= => H (Y ) = p ' P (Y = y j ) log P (Y = y j ) = log L = Max
M L
L
=> H(Y) t max l logL khi P(Y=yj)=1/L hoc P(X=xi)=1/M
L
H( , 1-)
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
51
1 H(,1-)
M
t tham s dk= q jk exp 2 q ji H (Y / X = xi ), k = 1, M
j =1
i =1
Nu dk>0 th dung lng knh truyn c dng:
M
M
C = Log exp 2 q ji H (Y / X = xi )
i =1
j =1
Gi tr cc i t khi tn hiu vo X=X* tha phn phi P(X*=xk)=2-Cdk
Hay C=max I(X/Y)=I(X*/Y)
Ch :
- iu kin dk>0 cho php hm I(X/Y) l hm li => Tn ti Max tuyt i ti phn phi ca
X* vi p(X*=xk)=2-C dk =pk (vi mi k).
- Nu iu kin ma trn vung hoc ma trn ngch o khng tha th gi tr cc i max s
nm trn ng bin ca min xc nh {pk>0 v -pk=1}
Bi tp
1. Cho mt knh truyn c ma trn truyn tin nh sau:
x1 1 / 2 1 / 3 1 / 6
x 2 1 / 3 1 / 6 1 / 2
x3 1 / 6 1 / 2 1 / 3
y1 y 2
y3
Tnh dung lng knh truyn.
2. Chng minh cc cng thc tnh dung lng knh truyn trn.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
52
BI 4.3: LC GII M
Mc tiu
Sau khi hon tt bi hc ny bn c th:
- Bit t vn bi ton gii m,
- Hiu cc khi nim c bn ca k thut truyn tin,
- Bit v hiu cc dng sai s c bn ca k thut truyn tin,
- Hiu phng php xy dng lc gii m ti u,
- Vn dng xy dng lc gii m ti u v tnh cc dng xc sut truyn sai.
t vn bi ton gii m
Phn tch yu cu gii m:
Khi truyn gi tr xi, ta s nhn c yj.
i vi knh truyn khng nhiu th yj chnh l xi. i vi knh truyn c nhiu th yj c
th khc xi. Do ta cn tm cch gii m yj v gi tr xi khi knh truyn c nhiu.
Php phn hoch cc gi tr u nhn:
Php phn hoch tp cc gi tr u nhp yj Y l php phn chia tp Y thnh cc tp
con Bi sao cho:
Bi I B j =
1. M
( i j)
U Bi = Y
i =1
2. Khi nhn yj Bi th gii m v xi.
V d bi ton gii m
Cho tp cc t m truyn X v tp cc dy n bit nhn c Y nh sau:
X={0000, 0101, 1110, 1011}
Y={0000, 0001, 0010, 0011, 0100, 0101, 0110, 0111,
1000, 1001, 1010, 1011, 1100, 1101, 1110, 1111}
Gi s ta c th phn hoch tp Y thnh cc tp con Bi nh sau:
B1={0000, 1000, 0001, 0010}
B2={0101, 1101, 0100, 0111}
B3={1110, 0110, 1111, 1100}
B4={1011, 0011, 1010, 1001}
Gi s nhn yj = 0011 th gii m v x4 = 1011 v yj B4.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
53
Knh
B to m
k t
m
B gii m
nhiu
P(e)
X{x1, , xM}
Nhn
k t
gii m
Y{y1, , yL}
Din gii:
- Ngun pht tn hiu (hay thng bo) vi vn tc R (tn hiu/giy).
- Tn hiu c m ha t b k t m.
- Tn hiu m ha c truyn trn knh vi vn tc C (k t/giy), C ng thi l dung lng
ca knh truyn.
- Tn hiu truyn trn knh c th b nhiu vi xc sut P(e).
- Trc khi nhn, tn hiu m ha c gii m theo mt phng thc ti u v chnh xc
cao nht c th c.
Bi ton t ra y: tm gii php to m sao cho sai s u nhn c xc sut nh hn bt k
( < P(e)) ng thi vi ng b ha: vn tc pht thng bo ngun R v vn tc truyn ti C
(C l dung lng knh).
Cc khi nim c bn:
T m: l dy n k t truyn hay dy n k t nhn ng.
B m (S,n): l tp hp gm S t m vi di mi t m u bng n v c k hiu l x(1), ,
x(s).
Lc gii m: l mt hm gn cho mt dy n k t nhn c yj mt t m ca b m W =
{w1, w2, , ws}. K hiu: g(yj) = wi
Lc gii m ti u: l lc gii m sao cho tng xc sut truyn sai l nh nht hay tng
xc sut truyn ng l ln nht.
Ngha l: khi nhn yj th ta gii m v wi* sao cho:
P(wi*/yj) = Max{P(wk/yj)}
wk W
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
54
Cch 1:
Cch 2:
m1=00000
m2=01101
m3=11010
m4=10111
m1=00
m2=01
m3=10
m4=11
Nu s dng cch 1 vi di 5 bit, trong 5 bit c th hiu l c 2 bit thng tin cn truyn v 3
bit con li l 3 bit c b sung pht hin nhiu theo mt phng php no s c cp
cc ni dung tip theo sau. Vi cch m ha ny, ta c nhiu kh nng pht hin v sa sai do
nhiu.
Nu s dng cch 2 th trng hp c 1 bit truyn sai s dn n trng lp sang mt trong cc tn
hiu khc. V d truyn m1=00 v nhn 2 bit l 01 (do nhiu), trong trng hp ny 01 chnh l
m2, y l mt tn hiu ng nn ta khng th pht hin c nhiu hay khng nhiu.
Nh vy, trong khong thi gian truyn v dung lng knh cho php, ta cn m ha mi tn hiu
cng di cng tt nhng khng c vt qu di m cho php. Trng hp vi thi gian n=5
v c= 1 bit th nC=5 l s bit ti a c th truyn nn ta ch m ha tn hiu vi di m ti a l
5 bit.
Cc dng sai s c bn
Xc sut truyn sai t m xi: p(e/xi)= p(Y=yj Bi/X=xi)
M
p(wM).p(yj/wM)
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
55
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
56
x2
y2
Nhm B2
x3
y3
Minh ha cch tnh cc sai s
Xt li v d minh ha xy dng lc gii m ti u trn, ta c:
- Ma trn truyn tin A:
x1 1 / 2 1 / 3 1 / 6
x 2 1 / 3 1 / 6 1 / 2
x3 1 / 6 1 / 2 1 / 3
y1 y 2
y3
- Xc sut u truyn: p(x1)=1/2; p(x2)=p(x3)=1/4.
- Lc gii m ti u:
Nhn
y1
Nhm B
1
Gii m
x1
x2
y2
Nhm B2
x3
y3
- Phn hoch: B1={y1, y2}, B2={y3} v B3={}.
Tnh cc xc sut truyn sai:
Xc sut truyn sai mt t m:
Xc sut truyn sai t m x1: p(e/x1)= p(Y=yj B1/X=x1)
= p(y3/x1) =1/6
Xc sut truyn sai t m x2: p(e/x2)= p(Y=yj B2/X=x2)
= p(y1/x2) + p(y2/x2) =1/3+1/6=1/2
Xc sut truyn sai t m x3: p(e/x3)= p(Y=yj B3/X=x3)
= p(y1/x3) + p(y2/x3) + p(y3/x3) =1/6+1/3+1/2=1
M
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
57
Bi tp 1
1. Cho ma trn truyn tin sau:
x1 1 / 2 1 / 3 1 / 6
x2 1 / 3 1 / 6 1 / 2
x3 1 / 6 1 / 2 1 / 3
y1 y2 y3
Bit xc sut u truyn: p(x1)=5/10, p(x2)=3/10, p(x3)=2/10.
- Tnh dung lng knh truyn.
- Xy dng lc gii m ti u.
- Tnh cc sai s p(e) v pm(e).
2. Cho ma trn truyn tin sau:
x1 7 / 12 3 / 12 2 / 12
x2 2 / 12 7 / 12 3 / 12
x3 3 / 12 2 / 12 7 / 12
y2
y3
y1
Bit xc sut u truyn: p(x1)=1/3, p(x2)=1/3, p(x3)=1/3.
- Tnh dung lng knh truyn.
- Xy dng lc gii m ti u
- Tm cc sai s p(e) v pm(e).
Bi Tp 2
1. Cho ma trn truyn tin sau:
x1 1 2 13 1 6
1
1
x2 1
2
3
6
1
1
x3 1
6
2
3
y1 y2 y3
Bit p(x1)=1/2, p(x2)=1/4, p(x3)=1/4.
- Tnh dung lng knh truyn.
- Xy dng lc gii m ti u.
- Tnh cc sai s p(e) v pm(e).
2. Cho ma trn truyn tin sau:
x1 7 / 10 2 / 10 1 / 10
x2 1 / 10 7 / 10 2 / 10
x3 2 / 10 1 / 10 7 / 10
y2
y3
y1
Bit xc sut truyn p(x1)=0.4, p(x2)=0.4, p(x3)=0.2.
- Tnh dung lng knh truyn.
- Xy dng lc gii m ti u.
- Tnh cc sai s p(e) v pm(e).
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
58
CHNG 5: SA LI
Mc tiu: Xy dng nguyn tc sa li da vo khong cch Hamming. Trn nguyn tc ny,
phng php sa li kim tra chn l (parity check) c xy dng v to ra quy trnh sa li
ti u v ph hp vi cng ngh truyn tin hin nay.
V d:
v1=10101010
v2=10101111
Ta nhn thy rng bit th 6 v bit th 8 gia gia v1 v v2 l khc nhau nn s bit tng ng khc
nhau gia v1 v v2 l 2. Do , ta ni khong cch Hamming gia v1 v v2 l 2 hay d(v1, v2) = 2
1-
59
Nhn v2 gii m v w3
d2
(1 )
nd2
d1
(1
d d
p(v / w1 )
) 1 1 2 1
= d
=
So snh xc sut:
p(v / w2 ) 2 (1 ) n d 2
1
>1
Nu nhiu 0 < < th
Do : P(v/w1)>p(v/w2) d1 <d2
Nhn xt: xc sut gii m cng ln th khong cch Hamming cng nh.
Nguyn l Hamming
nh l: trn knh truyn i xng nh phn vi s t m u truyn c di n bit, lc gii
m ti u c th thay th bng lc gii m theo khong cch Hamming vi nguyn l: nu
nhn c v, ta s gii ra w*i
sao cho d(v,w*i)=Min d(v,wk) (vi wk W).
V d:
Gi s nhn c dy v=01011.
ta c: d(v,w1)=3; d(v,w2)=2; d(v,w3)=4; d(v,w4)=1.
vy v c gii v w4 v khong cch Hamming gia v v w4 l nh nht.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
60
Bi tp
1. Cho b m W={w1=000000, w2=101010, w3=111000, w4=111111} v nhn c dy
v=010111, khi gii m v t m no? din gii?
2. Cho b m W={w1=000000, w2=010101, w3=000111, w4=111111} v Nhn c dy
v=010111, khi gii m v t m no? din gii?
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
61
BI 5.2: B V T SA LI V CN HAMMING
Mc tiu
Sau khi hon tt bi hc ny bn c th:
- Bit c B v t sa li,
- Hiu nh l v cn Hamming,
- Bit phn loi c cc dng li,
- Lm c s l thuyt cho cc phng php sa li c trnh bi trong cc bi hc tip
theo.
B v t sa li
t vn : mt t m w di n bit khi c truyn tun t tng bit c th sai e bit. Vn t ra
l khong cch (Hamming) gia cc t m v sai s e quan h vi nhau nh th no c th
phn bit tt nht ng thi tt c cc t m? B sau xc nh quan h ny.
B :
Xt b m W={w1, w2, , ws} gm c s t m nh phn di n bit v 1 s nguyn dng e.
1. Nu d(wi, wj) 2e+1 (vi ij )
Khi : tt c cc dy nhn c v c s bit li e th v c th t iu chnh (hay t sa li).
2. Nu d(wi, wj) 2e (vi ij )
Khi : tt c cc dy nhn c v c s bit li < e th v c th t iu chnh. Tt c cc dy
nhn c c s bit li = e th ta ch pht hin l v c li v khng th t iu chnh c.
3. Ngc li;
Nu v c s ch s bit li e v c th t iu chnh th d(wi, wj) 2e+1 (vi ij ).
Nu v c s ch s bit li e-1 t iu chnh c v tt c cc tn hiu vi s ch s bit li
e c pht hin th khong cch gia cc t m lun tha: d(wi,wj) 2e (vi ij ).
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
62
* wj
v
w2=001
101
z
Cn Hamming.
t vn : trong tng s 2n dy nh nhn di n bit c th chn ra bao nhiu dy to thnh mt
b m c th t iu chnh c e bit li. nh l cn Hamming cho chng ta xc nh s t m
c di n bit vi gi thit: c kh nng t sa c e bit li (iu kin cn t sa li).
nh l: Nu b m W c s t m c di n bit c th t sa c e bit li th
2n
s e
C ni
i =1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
63
Tng ng vi s t m, tng s dy vj c th t sa li l : s. C ni 2 n
(2n l tng s dy nh phn di n bits).
=> s
i =0
2n
e
C
i =1
i
n
Phn cc dng li
Gi s ta truyn t m n bit wi W ( 1 i s) v nhn c dy n bit vj ( 1 j 2n).
Cc loi li c th pht hin sau:
Li c th t iu chnh:
Trong trng hp ny tn ti duy nht t m w*i sao cho d(vj, w*i)= Min d(vj, wk) vi wk W.
=> vj c gii m v w*i
Li ch pht hin khng iu chnh c:
Trong trng hp ny tn ti t m w*i v w**i sao cho
d(vj, w*i)= d(vj, w**i)=Min d(vj, wk) vi wk W
=> vj khng th gii m chnh xc.
Li khng pht hin c.
Trong trng hp ta gii m ra w*i nhng khc vi wi truyn.
Bi tp
1. Cho n=7 v e=2, hy p dng nh l cn Hamming cho bit s t m ti a ca b m W.
2. Cho n=7 v e=2, hy p dng nh l cn Hamming cho bit s t m ti a ca b m W.
3. Hy cho mt v d c th minh ha cc trng hp phn loi li.
64
Ghi ch: trong mt s trng hp sinh m theo phng php kim tra chn l, th t cc bit kim
tra v cc bit thng tin c th xen k nhau (theo mt th t no , chng hn nh m
Hamming,) hay cng c th theo mt th t khc (theo quy c khc). y, ta chn th t
cc bit kim tra chn l v cc bit thng tin nh trn d tnh ton nhng vn mt tnh tng qut
ha.
...
...
... ...
...
a n1 r1 + a n 2 r2 + ... + a nn rn = 0
Gi A=||aij|| =Am x n , aij {0,1}, i= 1, m , j= 1, n . Ma trn A c gi l ma trn kim tra chn l c
hng l m (hay Rank(A) = m).
Cc php ton trong Modulo 2 (+,-):
0 + 1 = 1 + 0 = 1; 0 1 = 1 0 = 1;
1 + 1 = 1 1 = 0;
65
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
66
1 0 1 1 0 1
r1
r
2 0
r1 = 0
r1 = 0
r3
r1
r
2
r1 = 1
r1 = 1
1 0 0 1 1 0 0
0 1 1 1 0 1 r3 = 0 => r + r = 0 => r = 1 =>w =111010
2
2
2 3
0
1 0 1 1 0 1
r3 = 1
r1 + r3 = 0
1
0
Gii tng t cho cc trng hp cn li ta c:
w0=000000, w3=110011, w4=110100,
w5=111101, w6=001110, w7=000111.
W={000000, 001001, 111010, 110011, 110100, 111101, 001110, 000111}
2 m C ni
i =0
iu kin ( K Vasharmov-Gilbert-Sacks):
iu kin b m kim tra chn l c di n bit vi m bit kim tra chn l c th t sa
c e bit li l:
2m >
i
2 e 1
C
i =0
i
n 1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
67
V d tm m nh nht t n v e
Gi s bit trc n=7 v e=1. Tm s bit kim tra ti thiu cn thit ca b m chn l.
Theo nh l iu kin cn (Cn Hamming):
e
Ta c: 2 m C ni
i =0
e =1
2 m C 7i (*)
i =0
m = 1 (*) sai.
m = 2 (*) sai.
m 3 (*) ng.
Vy s bit kim tra ti thiu cn thit l m = 3.
V d tm e ln nht t m v n
Gi s cho trc m=3, k=2. Tm s bit li ln nht c th t sa e?
Theo nh l iu kin (K Vassharmov-Gilbert-Sacks):
2m
2 e 1
2 e 1
i =0
i =0
C ni 1 2 3
i
51
(*)
e =1 (*) ng.
e > 1 (*) sai.
Vy s bit li ln nht c th t sa l e = 1.
Bi tp
1. Xy dng b m kim tra chn l c sinh t ma trn kim tra A nh sau:
1 0 0 1 1 1
A = 0 1 1 1 0 1
1 0 1 1 0 1
2. Tm b m kim tra chn l c sinh t ma trn kim tra A nh sau:
1 0 0 1 1 1
A = 0 1 0 1 0 1
1 0 1 1 0 1
Gi gii bi tp 1 & 2: da vo phng php sinh m kim tra chn l v tham kho v
d sinh m kim tra chn l.
3. Xt b m kim tra chn l di 15 bit c th t sa c 1 bit li trn ng truyn, hy
cho bit s bit kim tra chn l ti thiu?
4. Xt b m kim tra chn l di 8 bit vi 4 bit kim tra chn l. Hy cho bit s li t sa
ti a ca b m?
Gi gii bi tp 3 & 4: da vo inh l iu kin cn (Cn Hamming) v iu kin
(K Varshamov-Gilbert-Sacks).
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
68
tnh ca b m.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
69
b11
b
A = I m 21
...
bm1
b12
b22
...
bm 2
... b1k
... b2 k
... ...
... bmk
Trong :
- Ma trn A c m dng v n ct.
- Im : l ma trn n v cp m.
- k: l s dy nh phn (hay t m) c lp tuyn tnh ln nht.
- n: l di ca t m v m = n-k:
- bij: c xc nh bng cch da vo h phng trnh tuyn tnh (*) v k t m c lp
tuyn tnh nh sau:
wi=r1r2r3rm rm+1rm+2rn. (i = 1, k )
on kim tra on thng tin
r1 = b11rm +1 + ... + b1k rm + k
(*)....................................
r = b r + ... + b r
m1 m +1
mk m + k
m
Th k t m c lp tuyn tnh vo h pt (*) tm cc bij ma trn A.
V d minh ha
Xt tp hp M gm c 8 dy nh phn di 6 bits nh sau:
r1 r2 r3 r4 r5 r6
w0 = 0
w1 = 1
w2 = 1
w3 = 0
w4 = 0
w5 = 1
w6 = 1
w7 = 0
0
0
1
1
1
1
0
0
0
1
0
0
1
1
0
1
0
0
0
1
0
1
1
1
0
0
1
0
1
0
1
1
0
1
0
1
1 (w1+w2)
0 (w1+w3)
1 (w2+w3)
0 (w1+w2+w3)
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
70
A = I3
11
12
13 0
0
0
1
0
0
1
0
=> 1 = b21 0 + b22 1 + b23 0
1
0
1
1
1
0
0
1
0 = b31 0 + b32 1 + b33 0
1
0
1
0
b11 = 1 b12 = 1 b13 = 1
=>
b21 = 1 b22 = 1 b23 = 0
b31 = 1 b32 = 0 b33 = 1
1 0 0 1 1 1
=> A= 0 1 0 1 1 0
0 0 1 1 0 1
Tng s t m s= C ki = 2 k t m.
i =0
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
71
Bi tp
1. S dng phng php sinh m nhanh cho b m t ma trn kim tra A nh sau:
1 0 0 1 1 1
A = 0 1 1 1 0 1
1 0 1 1 0 1
2. S dng phng php sinh m nhanh cho b m t ma trn kim tra A trong cc trng hp
sau:
0
A=
0
0
0
1
0
0
1
0
1
1
0
1
0
0
1
0
0
1
0
0
0
; A=
1
0
0
1
0
1
1
1
1
1
1
1
1
1
1
0
1
1
0
0
1
1
0
0
; A=
0
0
1
0
0
1
0
0
0
0
1
0
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
0
0
0
1
1
1
1
0
0
1
72
BI 5.5: LC SA LI TI U
Mc tiu
Sau khi hon tt bi hc ny bn c th:
- Bit c vn ca bi ton,
- Hiu nh ngha Hip hp,
- Vn dng xy dng lc sa li theo cc hip hp,
- Vn dng xy dng lc sa li thng qua b sa li,
- Vn dng tnh Xc sut truyn ng cho lc sa li,
- Kin thc t c s l c s cc bn c th ng dng cho vic thit k mt h, thng
m ha, gii m v bo mt thng tin.
t vn
Trong mt h thng lin lc truyn tin, bn cnh cc yu cu thit b (nh ngun pht, b m ha,
knh truyn, b gii m,) m bo tt cho vic truyn v nhn d liu th cn c cc kha cnh
khc nh phng php m ha v gii m sao cho ti u l phn rt quan trng trong h thng.
Vn lun c t ra y l lm th no ch ra mt phng php gii m ti u, c ngha
l h thng phi c kh nng pht hin v sa li mt cch chnh xc nht c th c khi nhiu xy
ra. y chnh l vn chnh c tho lun trong sut bi hc ny.
nh ngha Hip hp
Gi W={w1, w2, ,ws} l b m kim tra chn l.
V ={v1, v2, , v 2 n } l tp hp cc dy n bit c th nhn c cui knh.
Ta gi mt hip hp ca W trong V l tp hp c dng z + W (z l b li)
V d: Cho ma trn kim tra chn l sau:
1 0 1 0
A=
0 1 1 1
1000
0100
0010
0001
1101
0001
0111
0100
0110
1010
1100
1111
0011
1111
1001
1010
(vi z1=1000)
(vi z2=0100)
(vi z3=0010)
(vi z4=0001)
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
73
Lc sa li theo cc hip hp
Bc 1: Lp bng cc hip hp ng vi cc b li cn thit
- Dng u tin vit cc t m wi W.
- Cc dng tip theo ng vi ct w0 = 0000 vit cc b li z (cc b li 1 bit, 2 bit,).
- Cc dng ct th i c xc nh bi z + wi
Bc 2: Qu trnh gii m
Gii m: khi nhn v, ta xc nh ct th i cha v v gii m v wi tng ng.
V d: xy dng lc sa li theo cc hip hp cho b m c sinh t ma trn kim tra chn
l sau:
1 0 1 0
A=
0 1 1 1
0011
1111
1001
1010
(vi z1=1000)
(vi z2=0100)
(vi z3=0010)
(vi z4=0001)
bng cc Hip hp ta c v ct 1. Do , v c
Lc sa li thong qua b li
xy dng lc sa li thng qua b sa li, ta da vo tnh cht ca b sa li. Nh vy ta
c th thy lc gii m gm 2 bc sau:
Bc 1: Lp bng sa li: B li (Z) B sa li (C=A*Z).
Bc 2: Qu trnh sa li
- Khi nhn c dy n bit v V, ta xc nh b iu li C cho v vi C=A.v
- Tra bng sa li tm b li z0 ng vi C.
- Gii m w=v+z0.
V d minh ha lc sa li 1 bit
1 0 0 0 1 1
0 1 0 0 1 0
Xt b m c sinh t ma trn A =
0 0 1 0 1 1
0 0 0 1 0 1
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
74
000000
100000
010000
001000
000100
000010
000001
0000
1000
0100
0010
0001
1110
1011
1 B
6 B
Bc 2: Qu trnh sa li
- Gi s nhn v=001101, tnh C = A.v = 1000
- Tra bng sa li tm b li z0 ng vi C, ta c z0 = 100000
Gii m w = v + z0 = 001101 + 100000 = 101101 = w2
-
V d minh ha lc sa li 2 bit
Lc sa li:
Bc 1: Lp bng sa li: B li- B iu chnh (e = 2)
B li (z)
B iu chnh (C=A.z)
B li 2 bit
110000
101000
100100
100010
100001
011000
010100
1100
1010
1001
0110
0011
0110
0101
7 B
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
75
V d minh ha lc sa li 3 bit
Lc sa li:
Bc 1: Lp bng sa li: B li- B iu chnh (e = 3)
z
B li 3 bit
C=A.z
110100 1101
110001 0111
2 B
Xc sut truyn ng
Gi Ni l s b li ng vi i li c th t sa, khi xc sut truyn ng v t iu chnh s l:
n
Vi n l di t m
V d: xt trng hp cc v d trn vi n= 6 v t sa e = 3 bit li. p dng cng thc trn ta c:
3
Bi tp
1. Cho ma trn kim tra chn l sau:
1 0 0 1 1 1
A = 0 1 1 1 0 1
1 0 1 1 0 1
-
BI 5.6: M HAMMING
Mc tiu
Sau khi hon tt bi hc ny bn c th:
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
76
Hiu M Hamming,
Hiu tnh cht ca m Hamming.
M Hammin
M Hamming l mt dng m nhm (m kim tra chn l) c xc nh t ma trn kim tra chn
l A c dng sau:
- Ct th j ca ma trn A l biu din nh phn m bit (m l s bit kim tra chn l) ca
s j theo qui c biu din nh phn ca s j c vit theo th t t di ln trn (vit
theo ct), tng ng vi vit t tri sang phi (vit theo dng).
- Cc bit v tr 2i ( i = 0, 1, 2, ) c chn lm bit kim tra.
V d 1: biu din nh phn ca s j = 3 c m = 3 bit nh sau:
Vit theo dng: 011 (vit t tri sang phi)
1
Vit theo ct: 1 (vit t di ln)
0
V d 2: ma trn kim tra chn l vi n=6, m=3 c th vit nh sau:
1 0 1 0 1 0
A = 0 1 1 0 0 1
0 0 0 1 1 1
T m Hamming c dng: w=r1r2r3r4r5r6. Trong , r1r2r4 l cc bit kim tra v r3r5r6 l cc bit
thng tin (v cc bit v tr 2i (vi i = 0, 1, 2, ) c chn lm bits kim tra).
Tnh cht
Nu cho trc s bit (m) v s bit li t sa (e) th s bit ti a ca b m Hamming (n) c th
c c lng t bt ng thc sau:
e
2 m C ni
i =o
V d minh ha
Tm b m Hamming vi n = 6 v m =3
Ta c th vit ngay ma trn kim tra chn l cho b m Hamming
1 0 1 0 1 0
A = 0 1 1 0 0 1
0 0 0 1 1 1
T A k = n m = 3.
Cc bit cc v tr 1, 2, 4 c chn lm cc bit kim tra.
=> s t m ca b m Hamming l s = 2k = 8
Tm k t m c lp tuyn tnh c dng:
w1=r1r20r401
w2=r1r20r410
w3=r1r21r400
Gii cc h phng trnh: A.w1=0, A.w2=0, A.w3=0
Cc t m cn li c xc nh theo phng php sinh m nhanh.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
77
Bi tp
1. Vit ma trn kim tra chn l cho b m Hamming vi n = 15.
2. T kt qu bi tp 1, hy tm cc t m Hamming c lp tuyn tnh tng ng.
3. Xt b m Hamming vi s bit kim tra cho trc l m, khi :
- di m ti thiu l bao nhiu?
- di m ti a l bao nhiu?
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
78
t vn
Nh chng ta bit, phng php sinh b m kim tra chn l da trn l thuyt nhm cho php
chng ta sinh m nhanh bng cch ch sinh ra k t m c lp tuyn tnh trong tng s s=2k t m,
t k t m ny ta c th xc nh cc t m cn li (bng cch cng t hp cc t m). Vn t
ra y l lm sao tm ra mt phng php sinh m khc sao cho s t m sinh ban u nh
hn k (k l s t m c lp tuyn tnh ca b m kim tra chn l) v t y ta c th xc nh
nhanh cc t m cn. C th da trn m hnh ca thanh ghi li tng bc c th gii quyt c
vn ny.
Fm-1
Fm-2
F1
F0
am-1
am-2
a1
a0
Qu trnh dch chuyn li tng bc: sau mi xung ng h th d liu trong bit Fi s c
chuyn v lu tr bit Fi-1 (F1-> F0; F2->F1; ; Fm-2->Fm-3; Fm-1->Fm-2). Tt c cc gi tr trn
cc Fi (trc khi c xung in) s c chuyn v b cng (ty theo cc cng tc ng hay m),
tng ca cc gi tr ny s c a vo lu tr bit Fm-1.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
79
xm-2=xm-1
xm-1=a0x0 + a1x1 + + am-1xm-1.
Hay vit theo dng ma trn ta c x = T.x
Trong :
0
0
0 1 0 0 0
0 0 1 0 0
0
0
0 0 0 1 0
0
0
T= 0 0 0 0 ...
0
0
... ... ... ... ... ...
...
0
1
0 0 0 0 ..
a a a a ... a
a m 1
1
2
3
m2
0
T: Ma trn vung cp m.
Dng cui ca ma trn: l cc h s: a0,
a1, , am-1.
Gc trn bn phi: l ma trn n v cp
m-1.
x2
Gi x(0)= x3 l vc t ch gi tr ca thanh ghi ti thi im ang xt.
M
x
m 1
Gi tr ca thanh ghi sau 1 xung ng h l x(1)=T.x(0)
Gi tr ca thanh ghi sau 2 xung ng h l x(2)=T.x(1)=T2.x(0)
Gi tr ca thanh ghi sau 3 xung ng h l x(3)=T.x(2)=T3.x(0)
-----------
F3
F2
F1
F0
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
80
0
0
Ma trn c trng ca thanh ghi: T=
0
1
0
0
0
0
1
0
1
0
0
1
x2
Nu ta gi x(0)= x3
l vc t ch gi tr ca thanh ghi ti thi im khi to th cc gi
Gi tr ca thanh ghi sau n xung ng h l x(n)=T.x(n-1)=Tn.x(0) (bi v s trng thi thng tin khc
nhau c th c l 2m)
Vy chu k ca thanh ghi l s xung nhp ng h thanh ghi lp li trng thi ban u. Ngha l
nu x(0)0 v n>0 sao cho x(n) = x(0) th ta ni n l chu k ca thanh ghi.
Lu :
Cch vit biu din nh phn cho gi tr ca x(i) theo th t t trn xung (theo ct), tng ng vi
vit t tri sang phi (theo dng). V d: biu din nh phn ca x(i) = 3 c m = 3 bit nh sau:
Vit theo dng: x(i) = 011 (vit t tri sang phi)
0
(i)
Vit theo ct: x = 1 (vit t trn xung)
1
F3
F2
F1
F0
1 0 1 0
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
81
x0 0
x 0
(0)
c gi tr khi to ca thanh ghi x =1= 1 =
x
0
2
x 1
3
Tm chu k:
0
0
1
0
1
0
0 (0)
0 = x
1
12
15
0
11
13
10
Chu k n=6
Thanh ghi trn c 4 chu k.
Chu k n=6
14
Chu k n=3
Chu k n=1
Bi tp
1. Tm cc chu k ca thanh ghi lui tng bc nh hnh sau:
+
F2
F2
F1
F0
F2
F1
F0
82
Bit cch xc nh ma trn kim tra chn l cho m xoay vng (hay cn gi l m
vng),
Hiu nh ngha m xoay vng,
Vn dng xy dng b m xoay vng,
Vn dng phng php sinh nhanh b m xoay vng sinh b m kim tra chn l.
A =[ x x x x x x ]=
0 1 0 1 0 0
1 0 1 0 0 0
1 0 1 0 0 0
Ta c n = 6, m = 3, k = 2 s = 2k = 22 = 4 t m.
p dng Phng php sinh m nhanh b m kim tra chn l ta c b m kim tra chn l gm 4
t m sau : w0 = 000000, w1 = 101010, w2 = 010101, w4 = 111111, y chnh l mt trong cc b
m xoay vng sinh t thanh ghi li tng bc nu trn (Cc bc sinh m nhanh ngh cc
bn t lm)
83
F3
F2
F1
F0
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
84
Bi tp
1. Cho thanh ghi li tng bc sau:
F2
F1
F0
F3
F2
F1
F0
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
85
F3
F2
F1
F0
a0 = 1, a1= 0, a2 = 1, a3 = 0
a thc c trng ca thanh ghi c dng: gm(x)=1 + x2 + x4.
F3
F2
F1
F0
F3
F2
F1
F0
a0 = 1, a1= 0, a2 = 1, a3 = 0
a thc c trng ca thanh ghi c dng: g4(x)=1 + x2 + x4.
thanh ghi ny c chu k n = 6 v (x6 + 1) : 1 + x2 + x4 = x2 + 1.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
86
am-2
a1
a0
V d minh ha
Thit k thanh ghi c m=3 bit v chu k n=7, ta thc hin theo 2 bc sau:
Bc 1: Xc nh a thc c trng ca thanh ghi
Ta c (x7 + 1) : (1 + x2 + x3) = (1 + x2 + x3 + x4)
Do m=3 nn chn g3(x) = (1 + x2 + x3) lm a thc c trng ca thanh ghi.
Bc 2: V thanh ghi
T g3(x) = (1 + x2 + x3) ta c, a0=1, a1=0, a2=1
F2
F1
F0
Bi tp
1. Trong cc thanh ghi sau y, thanh ghi no sinh ra b m vng c di n=15 bit?
(R1):
F3
F2
F1
F0
(R2):
F3
F2
F1
F0
(R3):
F3
F2
F1
F0
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
87
t vn
sinh b m kim tra chn l, ta c th da theo nhiu phng php khc nhau nh: sinh m
da theo l thuyt nhm, m Hamming,... Vn t ra y l lm sao sinh b m xoay vng
vi di n bit v m bit kim tra chn l. Phng php sinh m xoay vng da trn l thuyt v
a thc c trng nh phn ca thanh ghi gip ta c ci nhn tng qut v vn sinh b m xoay
vng theo nhiu cch khc nhau.
0 1
1 h
k 1
hk 1
hk 1
k k 1
h1
h1
h0
h1
h1
h0
h0
h0
0
0
(m-1) bits
Sinh b m xoay vng theo Phng php sinh nhanh b m xoay vng.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
88
Nhn xt: kt qu theo 3 cch sinh b m xoay vng ni trn la nh nhau (cho cng b m).
V d minh ha 1
Thit k thanh ghi v sinh ma trn kim tra chn l.
Chn a thc gm(x)= 1+x+x4 a0 = 1, a1 = 1, a2 = 0, a3 = 0
F3
F2
F1
F0
+
0
0
Ma trn c trng ca thanh ghi: T=
0
1
Tm chu k ca thanh ghi:
0
0
(0)
Chn gi tr khi to x =1=
0
1
1
0
0
1
0
1
0
0
0
0
1
0
0
1
0
0
(1)
(0) 0
(2)
(1) 1
(3)
(2) 0
(4)
(3) 0
(5)
(4) 1
x =T.x = ; x =Tx = ; x =Tx = ; x =Tx = ; x =Tx =
1
0
0
1
1
0
0
1
1
0
1
1
0
1
0
(6)
(5) 1
(7)
(6) 0
(8)
(7) 1
(9)
(8) 0
(10)
(9) 1
x =Tx = ; x =Tx = ; x =Tx = ; x =Tx = ; x =Tx =
0
1
0
1
1
1
0
1
1
1
1
1
1
1
0
(11)
(12) 1 (12)
(11) 1 (13)
(12) 1 (14)
(13) 0
(15)
(14) 0
x =Tx = ;x =Tx = ;x =Tx = ;x =Tx = ; x =T.x = = x(0)
1
1
0
0
0
1
0
0
0
1
Ma trn kim tra chn l :
0 0 0 1 0
0 0 1 0 0
A=
0 1 0 0 1
1 0 0 1 1
0
1
1
0
1
1
0
1
1
0
1
0
0
1
0
1
1
0
1
1
0
1
1
1
1
1
1
1
1
1
1
0
1
1
0
0
0
0
V d minh ha 2
Chn a thc gm(x)= 1+x+x4 a0 = 1, a1 = 1, a2 = 0, a3 = 0.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
89
V d minh ha 3
Chn hk(x)= 1+ x + x2 + x3 +x5 + x7 + x8 + x11 lm a thc sinh ma trn kim tra chn l cho b m
vng h0 = 1, h1 = 1, h2 = 1, h3 = 1, h4 = 0, h5 = 1, h6 = 0, h7 = 1, h8 =1, h9 = 0, h10 = 0.
0 0 0 1 0 0 1 1 0 1 0 1 1 1 1
0 0 1 0 0 1 1 0 1 0 1 1 1 1 0
B m xoay vng
A=
0 1 0 0 1 1 0 1 0 1 1 1 1 0 0
1 0 0 1 1 0 1 0 1 1 1 1 0 0 0
a thc
1+x+x3
1+x+x4
1+x2+x5
1+x+x6
1+x3+x7
1+x2+x3+x4+x8
1+x4+x9
1+x3+x10
1+x2+x11
1+x+x4+x6+x12
1+x+x3+x4+x13
M
14
15
16
17
18
19
20
21
22
23
24
a thc
1+x+x6+x10+x14
1+x+x15
1+x+x3+x12+x16
1+x3+x7
1+x7+x18
1+x+x2+x5+x19
1+x3+x20
1+x2+x21
1+x+x22
1+x3+x23
1+x+x2+x7+x24
Bi tp
1. Tm b m vng c di 7 bit.
2. Tm thanh ghi sinh b m vng c di 15 bit.
3. Tm thanh ghi sinh b m vng c di 31 bit.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
90
BI TP TNG HP
Mc tiu
Sau khi hon tt bi hc ny bn c th:
- Hiu r hn v ni dung mn hc.
- Vn dng ni dung mn hc gii quyt mt s bi tp tng hp.
Bi 1
Xt mt m hnh chn on bnh t cc triu chng: A, B v C; chn on 1 trong 4 bnh: 1,
2, 3 v 4 vi ma trn chn on (hay ma trn truyn tin).
Bnh
Triu chng
A
B
C
0,6
0,2
0
0,3
0,6
0
0
0,2
0,3
0,1
0
0,7
Yu cu:
Cu 1: V s m t m hnh chn on bnh trn v din gii cc ngha ca s .
Cu 2: Nu phn phi ca Triu chng c dng:
Triu chng
P
A
0,5
B
0,3
C
0,2
A=
1
0
1
1
1
0
1
0
0
0
1
1
1
1
1
Tnh cc t m.
Xy dng B sa li 1 bit dng cho t ng sa li ti u trong qu trnh chn on trc tuyn.
Cho mt v d.
Bi 2
Xt mt knh truyn tin c bit dng : Truyn X Nhn Y.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
91
y1
y2
y3
y4
y5
y6
0,6
0,1
0,05
0,1
0,1
0,05
0,1
0,05
0,1
0,6
0,1
0,05
0,05
0,1
0,05
0,1
0,05
0,1
0,6
0,1
0,1
0,05
0,1
0,6
Yu cu:
Cu 1: V s m t knh truyn tin trn v din gii cc ngha ca s .
Cu 2: Nu phn phi ca X c dng :
X
P
x0
0.5
x1
0.25
x3
0.15
x4
0.1
A=
1
0
1
1
1
0
0
1
Tnh cc t m.
Xy dng B sa li dng cho t ng sa li ti u trong qu trnh truyn tin. Cho mt v d.
Bi 3
Ngi ta cn nh gi knh truyn tin v chun b thc hin truyn mt loi tn hiu c bit: X =
{x0, x1, x2, x3}
Cng vic u tin l phi kho st knh truyn. Kt qu kho st cho thy:
Knh c th truyn nhn c 8 gi tr khc nhau, c kh nng pht hin li hoc iu chnh
li. Ma trn truyn tin c dng:
y1
y2
y3
y4
y5
y6
y7
y8
Y
X
x0
0,6
0,1
0,05 0,05 0,05 0,05 0,05 0,05
x1
0,05 0,05 0,6
0,1
0,05 0,05 0,05 0,05
x2
0,05 0,05 0,05 0,05 0,6
0,1
0,05 0,05
x3
0,05 0,05 0,05 0,05 0,05 0,05 0,6
0,1
Yu cu:
Cu 1: V s m t knh truyn tin trn v din gii cc ngha ca s . Nu phn phi ca
X c dng :
X
P
x0
0.5
x1
0.25
x3
0.15
x4
0.1
92
A=
1
0
0
1
0
1
1
1
Tnh cc t m.
Xy dng B sa li dng cho t ng sa li ti u trong qu trnh truyn tin. Cho mt v d.
Bi 4
Xt mt m hnh chn on bnh t cc triu chng: A, B v C; chn on 1 trong 4 bnh: 1,
2, 3 v 4 vi ma trn chn on (hay ma trn truyn tin)
Bnh
Triu chng
A
B
C
0,5
0,1
0
0,3
0,2
0,1
0
0,7
0,3
0,2
0
0,6
Yu cu:
Cu 1: Gi s ngi ta bit thm 3 triu chng gy bnh khc l : D, E v F v mun ghi li
cc triu chng ny thng qua bng k hiu A = {+, - }.
Hy kim tra tnh tch c ca bng m sau :
Triu chng : X
M : W
A
+
B
-+
C
++-
D
--+-
E
++-+
F
--
B
0.2
C
0.2
D
0.05
E
0.03
F
0.2
A
0.5
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
93
A=
1
0
1
1
1
0
1
0
0
0
1
1
1
1
1
Tnh cc t m.
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
94
Bin son: TS. L Quy t Thng, ThS. Phan Tn Ti & Ks. Dng Vn Hiu.
95