You are on page 1of 227

HC VIN CNG NGH BU CHNH VIN THNG

- - - - - - - - - - - - - -




BI GING
L THUYT THNG TIN
Bin son : PGS.Ts. NGUYN BNH












Lu hnh ni b


H NI - 2006
LI NI U
Gio trnh L thuyt thng tin l mt gio trnh c s dng cho sinh vin chuyn ngnh
in t Vin thng v Cng ngh thng tin ca Hc vin Cng ngh Bu chnh Vin thng.
y cng l mt ti liu tham kho hu ch cho cc sinh vin chuyn ngnh in - in t.
Gio trnh ny nhm chun b tt kin thc c s cho sinh vin hc tp v nm vng cc
mn k thut chuyn ngnh, m bo cho sinh vin c th nh gi cc ch tiu cht lng c bn
ca mt h thng truyn tin mt cch c cn c khoa hc.
Gio trnh gm 6 chng, ngoi chng I c tnh cht gii thiu chung, cc chng cn li
c chia thnh 4 phn chnh:
Phn I: L thuyt tn hiu ngu nhin v nhiu (Chng 2)
Phn II: L thuyt thng tin v m ha (Chng 3 v Chng 4)
Phn III: L thuyt thu ti u (Chng 5)
Phn IV: Mt m (Chng 6)

Phn I: (Chng II). Nhm cung cp cc cng c ton hc cn thit cho cc chng sau.
Phn II: Gm hai chng vi cc ni dungch yu sau:
- Chng III: Cung cp nhng khi nim c bn ca l thuyt thng tin Shannon trong h
truyn tin ri rc v m rng cho cc h truyn tin lin tc.
- Chng IV: Trnh by hai hng kin thit cho hai nh l m ha ca Shannon. V
khun kh c hn ca gio trnh, cc hng ny (m ngun v m knh) ch c trnh by mc
cc hiu bit c bn. c th tm hiu su hn nhng kt qu mi v cc ng dng c th
sinh vin cn phi xem thm trong cc ti liu tham kho.
Phn III: (Chng V) Trnh by vn xy dng cc h thng thu ti u m bo tc
truyn tin v chnh xc t c cc gi tr gii hn. Theo truyn thng bao trm ln ton b
gio trnh l vic trnh by hai bi ton phn tch v tng hp. Cc v d trong gio trnh c
chn lc k nhm gip cho sinh vin hiu c cc khi nim mt cch su sc hn. Cc hnh v,
bng biu nhm m t mt cch trc quan nht cc khi nim v hot ng ca s khi chc
nng ca cc thit b c th
Phn VI: (Chng VI) Trnh by c s l thuyt cc h mt bao gm cc h mt kha b
mt v cc h mt kha cng khai. Do khun kh c hn ca gio trnh, mt s vn quan trng
cn cha c cp ti (nh trao i v phn phi kha, xc thc, m bo tnh ton vn )
Sau mi chng u c cc cu hi v bi tp nhm gip cho sinh vin cng c c cc k
nng tnh ton cn thit v hiu su sc hn cc khi nim v cc thut ton quan trng.
Phn ph lc cung cp mt s kin thc b xung cn thit i vi mt s khi nim quan
trng v mt s s liu cn thit gip cho sinh vin lm c cc bi tp c ra cc chng.

Gio trnh c vit da trn c s cng mn hc L thuyt thng tin do B Gio dc
v o to v c c kt sau nhiu nm ging dy v nghin cu ca tc gi. Rt mong c
s ng gp ca bn c.
Cc ng gp kin xin gi v
KHOA K THUT IN T 1 - HC VIN CNG NGH BU CHNH VIN THNG
KM 10. NG NGUYN TRI - TH X H NG
Email: KhoaDT1@hn.vnn.vn
Hoc nguyenbinh1999@yahoo.com
Cui cng ti xin chn thnh cm n GS. Hunh Hu Tu cho ti nhiu kin qu bu
trong cc trao i hc thut c lin quan ti mt s ni dung quan trng trong gio trnh ny.


NGI BIN SON
Chng 1: Nhng vn chung v nhng khi nim c bn

3
CHNG I: NHNG VN CHUNG V NHNG KHI
NIM C BN
1.1. V TR, VAI TR V S LC LCH S PHT TRIN CA L THUYT
THNG TIN
1.1.1. V tr, vai tr ca L thuyt thng tin
Do s pht trin mnh m ca k thut tnh ton v cc h t ng, mt ngnh khoa hc
mi ra i v pht trin nhanh chng, l: L thuyt thng tin. L mt ngnh khoa hc nhng
n khng ngng pht trin v thm nhp vo nhiu ngnh khoa hc khc nh: Ton; trit; ho;
Xibecnetic; l thuyt h thng; l thuyt v k thut thng tin lin lc v t c nhiu kt
qu. Tuy vy n cng cn nhiu vn cn c gii quyt hoc gii quyt hon chnh hn.
Gio trnh L thuyt thng tin ny (cn c gi l C s l thuyt truyn tin) ch l
mt b phn ca l thuyt thng tin chung N l phn p dng ca L thuyt thng tin vo k
thut thng tin lin lc.
Trong cc quan h ca L thuyt thng tin chung vi cc ngnh khoa hc khc nhau, ta phi
c bit k n mi quan h ca n vi ngnh Xibecnetic.
Mi quan h gia cc hot ng khoa hc ca con ngi v cc qung tnh ca vt cht
c m t trn hnh (1.1).

- Nng lng hc: L mt ngnh khoa hc chuyn nghin cu cc vn lin quan ti cc
khi nim thuc v nng lng. Mc ch ca nng lng hc l lm gim s nng nhc ca lao
ng chn tay v nng cao hiu sut lao ng chn tay. Nhim v trung tm ca n l to, truyn,
th, bin i, tch lu v x l nng lng.
Qung tnh ca vt cht
Khi lng
Cng ngh hc
Thng tin
Nng lng
Nng lng hc
iu khin hc
(Xibecnetic)
Cc lnh vc hot ng khoa hc ca
con ngi
Hnh 1.1. Quan h gia hot ng khoa hc v qung tnh ca vt cht
Chng 1: Nhng vn chung v nhng khi nim c bn

4
- Xibecnetic: Bao gm cc ngnh khoa hc chuyn nghin cu cc vn c lin quan n
khi nim thng tin v tn hiu. Mc ch ca Xibecnetic l lm gim s nng nhc ca tr c v
nng cao hiu sut lao ng tr c. Ngoi nhng vn c xt trong Xibecnetic nh i tng,
mc ch, ti u ho vic iu khin, lin h ngc. Vic nghin cu cc qu trnh thng tin (nh
chn, truyn, x l, lu tr v hin th thng tin) cng l mt vn trung tm ca Xibecnetic.
Chnh v vy, l thuyt v k thut thng tin chim vai tr rt quan trng trong Xibecnetic.
- Cng ngh hc: gm cc ngnh khoa hc to, bin i v x l cc vt liu mi. Cng
ngh hc phc v c lc cho Xibecnetic v nng lng hc. Khng c cng ngh hc hin i
th khng th c cc ngnh khoa hc k thut hin i.
1.1.2. S lc lch s pht trin
Ngi t vin gch u tin xy dng l thuyt thng tin l Hartley R.V.L. Nm 1928,
ng a ra s o lng thng tin l mt khi nim trung tm ca l thuyt thng tin. Da vo
khi nim ny, ta c th so snh nh lng cc h truyn tin vi nhau.
Nm 1933, V.A Kachenhicov chng minh mt lot nhng lun im quan trng ca l
thuyt thng tin trong bi bo V kh nng thng qua ca khng trung v dy dn trong h thng
lin lc in.
Nm 1935, D.V Ageev a ra cng trnh L thuyt tch tuyn tnh, trong ng pht
biu nhng nguyn tc c bn v l thuyt tch cc tn hiu.
Nm 1946, V.A Kachenhicov thng bo cng trnh L thuyt th chng nhiu nh du
mt bc pht trin rt quan trng ca l thuyt thng tin.
Trong hai nm 1948 1949, Shanon C.E cng b mt lot cc cng trnh v i, a s
pht trin ca l thuyt thng tin ln mt bc tin mi cha tng c. Trong cc cng trnh ny,
nh vic a vo khi nim lng thng tin v tnh n cu trc thng k ca tin, ng chng
minh mt lot nh l v kh nng thng qua ca knh truyn tin khi c nhiu v cc nh l m
ho. Nhng cng trnh ny l nn tng vng chc ca l thuyt thng tin.
Ngy nay, l thuyt thng tin pht trin theo hai hng ch yu sau:
L thuyt thng tin ton hc: Xy dng nhng lun im thun tu ton hc v nhng c
s ton hc cht ch ca l thuyt thng tin. Cng hin ch yu trong lnh vc ny thuc v cc
nh bc hc li lc nh: N.Wiener, A. Feinstain, C.E Shanon, A.N. Kanmgorov, A.JA Khintrin.
L thuyt thng tin ng dng: (l thuyt truyn tin)
Chuyn nghin cu cc bi ton thc t quan trng do k thut lin lc t ra c lin quan
n vn chng nhiu v nng cao tin cy ca vic truyn tin. Cc bc hc C.E Shanon, S.O
RiCe, D. Midleton, W. Peterson, A.A Khakevich, V. Kachenhicov c nhng cng trnh qu
bu trong lnh vc ny.
Chng 1: Nhng vn chung v nhng khi nim c bn

5
1.2. NHNG KHI NIM C BN - S H TRUYN TIN V NHIM V CA N
1.2.1. Cc nh ngha c bn
1.2.1.1. Thng tin
nh ngha: Thng tin l nhng tnh cht xc nh ca vt cht m con ngi (hoc h
thng k thut) nhn c t th gii vt cht bn ngoi hoc t nhng qu trnh xy ra trong bn
thn n.
Vi nh ngha ny, mi ngnh khoa hc l khm ph ra cc cu trc thng qua vic thu
thp, ch bin, x l thng tin. y thng tin l mt danh t ch khng phi l ng t ch
mt hnh vi tc ng gia hai i tng (ngi, my) lin lc vi nhau.
Theo quan im trit hc, thng tin l mt qung tnh ca th gii vt cht (tng t nh
nng lng, khi lng). Thng tin khng c to ra m ch c s dng bi h th cm.
Thng tin tn ti mt cch khch quan, khng ph thuc vo h th cm. Trong ngha khi qut
nht, thng tin l s a dng. S a dng y c th hiu theo nhiu ngha khc nhau: Tnh ngu
nhin, trnh t chc,
1.2.1.2. Tin
Tin l dng vt cht c th biu din hoc th hin thng tin. C hai dng: tin ri rc v
tin lin tc.
V d: Tm nh, bn nhc, bng s liu, bi ni, l cc tin.
1.2.1.3. Tn hiu
Tn hiu l cc i lng vt l bin thin, phn nh tin cn truyn.
Ch : Khng phi bn thn qu trnh vt l l tn hiu, m s bin i cc tham s ring
ca qu trnh vt l mi l tn hiu.
Cc c trng vt l c th l dng in, in p, nh sng, m thanh, trng in t
1.2.2. S khi ca h thng truyn tin s (Hnh 1.2)


M bo
mt
M
knh
Dn
knh
Tri
ph

Gii m
mt

Gii m
knh
Chia
knh
p
ph
Dng bit
H thng ng b
( Synchronization )
Dng sng s
K

N
H
N
h
i

u

T cc ngun khc
Ti cc b nhn tin khc
nh khun
dng
nh khun
dng
u vo s
u ra s

iu ch
My
Pht
(XMT)
Gii iu
ch
MY
THU
(RCV)


Khi c bn


Khi tu chn


Hnh 1.2. S khi h thng truyn tin s.

m
1 S
1
(t)
Nhn
tin

m
1
Ngun
tin
M
ngun
Gii m
ngun
a truy
nhp
a truy
nhp
Chng 1: Nhng vn chung v nhng khi nim c bn

7
1.2.2.1. Ngun tin
Ni sn ra tin:
- Nu tp tin l hu hn th ngun sinh ra n c gi l ngun ri rc.
- Nu tp tin l v hn th ngun sinh ra n c gi l ngun lin tc.
Ngun tin c hai tnh cht: Tnh thng k v tnh hm .
Vi ngun ri rc, tnh thng k biu hin ch xc sut xut hin cc tin l khc nhau.
Tnh hm biu hin ch xc sut xut hin ca mt tin no sau mt dy tin khc nhau
no l khc nhau.
V d: P(y/ta) P(y/ba)
1.2.2.2. My pht
L thit b bin i tp tin thnh tp tn hiu tng ng. Php bin i ny phi l n tr
hai chiu (th bn thu mi c th sao li c ng tin gi i). Trong trng hp tng qut, my
pht gm hai khi chnh.
- Thit b m ho: Lm ng mi tin vi mt t hp cc k hiu chn nhm tng mt ,
tng kh nng chng nhiu, tng tc truyn tin.
- Khi iu ch: L thit b bin tp tin ( hoc khng m ho) thnh cc tn hiu bc x
vo khng gian di dng sng in t cao tn. V nguyn tc, bt k mt my pht no cng c
khi ny.
1.2.2.3. ng truyn tin
L mi trng vt l, trong tn hiu truyn i t my pht sang my thu. Trn ng
truyn c nhng tc ng lm mt nng lng, lm mt thng tin ca tn hiu.
1.2.2.4. My thu
L thit b lp li (sao li) thng tin t tn hiu nhn c. My thu thc hin php bin i
ngc li vi php bin i my pht: Bin tp tn hiu thu c thnh tp tin tng ng.
My thu gm hai khi:
- Gii iu ch: Bin i tn hiu nhn c thnh tin m ho.
- Gii m: Bin i cc tin m ho thnh cc tin tng ng ban u (cc tin ca ngun
gi i).
1.2.2.5. Nhn tin
C ba chc nng:
- Ghi gi tin (v d b nh ca my tnh, bng ghi m, ghi hnh,)
- Biu th tin: Lm cho cc gic quan ca con ngi hoc cc b cm bin ca my th cm
c x l tin (v d bng m thanh, ch s, hnh nh,)
Chng 1: Nhng vn chung v nhng khi nim c bn

8
- X l tin: Bin i tin a n v dng d s dng. Chc nng ny c th thc hin
bng con ngi hoc bng my.
1.2.2.6. Knh truyn tin
L tp hp cc thit b k thut phc v cho vic truyn tin t ngun n ni nhn tin.
1.2.2.7. Nhiu
L mi yu t ngu nhin c nh hng xu n vic thu tin. Nhng yu t ny tc ng
xu n tin truyn i t bn pht n bn thu. cho gn, ta gp cc yu t tc ng vo mt
trn hnh 1.2.
Hnh 1.2 l s khi tng qut nht ca mt h truyn tin s. N c th l: h thng v
tuyn in thoi, v tuyn in bo, raa, v tuyn truyn hnh, h thng thng tin truyn s liu,
v tuyn iu khin t xa.
1.2.2.8. Cc phng php bin i thng tin s trong cc khi chc nng ca h thng

Chng 1: Nhng vn chung v nhng khi nim c bn

9

nh dng/ M ngun
M ho k t
Ly mu
Lng t ho
iu ch m xung
(PCM)
- PCM vi phn
- iu ch Delta (DM)
- DM c tc bin i
lin tc (CVSD)
- M ho d on tuyn
tnh (LPC)
- Cc phng php nn:
M Huffman, m s hc,
thut ton Ziv_Lempel
iu ch
Kt hp

- PSK: Manip pha
- FSK: Manip tn s
- ASK: Manip bin
- Hn hp
- OQPSK: Manip pha
tng i 4 mc
- MSK
Khng kt hp

- PSK vi phn
- FSK
- ASK
- Hn hp

M knh
Dng sng

Tn hiu M_tr
Tn hiu trc giao
Tn hiu song trc
giao

Cc dy c cu trc

- M khi
- M lin tc
Dn knh/ a truy cp
- Phn chia tn s:
FDM/ FDMA
- Phn chia thi gian:
TDM/ TDMA
- Phn chia m:
CDM/ CDMA
- Phn chia khng gian:
SDMA
- Phn chia cc tnh:
PDMA
- OFDM
Tri ph
Dy trc tip (DS)
Nhy tn (FH)
Nhy thi gian (TH)
Cc phng php hn
hp
ng b
- ng b sng mang
- ng b du
- ng b khung
- ng b mng
- Hon v
- Thay th
- X l bit
- Cc phng php hn hp

- Thut ton RSA
- Thut ton logarit ri rc
- Thut ton McElice
- Thut ton Merkle-Hellman
- Thut ton s dng ng
cong Elliptic

M bo mt
M ho theo khi
M ho dng s liu
Mt m c in

Mt m kho cng khai
Chng 1: Nhng vn chung v nhng khi nim c bn

10
1.2.3. Nhng ch tiu cht lng c bn ca mt h truyn tin
1.2.3.1. Tnh hu hiu
Th hin trn cc mt sau:
- Tc truyn tin cao.
- Truyn c ng thi nhiu tin khc nhau.
- Chi ph cho mt bit thng tin thp.
1.2.3.2. tin cy
m bo chnh xc ca vic thu nhn tin cao, xc sut thu sai (BER) thp.
Hai ch tiu trn mu thun nhau. Gii quyt mu thun trn l nhim v ca l thuyt thng
tin.
1.2.3.3. An ton
- B mt:
+ Khng th khai thc thng tin tri php.
+ Ch c ngi nhn hp l mi hiu c thng tin.
- Xc thc: Gn trch nhim ca bn gi bn nhn vi bn tin (ch k s).
- Ton vn:
+ Thng tin khng b bp mo (ct xn, xuyn tc, sa i).
+ Thng tin c nhn phi nguyn vn c v ni dung v hnh thc.
- Kh dng: Mi ti nguyn v dch v ca h thng phi c cung cp y cho ngi
dng hp php.
1.2.3.4. m bo cht lng dch v (QoS)
y l mt ch tiu rt quan trng c bit l i vi cc dch v thi gian thc, nhy cm
vi tr (truyn ting ni, hnh nh, .)
Chng 2: Tn hiu v nhiu

11
CHNG II: TN HIU V NHIU
2.1. TN HIU XC NH V CC C TRNG VT L CA CHNG
Tn hiu xc nh thng c xem l mt hm xc nh ca bin thi gian t (s(t)). Hm
ny c th c m t bng mt biu thc gii tch hoc c m t bng th. Mt trong cc
c trng vt l quan trng ca tn hiu l hm mt ph bin phc S( )

. Vi tn hiu s(t)
kh tch tuyt i, ta c cp bin i Fourier sau:

j t
j t
S( ) s(t)e dt (2.1)
1
s(t) S( )e d (2.2)
2

=
=


Sau y l mt s c trng vt l quen thuc ca tn hiu:
- Thi hn ca tn hiu (T): Thi hn ca tn hiu l khong thi gian tn ti ca tn hiu,
trong khong ny gi tr ca tn hiu khng ng nht bng 0.
- B rng ph ca tn hiu (F): y l min xc nh bi tn s khc khng cao nht ca tn
hiu.
- Nng lng ca tn hiu (E): Nng lng ca tn hiu c th tnh theo min thi gian hay
min tn s.

2
2
1
E s (t)dt S( ) d [J] (2.3)
2



= =



(nh l Parseval)
- Cng sut ca tn hiu (P):

E
P [W]
T
=
2.2. TN HIU V NHIU L CC QU TRNH NGU NHIN
2.2.1. Bn cht ngu nhin ca tn hiu v nhiu
Nh xt trn, chng ta coi tn hiu l biu hin vt l ca tin (trong thng tin v tuyn:
dng vt l cui cng ca tin l sng in t). Qu trnh vt l mang tin din ra theo thi gian, do
v mt ton hc th khi c th c, cch biu din trc tip nht cho tn hiu l vit biu thc
ca n theo thi gian hay v th thi gian ca n.
Chng 2: Tn hiu v nhiu

12
Trong l thuyt c in, d tn hiu tun hon hoc khng tun hon nhng ta u coi l
bit trc v biu din n bng mt hm tin nh ca thi gian. l quan nim xc nh v tn
hiu (tn hiu tin nh). Tuy vy, quan nim ny khng ph hp vi thc t. Tht vy, tn hiu
tin nh khng th dng vo vic truyn tin tc c. Vi cch coi tn hiu l biu hin vt l ca
tin, nu chng ta hon ton bit trc n th v mt thng tin, vic nhn tn hiu khng c
ngha g. Nhng nu ta hon ton khng bit g v tn hiu truyn i, th ta khng th thc hin
nhn tin c. Bi v khi khng c ci g lm cn c phn bit tn hiu vi nhng ci khng
phi n, c bit l vi cc nhiu. Nh vy, quan nim hp l nht l phi k n cc c tnh
thng k ca tn hiu, tc l phi coi tn hiu l mt qu trnh ngu nhin. Chng ta s gi cc tn
hiu xt theo quan im thng k ny l cc tn hiu ngu nhin.
2.2.2. nh ngha v phn loi nhiu
Trong qu trnh truyn tin, tn hiu lun lun b nhiu yu t ngu nhin tc ng vo, lm
mt mt mt phn hoc thm ch c th mt ton b thng tin cha trong n. Nhng yu t ngu
nhin rt a dng, chng c th l nhng thay i ngu nhin ca cc hng s vt l ca mi
trng truyn qua hoc nhng loi trng in t cm ng trong cng nghip, y hcvv
Trong v tuyn in, ngi ta gi tt c nhng yu t ngu nhin y l cc can nhiu (hay nhiu).
Tm li, ta c th coi nhiu l tt c nhng tn hiu v ch (tt nhin l i vi h truyn tin ta xt)
c nh hng xu n vic thu tin. Ngun nhiu c th ngoi hoc trong h. Nu nhiu xc nh
th vic chng n khng c kh khn g v mt nguyn tc. V d nh ngi ta c nhng bin
php chng n do dng xoay chiu gy ra trong cc my khuch i m tn, ngi ta cng bit
r nhng cch chng s nhiu ln nhau gia cc in i v tuyn in cng lm vic m chng
c ph tn hiu trm nhauvv Cc loi nhiu ny khng ng ngi.
Ch :
Cn phn bit nhiu vi s mo gy ra bi c tnh tn s v c tnh thi gian ca cc thit
b, knh truyn (mo tuyn tnh v mo phi tuyn). V mt nguyn tc, ta c th khc phc
c chng bng cch hiu chnh.
Nhiu ng lo ngi nht vn l cc nhiu ngu nhin. Cho n nay, vic chng cc nhiu
ngu nhin vn gp nhng kh khn ln c v mt l lun ln v mt thc hin k thut. Do ,
trong gio trnh ny ta ch cp n mt dng no (sau ny s thy y thng xt nht l
nhiu cng, chun) ca nhiu ngu nhin.
Vic chia thnh cc loi (dng) nhiu khc nhau c th lm theo cc du hiu sau:
1. Theo b rng ph ca nhiu: c nhiu gii rng (ph rng nh ph ca nh sng trng gi
l tp m trng), nhiu gii hp (gi l tp m mu).
2. Theo quy lut bin thin thi gian ca nhiu: c nhiu ri rc v nhiu lin tc.
3. Theo phng thc m nhiu tc ng ln tn hiu: c nhiu cng v nhiu nhn.
4. Theo cch bc x ca nhiu: c nhiu th ng v nhiu tch cc.
Nhiu th ng l cc tia phn x t cc mc tiu gi hoc t a vt tr v i ta xt khi
cc tia sng ca n p vo chng. Nhiu tch cc (ch ng) do mt ngun bc x nng lng
(cc i hoc cc h thng ln cn) hoc my pht nhiu ca i phng cha vo i hoc h
thng ang xt.
Chng 2: Tn hiu v nhiu

13
5. Theo ngun gc pht sinh: c nhiu cng nghip, nhiu kh quyn, nhiu v trvv
Trong gio trnh ny khi ni v nhiu, ta ch ni theo phng thc tc ng ca nhiu ln
tn hiu, tc l ch ni n nhiu nhn hoc nhiu cng.
V mt ton hc, tc ng ca nhiu cng ln tn hiu c biu din bi h thc sau:
u(t) = s(t) + n(t) (2.4)
s(t) l tn hiu gi i
u(t) l tn hiu thu c
n(t) l nhiu cng
Cn nhiu nhn c biu din bi:
u(t) (t).s(t) = (2.5)
(t): nhiu nhn, l mt qu trnh ngu nhin. Hin tng gy nn bi nhiu nhn gi l
suy lc (fading).
Tng qut, khi tn hiu chu tc ng ng thi ca c nhiu cng v nhiu nhn th:
u(t) (t).s(t) n(t) = + (2.6)
y, ta coi h s truyn ca knh bng n v v b qua thi gian gi chm tn hiu
ca knh truyn. Nu k n thi gian gi chm ca knh truyn th (2.6) c dng:
u(t) (t).s(t ) n(t) = + (2.7)
2.3. CC C TRNG THNG K CA TN HIU NGU NHIN V NHIU
2.3.1. Cc c trng thng k
Theo quan im thng k, tn hiu v nhiu c coi l cc qu trnh ngu nhin. c trng
cho cc qu trnh ngu nhin chnh l cc quy lut thng k (cc hm phn b v mt phn b)
v cc c trng thng k (k vng, phng sai, hm t tng quan, hm tng quan). Cc quy
lut thng k v cc c trng thng k c nghin cu trong l thuyt hm ngu nhin, v
vy y ta s khng nhc li.
Trong lp cc qu trnh ngu nhin, c bit quan trng l cc qu trnh ngu nhin sau:
- Qu trnh ngu nhin dng (theo ngha hp v theo ngha rng) v qu trnh ngu nhin
chun dng.
- Qu trnh ngu nhin ergodic
Ta minh ho chng theo lc sau:


Chng 2: Tn hiu v nhiu

14

Hnh 2.1
Trong nhng c trng thng k ca cc qu trnh ngu nhin, hm t tng quan v hm
tng quan l nhng c trng quan trng nht. Theo nh ngha, hm t tng quan s bng:
{ }
[ ] [ ]
x 1 2 1 x 1 2 x 2
1 x 1 2 x 2 2 1 2 1 2 1 2
R (t , t ) M X(t ) m (t ) . X(t ) m (t )
x(t ) m (t ) . x(t ) m (t ) .W (x , x , t , t )dx dx


=

=

(2.8)
x 1 2
R (t , t ) c trng cho s ph thuc thng k gia hai gi tr hai thi im thuc cng
mt th hin ca qu trnh ngu nhin.
( )
2 1 2 1 2
W x , x , t , t l hm mt phn b xc sut hai chiu ca hai gi tr ca qu trnh
ngu nhin hai thi im
1
t v
2
t .
Khi t
1
= t
2
th (2.8) tr thnh:

[ ]
{ }
2
x 1 2 x x
R (t , t ) M X(t) m (t) D (t) = = (2.9)
Nh vy, phng sai l trng hp ring ca hm t tng quan khi hai thi im xt trng
nhau.
i khi tin tnh ton v so snh, ngi ta dng hm t tng quan chun ho c nh
ngha bi cng thc:

x 1 2 x 1 2
x 1 2
x 1 1 x 2 2 x 1 x 2
x 1 2
x 1 x 2
R (t , t ) R (t , t )
(t , t )
R (t , t ).R (t , t ) D (t ).D (t )
R (t , t )
(t ). (t )

= =
=

(2.10)
D dng thy rng:
x 1 2
(t , t ) 1 .



QTNN QTNN
dng dng QTNN
rng hp chun


QTNN chun dng
QTNN
QTNN ergodic
Chng 2: Tn hiu v nhiu

15
2.3.2. Khong tng quan
Khong tng quan cng l mt c trng kh quan trng. Ta thy rng hai gi tr ca mt
qu trnh ngu nhin (t) ch tng quan vi nhau khi khong cch gia hai thi im xt l
hu hn. Khi , th coi nh hai gi tr y khng tng quan vi nhau na. Tuy vy, trong
thc t, i vi hu ht cc qu trnh ngu nhin ch cn ln th s tng quan gia hai gi
tr ca qu trnh mt. Do , i vi tnh ton thc t ngi ta nh ngha khong (thi gian)
tng quan nh sau:
nh ngha 1:
Khong tng quan
K
l khong
thi gian trong ( )

khng nh hn
0,05. (hnh v 2.2). Nh vy, >
K
th
xem nh ht tng quan.
Nu cho biu thc gii tch ca ( )


th
K
c tnh nh sau:
K
1
( ) d
2

(2.11)
ngha hnh hc:
K
l na cnh y ca hnh ch nht c chiu cao bng n v K, c din tch bng din
tch ca min gii hn bi trc honh v ng biu din ( )

.
Trong thc t, ta thng gp nhng qu trnh ngu nhin ergodic. V d: tp m ca cc
my thu v tuyn in, i vi cc qu trnh ngu nhin ergodic, ta c th xc nh cc c
trng thng k ca chng bng thc nghim mt cch d dng.
Ta bit rng, nu X(t) ergodic v vi T ln th ta c th vit:

[ ] [ ] { }
[ ] [ ]
x x x
T
x x
0
R ( ) M X(t) m . X(t ) m
1
x(t) m . x(t ) m dt
T
=
+

(2.12)
Trung bnh thng k = trung bnh theo thi gian

1

()

0,05


0 k t
Hnh 2.2
Chng 2: Tn hiu v nhiu

16
2.4. CC C TRNG VT L CA TN HIU NGU NHIN V NHIU. BIN
I WIENER KHINCHIN
2.4.1. Nhng khi nim xy dng l thuyt ph ca qu trnh ngu nhin - mt ph
cng sut
Mc trc ta mi ch a ra mt s c trng thng k ca cc qu trnh ngu nhin (tn
hiu, nhiu) m cha a ra cc c trng vt l ca chng. V mt l thuyt cng nh thc t,
cc c trng vt l ca tn hiu ngu nhin (qu trnh ngu nhin) ng mt vai tr rt quan trng
nhng chng sau khi ni n c s l thuyt chng nhiu cng nh xt cc bin php thc t
v cc thit b chng nhiu ta khng th khng dng n nhng c trng vt l ca tn hiu ngu
nhin v nhiu. Khi xt cc loi tn hiu xc nh trong gio trnh L thuyt mch, chng ta
lm quen vi cc c trng vt l ca chng nh: nng lng, cng sut, thi hn ca tn hiu,
ph bin phc, mt ph, b rng ph, C s hnh thnh cc c trng vt l ny l
chui v tch phn Fourier.
i vi cc tn hiu ngu nhin v nhiu, ta khng th dng trc tip cc bin i Fourier
xy dng cc c trng vt l ca chng c v nhng l do sau:
- Tp cc th hin
{ }
i
x (t) , i 1, 2,..., = ca qu trnh ngu nhin X(t) cho trn khong T
thng l mt tp v hn (thm ch n cng khng phi l mt tp m c).
- Nu tn hiu ngu nhin l dng cht th tp v hn cc th hin theo thi gian ca n
thng s khng kh tch tuyt i. Tc l:

T 2
T
T 2
lim x(t) dt


trnh khi nhng kh khn trn, ta lm nh sau:
Ly hm
T
x (t) trng vi mt th hin ca qu trnh ngu nhin trung tm X(t) (QTNN trung
tm l QTNN c k vng khng) trong on
T T
,
2 2



v n bng khng ngoi on :
T
x(t) t T 2
x (t)
0 t T 2

=

>

(2.13)
T (2.13), ta thy
T
x (t) tho mn iu kin kh tch tuyt i nn c th dng bin i
Fourier cho n c. Ta bit rng ph bin phc
( )
T
S
`
ca
T
x (t) c xc nh bi
tch phn thun Fourier sau:

( ) ( )
T 2
j t
T T
T 2
S x t e dt

=

`
(2.14)
Theo nh l Parseval, ta c biu thc tnh nng lng ca
T
x (t) nh sau:
Chng 2: Tn hiu v nhiu

17

2
2
T
T T
1
E x (t)dt S ( ) d
2



= =


(2.15)
Cng sut ca th hin
T
x (t) s bng:

2
T 2
T
T
T
S ( )
E 1 1
P S ( ) d d
T 2 T 2 T

= = =


(2.16)
Ta thy v tri ca (2.16) l cng sut ca th hin
T
x (t) trong khong thi gian tn ti hu
hn T, cn v phi l mt tng lin tc ca cc i lng
2
T
S ( ) T d







. R rng l m
bo s bnh ng v th nguyn gia hai v ca (2.16) th lng
2
T
S ( )
d
T

phi biu th cng


sut trong gii tn v cng b d. Nh vy,
2
T
S ( )
T

s biu th cng sut ca th hin


T
x (t)
trong mt n v tn s [W/Hz] tc l mt ph cng sut ca th hin
T
x (t) . n y ta t:

2
T
T
S ( )
G ( )
T

= (2.17)
v gi
T
G ( ) l mt ph cng sut ca th hin
T
x (t) trong khong T hu hn.
T
G ( ) c trng cho s phn b cng sut ca mt th hin
T
x (t) trn thang tn s. Khi cho
T ta s tm c mt ph cng sut ca mt th hin duy nht
T
x (t) ca qu trnh
ngu nhin:

2
T
x T
T T
S ( )
G ( ) lim G ( ) lim
T

= = (2.18)
x
G ( ) cng c ngha tng t nh
T
G ( ) .
T (2.18) ta thy rng xc nh mt ph cng sut ca c qu trnh ngu nhin (tc l
tp cc th hin ngu nhin) th phi ly trung bnh thng k i lng
x
G ( ) , tc l:
Chng 2: Tn hiu v nhiu

18

{ }
2
T
x
T
S ( )
G( ) M G ( ) M lim
T

= = (2.19)
(2.19) l cng thc xc nh mt ph cng sut ca cc qu trnh ngu nhin.
2.4.2. Cp bin i Wiener Khinchin
thy c mi quan h gia cc c trng thng k (ni ring l hm t tng quan) v cc
c trng vt l (ni ring l mt ph cng sut) ta vit li v thc hin bin i (2.19) nh sau:

{ }
1 2
1 2
2 2
T T
T T
*
T T
T
T 2 T 2
j t j t
T 1 1 T 2 2
T
T 2 T 2
T/ 2 T/ 2
j (t t )
T 1 T 2 1 2
T
T/ 2 T/ 2
S ( ) MS ( )
G( ) M lim lim
T T
1
lim M S ( )S ( ) do (2.14)
T
1
lim M x (t )e dt . x (t )e dt
T
1
lim M x (t ).x (t ) e dt dt
T




= = =


=





= =



=



Nhng theo nh ngha (2.8), ta thy ngay
{ }
T 1 T 2
M x (t ).x (t ) l hm t tng quan ca
qu trnh ngu nhin trung tm (c
x
m 0 = ) nn ta c th vit:

{ }
T 1 T 2 T 1 2
M x (t ).x (t ) R (t , t ) =
Nu
2 1
t t = + th i vi nhng qu trnh dng, ta c:
{ }
T 1 T 2 T
M x (t ).x (t ) R ( ) =

Ta c th vit li biu thc cho
( )
G :

2
2
2
2
T
t
T/ 2
2
j
T 2
T
T
T/ 2
t
2
T
t
T/ 2
2
j
T 2
T T
T
T/ 2
t
2
1
G( ) lim R ( )e d dt
T
1
lim R ( )e d . lim dt
T
+



+






=



=



Chng 2: Tn hiu v nhiu

19

j
G( ) R( )e d

(2.20)
Tt nhin y phi gi s tch phn v phi ca (2.20) tn ti. iu ny lun lun ng
nu hm t tng quan R( ) kh tch tuyt i, tc l:
R( )d

<


(2.20) l mt ph cng sut ca qu trnh ngu nhin dng. N biu din mt cch trung
bnh (thng k) s phn b cng sut ca qu trnh ngu nhin theo tn s ca cc thnh phn dao
ng iu ho nguyn t (tc l nhng thnh phn dao ng iu ho v cng b).
Nh vy, t (2.20) ta c th kt lun rng ph cng sut G( ) ca qu trnh ngu nhin
dng l bin i thun Fourier ca hm t tng quan R( ) . Hin nhin rng khi tn ti bin
i thun Fourier th cng tn ti bin i ngc Fourier sau:

j
1
R( ) G( )e d
2


(2.21)
Cp cng thc (2.20) v (2.21) gi l cp bin i Wiener Khinchin, l s m rng cp
bin i Fourier sang cc tn hiu ngu nhin dng (t nht l theo ngha rng).
R rng t nh ngha (2.17) ca mt ph cng sut, ta thy hm G( ) l hm chn
ca i s . Do sau khi dng cng thc Euler (
j
e cos jsin

= ) bin i
(2.20) v (2.21), ta c:

0
0
G( ) 2 R( )cos d
1
R( ) G( )cos d

=
=

(2.22)
Ch 1: T mt ph cng sut ca tn hiu ngu nhin, khng th sao li bt c mt th
hin no (l hm ca thi gian t) ca n, v G( ) khng cha nhng thng tin (nhng hiu bit)
v pha ca cc thnh phn ph ring l. i vi tn hiu xc nh th t mt ph hon ton c
th sao li chnh tn hiu nh tch phn ngc Fourier. l ch khc nhau v bn cht gia
bin i Fourier v bin i Wiener Khinchin.
Ch 2: Nu phi xt ng thi hai qu trnh ngu nhin th ngi ta cng a ra khi
nim mt ph cho. Mt ph cho v hm tng quan cho ca hai qu trnh ngu nhin c
lin h dng cng tho mn cp bin i Wiener Khinchi.
2.4.3. B rng ph cng sut
Chng 2: Tn hiu v nhiu

20
Mt c trng vt l quan trng khc ca
cc tn hiu ngu nhin l b rng ph cng sut,
n c nh ngha bi cng thc sau:

0
0
G( )d
G( )

(2.23)
Trong :
G( ) l mt ph cng sut ca tn hiu
ngu nhin.
G(
0
) l gi tr cc i ca G( ).
l b rng ph cng sut (cn gi l
b rng ph) ca qu trnh ngu nhin.
ngha hnh hc:
B rng ph chnh l y ca hnh ch nht c chiu cao bng G(
0
) v c din tch
bng din tch ca min gii hn bi trc v ng cong biu din G( ). (Hnh 2.4).
ngha vt l:
B rng ph c trng cho s tp trung cng sut (hoc nng lng) ca tn hiu ngu nhin
quanh mt tn s trung tm, ngoi ra n cng c trng cho c s bng phng ca ph quanh
tn s trung tm
0
.
2.4.4. M rng cp bin i Wiener Khinchin cho trng hp R( ) khng kh tch
tuyt i
Nu qu trnh ngu nhin X(t) cha cc thnh phn dao ng iu ho dng:

K K K K
X (t) A cos( t ) =
trong
K
A v
K
ni chung c th l cc i lng ngu nhin, th hm tng quan trung bnh:

K
2
*
K
X K
A
R ( ) cos
2
= khng tho mn iu kin kh tch tuyt i.
Nu s dng biu din sau ca hm delta:

ixy
e dx cos(xy)dx (y)


= =


v biu din ph nng lng ca
K
X (t) di dng:

0,05



0



G()
Hnh 2.3
Chng 2: Tn hiu v nhiu

21

[ ]
2
*
K
K K K
A
G ( ) ( ) ( )
4
= + +
th nh l Wiener Khinchin s ng c i vi nhng qu trnh ngu nhin c nhng
thnh phn tn s ri rc, k c thnh phn mt chiu tn s
K
= 0.







2.5. TRUYN CC TN HIU NGU NHIN QUA CC MCH V TUYN IN
TUYN TNH
i vi cc tn hiu xc nh, trong gio trnh L thuyt mch, ta xt bi ton phn
tch sau: Cho mt mch tuyn tnh c cu trc bit (bit hm truyn t K( )

hoc bit phn


ng xung g(t)). Ta phi xt tc ng u vo theo hng ng u ra v ngc li. i vi cc tn
hiu ngu nhin nu s th hin l m c v hu hn th ta c th xt hng ng ra i vi
tng tc ng u vo nh bi ton trn. Nhng khi s th hin ca tn hiu ngu nhin l v hn
th ta khng th p dng c nhng kt qu ca bi ton phn tch i vi cc tn hiu xc nh.
Sau y ta s xt bi ton ny.
2.5.1. Bi ton ti thiu
2.5.1.1. Bi ton:
Cho mt mch tuyn tnh (c tham s khng i v bit K( )

ca n. Bit mt ph
cng sut
v
G ( ) ca qu trnh ngu nhin tc ng u vo. Ta phi tm mt ph cng sut
ra
G ( ) v hm t tng quan
ra
R ( ) ca qu trnh ngu nhin u ra.

2.5.1.2. Gii bi ton:
gio trnh L thuyt mch ta bit hm ph bin phc ca tn hiu u ra mch
v tuyn in tuyn tnh bng:

ra v
S ( ) K( ).S ( )

= (2.24)

K() G
V
()

G
ra
())
Ph bin S
K
()

A
K
/2 A
K
/2



-
K
0
K

Ph nng lng G
K
()

( +
K
) ( -
K
)



-
K
0
K

Chng 2: Tn hiu v nhiu

22
Trong : K( )

l hm truyn ca mch bit.



v
S ( )

l ph bin phc ca tn hiu vo


Ch : i vi cc qu trnh ngu nhin ta khng bit c
v
S ( )

. Khng th tnh c
v
S ( )

, mt khc ta bit theo (2.19):



2
2
v
T
ra
T
v
T T
2
ra
T
ra
2 2
T
S ( )
S ( )
1
G ( ) M lim M lim
T T
K( )
S ( )
1 1
M lim .G ( )
T
K( ) K( )


= =

= =


Hay:
2
ra v
G ( ) K( ) .G ( )

= (2.25)
Ngi ta chng minh c rng hng ng ra ca h thng tuyn tnh c tham s khng
i l mt qu trnh ngu nhin khng dng ngay c khi tc ng u vo l mt qu trnh ngu
nhin dng.
Tuy vy, trong trng hp h thng tuyn tnh th ng c suy gim th nhng thi im
t >> t
0
= 0 (thi im t tc ng vo) th qu trnh ngu nhin u ra s c coi l dng.
Khi hm t tng quan v mt ph cng sut ca qu trnh ngu nhin u ra s
lin h vi nhau theo cp bin i Wiener Khinchin. Ta c:

j
ra ra
1
R ( ) G ( )e d
2


(2.26)
Nhn xt:
T (2.25) ta thy mt ph cng sut ca hng ng ra c quyt nh bi bnh phng
mun hm truyn ca mch khi cho ph cng sut ca tc ng vo, n khng ph thuc g
vo c tnh pha tn ca mch.
Cng sut ca qu trnh ngu nhin u ra (khi qu trnh ngu nhin vo l dng):
Chng 2: Tn hiu v nhiu

23

2
2
ra ra ra v
1 1
R (0) G ( )d P K( ) G ( )d
2 2



= = = =


(2.27)
Nu ph cng sut ca tc ng vo khng ph thuc tn s, tc l
v
G ( ) =
0
N (qu
trnh ngu nhin c tnh cht ny c gi l tp m trng) th:

2
ra 0
1
P N K( ) d
2


(2.28)
V mun hm truyn lun l mt hm chn nn:

2
ra 0
0
2
P N K( ) d
2


(2.29)
Mt khc, nu gi
0
G l ph cng sut thc t (phn ph cng sut tri t 0 ) th
0
G = 2
0
N v (2.29) c th vit li nh sau:

2
0
ra
0
G
P K( ) d
2


(2.30)
Hm t tng quan ca qu trnh ngu nhin u ra trong trng hp ny s bng:

2
j
ra v
2
j
0
2
j
0
1
R ( ) G ( ) K( ) e d
2
1
N K( ) e d
2
N
K( ) e d
2



2
0
ra
0
G
R ( ) K( ) cos d
2

(2.31)
2.5.1.3. V d 1
Mt mch v tuyn in tuyn tnh c tham s khng i v c tnh truyn t dng ch
nht (hnh 2.4b) chu tc ng ca tp m trng dng. Tm hm t tng quan ca tp m ra.


G
V
()

2N
0






0
1

0

2

| K() |
Chng 2: Tn hiu v nhiu

24






Theo gi thit:
v 0
G ( ) 2N = v
0 1 2
1 2
K
K( )
0 ( , )

< <


Theo (2.31), ta c:

2
1
2
2
0 0 0
ra 0 2 1
2
0 0
0
N N K
R ( ) K cos d = (sin sin )
sin
N K
2
. cos
2



2
ra ra 0
sin
2
R ( ) cos
2

(2.32)
th
( )
ra
R nh hnh 2.5.
(2.32) c th vit gn li nh sau:

ra 0ra 0
R ( ) R ( )cos = (2.32a)
Trong :

2
0ra ra
sin 2
R ( )
2

(2.32b)
(2.32b) gi l bao ca hm t tng quan ca hng ng.

1 2
0
2
+
= (2.32c)
gi l tn s trung bnh.
Chng 2: Tn hiu v nhiu

25


Vy, bao ca hm t tng quan ca tp m ra l mt hm ca i s dng
sin x
x
. Cc
i ca hm t tng quan ca tp m ra t ti = 0 v bng
2
ra
, tc l bng cng sut trung
bnh ca tp m ra.
By gi ta s chuyn sang xt mt tham s vt l na nh gi mc truyn tp m qua
mch tuyn tnh.
2.5.1.4. Gii thng tp m
nh ngha:
Gii thng tp m ca
mch tuyn tnh (hay b lc
tuyn tnh) c xc nh theo
biu thc sau:
2
0
t
2
K( ) d
K( ) m

ax

(2.33)
2/

R
ra
()

2
ra

0






0


ta

| K()|
2


| K()|
2
max

Hnh 2.6.
Hnh 2.5.
Chng 2: Tn hiu v nhiu

26
ngha hnh hc:
t
chnh l y ca hnh ch nht c din tch bng din tch ca
min gii hn bi ng cong
2
K( )

v na trc honh (0, ); cn chiu cao ca hnh ch


nht ny l
2
K( )

max.
ngha vt l:
t
c trng cho kh nng lm suy gim tp m ca cc b lc tuyn tnh. Vi cng
0
K( )

, b lc no c
t
cng hp th cng sut tp m u ra ca b lc y cng b.
2.5.2. Bi ton ti a
R
G ( ) v
R
B ( ) cha c trng y cho qu trnh ngu nhin.
Ni dung: Tm hm mt xc sut ca tn hiu u ra mch v tuyn in tuyn tnh.
2.5.2.1. M u
Tm mt xc sut n chiu ca tn hiu ngu nhin u ra mch tuyn tnh l bi ton rt
kh, n khng gii c di dng tng qut. Di y ch xt hai trng hp n gin:
- Tm mt xc sut mt chiu ca tn hiu ra b lc tuyn tnh khi tc ng u vo l tn
hiu ngu nhin chun (c v hn th hin). Trong trng hp ny ngi ta chng minh c
tn hiu ra cng l mt tn hiu ngu nhin chun.
- t vo b lc tuyn tnh mt tn hiu ngu nhin khng chun. Nu
t
1
2 F

<<

(F l
b rng ph ca tn hiu vo) th tn hiu ngu nhin u ra s c phn b tim cn chun.
Ngi ta bo l s chun ho (Gauss ho) cc qu trnh ngu nhin khng chun bng b lc
gii hp.
2.5.2.2. V d 2
Cho tp m gii hp, chun c dng:

0
n(t) c(t)c t s(t)sin t A(t)c t )
0 0
os os( = + = (*)
vi c(t) v s(t) c phn b chun cng cng sut trung bnh v vi
s(t)
arctg
c(t)
=
2 2
A(t) c (t) s (t) = + - ng bao ca nhiu.
Chng 2: Tn hiu v nhiu

27
Cng sut trung bnh ca c hai thnh phn ca nhiu bng nhau v bng hng s:
2 2 2
c s
= = . Khi n(t) dng, ngi ta coi l hai thnh phn ca nhiu khng tng quan.
Tc ng n(t) ln b tch sng tuyn tnh. Hy tm mt xc sut mt chiu ca in p ra
b tch sng bit rng b tch sng khng gy mo ng bao v khng gy thm mt lng dch
pha no. Thc cht ca bi ton l phi tm (A) v
1 1
W W ( ) .
Trong gio trnh l thuyt xc sut, ta c cng thc tm mt xc sut mt chiu ca
tng i lng ngu nhin theo mt xc sut ng thi ca chng, nn ta c:

2
0 0
(A) (A, )d ; ( ) (A, )dA
1 2 1 2
W W W W

= =


Do , vn y l phi tm (A, )
2
W .
V b tch sng khng gy mo ng bao v khng gy thm mt lng dch pha no nn
(A, )
2
W u ra cng chnh l (A, )
2
W u vo.
Tm (A, )
2
W : V u bi ch cho (c) v (s)
1 1
W W nn ta phi tm (A, )
2
W theo
(c,s)
2
W .
Theo gi thit c(t) v s(t) khng tng quan nn:
(c,s)
2
W = (c). (s)
1 1
W W (2.34)
( )
2 2 2 2
2 2
c 2 s 2
2
2 2
1 1 1 c s
W c,s e . e exp
2 2 2 2


+
= =






( )
2
2
2 2
1 1
W c,s exp A
2 2

=


(2.35)
Ta thy xc sut mt im c to (c,s) trong h to cac ri vo mt yu t din
tch dcds s bng: (c,s)
dcds 2
P W dcds = . n (*) ta thy xc sut ny cng chnh l xc
sut mt im c to (A, ) trong h to cc ri vo mt yu t din tch dAd. Ta c:
Chng 2: Tn hiu v nhiu

28

(c,s) (A, )
dcds 2 2
P W dcds = W dAd =

(2.36)
T :
(A, ) (c,s)
2 2
dcds
W W
dAd
=

(**)
T H.2.7 ta thy vi dA, d nh ta c: dc ds = Ad. DA
T (**) ta c:
( ) ( )
2
2 2
2 2
1 A
W A, W c,s exp
2 2


= =




(2.37)
Do :
( ) ( )
2 2
2
1 2
2 2
0 0
A A
W A W A, d exp d
2 2



= =






( )
2
1
2 2
A A
W A exp
2


=




(2.38)
(2.38) gi l phn b Reyleigh (H.2.8).

d
dA
S + dS

S
S

0 c c + dc c

A
Hnh 2.7.
Chng 2: Tn hiu v nhiu

29

Vy nhiu gii hp m tr tc thi c phn b chun th phn b ca ng bao l phn b
khng i xng Reyleigh. S d nh vy v gi tr tc thi c c gi tr m v gi tr dng nn
phn b mt xc sut s i xng qua trc tung (phn b Gausse). Cn xt ng bao tc l
ch xt bin (gi tr dng) nn mt phn b xc sut l ng cong khng i xng v ch
tn ti na dng trc honh.
( ) ( )
2
1 2
2 2
0 0
1 A A
W W A, dA exp dA
2
2



= =





( ) ( )
1 1
0
1
W W A dA
2

(2.39)
Vy mt phn b xc sut pha u ca nhiu gii hp, chun l phn b u trong
khong (0,2 ). (H.2.9).
2.5.2.3. V d 3:
u vo b tch sng tuyn tnh t hn hp tn hiu v nhiu:
y(t) = x(t) + n(t)
Vi:
0
x(t) U c t
0
os = l tn hiu xc nh.

[ ]
n
n(t) A (t)c t (t)
0
os = l nhiu gii hp, chun.
Tm mt phn b xc sut ng bao v pha ca in p u ra b tch sng tuyn tnh.
Ta c:

[ ]
0 0
0 0 y y
y(t) U c t c(t)c t s(t)sin t
U c(t) c t s(t)sin t A (t)c t (t)
0 0
0 0
os os
os os
= + +

= + + =


Trong :
[ ]
2
2
y 0
A (t) U c(t) s (t) = + + l bao ca hn hp tn hiu v nhiu.

y
(t)
c(t)
0
s(t)
arctang
U
=
+
l pha ca hn hp tn hiu v nhiu.
Lm tng t nh VD2, ta c:
W
1
(A/)

0,6

0,4

0,2


0 1 2 3 A/
Hnh 2.8.
W
1
()

1/2

0 2
Hnh 2.9.
Chng 2: Tn hiu v nhiu

30

( )
( ) ( ) ( )
2 2
y y 0 y 0
1 y 0
2 2 2
A t A t U A t U
W A exp .I

+ +

=





(2.40)
(2.40) gi l phn b Rice (H.2.10a).
I
0
l hm Bessel bin dng loi 1 cp 0.

2
zc
0
0
1
I (z) e d
2
os



I
0
(z) c th vit di dng chui v hn sau:

2n
0
2
n 0
1 z
I (z)
2
(n!)

=

=


Khi z << 1:
2
2
z 4
0
z
I (z) 1 ... e
4
= + +
Nhn xt:
- Khi a = 0 khng c tn hiu, ch c nhiu gii hp, chun phn b Rice tr v
phn b Reyleigh.
- a cng ln, phn b Rice cng tin ti phn b Gausse.
Gii thch:
a >> 1 tn hiu mnh, nhiu yu. Tn hiu tc dng vi thnh phn khng trc giao vi
n ca nhiu (khi tn hiu cng mnh th hn hp ny cng t khc tn hiu), cn thnh phn ca
nhiu trc giao vi tn hiu th khng chu s chn p ca tn hiu. Do mt phn b xc
sut bao ca hn hp s mang c im ca thnh phn nhiu trc giao vi tn hiu.
( )
2
2
0 y 0 y 0 y
0
1 y
2 2
2 2
U cos U cos U sin
U 1
W exp 1 exp
2
2
2 2 2



= + +





(2.41)
Trong :
2
z
2
0
2
(z) e d
2

=

l tch phn xc sut.


th (2.41) biu din trn hnh H.2.10b.




W
1
(
y
)

a = 5



a = 2 U
0
/ = 0
a = U
0
/ = 0
a = 2
a = 4
0,2
0,4
W(A
y
/)
Chng 2: Tn hiu v nhiu

31








Nhn xt:
- a = 0 ch c nhiu
y
( )
1
W chnh l ( )
1
W xt VD2.
- a >> 1 ng cong
y
( )
1
W cng nhn, hp.
Gii thch:
Vi a cng ln th c th b qua nh hng xu ca nhiu. Do ng bao (bin tn
hiu) khng c gia s (khng thng ging) v cng khng c sai pha. Khi
y
nhn gi tr 0
trong khong (- , ) vi xc sut ln.
2.6. BIU DIN PHC CHO TH HIN CA TN HIU NGU NHIN TN HIU
GII HP
2.6.1. Cp bin i Hilbert v tn hiu gii tch
2.6.1.1. Nhc li cch biu din mt dao ng iu ho di dng phc
Cho: x(t) =
( )
0 0
A c t A(t)c
0
os os (t) + = (2.42)
Trong :
0
: tn s trung tm; (t) : pha y ;
0
: pha u.
Trong L thuyt mch, ngi ta rt hay
dng cch biu din x(t) di dng phc sau:
j (t)
x(t) x(t) jx(t) A(t)e


= + = (2.43)
Trong :
x(t) = Re [ x(t)

];
x(t)

= Im [ x(t)

] =
0
A sin (t)
Im[x(t)]

x(t) M

A

(t)

0 x(t) Re[x(t)]
Hnh 2.11
Chng 2: Tn hiu v nhiu

32
Ta c th biu din x(t)

di dng mt vecteur trn mt phng phc.


Khi A(t) = const th qu tch ca im M s l mt vng trn tm O, bn knh OM.
(t) d (t) dt = l tn s ca dao ng (H.2.11)
2.6.1.2. Cp bin i Hilbert Tn hiu gii tch
a. Cp bin i Hilbert v tn hiu gii tch:
d dng biu din di dng phc nhng th hin phc tp ca cc qu trnh ngu nhin,
ngi ta dng cp bin i Hilbert. N cho php ta tm x(t)

khi bit x(t) v ngc li.


Hilbert chng t rng phn thc v phn o ca hm phc (2.43) lin h vi nhau bi cc
bin i tch phn n tr hai chiu sau:

x( )
x(t) Im (t) d
t
1
[ x ] =

= =

h [x(t)] (2.44)

x( )
x(t) d Re (t)
t
1
[ x ]

= = =

h
1
[x(t)] (2.45)
Cp cng thc trn c gi l cp bin i Hilbert. Trong (2.44) gi l bin i thun
Hilbert, cn (2.45) gi l bin i ngc Hilbert.
Ch :
Cng ging nh tnh cht ca cc tch phn, bin i Hilbert l mt php bin i tuyn
tnh.
(Mt php bin i f c gi l tuyn tnh nu c:
f(x
1
+ x
2
) = f(x
1
) + f(x
2
)
f(kx) = k f(x), k = const)
Cc hm x(t) v x(t)

c gi l lin hip Hilbert i vi nhau. Tn hiu phc x(t)

c
phn thc v phn o tho mn cp bin i Hilbert gi l tn hiu gii tch (tng ng vi tn
hiu thc x(t)).
b. Bin i Hilbert i vi tn hiu hnh sin:
Trong mc ny ta s chng t c t
0
os v t
0
sin tho mn cp bin i H. Tht vy:
Chng 2: Tn hiu v nhiu

33
1 c 1 c (t ) t
x(t) d d
t t
1 c (t ).c t sin (t ).sin t
d
t
c t c (t ) sin t sin (t )
d d
t t
0 0 0
0 0 0 0
0 0 0 0
os os[ ]
os os ]
os os




= = =

+
= =


= +



Ch rng:
c
dz 0
osaz
z

v
sin
dz
az
z



0
x(t) sin t

=
Vy (
0
sin t ) l lin hp H ca (
0
c t os )
Tng t ( -
0
c t os ) l lin hp phc H ca (
0
sin t )
c. Bin i H i vi cc hm tng qut hn:
- i vi cc hm tun hon x(t):
Trong L thuyt mch ta bit, chui Fourier ca hm tun hon (tho mn iu kin
Dirichlet) l:

K K 0
K 0
x(t) (a c K t b sinK t)
0
os

=
= +

(2.46)
V bin i H l bin i tuyn tnh nn bin i H ca tng bng tng cc bin i H ca
cc hm thnh phn, nn:
x(t)

= h [x(t)]
K K 0
K 0
(a sinK t b c K t)
0
os

=
=

(2.47)
(2.46) v (2.47) gi l chui lin hip H.
- x(t) khng tun hon:
Nu hm khng tun hon x(t) kh tch tuyt i th khai trin Fourier ca n l:

0
1
x(t) a( )c t b( )sin t
2
[ os ]d

= +

(2.48)
Khi :
Chng 2: Tn hiu v nhiu

34
x(t)

= h [x(t)] =
1
2
h
0
[a( )cos t + b( )sin t]d


{ }
0
1
H[a( )cos t] + H[b( )sin t] d
2



0
1
[a( )sin t - b( )cos t]d
2

(2.49)
(2.48) v (2.49) gi l cc tch phn lin hip H.
d. Cc yu t ca tn hiu gii tch:
T (2.46) v (2.47) (hoc t (2.48) v (2.49)) ta xy dng c tn hiu gii tch ng vi tn
hiu thc x(t) nh sau:

j (t)
x(t) x(t) jx(t) A(t)e


= + =
x(t) = Re [ x(t)

] = A(t)cos (t) (a)


x(t)

= Im [ x(t)

] = A(t)sin (t) (b)


- ng bao ca tn hiu gii tch:
T (a) v (b) ta thy:
2
2
A(t) x (t) x (t)

= + (2.50)
A(t) c trng cho s bin
thin (dng bin thin) ca bin
ca tn hiu (H.2.12).
A(t) c gi l ng bao
ca tn hiu (cn gi l bin
bin thin hay bin tc thi ca
tn hiu).
- Pha tc thi ca tn hiu
gii tch:
K hiu pha tc thi: (t)
bng:
x(t)
(t) arctg
x(t)

= (2.51)
t
x(t)
A(t)
Hnh 2.12
Chng 2: Tn hiu v nhiu

35
- Tn s gc tc thi ca tn hiu gii tch
(t)
:
d (t) x(t)
(t) arctg
dt x(t)


= = =



2 2
2
2
x(t) x(t)
x(t) x (t) x(t)x (t)
x (t) x (t) x (t)
1
x (t)






=
+
+
(2.52)
- Tnh cht ca A(t):
+ A(t) x(t)
+ Khi x(t)

= 0 A(t) = x(t)
+ Xt:
2
2
x(t).x (t) x(t).x (t)
A (t)
x (t) x (t)

+
=
+

Khi x(t)

= 0 A(t) = x(t)
Vy khi x(t)

= 0 th nghing ca A(t) v x(t) l nh nhau.


- Kt lun:
i vi cc tn hiu ngu nhin th cc yu t ca tn hiu l ngu nhin. Nh c
khi nim tn hiu gii tch nn ta mi nghin cu cc tnh cht thng k ca cc yu
t ca n c thun li, c bit l trong tnh ton.
2.6.2. Tn hiu gii rng v gii hp
2.6.2.1. Tn hiu gii rng
Ngi ta gi mt tn hiu l tn hiu gii rng
nu b rng ph ca n tho mn bt ng thc
sau:

0
1

(2.53)
Nhn chung tn hiu gii rng l tn hiu m
b rng ph ca n c th so snh c vi
0
.
Trong
2 1
= v
2 1
0
2
+
= gi l tn s trung tm (xem H.2.13).



0
1

0

2


G()
Hnh 2.13
Chng 2: Tn hiu v nhiu

36
V d: Cc tn hiu iu tn, iu xung, iu ch m xung, manip tn s, manip pha, l
cc tn hiu gii rng.
2.6.2.2. Tn hiu gii hp
Nu tn hiu c b rng ph tho mn:

0
1

(2.54)
Th n c gi l tn hiu gii hp. (H.2.14).
V d: tn hiu gii hp l cc tn hiu nh:
tn hiu cao tn hnh sin, tn hiu cao tn iu bin,
tn hiu n bin .
Nhn chung tn hiu gii hp l tn hiu m b
rng ph ca n kh nh hn so vi tn s
0
.
2.6.2.3. Biu din tn hiu gii hp
Nu mt tn hiu gii hp c biu thc gii tch sau:

0
x(t) A(t)cos[ t (t)] = A(t)cos (t) = (2.55)
Trong :
0
t l thnh phn thay i tuyn tnh ca pha chy (pha tc thi)
(t) l thnh phn thay i chm ca pha chy
A(t) l ng bao ca tn hiu
Th (2.55) c th khai trin nh sau:

0 0
0 0
x(t) A(t)cos t cos (t) A(t)sin t sin (t)
A(t)cos (t)cos t A(t) sin (t) sin t
= +
= +
_ _

= c(t). cos
0
t + s(t). sin
0
t (2.56)
c(t). cos
0
t l tn hiu iu bin bin i chm
s(t). sin
0
t l tn hiu iu bin bin i chm
Vy mt tn hiu gii hp hnh sin bao gi cng c th biu din di dng tng ca hai tn
hiu iu bin bin i chm, vi cc yu t xc nh nh sau:

0
1

0

2


G()
Hnh 2.14
Chng 2: Tn hiu v nhiu

37

2 2
A(t) c (t) s (t)
s(t)
(t) arctg
c(t)
d (t)
(t)
dt

= +

(2.57)
R rng l cc s hng v phi (2.56) tho mn cp bin i Hilbert.
Vic biu din mt tn hiu gii hp thnh tng ca hai tn hiu iu bin bin thin chm s
lm cho vic phn tch mch v tuyn in di tc ng ca n n gin i nhiu. Ta s xt li
bi ton ny phn sau.
2.7. BIU DIN HNH HC CHO TH HIN CA TN HIU NGU NHIN
2.7.1. Khai trin trc giao v biu din vecteur ca tn hiu
2.7.1.1. Nng lng ca chui Kachennhicov
Ta bit rt r khai trin trc giao Fourier cho cc hm x(t) c ph v hn. gio trnh
L thuyt mch, ta cng bit rng mt hm x(t) c ph khng cha tn s ln hn Fc c th
phn tch thnh chui trc giao Kachennhicov sau:

c
c
K
sin2 F (t K t)
x(t) x(K t)
2 F (t K t)

=

=

(2.58)
Trong :
c
t 1 2F =
Nu ta ch xt tn hiu c ph hu hn x(t) trong khong thi gian T hu hn th ta c biu
thc gn ng sau tnh nng lng ca n:

2
T 2 T 2
n
2
c
K
c
K 1
T 2 T 2
sin (t K t)
E x (t)dt x dt
(t K t)
=



=



(*)
Trong n l s cc gi tr ri rc (cn gi l cc gi tr mu) ca th hin tn hiu x(t)
trong khong quan st T; cn x
K
l gi tr mu th K ca x(t) ti thi im ri rc K t . cho
gn, ta t
c
(t K t) = , khi (*) c dng:

2
T 2 T 2
2 n n
2
K K
2
c c
K 1 K 1
T 2 T 2
1 sin 1 sin
E x d x d
= =



=







Ta c:
T 2
2
2
T 2
sin
d

(vi T kh ln)
Chng 2: Tn hiu v nhiu

38

n n
2 2
K K
c c
K 1 K 1
1
E x x
2F
= =

= =


(2.59)
(2.59) cho ta tnh c nng lng ca chui
2.7.1.2. Biu din x(t) thnh vect x

trong khng gian n chiu


Khai trin Kachennhicov (2.58) l mt dng khai trin trc giao. Cc hm
c
K
c
sin (t K t)
(t)
(t K t)

=

l cc hm trc giao.
c
c c
c c
i K
sin (t K t) sin (t i t)
. dt
(t K t) (t i t) 0 i K


=

=


V vy ta c th coi mi hm l mt vecteur n v trn h trc to trc giao. Khi T hu
hn th K
max
= n cng s hu hn. Khi ta c th coi x(t) l mt vect x

trong khng gian n


chiu c cc thnh phn (hnh chiu) trn cc trc to tng ng l x(K t) , (K = 1, n ).

{ }
{ }
1 2 n
x(t) x(t t), x(t 2 t),..., x(t n t)
x(t) x , x ,..., x x




Theo nh ngha, di (hay chun) ca vecteur x

s l:

n
2
K
K 1
x x ( x, x)

=

= =

(2.60)
n (2.59), ta c:

c c
x 2F E 2F T.P nP

= = = (2.61)
(
c
T
n 2F T
t
= =

)
Trong P l cng sut ca th hin tn hiu trong khong hu hn T. Nh vy, vi thi
hn quan st v b rng ph ca th hin cho trc th di ca vecteur biu din t l vi cn
bc hai cng sut trung bnh ca n. Nu cho trc cng sut trung bnh P th di ca vecteur
x

s t l vi n (tc l t l vi cn bc hai ca y tn hiu B =


c
n
F T
2
= )
Nhn xt:
Chng 2: Tn hiu v nhiu

39
Nh vy, vi cng mt cng sut trung bnh tn hiu no c y cng ln (tc l tn hiu
cng phc tp) th di ca vecteur biu din n cng ln. Khi y ca tn hiu cng ln th
di ca vecteur tn hiu cng ln vecteur tng ca tn hiu v nhiu gii hp cng t khc
vecteur tn hiu ta s nhn ng c tn hiu vi xc sut cao. tnh chng nhiu ca tn
hiu cng cao th yu cu B cng phi ln.
Trong trng hp x(t) khng ri rc ho:
T
2
x
0
E x (t)dt =

. Khi chun ca vecteur s


l:

T
2
c x c
0
x ( x, x) 2F E x 2F x (t)dt

= = =

(2.62)
Ngi ta cn gi khng gian m chun ca vecteur cho bi tch v hng (2.62) l khng
gian Hilbert v k hiu l L
2
. Khng gian L
2
l s m rng trc tip ca khng gian Euclide hu
hn chiu ln s chiu v hn.
2.7.2. Mt xc sut ca vecteur ngu nhin - Khong cch gia hai vecteur tn hiu
2.7.2.1. Mt xc sut ca vecteur ngu nhin
a. Vecteur tn hiu:
tip tc nhng vn sau ny c thun tin, ta a vo khi nim vecteur tn hiu.
nh ngha:
Vecteur tn hiu
0
x

l vecteur sau:
0
x
x
n


= (2.63)
Trong x

l vecteur biu din tn hiu x(t) trong khng gian n chiu.


Tnh cht:

+
0
x

c phng v chiu trng vi x


+ ln (modul):
0
x
x P
n

= =
b. Xc sut phn b ca mt vecteur
0
x

v min xc nh ca n
Trong khng gian tn hiu, tn hiu c biu din bi vecteur. Do xc sut tn ti tn
hiu mt min (ni ring: ti mt im) no y ca khng gian chnh l xc sut mt
vecteur tn hiu ri vo min y (ni ring: im y) ca khng gian.
Chng 2: Tn hiu v nhiu

40
Nu x(t) l xc nh th mt ca vecteur
0
x

ch chim mt im trong khng gian n chiu.


Cn nu x(t) l ngu nhin c mt tp cc th hin
{ }
i
x (t) th mt vecteur
0
x

ca n s chim
mt min no trong khng gian n chiu vi th tch:
1 2 n
V x . x .... x = . Khi y, xc sut
tn ti tn hiu ngu nhin trong min c th tch dV s l:

{ }
( )
1 2 n 1 2 n 0
P t / h NN dV P dV
dP x , x ,..., x dx dx ...dx (x )dV
n n
{mt vecteur t/h } =
W W

=
= = =
(2.64)
Sau y ta s xt min xc nh ca mt s dng tn hiu ngu nhin:
- Cc th hin ca tn hiu pht c cng y, cng cng sut:
Khi min cc nh ca vecteur tn hiu pht s l mt cu c bn knh bng chun ca
vecteur tn hiu pht
0
x P

= v c tm gc to ca vecteur y. (S d nh vy v
0
x


c chun khng i nhng phng v chiu ca n thay i ngu nhin).
- Tp m trng:
Ta bit rng cc th hin
i
n (t) ca tp m trng n(t) c cng cng sut P
n
. Nh vy
min xc nh ca tp m trng l mt cu c bn knh bng
n
P , c tm l gc ca vecteur tp
m
0
n

.
- Tng ca tn hiu x(t) v tp m n(t):
y(t) = x(t) + n(t)

0 0 0 0 y
y x n y P

= + =
Nu x(t) v n(t) khng tng quan th:

y x n
P P P = + (v
y x n
B (0) B (0) B (0) = + )

2
x n x n 0 0
y P P y P P

= + = +

2 2 2
0 0 0
y x n

= + (*)
Chng 2: Tn hiu v nhiu

41
T (*) ta thy
0
x


0
n

v
0
y

l cnh huyn ca mt tam gic vung c hai cnh l


0
x


v
0
n

.
Nu x(t) xc nh th min xc nh ca mt
0
y

s l ng trn y ca hnh nn c nh
gc ta , chiu cao bng
0
x

v bn knh bng
0
n

. (H.2.15a).







Nu x(t) ch l mt th hin no ca qu trnh ngu nhin X(t) c cc th hin cng cng
sut th lc min xc nh ca mt
0
y

s l mt mt cu c bn knh bng
x n
P P + v c
tm gc to (H.2.15b).







2.7.2.2. Khong cch gia hai vecteur tn hiu
nh gi nh lng s khc nhau gia hai vecteur tn hiu, ta a ra khi nim khong
cch gia hai vecteur tn hiu.
nh ngha:
Khong cch gia hai vecteur tn hiu
0
u

v
0
v

c xc nh theo biu thc sau:



n
0



x
0

y
0


0
Hnh 2.15a


0
Hnh 2.15b
Chng 2: Tn hiu v nhiu

42

0 0 0 0
n
2
0 0 K K
K 1
1
d(u , v ) u v u v
n
1
d(u , v ) (u v )
n


=
= =
=


Hay:
n n n
2 2 2
0 0 K K K K
2 2
K 1 K 1 K 1
1 1 2
d (u , v ) u v u .v
n
( n) ( n)

= = =
= +


Ta c:
2 2
n
2
K 0 0 0 0 0
2
K 1
2 2
n
2
K 0 0 0 0 0
2
K 1
n
K K 0 0 0 0 0 0
K 1
1 1
u u u u . u c (u , u )
n
( n)
1 1
v v v v . v c (v , v )
n
( n)
1
u .v (u , v ) u . v c (u , v )
n
os
os
os

=

=

=

= = =

= = =

= =


2 2
2
0 0 0 0 0 0 0 0
2 2
2
0 0 0 0 0 0
d (u , v ) u v 2 u . v c (u , v )
d (u , v ) u v 2 u . v c
os
os


= +
= +

Trong l gc hp bi
0
u

v
0
v

trong khng gian n chiu.



0 0
0 0
u .v
c
u . v
os


= (2.65)

2
0 0 u v u v
d (u , v ) P P 2 P P cos

= + (2.66)
Nu ta khng ri rc ho tn hiu th:

T
0 0 0 0
0
1
d(u , v ) u v dt
T
2
[u(t) - v(t)]

= =


Chng 2: Tn hiu v nhiu

43
Hay
T T T
2
0 0
0 0 0
1 1 2
d (u , v ) dt v dt v dt
T T T
2 2
u (t) (t) u(t). (t) = +



u v u v
u v u v
P P 2R (t, t)
P P 2R (0)
= +
= +

Trong
u v
R (0) l hm tng quan cho ca tn hiu u(t) v v(t).

u v u v u v
R (0) D (t).D (t) (0) =

2
0 0
d (u , v ) =
u v u v u v
P P 2 P .P (0) + (2.67)
So snh (2.66) v (2.67) ta thy ngay ngha hnh hc ca hm tng quan cho chun ho:
u v
(0) ng vai tr cosin ch phng ca hai vecteur tn hiu.

u v
c (0) os = (2.68)
Kt lun:
- Vi mt mc nhiu xc nh, xc sut thu ng cng cao khi cc th hin ca tn hiu
cng cch xa nhau.
- Khong cch gia hai mt ca hai vecteur tn hiu cng ln khi di hai vecteur cng
ln.
2.7.3. Khi nim v my thu ti u
2.7.3.1. My thu ti u
Mt cch tng qut, ta coi mt my thu c trng bi mt ton t thu (H.2.17). Yu cu
ca ton t thu l tc dng vo y(t) (l tn hiu vo) phi cho ra tn hiu pht x(t).
Nu ta pht i mt th hin no ca mt qu trnh ngu nhin X(t):

{ }
i
X(t) x (t) (i 1, m) = =
Ta coi nhng th hin ny c cng cng sut P
x
, c cng thi
hn T v c cng b rng ph F
c
.
Gi thit: trong qu trnh truyn t ni pht n ni thu ch c
tp m trng Gausse n(t), cc tn hiu pht l ng xc sut
Vecteur tn hiu ta nhn c:
0
y y n

=

y(t) x(t)
Hnh 2.16.
Chng 2: Tn hiu v nhiu

44
Nu
0
y

ny gn vi vecteur tn hiu
j0
x

nht so vi cc vecteur tn hiu khc, tc l:



j
i
x
y y x
n n n n


Vi i : i 1, m v i j =
Khi my thu c tc dng ln y

cho ra
j
x

:
K
[ y ]= x

, s c gi l my thu
ti u (theo ngha Kachennhicov trong trng hp cc tn hiu
( )
i
x t l ng xc sut).
2.7.3.2. Lin h gia my thu ti u K v my thu theo tiu chun lch trung bnh bnh
phng nh nht
lch trung bnh bnh phng (tbbp) gia tn hiu thu c v tn hiu pht th j l:

T
0
1
(t) (t) dt
T
2 2
j j
[y(t) - x ] [y(t) - x ]

=


My thu theo tiu chun lch tbbp nh nht l my thu m bo:

j
min (t) j 1, m
2
j
[y(t) - x ]

=
Nh vy, my thu s cho ra tn hiu
j
x (t)

nu:
(t) (t) i j, i 1, m
2 2
j i
[y(t) - x ] [y(t) - x ]

=
Hay
T T
0 0
1 1
(t) dt (t) dt i j, i 1, m
T T
2 2
j i
[y(t) - x ] [y(t) - x ] =


Nng ln lu tha 1/2, ta c:

T T
0 0
1 1
(t) dt (t) dt i j, i 1, m
T T
2 2
j i
[y(t) - x ] [y(t) - x ] =


Theo nh ngha ca khong cch, ta c th vit li nh sau:

0 j0 0 i 0
d(y , x ) d(y , x ) i j, i 1, m

=
y chnh l h thc m bo bi my thu ti u K.
Chng 2: Tn hiu v nhiu

45
BI TP
2.1. th gi tr trung bnh a(t) v gi tr trung bnh bnh phng
( )
t ca cc qu trnh ngu
nhin X(t), Y(t) v Z(t) v trn hnh 1 di y. Hy ch ra trn th min cc gi tr c th c
ca cc qu trnh ngu nhin ny, bit rng bin gii ca cc min c xc nh bi cc gi tr
ca
( )
t .



Hnh 1.

2.2. Trn hnh 2 v hm ngu nhin dng ri rc X(t), gi l dy xung in bo. Dy xung c bin
khng i bng n v, c rng ngu nhin.







Phn b xc sut cc gi tr (0 hoc 1) ca X(t) tun theo lut Poisson:

a
x
(t)


0
t

0
a
y
(t)

t

t
a
z
(t)
0
t t t
( )
y
t

0 0
( )
z
t

0
x(t)


1


0
Hnh 2.
Chng 2: Tn hiu v nhiu

46
( )
( )
n
t
n
t
P t e t 0
n!

= >
Trong l s cc bc nhy ca hm X(t) trong mt n v thi gian, cn
( )
n
P t l
xc sut xy ra n bc nhy ca hm X(t) trong thi gian t.
Hy tm hm t tng quan, hm tng quan chun ho v thi gian tng quan ca qu
trnh ngu nhin, bit rng P(1) = P(0) = 0,5.
2.3. Tm hm t tng quan ca qu trnh ngu nhin dng sau:

( ) ( )
0
X t Acos 2 f t = +
Trong A = const,
0
f = const, l i lng ngu nhin c phn b u trong khong
( )
, .
2.4. Tm hm t tng quan v mt ph ca tn hiu in bo ngu nhin X(t) cho bi hnh
di y. Bit rng n nhn cc gi tr + a; - a vi xc sut nh nhau v bng 1/2. Cn xc sut
trong khong c N bc nhy l:

( )
( )
N
P N, e 0
N!

= >
(theo phn b Poisson).
2.5. Hy chng t rng ng bao ca tn hiu gii tch c th biu din bng cng thc sau:

( ) ( ) ( )
*
a a
A t S t .S t =
Trong :
( )
*
a
S t l hm lin hp phc ca
( )
a
S t :

( ) ( ) ( )
a
S t x t j x t

= + l tn hiu gii tch.


2.6. Mt qu trnh ngu nhin dng c hm t tng quan:
a.
( )
1
2
x
R .e

=
b.
( )
2
2
x 0
R .e .cos

=
Hy tnh ton v v th mt ph ca cc qu trnh ngu nhin trn.
Chng 3: C s l thuyt thng tin thng k

47
CHNG 3 - C S L THUYT THNG TIN THNG K
3.1. THNG TIN - LNG THNG TIN XC SUT V THNG TIN N V
O THNG TIN
3.1.1. nh ngha nh tnh thng tin v lng thng tin
3.1.1.1. Thng tin
chng trc, ta hc khi nim v thng tin. y ta s xy dng nh ngha nh
tnh ca thng tin theo quan im thng k. i ti nh ngha nh tnh ca thng tin, ta s xt
v d sau:
Ta nhn c mt bc in (th) t nh n. Khi cha m bc in ra c th ta ch c th d
on hoc th ny hoc th khc v bc in, m khng dm chc ni dung ca n l g. Ni khc
i, khi cha m bc in ra c th ta khng th xc nh c ni dung ca n, tc l ta cha bit
gia nh bo cho ta thng tin g. Nhng khi xem xong bc in th ni dung ca n i vi ta
hon ton r rng, xc nh. Lc , ni dung ca bc in khng cn bp bnh na. Nh vy, ta ni
rng: ta nhn c mt tin v gia nh. Ni dung ca bc in c th c 3 c im sau:
- Ni dung ta tha bit. (VD: Cc em con c ngh h 3 thng). Khi bc in
khng cho ta mt hiu bit g mi v tnh hnh gia nh. Hay ni theo quan im thng tin, th bc
in vi ni dung ta tha bit khng mang n cho ta mt thng tin g.
- Loi ni dung ta c th on th ny hoc th n (tc l loi ni dung c bp bnh no
y). VD: Em An i hc. V em An hc lc trung bnh nn thi vo i hc c th , c
th khng. in vi ni dung ta khng bit chc (ni dung cha mt bt nh no ) tht s
c mang n cho ta mt thng tin nht nh.
- Loi ni dung m ta hon ton khng ng ti, cha h ngh ti. VD: Em An trng gii
nht trong t x s. Bc in nh vy, ng v mt thng tin m ni, a n cho ta mt
thng tin rt ln.
Ch : y ta ni ti nhng ni dung cha h ngh ti phi hiu theo hon ton
khch quan ch khng phi do s khng y v t duy ca con ngi em li.
T nhng v d trn, ta rt ra nhng kt lun sau v khi nim thng tin:
- iu g xc nh (khng nh c, on chc c, khng bp bnh,) th khng c
thng tin v ngi ta ni rng lng thng tin cha trong iu y bng khng.
- iu g khng xc nh (bt nh) th iu c thng tin v lng thng tin cha trong n
khc khng. Nu ta cng khng th ng ti iu th thng tin m iu mang li cho ta rt ln.
Tm li, ta thy khi nim thng tin gn lin vi s bt nh ca i tng ta cn xt. C s
bt nh v mt i tng no th nhng thng bo v i tng s cho ta thng tin. Khi
khng c s bt nh th s khng c thng tin v i tng . Nh vy, khi nim thng tin ch
l mt cch din t khc i ca khi nim s bt nh.
Chng 3: C s l thuyt thng tin thng k

48
Trc khi nhn tin (c thng bo) v mt i tng no y th vn cn s bt nh v
i tng , tc l bt nh v i tng khc khng (c th ln hoc nh). Sau khi nhn
tin ( c hiu r hoc hiu mt phn) v i tng th bt nh ca n gim n mc thp
nht, hoc hon ton mt. Nh vy, r rng Thng tin l bt nh b th tiu hay ni mt
cch khc Lm gim bt nh kt qu cho ta thng tin.
3.1.1.2. Lng thng tin
Trong l lun trn, ta tng ni n lng thng tin v lng thng tin ln, lng thng
tin nh m khng h nh ngha cc danh t . Di y ta s tr li vn .
trn ta cng ni: trc khi nhn tin th bt nh ln nht. Sau khi nhn tin (hiu r
hoc hiu mt phn v i tng th bt nh gim n mc thp nht, c khi trit hon ton.
Nh vy, c mt s chnh lch gia bt nh trc khi nhn tin v bt nh sau khi nhn tin.
S chnh lch l mc th tiu bt nh. ln, nh ca thng tin mang n ta ph thuc
trc tip vo mc chnh . Vy:
Lng thng tin l mc b th tiu ca bt nh Lng thng tin = chnh ca
bt nh trc v sau khi nhn tin = bt nh trc khi nhn tin - bt nh sau khi nhn
tin ( bt nh tin nghim - bt nh hu nghim).
3.1.2. Quan h gia bt nh v xc sut
3.1.2.1. Xt v d sau
Ta phi chn mt phn t trong mt tp no . Php chn nh th (hoc chn hiu theo
ngha rng: th, tm hiu, iu tra, trinh st, tnh bo,) bao gi cng c bt nh.
- Nu tp ch c mt phn t th ta chng phi chn g c v nh vy khng c bt nh
trong php chn .
- Nu tp c hai phn t th ta phi chn. Nh vy, trong trng hp ny php chn c
bt nh. Nu s phn t ca tp tng th bt nh s tng.
- Cc bc tip theo s cho bi bng sau:
S phn t ca tp bt nh ca php chn Xc sut chn mt phn t trong tp
1
2
3
.
.
.
n
.
.
.

0
0

0

.
.
.
0

.
.
.

1
1/2
1/3
.
.
.
1/n
.
.
.
1/ 0 =

Ch : Bng ny a ra vi gi s vic chn cc phn t l ng xc sut.
T

n
g

G
i

m

Chng 3: C s l thuyt thng tin thng k

49
3.1.2.2. Kt lun
- Bng ny cho thy: bt nh gn lin vi bn cht ngu nhin ca php chn, ca bin c.
- bt nh (k hiu I) l hm ca s phn t thuc tp
K
I(x ) f (n) = (a)
- bt nh c lin quan vi xc sut chn phn t ca tp
K K
I(x ) E (x ) [p ] = (b)
tm mi quan h gia bt nh I v xc sut chn mt phn t
K K
x ( (x )) p trong
tp, ta xut pht t cc tiu sau:
Theo suy ngh thng thng, bt nh I phi tho mn:
+
K
I(x ) 0
+
K K K
(x ) 1 I(x ) E (x ) p [p ] = E[1] = 0 = = (3.1)
+ Tnh cng c:
Nu
K
x v
i
x c lp, th:

K i K i K i
E (x x ) (x ) (x ) (x ) (x ) [p ] = E[p p ] = E[p ] + E[p ]
Nu
K
x v
i
x ph thuc th:

K i K i K K i K
E (x x ) (x ) (x x ) (x ) (x x ) [p ] = E[p p ] = E[p ] + E[p ]
t
K
(x ) p p = v
i K
(x x ) q p ] = , th khi vi mi p, q (0 p 1, 0 q 1) < < , ta
c:
E[p] + E[q] = E(pq) (3.2)
T (3.2) ta c th tm c dng hm I(p). Ly vi phn 2 v ca (3.2) theo p, ta c:
E(p) = q E(pq)
Nhn c 2 v ca phng trnh ny vi p v k hiu p.q = , ta c:
pE(p) = E( ) (3.3)
(3.3) ng p, 0. Nhng iu ny ch c th c khi c hai v ca (3.3) bng mt
hng s k no :
pE(p) = E( ) = k = const
T chng ta c phng trnh vi phn pI(p) = const = k, ly tch phn phng trnh ny,
ta tm c:
E(p) = k.lnp + C (3.4)
K n iu kin ban u (3.1), chng ta c:
E(p) = k.lnp (3.5)
Nh vy, ta c:
K K
I(x ) k.ln x ) [p( ] = (3.6)
Chng 3: C s l thuyt thng tin thng k

50
H s t l k trong (3.6) c th chn tu , n ch xc nh h n v o ca
K
I(x ) . V
K
ln x ) [p( ] 0 nn
K
I(x ) 0 th k < 0.
Nu ly k = -1 th
K K
K
1
I(x ) ln x ) ln
x )
[p( ] =
p(

=


(3.7)
Khi , n v o bt nh s l n v t nhin, k hiu l nat.
Nu ly
1
k
ln2
= th
K
K 2 K
ln x )
I(x ) log p(x )
ln2
p(
= = (3.8)
Khi n v o bt nh s l n v nh phn, k hiu l bit (1 nat = 1,433 bit)
Mt bit chnh l bt nh cha trong mt phn t (bin c ca tp xc sut chn (xut
hin) bng 1/2. Ngi ta thng s dng n v [bit] do trong k thut tnh v k thut lin lc
thng dng cc m nh phn.
Ngoi ra, ngi ta cn c th s dng nhng n v o khc tu theo cch chn c s ca
logarit. V vy trong trng hp tng qut, ta c th vit:

K K
I(x ) log x ) p( = (3.9)
3.1.3. Xc nh lng thng tin
mc 1, ta c kt lun sau:
Lng thng tin = bt nh tin nghim - bt nh hu nghim. V bt nh s tr
thnh thng tin khi n b th tiu nn ta c th coi bt nh cng chnh l thng tin. Do :
Lng thng tin = thng tin tin nghim thng tin hu nghim (*)
Thng tin tin nghim (hay cn gi l lng thng tin ring) c xc nh theo (3.9). Cn
thng tin hu nghim xc nh nh sau:
Gi
K
x l tin gi i, y
/
l tin thu c c cha nhng du hiu hiu bit v
K
x (c
cha thng tin v
K
x ). Khi xc sut r v
K
x khi thu c y
/
l
K
(x y ) p
/
. Nh
vy bt nh ca tin
K
x khi r y
/
bng:

(3.9)
K K
x y ) (x y ) I( - logp =
/ /
(3.10)
(3.10) c gi l thng tin hu nghim v
K
x (thng tin ring v
K
x sau khi c y
/
).
Thay (3.9) v (3.10) vo (*), ta c:
Chng 3: C s l thuyt thng tin thng k

51

K
L I( ) I( y )
L I( ) I( y )
1 1
I( , y ) log log
p( ) p( y )
K K K
K K K
hiu
K
K K
ng thng tin v x x x
ng thng tin v x x x
x
x x

=
=
=
/
/
/
/
_

K
K
K
p(x y )
I(x , y ) log
p(x )
=
/
/
(3.11)
(3.11) gi l lng thng tin v
K
x khi r tin y
/
hay cn gi l lng thng tin cho v
K
x do y
/
mang li.
Nu vic truyn tin khng b nhiu th
K
y x
/
. Tc l nu pht
K
x th chc chn nhn
c chnh n. Khi :

K K K
p(x y ) p(x x ) 1 = =
/

T (3.11) ta c:

K K K K
K
1
I(x , y ) I(x , x ) I(x ) log
p(x )
= = =
/
(**)
Nh vy khi khng c nhiu, lng thng tin nhn c ng bng bt nh ca s kin
K
x , tc l ng bng thng tin tin nghim ca
K
x .
Vy lng thng tin tn hao trong knh s l:
I( ) I( , y ) I( y )
K K K
x x x =
/ /

n v o ca thng tin (lng thng tin) cng chnh l n v o bt nh.
Nu c s ca logarit l 10 th n v o thng tin c gi l Hartley, hay n v thp
phn.
Nu c s ca logarit l e = 2,718 th n v o thng tin c gi l nat, hay n v o
t nhin.
Nu c s ca logarit l 2 th n v o thng tin c gi l bit, hay n v nh phn.
1 Harley = 3,322 bit
1 nat = 1,443 bit
Chng 3: C s l thuyt thng tin thng k

52
3.2. ENTROPIE V CC TNH CHT CA ENTROPIE
3.2.1. Tnh cht thng k ca ngun ri rc v s ra i ca khi nim entropie
Trong mc trc, ta mi ch xt n lng thng tin v mt bin c (hay mt tin) trong mt
tp cc bin c (hay tin) xung khc, ng xc sut.
Thc t tn ti ph bin loi tp cc bin c (hay ngun tin, tp tin) xung khc, khng ng
xc sut. Tc l xc sut xut hin cc bin c khc nhau trong tp l khc nhau. Ta gi s khc
nhau gia cc xc sut xut hin bin c ca tp (hay tin ca ngun ri rc) l tnh cht thng k
ca n.
V d 1: S xut hin cc con ch trong b ch Vit c xc sut khc nhau: p(e) = 0,02843;
p(m) = 0,02395; p(k) = 0,02102, (Theo s liu trong n tt nghip Kho st cu trc thng
k ch Vit ca on Cng Vinh HBK HN).
V d 2: Xc sut xut hin ca 26 ch ci trong ting Anh: (S liu theo Beker v Pipe)
K t Xc sut K t Xc sut
A
B
C
D
E
F
G
H
I
J
K
L
M
0,082
0,015
0,028
0,043
0,127
0,022
0,020
0,061
0,070
0,002
0,008
0,040
0,024
N
O
P
Q
R
S
T
U
V
W
X
Y
Z
0,067
0,075
0,019
0,001
0,060
0,063
0,091
0,028
0,010
0,023
0,001
0,020
0,001

Trong mt ngun tin nh th, ngoi thng tin ring ca mi tin (hay du) ca n, ngi ta
cn phi quan tm n thng tin trung bnh ca mi tin thuc ngun. Ngi ta cn gi thng tin
trung bnh do mi du ca ngun mang li l entropie. Di y ta s xt k nh ngha v
entropie.
3.2.2. nh ngha entropie ca ngun ri rc
3.2.2.1. t vn
php o c chnh xc, trong vt l, khi o lng mt i lng, ta khng quan tm
n tng tr o c ca i lng m thng xt tr trung bnh ca chng. Khi ta ly cc tr
o c cng vi nhau ri chia cho s lng ca chng:

n
tb r
r 1
i i n
=
=


Chng 3: C s l thuyt thng tin thng k

53
y cng c iu tng t: ta khng quan tm n tng thng tin ring ca mi du m
li ch n gi tr trung bnh ca cc thng tin . Ch khc ch mi mt thng tin ring n
tng ng vi mt xc sut xut hin no , tc l ta c th xem cc thng tin ring l m i
lng ngu nhin I. Do gi tr trung bnh ca cc thng tin ny (lng thng tin trung bnh hay
entropie) chnh l k vng ca i lng ngu nhin I. Ta i ti nh ngha sau:
3.2.2.2. nh ngha
Entropie ca ngun tin ri rc l trung bnh thng k ca lng thng tin ring ca cc du
thuc ngun A, k hiu
1
H (A) :

1
H (A) M )
i
[I(a ]

= (3.12)
Trong
i
a l cc du ca ngun A (Ta hiu du l cc con ch, hoc cc k hiu v.v
ca ngun). Cn ngun A l mt tp ri rc cc du
i
a vi cc xc sut xut hin ca chng. Ta
quy c vit A nh sau:

2 s
a ... a
A
p( ) p( ) ... p( )
1
i
1 2 s
a
{a } =
a a a

=


(3.13)
Vi
i
0 p(a ) 1 v
s
i
i 1
p(a ) 1
=
=

(3.14)
A c cho bi (3.13) v (3.14) cn gi l trng tin (hay trng bin c). T (3.12) v
(3.13), ta c:

1
H (A) M ) ) I )
s
i i i
i =1
[I(a ] = p(a (a =



1
H (A) )logp )
s
i i
i =1
= p(a (a

(3.15)
1
H (A) cn gi l entropie mt chiu ca ngun ri rc:
V d:
1
H (Vit) = 4,5167 bit
1
H (Nga) = 4,35 bit

1
H (Anh) = 4,19 bit
3.2.3. Cc tnh cht ca entropie mt chiu ca ngun ri rc
3.2.3.1. Tnh cht 1
Khi
k
p(a ) 1 = v
r
p(a ) 0 = vi r k th:

1 1 min
H (A) H (A ) 0 = = (3.16)
Chng 3: C s l thuyt thng tin thng k

54
Chng minh:
Ta c:
i
0 p(a ) 1
i i
logp(a ) 0 logp(a ) 0

1 1 min
H (A) 0 H (A ) 0 =
By gi ta ch cn phi chng t
1 min
H (A ) 0 = khi
k
p(a ) 1 = v
r
p(a ) 0 = ( r k ).
Tht vy,
r
p(a ) 0 =
r r
p(a )logp(a ) 0 ( r k) =

k
p(a ) 1 =
k k
p(a )logp(a ) 0 ( r k) =
s
1 i i
i 1
s
k k i i
i 1,i k
H (A) p(a )logp(a )
p(a )logp(a ) p(a )logp(a ) 0
=
=
=
= =


ngha:
Thc ra khng cn phi chng minh nh vy, m lp lun nh sau cng cho ta cng thc
(3.16):
r
p(a ) 0 =
cc
r
a
khng xut hin
k
p(a ) 1 =
cc
k
a
chc chn xut hin
Khng c bt nh no v cc
i
a lng thng tin ring khng c lng
thng tin trung bnh cng khng c.
3.2.3.2. Tnh cht 2
Mt ngun ri rc gm s du ng xc sut (v
tho mn (3.14)) th entropie ca n t cc i v cc
i bng log s.

1 m
H (A ) logs
ax
= (3.17)
Chng minh:
Khi
i j
p(a ) p(a ), i, j (i, j 1,s) = =
Khi
i
1
p(a )
s
= , tc l ngun gm cc du
xung khc v ng kh nng.

y
x 1

lnx

0 1 x

- 1
Hnh 3.1.
Chng 3: C s l thuyt thng tin thng k

55
s
1
i 1
1 1
H (A') log logs
s s
=
= =


Xt hiu:
s
1 i
i
i 1
s s
i i
i
i 1 i 1
s
i
i
i 1
s s
i i
i
i 1 i 1
1
H (A) logs p(a )log logs
p(a )
1
p(a )log p(a )logs
p(a )
1
p(a ) log logs
p(a )
1
p(a )log p(a )logx
p(a )s
=
= =
=
= =
=
=

=


= =



Ta c: lnx x 1 x (xem hnh 3.1)
s
i i
i 1
p(a )l p(a )(x 1) ogx
=



M:
s s s
i i
i
i 1 i 1 i 1
1 1
p(a ) 1 p(a ) 0
p(a )s s
= = =

= =




Vy:
1 1
H (A) logs 0 H (A) logs
Tm li, ta thy
1
0 H (A) logs (entropie ca ngun ri rc)
Entropie l mt i lng gii ni.
K hiu
m 0
H(A) H (A)
ax
=
V d:
0
H (Vi 36 5,1713bit
2
t) = log =

0
H (Nga 32 5bit
2
) = log =

0
H (Anh 27 4, 75489bit
2
) = log =
3.2.4. Entropie ca ngun ri rc, nh phn
Ngun ri rc nh phn l ngun ch c hai du:
1
2
a "0" v ) p
a "1" v ) 1 p
1
2
i xc sut p(a
i xc sut p(a
=


Chng 3: C s l thuyt thng tin thng k

56
Ta c ngay:
2
1 i i
i 1
H (A) p(a )logp(a ) plogp (1 p) f (p)
=
= = =

(3.18)
th f(p) c biu din trn hnh 3.2.
Ta thy
1
H (A) f (p) = ch ph thuc
vo c tnh thng k ca cc tin.
Nu n v dng l bit th
max
1
H (A) 1 =
Nhn xt:
-
1
H (A) t max ti
1
p
2
= . S d nh
vy v tp ch c hai phn t, nn bt nh ca
php chn s ln nht khi hai du c xc sut
xut hin nh nhau.
- p = 0
1 min
H (A) 0 = . Khi 1 p = 1 l xc sut xut hin du
2
a . Vy
2
a l mt
bin c chc chn. Php chn ny khng c bt nh lng thng tin trung bnh trit.
- p = 1
1 min
H (A) 0 = . Gii thch tng t.
3.2.5. Entropie ca trng s kin ng thi
nh ngha 1:
C hai trng s kin A v B:
1 2 s
1 2 s
a a ... a
A
p(a ) p(a ) ... p(a )

=


v
1 2 t
1 2 t
b b ... b
B
p(b ) p(b ) ... p(b )

=



Cc
i
a v
j
b l cc s kin.
Ta xt mt s kin tch:
k i j
c a .b =
k i j
p(c ) p(a .b ) = . Ta xt trng C l giao ca hai trng A v B, nu:

1 1 1 2 1 t 2 j s t
1 1 1 2 1 t 2 j s t
a b a b ... a b ... a b ... a b
C A.B
p(a b ) p(a b ) ... p(a b ) ... p(a b ) ... p(a b )

= =




Trng C c gi l trng s kin ng thi (trng giao, tch) ca hai trng s kin c
bn A v B.
nh ngha 2:

H
1
(A)

1



H
1
(A)
max





0 0,5 1 p


Hnh 3.2.
Chng 3: C s l thuyt thng tin thng k

57
Hai trng s kin A v B c gi l c lp vi nhau nu:
i j i j
p(a .b ) p(a ).p(b ) =

Ch : Tt nhin nu
i
p(a ) v
j
p(b ) tho mn (3.14) th ta cng c:

s t
i j i j
i 1 j 1
0 p(a b ) 1 ; p(a b ) 1
= =
=

(*)
nh l 1:
Entropie ca trng s kin ng thi C = A. B s bng tng entropie ca cc trng s
kin c bn A v B nu A v B c lp.
H(A.B) = H(A) + H(B) (3.19)
Chng minh: Theo nh ngha:

s t
i j i j
i 1 j 1
H(A.B) p(a b )logp(a b )

= =
=


Theo gi thit A v B c lp vi nhau nn ta c:

s t s t
i j i i j j
i 1 j 1 i 1 j 1
s t t s
i i j j j i
i 1 j 1 j 1 i 1
H(A.B) p(a )p(b )logp(a ) p(a )p(b )logp(b )
p(a )logp(a ) p(b ) p(b )logp(b ) p(a )
= = = =
= = = =
=
=



M:
t
j
j 1
p(b ) 1
=
=

,
s
i
i 1
p(a ) 1
=
=


H(A.B) = H(A) + H(B)
Nhn xt: Tng t, nu cc ngun
k
X , (k 1, n) = c lp vi nhau th:

n
1 2 n k
k 1
H(X .X ....X ) H(X )
=
=


3.3. ENTROPIE C IU KIN. LNG THNG TIN CHO TRUNG BNH
3.3.1. Entropie c iu kin v mt trng tin ny khi r mt tin nht nh ca
a
1


a
2





a
k
b
1


b
2





b
l
Chng 3: C s l thuyt thng tin thng k

58
trng tin kia
3.3.1.1. M u
Trong phn trc, ta ni nu truyn tin c nhiu th tin pht i
k
a v tin thu c b
/
l
khc nhau. V khi lng thng tin ring v
k
a do b
/
mang li l:

k
k
1
I(a / b ) log
p(a / b )
=
/
/

Vn : ta khng quan tm n lng thng tin ring v mt du
k
a c th no ca ngun
tin pht {
i
a } do b
/
mang li m ch quan tm n lng thng tin ring trung bnh v mt du
no ca tp {
i
a } do b
/
mang li. Ta thy rng
k
I(a / b )
/
l mt i lng ngu nhin. Do
tng t nh nh ngha ca entropie mt chiu, ta i ti nh ngha sau.
3.3.1.2.nh ngha
Entropie c iu kin v mt trng tin ny khi r mt tin ca trng tin kia c xc
nh bng k vng ca lng thng tin ring c iu kin v
k
a do mt b
/
mang li:

s
i 1
H(A/ b ) M / b ) / b ) I / b )
i i i
[I(a ] = p(a (a

=
=
/ / / /


s
i 1
/ b )logp / b )
i i
p(a (a
=
=
/ /
(3.20)
ngha:
H(A/ b )
/
l lng thng tin tn hao trung bnh ca mi tin u pht khi u thu thu
c
j
b .
Tng t:
t
i i i
j 1
H(B/ a ) / a )logp / a )
j j
p(b (b
=
=


ngha:
i
H(B/ a ) l lng thng tin ring trung bnh cha trong mi tin u thu khi u pht
pht i mt tin
i
a .
3.3.2. Entropie c iu kin v trng tin ny khi r trng tin kia
Ta thy rng do nhiu ngu nhin nn bn thu khng phi ch thu c mt tin duy nht m
l c tp tin B = {
j
b } no , ( j 1, t) = . Vy
j
H(A/ b ) cng l mt i lng ngu nhin, do
Chng 3: C s l thuyt thng tin thng k

59
ta phi xt n lng thng tin ring trung bnh v mi tin u pht khi u thu thu c
mt du no .
Tng t nh trn, ta cng phi ly trung bnh thng k ca i lng ngu nhin ny.
nh ngha:
Entropie c iu kin ca trng s kin A khi r trng s kin B c xc nh bi k
vng ca i lng
j
H(A/ b ) .

t
j j j
j 1
t s
j i j i j
j 1 i 1
s t
j i j i j
i 1 j 1
H(A/ B) M H(A/ b ) p(b ) H(A/ b )
p(b ) p(a / b )logp(a / b )
p(b ) p(a / b )logp(a / b )

=
= =
= =

= =


=


=



s t
i j i j
i 1 j 1
H(A/ B) p(a b )logp(a / b )
= =
=

(3.21)
ngha:
H(A/B) l lng thng tin tn hao trung bnh ca mi tin u pht khi u thu thu
c mt du no .
Tng t:

s t
j i j i
i 1 j 1
H(B/ A) p(b a )logp(b / a )
= =
=

(3.22)
ngha:
H(B/A) l lng thng tin ring trung bnh cha trong mi tin u thu khi u pht
pht i mt tin no .
Ch :
Ta xt mt b ch A. c trng cho lng thng tin ring trung bnh cha trong mi con
ch khi k n xc sut xut hin cc cp ch (VD: trong ting Vit: p(a/b) 0, p(b/a) = 0,
p(t/a) 0, p(a/t) 0), ngi ta dng H(A/A) v k hiu l H
2
(A).
V d: H
2
(Vit) = 3,2223 bit
H
2
(Nga) = 3,52 bit
H
2
(Anh) = 3,32 bit
Chng 3: C s l thuyt thng tin thng k

60
Vic tnh H
3
, H
4
rt phc tp.
Khakevich tnh c n H
5
. Shannon tnh c n H
8
.
3.3.3. Hai trng thi cc oan ca knh truyn tin
3.3.3.1. Knh b t (b nhiu tuyt i)
Trong trng hp ny, cc tin thu c hon ton khc cc tin pht i. Ni khc i v b
nhiu tuyt i nn trong mi tin
j
b B khng cha du hiu hiu bit no v cc tin pht i.
Nh vy, A v B l c lp nhau:
i j i
p(a / b ) p(a ) = ;
j i j
p(b / a ) p(b ) =
i j i j
p(a b ) p(a ) p(b ) =

Khi ta c:
s
j i i
i 1
t
i j j
j 1
t s
j i i
j 1 i 1
s t
i j j
i 1 j 1
H(A/ b ) p(a )logp(a ) H(A)
H(B/ a ) p(b )logp(b ) H(B)
H(A/ B) p(b ) p(a )logp(a ) H(A)
H(B/ A) p(a ) p(b )logp(b ) H(B)
=
=
= =
= =
= =
= =
= =
= =



(3.23)
3.3.3.2. Knh khng nhiu
Khi : t = s. Vi
i i
i 1,s a b = =
i i
p(a ) p(b ) = nn H(A) = H(B)
k k k k
i k i k
p(a / b ) p(b / a ) 1
p(a / b ) p(b / a ) 0 vi i k
= =
= =

k k
H(A/ b ) 0 H(B/ a ) 0
H(A/ B) 0 H(B/ A) 0
= =


= =

(3.24)
V khi khng nhiu, coi A v B ph thuc mnh nht, c
i
a th chc chn c
i
b , nn
bt nh v
i
a khi thu c
i
b l khng c bt nh trung bnh cng khng c.
Chng 3: C s l thuyt thng tin thng k

61
3.3.4. Cc tnh cht ca entropie c iu kin
3.3.4.1.Tnh cht 1
Nu A v B l hai trng bin c bt k (hai ngun tin bt k) th entropie ca trng bin
c ng thi A.B bng:
H(A.B) = H(A) + H(B/A) = H(B) + H(A/B) (3.25)
Chng minh:

{ }
s t
i j i j
i 1 j 1
s t
j i j j i j
i 1 j 1
H(A.B) p(a b )logp(a b )
p(b ) p(a / b )log p(b ) p(a / b )
= =
= =
= =
= =


s t s t
j i j j j i j i j
i 1 j 1 i 1 j 1
s t s t
i j j j i j i j
i 1 j 1 i 1 j 1
H(A.B) p(b ) p(a / b )logp(b ) p(b ) p(a / b )logp(a / b )
p(a / b ) p(b )logp(b ) p(a b )logp(a / b )
H(B) H(A/ B)
= = = =
= = = =
= =
=
= +


_ _
Trong :
s
i j
i 1
p(a / b ) 1
=
=

.
3.3.4.2.Tnh cht 2
Entropie c iu kin nm trong khong:
0 H(A/ B) H(A) (3.26)
Chng minh:
+ H(A/ B) 0:
i j i j
i j
0 p(a / b ) 1 logp(a / b ) 0
logp(a / b ) 0 H(A/ B) 0



N s nhn du bng khi A v B l ng nht (knh khng nhiu).

+ H(A/B) H(A):
Xt hiu: H(A/B) H(A) = G
Chng 3: C s l thuyt thng tin thng k

62
s t s
j i j i j i i
i 1 j 1 i 1
G p(b ) p(a / b )logp(a / b ) p(a )logp(a ).1
= = =
= +


Ch : ta thay
t
j i
j 1
1 p(b / a )
=
=


s t s t
i j i j i j i
i 1 j 1 i 1 j 1
s t
i j
i j
i
i 1 j 1
s t
i
i j
i j
i 1 j 1
G p(a b )logp(a / b ) p(a b )logp(a )
p(a / b )
p(a b )log
p(a )
p(a )
p(a b )log
p(a / b )
= = = =
= =
= =
= +
=
=


p dng logx x 1 :
s t
i
i j
i j
i 1 j 1
s t
i
j i j
i j
i 1 j 1
s t s t
i j j i j
i 1 j 1 i 1 j 1
p(a )
G p(a b ) 1
p(a / b )
p(a )
G p(b ) p(a / b ) 1
p(a / b )
G p(a ) p(b ) p(b ) p(a / b )
G 1 . 1 1 0
= =
= =
= = = =











=



H(A/B) H(A).
H(A/B) = H(A) khi A v B l c lp (knh b t).
3.3.4.3. Tnh cht 3
Entropie ca trng s kin ng thi khng ln hn tng entropie ca cc trng s kin
c bn.
H(A.B) H(A) + H(B) (3.27)
Chng minh:
(3.27) rt ra trc tip t (3.25) v (3.26).
Chng 3: C s l thuyt thng tin thng k

63
3.3.5. Lng thng tin cho trung bnh
phn trc, chng ta bit lng thng tin cho v mt tin
i
a pht i do mt tin
j
b
thu c mang li l:

i j
i j
i
p(a / b )
I(a , b ) log
p(a )
=
Thng thng, v bn pht pht i mt tp tin A = {
i
a } v bn thu nhn c mt tp tin B
= {
j
b }. Do ta khng quan tm n lng thng tin cho v mt tin c th
i
a pht do mt
tin
j
b c th thu c, m ta ch quan tm n lng thng tin cho trung bnh v mi tin ca tp
pht A do mi tin ca tp thu B mang li.
i j
I(a , b ) l mt i lng ngu nhin, do ta phi ly
trung bnh thng k ca n.
nh ngha:
Lng thng tin cho trung bnh (k hiu l I(A,B)):

i j
I(A, B) M I(a , b )


=

(3.28)
Xc sut c thng tin
i j
I(a , b ) l
i j
p(a b ) , do ta c:

s t
i j
i j
i
i 1 j 1
p(a / b )
I(A, B) p(a b )log
p(a )
= =
=



s t s t
i j i j i j i
i 1 j 1 i 1 j 1
I(A, B) p(a b )logp(a / b ) p(a b )logp(a )
H(A/ B) H(A)
= = = =
=
= +


Tm li: I(A,B) = H(A) H(A/B) (3.29a)
Tng t, ta c: I(A,B) = H(B) H(B/A) (3.29b)
Hay: I(A,B) = H(A) + H(B) H(A.B)
I(A,B) cn gi l lng thng tin trung bnh c truyn theo knh ri rc.
3.3.6. Tnh cht ca I(A,B)
3.3.6.1. Tnh cht 1
I(A,B) 0: (3.30)
Theo tnh cht 2 mc 3.3.4: H(A/B) H(A) H(A) H(A/B) 0.
I(A,B) = 0 khi knh b t.
Chng 3: C s l thuyt thng tin thng k

64
3.3.6.2.Tnh cht 2
I(A,B) H(A): (3.31)
Tht vy: H(A/B) 0 I(A,B) = H(A) H(A/B) H(A)
I(A,B) = H(A) khi knh khng c nhiu.
T (3.31) ta thy khi truyn tin trong knh c nhiu, thng tin s b tn hao mt phn.
Lng thng tin tn hao trung bnh chnh l H(A/B).
3.3.6.3.Tnh cht 3
I(A,A) = H(A)
3.3.6.4. Tnh cht 4
I(A,B) = I(B,A)
3.3.7. M hnh ca knh truyn tin c nhiu
Da vo (3.29a), ta c m hnh knh truyn khi c nhiu nh sau:















Hnh 3.4. Lc Wenn m t mi quan h gia cc i lng.


A B




H(A)

A B




H(A/B)

A B




I(A,B)

A B




H(AB)

A B




H(B/A)


H(A) I(A,B) = I(B,A) H(B)


H(A/B) H(B/A)

Tn hao Lng tin tc b bng hi lin
Hnh 3.3.
Chng 3: C s l thuyt thng tin thng k

65
3.4. TC PHT. KH NNG PHT. THA. KH NNG THNG QUA
CA KNH RI RC
3.4.1. Tc pht ca ngun ri rc
Trong thng tin ri rc, ngi ta thng pht i cc xung. Nu gi
n
T l rng trung
bnh ca mi xung th tc pht ca ngun tin ri rc c nh ngha nh sau:

n
n
1
T

= (3.32)
(3.32) biu th s xung trong mt n v thi gian.
Th nguyn: [
n
] = bt = s du (xung)/ sec
V d: in bo tay:
n
= 25 bt.
in bo t ng:
n
= (50 300) bt.
Thng tin truyn s liu: (500
4
n.10 ) bt.
3.4.2. Kh nng pht ca ngun ri rc
nh ngha:

n
n
H(A)
H'(A) H(A)
T

= = (3.33)
Th nguyn: [H(A)] = bit/sec.

n
1
m H'(A) H(A)
T
ax =
(3.33) biu th lng thng tin trung bnh do ngun pht ra trong mt n v thi gian.

V d: Mt my in bo dng m B u 5 du, c s 2, tc pht l 75 bt th kh
nng ti a ca my l:

5
m n 1 m 2
H'(A) .H (A) 75.log 2 375bit / s
ax ax
= = =
3.4.3. tha ca ngun ri rc
nh ngha:
tha ca ngun ri rc l t s:

m
m m
H(A) H(A) H(A)
D 1
H(A) H(A)
ax
ax ax


= = (3.34)
Chng 3: C s l thuyt thng tin thng k

66
D 1 = , trong :
m
H(A)
H(A)
ax
= c gi l h s nn tin.
i vi ngun tin c s du: H(A)
max
= H
0
(A) = log s.
ngha:
tha c trng cho hiu sut, kh nng chng nhiu v mt ca tin. Nu D cng ln
th hiu sut cng thp, mt cng thp nhng kh nng chng nhiu cng cao.
V d:
- i vi ting Vit: H
1
(Vit) = 4.5167; H
0
(Vit) = 5,1713
1
87 = %
1
D = 13 %
2
2
H (A) 3, 2223
l 5,1713 ogs
= = = 62%
2
D =38%
- i vi ting Nga:
1
= 87%
1
D = 13 %

3
= 60%
3
D = 40 %
- i vi ting Anh:
1
= 84%
1
D = 16 %

8
= 38%
8
D = 62 %
3.4.4. Cc c trng ca knh ri rc v cc loi knh ri rc
Mt knh ri rc hon ton c c trng bi ba tham s sau:
- Trng du li vo v trng du li ra ca knh.
- Xc sut chuyn
j i
p(b / a )
- Tc truyn tin ca knh
K

nh ngha 1:
Nu mt knh c
j i
p(b / a ) t th c gi l knh ng nht;
j i
p(b / a ) vo du
pht trc n th c gi l knh khng nh. Ngc li,
j i
p(b / a ) t th knh c gi l
khng ng nht;
j i
p(b / a ) vo du pht trc n th knh c gi l knh c nh
( i, j ).
nh ngha 2:
Nu mt knh c xc sut chuyn:

j i
c , j 1, t
p(b / a )
p c i j
s

p onst vi i j, i =1,s
onst

= =

=

= =


Chng 3: C s l thuyt thng tin thng k

67
th knh s c gi l knh i xng.
V d:






xc sut sai bng nhau, xc sut ng bng nhau.
i vi knh i xng nh phn (Hnh v):
s
p p 1

+ = .
3.4.5. Lng thng tin truyn qua knh trong mt n v thi gian
nh ngha:

K
K
I(A, B)
I'(A, B) I(A, B)
T

= = [bit/s] (3.35)
Trong :
K
K
1
T
= ,
K
T : thi gian trung bnh truyn mt du qua knh.
K
biu th
s du m knh truyn c (c truyn qua knh) trong mt n v thi gian. I(A,B) l
lng thng tin truyn qua knh trong mt n v thi gian.
Nu knh gin tin:
K n
T T >
Nu knh nn tin:
K n
T T <
Thng thng:
K n
T T =
3.4.6. Kh nng thng qua ca knh ri rc
nh gi nng lc ti tin ti a cu mt knh truyn, ngi ta a ra khi nim kh nng
thng qua.
3.4.6.1. nh ngha
Kh nng thng qua ca knh ri rc l gi tr cc i ca lng thng tin truyn qua knh
trong mt n v thi gian, ly theo mi kh nng c th c ca ngun tin A. (Cc i ny s t
c ng vi mt phn b ti u ca cc xc sut tin nghim p(
i
a ),
i
a A ).

K
A A
C' m I'(A, B) m I(A, B) ax ax

= = [bit/s] (3.36)

p(b
1
/a
1
) = p


a
1
b
1



a
2
b
2

p(b
2
/a
2
) = p

p(b
2
/a
1
) p(b
1
/a
2
)
Chng 3: C s l thuyt thng tin thng k

68

K
A
C' .C v m I(A, B) i C = ax =
C c gi l kh nng thng qua ca knh i vi mi du.
C l mt tham s rt quan trng ca mt knh.
3.4.6.2. Tnh cht
- C 0, C = 0 khi v ch khi A v B c lp (knh b t).
- C
K
logs , ng thc ch xy ra khi knh khng nhiu. (3.37)
Chng minh:

K K K
K K
K K
K
I(A, B) H(A)
I(A, B) H(A) ( 0)
m I(A, B)) m H(A))
m I(A, B) m H(A)
C' logs
ax( ax(
ax ax

>



_ _

3.4.7. Tnh kh nng thng qua ca knh nh phn i xng khng nh, ng nht
3.4.7.1. t bi ton
Ta c mt knh nh phn nh hnh 3.4. Trong :
Xc sut sai:
2 1 1 2 s
p(b / a ) p(b / a ) p = =
Xc sut ng:
2 2 1 1
p(b / a ) p(b / a ) p

= =
p(a
1
) = p; p(a
2
) = 1 - p;
Cc du a
1
v a
2
c cng thi hn T. Vn : tnh C?
3.4.7.2. Gii bi ton
Ta c:

[ ]
K K
1 1
C' m I(A, B) m H(B) H(B/ A)
T T A A
ax ax = =
Ta c ngay:

2 2
i j i j i
i 1 j 1
H(B/ A) p(a ) p(b / a )logp(b / a )
= =
=



p(b
1
/a
1
) = p


a
1
b
1



a
2
b
2

p(b
2
/a
2
) = p

p(b
1
/a
2
)
= p
s

Chng 3: C s l thuyt thng tin thng k

69

[ ]
[ ]
[ ]
[ ]
1 1 1 1 1 2 1 2 1
2 1 2 1 2 2 2 2 2
s s s s
s s s s
H(B/ A) p(a ) p(b / a )logp(b / a ) p(b / a )logp(b / a )
p(a ) p(b / a )logp(b / a ) p(b / a )logp(b / a )
p (1 p )log(1 p ) p logp
(1 p) p logp (1 p )log(1 p )
= +
+
= +
+


[ ]
s s s s
H(B/ A) p logp (1 p )log(1 p ) = +
Ta thy H(B/A) ch ph thuc vo
s
p , m khng ph thuc vo xc sut tin nghim ca
cc du thuc ngun tin A. Do :

[ ]
K
K K
1
C' m H(B) H(B/ A)
T
1 1
m H(B) H(B/ A)
T T
A
A
ax
ax
=
=

y H(B/A) khng i i vi mi trng thi (c tnh thng k) ca ngun A.
M:

m 2 2
m H(B) H(B) log s log 2 1
ax
A
ax = = = =
Vy:
[ ]
s s s s
K
1
C' 1 p logp (1 p )log(1 p )
T
= + +

( )
s K
C' f p , T =
m s
K
1
C' p 0
T
ax
= = Knh khng nhiu.
s s s s
m
C'
1 p logp (1 p )log(1 p )
C'
ax
= + +
(3.38)
th (3.38) biu din trn hnh 3.5.
3.4.8. nh l m ho th hai ca Shannon
nh l: Nu kh nng pht H(A) ca ngun tin ri rc A b hn kh nng thng qua ca
knh: (H(A) < C) th tn ti mt php m ho v gii m sao cho vic truyn tin c xc sut gp
li b tu (nu H(A) > C th khng tn ti php m ho v gii m nh vy) khi di t m
ln.
Nhn xt: y l mt nh l tn ti v n khng ch cho ta cch thit lp mt m c th
no. L thuyt m knh trong chng 4 chnh l hng dn cn thit cho nh l ny.
C/ C
max


1






0 0,5 1 p
s
Hnh 3.5.
Chng 3: C s l thuyt thng tin thng k

70
3.4.9. Kh nng thng qua ca knh nh phn i xng c xo
3.4.9.1.t bi ton
Cho knh truyn, cc du
1
a v
2
a nh hnh v. Cc du
1
a v
2
a c cng thi hn T.
Hy tnh kh nng thng qua C ca knh ny vi iu kin:
Xc sut xo:
3 i
p(b / a ) q =
Xc sut thu ng:
1 1 2 2 s
p(b / a ) p(b / a ) 1 p q = =
Xc sut thu sai:
2 1 1 2 s
p(b / a ) p(b / a ) p = =
3.4.9.2. Gii bi ton
Tng t bi ton trn, ta c:

[ ]
1
C' m H(B) H(B/ A)
T A
ax =
Trong :

( ) ( )
( ) ( ) ( )
( ) ( )
2 3
i j i j i
i 1 j 1
s s s s
s s s s
s s s s
H(B/ A) p(a )p(b / a )logp(b / a )
p 1 p q log 1 p q p logp qlogq
1 p p logp 1 p q log 1 p q qlogq
1 p q log 1 p q p logp qlogq
= =
=
= + +

+ +

= + +


Ta thy H(B/A) vo tnh cht thng k ca ngun A. Do :

[ ]
m H(B) H(B/ A) m H(B) H(B/ A)
A A
ax ax =

( )
( ) ( )
3
j j
j 1
H B p b logp b
=
=


Trong :

( ) ( ) ( ) ( ) ( )
( )
3 1 3 1 2 3 2
p b p a p b / a p a p b / a
pq 1 p q q
= +
= + =

khng ph thuc vo tnh cht thng k ca ngun A.
Nh vy, H(B) s t max ng vi phn b ca cc xc sut p(
i
a ) m bo c:
1- p
s
- q
a
1
b
1


p
s

q
b
3

q
p
s

a
2
b
2

1 p
s
- q
Chng 3: C s l thuyt thng tin thng k

71

( ) ( )
1 2
1 q
p b p b
2

= =
( ) ( )
( )
1 q
m H B qlogq 1 q log
2 A
ax

=
( ) ( ) ( ) ( )
{ }
s s s s
C' F 1 q 1 log 1 q p logp 1 p q log 1 p q = + +


Trong
1
F
T
=
3.5. ENTROPIE CA NGUN LIN TC. LNG THNG TIN CHO TRUNG
BNH TRUYN QUA KNH LIN TC KHNG NH
3.5.1. Cc dng tn hiu lin tc
i vi cc tn hiu cao tn lin tc s(t) th gi tr ca n c th nhn mt cch lin tc cc
gi tr khc nhau trong mt khong xc nh
min m
s s
ax
, cn i s thi gian t li c th lin
tc hay ri rc (hnh 3.6)
V vy, ta s phn cc tn hiu lin tc ra 2 loi.
- Tn hiu lin tc vi thi gian ri rc (hnh 3.6a).
- Tn hiu lin tc vi thi gian lin tc (hnh 3.6b).
Cc tham s c trng ca tn hiu lin tc l:
- Cng sut ph trung bnh
- B rng ph
3.5.2. Cc c trng v tham s ca knh lin tc
Ta bit rng cc c trng ca knh ri rc l:
- Trng du li vo trc hay sau b m ho: A
s(t)
s
max





t
s
min


t
s(t)
s
max






s
min


t
a. b.
Hnh 3.6.
Chng 3: C s l thuyt thng tin thng k

72
- Trng du li ra sau b gii iu ch hoc sau b gii m B.
- Xc sut chuyn
( )
i j
p a / b hoc
( ) ( )
( )
n n
i i
p /
i vi knh lin tc, cc c trng ca n l:
- Trng du li vo (sau b iu ch): {s(t)}
- Trng du li ra (trc b gii iu ch): {U(t)}
- Mt phn b xc sut xut hin
( )
j
U t khi pht hin
( )
i
s t :
( ) ( )
( )
i
t / s t
j
W U
Cng nh i vi knh ri rc tham s quan trng nht ca knh lin tc l kh nng thng
qua ca n.


nh ngha:
Knh Gausse khng i l mt knh lin tc c tp tin li vo v tp tin li ra lin h vi
nhau theo cng thc:

( ) ( ) ( )
u t .s t n t = + (3.39)
Trong = const,
( )
t , n(t): nhiu cng l tp m trng phn b chun.
3.5.3. Knh lin tc cha trong knh ri rc
Tnh cht:
Kh nng thng qua ca knh lin tc khng nh hn kh nng thng qua ca knh ri rc
cha n:

'
lt r.r ch
C C
'
a lt
(3.40)
Chng minh:
Nu php gii iu ch v iu ch l hai php thun nghch ln nhau nh ta mong mun th
khi qua b iu ch v gii iu ch lng thng tin l khng i (lng thng tin truyn qua

M ho

iu ch
ng tin

Gii iu ch

Gii m

Nhiu
Knh lin tc
Knh ri rc (cha knh lin tc)
i
a
i

s(t) u(t)
i

i
b
Chng 3: C s l thuyt thng tin thng k

73
knh trong mt n v thi gian). Nh vy, kh nng thng qua ca knh lin tc ng bng kh
nng thng qua ca knh ri rc. Tuy nhin php gii iu ch thng lm tn hao thng tin, do
kh nng thng qua ca knh ri rc khng th ln hn kh nng thng qua ca knh lin tc
nm trong n.
3.5.4. Entropie ca ngun tin lin tc (ca mt qu trnh ngu nhin lin tc)
Xt mt ngun tin S mi mt thi im c th pht ra nhng tin l mt i lng ngu
nhin s c th nhn cc gi tr lin tc trong khong
min m
s s
ax
vi mt xc sut
( )
s
1
W .
V trong khong
min m
s s
ax
ta c v s
nhng gi tr ca s nn tp tin ca ngun S l
mt tp v hn v nh vy S l mt ngun tin
lin tc. tnh entropie ca ngun ny ta
lm nh sau:
Ta thc hin mt php lng t ho
hnh thc bng cch chia khong
min m
s s
ax
ra n phn bng nhau. Mi phn
bng s v c gi l bc lng t (hnh
3.7).
Ta coi rng s s nhn gi tr
i
s nu gi
tr ca n nm trong mt phn th i no . Nh vy s c th nhn cc gi tr sau: S = {
i
s }, i =
1, n . Xc sut s nhn gi tr
i
s s l:
( ) ( )
i i
p s s . s
1
W
Entropie ca ngun tin ri rc ho S s bng:
( ) ( ) ( )
n
i i
i 1
H S' s . slog s . s
1 1
W W
=
=


Khi cho s 0, ta s c entropie ca ngun tin lin tc.

( ) ( ) ( ) ( )
( )
n
i i
s 0 s 0
i 1
n
i
s 0
i 1
H S lim H S' lim s log s . s
1
lim log s . s
s
1 1
1
W W
W

=

=

= = +




+



( ) ( )
( )
( )
s 0
1
1 1
H S s log ds lim s ds
s s
1 1
1
W W
W



=


= +





_


s
max



s
i


s
min


t
Hnh 3.7.
Chng 3: C s l thuyt thng tin thng k

74
( ) ( )
( )
s 0
1 1
H S s log ds lim
s s
1
1
W
W

= +

(3.41)
T (3.41) ta thy entropie mt chiu ca ngun tin lin tc ln v hn do
s 0
1
lim
s
=

.
S hng th hai khng ph thuc vo bn cht thng k ca ngun (tn hiu) m ch c s hng
th nht ph thuc vo bn cht thng k ca ngun, v vy ta c th ly n c trng cho nhng
qu trnh ngu nhin khc nhau. Ta t:

( ) ( )
( )
1
h S s log ds
s
1
1
W
W

=

(3.42)
v gi h(S) l entropie vi phn (hay entropie tng i) ca ngun S.
Ch :
- Khc vi entropie ca ngun ri rc, h(S) c th nhn cc gi tr dng, m (hu hn).
- Khc vi entropie ca ngun ri rc, h(S) ph thuc vo thang t l ca s, tc l ph thuc
vo vic chn n v o. Nu tng s ln ln:
*
s .s = , khi :
( )
( ) ( )
*
*
ds 1
s s s
ds
1 1 1
W W W = =


( ) ( ) ( )
( )
* * * *
h S s log s ds h S log
1 1
W W

= = +


h(S) cng c tnh cht cng tnh.
3.5.5. Mu vt l minh ho s ln v hn ca entropie ca ngun lin tc
Gi s ta truyn tin t A n B bng ng dy l
tng: khng tn hao, khng gy nhiu. u B ta t
mt my thu l mt volt k l tng (c tp m ni b
bng khng, nn c th o vi chnh xc tu ,
V
Z = ). Tn hiu pht nm trong khong
( )
0 1 Vol. Nh vy, u thu ta s nhn c u = s.
Nu trng
{ }
i
A a , i 1,10 = = (c 10 tin) th
ta c th m ho mt cch n gin bng cch i chng nh sau:
1
a 0,1V ,
2
a 0, 2V , ... ,
10
a 1V
Gi s cc tin l ng xc sut th H(A) = log 10.
Nu
{ }
i
A a , i 1,100 = = th ta c th pht i bng cch i chng:
A B


s u
Hnh 3.8.
Chng 3: C s l thuyt thng tin thng k

75
1
a 0, 01V ,
2
a 0, 02V , ... ,
100
a 1V
Nu cc tin l ng xc sut th H(A) = log100.
Tng t, nu
6
i 1,10 = th ch cn chn bc lng t
6
s 10

= th ta c th m bo
truyn c mi tin. Nu cc tin l ng xc sut th
6
H(A) log10 = .
V knh v thit b thu khng c nhiu nn ta c th chn s b tu truyn mt s tin
ln tu . Khi entropie ca ngun tin c th ln tu . Nu s 0 H(A) .
Trong thc t, lun tn ti nhiu n(t) trn ng dy v volt k lun c tp m ni b. Do
khng th chn s nh tu c m phi l mt s hu hn. V vy entropie ca ngun trn
thc t l hu hn.
3.5.6. Lng thng tin cho trung bnh truyn theo knh lin tc khng nh
Xt mt ngun lin tc S v gi thit cc tin s do ngun sinh ra l c lp thng k vi
nhau, ngha l xt ngun lin tc khng nh. Xt knh lin tc ch c can nhiu cng n(t) c cc
gi tr cng c lp thng k vi nhau. Khi li ra ca knh ta nhn c cc tin:
u .s n = +
Cc tin ny cng c lp thng k vi nhau. Khi knh xt cng l knh lin tc khng
nh. Ta s tnh lng thng tin trung bnh truyn theo knh ny: I(S, U).
Ta cng s lng t ho cc tin u thu v u pht. Bc lng t u pht l s ,
bc lng t u thu l u . Khi ta c hai ngun ri rc sau:
{ }
i
S' s , i 1, n = = v
{ }
j
U' u , j 1, m = = . Tng t nh mc 4, ta c:
Xc sut s nhn gi tr
i
s s l:
( ) ( )
i i
p s s . s
1
W = .
Tng t, ta c:
( ) ( )
j j
p u u . u
1
W = .
Xc sut ng thi s nhn gi tr
i
s v u nhn gi tr
j
u gn ng bng:

( ) ( )
i j i j
p s , u s , u . s. u
2
W =
Nu coi
i
s l tin truyn i v
j
u l tin nhn c tng ng th khi knh s l ri rc
khng nh v lng thng tin cho trung bnh truyn theo knh ri rc l:

( )
( )
( )
( )
n m
i j
i j
i
i 1 j 1
p s / u
I S', U' s , u . s. u.log
p s
2
W
= =
=


Ch rng theo cng thc nhn xc sut:
Chng 3: C s l thuyt thng tin thng k

76

( )
( )
( )
( )
( )
( )
( )
( )
( ) ( )
i j i j
i j
j j
n m
i j
i j
i 1 j 1 j j
p s .u s , u . s. u
p s / u
p u u . u
s , u . s. u
I S', U' s , u . s. u.log
u . u. s . s
2
1
2
2
1 1
W
W
W
W
W W
= =

= =


Khi cho s 0 v u 0 ta s chuyn t knh ri rc sang knh lin tc v lng
thng tin trung bnh truyn theo knh lin tc l:
( ) ( ) ( )
( )
( ) ( )
s 0
u 0
s, u
I S, U lim I S', U' s, u log ds.du
s . u
2
2
1 1
W
W
W W




= =

(3.43a)
hay
( )
( )
( ) ( )
s, u
I S, U M log
s . u
2
1 1
W
W W

=


(3.43b)
3.6. ENTROPIE VI PHN C IU KIN. TNH CHT CA CC TN HIU
GAUSSE
3.6.1. Entropie vi phn c iu kin
T (3.43b), ta c:
( )
( )
( )
( )
s, u
1
I S, U M log log
s u
2
1 1
W
W W

= +



( )
( )
( )
( )
s, u
1
I S, U M log M log
s u
2
1 1
W
W W

= +



( )
( )
( )
( )
( )
s, u
1
s log ds s, u log ds.du
s u
2
1 2
1 1
W
W W
W W


= +

(3.44a)
Ta c th vit di dng sau:
I(S,U) = h(S) - h(S/U) (3.44b)
Trong h(S) chnh l entropie vi phn ca ngun.

( ) ( )
( )
1
h S s log ds
s
1
1
W
W

=



Chng 3: C s l thuyt thng tin thng k

77
( ) ( )
( )
( )
u
h S/ U s, u log ds.du
s, u
1
2
2
W
W
W

=


( )
( )
1
s, u log ds.du
s / u
2
1
W
W

=

(3.45)
Ch :
Theo cng thc xc sut nhn:
( ) ( ) ( )
s, u u . s / u
2 1 1
W W W =
h(S/U) tnh theo (3.45) c gi l entropie vi phn c iu kin ca ngun S khi bit
ngun U.
i vi ngun ri rc, ta c: I(A,B) = H(A) H(A/B)
H(A) l lng thng tin ring trung bnh cha trong mi du ca A.
H(A/B) l lng thng tin tn hao trung bnh ca mi tin do nhiu trong knh gy ra.
V mt hnh thc, ta thy h(S) ng vai tr ca H(A), cn h(S/U) ng vai tr ca H(A/B).
V mt ngha th khng phi nh vy, bi v h(S) v h(S/U) c th m v ph thuc vo
thang t l. Tuy vy, vic a ra h(S) v h(S/U) rt c li cho vic tnh ton.
T (3.44a) v (3.44b) ta c th suy ra cc tnh cht sau ca I(S,U):
- I(S,U) 0, I(S,U) = 0 khi knh b t: W(u/s) = W(u)
- I(S,U) = I(U,S) = h(U) h(U/S): tnh cht i xng.
- Nu knh l khng nhiu n(t) = 0 th I(S,U) = .
Hai tnh cht u tng t nh trong trng hp knh ri rc khng nh. Tnh cht sau suy
ra t tnh cht ln v hn ca entropie ca ngun lin tc.
Ch :
I(S,U) khng ph thuc vo thang t l.
3.6.2. Entropie vi phn ca nhiu Gausse
Xt nhiu Gausse n(t) c M[n] = 0 v D[n] =
n
P .
Hm mt phn b xc sut ca n l:

( )
n n
1
2P 2 P
2
n
W n exp -


=




Ta s tnh vi phn entropie vi phn ca nhiu ny.
Chng 3: C s l thuyt thng tin thng k

78
Ta c:
( ) ( )
2
n
n
2P
n
h N log 2 P e dn W n



( ) ( ) ( )
( ) ( )
[ ]
2
n
n
n
2P
n
2
n
n
1 D n P
h N .log 2 P .dn .loge .dn
loge
log 2 P .dn n . .dn
2P
W n W n
W n W n




= = =
= +
= +


_ _


( )
n
1
h N log 2 P loge
2
= +
( )
n
h N log 2 P .e = (3.46)
3.6.3. Lng thng tin cho trung bnh truyn theo knh Gausse
Ta c:

( ) ( ) ( )
( )
( )
( )
I S, U h U h U/ S
1
u log du h U/ S
u
1
1
W
W

=
=


Ta s tnh h(U/S) trong trng hp nhiu Gausse. Knh ta xt s l knh Gausse:

( ) ( ) ( )
u t .s t n t = +

( ) ( ) ( )
( ) ( ) ( ) ( )
( ) ( ) ( )
h U/ S s, u .log u / s .du.ds
h U/ S s . u / s .log u / s .du.ds
s .ds u / s .log u / s .du
2 1
1 1 1
1 1 1
W W
W W W
W W W



=
=
=




( ) ( ) ( )
h U/ S u / s .log u / s .du
1 1
W W

=

(3.47)
xc nh h(U/S) ta phi tnh c
( )
u / s
1
W .
Chng 3: C s l thuyt thng tin thng k

79
V yu t ngu nhin ch do nhiu gy nn, o vi bt c mt gi tr nht nh no ca s
th xc sut u ri vo khong du cng chnh bng xc sut n ri vo khong dn.

{ }
{ }
du
p u p n dn
s
=

( ) ( )
u / s du n dn
1 1
W W =
( ) ( ) ( )
du
dn
dn
1
u / s n n
du
1 1 1
W W W = =
Vi ( )
du d ds dn
s n 1
dn dn dn dn
= + = + = V 0 khi s, n
ds
c lp
dn

=



Vy ( ) ( )
n n
1
u / s n
2P 2 P
2
1 1
n
W W exp -


= =





( ) ( )
n
U/ S n log 2 eP h h = =
( )
( )
n
1
u .log .du log 2 eP
u
1
1
-
I(U,S) = W
W

(3.48)
Nu u cng c phn b chun th:
( )
u
U log 2 eP h =
Do s(t) v n(t) l c lp nn:

2 2
u s n u n
P P P = + = +
Vy:
( ) ( )
s n
U log 2 e P P h = +
Cui cng, ta c: I(S,U) = h(U) h(S/U)

s s
n n
P P 1
I(S, U) log 1 log 1
P 2 P

= + = +


(3.49)
Trong
s
P l cng sut trung bnh ca tn hiu hu ch (tn hiu pht).
Nhn xt:
T (3.49) ta thy I(S,U) khng ph thuc vo hnh dng v cu trc ca tn hiu, m ch ph
thuc vo t s
s n
P / P . Thc ra kt lun ny ch ng v hnh thc, thc ra sau ny ta s thy nu
cu trc v hnh dng ca tn hiu thay i th
s n
P / P cng s thay i, do I(S,U) cng s khc
nhau i vi cc tn hiu c cu trc v hnh dng khc nhau.
Chng 3: C s l thuyt thng tin thng k

80
3.6.4. Tnh cht ca cc tn hiu c phn b chun
nh l:
Trong s nhng qu trnh (tn hiu) c cng cng sut trung bnh (
2
), tn hiu c phn b
Gausse s cho entropie vi phn ln nht. Tc l:

( ) ( ) ( )
2
h X x .log x .dx log 2 e
1 1
W W



( ) ( )
2
m h X log 2 e khi x m
1
ax W t chun =
Chng minh:
Gi x(t) l tn hiu khng Gausse.

~
x(t) l tn hiu Gause:
~ ~
2
~
x x
1
x
2P 2 P
~
1
x
W exp -


=







iu cn chng minh nh l trn trng ng vi vic chng minh bt ng thc sau:

( )
x
h X log 2 eP 0 (*)
Trc ht theo gi thit, ta c:
~
x
x
D D D = =
( )
2
~ ~ ~
2
x x dx x x dx
1 1
W W



=



(a)
Ta c:

( )
~ ~ ~ ~
~ ~
h X x log x dx
loge
log 2 D x dx x dx
2D
1 1
2
1 1
W W
W x W




= =



= +



( )
~ ~
do x dx x dx 1 v
1 1
W W do (a)




= =






Chng 3: C s l thuyt thng tin thng k

81
( )
( )
2
~
~
1 x
h X log2 D loge x dx
2 2D
x log x dx
1
1 1
W
W W



=





=


T (*) cn chng minh:
( )
~
h X h X 0





Ta c:
( ) ( ) ( ) ( )
~ ~
h X h X x log x dx x log x dx
1 1 1 1
W W W W



= +




( )
( )
~
x
x log dx
x
1
1
1
W
W
W




=

(**)
Vi a > 1 bao gi ta cng c:
a
log x x 1 .
Nn:

( ) ( )
( )
( )
~
~
~
x
h X h X x 1 dx
x
x dx x dx
1
1
1
1 1
W
W
W
W W



Vy
( ) ( )
~ ~ ~
h X h X 0 h X h X x x





( )
~
m h X log 2 eD axh X

= =



ngha nh l:
Trong s cc qu trnh ngu nhin c cng phng sai th qu trnh c phn b chun th
hin tnh ngu nhin nhiu hn c. Do ta thy rng trong s nhng tp c cng phng sai
th tp phn b chun c tc hi ln nht i vi vic truyn tin. (v entropie c trng cho bt
Chng 3: C s l thuyt thng tin thng k

82
nh, m entropie ca tp chun max nn bt nh ca n ln nht). l l do v sao trong
cc bi ton ca v tuyn in thng k ngi ta thng xt tp chun.
Bng phng php tng t, ta c th chng minh c:
a. Trong s tt c cc phn b trong mt khong hu hn (a,b):
( )
b
1
a
W x dx 1 =

. i
lng ngu nhin phn b u c entropie ln nht. H(X) = log(b a) = log 2 3 l
b. Trong s tt c cc i lng ngu nhin lin tc dng c cng k vng m:
( )
1
0
W x dx 1

v
( )
1
0
xW x dx m

. i lng ngu nhin phn b theo lut m c


entropie ln nht.
3.7. KH NNG THNG QUA CA KNH GAUSSE
3.7.1. Kh nng thng qua ca knh Gausse vi thi gian ri rc
nh ngha:
Knh Gausse khng i vi thi gian ri rc l knh Gausse khng i c tn hiu li vo
s(t) l hm lin tc ca i s ri rc.
Ta c th coi tn hiu lin tc vi thi gian ri rc (hnh 5.1a) l mt dy xung c bin l
cc gi tr bt k trong khong
min m
s s
ax
v chu k lp li (ng thi cng l rng xung)
l khong thi gian ri rc t . em cc xung (tin) truyn vo knh th tc truyn tin ca
knh (cng l tc truyn tin ca ngun) vi thi gian ri rc s l:

K
1
t
=


Tng t nh i vi knh ri rc, kh nng thng qua ca knh Gausse vi thi gian ri
rc s l:

K
C' .maxI(U,S) = (3.50)
I(U,S) l lng thng tin cho trung bnh truyn trong knh lin tc. i vi knh Gausse
khng i, ta c:

( ) ( ) ( ) ( )
( ) ( )
n
n
I U,S h U h N h U log 2 eP
m I U,S m h U log 2 eP ax ax
= =
=

Theo nh l phn 3.6, ta thy h(U) t max khi u c phn b chun:

( )
u
m h U log 2 eP ax =
Chng 3: C s l thuyt thng tin thng k

83
mt thi im no , ta c: u .s n = +
Do s v n c lp nn:
u s n
P P P

= +
Vy:
( )
K s n n
C' log 2 e P P log 2 eP


= +




s n
K
n
P P
C' log
P

+
=

s
K
n
P
1
C' log 1
2 P


= +


(3.51)
Trong
s n
P P

l t s tn trn tp u ra ca knh lin tc (u vo b gii iu ch).


Ta kho st
( )
s n
C' f P P

= :
Khi
s
n
P
0 C' 0
P

. Tc l nu S/N rt b th knh coi nh b t.


Khi
s
n
P
P

nhng cn nh (< 3) th C tng theo rt nhanh.


Khi
s
n
P
P

nhng kh ln (> 12) th C tng theo rt chm.


Do ta thy khng nn chy theo vic tng cng sut ca my pht tng kh nng
thng qua ca knh m nn tng tc truyn tin ca knh (v C ~
K
).
3.7.2. Kh nng thng qua ca knh Gausse vi thi gian lin tc trong mt gii tn hn
ch
Ta s tnh kh nng thng qua ca knh Gausse trong trng hp tn hiu vo s(t) l hm
lin tc ca thi gian lin tc, c ph hu hn F.
u vo ca b gii iu ch ,ta c th t thm mt b lc tn thp c gii thng F. (Gii
tn cng tc ca knh lc ny cng chnh l gii thng tn ca b lc ny). Nh vy b lc s
khng nh hng n mo tn hiu nhng s hn ch c tp m trng. Theo nh l
B.A.Kachennhicop ta c th ri rc ho tn hiu theo trc t m vn khng lm mt thng tin nu
nh
1
t
2F
= . Nh vy ta thay vic truyn tn hiu lin tc vi thi gian lin tc bng vic
truyn tin liu lin tc vi thi gian ri rc. Khi tc truyn ca knh (s xung truyn trong
mt n v thi gian) s l:
K
1
2F
t
= =

. Do theo (3.51), ta c:
c

2

1

P
S
/P
n

0 4 8 12
Hnh 3.9.
Chng 3: C s l thuyt thng tin thng k

84

s
n
P
C' Flog 1
P


= +


(3.52)
Trong : F l b rng ph ca tn hiu

n
P l cng sut trung bnh ca nhiu trong gii F
Vi tp trng ta c:
n 0
P N .F =

0
N l mt ph cng sut thc t ca nhiu

s
0
P
C' Flog 1
N .F


= +


(3.52)
Nhn xt:
Nu tng C bng cch tng F th ko theo
n
P
S
N




. Nh vy gia C, F v
(S/N) c s tr gi, ta c li v mt ny th phi chu thit mt khc.
Ta vn c th thu chnh xc c tn hiu (m bo C = const) trong trng hp S/N b
(cng sut ca my pht nh, c ly lin lc xa, nhiu mnh) bng cch m rng ph ca tn hiu.
V d: trong thng tin v tr, S/N rt nh nn tn hiu lin lc phi l tn hiu gii rng (tn hiu
iu ch phc tp, tn hiu gi tp,...)
chnh l ngha ca (3.52), n cn c gi l cng thc Shannon.
3.7.3. Kh nng thng qua ca knh Gausse vi thi gian lin tc trong gii tn v hn
Trong (3.52), nu ly c s ca log l e th C c o bng [nat/s]. Nu o bng [bit/s]
th:

s
0
P
1
C' 1, 443Fln 1 .
N F


= +


[bit/s] (3.53)
By gi ta s xt s ph thuc ca C vo F.
- Khi F 0 th r rng l C' 0
- Khi F th C'
c bit, ta s xt gi tr ca C khi F , tc l khi gii thng ca knh khng hn ch.
t
s
0
P
1
. x
N F

=
s
0
P
1
F .
N x

=
Khi x 0 th F .
Chng 3: C s l thuyt thng tin thng k

85
Ta k hiu:
( )
s '
F x 0
0
P
1
C lim C' lim . .ln 1 x .1, 443
N x



= = +




( )
s '
x 0
0
P
1
C 1, 443. . lim .ln 1 x
N x



= +



Ta c:
( )
1/ x
x 0
lim 1 x 1

+ =

s '
0
P
C 1, 443.
N

= (3.54)
th C = f(F) c v hnh 3.10.
Ti gi tr
s
0
P
F
N

=
s
0
P
C F
N

= = .
T th, ta thy: Kh nng thng qu ca knh Gausse vi thi gian lin tc l mt i
lng gii ni:
'
0 C' C

. iu ny c gii thch nh sau: Trong thc t, mi vt u c


tp m nhit. Tp m nhit c phn b chun v c mt cng sut
o
0
N k.T = .
Trong : k l hng s Boltzman, k =
23
1,38.10

J/.

o
T l nhit tuyt i ca vt.
V vy kh nng thng qua ca mi knh thc t u b gii ni.
3.7.4. nh l m ho th hai ca Shannon i vi knh lin tc
i vi knh lin tc, nh l m ho th hai ca Shannon c pht biu nh sau:
nh l:
Cc ngun tin ri rc c th m ho v truyn theo knh lin tc vi xc sut sai b tu
khi gii m cc tn hiu nhn c nu kh nng pht ca ngun nh hn kh nng thng qua ca
knh. Nu kh nng pht ca ngun ln hn kh nng thng qua ca knh th khng th thc hin
c m ho v gii m vi xc sut sai b tu c.
3.7.5. V d: Kh nng thng qua ca mt s knh thc t
- Knh vin thng chuyn tip:

( )
6 7
C' n.10 n.10 = Hartley/s
- in thoi, in bo nh, vin thng chuyn tip:
c


c



P
S
/N
0






0 P
S
/N
0
F
Hnh 3.10.
Chng 3: C s l thuyt thng tin thng k

86

( )
3 4
C' n.10 n.10 = Hartley/s
- in bo:

( )
2
C' n.10 n.10 = Hartley/s
- Con ngi: + Th gic:
' 6
1
C n.10 = Hart./s
+ Thnh gic:
' 3
2
C n.10 = Hart./s.
iu ny chng t "trm nghe khng bng mt thy"
+ Xc gic
'
3
C :
' ' '
2 3 1
C C C < <
Con ngi ch c th nhn thc c cc thng tin a ra vi tc truyn 15 Hart./s.
Mt quyn sch 100 trang ( 2000 du/trang): I =
( )
3 7
10 10 bit.
Tr nh ngn hn ca con ngi:
( )
2 5
10 10 bit.
Trung bnh mt i ngi tip nhn
10
10 bit.
BI TP
3.1. Thnh ph n c 1% dn s l sinh vin. Trong s sinh vin c 50% l nam thanh nin. S
nam thanh nin trong thnh ph l 32%. Gi s ta gp mt nam thanh nin. Hy tnh lng thng
tin cha trong tin khi bit rng l mt sinh vin.
3.2. C hai hp ng bt ch, mi hp ng 20 bt ch. Hp th nht c 10 bt trng, 5 bt en v
5 bt . Hp th hai c 8 bt trng, 8 bt en v 4 bt . Ta ly h ho mt bt ch t mi hp.
Hi rng php th no trong hai php th ni trn c bt nh ln.
3.3. Cc tn hiu
1
x ,
2
x vi cc xc sut tin nghim
( )
1
p x 3/ 4 = ,
( )
2
p x 1/ 4 = c
truyn theo knh nh phn i xng c nhiu nh hnh v. Do c nhiu nn xc sut thu ng mi
tn hiu gim i ch bng 7/8. Hy tm:
a. Lng tin tc ring c iu kin
( )
2 2
I x / y
b. Lng tin tc cho
( )
2 2
I x , y
c. Cc lng tin tc
trung bnh
( )
2
I X, y ,
H(X), H(X/Y), I(X,Y)


1
y
2
y
2
x
1
x
( )
1 1
p y / x 7/ 8 =
( )
2 2
p y / x 7/ 8 =
( )
1 2
p y / x 1/ 8 =
( )
2 1
p y / x 1/ 8 =
( )
1
p x 3/ 4 =
( )
2
p x 1/ 4 =
Chng 3: C s l thuyt thng tin thng k

87






3.4. Mt bng ch ci gm bn con ch
1
x ,
2
x ,
3
x ,
4
x . Gi tr xc sut xut hin ring r cc
ch
( )
i
p x v xc sut c iu kin
( )
j i
p x / x cho trong cc bng di y.

i
x
1
x
2
x
3
x
4
x
( )
i
p x
0,5 0,25 0,125 0,125


1
x
2
x
3
x
4
x
( )
4
j i
j 1
p x / x
=

1
x
2
x
3
x
4
x
0

0,2

0,25

0,2
0,2

0,2

0

0,4
0,4

0,3

0,25

0,4
0,4

0,3

0,5

0
1

1

1

1
Hy tm tha ca ngun tin trong hai trng hp:
a. Khi cc con ch c lp thng k vi nhau.
b. Khi cc con ch ph thuc thng k vi nhau.
3.5. Mt in i v tuyn in gm 16 khi c gi tr nh nhau v tin cy v c mc ni
tip v mt thit b kim tra thng bo s hng hc ca cc khi. Hy tnh s ln th t nht tin
hnh bng thit b kim tra thng bo c th pht hin bt c s hng hc no ca tt c
cc khi.
3.6. Mt in i ca ch c th lm vic trn sng
1
(s kin
1
A ) hoc trn sng
2
(s
kin
2
A ); n cng c th lm vic ch lin tc (s kin
1
B ) cng nh ch xung (s
kin
2
B ). Xc sut cc s kin ng thi c gi tr nh nhau:
( )
1 1
p A B 0,15 = ;
( )
1 2
p A B 0, 7 = ;
( )
2 1
p A B 0,1 = ;
( )
2 2
p A B 0, 05 = .
j
x
i
x
Chng 3: C s l thuyt thng tin thng k

88
Hy tnh lng tin tc v ch cng tc ca in i y nu coi rng di bc sng
bit.
3.7. Xc nh kh nng thng qua ca knh nh phn i xng c xo (nh hnh v). Nu cc du
i
x v
j
y c thi hn nh nhau v
1
F
= . F l tn s pht i cc du.







Ghi ch: Gii bng cch tm cc tr ca hm
( ) ( )
= H B f p
3.8. u vo mt my thu nhn c tn hiu hn hp y(t) = x(t) + n(t). Trong tn hiu x(t)
v can nhiu n(t) u l cc qu trnh ngu nhin chun, c lp, c k vng bng khng v
phng sai ln lt bng
2
s
v
2
n
. Hy tnh:
a. Lng tin tc I(x,y) v tn hiu x(t) cha trong tn hiu thu c y(t).
b. Lng tin tc cho trung bnh.
3.9. A chn mt trong cc s t 0 7. Hi B phi dng trung bnh bao nhiu cu hi tm ra s
A ngh?
3.10. Tnh rng gii thng ca mt knh v tuyn truyn hnh truyn hnh nh en trng vi
5
5.10 yu t, 25 nh trong 1s v c 8 mc sng ng xc sut, vi t s
2
s s
n 0
P
15
P N .F

= = .
Nu coi rng nh v tuyn truyn hnh xem nh mt dng tp m trng.
3.11. Tm mt ph tn hiu S(f) bo m tc truyn tin cc i khi cho trc cng sut
ton phn ca tn hiu:
( )
2
1
f
s
f
P S f df =

v mt ph ca nhiu N(f).
3.12. Hy so snh kh nng thng qua ca hai knh thng tin nu knh th nht chu mt tc ng
ca mt tp m trng, chun trong gii tn F vi phng sai
2 2
1V = , cn knh th hai chu
tc ng ca mt tp m trng, phn b u trong khong 1,5 vi gii tn 2F. Coi rng cng
sut ca tn hiu rt ln hn cng sut ca tp m.
1 - p
s
- q
p(x
1
) = p x
1
y
1

p
s
q
y
3


p
s

p(x
2
) = 1 - p x
2
y
2

1 p
s
- q

Chng 3: C s l thuyt thng tin thng k

89
3.13. Trong 27 ng xu ging nhau c 1 ng xu gi nh hn. Gi s ta dng mt cn a thng
bng (c hai a cn) xc nh ng xu gi. Hy tnh s ln cn trung bnh ti thiu xc nh
c ng xu gi. Nu thut ton cn.
3.14. Trong b t l kh 52 qun bi (khng k phng teo), A rt ra mt qun bi bt k. Tnh s
cu hi trung bnh ti thiu m B cn t ra cho A xc nh c qun bi m A rt. Nu
thut ton hi? Gi s A rt ra 5 r, hy nu cc cu hi cn thit.


Chng 4: C s l thuyt m ha


90
CHNG IV C S L THUYT M HA
4.1. CC NH NGHA V KHI NIM C BN
4.1.1. Cc nh ngha c bn
4.1.1.1. M ha
Tp cc tin ri rc rt a dng v phong ph. h thng truyn tin s c th truyn c
cc tin ny cn phi c mt qu trnh bin i thch hp i vi cc tin ri rc, chnh l qu
trnh m ha.
nh ngha 1: M ha l mt nh x 1- 1 t tp cc tin ri rc
i
a ln tp cc t m
i
n
i

i
n
i i
: a f
c th d dng m ha v gii m, t cc t m
i
n
i
thng l cc phn t ca mt cu
trc i s no . Bi vy ta c th nh ngha c th hn cho php m ha.
nh ngha 2: M ha l mt nh x 1- 1 t tp cc tin ri rc
i
a ln mt tp con c cu
trc ca mt cu trc i s no .
4.1.1.2. M
nh ngha 3: M (hay b m) l sn phm ca php m ha, hay ni cch khc m l mt
tp cc t m c lp nn theo mt lut nh.
4.1.1.3. Cc yu t ca t m
nh ngha 4: di t m
i
n l s cc du m cn thit dng m ha cho tin
i
a .
Nu
i
n const = vi mi i th mi t m u c cng di. B m tng ng c gi l
b m u.
Nu
i j
n n th b m tng ng c gi l b m khng u
nh ngha 5: S cc du m khc nhau (v gi tr) c s dng trong b m c gi l
c s m. Ta k hiu gi tr ny l m.
Nu m = 2 th b m tng ng c gi l m nh phn.
Nu m = 3 th b m tng ng c gi l m tam phn

Nu m = p th b m tng ng c gi l m p phn.
Thng thng cc du m c chn l cc phn t trong mt trng F no .
Chng 4: C s l thuyt m ha


91
V d 1: T m
7
i
trong b m u nh phn c di 7 c th m t nh sau:
7
i
0 1 1 0 1 0 1 =
Mi mt du m trong t m ny ch c th nhn mt trong hai gi tr
{ }
0,1 , mi du m l
mt phn t ca trng nh phn GF(2).
4.1.2. Cc khi nim c bn
4.1.2.1. tha ca mt b m u (D)
Cho ngun ri rc A gm s tin:
{ }
i
A a ; 1,s = .
Xt php m ha f sau:
n n
i i i
: a ; V f .
C s m l m, khi s cc t m di n c th c l:
n
N m = .
nh ngha 6: tha ca mt b m u c xc nh theo biu thc sau:
( ) ( )
( )
( )
( )
[ ]
0 0 0
0 0
H V H A H A
D 1 %
H V H V


= = (4.1)
Trong :
( )
0
H A logs =

( )
0
H V log N nlogm = =
V d 2: Ta c m ha 4 tin A, B, C, D bng cc tin t m ca mt b lc gii m u nh
phn, c di n = 3, khi tha ca b m ny l:
log4
D 1 33,33%
3log2
= =
B m ny c 4 t m c dng m ha cho 4 tin ri rc. Cc t m cn li (4 t m)
khng c dng m ha c gi l cc t m cm.
i vi cc b t m u, nh gi nh lng s khc nhau gia cc t m trong b m,
ta s dng khi nim khong cch m sau.
4.1.2.2. Khong cch m (d)
nh ngha 7: Khng cch gia hai t m bt k
n
i
v
n
j
l s cc du m khc nhau
tnh theo cng mt v tr gia hai t m ny, k hiu
( )
n n
i j
d ,
V d 3:
7
i
0 1 1 0 1 0 1 =

7
j
1 0 0 1 1 1 0 =
Chng 4: C s l thuyt m ha


92
( )
7 7
i j
d , 6 =
Khong cch m d c y cc tnh cht ca khong cch trong mt khng gian metric.
Tnh cht 1:
( ) ( )
n n n n
i j j i
d , d , =
Tnh cht 2:
( )
n n
i j
1 d , 0
Tnh cht 3: (Tnh cht tam gic):
( ) ( ) ( )
n n n n n n
i j j k i k
d , d , d , +
nh gi nh lng kh nng khng ch sai (bao gm kh nng pht hin sai v kh
nng sa sai) ca mt b m ta s dng khi nim khong cch m ti tiu (haykhong cch
Hamming) sau:
nh ngha 8: Khong cch Hamming
0
d ca mt b m c xc nh theo biu thc
sau:
( )
n n
i j
n n
0 i j
,
d min d ,


=
y
n
i
v
n
j
khng ng nht bng khng (Ta coi
n
i
l t m khng khi mi du
m trong t m u nhn gi tr khng).
4.1.2.3. Trng s ca mt t m
nh ngha 9: Trng s ca mt t m
( )
n
i
W l s cc du m khc khng trong t
m.
V d:
7
i
0 1 1 0 1 0 1 =

( )
7
i
W 4 =
Nu ta coi mi t m
n
i
l mt vct n chiu trong mt khng gian tuyn tnh n chiu
n
V , khi php cng c thc hin gia hai t m tng th nh php cng gia hai vct
tng ng.
V d 4:
( )
7
i
0 1 1 0 1 0 1 0, 1, 1, 0, 1, 0, 1 =

( )
7
j
1 0 0 1 1 1 0 1, 0, 0, 1, 1, 1, 0 =
( )
7 7 7
k i j
1 1 1 1 0 1 1 1, 1, 1, 1, 0, 1, 1 = + =
Chng 4: C s l thuyt m ha


93
y php cng trn mi thnh phn (ta ) ca vct c thc hin trn trng nh
phn GF(2). Php cng theo modulo 2 ny c m t nh sau:
+ 0 1
0 0 1
1 1 0

Sau y l cc tnh cht ca trng s:
-
( )
n
i
0 W 1
-
( ) ( )
n n n n
i j i j
d , W = +
4.1.3. Kh nng khng ch sai ca mt b m u nh phn
4.1.3.1. Kh nng pht hin sai
nh l 1: Mt b m u nh phn c tha (D > 0) v c
0
d 2 s c kh nng pht
hin c t sai tha mn iu kin:
0
t d 1 (4.2)
Chng minh:
Mi t m trong b m u cch nhau mt khong cch t nht l
0
d . Khi truyn tin, do c
nhiu t m nhn c c th b sai t v tr
0
t d 1 . V vy t m nhn c khng th bin
thnh mt t m c dng khc. Nh vy ta lun c th pht hin c rng t m nhn sai.
4.1.3.2. Kh nng sa sai
nh l 2: Mt b m u nh phn c tha
( )
D 0 v c
( )
0
d 3 s c kh nng
sa c e sai tha mn iu kin:
0
d 1
e
2



(4.3)
y
[ ]
x l k hiu phn nguyn ca s x .
Chng minh:
Khi truyn tin, do c nhiu, t m nhn c c th b sai e v tr
0
d 1
e
2





. Nh
vy, Khong cch gia t m nhn c vi t m khc ti tiu l e 1 + . Nh vy, ta lun c th
xc nh ng c t m pht. iu c ngha l ta sa sai c e sai gp phi trn c
truyn.
Chng 4: C s l thuyt m ha


94
4.1.4. M u nh phn khng c tha
M u nh phn khng c tha (D = 0) cn c gi l m n gin. Vi m n gin
ta c
n
s = N = 2 . Nh vy mi mt t m c th c u c s dng m ha cho cc tin
ri rc. Vi t m n gin
0
d 1 = . V vy ta khng th pht hin hay sa c bt c mt sai
no.
Gi s ta truyn t m n gin qua knh i xng nh phn khng nh c xc sut thu sai
mt du l
0
p . Khi xc sut thu ng mt du tng ng l
( )
0
1 p . T m ch nhn ng
khi mi du m u nhn ng. Nh vy, xc sut thu ng t m p

l:
( )
n
0
p 1 p =

(4.4)
Xc sut thu sai ca t m l:

( )
n
s 0
p 1 p 1 1 p = =

(4.5.a)

Vi
0
p 1 < ta c cng thc gn ng sau:

( )
n
0 0
1 p 1 np
Ta c:
s 0
p np (4.5.b)
Gi s xc sut thu sai cho php i vi mi tin ri rc l
s cp
p , khi iu kin s
dng m n gin trong knh i xng nh phn khng nh l:

s scp
p p
Hay
scp
0
p
p
n
< (4.6)
4.2. M THNG K TI U
Ta xt php m ha sau i vi cc tin ca ngun ri rc A:
i
n
i i
: a f
Mi tin
i
a c m ha bng mt t hp m (t m)
i
n
i
(
i
n
i
l mt t hp m gm
i
n
du m).
Ta xt trng hp m nh phn tc l mi du m ch nhn mt trong hai gi tr "0" v "1".
Chng 4: C s l thuyt m ha


95
4.2.1. di trung bnh ca t m v m ha ti u
Ta c
( )
( )
i
n
i
i
i 1,s
i
i
a
A V i 1,s
p a
p a
=


= = =







nh ngha 1: di trung bnh ca mt t hp m c xc nh theo biu thc sau:
[ ] ( )
s
i i i
i 1
n M n n p a

=
= =


nh ngha 2: Mt php m ha c gi l tit kim (hay ti u) nu n lm cc tiu gi
tr n .
4.2.2. Yu cu ca mt php m ha ti u
- n min .
- C kh nng gii m tc th: khng mt dy bt no trong biu din ca mt tin (k t) no
li l phn u (prefix) ca mt dy bt di hn biu din cho mt tin (k t) khc.
V d 1: M Moorse khng m bo yu cu ny v:
M s cho E (.) l tin t ca m s cho A
( )
.


M s cho D
( )
..

l tin t ca m s cho B
( )
...


4.2.3. nh l m ha th nht ca Shannon (i vi m nh phn)
4.2.3.1. nh l
Lun lun c th xy dng c mt php m ha cc tin ri rc c hiu qu m n c th
nh ty nhng khng nh hn entropic H(A) c xc nh bi c tnh thng k ca ngun A.
( )
n H A
Chng minh:
Nu gi m l c s ca b m th lng thng tin ring cc i cha trong mi du m l
log m.
Gi
i
n l di ca t m
i
n
i
ng vi tin
i
a , khi lng thng tin ring cc i cha
trong t m ny l
i
n logm.
Lng thng tin ring trung bnh ca mi t m l:
( )
s
i i
i 1
p a n logm nlogm
=
=


Chng 4: C s l thuyt m ha


96
php m ha khng lm tn hao thng tin th lng thng tin ring trung bnh cc i
cha trong mi t m phi khng nh hn lng thng tin ring trung bnh cha trong mi tin
thuc ngun. Tc l:
( ) nlog m H A
hay
( ) H A
n
log m
.
Vi m nh phn (m = 2) ta c:
( )
n H A
4.2.3.2. Nguyn tc lp m tit kim
Theo nh l ta c:
( ) ( ) ( )
s s
i i i i
i 1 i 1
p a n p a logp a
= =



Bt ng thc trn s tha mn nu i ta c:

( ) ( ) ( )
i i i i
p a n p a logp a
hay
( )
i i
n logp a
Nguyn tc: Cc t m c di cng nh s c dng m ha cho cc tin c xc sut
xut hin cng ln v ngc li.
4.2.4. Thut ton Huffman
4.2.4.1. Thut ton m ha
Vi php m ha ti u ta c:
( )
n H A =
VO: Ngun ri rc
( )
i
i
a
A , i 1,s
p a

= =



RA: T m
i
n
i
tng ng vi tin
i
a
Bc 1: Khi ng mt danh sch cc cy nh phn mt nt cha cc trng lng
1 2 n
p , p , , p cho cc tin
1 2 n
a , , , a .
Bc 2: Thc hin cc bc sau n 1 ln:
Tm hai cy T' v T" trong danh sch vi cc nt gc c trng lng ti thiu p' v p".
Thay th hai cy ny bng cy nh phn vi nt gc c trng lng p' + p" v c cc cy
con l T' v T".
nh du cc mi tn ch n cc cy con 0 v 1.

p' + p"
T'
1
T"
0
Chng 4: C s l thuyt m ha


97




Bc 3: M s ca tin
i
a l dy cc bt c nh du trn ng t gc ca cy nh phn
cui cng ti nt
i
a .
V d 1: Xt cc k t A, B, C, D, E c cc xc sut xut hin tng ng l 0,2; 0,1; 0,1;
0,15; 0,45

Bc 1:

Bc 2: Ln 1:




Ln 2:






Ln 3:








0,2
1 0
0,1
B
0,1
C
0,15
D
0,2
A
0,45
E
0,1
B
0,1
C
0,2
1 0
0,15
D
0,2
A
0,45
E
0,35
1
0
0,1
B
0,1
C
0,15
D
0,2
A
0,45
E
0,1
B
0,1
C
0,2
1 0
0,15
D
0,2
A
0,45
E
0,35
1
0
0,55
0
1
Chng 4: C s l thuyt m ha


98
Ln 4:








Bc 3:
K t A B C D E
M tng ng 01 0000 0001 001 1
i
n
2 4 4 3 1

nh gi hiu qu:
( )
s
i i
i 1
n n p a 2.0, 2 4.0,1 4.0,1 3.0,15 1.0, 45
2,1
=
= = + + + +
=

du

( ) ( )
( )
s
i
i
i 1
1 100 100
H A p a log 2.0,1log10 0,15log 0, 2log5 0, 45log
p a 15 45
0, 2.3,3226 0,15.2, 7375 0, 2.2,3224 0, 45.1,1522
0, 6645 0, 4106 0, 4645 0,5185
2, 058 bit
=
= = + + +
= + + +
= + + +
=

Ta thy
( )
n H A
Nhn xt: Php m ha trn l gn ti u.
4.2.4.2. Thut ton gii m
VO: Xu bt
RA: Xu tin (k t)
Bc 1: Khi ng con tr P ch n gc ca cy Huffman.
Bc 2: While (cha t ti kt thc thng bo) do:
a. t x l bt tip theo trong xu bt.
0,1
B
0,1
C
0,2
1 0
0,15
D
0,2
A
0,45
E
0,35
1
0
0,55
0
1
1
0
1
Chng 4: C s l thuyt m ha


99
b. If x = 0 then
t P: = con tr ch n cy con tri ca n
else
P: = con tr ch n cy con phi ca n
c. If (P ch n nt l) then
1. Hin th k t tng ng vi nt l.
2. t li P n li ch n gc ca cy Huffman
V d 2: Thng bo nhn c: 0 1 0 0 0 1 1 0 0 1 1 0 1
Qu trnh gii m:
G G G G G G
G 0 1 0 0 0 1 1 0 0 1 1 0 1
P
A C E D E A


RA: A C E D E A
4.3. CC CU TRC I S V M TUYN TNH
4.3.1. Mt s cu trc i s c bn
4.3.1.1. Nhm:
*
G,
Nhm G l mt tp hp cc phn t vi mt php ton trong 2 ngi tha mn cc tnh cht
sau:
- a, b G a b c G =
- Tn ti phn t n v e: a e = e a = a
- Tn ti phn t ngc
1
a

:
1 1
a a = a a = e


Nu a b = b a th nhm c gi l nhm giao hon.
V d 1: Tp cc s nguyn Z vi php ton cng (+) to nn mt nhm giao hon vi phn
t n v l 0.
Nu s cc phn t trong nhm G l hu hn th ta c nhm hu hn cp G .
Nu H G v H, to nn mt nhm th H c gi l nhm con ca G. Cp ca H l
c ca cp ca G.
4.3.1.2. Nhm xyclic
Xt nhm hu hn G, - . Nu G c th m t nh sau"
Chng 4: C s l thuyt m ha


100

{ }
i
G , i =
th G c gi l nhm xyclic sinh bi . c gi l phn t sinh (hay phn t nguyn
thy) ca nhm.
V d 2: Xt nhm nhn:
{ }
11
Z 1, 2, 3, 4, 5, 6, 7, 8, 9, 10

=
Ta c:
0 5
2 1 2 10 = =

1 6
2 7
3 8
4 9
2 2 2 9
2 4 2 7
2 8 2 3
2 5 2 6
= =
= =
= =
= =

Ta c th vit
{ }
i
11
Z 2 mod 11

= .
Phn t c gi l c cp k nu n l s nguyn dng nh nht tha mn
k
1modn .
v d trn ta c
( ) ( ) ( ) ( )
ord 2 ord 8 ord 7 ord 9 10 = = = =
4.3.1.3. Vnh: R, , + -
Vnh R l mt tp hp cc phn t vi hai php ton trong hai ngi (Php cng (+), php
nhn ( - )) tha mn cc tnh cht sau:
- R, + l mt nhm i vi php cng
- R, - l mt na nhm i vi php nhn. iu ny c ngha l khng nht thit mi
phn t u c phn t ngc ca php nhn.
- Tnh cht phn phi:
( )
a b c = a c bc + +
Vnh R c gi l vnh giao hon nu ta c a b = ba
4.3.1.4. Ideal:
Ideal I l mt tp con trong R c cc tnh cht sau:
- a, b I : a b I + , I, + l mt nhm i vi php *.
- c R : c.a I
Chng 4: C s l thuyt m ha


101
4.3.1.5. Trng F, , + -
Trng F l mt tp hp cc phn t vi hai php ton trong hai ngi tha mn:
- F, + l mt nhm cng
-
*
F , - l mt nhm i vi php nhn.
Trong :
{ }
*
F F \ 0 =
V d 3: Trng nh phn GF(2): Trng ny ch c hai phn t 0 v 1.
4.3.1.6. Khng gian tuyn tnh
n
V
Cc phn t trong khng gian tuyn tnh c gi l cc vct.
n
V v l cc vct n chiu. Mi vct n chiu c m t bng mt b n ta c sp
( )
0 1 n 1
, , ...,

v v v v vi
i
F v
Trong khng gian
n
V ta xc nh cc php ton sau:
- Cng vct:
( )
0 n 1
, ...,

= u u u ,
( )
0 n 1
, ...,

= v v v
( )
0 n 1
, ...,

= u+v y y vi
j j j
F y =u +v
- Tch v hng ca hai vct:
( )
u,v
( )
n 1
i i
i 0
F

=
=

u,v u v
Hai vct c gi l trc giao nu
( )
0 = u,v
- Nhn mt vct vi mt phn t v hng
Xt phn t v hng F

( )
1 n 1
. , ...,

u = u u
4.3.2. Cc dng tuyn tnh v m tuyn tnh
4.3.2.1. Dng tuyn tnh
nh ngha 1: Cc dng tuyn tnh ca k bin c lp
1 2 k
, , ..., x x x l cc biu thc c
dng:

( )
k
1 k i i
i 1
, ...,
=
=

f x x a x (4.7)
Chng 4: C s l thuyt m ha


102
Trong :
i
F a
Nhn xt: C s tng ng 1 1 gia cc dng tuyn tnh, cc vct v cc a thc trong
vnh a thc.
4.3.2.2. M tuyn tnh
nh ngha 2: M tuyn tnh di n l m m t m ca n c cc du m l cc dng
tuyn tnh
nh ngha 3: M h thng tuyn tnh (n,k) l m tuyn tnh di n trong ta c th ch
ra c v tr ca k du thng tin trong t m.
nh ngha 4: M tuyn tnh ngu nhin l m tuyn tnh c cc du m c chn ngu
nhin t cc dng tuyn tnh c th c.
Nhn xt:
- Shannon chng minh rng tn ti cc m t c gii hn Shannon (tha mn nh l
m ha th hai) trong cc m tuyn tnh ngu nhin.
- Kh tm cc m tt trn cc m tuyn tnh ngu nhin. Hn na vic m ha v gii m
cho cc m ny cng rt phc tp. Bi vy cc m ny ch c ngha v mt l thuyt.
V d 4: S cc dng tuyn tnh khc nhau ca 4 bin c lp l:
4
0
N 2 1 15 = =
S cc m h thng tuyn tnh
( )
7, 4 l
3
1 11
N C 165 = =
4.3.2.3. Ma trn sinh v ma trn kim tra ca m tuyn tnh
n gin cho vic m t m tuyn tnh ngi ta thng s dng ma trn sinh
k.n
G . Ma
trn ny cha k vct hng c lp tuyn tnh to nn khng gian m
( ) n,k
V


k
2 cc vt khc nhau l tt c cc t hp tuyn tnh c th c ca k vct hng ny.
Trong i s tuyn tnh ta bit rng vi mi G s tn ti ma trn
r n
H

tha mn:
T
G.H 0 = (4.8)
Trong : r n k =

T
H c gi l ma trn chuyn v ca H
H c gi l ma trn kim tra ca m tuyn tnh (n, k)
Ta thy rng H cha r vct hng trc giao vi cc vct hng ca G
Hin nhin l nu a l mt vct m
( )
( )
n,r
a V

th :
Chng 4: C s l thuyt m ha


103

T
a.H 0 = (4.9)
y H cng l mt ma trn sinh ca mt m tuyn tnh
( ) n,r
V

v G li chnh l ma trn
kim tra ca m ny. Ta thy rng khng gian tuyn tnh C sinh bi G l khng gian khng ca
khng gian tuyn tnh C

sinh bi H.
T (4.9) ta c th vit ra r phng trnh:

n
j ij
j 1
a h 0 , i 1, r
=
= =

(4.10)
Cc phng trnh ny cn c gi l cc tng kim tra. M C sinh bi m G v C

sinh
bi H c gi l cc m i ngu.
Nu C C

th C c gi l m t i ngu. Cc m t i ngu c r n k = v bi
vy c tc
k 1
R
n 2
= = .
V d 5: Xt m h thng tuyn tnh (7, 4) c cc du m c chn t cc dng tuyn tnh
nh sau:
T m a gm cc du m
i
a c chn nh sau:

0 0
1 1
2 2
3 3
a
a
a
a
=
=
=
=
x
x
x
x


4 0 1 2
5 1 2 3
a
a
= + +
= + +
x x x
x x x


6 0 1 3
a = + + x x x
Nh vy ma trn sinh G c dng:

1 0 0 0 0 0 1
0 1 0 0 1 1 1
G
0 0 1 0 1 1 0
0 0 0 1 0 1 1



=




Ma trn kim tra ca m (7, 4) ny l:
Chng 4: C s l thuyt m ha


104

1 1 1 0 1 0 0
H 0 1 1 1 0 1 0
1 1 0 1 0 0 1


=




H chnh l ma trn sinh ca m (7, 3) l m i ngu vi m (7, 4) sinh bi G
4.3.3. Cc bi ton ti u ca m tuyn tnh nh phn
Khi xy dng mt m tuyn tnh
( )
0
n, k, d ngi ta mong mun tm c cc m c
tha nh nhng li c kh nng khng ch sai ln. n gin ngi ta thng xy dng m da
trn cc bi ton ti u sau:
4.3.3.1. Bi ton 1
Vi k v
0
d xc nh, ta phi tm c m c di vi t m l nh nht.
Tng ng vi bi ton ny ta c gii hn Griesmer sau:

k 1
0
i
i 0
d
n
2

(4.11)
y


x ch s nguyn nh nht ln hn hoc bng x.
V d 6: Cho
0
k 4, d 3 = =
n 3 2 1 1 7 + + + =
Vy m phi c di ti tiu l 7. Hay ni mt cch khc m (7, 4, 3) l mt m ti u t
c gii hn Griesmer.
4.3.3.2. Bi ton 2
Vi n v k xc nh, ta phi tm c m c khong cch tiu
0
d l ln nht.
Tng ng vi bi ton ny ta c gii hn Plotkin sau:

k 1
0
k
n.2
d
2 1

(4.12)
V d 7: Cho k = 3, n = 7

2
0
3
7.2
d 4
2 1
=


Vy khong cch
0
d ln nht l 4. Ni mt cch khc m (7, 3, 4) l mt m ti u t
c gii hn Plotkin.
Chng 4: C s l thuyt m ha


105
4.3.3.3. Bi ton 3
Vi n v s sai kh sa t xc nh, ta phi tm c m c s du thng tin k l ln nht
(hay s du tha r n k = l nh nht)
Tng ng vi bi ton ny ta c gii hn Hamming sau:

t
n k i
n
i 0
2 C

(4.13)
V d 8: Cho n = 7 v t = 1

1
r i 0 1
7 7 7
i 0
2 C C C 8
=
= + =



2
r log 8 3 =
hay k 7 3 4 =
Nh vy m (7, 4, 3) l m ti u t c gii hn Hamming
M t c gii hn Hamming cn c gi l m hon thin.
4.4. VNH A THC V M XYCLIC
4.4.1. Vnh a thc
Ta xt tp hp cc a thc c bc khng ln hn n 1 sau:

( )
n 1
i
i
i 0

=
=

f x f x (4.14)

( )
deg n 1 f x
i
f l cc h s c ly gi tr trong mt trng F no .
Trn tp cc a thc ny ta xc nh 2 php ton trong l php cng a thc v php nhn
a thc nh sau:
4.4.1.1. Php cng a thc
Xt hai a thc sau:
( )
n 1
i
i
i 0
a X

=
=

a x ,
( )
n 1
i
i
i 0
b X

=
=

b x
Ta c:
( ) ( ) ( )
a X + b X c X =

( )
n 1
i
i
i 0
c X c

=
=

x
Chng 4: C s l thuyt m ha


106

i i i
+ c =a b
y php cng cc h s
i
a v
i
b c thc hin trn trng F
Nu ta coi mi a thc c bc nh hn hoc bng n 1 l mt vct trong khng gian
tuyn tnh n chiu
n
V th php cng a thc hon ton tng t nh php cng vct.
V d 1: Xt n = 7, F = GF(2)

( ) ( )
( ) ( )
( ) ( ) ( )
4
2
2 4
a X 1 x x a 1 1 0 0 1 0 0
b X x x b 0 1 1 0 0 0 0
a X b X 1 x x a b 1 0 1 0 1 0 0
= + + =
= + =
+ = + + + =

4.4.1.2. Php nhn a thc
tch ca hai a thc c bc n 1 vn l mt a thc c bc n 1 ta phi thc hin
php nhn 2 a thc theo moulo
n
X 1 + (tc l coi
n
X 1 = ).

( ) ( )
n 1 n 1
i i n
i i
i 0 i 0
a X .b X . b modX 1

= =

= +




a x x
V d 2:
( )
4
a X 1 X X = + + ,
( )
2
b X X X = +

( ) ( )
( )( )
( ) ( )
( )
( ) ( )
4 3 7
2 5 3 4 7 7
2 3 4 5
a X .b X 1 X X X X modX 1
a X .b X 1 X X X X X modX 1
a X .b X 1 X X X X X
= + + + +
= + + + + + +
= + + + + +

Ta thy rng tch ca hai a thc c thc hin trn c s tch ca hai n thc
i
x v
j
x .

( ) i j modn i j
.
+
= x x x (4.15)
Ch : Php nhn cc h s
i
a v
j
b l php nhn trn trng F
4.4.1.3. Php dch vng
Ta xt mt trng hp c bit ca php nhn l nhn mt a thc
( )
a X v mt n thc
i
x .

( ) ( )
n 1
i
i 0 1 2 n 1
i 0
a X a , , , ,

=
= =

a x a a a a
Xt tch sau:
Chng 4: C s l thuyt m ha


107

( ) ( ) ( )
n 1
i
i n 1 0 1 n 2
i 0
b X .a X . b , , , ,


=

= = =


x x a x a a a a
Ta thy biu din vct b c dch vng v pha phi mt cp so vi biu din vct a.
Tng t ta c:

( ) ( )
( )
n 1
j j i
i n j n j 1 n j 1
i 0
c X .a X . c , , ,

+
=

= = =


x x a x a a a
Xt thng sau:
( )
( )
( )
i
i
1 2 n 1 0
a X
d d , , , ,

= = =


a x
x a a a a
x x

Ta thy biu din ca vc t d dc dch vng v pha tri 1 cp so vi biu din ca vct
a.
Nhn xt:

( ) ( )
( )
n
n-1
a X a X
a X = =
x
x
x x


V d 3:
( ) ( )
( ) ( )
( )
( )
( )
( )
( )
( )
4
4 2 5
4
3 6
a X 1 x x a 1 1 0 0 1 0 0
b X x a X x 1 x x x x x b 0 1 1 0 0 1 0
1 x x
a X
d X 1 x x d 1 0 0 1 0 0 1
x x
= + + =
= = + + = + + =
+ +
= = = + + =
.
4.4.1.4. nh ngha vnh a thc
nh ngha 1: Tp cc a thc xc nh theo (3.11) vi hai php ton cng a thc v nhn
a thc theo modulo
n
X 1 + to nn vnh a thc. Trong trng hp cc h s ca cc a thc
nm trong
( )
GF 2 ta k hiu vnh ny l
[ ]
n
2
Z x X 1 + .
4.4.2. Ideal ca vnh a thc
nh ngha 2: Ideal I ca vnh a thc gm tp cc a thc
( )
a X l bi ca mt a thc
( )
g X tha mn:
-
( )
n
g X X 1 + (
( )
g X l c ca
n
X 1 + )
Chng 4: C s l thuyt m ha


108
-
( ) ( )
deg g X r mindeg a X = = vi
( ) ( )
a X I, a X 0
Ta k hiu Ideal trong vnh a thc l ( )
I g X =
Hin nhin l vi
( )
r
i
i
i 0
g X
=
=

g x ta c

0 r
1 = = g g ,
{ }
i
0,1 g vi i 1, r 1 =
c th tm c tt c cc Ideal trong vnh ta phi thc hin phn tch nh thc
n
X 1 +
thnh tch ca cc a thc bt kh quy.
nh ngha 3: a thc
( )
a X c gi l bt kh quy nu n ch chia ht cho 1 v cho
chnh n.
Nh vy a thc bt kh quy l a thc khng th phn tch thnh tch cc a thc c bc
nh hn.
nh l 4: Vi
m
n 2 1 = , a thc
n
X 1 + c phn tch thnh tch ca tt c cc a
thc bt kh quy c bc m v c ca m.
V d 4:
- m = 2, n = 3: ch c duy nht mt a thc bt kh quy bc 2 l
2
x x 1 + + v mt a thc
bt kh quy bc 1 l
( )
1 x + . Nh vy:

( )
( )
3 2
X 1 1 x 1 x x + = + + +
- m = 3, n = 7: Trong s 8 a thc bc 3 ch c 2 a thc sau l cc a thc bt kh quy,
l
3
x x 1 + + v
3 2
x x 1 + + . Nh vy:
( )
( )( )
7 3 2 3
X 1 1 x 1 x x 1 x x + = + + + + +
- m = 4, n = 15: Trong s 16 a thc bc 4 ch c 3 a thc sau l cc a thc bt kh quy:
4
x x 1 + + ,
4 3
x x 1 + + v
4 3 2
x x x x 1 + + + + . Nh vy:
( )
( )( )( )( )
15 2 4 3 4 2 3 4
X 1 1 x 1 x x 1 x x 1 x x 1 x x x x + = + + + + + + + + + + +
Gi s cc a thc bt kh quy trong phn tch ca
n
X 1 + l I, khi s cc Ideal trong
vnh c xc nh theo biu thc sau:
I
I 2 1 =
nh ngha 5: a thc
( )
g* X c gi l a thc i ngu ca a thc
( )
g X nu:
( )
( )
( )
degg X 1
g* X X .g X

=
Chng 4: C s l thuyt m ha


109
V d 5: Cho ( )
( )
3
g X 1 X X = + + .
Khi a thc i ngu
( )
g* X ca n l:

( )
3 3 2
3
1 1
g* X X . 1 X X 1
X
X

= + + = + +



Nu
( ) ( )
g* X g X = th
( )
g X c gi l a thc t i ngu.
Nhn xt:
- Nu
( )
a X l bt kh quy th n phi cha mt s l cc n thc.
- Nu
( )
a X l bt kh quy th
( )
a * X cng l mt a thc bt kh quy.
4.4.3. nh ngha m xyclic
nh ngha 6: M xyclic (n, k) l Ideal ( )
I g X = ca vnh a thc
[ ]
n
2
Z x X 1 + .
V Ideal ( ) g X cha tt c cc bi ca
( )
g X nn nu ( ) ( ) a X g X th
( ) ( )
a X g X . v hin nhin l ( ) ( ) ( ) ( ) x.a X g X x.a X g X . .
Ta c th a ra mt nh ngha trc quan hn cho m xyclic.
nh ngha 7: M xyclic l mt b m tuyn tnh c tnh cht sau: Nu
( )
a X l mt t
m th dch vng ca
( )
a X cng l mt t m thuc b m ny.
Ch :
( )
g X c gi l a thc sinh ca m xyclic
V d 7: Tp tt c cc m xyclic trn vnh
[ ]
7
2
Z x X 1 + . Vnh ny c tt c 7 ideal
tng ng vi 7 b m xyclic.
o
N
( )
g X
M (n, k) 0
d
1 1 (7, 7) 1
2 1 + X (7, 6) 2
3
3
1 X X + +
(7, 4) 3
3
2 3
1 X X + +
(7, 4) 3
4
2 4
1 X X X + + +
(7, 3) 4
4
2 3 4
1 X X X + + +
(7, 3) 4
Chng 4: C s l thuyt m ha


110
7
6
i
i 0 =

x (7, 1) 7
4.4.4. Ma trn sinh ca m xyclic
V m xyclic (n, k) l mt m tuyn tnh nn ta c th m t n thng qua ma trn sinh G
nn cha k vct hng c lp tuyn tnh. Ta c th thit lp G nh sau:

( )
( )
( )
k 1
g X
x.g X
G
x .g X

(4.1.6)
V d 8: M xyclic (7, 4) c a thc sinh
( )
3
g X 1 X X = + + . Ma trn sinh ca m ny
c th m t nh sau:

3
2 4
2 3 5
3 4 6
1 X X
1 1 0 1 0 0 0
X X X 0 1 1 0 1 0 0
G
0 0 1 1 0 1 0
X X X
0 0 0 1 1 0 1
X X X

+ +



+ +

= =


+ +




+ +


4.4.5. Ma trn kim tra ca m xyclic
V
( )
n
g X X 1 + nn ta c th vit
( ) ( )
n
x 1 g X .h X + =
Hay
( )
( )
n
x 1
h X
g X
+
=
( )
h X c gi l a thc kim tra.
V
( ) ( )
n
g X .h X 0modX 1 + nn cc a thc
( )
h X v
( )
g X c gi l cc a
thc trc giao.
Ta c: ( )
k
j
j
j 0
h X
=
=

h x vi
0 k
1 = = h h , { }
j
0,1 h vi j 2, k 1 =
Do s khc bit gia tch v hng ca 2 vct v tch ca hai a thc tng ng nn ta c
th xy dng ma trn kim tra ca m xyclic sinh bi
( )
g X nh sau:
Chng 4: C s l thuyt m ha


111
( )
( )
( )
*
*
r 1 *
h X
x.h X
H
x .h X




=




.
(4.17)
V d 9: Xy dng ma trn kim tra cho m xyclic (7, 4) c
( )
3
g X 1 X X = + +
Ta c: ( ) ( )
( )
7
2 3 4 2
3
X 1
h X 1 x 1 X X X X X 1
X X 1
+
= = + + + = + + +
+ +


( )
* 2 3 4
h X 1 X X X = + + +
Ma trn kim tra:

2 3 4
3 4 5
2 4 5 6
1 X X X
1 0 1 1 1 0 0
H X X X X 0 1 0 1 1 1 0
0 0 1 0 1 1 1
X X X X

+ + +



= + + + =




+ + +


Ta d dng kim tra:
T
G.H 0 =
Vi
( )
a X l mt t m ta c:
( )
T
a X .H 0 =


4.5. M HA CHO CC M XYCLIC
4.5.1. M t t m ca m xyclic h thng
nh ngha: M xyclic (n, k) c gi l mt m xyclic h thng nu ta c th ch r v tr
ca cc du thng tin v cc du kim tra trong t m.
Thng thng cc du thng tin c sp xp k v tr bc cao (t bc r ti bc n 1 ) Cc
v tr bc thp cn li l cc du kim tra (t bc 0 ti bc r 1 )
0
f
1
f

r 1
f
r
f
r 1 +
f

n 1
f

r du kim tra

k du thng tin

( ) ( ) ( )
n 1
i n k
i
i 0
X x .a X r X

=
= = +

f f x
Ta c:
( ) ( ) ( ) ( ) ( )
X g X X q X .g X = . f f (1.18)
Chng 4: C s l thuyt m ha


112

( )
( )
( )
( )
( )
( )
n k
X x .a X r X
g X g X g X

= +
f


( )
( )
( )
( )
( )
( )
( )
X r ' X r X
q X
g X g X g X
= + +
f
(1.19)
T (1.1) v (1.2) ta thy:
( ) ( )
r ' X r X 0 + =
4.5.2. Thut ton m ha h thng
T (1.19) ta c th m t thut ton xy dng t m xyclic theo cc bc sau:
VO: Tin ri rc
i
a A
RA: T m
( )
i
x f tng ng vi
i
a .
Bc 1: M t tin
i
a trong tp tin cn m ha (gm
k
2 tin) bng mt a thc
( )
i
a X vi
( )
i
deg a X k 1 .
Bc 2: Nng bc
( )
i
a X bng cch nhn n vi
n k
x

.
Bc 3: Chia
( )
n k
i
a X .x

cho a thc sinh g(X) tm phn d
( )
i
r X .
Bc 4: Xy dng t m xyclic:
( ) ( ) ( )
n k
i i i
x a X .x r X

= + f (1.20)
4.5.3. Thit b m ha
Phn trung tm ca thit b m ha l mt thit b chia cho g(X) tnh d. Thc cht y
l mt otomat nh dng ca g(X).
Gi s:
( )
r 1
i
i
i 0
g X

=
=

g x (1.21)
Khi thit b m ha cho m (n, k) vi a thc sinh dng (1.21) c m t nh sau (Hnh
4. 1):
i
0
g
1

H mch
Ngn mch







1 n

1
V
( )
n k
i
a X .x


VO
r 1
g


3
g

2
g

1 2
1
g
+ +
3
+ +
r
+
k 1 n +

2
V

RA
H
1 k

Hnh 4.1: Thit b m ha cho m xyclic (n, k) c a thc sinh g(X)
Chng 4: C s l thuyt m ha


113


Hot ng ca thit b m ha:
- k nhp u: chia v tnh phn d: Mch v
1
V m,
2
V ng, thit b hot ng nh mt
b chia tnh d. Kt thc nhp th k ton b phn d nm trong r nh t 1 n r. Trong qu
trnh ny, cc du thng tin ( )
( )
n k
i
a X .x

c a ra qua mch hoc H.
- r nhp sau: a ra cc du kim tra (phn d) ti u ra. Mch V
1
V ng, thit b hot
ng nh mt thanh ghi dch ni tip. Mch V
2
V m, cc du kim tra c ln lt a ra t
bc cao ti bc thp. Kt thc nhp th n, ton b t m c a ra u ra.
V d 1: Thit b m ha cho m xyclic (7, 4) c
( )
3
g X 1 X X = + +







Gi s a thc thng tin cn m:
( )
3
a X X X = +
Qu trnh hot ng ca thit b c m t trn bng sau:

Trng thi cc nh Xung
nhp
Vo
1 2 1
Ra
1 1 1 1 0 1
2 0 0 1 1 0
3 1 0 0 1 1
4 0 1 1 0 0
5 0 0 1 1 0
6 0 0 0 1 1
7 0 0 0 0 1
Bng 1: Qu trnh hot ng ca b m ha.
Kim tra li: ( )
( )
n k 3 3 6 4
a X .x x x .x x x

= + = +
1 7
1
V
( )
n k
i
a X .x

1 2
+
3
+
5 7
2
V

H
1 4
1 0 1 0 . 0 0 0
Chng 4: C s l thuyt m ha


114

( )
6 4 3
6 4 3 3
3
3
x x x x 1
x x x x 1
x
x x 1
r X x 1
+ + +

+ + +

+ +
= + D

T m c thit lp
( )
6 0
X . . . . . X
6 4
X x x x 1 1 0 1 0 0 1 1 = + + + f
4.5.4. To cc du kim tra ca m xyclic
Gi s
( )
X V f - m xyclic (n, k) c a thc sinh g(X).
Khi
( ) ( )
X g X . f hay
( ) ( ) ( )
X g X .q X = f (*)
Trong :
( )
deg X n 1 f

( )
deg g X r n k = =

( )
deg q X n 1 r k 1 =
Vi
( )
n 1
i
i
i 0
X

=
=

f f x
Gi
( )
( )
n
x 1
h X
g X
+
= ta c
( )
deg h X k =
Nhn hai v ca (*) vi h(X) ta c:
( ) ( ) ( ) ( ) ( )
X .h X g X .q X .h x = f
V
( ) ( )
n
g X .h x x 1 = + nn
( ) ( ) ( ) ( )
n
X .h X g X .x q X = + f (**)
V
( )
deg g X k 1 nn trong (**) khng cha cc thnh phn bc cao ca x c m
k, k 1, , n 1 + .
Do cc h s tng ng ca cc thnh phn ny trong (**) phi bng 0. Tc l trong
biu thc:

( ) ( )
n 1 k
i j
i j
i 0 j 0
X .h X .

= =


=






f f x h x
Chng 4: C s l thuyt m ha


115
ta phi c cc s hng c dng:
i+j
i j
0 = f h x vi i j + tha mn: k i j n 1 + hay
k j i n 1 j .
Khi j chy t 0 n k th: n r j i n 1 j .
Nh vy ta c:

k
j n j i
j 0
0

=
=

h f , 1 i n k
( )
*
**

Hin nhin l ta lun c:
0 k
h h 1 = = .
T
( )
*
**
:
k 1
n k i j n j i
j 0


=
=

f h f , 1 i n k
( )
**
**

( )
**
**
l phng trnh to cc du kim tra. Ta c th dng n to cc du kim tra trong
cc chng trnh m ha v gii m.
V d 2: Cho m xyclic (7, 4) c
( )
3
g X 1 X X = + +
Ta c: ( )
7
4 2
3
x 1
h X x x x 1
x x 1
+
= = + + +
+ +
.
Vy
0 1 2 4
h h h h 1 = = = = ,
3
h 0 = .
T
( )
**
**
ta thy cc du kim tra ca m ny c to t phng trnh sau:

3 i 7 i 6 i 5 i
= + + f f f f , 1 i 3 .
V d 3:
( )
3
a X x 1 = +
Ta c:
6 3 5 4
1 , 0 = = + = f f f f
Khi :
2 6 5 4
1 = + + = f f f f

1 5 4 3
1 = + + = f f f f

0 4 3 2
0 = + + = f f f f
Thit b m ha xy dng theo phng trnh trn c dng:




1 7
1 4
+
5 7
RA
3
f
4
f
5
f
6
f
+
VO
Chng 4: C s l thuyt m ha


116


Trng thi cc nh
Xung
nhp
VO
3
f
4
f
5
f
6
f
RA
1 1 1 0 0 0 1
2 0 0 1 0 0 0
3 0 0 0 1 0 0
4 1 1 0 0 1 1
5 0 1 1 0 0 1
6 0 1 1 1 0 1
7 0 0 1 1 1 0
4.5.5. Thut ton thit lp t m h thng theo phng php nhn
VO: - M xyclic (n, k), g(X)
- Tin
i
a A
RA: T m h thng ca m (n, k) xyclic
Bc 1: M ha tin
i
a bng a thc thng tin
( )
a X vi
( )
deg a X k 1 ,
( )
k 1
j
j
j 0
a X a

=
=

x
Bc 2: - Nng bc:
( )
n-k
a X .x
( )
k 1 n 1
n-k j+r i
j r i r
j 0 i r
a X a

+ +
= =
= =

.x x f x
- Tnh
( )
h x .
Bc 3: for i = 1 to n k do

k 1
n k i j n j i
j 0


=
=

f h f
Bc 4: Thit lp t m h thng.

( ) ( )
n 1
i
0 1 n 1 i
i r
, , , X

=
=

f f f f f x
Chng 4: C s l thuyt m ha


117
4.6. GII M NGNG
4.6.1. Hai th tc gii m
Mi phng php gii m u c th tin hnh theo mt trong hai th tc gii m sau:
- Phng php (th tc) 1: Dn ra bn tin t dy du nhn c.




- Th tc 2: Dn ra vct sai t dy du nhn c.






4.6.2. Gii m theo Syndrom
Gi s v V - m xyclic (n, k) c a thc sinh g(X).
Ma trn sinh ca
( )
V n, k

c dng:
( )
( )
( )
k 1
g X
x.g X
G
x .g X


Gi ( )
( )
n
x H
h X
g X
= ; Ta c
( )
deg g X r = ,
( )
deg h X k = .
Gi
( )
*
h X l a thc i ngu ca
( )
h X . Theo nh ngha:

( )
( )
( )
deg h X * 1
h X x .h x

=
Khi ma trn kim tra ca m
( )
V n, k

c dng:
Knh
Gii m
x
e
y
y = x + e
x
Knh
Gii m
x
e
y
x
e
+
Chng 4: C s l thuyt m ha


118
( )
( )
( )
*
*
r 1 *
h x
x.h x
H
x .h x


Ta c
T
G.H 0 =
Vi v bt k, v V ta c
T
v.H 0 =
Xt m hnh knh truyn tin sau:



u v e = +
Ta c
( ) ( ) ( )
T T T
S u u.H v r H e.H S e = = + = =
( )
S e l mt vct r chiu c trng cho vct sai e n chiu.
Ta gi
( )
S u l Syndrom ca vct nhn c u.
Qu trnh gii m da trn vic phn tch trng thi ca
( )
S u c gi l gii m theo
syndrom (hi chng).
Hin nhin l khi khng c sai
( )
e 0 ta c:
( ) ( )
S u S e 0 = =
Khi c sai:
( ) ( )
S u S e 0 =
Cn c vo trng thi (gi tr) c th ca
( )
S e m ta c th a ra mt phn on nht
nh v e.
Mi mt thnh phn ca
( )
S u s cho ta mt mi quan h no gia cc du m v n
c gi l mt tng kim tra.
4.6.3. H tng kim tra trc giao v c kh nng trc giao
Tp r tng kim tra trong
( )
S u to nn h tng kim tra. Mi tng kim tra trong h s
cha mt thng tin nht nh v du cn gii m
i
u , thng tin c th nhiu, t hoc bng
khng. Ngoi ra mi tng kim tra ny cn cha thng tin v cc du m
j
u khc.
d gii cho
i
u hin nhin rng ta cn xy dng mt h tng kim tra cha nhiu thng
tin nht v
i
u . Trn c s ta a ra khi nim h tng kim tra trc giao sau:
Knh
x
e
( )
0 1 n 1
u u , u , , u

=
Chng 4: C s l thuyt m ha


119
nh ngha: H J tng kim tra c gi l trc giao vi
i
u nu:
- Mi tng kim tra trong h u cha
i
u .
- Du m ( )
j
u j i ch nm ti a trong mt tng kim tra
Nhn xt:
- H tng kim tra trc giao cha nhiu thng tin v
i
u v cha t thng tin v cc du m
khc.
- Sai mt du m
j
u ch lm nh hng ti nhiu nht l mt tng kim tra trong h.
- Sai
i
u s lm thay i tt c cc gi tr ca cc tng kim tra trong h.
- Ta c th sa c sai cho du
i
u da trn thng tin v gi tr ca cc tng kim tra bng
phng php b phiu (gii m ngng theo a s). Khi khong cch m Hamming t c
theo phng php ny s tha mn iu kin:
0
d J 1 = +
iu kin trc giao trn l mt iu kin kh cht ch, bi vy J r < (s tng kim tra c
lp tuyn tnh) v khng phi vi bt c m no ta cng c th xy dng c h J tng kim tra
trc giao tha mn iu kin
0
J d 1 = .
m rng hn ta s a ra khi nim h tng kim tra c kh nng trc giao.
nh ngha: H tng kim tra c gi l c kh nng trc giao nu n l h tng kim tra
trc giao vi mt t hp tuyn tnh no cc du m.
Xt t hp tuyn tnh cc du m sau:
1 2 m
i i i
U U U = + + + . Khi h tng kim
tra c kh nng trc giao s gm cc tng kim tra tha mn iu kin:
- nm trong tt c cc tng kim tra trong h.
-
j
U (
k
j i vi
k
i
U ) ch nm trong nhiu nht l mt tng kim tra trong h.
Nhn xt:
- Da trn h tng kim tra c kh nng trc giao ta c th gii m c cho gi tr ca
bng phng php ngng.
- gii m cho mt du m
k
i
U c th ta phi s dng nhiu bc (nhiu cp
ngng)
4.6.4. Gii m ngng da trn h tng kim tra trc giao
V d 1: Xt m (7, 3) c
( )
2 4
g 1 x x x = + + +
Chng 4: C s l thuyt m ha


120
( )
( )
7
3
x 1
h X x x 1
g X
+
= = + +

( )
* 2 3
h X 1 x x = + +

1 0 1 1 0 0 0
0 1 0 1 1 0 0
H
0 0 1 0 1 1 0
0 0 0 1 0 1 1



=





[ ]
T
i
v.H S =
Ta c h tng kim tra trc giao vi du m
3
v

0 0 2 3
S v v v = + +
1 1 4 3
S v v v = + +
2 5 6 3
S v v v = + +
H tng kim tra vi du m
6
v (suy ra bng cch dch vng h tng kim tra trn)

0 6 3 5
1 6 0 4
2 6 1 2
S v v v
S v v v
S v v v
= + +
= + +
= + +

S thit b gii m theo th tc 2:










S thit b ngng M = 2

0 1 1 2 2 3
E S S S S S S = + +

E
+
0
v
1
v
2
v
3
v
4
v
5
v
6
v
+
+
+
+ +
M=2
0
S

1
S

2
S

+
Chng 4: C s l thuyt m ha


121








Qu trnh gii m dc thc hin trong 2n = 14 nhp. 7 nhp u a t m nhn c
vo cc nh. Qu trnh gii m c thc hin trong 7 nhp sau.
Gii m t m nhn c c dng 0 0 1 1 1 1 1
Hay
( )
6 5 4 3 2
v X x x x x x = + + + +

Trng thi cc nh
Nhp
0
v
1
v
2
v
3
v
4
v
5
v
6
v
0
S
1
S
2
S
E
4
R
0 0 0 1 1 1 1 1
1 1 0 0 1 1 1 1 1 0 0 0 1
2 1 1 0 0 1 1 1 1 1 1 1 0
3 1 1 1 0 0 1 1 0 1 0 0 1
4 1 1 1 1 0 0 1 0 0 1 0 1
5 1 1 1 1 1 0 0 0 0 1 0 1
6 0 1 1 1 1 1 0 1 0 0 0 0
7 0 0 1 1 1 1 1 0 1 0 0 0

T m gii m: 0 0 1 1 1 0 1
Hay
( )
6 4 3 2
v X x x x x

= + + +
Sai v tr
5
x c sa.
Kim tra li:
E
2
S

1
S

0
S

Chng 4: C s l thuyt m ha


122

6 4 3 2 4 2
6 4 3 2 2
x x x x x x x 1
x x x x x
0
+ + + + + +

+ + +

4.6.5. Gii m ngng da trn h tng kim tra c kh nng trc giao
V d: Xt m (7, 4) c
( )
3
g X 1 x x = + +

( )
( )
7
4 2
x 1
h X x x x 1
g X
+
= = + + +

( )
* 2 3 4
h X 1 x x x = + + +

1 0 1 1 1 0 0
H 0 1 0 1 1 1 0
0 0 1 0 1 1 1


=




Ta c:
[ ]
T
i
v.H S =
H tng kim tra c kh nng trc giao vi cp du m
4 5
v v + :
1 5 4 3 1
2 5 4 2 6
S v v v v
S v v v v
= + + +
= + + +

Dch vng h tng kim tra ny i hai cp ta c c h tng kim tra c kh nng trc giao
vi cp du m:
6 0
v v + :
'
1 0 6 5 3
'
2 0 6 4 1
S v v v v
S v v v v
= + + +
= + + +

nhp gii m u tin sau cp ngng th nht ta c c gi tr ng ca
( )
0 6
v v + .
Ti nhp gii m th hai ta c c gi tr ng ca
( )
6 5
v v + .
Cn c vo cc gi tr ny ta c th gii ra c gi tr ng ca
6
v sau cp ngng th
hai.
S chc nng thit b gii m theo th tc 2.




RA
+
0
v
1
v
2
v
3
v
4
v
5
v
6
v
+
+ +
'
1
S

'
2
S

1
Y
+
+
+
'
1
Y
2
Y

Chng 4: C s l thuyt m ha


123



CY: Thit b ngng c hai cp ngng ch l mt mch V c hai u vo.
Gi s t m nhn c c dng 0 0 0 1 1 1 1
Hay
( )
6 5 4 3
v X x x x x = + + +
Qu trnh gii m c thc hin trong 2n 1 15 + = nhp. n = 7 nhp u, t m nhn c
c a vo cc nh. 8 nhp sau l qu trnh gii m.

Trng thi cc nh
Nhp
0
v
1
v
2
v
3
v
4
v
5
v
6
v
'
1
S
'
2
S
1
Y
'
1
Y
2
Y RA
1 1 0 0 0 1 1 1 1 0 0 0 0
2 1 1 0 0 0 1 1 1 1 1 0 0 1
3 1 1 1 0 0 0 1 1 1 1 1 1 0
4 1 1 1 1 0 0 0 0 1 0 1 0 1
5 0 1 1 1 1 0 0 0 0 0 0 0 1
6 0 0 1 1 1 1 0 1 0 0 0 0 0
7 0 0 0 1 1 1 1 0 1 0 0 0 0
8 1 0 0 0 1 1 1 1 0 0 0 0 0
Sai v tr
5
x c sa.
T m gii m: 0 0 0 1 1 0 1
Hay
( )
6 4 3
v x x x x

= + +
Kim tra li:
6 4 3 3
6 4 3 3
x x x x x 1
x x x x
0
+ + + +

+ +

4.7. GII M THEO THUT TON MEGGIT
Gi s
( )
f x l mt t m ca mt b m xyclic
( )
V n, k

c a thc sinh g(x). Khi


( ) ( )
f x g X . .
Knh
( )
f x
( )
e x
( ) ( ) ( )
v x f x e x = +
Chng 4: C s l thuyt m ha


124



Gi s
( )
v x l t m a ti u vo b gii m, khi :

( )
( )
( )
( )
( )
( )
v x f x e x
g x g x g x
= + (4.22)
Bng cch phn tch phn d ca php chia trn ta c th tm c a thc sai
( )
e x .
S phn tch d l mt s logic tng hp, y l mt thnh phn chc nng quan
trng trong s gii m theo thut ton Meggit sau:







V d: Xt m xyclic (7, 4) c
( )
3
g x x x 1 = + + . Gi s du sai l du u tin c bc
cao nht ca t m, khi ta c
( )
6
e x x = . Phn d tng ng ca (4.22):

( )
6 3
4 3 3
3 2
2
x x x 1
x x x x 1
x x x
r x x 1
+ +
+ + +
+ +
= + Phn d

Khi nhn thy phn d c dng
( )
2
r x x 1 = + th s phn tch phn d cho ra tn hiu
sa sai (Tn hiu 1) a ti b cng mod 2 sa sai cho du m tng ng.
Nh vy ch khi phn s c dng 1 0 1 th thit b logic t hp mi to ra tn hiu "1" sa
sai
S b gii m c dng:



+

vo
Thit b nh t m n du
Thit b chia cho g(x) v tnh d
S phn tch phn d
RA
0
v
1
v
2
v
3
v
4
v
5
v
6
v
+
1
+
+
VO
1 7
2 3
1 14
V
Chng 4: C s l thuyt m ha


125





Sau 2n = 14 nhp, b gii m hon thnh qu trnh gii m (7 nhp u chia v tnh d ng
thi a t m vo b ghi dch m, 7 nhp sau gii m).
V d t m nhn c c dng:

( )
3 2
v x x x x 0 1 1 1 0 0 0 = + +
Hot ng ca b gii m c m t theo bng sau:

Trng thi cc nh
Nhp VO
0
v
1
v
2
v
3
v
4
v
5
v
6
v 1 2 3
V RA
1 0 0 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0 0 0
4 1 1 0 0 0 0 0 0 1 0 0
5 1 1 1 0 0 0 0 0 1 1 0
6 1 1 1 1 0 0 0 0 1 1 1
7 0 0 1 1 1 0 0 0 1 0 1
8 0 0 0 1 1 1 0 0 1 0 0 1 1
9 0 0 0 0 1 1 1 0 0 1 0 0 0
10 0 0 0 0 0 1 1 1 0 0 1 0 0
11 0 0 0 0 0 0 1 1 1 1 0 0 1
12 0 0 0 0 0 0 0 1 0 1 1 0 1
13 0 0 0 0 0 0 0 0 1 1 1 0 1
14 0 0 0 0 0 0 0 0 1 0 1 0 0

T m sa:
( ) ( ) ( )
6 3 2
v x v X e X x x x x

= + = + + +
Du sai l
6
x c sa
Chng 4: C s l thuyt m ha


126
4.8. GII M XYCLIC THEO THUT TON CHIA DCH VNG
4.8.1. Nhim v ca thut ton gii m
Ta bit rng vi m xyclic (n, k) khi chia t m nhn c f(x) cho a thc sinh g(x) s c
hai trng hp sau xy ra:
0 Nu t m nhn ng (khng c sai trn knh truyn:
( )
e x 0 = ) th php chia ny khng
c d.
- Nu t m nhn sai ( ) ( )
e x 0 th php chia ny c d.
Cu trc ca phn d s phn nh cu trc ca vct sai
( )
e x . V vy vic phn tch cu
trc ca phn d chnh l nhim v ca cc thut ton gii m.




Ta c:
( ) ( )
a x g X . .

( )
( )
( )
( )
( )
( )
f x a x e x
g x g x g x
= + (4.23)
Nh vy phn d ca php chia f(x) cho g(x) chnh l phn d ca php chia vct sai e(x)
cho g(x).
Ch : Phn d ca php chia e(x) cho g(x) l mt a thc c bc r 1 . Nh vy phn
d ny c
r
2 trng thi khc nhau. Trong khi s cc kiu sai khc nhau li l
n r
2 2 > .
S cc kiu sai c trng s t l:

0 1 2 t
n n n n
C C C C + + + +
Nh vy iu kin cn sa dc t sai l:

t
i n k
n
i 0
C 2

=

(4.23)
y chnh l gii hn Hamming
Knh
( )
a x
( )
e x
( ) ( ) ( )
f x a x e x = +
Chng 4: C s l thuyt m ha


127
4.8.2. Gii m theo thut ton chia dch vng
4.8.2.1. Nhn xt
T (1.1) ta thy rng nu k du thng tin trong t m u nhn ng th v tr sai cc con
"1" trong phn d chnh l v tr tng ng ca cc du kim tra b sai. gii m ta ch cn cng
(theo mod 2) t m nhn c vi phn d sau php chia l thu c t m pht.
4.8.2.2. Thut ton chia dch vng (by li)
VO: - T m nhn c f(x)
- M
( )
V n, k

c g(x), c
0
d .
RA: - T m nh gi
( )
f X


Bc 1: For i : 0 = to
( )
n 1 do.
(1) Chia
( )
i
f x .x
( )
i
f x
x



hoc cho g(x) tm phn d
( )
i
r x .
(2) Tnh ( ) ( )
i
w r x .
- Nu
( ) ( )
0
i
d 1
w r x t
2


=


chuyn sang bc 2.
- Nu ( ) ( )
i
w r x t i : i 1 > = + . Nu i 1 n + = chuyn sang bc 3.
Bc 2: T m nh gi:

( )
( ) ( )
i
i
i
f x .x r x
f X
x

+
=

( )
( )
( )
i
i
i
f x
f X x r x
x



= +




Hoc
Bc 3: - Thng bo khng sa c sai (S sai vt qu kh nng sa sai ca b m)
4.8.3. V d
Gi s t m nhn c ca m xyclic (7, 3, 4) vi a thc sinh

( )
( )
2 4
2 3 5 6
g x 1 x x x
v x x x x x x 0111011
= + + +
= + + + +

Ta s dng thut ton chia dch vng tm li t m pht theo cc bc sau:
Chng 4: C s l thuyt m ha


128
Bc 1:
(1) i = 0 (+) Chia v(x) cho g(x) tm phn d
( )
0
r x .

( )
6 5 3 2
4 2
6 4 3 2
2
5 4
5 3 2
4 3 2
4 2
3
0
x x x x x
x x x 1
x x x x
x x 1
x x x
x x x x
x x x
x x x 1
r x x x 1
+ + + +
+ + +
+ + +
+ +
+ +
+ + +
+ +
+ + +
= + +

(+)
( ) ( )
0
4 1
w r x 3 1
2


= > =



(2) i = 1 (+) Chia
( )
x.v x cho
( )
g x tm phn d
( )
1
r x .

( )
6 4 3 2
4 2
6 4 3 2
2
1
x x x x 1
x x x 1
x x x x
x
r x 1
+ + + +
+ + +
+ + +
=

(+) ( ) ( )
1
w r x 1 t = =
Bc 2: Tm t m nh gi.

( )
( ) ( )
5 3 2 1
x.v x r x
f X x x x x
x

+
= = + + +
Vy sai v tr c sa
4.9. GII M LI.
4.9.1. Trng thi v gin li
T bng trng thi ca s m ha mc 4.5.3 ta c mt s nhn xt sau:
- Qu trnh m ha lun bt u t trng thi ton 0 v kt thc cng trng thi ton 0.
- Trong k nhp u (k = 4) cc bt ra ging nh cc bt vo.
- Sau nhp th k, cc bt kim tra nm trong thanh ghi c y dn ra u ra.
Chng 4: C s l thuyt m ha


129
- S cc trng thi bng
n k
2

(trong v d ny
7 4
2 8

= trng thi) tng theo hm m


khi n k tng.
S dng thanh ghi m t trong mc 4.5.3 ta c th tm c tt c cc trng thi k tip khi
thanh ghi nm mt trng thi xc nh.
Hnh sau ch ra tt c cc dch chuyn trng thi c th mt trng thi bt k ca b m
ha cho m (7, 4, 3).




























Trng thi hin thi Trng thi k tip
Trng thi 0
000

Trng thi 0
000
Trng thi 1
001

Trng thi 1
001
Trng thi 2
010

Trng thi 2
010
Trng thi 3
011

Trng thi 3
011
Trng thi 4
100

Trng thi 4
100
Trng thi 5
101

Trng thi 5
101
Trng thi 6
110

Trng thi 6
110
Trng thi 7
111

Trng thi 7
111
Bt d liu 0:
Bt d liu 1:
Hnh 4.2: Biu chuyn trng thi cho m (7, 4, 3) c 8 trng thi
Chng 4: C s l thuyt m ha


130




Bng cch s dng biu trng thi trn ta c th m ha cc bt d liu 1011 m khng
dng thanh ghi dch trong mc 4.5.2. Bt d liu u tin l logic 1, bi vy trng thi s chuyn
t 000 n 110 (minh ha bng ng lin nt t trng thi 000). u ra b m ha lc ny cng
l 1 ging nh u vo. thi im k tip trng thi hin ti l 110 v bt d liu l logic 0, bi
vy trng thi s chuyn t 110 sang 011
Nh vy qua 4 nhp ta thy qu trnh chuyn trng thi l:
000 110 011 001 110
Sau nhp th 4, cc thay i trng thi s tun theo vic dch cc bt kim tra t thanh ghi (
y l 110).
Ta cng c th s dng mt cch m t khc cho qu trnh m ha bng gin li (hnh
4.4)

















Gin ny c to nn bng cch ni cc trng thi k tip ca gin chuyn trng thi
hnh 4.2 bt u t trng thi ton 0.
000
110
011 101
100
010
001 111
Bt d liu 0:
Bt d liu 1:

Hnh 4.3: Gin trng thi cho m (7, 4, 3) c 8 trng thi

Chng 4: C s l thuyt m ha


131
Gin ny minh ha ton b
k
2 16 = ng dn c th c cho m (7, 4, 3). Li c
n k
2 8

= hng (8 trng thi khc nhau), v c n 1 8 + = ct. Cc nt trong cng hng biu th
cng mt trng thi trong khi cc nt trong cng mt ct biu th tt c cc trng thi c th
000 (trng thi a), 001 (trng thi b), 010 (trng thi c), , 111 (trng thi h). Vic chuyn trng
thi gia cc ct k cn c v hoc bng cc ng lin nt hoc bng cc ng t nt ty
theo liu bt ra ca b m ha l 1 hay 0.
Ch c duy nht mt trng thi ban u l trng thi ton 0 (trng thi a). S cc trng thi
li s tng theo mi khi bt d liu mi c a vo b m ha.
Khi a bt d liu u tin vo b m ha (T = 0), c th c hai nt khc nhau thi im
tip nhau. Bt d liu t 2 a vo (T = 1) to nn s cc nt c th thi im k tip l
2
2 . S
cc nt c th c s tip tc tng theo T cho ti khi t ti s nt cc i
n k
2 8

= (S cc trng
thi ln nht t c khi T n k 3 = = ).
Sau khi T = k s cc trng thi c th s c chia i mi thi im k tip hng v
trng thi 0 l trng thi t c T = n.





















T = 0 T = 1 T = 2 T = 3 T = 4 T = 5 T = 6 T = 7
Trng thi a
000

Trng thi b
001

Trng thi c
010

Trng thi d
011

Trng thi e
100

Trng thi f
101

Trng thi g
110

Trng thi h
111


Bt d liu 0:
Bt d liu 1:
Hnh 4.4: Gin li cho m (7, 4, 3) c 8 trng thi v 8 giai on k tip
Chng 4: C s l thuyt m ha


132



4.9.2. Gii m li.
4.9.2.1. M u.
Gii m li cho m tuyn tnh do Wolf a ra vo 1978, tuy nhin k thut ny ch thch
hp cho mt s m nht nh do s cc trng thi tng theo hm m khi n k tng.
4.9.2.2. Thut ton Viterbi
Vo 1967, Viterbi l ngi u tin a ra thut ton Viterbi (VA). Thut ton ny tm tt
c cc ng c th trong li v cc khong Hamming (hoc cc khong cch Euclide) t dy
thu c u vo cc b gii m. ng dn s biu th khong cch nh nht t dy thu c
c chn l dy pht hp l nht v cc dy bt thng tin kt hp c ti to li. Phng php
ny chnh l phng php nh gi dy hp l ti a v ng dn hp l nht c chn t tp
tt c cc ng dn trong li.
Hnh 4.5 ghi "lch s " ca cc ng dn c chn bi b m Viterbi cho m (7, 4, 3).
Gi s rng khng c sai trong knh v bi vy dy vo ca b gii m chnh l dy m ha
cho dy 0000000. thi im u (T = 1) bt nhn c l 0, bt ny c so snh vi cc bt
pht c th c l 0 v 1 tng ng vi cc nhnh t nt a ti a v t nt a n g.
o ca hai nhnh ny l cc khong cch Hamming ca chng (chnh l s khc nhau
gia cc bt pht c th c (0 hoc 1) v bt nhn c 0). Cc khong cch Hamming tng ng
s l 0 v 1.
Ta xc nh o nhnh l khong cch Hamming ca mt nhnh ring t cc bt nhn
c v o ng dn thi im th T. o ny bng tng cc o nhnh tt c cc
nhnh t T = 0 n T = T. cc o ng dn ny c ghi trn nh ca mi nhnh hnh
4.5, tng ng thi im T = 1 l 0 v 1 i vi cc ng dn a a v a g . thi im
T = 2 bt nhn c l 0 v cc o nhnh l 0, 1, 0 v 1 tng ng vi cc nhnh a a ,
a g , g d v g f . o ca cc ng dn ny l 0, 1, 1, v 2 tng ng vi cc
ng a a a , a a g a g d , a g f . thi im th 3, bt nhn c
l 0. C 8 nhnh c th v cc o ng dn (xem hnh 4.5) l 0, 1, 2, 1, 3, 2, 1 v 2 tng ng
vi cc ng a a a a , a a a g , a g d b , a g d h ,
a g f c , a g f e , a a g d v a a g f .





Chng 4: C s l thuyt m ha


133



































T = 0 T = 1 T = 2 T = 3 T = 4 T = 5 T = 6 T = 7
Cc bt gii
m
0 0 0 0 0 0 0
Cc bt nhn
c
0 0 0 0 0 0
Trng thi a
000

Trng thi b
001

Trng thi c
010

Trng thi d
011

Trng thi e
100

Trng thi f
101

Trng thi g
110

Trng thi h
111


Bt d liu 0:
Bt d liu 1:
H h 4 5 V d ii Vit bi h (7 4 3)
0 0 0
0 0
0 0
1
1 1
1
3 3
3 3
3
2
2
2
2
2
2
1
1
2
2
1
1
1
Chng 4: C s l thuyt m ha


134





Ta k hiu
1
v
2
tng ng l cc ng a a a a a v
a g d b a , cc ng ny xut pht nt khi u a v tr v nt a T 4 = . Cc
o ng dn tng ng l 0 v 3, cc nhnh tip sau gn vi T 4 > i t nt a T 4 = s
cng thm cc o nhnh nh nhau vo cc o ng dn ca c hai ng
1
v
2
. iu
ny c ngha l o ng dn ca
2
l ln hn T 4 = v vn gi mc ln hn vi
T 4 > . B gii m Viterbi s chn ng dn c o nh nht (chnh l dy trng thi ton 0)
v loi b ng
2
. ng
1
c xem l ng sng st. Th tc ny cng c p dng
cc nt khc vi T n k 3 = . Cn lu rng cc ng a g f c ,
a a g f , khng th sng st v cc o ng dn ca chng l ln hn v bi
vy chng b loi b khi b nh ca b gii m.
Nh vy ch c
n k
2 8

= ng sng st t T n k = n T k = . Sau thi im


T 3 = s cc ng sng st s gim i mt na sau mi thi im.
i khi 2 ng nhp vo li cng mt o ng dn. T = 5 cc ng
a a a g d b , a g f e c b nhp li nt b. C hai ng ny
u c cng o ng dn l 2. Thng thng b gii m Viterbi s chn ngu nhin mt
ng sng st v loi b cc ng khc. Tuy nhin tnh trng ny rt him khi xy ra trong
mt thut ton Viterbi quyt nh mm (hay thut ton Viterbi u ra mm - SOVA) hay c s
dng trong thc t.
4.9.2.3. Gii m Viterbi quyt nh cng.
Khi gii m quyt nh cng, b iu ch s cho ra cc quyt nh cng (1 hoc 0) khi to
li dy pht. Trong trng hp ny cc khong cch Hamming gia cc bt nhn c v cc
bt pht c nh gi trong li s c dng lm o mc tin cy.
minh ha cho qu trnh gii m ny ta s dng m (7, 4, 3) vi dy bt pht i l
0000000. Sai s trn knh nm bt u tin v dy nhn c u ra b gii m iu ch l
1000000. B gii m s so snh bt ra ca b gii iu ch vi c hai bt c th c gii m
(c biu th bng cc ng lin nt v t nt trn hnh 4.6) l 1 v 0. Khi bt ra ca b gii
iu ch v bt c gii m nh nhau th khong cch Hamming ca chng bng 0. Ngc li
khi hai bt ny khc nhau th gi tr bng 1 ca khong cch Hamming s c cng thm vo
o ng dn.
V ta i ngang qua li nn cc o nhnh s c cng li T = 7.\, ng dn c trng
s Hamming nh nht s c xem l ng sng st. Bi vy dy c gii m l xu.
Chng 4: C s l thuyt m ha


135
Hnh 4.6 minh ha vic la chn ng sng st (c nh gi bng ng t nt m)
ca b gii m Viterbi ra sao. ng ny c o ng dn nh nht v s gii m ra c
ng dy thu c. Cn ch rng o ng dn ca ng sng st tng ng vi s sai
trong dy nhn c khi b gii m c kh nng sa cc sai ny.
Tuy nhin khi s sao trong knh vt qu kh nng sa sai ca m th s sy ra gii m sai.
Gi s knh c hai sai v tr th 1 v v tr th 3. Gii m sai s xy ra 4 nhnh ban u (c
ghi bng ng m nt trn hnh 4.7) v dy c gii m l 1011000





























T = 0 T = 1 T = 2 T = 3 T = 4 T = 5 T = 6 T = 7
Cc bt gii
m
0 0 0 0 0 0 0
Cc bt nhn
c
1 0 0 0 0 0
Trng thi a
000

Trng thi b
001

Trng thi c
010

Trng thi d
011

Trng thi e
100

Trng thi f
101

Trng thi g
110

Trng thi h
111

Bt d liu 0:
Bt d liu 1:
Hnh 4.6: Gii m Viterbi quyt nh cng cho m (7, 4, 3)
1 1
1
1 1
1 1
0
2 3
2
2
1
1
2 1
1
1
2
0
1
1
0
0
Chng 4: C s l thuyt m ha


136



































T = 0 T = 1 T = 2 T = 3 T = 4 T = 5 T = 6 T = 7
Cc bt gii
m
1 0 1 1 0 0 0
Cc bt nhn
c
1 0 1 0 0 0
Trng thi a
000

Trng thi b
001

Trng thi c
010

Trng thi d
011

Trng thi e
100

Trng thi f
101

Trng thi g
110

Trng thi h
111


Bt d liu 0:
Bt d liu 1:
Hnh 4.7: Gii m sai khi dng gii m Viterbi quyt nh cng
h (7 4 3)
1 1 2
2 1
1 1
0
1 2
2 2
0
1
1
2
1
1
0
1
0
0
1
0
Chng 4: C s l thuyt m ha


137


4.9.2.4. Gii m Viterbi quyt nh mm.
Theo quan im gii m Viterbi quyt nh mm, tn hiu nhn c u ra ca b gii
m iu ch s c ly mu. Sau cc gi tr mu s c a trc tip ti u vo ca b gii
m Viterbi. Gi s rng ta s dng iu ch dch pha nh phn (BPSK) u pht, khi mc
logic 0 s c gi l 1, 0 cn mc logic 1 s c gi l +1, 0. Nu ta pht dy ton 0 th dy
pht tng ng l 1 1 1 1 1 1 1 . my thu, cc u ra mm ca b gii m iu ch
l 0,8 , 1, 2 , 0, 6 , 2, 2 , 0, 4 , 1,3 , 0,9 + + (tng ng vi dy 1010000 nu ta
s dng gii m quyt nh cng). Cc u ra mm ca b gii m iu ch c dng nh o
mc tin cy (xem hnh 4.8).

























T = 0 T = 1 T = 2 T = 3 T = 4 T = 5 T = 6 T = 7
Cc bt gii
m
0 0 0 0 0 0 0 0
Cc bt nhn
c
+ 0,8 1,2 +0,6 2,2 0,4 1,3 0,9
Trng thi a
000

Trng thi b
001

Trng thi c
010

Trng thi d
011

Trng thi e
100

Trng thi f
101

Trng thi g
110

Trng thi h
111


Bt d liu 0:
Bt d liu 1:
Hnh 4.8: Gii m Viterbi quyt nh mm cho m (7, 4, 3)
0,8
+1,4
0,2
+2,0 +2,4 +3,7
+4,6
+0,4 +2,0
+0,3
+3,6
+2,4 +1,6 +4,5
+2,6
+1,2
+3,2
0,4
+2,0
+2,0
1,0
+0,8
Chng 4: C s l thuyt m ha


138




Tn hiu ra mm u tin ca b gii iu ch l + 0,8 ng rng tn hiu pht rt c th l
+1 v o mc tin cy ca quyt nh ny l 0,8. Xem xt ng dn a g tng ng vi
logic 1, o nhnh ca ng dn ny l +0,8. Tuy nhin ng dn a a khng n khp vi
tn hiu nhn c v o nhnh ca ng dn ny l 0,8 (tch ly mt ndo ng dn
m hay l lng pht) do s sai lc ca n. thi im th hai tn hiu nhn c l 1, 2 to
nn cc o ng dn l 0, 4 , 2, 0 , 0, 2 + + v 0, 4 tng ng vi cc ng
dn a a a , a a g , a g d v a g f . Ta k hiu
1
v
2
l cc
ng a a a a a v a g d b a . Cc o ng dn tng cng
c tch ly ca hai ng dn ny tng ng l 0, 2 + v 0, 4 + . B gii m Viterbi s chn
ng dn c o ng dn ln hn v mc tin cy c tch ly ca n ln hn. Bi vy
ng
1
s c chn (ch khng phi l ng
2
c chn trong v d gii m quyt
nh cng trn). iu ny chng t rng gii m quyt nh mm c hiu qu cao hn gii m
quyt nh cng.
4.10. M HAMMING V M C DI CC I
M Hamming v m c di cc i l hai lp m quan trng trong m xyclic.
nh ngha: M xyclic Hamming l m xyclic c a thc sinh l a thc nguyn thy bc
m, m ny c cc tham s nh sau:

( )
m m
0
(n, k, d ) 2 1, 2 1 m,3 =
M Hamming l m ti u tha mn gii hn Hamming (4.13). Ngoi m Hamming ch cn
m Golay (23, 12, 7) l m hon thin, m Golay c a thc sinh nh sau:

( )
11 9 7 5
g X X X X X X 1 = + + + + +
Bng sau l danh sch cc a thc nguyn thy c bc m t 2 n 8.

Bc a thc nguyn thy
(0 1 2)
(0 1 3)
(0 1 4)
(0 2 5), (0 2 3 4 5), (0 1 2 4 5)
(0 1 6), (0 2 3 5 6), ( 0 1 2 5 6)
Chng 4: C s l thuyt m ha


139
Bc a thc nguyn thy
(0 3 7), (0 1 2 3 7), (0 2 3 4 7), (0 1 2 4 5 6 7), (0 1 2 3 4 5 7),
(0 2 4 6 7), (0 1 7), (0 1 3 6 7), (0 2 5 6 7),
(0 2 3 4 8), (0 3 5 6 8), (0 1 2 5 6 7 8), (0 1 3 5 8), (0 2 5 6 8),
(0 1 5 6 8), (0 1 2 3 4 6 8), (0 1 6 7 8)

Ch : bng trn ta thy k hiu vit cc a thc theo s m ca cc bc khc khng.
V d:
( ) ( )
7 6 5 2
02567 g X X X X X 1 = + + + +
Cc a thc i ngu ca cc a thc trong bng cng l cc a thc nguyn thy, cc a
thc ny khng c lit k y.
V d: a thc i ngu ca
( )
4
g X X X 1 = + + l a thc

( )
* 4 3
g X X X 1 = + + .
M i ngu ca m Hamming l m c di cc i. m ny c tham s nh sau:

( )
m m 1
0
(n, k, d ) 2 1, m, 2

=
a thc sinh ca m ny c dng sau:

( )
( )
m
2 1
X 1
g X
h X

+
=
Trong h(X) l a thc nguyn thy bc m.
Cc m c di cc i l cc m ti u tha mn gii hn Griesmer (4. 11).
V d: - M xyclic (7, 4) c a thc sinh
( )
3
g X X X 1 = + + l m Hamming.
- M xyclic (7, 3) c a thc sinh
( )
4 2
g X X X X 1 = + + + l m c di cc i.
4.11. CC M KHI DA TRN S HC CA TRNG HU HN
4.11.1. Trng hu hn c nguyn t GF(p)
Ta lm quen vi trng nh phn GF(2), trong trng ny cc php ton s hc c
thc hin theo modulo 2. Tng t i vi trng GF(p) vi p l s nguyn t, cc php ton s
hc thch hp (cng v nhn) gia hai phn t bt k ca trng phi c thc hin theo modulo
p. Phn t ngc ca mt phn t bt k i vi php cng dc tnh bng kt qu ca php tr
gia p v phn t . V d trong GF(7), phn t ngc ca php cng ca 5 l 2. Phn t ngc
ca php nhn (phn t nghch o) kh tm hn, tuy nhin quan im sau y s gip ta tm c
n ng thi cho ta mt phng php xy dng trng. Trong trng GF(p) ngi ta chng
Chng 4: C s l thuyt m ha


140
minh c rng tn ti t nht mt phn t m cc ly tha ca n l cc phn t khc 0 ca
trng. Phn t ny c gi l phn t nguyn thy. V d trong trng GF(7) s 3 l phn t
nguyn thy v:

{ }
0 1 2 3 4 5
3 1, 3 3, 3 2, 3 6, 3 4, 3 5 = = = = = =
y l mt nhm nhn xyclic cp 6 (c th thy rng nhm nhn ny c hai phn t nguyn
thy l 3 v 5).
Vi
6
3 ta thy rng
6 5
3 3 .3 5.3mod7 1 = = = .
Ta c th thc hin php nhn bng cch cng cc s m ca 3.
V d:
( ) ( )
3 2 5
6.2 3 . 3 3 3 = = = .
Bi vy ta c th tm c phn t nghch o ca mt phn t
n
3 bt k l
n 6 n
3 3

= .
Nh vy nghch o ca 6 l 6 v nghch o ca 5 l 3.
4.11.2. Cc trng m rng ca trng nh phn. Trng hu hn GF(2
m
)
Ta c th xy dng c trng hu hn c s cc phn t l ly tha nguyn ca mt s
nguyn t p. Trong trng hp ny ngi ta cng chng minh c rng lun tn ti mt phn t
nguyn thy trong trng v cc php ton s hc s c thc hin theo modulo ca mt a thc
no trn GF(p). Trong gio trnh ny ta ch quan tm ti trng hp p = 2, khi a thc c
dng s l mt trong cc a thc nh phn nguyn thy (chnh l cc a thc sinh ca m
Hamming).
Gi s ta cn to mt trng hu hn GF(q) v k hiu l phn t nguyn thy ca n.
Cc ly tha ca (t
0
n
q 2
) gm q 1 phn t khc khng ca trng. Phn t
q 1
s bng phn t
0
, cn cc phn t c s m cao hn cng lp li cc phn t c s m
thp hn. Phng php nhn rt ra trc tip t php cng theo modulo
( )
q 1 i vi cc s m
ca . i vi trng
( )
m
GF 2 ta c:
( )
m
2 1
1

= hay
( )
m
2 1
1 0

+ = .
iu ny s tha mn nu c bt k mt nhn thc no ca a thc ny bng khng. Nhn
thc m ta chn phi l bt kh quy v khng l nhn thc ca
n
1 + i vi bt k gi tr n
no nh hn
m
2 1 , nu khng nh vy cc ly tha ca s lp li trc khi chng to ra tt
c cc phn t khc khng ca trng (iu ny c ngha l khng phi l phn t nguyn thy
ca trng). Nhn thc tha mn cc tnh cht trn chnh l a thc nguyn thy c bc m.
V d: Xt trng
( )
3
GF 2 . Cc nhn thc ca
7
1 + l
( )
( )( )
7 3 3 2
1 1 1 1 + = + + + + +
Chng 4: C s l thuyt m ha


141
C hai a thc bc 3 trn u l cc a thc nguyn thy v ta c th chn ty . Gi s ta
to cc ly tha ca theo iu kin
3
1 0 + + = . Khi cc phn t khc khng ca
trng l:

2
3
4 2
5 3 2 2
6 3 2 2
1
1
1
1

= +
= +
= + = + +
= + + = +

Mi ly tha ca c th c biu th bng mt a thc nh phn c bc nh hn hoc
bng 2. Php nhn cc phn t ca trng c thc hin thng qua php cng cc s m ca
theo modulo 7. Php cng c thc hin bng php cng modulo 2 cc s hng trong a thc.
V d:
3 4 2 2 6
1 1 + = + + + = + =
Cn ch rng mi phn t l phn t i (phn t ngc ca php cng) ca chnh n.
(iu ny rt ra t tnh cht ca php cng modulo 2) Cn mt vn ta cha tha mn l c
th biu th bng s nh th no. Tuy nhin iu ny khng quan trng v ta c th gn theo cch
m ta mun. V d ta gn gi tr 2 cho v 3 cho
2
, khi ta quyt nh rng trong s hc
ca ta 2.2 = 3. iu ny khc vi suy ngh thng thng ca chng ta v bi vy ta phi coi vic
gn cc gi tr s l hon ton ty mc d c mt s cch gn thun tin cho s dng.
4.11.3. Biu din a thc cho trng hu hn GF(2
m
)
Ngoi cch biu din s ngi ta c th s dng biu din a thc cho cc phn t ca
trng hu hn
( )
m
GF q . Vi trng
( )
m
GF 2 cc h s nh phn ca cc a thc c dng
to nn biu din cho cc phn t.
V d: Xt
( )
3
GF 2 , biu din cho 8 phn t ca trng ny c th vit nh sau:
Chng 4: C s l thuyt m ha


142

2
3
4 2
5 2
6 2
0 000
1 001
010
100
1 011
110
1 111
1 101
=
=
=
=
= + =
= + =
= + + =
= + =

y dy 3 bt c dng m t cho biu din a thc ca cc phn t. Php cng c
thc hin bng cch cng modulo 2 theo tng bt ca dy
4.11.4. Cc tnh cht ca a thc v cc phn t ca trng hu hn
4.11.4.1. Cc nghim ca a thc
Ta bit rng cc a thc vi cc h s thc khng phi lc no cng c cc nhn t thc,
tuy nhin lun lun c th phn tch chng di dng cc nhn thc phc. Tng t, mt a thc
bt kh quy trn trng hu hn lun c th phn tch c trong mt trng m rng no .
V d: a thc nh phn
3
X X 1 + + c th phn tch c trn GF(8) nh sau:

( )
( )( )
3 2 4
X X 1 X X X + + = + + +
Cc gi tr
2 4
, , c gi l cc nghim ca
3
X X 1 + + v chng biu th cc
gi tr ca X lm cho a thc bng khng.
Nu f(X) l mt a thc bt kh quy q phn th f(X) s c cc nghim trong mt trng m
rng
( )
m
GF q no , tc l f(X) c th biu din bng tch ca mt s hng c dng
( )
i
x +
vi
i
l phn t ca
( )
m
GF q . Hn na nu l mt nghim no th c th
thy rng cc nghim khc c dng
2 3
q q q
, , ,
Tng t nh trng hp phn tch cc a thc vi cc h s thc ta c th s dng thut
ng cc phn t lin hp cho cc nghim ca mt a thc bt kh quy. Vi a thc nh phn bt
kh quy c nghim th cc nghim lin hp l
2 4 8
, , ,
S tn ti cc nghim lin hp ca mt a thc tng ng vi cc tnh cht sau:
( )
( )
q
q
X X =

f f
Chng 4: C s l thuyt m ha


143
Nu l mt nghim ca
( )
X f th
q
cng l mt nghim ca
( )
X f . a thc
( )
X f c gi l a thc ti tiu ca . Nu l phn t nguyn thy th
( )
X f l mt a
thc nguyn thy. Nh vy c th sinh ra mt trng hu hn t mt phn t nguyn thy l mt
nghim ca a thc nguyn thy.
V d: Xt trng hu hn GF(8) to bi a thc nguyn thy
3
X X 1 + + . Th
2
X , X = = hoc
4
X = vo a thc ny ta thy n bng 0. Bi vy
3
X X 1 + + l a
thc ti tiu ca cc phn t
2 4
, , . Tng t th
3 6
, v
( )
12 5
= vo
3
X X 1 + + ta thy rng chng l cc nghim ca a thc ny. a thc ti tiu ca
0
l
( )
X 1 + .
Nu m l s nguyn nh nht
m
1 = th phn t c gi l c cp m (k hiu
( )
ord m = ) v phi l nghim ca
m
X 1 + . Nu cng l nghim ca mt a thc bt
kh quy
( )
X f no th
( )
X f phi l mt nhn thc ca
m
X 1 + .
V d: Gi tr nh nht ca m
( )
m
3
1 = l 7. Bi vy a thc
( )
3 2
X X X 1 = + + f l mt nhn thc ca
7
X 1 + .
4.11.4.2. Cc phn t ca trng hu hn xem nh cc nghim ca mt a thc
Cc nghim ca nh thc
m
2 1
X 1

+ chnh l cc phn t khc khng ca


( )
m
GF 2 .
V d: Ta c phn tch ca
7
X 1 + nh sau:
( )
( )( )
7 3 2 3
X 1 1 X 1 X X 1 X X + = + + + + +
Ta cng bit rng l nghim ca
( )
3
X X 1 + + v bi vy
2
v
4
cng l
cc nghim ca n.
3
l nghim ca
( )
3 2
X X 1 + + v bi vy
6
v
5
cng l
cc nghim ca n. Nghim ca
( )
X 1 + l 1.
4.11.4.3. Cc nghim ca mt a thc bt kh quy
a thc bt kh quy
( )
X f bc m s c m nghim l
m
2 4 2 1
, , , ,

v
m
2
=
v
m
2 1
1

= .
Chng 4: C s l thuyt m ha


144
V cc nghim ca
m
2 1
X 1

+ l tt c cc phn t khc khng ca


( )
m
GF 2 nn mt a
thc bt kh quy bc m lun c cc nghim trong
( )
m
GF 2 . Ngc li, cc nhn thc ca
m
2 1
X 1

+ cha tt c cc a thc bt kh quy bc m. Nh vy


3 2
X X 1 + + v
3
X X 1 + +
l ton b cc a thc bt kh quy bc 3 c th c.
Ch rng
m
X 1 + l c ca
n
X 1 + nu v ch nu m l c ca n. iu ny cng c
ngha l tt c cc a thc bt kh quy bc m l nguyn thy nu
m
2 1 l s nguyn t.
V d: 7 l s nguyn t nn tt c cc a thc bt kh quy bc 3 u l cc a thc nguyn
thu.
15 khng l cc s nguyn t nn khng phi tt c cc a thc bt kh quy bc 4 u l cc
a thc nguyn thy. C ba a thc bt kh quy bc 4 l
4
1 X X + + ,
3 4
1 X X + + v
2 3 4
1 X X X X + + + + . Ch c hai a thc
4
1 X X + + v
3 4
1 X X + + l cc a thc
nguyn thy
4.11.4.4. Phn tch mt a thc nh phn f(X)
phn tch mt a thc nh phn ta phi xy dng c trng hu hn m trn n c th
tm c cc nhn thc ca a thc ny. Mun vy, trc tin ta phi tm cc nhn thc bt kh
quy nh phn ca a thc
( )
X f ny (nu c) v cc bc ca chng. Sau ta tm bi chung nh
nht (BCNN) c' ca cc bc ny. Cc nhn thc ca
( )
X f s c tm trong
( )
c'
GF 2 . Cn
rng:

( ) ( ) ( ) ( ) ( )
b b 1 b 2 b 3
ab a a a a a
2 1 2 1 2 1 2 2 2 1


= = + + + +



Bi vy
c'
2 1 l bi ca
c
2 1 nu c' l bi ca c. Bng cch chn c' l bi ca bc c
ca mt nhn thc bt kh quy nh phn no , khi cc nghim ca n s nm trong
( )
c
GF 2
v cng nm trong
( )
c'
GF 2
Nu c' l bi ca cc bc ca mi a thc bt kh quy nh phn th tt c cc nghim ca
chng c th biu din c trong
( )
c'
GF 2 .
V d: a thc
( )
5 4
X X X 1 = + + f c phn tch thnh tch ca hai a thc bt kh
quy sau:

( )( )
5 4 3 2
X X 1 X X 1 X X 1 + + = + + + +
Chng 4: C s l thuyt m ha


145
Ta c
( ) ( )
3 2
deg X X 1 3 , deg X X 1 2 + + = + + =

( )
BCNN 3, 2 6 =
Nh vy
( )
X f c th phn tch c thnh tch ca cc a thc bc nht trong
( )
6
GF 2 .
4.11.5. Xc nh cc m bng cc nghim
Ta c th xc nh mt b m bng cch cho rng cc t m l cc a thc nh phn c cc
nghim xc nh trong
( )
m
GF 2 . Chng hn nu nghim l trong GF(8) th a thc ti tiu
ca n l
3
X X 1 + + v tt c cc t m phi chia ht c cho a thc ny. Trong trng hp
ny, a thc ti tiu ng vai tr nh a thc sinh ca m.
Mt cch tng qut ta c th coi a thc sinh l BCNN ca cc a thc ti tiu ca cc
nghim c xc nh. Bc ca a thc (chnh l s du kim tra ca m) l s cc nghim phn
bit sao cho tng s cc nghim l s du kim tra .
Nu a thc m
( )
v X c mt nghim th
( )
v 0 = .
Cho
n
v l h s ca
n
X , khi :

n 1 2 0
n 1 2 1 0
v v v v 0

+ + + + =
dng vct ta c th vit nh sau:

n 1
2
1
0
v 0


.

Tng t, nu
( )
v X c j nghim t
1
n
j
th :

n 1
n 1 n 1
j
1 2
2
2 2
j
1 2
1 1 1
1 2 j
0 0
0
1 2
j
v 0

.
. .

Chng 4: C s l thuyt m ha


146
Ta bit rng:
T
v.H 0 =
Nh vy ma trn chuyn v ca ma trn trn chnh l ma trn kim tra ca m. Cc
nghim u l cc a thc ca (ta cng xem nh l cc vct v chng cng phi c chuyn
v), bi vy ta c th vit:

T T T
T T T
T T T
n 1 1 0
1 1 1
n 1 n 1 0
2 2 2
n 1 1 0
j j j
H

. . .


Ta thy rng ch cn mt trong cc nghim
2 4 8
, , , , nm trong ma trn kim tra l
.
4.11.6. M Hamming
M Hamming c a thc sinh l a thc nguyn thy. Bi vy mt phn t nguyn thy bt
k u c xem l nghim ca m. nu ta ly phn t lm nghim th:

T T T
n 1 1 0
H


=



Ta bit rng cc ly tha ca l tt c cc phn t khc khng ca trng, iu ny c
ngha l ma trn kim tra H cha mi t hp 0 v 1 c th c.
V d: Xt m Hamming trn GF(8) c
3
1 0 + + = , ma trn kim tra H ca m ny c
dng:

1 1 1 0 1 0 0
H 0 1 1 1 0 1 0
0 0 1 1 1 0 1


=




Ma trn nycha tt c cc vct ct 3 bt c th c. y chnh l ma trn kim tra ca m
xyclic (7, 4)
4.11.7. M BCH
Vo nm 1959, Bose,Ray Chaudhuri v Hocquenghem l nhng ngi u tin a ra lp
m quan trng ny.
nh ngha: M BCH sa t sai l m xyclic c 2t nghim lin tip trong
( )
m
GF q v c
di l
m
q 1 .
Chng 4: C s l thuyt m ha


147
Sau y l cc bc xc nh mt m BCH trn
( )
GF q c di n v c kh nng sa
t sai:
1. Xc nh s nguyn nh nht m sao cho
( )
m
GF q c phn t nguyn thy .
2. Chn mt s nguyn t khng m b. Thng thng b = 1
3. Lit k ra 2t ly tha lin tip ca

b b 1 b 2t 1
, , ,
+ +

Xc nh cc a thc ti tiu trn
( )
GF q ca cc phn t ny (cn ch rng cc phn t
lin hp c cng mt a thc ti tiu)
4. a thc sinh g(X) l BCNN ca a thc ti tiu ny. m to c chnh l m xyclic (n,
k) vi
( )
k n degg X = .
nh ngha: Nu b 1 = th m BCH c gi l m BCH ngha hp. Nu
m
n q 1 = th
m BCH c gi l m BCH nguyn thy.
V d: M BCH nh phn sa sai n c di
m
2 1 l m c hai nghim lin tip trong
( )
m
GF 2 . Nu ta chn cc nghim ny l v
2
th nghim th hai
( )
2
l hin nhin c.
Bi vy y chnh l m Hamming.
M BCH nh phn sa hai sai phi c cc nghim lin tip l ,
2
,
3
v
4
. Hin
nhin l ch c v
3
l cc nghim c lp (
2
v
4
l cc phn t lin hp ca ). Bi
vy ma trn kim tra ca m ny c dng sau:

( )
T T T T
T
T T T
n 1 2 1 0
3 n 1 3.2 3.1 3.0
H


Cc m BCH cho php s dng phng php gii m i s. Xt trng hp n 15 = v c
hai sai cc v tr i v j. Ta c syndrom sau:
T
s e.H =
Syndrom c hai thnh phn
1
s v
3
s :

j i
1
3j 3i
3
s
s
= +
= +

Th
j i
1
s = + t phng trnh th nht vo phng trnh th hai ta c:

2 i 2i 3
1 1 1 3
s s s s 0 + + + =
Chng 4: C s l thuyt m ha


148
i
chnh l nghim ca phng trnh ny. V cc gi tr i v j l ty nn c hai v tr sai
c th tm c t phng trnh trn
V d: M BCH sa 2 sai c di 15 c cc nghim v
3
trn GF(16) s dng a
thc nguyn thy
4
X X 1 + + . Cc phn t
i
ca trng c biu din bng cc a thc c
dng sau:

0 8
1 9
2 10
3 11
4 12
5 13
6 14
7
0 0 0 1 0 1 0 1
0 0 1 0 1 0 1 0
0 1 0 0 0 1 1 1
1 0 0 0 1 1 1 0
0 0 1 1 1 1 1 1
0 1 1 0 1 1 0 1
1 1 0 0 1 0 0 1
1 0 1 1
= =
= =
= =
= =
= =
= =
= =
=

Khi ma trn kim tra c dng sau:

T T T T T
T T T T T
14 13 2 1 0
12 9 6 3 0
H



=




1 1 1 1 0 1 0 1 1 0 0 1 0 0 0
0 1 1 1 1 0 1 0 1 1 0 0 1 0 0
0 0 1 1 1 1 0 1 0 1 1 0 0 1 0
1 1 1 0 1 0 1 1 0 0 1 0 0 0 1
H
1 1 1 1 0 1 1 1 1 0 1 1 1 1 0
1 0 1 0 0 1 0 1 0 0 1 0 1 0 0
1 1 0 0 0 1 1 0 0 0 1 1 0 0 0
1 0 0 0 1 1 0 0 0 1 1 0 0 0 1






=








Gi s t m nhn c l :

( )
6 4
v X x x 1 0 0 0 0 0 0 0 0 1 0 1 0 0 0 1 = + +
Syndrom tng ng l 1 1 1 0 0 1 1 0
Hay
( )
11 5 11 5
1 3
s , s 1 1 1 0, 0 1 1 0 = = = =
Chng 4: C s l thuyt m ha


149
Ta c phng trnh sau:
7 i 11 2i 3 5
0
+ +
+ + + =
Vi i = 7 ta c:

14 10 3 5
1 0 1 0 0
0 1 0 1 0
0 1 0 1 0
1 1 0 0 0



+ + + = + + + =




Vi i = 8 ta c:

0 12 3 5
0 1 1 0 0
0 1 0 1 0
0
0 1 0 1 0
1 1 0 0 0



+ + + = + + + = =




Nh vy sai nm v tr 7 v 8. t m pht f(X) l:

( )
8 7 6 4
X X X X X 1 0 0 0 0 0 0 1 1 1 0 1 0 0 0 1 = + + + + f
Ta c th kim tra li kt qu gii m trn theo mt cch khc. Bit rng cc nghim v
3
c cc a thc ti tiu tng ng l
4
X X 1 + + v
4 3 2
X X X X 1 + + + + . a thc sinh
ca m xyclic ny l tch ca hai a thc ti tiu trn
( )
8 7 6 4
g X X X X X 1 = + + + + . Bi
vy y l m xylic (15, 7) v t m nhn c trn phi chia ht cho
( )
g X .
4.11.8. Cc m Reed Solomon (RS)
nh ngha: M RS l m BCH q phn c di
m
q 1 .
Trong
( )
m
GF q a thc ti thiu ca mt phn t n gin ch l
( )
x . Bi vy a
thc sinh ca m RS c dng:
( )
( )( ) ( )
b b 1 b 2t 1
g x x x x
+ +
=
trong l phn t nguyn thy ca trng. Bc ca
( )
g x bng 2t, nh vy vi m RS
n k 2t = , khong cch ca m RS:
0
d n k 1 = +
V d: Cho n 7 = . Gi s l nghim ca a thc nguyn thy
3
x x 1 + + . Bi ly
tha lin tip ca l
1 2 3 4
, , , . Nh vy a tc sinh ca m RS sa 2 sai l:
( ) ( )
( )( )( )
2 3 4 4 3 3 2 3
g x x x x x x x x x = = + + + +
Chng 4: C s l thuyt m ha


150
Cn ch rng cc h s ca
( )
g x nm trong
( )
GF 8
M RS tng ng l m (7, 3) c
3
8 t m.
Ngoi cc m tm thng l m kim tra chn
( )
n, n 1 v m lp
( )
n,1 , m Rs cng l
mt m tha mn gii hn Singleton sau:
0
d n k 1 +
4.12. CC M CHP
4.12.1. M u v mt s khi nim c bn.
M chp l m tuyn tnh c ma trn sinh c cu trc sao cho php m ha c th xem nh
mt php lc (hoc ly tng chp). M chp c s dng rng ri trong thc t. Bi m ha
c xem nh mt tp hp cc b lc s tuyn tnh vi dy m l cc u ra ca b lc c php
xen k. Cc m chp l cc m u tin c xy dng cc thut ton gii m quyt nh phn
mm hiu qu
V d: M khi t cc khi k du to ra cc khi n du. Vi cc m chp (thng c xem
l cc m dng), b m ha hot ng trn dng lin tc cc du vo khng c phn thnh cc
khi tin ri rc. Tuy nhin tc m
k
n
c hiu l vic a vo k du mi bc thi gian s
to ra n du mi. S hc c th c thc hin trn mt trng ty nhng thng thng vn l
trn
( )
GF 2 .
Ta biu th cc dy v cc hm truyn t nh cc chui ly tha ca bin x (i khi cn
dng k hiu D thay cho x). Dy
{ }
2 1 0 1 2
, m , m , m , m , m ,

(vi cc phn t
i
m
thuc trng F) c xem nh mt chui Laurent:
( )
e
e
e
m x m x

=
=


Tp tt c cc chui Laurent trn F l mt trng, ta k hiu trng ny l
[ ]
F x

. Nh
vy
( ) [ ]
m x F x

.
i vi dng nhiu u vo ta dng k hiu
( )
( )
1
m x biu th dng u vo u tin,
( )
( )
2
m x biu th dng u vo th hai... Tp cc dng vo xem nh mt vect:
( )
( )
( )
( )
( ) [ ]
2
1 2
m x m x m x F x

=




B m ha cho m chp thng c coi l mt tp cc b lc s.
V d: Hnh 4.2 ch ra mt v d v mt b m ha

Chng 4: C s l thuyt m ha


151








(cc D biu th cc nh mt bt cc trig D)
Dng vo
k
m
i qua hai b lc dng chung cc phn t nh to ra hai dng ra:
( ) 1
k k 2 k
C m m

= + v
( ) 2
k k 1 k 2 k
C m m m

= + +
Hai dng ra ny c a ra xen k to ra dng c m
k
C . Nh vy c mi bt vo
li c hai bt m c a ra, kt qu l ta c mt m c tc
1
R
2
= .
Thng thng ta coi trng thi ban u ca cc phn t nh l 0, Nh vy, vi dng vo
{ }
m 1, 1, 0, 0, 1, 0, 1 = cc u ra s l:
( )
{ }
1
C 1, 1, 1, 1, 1, 0, 0, 0, 1 = v
( )
{ }
2
C 1, 0, 0, 1, 1, 1, 0, 1, 1 =
Dng ra:
{ }
C 11, 10, 10, 11, 11, 01, 00, 01, 11 =
y du phy phn cch cc cp bt ra ng vi mi bt vo.
Ta c th biu th hm truyn t u vo
( )
m x t u ra
( )
( )
1
C x nh sau:
( )
( )
1 2
g x 1 x = + . Tng t ta c
( )
2 2
g x 1 x x = + +
Dng vo
{ }
m 1, 1, 0, 0, 1, 0, 1 = c th biu th nh sau:
( ) ( ) [ ]
4 6
m x 1 x x x GF 2 x = + + +


Cc u ra s l:
( )
( ) ( ) ( )
( )( )
1 4 6 2 2 3 4 8
1
C x m x g x 1 x x x 1 x 1 x x x x x = = + + + + = + + + + +

( )
( ) ( ) ( )
( )( )
2 4 6 2
2
3 4 5 7 8
C x m x g x 1 x x x 1 x x
1 x x x x x
= = + + + + +
= + + + + +

k
C
+
k
m

D
Hnh 4.2: B m ha cho m chp tc
1
R
2
=

D
+
( ) 1
k
C
Chng 4: C s l thuyt m ha


152
Vi mi m chp tc
k
R
n
= c mt hm truyn ma trn
( )
k n x (cn c gi l
ma trn truyn). Vi m tc
1
R
2
= v d trn ta c:

( )
2 2
a
G x 1 x 1 x x

= + + +


Ma trn truyn ny khng ch c dng cc a thc, ta c th thy thng qua v d sau:
V d: Xt ma trn truyn ca m chp sau:
( )
2
b
2
1 x x
G x 1
1 x

+ +
=

+



V c "1" ct u tin nn dng vo s xut hin trc tip u ra an xen, bi vy y l
mt m chp h thng
B m ha cho m ny c m t hnh 3:







Vi dng vo:
( )
2 3 4 8
m x 1 x x x x x = + + + + + cc u ra
( ) 1
k
C v
( ) 2
k
C c dng:
( )
( )
( )
( )( )
1
2 3 4 8
k
2 3 4 8 2
2
k
2
3 4 5 7 8 10
C m x 1 x x x x x
1 x x x x x 1 x x
C
1 x
1 x x x x x x
= = + + + + +
+ + + + + + +
=
+
= + + + + + + +

Mt b m ha ch c cc hng a thc trong ma trn truyn c gi l b m ha c p
ng xung hu hn. Mt b m ha c cc hm hu t trong ma trn truyn gi l b m ha c
p ng xung v hn.
Vi m c tc k/n vi k > 1 dy thng bo u vo (ta coi nh c tch ra t mt dy
thng bo thnh k dng), ta c:
( )
( )
( )
( )
( )
( )
( )
1 2 k
m x m x , m x , , m x

=



k
C
k
m

D
Hnh 4.3: B m ha h thng vi
1
R
2
=
D
+
( ) 2
k
C
+
( ) 1
k
C
Chng 4: C s l thuyt m ha


153
v:
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
( )
1,1 1,2 1,n
2,1 2,2 2,n
k,1 k,2 k,n
g x g x g x
g x g x g x
G x
g x g x g x



=




. .


Dy ra c biu th nh sau:
( )
( )
( )
( )
( )
( )
( ) ( ) ( )
1 2 n
C x C x , C x , , C x m x G x

= =



Ma trn truyn
( )
G x c gi l h thng nu c th xc nh c mt ma trn n v
trong cc phn t ca
( )
G x (chng hn nu bng cc php hon v hng v/hoc ct ca
( )
G x
c th thu c mt ma trn n v).
V d: Cho m h thng tc R 2 3 = c ma trn truyn sau:

( )
3
2
3
x
1 0
1 x
G x
x
0 1
1 x


+

=


+

So th hin ca m ny cho trn Hnh 4:










Mt s m ha khc c hiu qu hn c m t Hnh 5:



( )
( )
3
C x

( )
( )
1
m x

D
Hnh 4.4: B m ha h thng
2
R
3
=

D
+
( )
( )
2
C x

+
( )
( )
1
C x

D
( )
( )
2
m x

D D
+
D
D D
+
+ D
( )
( )
3
C x

( )
( )
2
C x

( )
( )
1
C x

( )
( )
1
m x

( )
( )
2
m x

Hnh4.5: S b m ha h thng
2
R =
c phn cng n gin hn
Chng 4: C s l thuyt m ha


154




Gi s: ( )
2 4 5 7 2 5 6 7
m x 1 x x x x , x x x x

= + + + + + + + + +


Khi u ra
( )
C x c dng:
( )
2 4 5 7 2 5 6 7 3 5
C x 1 x x x x , x x x x , x x x

= + + + + + + + + + + + +


Khi a ra xen k dng ra s l:
{ }
100, 001, 110, 001, 100, 111, 010, 110
T cc v d trn ta c nh ngha sai cho m chp
nh ngha: M chp tc R k n = trn trng cc chui Laurent hu t
[ ]
F x

trn
trng F l nh ca mt nh x tuyn tnh n nh ca cc chui Laurent k chiu
( ) [ ]
k
m x F x

vo cc chui Laurent ( ) [ ]
n
C x F x

.
4.12.2. Cc m Turbo.
Vo nm 1993, Berrou, Glavieux v Thitimajashima a ra mt s m ha mi cho
cc m chp c gi l m Turbo (Hnh 6). Trong s ny dng thng tin vo c m ha hai
ln vi mt b xo trn t gia hai b m ha nhm to ra hai dng d liu c m ha c th
xem l c lp thng k vi nhau.







Trong s ny cc b m ha thng c s dng l cc b m ha cho m chp c tc
R 1 2 = .
Cc m ny c s dng rt hiu qu trn cc knh phainh. Ngi ta chng t rng
hiu nng ca m Turbo s tng khi tng kch thc ca b xo trn. Tuy nhin trong nhiu ng
dng quan trng (chng hn khi truyn ting ni), kch thc b xo trn qu ln khng s dng
c do kt qu gii m b gi chm
V d: Xt s d m ha Turbo c hm truyn sau: (Hnh 4.7)
Cc bt ra

( )
C x
Cc bt vo
( )
m x
Hnh4.6: B m ha Turbo
B m ha 1
B m ha 2
Trch
chn
Xo trn
Chng 4: C s l thuyt m ha


155

( )
2
1
G x
1 x
=
+

vi b xo trn c m t bi php hon v
{ } 8,3, 7, 6,9, 0, 2,5,1, 4 =












Gi s dy vo l:
( ) [ ]
( )
( )
1
m x 1,1, 0, 0,1, 0,1, 0,1,1 C x = =
Khi dy ra ca b m ha th nht l:

( )
( ) [ ]
2
C x 1,1,1,1, 0,1,1,1, 0, 0

=
Dy bt c hon v a vo b m ha th hai l:

( ) [ ]
m x 1, 0, 0,1,1,1, 0, 0,1,1

=
Dy ra ca b m ha th hai l:

( )
( ) [ ]
3
C x 1, 0,1,1, 0, 0, 0, 0,1,1

=
B trch chn s chn a ra cc bt c gch di ln lt cc u
( )
( )
2
C x

v
( )
( )
3
C x


Dy bt c m ha u ra c gi tr
1
R
2
= l:

( ) [ ]
v x 1,1,1, 0, 0,1, 0,1,1, 0, 0, 0,1,1, 0, 0,1, 0,1,1 =
Khi khng dng b trch chn dy bt ra s c tc
1
R
3
= v c dng
( )
( ) 3
x
C

( )
( ) 2
x
C

( )
m x


( )
m x
Hon v
+
+
Trch
chn
( )
( )
1
C x
( )
( )
2
C x
Hnh4.7:
Chng 4: C s l thuyt m ha


156

( ) [ ]
v x 1,1,1,1,1, 0, 0,1,1, 0,1,1,1, 0, 0, 0,1, 0,1,1, 0, 0,1, 0,1, 0,1,1, 0,1 =
Dy ra
( )
v x c iu ch v pht qua knh, u ra knh tn hiu nhn c gii iu
ch to ra vct
( )
r x bao gm cc vect
( )
( )
1
r x (tng ng vi
( )
( )
1
C x ),
( )
( )
2
r x
(tng ng vi
( )
( )
2
C x

) v
( )
( )
3
r x (tng ng vi
( )
( )
3
C x

),.
Hot ng chung ca thut ton gii m Turbo c th m t nh sau (xem hnh 4.8).
D liu
( )
( )
( )
( )
( )
1 2
r x , r x c a ti b gii m 1. Trc tin b gii m ny s dng
s dng thng tin tin nghim trn cc bt pht v to ra cc bt c xc sut xut hin ph
thuc vo d liu quan st c. u ra nh gi ny ca b gii m 1 c xo trn theo lut
hon v v c a ti b gii m 2 v c lm thng tin tin nghim. Cng a ti b gii
m 2 l d liu nhn c
( )
( )
( )
( )
( )
1 3
r x , r x , cn ch rng
( )
( )
1
r x phi c a ti b
xo trn . u ra nh gi ca b gii m 2 c gii xo trn bng lut hon v ngc
1

v c a tr li lm thng tin tin nghim cho b gii m 1. Qu trnh chuyn thng tin tin
nghim s c tip tc cho n khi b gii m quyt nh rng qu trnh hi t (hoc cho ti
khi t c mt s ln lp nht nh)
Phn quan trng nht ca thut ton gii m ny l mt thut ton gii m quyt nh mm,
thut ton ny s cung cp cc nh gi ca cc xc sut hiu nghim cho mi bt vo










BI TP
4.1. Hy thit lp cc t m h thng cho m xyclic
( )
2 4
7,3 1 x x x = + + + vi cc a thc
thng tin sau:
( )
1
a x 1 x = +

( )
2
2
a x 1 x = +
nh gi
( )
( )
3
r x

( )
( )
1
r x

( )
( )
2
r x

( )
( )
1
r x
nh gi
Gii xo trn
1

Xo trn
Xo trn
B gii
m 1

B gii
m 2
Gii xo
trn
1

RA
Hnh 4.8: S khi chc nng ca b gii m Turbo
Chng 4: C s l thuyt m ha


157
4.2. Gi s t m nhn c ca m xyclic (7, 3) c
( )
2 4
g x 1 x x x = + + + c dng
( )
6 0
6 5 4 2
. . . . . x x
v x x x x x x 0 1 1 1 0 1 1 = + + + +
Hy s dng thut ton chia dch vng tm dc t m pht bit rng m (7, 3) ny c
0
d 4 = .
4.3. Hy lp bn t m ca m h thng nh phn (8,4) bit rng cc du tin tc ca mi t m l:
a. 1 1 0 0
b. 0 1 0 1
c. 1 0 1 0
v ma trn kim tra ca b m l:
1 1 1 1
0 1 0 0
H
1 0 1 1
1 1 1 0



=




4.4. Hy lp m Huffman cho ngun tin sn ra cc ch c lp
1
x ,
2
x ,
3
x ,
4
x vi cc xc sut
tng ng
( )
1
p x 0,1 = ;
( )
2
p x 0, 6 = ;
( )
3
p x 0, 25 = ;
( )
4
p x 0, 05 = . Tnh di trung
bnh ca t m. Tnh entropie ca ngun.
4.5. Mt m n gin n du dng trong knh nh phn khng i xng vi xc sut thu sai du
0 l
( )
0
p p 0 1 = khc xc sut thu sai du 1 l
( )
1
p p 1 0 = . Cc li xy ra c
lp vi nhau. Hy tm xc sut gii ng m. Xc sut ny c nh nhau i vi mi t m khng?
4.6. Cho b m h thng nh phn (8,4), cc du
1
,
2
,
3
,
4
l cc du mang tin, cc du
5
,
6
,
7
,
8
l cc du kim tra, c xc nh nh sau:
( )
5 1 2 3
6 2 3 4
6 1 2 4
5 1 2 3 4
a
= + +

= + +

= + +

= + + +


Chng minh rng khong cch cc tiu ca m trong b m ny bng
min
d 3 = .
4.7. Xt m (7,4) c d = 3. M ny sa c mt sai. Tnh xc sut thu ng mt t m khi xc
sut thu sai mt du m bng
0
p
4.8. M h thng (3,1) c hai t m 000 v 111. Tnh xc sut sai tng ng khi dng m ny
trong knh i xng c li xy ra vi xc sut thu sai mt du l p c lp vi nhau.
Chng 4: C s l thuyt m ha


158
4.9. S cc t hp m ca mt b m l
n
0
N m = . Trong s cc t m em dng l
0
N N < (s cc t m cn li gi l cc t m cm). Khi mt t m dng bin thnh mt t m
cm no th ta bo vic truyn tin gp li v nh vy li t ng c pht hin. Hy tnh s
lng cc t m sai c th c m chng c pht hin t ng v s ti a cc t m c th sa
ca b m ny. p dng bng s vi m = 2, n = 4, N = 8.
4.10. Cho :
( )
( )( )( )( )
+ = + + + + + + + + + + +
15 2 4 3 4 4 3 2
X 1 X 1 X X 1 X X 1 X X 1 X X X X 1
a. Hy tm tt c cc m xyclic c th c trn vnh
[ ]
+
15
2
Z x X 1
b. Hy tm a thc sinh ca m BCH sa 3 sai.

4.11. Hy thc hin bi tp 4.4 theo thut ton Shannon Fano sau:
Bc 1: Chia tp tin thnh hai nhm c tng xc sut xp x nhau
Bc 2: Ghi "0" vo cc tin ca mt nhm
Ghi "1" vo cc tin ca nhm cn li
Bc 3:Vi mi nhm li thc hin cc bc trn. Thut ton dng khi mi phn t ch cn
cha mt tin
4.12. Vi m BCH sa 2 sai c m t trong v d mc 4.10.7 hy gii m cho dy sau: 1 0 0 0
1 0 1 1 0 0 1 0 0 0 1
4.13. Hy gii cc bi tp 3.8 v 3.14 bng cch m ha nh phn.
4.14. Cho
( )
( )( )
+ = + + + + +
9 2 3 6
X 1 X 1 1 X X 1 X X . Hy thit lp tt c cc m xyclic c
th c trn vnh
[ ]
+
9
2
Z x X 1.
4.15. Hy thc hin m ha Huffman cho ngun ri rc sau:



=


1 2 3 4 5 6 7 8 9 10
a a a a a a a a a a
A
1 1 1 1 1 1 1 1 1 1
4 4 8 8 8 32 32 32 64 64

nh gi hiu qu ca php m ha
Hy gii m cho dy cc bt nhn c sau: 1 0 1 1 0 0 1 1 1 0 1 0 1 .
4.16. Hy thit lp t m h thng ca b m xyclic (7,4) c a thc sinh
( )
= + +
3 2
g X x x 1
tng ng vi a thc thng tin
( )
= +
3
a x x x theo thut ton nhn v theo thut ton
chia.
Chng 4: C s l thuyt m ha


159
4.17. Cho m xyclic (15, 11) c a thc sinh
( )
= + +
4
g X x x 1. Hy m t s chc nng
ca thit b m ha h thng theo phng php chia a thc cho b m ny. Tm t m ra ca
thit b trong trng hp a thc thng tin u vo c dng:
( )
= + +
10 9 7
a x x x x



Chng 5: L thuyt thu ti u


160
CHNG V L THUYT THU TI U
5.1. T BI TON V CC VN C BN
5.1.1. Thu tn hiu khi c nhiu l mt bi ton thng k
Ta xt trng hp n gin nht khi dng ca tn hiu trong knh khng b mo v ch b
nhiu cng tnh. Khi u vo ca my thu s c tng ca tn hiu v nhiu:

( ) ( ) ( )
i
u t S t n t = + (5.1)
Trong - h s truyn ca knh (thng thng 1 < )
Gi thit = const.
- thi gian gi chm tn hiu ca knh
n(t) - nhiu cng, l mt hm ngu nhin
Trng du li vo { }
i
i 1, m = , khi cc
( )
i
S t l cc tn hiu pht tng ng vi
cc tin
i
.
Do
( )
n t l mt QTNN nn
( )
u t cng l mt QTNN. Vy khi nhn c
( )
u t ta c th
ra m gi thit sau:
1.
( )( )
1 1
S t c gi i v trong qu trnh truyn
( )
1
S t c cng thm mt nhiu:
( ) ( ) ( )
1
n t u t S t =
2.
( )( )
2 2
S t c truyn i v trong qu trnh truyn
( )
2
S t c cng thm mt
nhiu:
( ) ( ) ( )
2
n t u t S t =
..
m.
( )( )
m m
S t c truyn i v trong qu trnh truyn
( )
m
S t c cng thm mt
nhiu:
( ) ( ) ( )
m
n t u t S t =
Nhim v ca b thu l phi chn mt trong m gi thuyt ny trong khi n ch bit mt s
tnh cht ca ngun tn hiu v dng ca tn hiu nhn c
( )
u t . R rng l mi mt gi thuyt
u c mt xc sut sai tng ng v
( )
n t l mt hm ngu nhin. Nh vy my thu phi chn
mt li gii no trong iu kin bt nh. Vic xt cc quy lut chn li gii trong iu kin bt
nh chnh l ni dung ca bi ton thng k. V vy thu tn hiu khi c nhiu l mt bi ton
thng k.
Chng 5: L thuyt thu ti u


161
5.1.2. My thu ti u
Nhim v ca my thu l phi chn li gii do my thu cn c gi l s gii. Yu
cu ln nht ca s gii l phi cho ra li gii ng (pht
i
ta phi tm c
i
). Trong thc
t c rt nhiu s gii. Trong tt c cc s gii c th c th ti mt s bo m xc sut
nhn ln phi ng l ln nht (xc sut gii sai l b nht). S d ny c gi l s gii ti
u. My thu xy dng theo s gii c gi l my thu ti u (hay l tng)
5.1.3. Th chng nhiu
C th dng xc sut thu ng nh gi chnh xc ca mt h thng truyn tin mt
cch nh lng. nh gi nh hng ca nhiu ln chnh xc ca vic thu, ngi ta a ra
khi nim tnh chng nhiu ca my thu. Nu cng mt mc nhiu, my thu no c xc sut
thu ng l ln th c coi l c tnh chng nhiu ln. Hin nhin rng tnh chng nhiu ca
my thu ti u l ln nht v c gi l th chng nhiu.
5.1.4. Hai loi sai lm khi chn gi thuyt
a. Sai lm loi 1: Gi
l
H l gi thuyt v tin
l
gi i. Ni dung ca sai lm ny l bc
b
l
H m thc t l n ng. Tc l qu tht
l
gi i m ta khng.gi. Sai lm 1 l b st tin
(hay mc tiu).
b. Sai lm loi 2: Tha nhn
l
H trong khi thc t n sai. Tc l thc ra khng c
l
m ta
li bo l c. Sai lm loi ny gi l nhm tin hoc bo ng nhm.
Bnh thng, khng c iu kin g c bit, s tn ti ca hai loi sai lm trn l khng
"ngang quyn" (khng gy tc hi nh nhau)
5.1.5. Tiu chun Kachennhicov.
Thng thng khi nim ti u l phi hiu theo mt ngha no , tc l ti u theo mt
tiu chun no . Thng thng trong thng tin "thu ti u" c hiu theo ngha nh sau (Do
Kachennhicov ra v gi l tiu chun Kachennhicov).
Trong cng mt iu kin cho trong s hai hay nhiu s gi, s no m bo xc
sut gii ng ln nht th c gi l ti u. (tiu chun ny cn c gi l tiu chun ngi
quan st l tng).
Nhc: Khng ng n cc loi sai lm, tc l coi chng tn ti "ngang quyn" nhau.
u: n gin, d tnh ton, d thc hin.
Ngoi tiu chun Kachennhicov cn c mt s nhng tiu chun khc nh: Neyman-
Pearson, Bayes, Vald . Nhng tiu chun ny khc phc c nhc im trn nhng kh phc
tp nn khng dng trong thng tin.
5.1.6. Vic x l ti u cc tn hiu
Nhim v ca my thu l cho ta cc li gii
i
. Qu trinh thc hin nhim v ny c gi
l qu trnh x l tn hiu. Trong qu trnh x l tn hiu thng phi thc hin cc php ton
Chng 5: L thuyt thu ti u


162
tuyn tnh hoc phi tuyn nh cc mch tuyn tnh hoc phi tuyn (v d: bin tn, tch sng, lc,
hn ch, nhn, chia, tch phn, bnh phng, khuch i .). Qu trnh x l tn hiu trong my
thu ti u c gi l x l ti u tn hiu. X l nhn li gii c xc sut sai b nht.. Trc
kia vic tng hp cc my thu (xy dng s gii) ch cn c vo cc tiu chun cht lng
mang tnh cht chc nng m khng mang tnh cht thng k. nh hng ca nhiu ln cht
lng ca my thu ch c tnh theo t s tnh /tp. Tc l vic tng hp my thu ti u trc
y ch ch yu da vo trc gic, kinh nghim, th nghim. Ngy nay l thuyt truyn tin cho
php bng ton hc tng hp c my thu ti u ("Ti u" lc ny mi mang tnh cht nh
lng) tc l da vo cc tiu chun ti u bng cng c thng k ton hc ngi ta a xc nh
c quy tc gii ti u.
5.1.7. Xc sut gii sai v quy tc gii ti u
Cho
i
l tn hiu gi i, xc sut gi tn hiu ny i l
( )
i
p ,
( )
i
p c gi l
xc sut tin nghim
( )
m
i
1
p 1

=


. Gi thit rng
( )
i
S t c thi hn T,
( )
i
S t c gi l
cc tn hiu nguyn t ng vi cc du m. my thu ta nhn c
( )
u t . T
( )
u t qua s
gii ta s c li gii
j
no . Nu nhn c
l
th ta coi rng
l
c gi i. Nh vy
l

c gi i vi mt xc sut
( )
p / u
l
c gi l xc sut hu nghim. Do xc sut gii
sai s l:

( ) ( )
p sai / u, 1 p / u =
l l
(5.1)
T (5.1) ta s tm ra quy tc gii ti u (theo tiu chun Kachennhicov)
tm ra quy tc gii ti u ta xt hai s gii:
- T
( )
u t cho ta
1

- T
( )
u l cho ta
2

Nu
( ) ( )
1 2
p sai / u, p sai / u, < (5.2) th ta s coi s th nht ti u hn s th
hai.
T (5.1) v (5.2)
( ) ( )
1 2
p sai / u, p sai / u, > (5.3)
Tc l xc sut chn li gii sai
( )
p sai / u,
l
cng nh nu xc sut hu nghim tng
ng
( )
p / u
l
cng ln.
Ta xt m s , khi ta c th coi
( )
m 1 h thc sau:

( ) ( )
i
p / u p / u
i l

>

l
i =1, m
Vi (5.4)
Chng 5: L thuyt thu ti u


163
Nu ta c
( )
m 1 h thc ny th ta coi s gii chn
l
s l ti u (theo ngha
Kachennhicov) v n m bo xc sut phi sai l b nht (5.4) chnh l quy tc gii ti u. S
gii tha mn (5.4) chnh l s gii ti u.
5.1.8. Hm hp l
Dng cng thc Bayes:
( )
( ) ( )
( )
j j
j
p w u /
p / u
w u

= (5.5)
Thay vo (5.4) ta c:
( ) ( ) ( ) ( )
i i
p w u / p w u /
i l

>

l l
i =1, m
Vi (5.6)
Hay
( )
( )
( )
( )
i
i
w u / p
w u / p

>

l
l

t
( )
( )
/i
i
w u /
w u /

=
l
l
v c gi l hm hp l (t s hp l). N c trng cho mc
hp l ca gi thuyt cho rng
l
c gi i (so vi gi thuyt cho rng
i
c gi i).
Ta c:
( )
( )
( )
i
/i
p
u
p
i l

=
l
l
i =1, m
Vi (5.7)
(5.7) chnh l quy tc gii ti u vit di dng hm hp l.
5.1.9. Quy tc hp l ti a
Nu mi tn hiu gi i u ng xc sut:
( ) ( )
i
1
p p
m
= =
l
vi i, =1, m l th
(5.7) tr thnh
( )
/i
u 1 i >
l
l Vi (5.8)
(5.8) c gi l quy tc hp l ti a, n hay c dng trong thc t v hu ht cc h
truyn tin u c th coi (vi sai s chp nhn c) ngun du c cc du ng xc sut.
c th thy r nh hng ca tnh thng k ca nhiu (5.8) ta thng vit n di
dng:

( )
( )
( )
( ) ( )
( ) ( )
/i
i i
w u / w u / : w u / 0
u
w u / w u / : w u / 0

= =

l l
l


( )
( )
( )
( ) ( )
/0
/i /0 i/0
i/0
u
u u u i
u

= >

l
l l
l (5.9)
Chng 5: L thuyt thu ti u


164
( )
/0
u
l
v
( )
i/0
u d tm hn
( )
/i
u
l
. y phi hiu rng
( )
w u / 0 chnh l mt
xc sut ca nhiu.
5.2. X L TI U CC TN HIU C THAM S BIT. KHI NIM V THU
KT HP V THU KHNG KT HP.
5.2.1. t bi ton
Mt knh truyn tn hiu lin tc chu tc ng ca nhiu cng Gausse (chun) c mt
xc sut bng:

( )
2
2
n
2
1
W n e
2

=

(5.10)
c phng sai
2
v k vng trit. Tn hiu pht c mi yu t trit trc (tin nh)
Hy tm cng thc ca quy tc gii ti u theo quy tc hp l ti a v lp s chc nng
ca s gii ti u trong trng hp ny.
5.2.2. Gii bi ton
5.2.2.1. Tm hm hp l
( )
/0
u
l

Ta c ( ) ( ) ( )
j
u t S t n t = +
, const = l cc tham s ca knh bit
( )
j
S t cng bit
tm
( )
/0
u
l
ta gi thit
( )
u t c ph hu hn
c
F . Nh vy ta c th ri rc ha
( )
u t
thnh n s c:
1 2 n
u , u , . u ,
c
n 2F T = , trong T l thi hn ca
( )
u t . Nh vy ta phi tm
( )
j/0 1 2 n
u , u , . u

( )
( )
( )
n 1 2 n i
j/0 1 2 n
n 1 2 n
W u , u , . u
u , u , . u
W u , u , . u 0


( )
n 1 2 n
W u , u , . u 0 chnh l mt phn b n chiu ca nhiu Gausse, nu coi cc
s c ca nhiu c lp, thng h vi nhau th:
Chng 5: L thuyt thu ti u


165

( ) ( )
( )
2
k
c c
2
c
c
u
2F T 2F T
2
n 1 2 n 1 k
k 1 k 1
2F T
2
k
2F T 2
k 1
1
W u , u , . u 0 W u e
2
1 u
exp
2
2

= =
=
= =



=


K hiu ( ) ( )
j j
c t S t = .
Khi pht
j
ta s nhn c cc
k jk k
u c n = + .
tnh ton d dng ta coi vic pht
j
tng ng vi vic nhn c nhiu c cc
gi tr nhiu
'
k k jk
n u c = . Tc l coi :
( ) ( )
' ' '
n 1 2 n j n 1 2 n
W u , u , . u W u , u , . u 0 =
Tng t nh trn ta c:
( )
( )
( )
( )
( )
c
c
c c
2
2F T
k jk
' ' '
n 1 2 n
2F T 2
k 1
2
2F T 2F T
2
k jk
k
j/0 1 2 n
2 2
k 1 k 1
u c
1
W u , u , . u 0 exp
2
2
u c
u
u , u , . u exp
2 2
=
= =


Phng sai
2
ca tp c th biu th qua mt ph cng sut ca n v gii thng ca
knh
c
F
2
0 c
G F = Trong
c
1
F
2 t
=
.

( )
( )
c c
2F T 2F T
2
2
j/0 1 2 n k k jk
0 0
k 1 k 1
1 1
u , u , . u exp u t u c t
G G
= =


=




. .
Khi
c
F ta c:
Chng 5: L thuyt thu ti u


166
( ) ( )
( ) ( ) ( )
( ) ( ) ( )
j/0 j/0 1 2 n
n
T T
2
2
j
0
0 0
T T
j 2
j j
0 0
0 0
u lim u , u , . u
1
exp u t dt u t c t dt
G
E
2
exp C t dt u t c t dt
G G

=




=









= +








( ) ( )
j
j/0 j
0 0
E
2T
u exp exp Z u
G G

=


(5.11)
Trong ( )
T
2
j j
0
E c t dt =

l nng lng ca ( )
j
c t
( )
j
c t l tn hiu nguyn t mang tin li ra ca knh
( ) ( ) ( )
T
j j
0
1
Z u u t c t dt
T
=

(5.12)

( )
j
Z u c gi l tch v hng ca
( )
u t v
( )
j
c t
5.2.2.2. Quy tc ti u vit theo cc tham s ca th hin tn hiu.
Dng quy tc hp l ti a
( )
( )
/0
i/0
u
1
u
i l

>

l
i =1, m
Vi . Ly
e
log hai v:

( ) ( )
/0 i/0
ln u ln u 0 >
l


( ) ( )
/0 i/0
ln u ln u >
l
(*)
Thay (5.11) vo (*) ta c:

( ) ( )
i
i
0 0 0 0
E 2T E 2T
Z u Z u
G G G G
i l

+ > +

l
l
i =1, m
Vi
Nhn hai v vi
0
G
2T
ta c:

( ) ( )
i
i
E E
Z u Z u
2T 2T
i l

>

l
l
i =1, m
Vi
Chng 5: L thuyt thu ti u


167
Ch rng
j j
E T P = l cng sut ca tn hiu
( )
j
c t u vo s gii.
( ) ( )
i
i
p p
Z u Z u i l
2 2
>
l
l
Vi (5.13)
Da vo quy tc gii ti u (5.13) ta s xy dng c s gia cng ti u tn hiu.
5.2.2.3. Xy dng s x l ti u tn hiu















Li gii
l
ly ra c chnh l li gii c xc sut sai b nht
T (5.12) ta v c s khi ca vic hnh thnh tch v hng
( )
i
Z u . S ny
gm 3 khi:
- To tn hiu
( )
i
c t ng vai tr nh ngoi sai
- Mch nhn ng vai tr nh bin tn
- Mch tch phn (ng vai tr nh b lc)
Ngi ta cn gi s trn l b lc phi hp ch ng (c ngun) hay cn gi l tng
quan k. Sau ny chng ta s thy c rng to tch v hng
( )
i
Z u ta c th ch dng mt
mch tuyn tnh, l b lc phi hp th ng (khng ngun)
Ch : so snh ng lc, ngi ta phi dng xung cc hp ng b m thit b so snh
vo ng thi im c
0
t T =
( )
1
Z u
X

( )
1
c t

T
0
1
T

1
p 2
( )
m
Z u
X

( )
m
c t


T
0
1
T

m
p 2
( )
1
Z u
( )
m
Z u


Thit
b
so
snh
( ) u t

( )
p
Z u
2

l
l


l

Xung cc hp d
ng b
0
t T =

Hnh 5.1: S gia cng ti u tn hiu.
Chng 5: L thuyt thu ti u


168
5.2.3. Khi nim v thu kt hp v thu khng kt hp
5.2.3.1. H c khong ngh ch ng.
trn ta gii bi tan thu ti u cc tn hiu c cc tham s bit (tc l xc nh c
mt cch chnh xc bin , tn s, pha ban u v , const = ). Thc t gi thit
, const = khng ph hp v , l cc tham s ca knh ph thuc rt nhiu vo cc yu t
ngu nhin.
Khi thay i th
( )
i
Z u s thay i t l vi cn
i
p s thay i t l vi
2
. V vy
m bo c quy tc gii (5.13) ta cn c mch t ng hiu chnh b li s thay i ca
(v d dng mch TK (APY)).
Khi thay i s lm cho gc thi gian thay i gy ra s khng ng b gia
( )
i
c t v
( )
u t . thc hin c s ng b gia
( )
i
c t v
( )
u t ta phi dng h thng TT (ATIY).
c th trnh c s phc tp ca thit b khi phi dng thm TK khi thay i
ngi ta chn cc tn hiu c cng sut trung bnh nh nhau, tc l
i j
p p = vi i, j 1, m = .
Lc quy tc gii s l:
( ) ( )
i
Z u Z u i >
l
l (5.14)
S gii lc ny s rt n gin v ngay c khi thay i ta cng khng phi dng thm
mch TK (Hnh 5.2)









H thng c
( )
i j
p p i, j 1, m = = c gi l h thng c khong ngh ch ng.
5.2.3.2. nh ngha thu kt hp v thu khng kt hp
Tn hiu tng qut c dng:
( ) ( ) ( ) ( )
i 0i 0
C t C t cos t t = + +
( )
1
Z u
( )
m
Z u

Thit
b
so
snh
( ) u t

0
t T =
Hnh 5.2:
( )
2
Z u
Chng 5: L thuyt thu ti u


169
Khi gia cng ti u tn hiu ta cn bit ng bao
( )
0i
C t v tn s tc thi
( )
( )
i
d t
t
dt

= + .
Nu vic thu
( )
i
C t cn bit
0
( iu chnh h thng thu) th c gi l thu kt hp.
Nu vic thu
( )
i
C t khng cn bit
0
( iu chnh h thng thu) th c gi l thu
khng kt hp.
Thc t khi thay i s lm cho
0
thay i. ch bin thin t nhng cng lm cho
0
thay i rt mnh. Khi ta phi chuyn sang thu khng kt hp.
5.3. PHT TN HIU TRONG NHIU NH B LC PHI HP TUYN TNH
TH NG.
5.3.1. nh ngha b lc phi hp tuyn tnh th ng
nh ngha: i vi mt tn hiu xc nh, mt mch tuyn tnh th ng m bo t s
ra
ra
S
N

=


cc i mt thi im quan st no y s c gi l mch lc phi hp tuyn
tnh th ng ca tn hiu .
Sau ny gn ta ch gi l b lc phi hp.
Trong
ra
l t s gia cng sut nh ca tn hiu v cng sut trung bnh ca nhiu
u ra b lc y.
5.3.2. Bi ton v b lc phi hp
5.3.2.1. Ni dung bi ton.
Cho u vo mt mch tuyn tnh th ng mt dao ng c dng:

( ) ( ) ( )
i
y t C t n t = +
( )
i
C t l th hin ca tn hiu pht i (cn c gi l tn hiu ti)
( )
n t l nhiu cng, trng, chun
Hy tng hp mch n c hm truyn sao cho mt thi im quan st
( )
y t no ,
ra
ca n phi cc i.
5.3.2.2. Gii bi ton.
Thc cht bi ton ny l bi ton tng hp mch (ngc vi bi ton phn tch mch) m
ta hc gio trnh "L thuyt mch ". Nhim v ca ta l phi tm biu thc gii tch ca
Chng 5: L thuyt thu ti u


170
hm truyn phc
( )
i
K ca mch tuyn tnh th ng sao cho mt thi im quan st (dao
ng nhn c) no
ra
t max.
Gi
( )
iv
S l mt ph (bin) phc ca th hin tn hiu u vo mch tuyn tnh.
Gi
( )
ira
S l mt ph phc ca th hin tn hiu u ra ca n.
Khi theo cng thc bin i ngc Fourier th hin tn hiu u ra ca mch tuyn tnh
th ng ny l:

( ) ( ) ( )
( ) ( )
j t j2 t
ira ira ira
j2 t
iv i
1
C t S e d S 2 e d
2
S 2 K 2 e d


= =

f
f
f f
f f f

Trong :
( ) ( ) ( )
ira iv i
S 2 S 2 K 2 = f f f
Cng sut nh ca tn hiu u ra ca mch:
( ) ( ) ( )
0
ira
2
2
j2 t
c ira 0 iv i
p C t S 2 K 2 e d

= =

f
f f f
( )
ira 0
C t l gi tr nh ca tn hiu
Theo gi thit v can nhiu l tp trng nn mt ph cng sut ca n s l
0
N const =
(
0
N bng
1
2
mt ph cng sut thc t, v ph thc t ch c t 0 ). Do cng sut
trung bnh ca tp u ra ca mch ny s l:
( ) ( )
ra
2 2
2
n n 0 i 0 i
p N K 2 d N K 2 d


= = =

f f f f
y ta p dng nh l Parseval:

( ) ( )
2
1
x t dt S d
2


=



Ta xt t s:
ira
ra
c
ra
n
p
p
=
Chng 5: L thuyt thu ti u


171

( ) ( ) ( )
( )
2
iv i 0
ra
2
0 i
S 2 K 2 exp j2 t d
N K 2 d

f f f f
f f
(5.15)
Vn y l phi xc nh
( )
i
K 2f trong (5.15) nh th no
ra
t max.
gii quyt vn ny ta c th dng nhiu phng php, y ta s dng bt ng thc
Byhakobckuu Schwartz:
( ) ( ) ( ) ( )
2
2 2
F x x dx F x dx x dx




(5.16)
ng thc (5.16) ch c khi:
( ) ( )
*
x kF x = (5.17)
Trong :
( ) ( )
x , F x l cc hm phc bin thc

( )
*
F x l hm lin hp phc ca
( )
F x
k l h s t l
Trong (5.15) nu cho
( )
0
j2 t
iv
S 2 e

f
f ng vai tr
( )
F x , cn
( )
i
K 2f ng vai tr
nh
( )
x trong (5.1).
Khi p dng (5.16) cho (5.15) ta c:

( ) ( ) ( )
( )
2 2
iv 0 i
ra
2
0 i
S 2 exp j2 t d K 2 d
N K 2 d

f f f f f
f f

( )
0
2
j2 t
ra iv
0
1
S 2 e d
N

f
f f
( )
2
i
ra iv
0 0
1 E
S 2 d
N N

f f nh l Parseval (5.18)
(5.18) chng t
i
ra max
0
E
N
= (5.19)
Chng 5: L thuyt thu ti u


172
trong ( )
2
i iv
E S 2 d

f f l nng lng ca tn hiu ti (5.19) chng t t s


ra
S
N



ch ph thuc vo nng lng ca tn hiu m hon ton khng ph thuc vo dng ca
n. Ta bit rng xc sut pht hin ng ch ph thuc vo
ra
S
N



. V vy theo quan im ca
bi ton pht hin dng ca tn hiu l khng quan trng. (Ch khi cn o lng cc tham s ca
tn hiu nh tz, F . ( dch tn) th chnh xc ca php o v kh nng phn bit ca h
thng o s ph thuc mnh vo dng tn hiu).
Theo (5.17)
ra
ch t max khi:
( ) ( ) { }
0
*
iv i
t 2 j exp 2 kS 2 k f f f = (5.20)
(5.20) chnh l p s c bi ton ta nu ra trn. Nh vy bi ton gii xong.
thy r c ngha vt l k thut ta s xt k (5.20) hn na.
5.3.3. c tnh bin tn v c tnh pha tn ca b lc phi hp
5.3.3.1. c tnh bin tn.
T (5.20) ta c ( ) ( ) f f = 2 S k 2 k
*
iv i
(5.21)
(5.21) l biu thc gii tch ca c tnh bin tn ca b lc phi hp, ta thy n c dng
ging ht modul mt ph ca tn hiu. iu c ngha l khi cho tn hiu ti th c tnh
ca mch tuyn tnh cn tng hp s do mt ph phc ca tn hiu quyt nh.
Ngoi ra t hnh 5.3 ta cn thy: b lc phi hp s lm suy gim cc thnh phn ph tn
hiu v tp m ng vi nhng phn c cng nh ca ph tn hiu. nhng khong tn s m
cng cc thnh phn ph ca tn hiu cng nh th s suy gim cng ln.









0
N 2
n
F

2
k

k
3
2

v
S
Hnh 5.3


Chng 5: L thuyt thu ti u


173
5.3.3.2. c tnh pha tn.
Ta vit li (5.20) nh sau:
( ) ( )
( )
( )
( )
= =
j *
iv
t j j *
iv i
e S k e e S k k
0 xi
(5.22)
trong ( )
xi
l ph pha ca tn hiu ti.
Cn ( ) ( ) [ ]
0 xi
t + = (5.23) l dch pha gy bi b lc. chnh l c tnh pha tn
ca b lc phi hp. Ta thy ( ) [ ]
0 xi
t + l dch pha ton phn ca tn hiu ti thi im quan
st
0
t . Nh vy ti thi im
0
t t = dch pha ton phn ca b lc va vn kh c dch pha
ton phn ca tn hiu truyn ti qua b lc, iu lm cho mi thnh phn dao ng iu ha
ca tn hiu ti ng pha vi nhau. V vy cc thnh phn dao ng iu ha c cng li vi
nhau v tn hiu ra s t c cc i
0
t t = .
Ngoi ra t (5.20) ta thy b lc phi hp c tnh cht bt bin i vi bin v thi gian
v pha u ca tn hiu. Bi v cc tn hiu khc vi ( ) t x
i
v bin v pha ban u
( )
1 1 1
, t , th mt ph ca tn hiu ny ch khc nhau vi mt ph ca ( ) t x
i
mt tha
s ( ) { }
1 1 1
t j exp + . Tnh cht ny ca b lc phi hp rt quan trng v c bit l i
vi thc t. Thc vy, thng thng bin , s gi chm v pha ban u ca tn hiu thu ta
khng bit. Nh vy ng l phi xy dng mt s ln cc b lc m mi b lc ch lm ti u
cho mt tn hiu c gi tr bin , s gi chm v pha ban u c th th ta ch cn mt b lc
phi hp tuyn tnh th ng, b lc ny s l ti u cho mi tn hiu cng dng. Trong raar
thng thng cc tham s nh bin v pha ban u nhn cc gi tr ngu nhin v khng may
thng tin c ch (c ngha l cc tham s k sinh). T kt lun trn ta thy rng s tn ti ca cc
tham s ngu nhin ny khng lm bin i cu trc ca b lc ti u.
5.3.4. Phn ng xung ( ) t g
i
ca mch lc phi hp
Ta bit rng phn ng xung v hm truyn lin h vi nhau theo cp bin i Fourier:
( ) ( )

= d e K
2
1
t g
t j
i i

Thay (5.20) vo:
( ) ( )

= d e e S
2
k
t g
t j t j *
iv i
0

( ) ( )
( )

= d e S
2
k
t g
t t j *
iv i
0

Ta c: ( ) ( ) =
i
*
iv
S S
Chng 5: L thuyt thu ti u


174
( ) ( )
( )( )

= d e S
2
k
t g
t t j
iv i
0

t
( ) ( )
( )
( )

= = ' d e ' S
2
k
t g '
t t ' j
iv i
0

( ) ( ) t t kC t g
0 iv i
=
V k l hng s ty nn ta c th ly:
( ) ( ) t t kC t g
0 iv i
= (5.23)
th ( ) t g
i
v trn hnh 5.4.
T hnh 5.4 ta thy rng tha mn iu kin th
hin c b lc:
( ) 0 t g
i
= khi 0 t < nn T t
0

5.3.5. Hng ng ra ca mch lc phi hp
Theo tch phn Duhamen:
( ) ( ) ( )

=
t
0
v ra
dx x t g x U t U
Thay (5.23) vo ta c:
( ) ( ) ( )

+ =
t
0
0 iv v ra
dx x t t C x U k t U
( ) ( ) ( ) ( ) ( )

= = =
t
0
iv v
t
0
iv v 0 ra 0
dt t C t U k dx x C x U k t U t t
Nu ly
0
t t = v
T
1
k = th ta c:
( ) ( ) ( )

=
T
0
iv v ra
dt t C t U
T
1
T U
( ) ( ) u Z T U
i ra
= (5.24)
Nh vy ta c th dng mch lc phi hp to ra tch v hng. S gii ti u nh
s n gin hn rt nhiu.
T t
0
<
( ) t C
iv

( ) t t C
0 iv

t
t
( ) t C
iv

T
t
T t
0
<
( ) t t C
0 iv

t
Hnh 5.4
Chng 5: L thuyt thu ti u


175
5.4. L LUN CHUNG V THU KT HP CC TN HIU NH PHN
5.4.1. Lp s gii ti u mt tuyn
5.4.1.1. Lp quy tc gii.
Xt mt ngun tin nh phn: " 1 "
1
v " 0 "
2
.
Khi tn hiu s c hai th hin ( ) t S
1
v ( ) t S
2

Ta gii hn ch xt nhiu cng v l tp m trng, chun dng.
Tn hiu u vo my thu: ( ) ( ) ( ) 2 , 1 i , t n t C t u
i
= + =
ng vi quy tc gii theo Kachennhicov ta s nhn c li gii ng
1
, nu:
( ) ( ) ( ) ( )
2
P
dt t C t u
T
1
2
P
dt t C t u
T
1
2
T
0
2
1
T
0
1
>

(*)
lp dc s mt tuyn ta a (*) v dng sau:
( ) ( ) ( ) [ ] ( )
2 1
T
0
2 1
P P
2
1
dt t C t C t u
T
1
>

(5.25)
( )
2 1
P P
2
1
c gi l ngng lm vic
5.4.1.2. S gii ti u mt tuyn. (hnh 5.5)






Nu
( )
v ng 1 2
1
U P P
2
> th
ra ng
U 0 , khi ta xem rng c li gii
1
v
1
.
Nu
( )
v ng 1 2
1
U P P
2
< th
ra ng
U 0 = , khi ta xem rng c li gii
2
v
2
.
Ch :
- Nu
1 2
P P m (hm truyn t ca ng truyn) thay i th ta phi c thit b t
ng iu chnh ngng. Nu khng th xc sut gii sai s tng ln.
0
t t =
ng ra
U
ng v
U
Hnh 5.5
X
So snh
vi ngng
( ) t C
1

( ) t C
2

T
0
T
1
Chng 5: L thuyt thu ti u


176
- Nu
1 2
P P = th ta khng cn phi c thit b so snh t ng iu chnh ngng. Khi
ta s dng b phn bit cc. Ta quy c rng:
+
ra ng
U 0 > th c li gii
1 1

+
ra ng
U 0 < th c li gii
2 2

Nu gi
( ) ( ) ( )
1 2
C t C t C t

= l tn hiu s th khi dng b lc phi hp vi tn hiu


( )
C t

thit b s n gin i rt nhiu (hnh 5.6.)







5.4.2. Xc sut sai khi thu kt hp tn hiu nh phn
5.4.2.1. t bi ton
Cho knh nh phn, i xng, khng nh c nhiu cng, trng, chun theo m hnh sau:








Hy tm cng thc biu din xc sut sai ton phn (xc sut sai khng iu kin) ca knh
ny khi s gii tn hiu l ti u theo Kopennhicop.
5.4.2.2. Gii bi ton
Theo cng thc xc sut y :
( ) ( ) ( ) ( )
s 1 2 1 2 1 2
p p .p / p .p / = +
tm xc sut sai ca h
s
p , ta phi tm xc sut sai ca mi du
( )
2 1
p / v
( )
1 2
p / .
Tm
( )
2 1
p / :
0
t t =
Hnh 5.6.
Thit b
ngng
B lc phi hp
vi
( )
C t


u(t)
1

2

2

1

( )
1 1
p /
( )
2 2
p /
( )
1 2
p /
( )
2 1
p b /
( )
1
1
p
2
=
( )
2
1
p
2
=
Chng 5: L thuyt thu ti u


177
- Theo quy tc gii (5.25),
( )
2 1
p / chnh l xc sut khng tho mn (5.25), tc l:
( ) ( ) ( ) ( ) ( )
T
2 1 1 2 1 2
0
1 1
p / p U t C t C t dt P P
T 2


= <



(5.26)
Trong :
( ) ( ) ( )
1
U t C t n t = + (*)

( )
T
2
i i
0
1
P C t dt
T
=

(**)
Thay (*) v (**) vo (5.26), sau mt vi bin i n gin, ta c:
( ) ( ) ( ) ( ) ( ) ( ) ( )
( ) ( )
T T T
2
2 1 1 1 2 1 2
0 0 0
T T
2 2
1 2
0 0
1 1 1
p / p C t dt C t .C t dt n t C t C t dt
T T T
1 1
C t dt C t dt
2T 2T

= +

<




( ) ( ) ( ) ( )
T T
2
2 1
0 0
1 1
p / p n t .C t dt C t dt
T 2T



= <




(5.27)
Trong :
( ) ( ) ( )
1 2
C t C t C t

= .
( )
T
2
0
1
P C t dt
T

=

l cng sut trung bnh ca tn hiu hiu s.
( ) ( )
T
0
1
n t .C t dt
T

=

l mt i lng ngu nhin, v n(t) l mt qu trnh ngu nhin
v tch phn l mt php bin i tuyn tnh.

( )
2 1
1
p / p P
2


= <


(5.28)
Theo nh ngha xc sut:

( )
1
P
2
1
p P W d
2


< =



(5.29)
Chng 5: L thuyt thu ti u


178
tm
( )
W , ta thy rng php bin i tuyn tnh ca mt qu trnh chun cng l mt
qu trnh chun. V n(t) chun nn cng chun. Do
( ) ( )
W W n = .

( )
2
2
2
a
1
W exp
2
2



(5.30)
Trong :
( ) ( ) ( ) { } ( )
T T
0 0
1 1
a M n t C t dt M n t C t dt
T T



= =





V M{n(t)} = 0 nn a 0

= .
Xc nh phng sai:
2

:

[ ] ( ) ( ) ( ) ( )
( ) ( ) ( ) ( )
( ) ( ) ( ) ( )
2
T T
2
2
0 0
T T
1 1 1
2
0 0
T T
1 1 1
2
0 0
1 1
D D n t C t dt M n t C t dt
T
T
1
M n t C t dt . n t C t dt
T
1
M C t C t n t n t dt dt
T







= = =







=





=








( ) ( ) ( ) ( ) { }
T T
1 1 1
2
0 0
1
C t C t M n t n t dt dt
T

=

(a)
Theo gi thit n(t) l tp m trng, chun, dng, dng bin i Wiener Khinchin, ta tnh
c hm t tng quan ca n:

( ) ( ) { } ( ) ( )
1 1 0 1
M n t n t R t t N t t

= = (b)
Vi
( )
( )
1
j t t
1 0
R t t N .e

=


Th (b) vo (a), ta c:

( ) ( ) ( )
T T
2
0
1 1 1
2
0 0
N
C t C t t t dt dt
T

=

(c)
Chng 5: L thuyt thu ti u


179
p dng tnh cht sau ca hm :

( ) ( ) ( )
b
0 0 0
a
f x x x dx f x khi a x b = < <


ta c:
( ) ( ) ( )
b
1 1 1
a
C t t t dt C t

=

(d)
Thay (d) vo (c), ta c:

( ) ( ) ( ) ( )
T T T
2 2
0 0
1 1 1
2 2
0 0 0
N N
C t dt C t t t dt C t dt
T T

= =



2
0
N P
T

= (5.31)
Thay (5.31) vo (5.30):

( )
2
0
0
1
W exp
N P
N P
2
2
T
T


(5.32)
Khi xc sut sai khi truyn dn
1
s bng:

( ) ( )
1
P
2
2 1
1
P
2 2
0
0
1
p / p P W d
2
1
exp d
N P
N P
2
2
T
T



= < = =



= =


i bin: t
0
N P
T

=

( )
0
P T
4N
2
2 1
0
P T 1
p / exp d
2 2G
2



= =

(*)
Chng 5: L thuyt thu ti u


180
Trong
0 0
G 2N = l ph cng
sut thc t.
( )
gi l hm xc sut sai (cn k
hiu l erf).
Trong gio trnh L thuyt xc sut, ta
c:
( ) ( )
x 1 x = . Nn ta c:
( )
2 1
0
P T
p / 1
2G


=




(5.33)
Tng t:
( )
1 2
0
P T
p / 1
2G


=



(5.33)
s
0
P T
p 1
2G


=



(5.34)

th biu din (5.34) v trn hnh 5.8.
Thng thng T l xc nh v khi thit k h
thng truyn tin ngi ta thng cho trc tc
truyn tin. gim nh
s
p ngi ta gim nh
0
G bng cch dng cc b khuch i tp m
nh (khuch i tham s, khuch i lng t,...)
5.4.2.3. Tnh xc sut sai trong mt s trng
hp c th
a. Cc tn hiu i cc:
( ) ( )
1 2
c t c t =
0
0
N 2
T P

1 0 1 2 3
4
0,5
0,2
0,1
0,05
0,02
10
2
10
3
10
4
10
5
10
6
P
S
Hnh 5.8
0

a = 0
2
1

=
0
P T
2G

Hnh 5.7.
Chng 5: L thuyt thu ti u


181











( ) ( ) ( ) ( )
1 2 1
C C t C t C t 2C t

= =
1 2 c
P 4P 4P 4P

= = =
1 2
c
P P
P
2
+
= l cng sut trung bnh ca tn hiu ti
( )
i
C t .

( )
c
s s
0
4P T
p 1 p 1 2 h
2G

= =



(5.35)
Trong
c
P T l nng lng ca tn hiu.

c
0
P T
h
G
= (chnh l t s tn/tp)
b. Cc tn hiu trc giao (theo ngha hp)
nh ngha: Hai tn hiu c gi l trc giao theo ngha hp, nu:
( ) ( )
T
1 2
0
C t C t dt 0 =










Khi :
( ) t C
2
0
t
( ) t C
1
T
0
t
( ) t C
2

T
0
t
( ) t C
1
T
0
t T
0
t
( ) t C
1
0
t
( ) t C
2
( ) t C
2

0
t
( ) t C
1

T
0
t
Chng 5: L thuyt thu ti u


182

( ) ( ) ( )
T T T
2 2 2
1 2
0 0 0
P C t dt C t dt C t dt

= = +



1 2 c
P P P 2P

= + =

c
s
0
2P T
p 1
2G

=





( )
s
p 1 h = (5.36)
c. Mt trong hai tn hiu trit (
( )
2
C t 0 = )
H ny chnh l h truyn tin nh phn c khong ngh th ng.

( ) ( )
1 1 c
C t C t P P 2P

= = =

( )
s
p 1 h = (5.37)
d. Cc tn hiu nh nhau (
( ) ( )
1 2
C t C t = )
( ) ( )
s smax
1 1
C t 0 P 0, 0 p p
2 2

= = = = =
Nh vy, vic lp li cc tin b sai hon ton: knh lin lc b t. M hnh knh trong
trng hp ny nh sau:






Ch :
y ta coi
1 2
c
P P
P
2
+
= .
5.5. X L TI U CC TN HIU C THAM S NGU NHIN THU KHNG
KT HP
5.5.1. Cc tham s ca tn hiu l cc tham s ngu nhin
Do chu tc ng ca nhiu yu t ngu nhin nh nhit , m, p sut, in p ngun...
nn:
1

2

2

1

0,5
0,5
0,5
0,5
Chng 5: L thuyt thu ti u


183
- Trng thi ca cc khu ca mch truyn tin lun thay i.
- Cc tham s vt l ca knh lun thay i
( )
, ,...
- V vy cc tham s ca tn hiu phi l cc tham s thay i ngu nhin.
5.5.2. X l ti u cc tn hiu c tham s ngu nhin bin thin chm
Ta gi mt tham s ngu nhin l bin thin chm nu trong khong quan st T, cc bin
thin ca n cha kp bc l r rng, tc l: d / dt 0 .
Ta s xt mt s trng hp c th sau:
a. Nu cc tham s ngu nhin bin thin chm c cc gi tr bit trc th ta s cn c vo
tn hiu nguyn t va nhn c thng bo nhng hiu bit v gi tr ca cc tham s ca tn
hiu nguyn t s thu tip sau. Thc cht bi ton ny xt trn (thu kt hp).
b. Nu gi tr ca cc tham s ngu nhin bin thin chm khng bit trc (thu khng kt
hp) th s gii ti u phi c nhng thay i c bn. Sau y ta s xt trng hp ny.
5.5.3. Xc sut hu nghim ca tn hiu c cc tham s thay i ngu nhin
n gin, ta ch gi s mt trong nhng tham s
i
ca tn hiu
( )
K 1 2
C , ,..., t l
ngu nhin. u thu tt c cc s cn li u bit chnh xc. Gi s tham s ngu nhin ny
l
1
. Khi tn hiu th K c tham s
1
khng bit s k hiu l
( )
1
K,
C t

. Trong trng
hp tng qut, lut phn b ca
1
c th ph thuc vo ch s k. V vy tnh cht thng k ca
tham s ny c xc nh bi phn b ng thi sau:
( ) ( ) ( )
K 1 K 1 K
W C , p C W / C = (5.38)
Trong :
( )
1 K
W / C l mt xc sut ca tham s
1
khi bit gi tr
K
C . Nu
gi tr ca
1
k (iu ny thng xy ra trong thc t) th:
( ) ( ) ( )
K 1 K 1
W C , p C W = (5.39)
Cng nh trong trng hp tn hiu bit hon ton chnh xc, ta c th tm xc sut hu
nghim ca
( )
1
K,
C t

theo cng thc:


( ) ( ) ( )
K 1 K 1 K 1
W C , / u bW C , W u / C , = (5.40) (Cng thc Bayes)
Trong b = const
( )
k .
( )
K 1
W u / C , l mt xc sut ca dao ng nhn c nu truyn tn hiu
( )
1
K,
C t

:
Chng 5: L thuyt thu ti u


184
u(t) =
( )
1
K,
C t

+ n(t)
Ta thy hm
( )
K 1
W C , / u khng ch cha thng tin v tn hiu pht
K
C m cn cha
c thng tin v
1
, l nhng thng tin tha. Ta c th b nhng thng tin tha ny bng cch
ly trung bnh
( )
K 1
W C , / u theo mi gi tr c th c ca
1
. Khi ta c:
( ) ( ) ( ) ( )
( )
1
K K 1 1 K 1 K K, 1
p C / u W C , / u d b.p C W / C W u / C d

= =


(5.41)
Sau trn c s phn tch xc sut hu nghim
( )
K
p C / u , ta s tm c li gii v tn
hiu pht:
( ) ( )
K i
p C / u p C / u i k > (5.42)
Nu tn hiu c mt s tham s ngu nhin
1 2
, ,... th ta cn phi tm
( )
1 2
K, , ,...
W u / C

v sau ly trung bnh theo mi gi tr c th c ca cc tham s
1 2
, ,... . Ch rng tnh cht thng k ca cc tham s
1 2
, ,... c xc nh bng hm:
( ) ( ) ( )
K 1 2 K 1 2 K
W C , , ,... p C .W , ,... / C =
Ta c:
( ) ( ) ( )
( )
1 2
K K 1 2 K K, , ,... 1 2
p C / u b' .p C ... W , ,... / C .W u / C d d ...

=


(5.43)
( )
K
p C l xc sut tin nghim ca tn hiu pht
K
C .
5.5.4. X l ti u cc tn hiu c pha ngu nhin
cc nh cu trc ca my thu ti u, ta s phn tch (5.41) c k n quy tc gii (5.42).
Gi s rng cc tn hiu pht c thi hn T v pha u thay i ngu nhin:

( ) ( ) ( )
( ) ( ) ( ) ( )

=

= +
K, K K
K K K K
C t A t cos t
A t cos t cos A t sin t sin


( ) ( )
K K
C t cos C t sin

= + (5.44)
Trong
( ) ( ) ( )
K K K
C t A t cos t = ,
( )
K
C t

l bin i Hilbert ca
( )
K
C t .
Chng 5: L thuyt thu ti u


185

( )
( )
K
K
C
1
C t d
t

.
( )
K
A t v
( )
K
t l bao v pha tc thi ca tn hiu
( )
K
C t . Gi s l tham s ngu
nhin k v c phn b u:

( )
( )
( )
1
0, 2
2 W
0 0, 2


Gi thit trn c ngha l pha trong khong (0,T) c gi khng i v thay i ngu
nhin mt cch lp khi chuyn t khong quan st ny sang khong quan st khc.
Trc tin ta s xc nh
( ) ( ) ( ) ( )
K, K,
W u / C W n' t u t C t


= =

.
phn 5.2 ta c:

( )
( )
( )
j
c
n
2
' '
n 1 n j K,
2F T 2
j 1
1 1
W n ,..., n / 0 exp U C
2
2

=


=


Trong :
c
n 2F T = .
tm
( )
K,
W u / C

ta cho
c
F
( ) ( )
( )
( )
c
c
' '
K, n 1 n
F
n
2
j Kj
n 2
F
j 1 c
W u / C lim W n ,..., n / 0
1 1
lim exp U C t
2 2F
2

=
= =


=


Trong
2
0
c c
1
t ; G
2F F

= = . Khi
c
F th t 0 .
( )
( )
( ) ( )
T
2
K, K,
n
0
0
1 1
W u / C exp U t C t dt
G
2




=




( )
( ) ( ) ( )
K
0
E
T
G
K, 1 K K
0
0
2
W u / C b .e .exp U t C t cos C t sin
G




= +



(5.45)
Chng 5: L thuyt thu ti u


186
( )
T
2
K K,
0
E C t dt


Nhn t
1
b cha tt c nhng i lng k .
Bin i tch phn m ca nhn t hm m, ta c:

( ) ( ) ( ) ( ) ( )
T T
K K
0 0
K K
q k, cos U t C t dt sin U t C t dt
U cos V sin

= + =
= +


K hiu
( )
2 2
K K K K K K
M U V , arctg V / U = + = (5.46)
Ta c th vit:
( ) ( )
K K
q k, M cos = (5.47)
Theo (5.41) ta tm c:

( )
( )
( )
K K
K 0 0
2
2
M cos
E G G K
K 1
0
p C
p C / u b . .e e d
2

= =




( )
K 0
E G
K
2 K 0
0
2M
b .p C e I
G


=


(5.48)
Trong
( )
0
I x l hm Bessel bin dng cp 0, l mt hm n iu tng ca x.
thun tin, chng ta s khng so snh cc
( )
K
p C / u m s so snh logarit t nhin
ca chng. Ly ln (5.48) v p dng quy tc gii, chng ta s nhn c quy tc gii sau:
Tn hiu
( )
K
C t c pht i, nu:
( ) ( )
K K i i
K 0 i 0
0 0 0 0
E 2M E 2M
lnp C lnI lnp C lnI i k
G G G G

+ > +



(5.49)
Nh vy quy tc gii khng ch ph thuc vo mc nhiu m cn ph thuc vo cc tnh
cht ca cc tn hiu. Thng thng, trong cc h thng thc t c khong ngh ch ng tt c
cc tn hiu pht c nng lng nh nhau. Gi s cc tn hiu l ng xc sut, khi quy tc gii
ca my thu ti u c th vit di dng sau:

K i
M M i k > (5.49)
Chng 5: L thuyt thu ti u


187
R rng l tin cy ca vic truyn cng cao nu trong iu kin khng c nhiu
i
M v
K
M cng khc nhau. Theo (5.46), gi tr
i
M s t cc tiu bng 0 nu:

( ) ( ) ( ) ( )
T T
K i K i
0 0
C t C t dt 0; C t C t dt 0

= =

(5.50)
Cc tn hiu tho mn (5.50) s c gi l cc tn hiu trc giao theo ngha cht. Cc tn
hiu , cc tn hiu khng giao nhau v thi gian,... l cc tn hiu trc giao theo ngha cht.
Nh vy, khi pha bt nh, cc tn hiu trc giao theo ngha cht s l cc tn hiu ti u.
n gin, ta s v s gii theo (5.49).



















5.5.5. So snh thu kt hp vi thu khng kt hp
c th, ta xt vn ny trong cc h thng tin dng tn hiu hai phn, trc giao (cht),
c ngh ch ng. Vi gi tr cho ca
c 0
h E / G = , xc sut sai khi thu khng kt hp s
c tnh theo cng thc sau:
m
M
2
M
1
M
( ) ( )


=
T
0
1
1
dt t c t u V
( ) ( )

=
T
0
1 1
dt t c t u U
X

( )
1
c t

T
0

Quay pha 90
0

Tch
sng
ng
bao
( ) u t
xung ng b
0
t T =

Hnh 5.9
X
X

T
0

X
My pht
cc dao
ng ph

+



Thit
b
so
snh
t sin
t cos
Chng 5: L thuyt thu ti u


188
2
s
1 h
p exp
2 2


=



(5.51)
Ta thy:

( )
2
s k kh s kh
1 h
p exp p 1 h
2 2


= > =




V d1:
Khi h = 3:
3
s kh
p 1,15.10

;
3
s k kh
p 5,55.10

. Do khi chuyn t thu kt hp


sang thu khng kt hp,
s
p tng # 5 ln (h=3).
Thng thng khi thit k h thng truyn tin ngi ta n nh trc
s
p ri tm h m
bo
s
p .
V d 2:
Nu
4
s
p 10

= :
kh
h 3, 73 = ;
k kh
h 4,12 = . V
2
c
h ~ P nn khi chuyn t thu kt hp
sang thu khng kt hp cng sut ca tn hiu phi tng mt lng l
2
4,12
1, 21
3, 73




ln.
Vy gi nguyn xc sut sai
4
s
p 10

= khi thu khng kt hp, phi tng 21% cng sut


so vi thu kt hp. Ngi ta vn dng cch thu khng kt hp v thu kt hp i thit b phc tp
v thc hin k thut cng phc tp. Do v mt kinh t, xt n cng thu khng kt hp vn
tit kim hn.
5.5.6. Ch thch
Ta khng xt x l ti u cc tn hiu c bin v tn s bin i ngu nhin v nu dng
tn hiu gii hp th bao v tn s ca n c th xem nh bit trc chnh xc.
i vi cc tn hiu gii rng th vn phi xt y hn, khi ta phi xt vic x l
ti u cc tn hiu c bin v tn s thay i ngu nhin.
5.6. M KHI KHNG GIAN , THI GIAN (STBC).
5.6.1. K thut thu phn tp.
Tn hiu nhn c my thu:
1 2
1 1 1
2 2 2
j j
1 1 2 2
y h x n
y h x n
h h e h h e

= +
= +
= =

Chng 5: L thuyt thu ti u


189
Gi s ta c thng tin y v knh (qua b nh gi knh). Khi ta c th loi b tc
ng ca knh to ra tn hiu kt hp u vo b tch hp l cc i nh sau:
1 1 2 2
x h y h y = +
( )
1 1 1 1 1 2 2 2 2 2
2 2
1 2 1 1 2 2
x h h y h n h h y h n
h h x h n h n
= + + +
= + + +




















Da trn khong cch Euclide gia x v tt c cc tn hiu pht c th c, b tch hp l
cc i s cho ra quyt nh hp l nht v tn hiu pht. Quy tc quyt nh n gin y l
chn tn hiu
1
x v ch nu :
( )
( )
i j
d x, x d x, x i j (5.52)
y d(A, B) l khong cch Euclide gia cc tn hiu A v B
T (5.52) ta thy rng tn hiu pht chnh l tn hiu c khong cch Euclide cc tiu i
vi tn hiu kt hp x
x
1
h
1 1 1
y h x n = +
2
n 1
n
1
h
x
2
h
2 2 2
y h x n = +
B nh
gi knh
B nh
gi knh
B tch hp l cc i
Hnh 5.10: K thut thu phn tp dng hai my thu
Chng 5: L thuyt thu ti u


190
5.6.2. M khi khng gian thi gian da trn hai my pht
2
G
y chnh l s STBC n gin nht do Alamouti xut (5.52) s dng hai my pht.
Ma trn pht c xc nh nh sau:
1 2
2
2 1
x x
G
x x

=


(5.53)
Vic m ha kt hp v qu trnh pht c nu trong bng sau:
Anten
Khe thi gian T
1
Tx
2
Tx
1
1
x
2
x
2
2
x
1
x
mi khe thi gian c hai tn hiu thu ng thi pht t hai anten.
V d: khe thi gian th nht
( )
T 1 = , tn hiu
1
x c pht t anten
1
Tx , ng thi
anten
2
Tx cng pht tn hiu
2
x , cc tn hiu
2
x v
1
x c ng thi pht t cc anten
1
Tx v
2
Tx ( y
1
x v
2
x l cc tn hiu lin hp ca cc tn hiu
1
x v
2
x )
5.6.2.1. STBC
2
G dng mt my thu
Gi s ta c:
( ) ( )
( ) ( )
1 1 1
2 2 2
h h T 1 h T 2
h h T 1 h T 2
= = = =
= = = =

Cc mu tp m c lp cng vo my thu mi khe thi gian v bi vy tn hiu nhn
c c th biu din nh sau:
1 1 1 2 2 1
y h x h x n = + + (5.54)
2 1 2 2 1 2
y h x h x n = + + (5.55)
1
y s nhn c trc tin, sau l
2
y






2
1
x
x

1
2
x
x

n
1
h
2
h
Chng 5: L thuyt thu ti u


191















Tn hiu
1
y cha cc tn hiu c pht
1
x v
2
x , cn tn hiu
2
y cha cc thnh phn
lin hp ca chng. xc nh cc du pht ta phi tch cc tn hiu
1
x v
2
x t cc tn
hiu nhn c
1
y v
2
y . Bi vy c hai tn hiu
1
y v
2
y phi c a qua b kt hp. B
kt hp thc hin x l tch cc tn hiu
1
x v
2
x .
c bit, tch
1
x ta kt hp
1
y v
2
y nh sau:
( )
1 1 1 2 2
1 1 1 1 2 2 1 1 2 1 2 2 2 1 2 2
2 2
1 2 1 1 1 2 2
x h y h y
h h x h h x h n h h x h h x h n
h h x h n h n
= +
= + + + +
= + + +

(5.56)
Tng t, i vi tn hiu
2
x ta thc hin nh sau:
( )
2 2 1 1 2
2 1 1 2 2 2 2 1 1 1 2 1 2 1 1 2
2 2
1 2 1 2 1 1 2
x h y h y
h h x h h x h n h h x h h x h n
h h x h n h n
= +
= + + +
= + +

(5.57)
T (5.56) v (5.57) ta c th thy rng ta tch c cc tn hiu
1
x v
2
x bng cc
php cng v nhn n gin. T tnh trc giao c trong (5.53) ta thy tn hiu khng mong mun
2
x c loi b khi (5.56) v ngc li tn hiu khng mong mun
1
x c loi b khi
(5.57).
Chng 5: L thuyt thu ti u


192
5.6.2.2. STBC
2
G dng hai my thu
my thu th nht
1
Rx ta c:
11 11 1 12 2 11
y h x h x n = + + (5.58)
12 11 2 12 1 12
y h x h x n = + + (5.59)
my thu th hai
2
Rx ta c:
21 21 1 22 2 21
y h x h x n = + + (5.60)
22 21 2 22 1 22
y h x h x n = + + (5.61)




















Tng qut ta c th dng q my thu, khi tn hiu nhn c my thu th i c dng:

i1 i1 1 i2 2 i1
i2 i1 2 i2 1 i2
y h x h x n
y h x h x n
= + +
= + +
i 1, q =
11
12
y
y

21
22
y
y
21
22
h
h
21
22
n
n
1
Tx
2
Tx
11
h
22
h
2
1
x
x

1
2
x
x

1
2
x
x


11
12
h
h

11
12
n
n

21
h
12
h
B kt hp B nh
gi knh
B tch hp l cc i
Hnh 5.12: STBC
2
G dng hai my thu
1
Rx
2
Rx
B nh
gi knh
Chng 5: L thuyt thu ti u


193
Cc tn hiu nhn c s kt hp tch cc tn hiu pht
1
x v
2
x t cc tn hiu thu
c
11 12 21 22
y , y , y , y nh sau:

1 11 11 12 12 21 21 22 22
x h y h y h y h y = + + + (5.62)

2 12 11 11 12 23 21 21 22
x h y h y h y h y = + (5.63)
Tip tc bin i ta c:
( )
2 2 2 2
1 11 12 21 22 1
11 11 12 12 21 21 22 22
x h h h h x
h n h n h n h n
= + + + +
+ + + +

(5.64)
( )
2 2 2 2
2 11 12 21 22 2
12 11 11 12 22 21 21 22
x h h h h x
h n h n h n h n
= + + + +
+ +

(5.65)
M rng cho q my thu ta c:
( )
q
2 2
1 i1 i2 1 i1 i1 i2 i2
i 1
x h h x h n h n
=

= + + +

(5.66)
( )
q
2 2
2 i1 i2 2 i2 i1 i1 i2
i 1
x h h x h n h n
=

= + +

(5.67)
Nhn xt: Trong (5.66) tn hiu
1
x c nhn vi mt thnh phn c lin quan n bin
phainh l
2 2
i1 i2
h h + . thu nhn tn hiu
1
x vi tin cy cao cc bin ca p ng
xung ca knh
ij
h phi ln. Trong (5.66) ta c th thy rng c hai thnh phn bin phaing
tc l c hai ng c lp pht cho du
1
x . Bi vy nu mt ng b suy gim th ng
cn li vn c th cung cp c
1
x vi tin cy cao.
BI TP

5.1. Ti li ra ca b khuch i trung gian ca mt my thu cc tn hiu mang iu bin c th
hin:
( ) ( ) ( ) ( ) ( )
1 1 2 2
x t .S t 1 .S t t = + + + +
Trong
( )
t l tp m chun, dng:
( ) ( ) ( )
0 0
t X t cos t Y t sin t = + , c k
vng bng khng v hm tng quan bng:
( ) ( )
2
0
B . cos

= .
Cn
( )
i i
S t, l tn hiu manp iu bin:
Chng 5: L thuyt thu ti u


194
( ) ( )
( )
1 1 m 0 1
2 2
S t, U cos t
0 t T
S t, 0
= +


Pha u
1
l mt i lng ngu nhin, phn b u trong khong
[ ]
, . Tham s
cng l i lng ngu nhin trong khong [0,T], n nhn cc gi tr
1
1 = = hoc
0
0 = = vi cc xc sut tin nghim bng:
( ) ( ) ( ) ( )
1 1 0 2
1
p p S p p S
2
= = = = . Bit rng
1
1 = = khi gi tr ng bao
u ra b tch sng tuyn tnh vt qu ngng
0
H . Trong trng hp ngc li th
0
0 = = . Tnh:
a. Ngng ti u
0
H m bo cc tiu ho xc sut sai tng cng.
b. Xc sut sai tng cng ng vi ngng
0
H .
5.2. Ti u vo b lc tuyn tnh tc ng tn hiu:
x(t) = s(t) + n(t)
Trong n(t) l tp m trng, chun, dng. Cn s(t) l xung th tn c lp vi n(t) v c
dng:
( )
( ) A t T
A.e t T
s t
0 t T


=

>


Tm hm truyn ca b lc sao cho t s tn trn tp u ra ca b lc t cc i. Tnh
( )
ra max
ra
s t
a =

.
5.3. Xc nh hm truyn ca b lc FH vi tn hiu dng:
( )
2
x
2t
S t Aexp



=





Trong
x
l thi hn ca xung mc A/e.

5.4. Tm s khi ca b lc FH vi xung th tn ch nht dng sau:
( )
x
x
A 0 t
s t
0 t , t 0

=

> <


Tnh t s tn/ tp u ra b lc ny.
Chng 5: L thuyt thu ti u


195
5.5. Chng minh rng my thu ti u m bo khong cch t vect tn hiu nhn c ti vect
tn hiu pht t cc tiu chnh l my thu ti u m bo xc sut sai b nht.
5.6. u vo mt mch tch phn RC, tc ng mt tn hiu dng:
x(t) = s(t) + n(t)
Trong n(t) l tp m trng, chun, dng c mt ph:
( )
n 0
S f G / 2 =
Cn s(t) l xung th tn ch nht dng:
( )
m x
x
U 0 t
s t
0 t 0, t

=

< >


K hiu
( )
ra max
ra
s t
a =

l t s gia gi tr cc i ca tn hiu trn gi tr trung bnh


bnh phng ca tp m u ra.
a. Tm s ph thuc gia a vi rng xung
x
v gii thng tp m ca mch
n
f .
b. Tm s ph thuc gia
x
v gii nng lng tp m ti u ca mch tr s a t max.



Ph lc


196
PH LC
BT NG THC BUNHIACOVSKI-SCHWAZT
nh l: Nu
( )
F x v
( )
x l cc hm phc tha mn iu kin:

( ) ( )
2 2
F x dx x dx


< <

( x bin thc)
th ta c:

( ) ( ) ( ) ( )
2
2 2
F x x dx F x dx . x dx





Chng minh:
t
( )
( )
( )
*
2
x
x
x dx

(a)
(Du * l k hiu lin hp phc)
v ( ) ( )
*
x F x dx

(b)
Ta c: ( ) ( ) ( ) ( ) ( ) ( )
2
* * *
F x x F x x F x x 0

=


(c)
Theo (a) ta c: ( )
2
x dx 1


Theo (b) ta c: ( ) ( )
* *
x F x dx


Khi ta c th vit li (c) nh sau:
( )
2
2
* *
F x dx 0


Ph lc


197
Hay ( )
2
2
F x dx

(d)
Thay (a) v (b) vo (d) ta c:

( )
( ) ( )
( )
2
2
2
x F x dx
F x dx
x dx


BIN I HILBERT
nh l:
Cho tn hiu
( )
s t v
( )
S j l bin i Fourier ca n. Khi tn hiu
( )
s t

c ph:

( ) ( )
j sign
2
S j S j e


=
(tt c cc thnh phn ph
( )
s t

u dch pha i mt lng bng


2

) c th biu din theo


( )
s t thng qua bin i tch phn sau:
( )
( )
s
1
s t d
t


Chng minh: Ta c:
( ) ( ) ( )
j sign
2
S j S j e S j cos sign jsin sign
2 2




= =





Trong :
1 khi 0
sign 0 0
1 0
>

= =

<



1 khi 0
cos sign 0 0
2
1 0
>


= =




<


Ph lc


198
sin sign sign
2


=



Theo bin i ngc Fourier ta c:
( ) ( ) ( )
j t j t
1 1
s t S j e d jsign S j e d
2 2




= =


(a)
( rng ( )
j t
1
S j cos sign e d 0
2 2

)
Mt khc ta c:

j
0
j
0
e cos sin
d d d
e sin sin x
d 2j d 2j sign dx
x







=

= =



_

V
sin x
dx
x 2

nn ta c:
j
e
d j

(b)
Thay (b) vo (a) ta c:

( ) ( )
( )
( )
( ) ( )
j
j t
j t
1 1 e
s t S j e d d
2
1 1
S j e d d
s t s 1 1
d d
t








=




=




= =





NH L KACHENNHICOV
nh l: Nu ph ca hm
( )
s t khng cha cc thnh phn tn s ln hn
m
F th hm
ny hon ton c xc nh bi cc gi tr mu ca n ly cc thi im cch nhau mt khong
m
1
t
2F

Ph lc


199
Chng minh:
Ta s chng t rng c th khi phc li c
( )
s t t:

( ) ( ) ( )
s t s t . t

= (hnh C.1.c) (a)

( ) ( )
n
t t n t

=
=

(hnh C.1.b) (b)



0 0 m m
0 m
1 1
t ; 2 F ; 2 F
F 2F
= = =
( )
t

l mt hm tun hon c chu k t , v vy ta c th biu din n bng chui


Fourier sau:

( )
0
jn t
n
n
t s e

=
=


trong
( )
0
t 2
jn t
n
t 2
1
s t e dt
t



Trong khong
t t
,
2 2



hm
( )
t

chnh l hm
( )
t
Do :
( )
0
t 2
jn t
n
t 2
1
s t e dt
t



Theo tnh cht lc ca ta c
n
1
s
t
=


( )
0
jn t
n
1
t e
t

=
=



Ta thy rng dy xung
( )
t

gm cc thnh phn dao ng iu ha cc tn s


0 0
0, , 2 , =
Do ta c th biu din c ph ca
( )
t

di dng sau:

( ) ( )
0
n
2
n
t

-
(Hnh C.1.e) (c)
Theo tnh cht ca bin i Fourier ph ca
( )
s t

c tnh theo tch chp sau:


Ph lc


200

( ) ( ) ( )
1
S S u u du
2


-
- -

Trong :
( )
S
-
l ph ca
( )
s t

( ) ( ) ( )
( ) ( )
0
n
0
n
1 2
S S u . n u du
2 t
1
S u . n u du
t

=


=


- -
-

Theo tnh cht lc ca ta c:

( ) ( )
0
n
1
S S n
t

=
=


- -
(Hnh C.1.f) (d)
Hnh C.1. Cc th ph v th thi gian:
















T (d) v hnh C.1 ta thy rng ph ca
( )
s t

lp li mt cch tun hon dng ph ca


( )
s t . Dng mt b lc c c tnh tn s dng ch nht l tng (ng t nt trn hnh C.1.f
ta c th khi phc li c
( )
s t )
0
2
t


( ) S


t
( ) t


t
t
s(t)
0
2
t


( ) S
m
0
m



( ) S




(a)
( ) t


t
(b)
(c)
(d)
(e)
(f)
Hnh C.1
Ph lc


201



LUT PHN B CHUN
Lut phn b xc sut: ( )
2
t
x
2
1
x e dt
2



Mt phn b xc sut: ( ) ( )
2
1 t
w x ' x exp
2 2


= =




x ( )
x
( )
w x x ( )
x
( )
w x
0,0 0,500 0,399 1,8 0,964 0,078
0,1 0,539 0,397 1,9 0,971 0,065
0,2 0,579 0,301 2,0 0,977 0,054
0,3 0,618 0,381 2,1 0,982 0,044
0,4 0,655 0,368 2,2 0,986 0,035
0,5 0,691 0,352 2,3 0,989 0,028
0,6 0,725 0,333 2,4 0,992 0,022
0,7 0,758 0,312 2,5 0,993 0,017
0,8 0,788 0,289 2,6 0,995 0,013
0,9 0,815 0,266 2,7 0,996 0,010
1,0 0,841 0,241 2,8 0,997 0,008
1,1 0,864 0,217 2,9 0,998 0,005
1,2 0,884 0,194 3,0 0,998 0,004
1,3 0,903 0,171 3,1 0,999 0,003
1,4 0,919 0,149 3,2 0,999 0,002
1,5 0,933 0,129 3,3 0,999 0,001
1,6 0,945 0,110 3,4 0,999 0,001
1,7 0,955 0,094 3,5 0,999 0,001


( )
s t ( )
s t


B lc l tng
Ph lc


202
LOGARIT C S HAI CA CC S NGUYN T 1 N 100

i
x
2 i
log x
i
x
2 i
log x
i
x
2 i
log x
i
x
2 i
log x
0,000 4,700 5,672 6,248
1,000 4,755 5,700 6,267
1,585 4,807 5,728 6,285
2,000 4,858 5,755 6,304
2,322 4,907 5,781 6,322
2,585 4,954 5,807 6,340
2,807 5,000 5,833 6,357
3,000 5,044 5,858 6,375
3,169 5,087 5,883 6,392
3,322 5,129 5,907 6,409
3,459 5,170 5,931 6,426
3,585 5,209 5,954 6,443
3,700 5,248 5,977 6,456
3,807 5,285 6,000 6,479
3,907 5,322 6,022 6,492
4,000 5,357 6,044 6,508
4,087 5,392 6,066 6,523
4,170 5,426 6,087 6,539
4,248 5,459 6,108 6,555
4,322 5,492 6,129 6,570
4,392 5,523 6,149 6,585
4,459 5,555 6,170 6,599
4,523 5,585 6,190 6,615
4,585 5,615 6,209 6,629
4,644 5,644 6,229 6,644


Ph lc


203
HM
( )
2
p = -plog P , HM
( ) ( ) ( )

2
p = - 1- p log 1- p , HM
2
log p V
ENTROPIE CA NGUN NH PHN
( ) ( ) ( )
+ H A = p p
p
2
log p
( )
p
( )
H A
( )
p
( )
2
log 1 p
( )
1 p
6,643 0,066 0,081 0,014 0,014 0,99
5,644 0,113 0,141 0,028 0,029 0,98
5,059 0,152 0,194 0,042 0,044 0,97
4,644 0,186 0,242 0,056 0,059 0,96
4,322 0,216 0,286 0,070 0,074 0,95
4,059 0,243 0,327 0,084 0,089 0,94
3,936 0,268 0,366 0,097 0,105 0,93
3,644 0,291 0,402 0,111 0,120 0,92
3,474 0,313 0,436 0,124 0,136 0,91
3,322 0,332 0,469 0,137 0,152 0,90
3,184 0,350 0,499 0,150 0,168 0,89
3,059 0,367 0,529 0,162 0,184 0,88
2,943 0,383 0,557 0,175 0,201 0,87
2,836 0,397 0,584 0,187 0,217 0,86
2,737 0,411 0,610 0,199 0,234 0,85
2,644 0,423 0,634 0,211 0,252 0,84
2,556 0,434 0,658 0,223 0,269 0,83
2,474 0,445 0,680 0,235 0,286 0,82
2,396 0,455 0,701 0,246 0,304 0,81
2,322 0,464 0,722 0,257 0,322 0,80
2,252 0,473 0,741 0,269 0,340 0,79
2,184 0,481 0,760 0,279 0,358 0,78
2,120 0,488 0,778 0,290 0,377 0,77
2,059 0,494 0,795 0,301 0,396 0,76
2,000 0,500 0,811 0,311 0,415 0,75


p
2
log p
( )
p
( )
H A
( )
p
( )
2
log 1 p
( )
1 p
Ph lc


204
1,943 0,505 0,827 0,321 0,434 0,74
1,889 0,510 0,841 0,331 0,454 0,73
1,836 0,514 0,855 0,341 0,474 0,72
1,786 0,518 0,869 0,351 0,494 0,71
1,737 0,521 0,881 0,360 0,514 0,70
1,690 0,524 0,893 0,369 0,535 0,69
1,644 0,526 0,904 0,378 0,556 0,68
1,599 0,528 0,915 0,387 0,578 0,67
1,556 0,529 0,925 0,396 0,599 0,66
1,514 0,530 0,934 0,404 0,621 0,65
1,474 0,531 0,943 0,412 0,644 0,64
1,434 0,531 0,951 0,420 0,667 0,63
1,396 0,530 0,958 0,428 0,690 0,62
1,358 0,529 0,965 0,435 0,713 0,61
1,322 0,529 0,971 0,442 0,737 0,60
1,286 0,527 0,976 0,449 0,761 0,59
1,252 0,526 0,981 0,455 0,786 0,58
1,217 0,523 0,986 0,462 0,811 0,57
1,184 0,521 0,989 0,468 0,836 0,56
1,152 0,518 0,993 0,474 0,862 0,55
1,120 0,515 0,995 0,480 0,889 0,54
1,1089 0,512 0,997 0,485 0,916 0,53
1,059 0,508 0,999 0,491 0,943 0,52
1,029 0,504 0,999 0,495 0,971 0,51
1,000 0,500 1,000 0,500 1,000 0,50





ENTROPIE H(X) CA CC LUT PHN B RI RC.

Ph lc


205
Lut phn
b
Biu thc gii tch v th Entropie H(X)
1. Phn b
u
( )
i
i
i
1
1 x m
p x k
m
0 m x 1

= =

< <







( )
H X logm =
2. Phn b
bi
( )
( )
k 1
i
i
i
p 1 p x 0
p x K
0 x 0

>
= =







( )
( ) ( ) plogmp 1 p log 1 p
H X
p
+
=

3. Phn b
nh thc
Bernoulli
( )
( )
m k
k k
m i
i
i
C p 1 p 0 x m
p x K
0 0 x m


= =

> >








( ) [
( ) ( )
( )
m 1
m k
k k k
m m
k 1
H X m plogp
1 p log 1 p
C p 1 p logC

=
=


( )
i
p x k =
i
x

1
m



0 1 2 3 . m
( )
i
p x k =
i
x






0 1 2 3 . m
( )
i
p x k =
i
x












0 1 2 3
Ph lc


206
4. Phn b
siu bi
( )
k r k
m N m
i
r
i
N
i
C C
0 x m
p x K
C
0 0 x m

= =

> >








( )
r
N
r
N
m 1
k r k k
m N m m
k 1
m 1
k r k r k
m N m N m
r
k 1 N
1
H X logC .
C
. C C logC
1
C C logC
C



=
=


5. Phn b
Poisson
( )
k
i
i
i
e x 0
p x k
K!
0 x 0

>
= =








( )
( )
k
k 1
e
H X log
e
log K!
K!

=
= +


6. Phn b
Polya
( )
( ) ( )
k
0
i
i
i
P .
1
x 0
P x K
1 ... 1 k 1
.
0 x 0

>

= =

+ +

( ) ( )
1
0
P p 0 1

= = +






( )
( )
( ) ( )
( ) ( )
k
0
k 1
1
H x' log .
.log 1 P . .
1
1 1 1 K 1
. .
K!
1 1 1 K 1
log
K!

=
+
= +


+

+

+ +

+ +



( )
i
p x k =
i
x






0 1 2 3 m
( )
i
p x k =
i
x






0 1 2 ..
( )
i
p x k =
i
x






0 1 2 3 4
Ph lc


207
ENTRIPIE VI PHN H(X) CA CC LUT PHN B LIN TC.
Lut phn
b
Biu thc gii tch v th Entropie H(X)
1. Phn b
u
( )
[ ]
[ ]
m M
M m
m M
1
x x , x
x x
W X
0 x x , x







( )
H X logm =
2. Phn b
tam gic
(Simson)
( )
( )
( )
( )
( )
[ ]
m m M
m
2
M m
M m M
M
2
M m
m M
4 x x x x
x x ,
2
x x
4 x x x x
W X x , x
2
x x
0 x x , x
+

+
=







( )
( )
M m
x x e
h x log
2

=
3. Phn b
2
sech x

( )
2
2
a a
W x sech x
2
2ch x
= =






( )
2
e
h x log
2a
=
M
x
m
x
M m
1
x x

( )
W X
x
M
x
m
x
M m
2
x x

( )
W X
x
0
a
2

( )
W X
x
Ph lc


208
4. Phn b
arcsin x
( )
( )
2 2
1 1
. x a, a
W x
a x
0 a x a

> >







( )
( )
2 2
1
2 2
0
log a x
1 1
h x log dx
a x

= + +


5. Phn b
Cauchy
( )
( )
2
2
a 1
W x .
x x a
=

+







( ) h x log4 a =
6. Phn b
Maxweel
( )
( )
2 2
2 x / 2
3/ 2
2
4
x .e x 0
W x 2
0 x 0

>

<








( )
2
1 2
h x' log Cloge
2 e

= +




C 0,5772 =
(C S Euler)





x
1
a

a a 0
( ) W X
x
1
a

x
0
( ) W X

2
4
2 e

x
0
( ) W X

Ph lc


209
7. Phn b
m mt
pha
( )
x
e x 0
W x
0 x 0

>
=

<






( )
e
h x log =


8. Phn b
Laplace
(phn b
m hai
pha)
( )
x x
W x e
2

=





( )
2e
h x log =


9. Phn b
siu m
( )
N
x
n n
n 1
a e n x 0
W x
0 x 0

>

<






( )
N
x
n n
n 1
0
N
x
n n
n 1
h x a e n .
.log a e n dx

=
=


10. Phn
b m
ly tha
( )
m
x
x
e x 0
W x
m!
0 x 0

>
=

<






( )
m
k 2
h x logm! loge e
1
mloge C
k
=
= +




C 0,5772 =
(C S Euler)
x
0
( ) W X
x
2


x
0
( ) W X
( ) W X

N
n n
1
a


x
0
m
me
m!


x
0
( ) W X

Ph lc


210
11. Phn
b Erlang
( ) ( )
a a
x
x 1
e x 0
W x a 1 !
0 x 0


>

<


a = 1, 2, 3, .







( ) ( )
( ) ( )
{ }
'
h x log a 1 ! log
a a 1 ln a loge
= +

+


( ) ( )
'
ln a a =


( )
a - Hm psi ca Euler
12. Phn
b
Pearsom
( )
( )
2
1
x
x
.e x 0
W x
0 x 0

>
=

<


( )
n
n 1, 2,3,
2
= =







( ) ( )
( ) ( )
{ }
'
h x log log
1 ln loge
= +
+


( ) ( )
'
ln =



13. Phn
b Gamma
( ) ( )
x /
1
1
x e x 0
1 W x
0 x 0

+

>

+ =

<

1 , 0 > >





( ) ( )
( ) ( )
'
h x log 1 loge.
. ln 1 1 .loge log
= +
+ + + +

( ) ( )
'
ln 1 1 + = +



a 1


( )
( )
a 1
a 1 1
e






x
0
( ) W X

a 1


( )
( )
1
1 1
e






x
0
( ) W X


( )
1
1 e



+


x
0
( ) W X

Ph lc


211
14. Phn
b Weibull
( )
1
x e x x 0
W x
0 x 0

>
=

<


0 , 0 > >





( ) ( )
1
h x loge 1 C ln
log

= + +



C 0,5772 =
15. Phn
b chun
( )
( )
2
2
x x
1
W x .exp
2 2


=










( ) h x log 2 e

=


16. Phn
b chun
mt pha
( )
2
2 2
2 x
exp x 0
W x
2
0 x 0



>

<







( )
e
h x log
2

=



17. Phn
b
Rayleigh ( )
2
2 2
x x
exp x 0
W x
2
0 x 0



>

<





( )
C
h x 1 loge
2

= +



C 0,5772 =
1 1




0
( ) W x

( ) ( )
1
1/ 1
. 1 .exp



x
x
0
( ) W x

1
2

x
0
( ) W x

n 1
( ) W x

x
1/ 2
1
e

( ) W x
0

x
Ph lc


212

18. Phn
b modul
ca i
lng
ngu nhin
phn b
chun
( )
( ) ( )
2 2
2 2
x x x x
2 2
1
e e x 0
W x
2
0 x 0
+




+ >

=

<










( )
e
h x log
2

=



19. Phn
b chun
cc
( )
( ) ( )
[ ]
[ ]
2 2
2 2
x x x x
2 2
m M
m M
1
e e x x , x
W X 2
0 x x , x
+




+

=

( ) ( ) M m
2 2
x x x x
t / 2 t / 2
0 0
1
A
1
e dt e dt
2


=










( )
( )
( )
2
M
2
2
m
2
x X
M 2
x X
m
2
2
h x log
A
1 x X 1
1 A . .e
2 2
x X 1
A . e loge
2

= +

20. Phn
b loga
chun
( )
( )
2
2
ln x a
2
1
x 0
W x
x 2
0 x 0

>
=

<





( )
a
h x log e 2 e

=


x
0
x
( ) W x

( )
2
2 x /
2
1
e
2


A
2

M
x
m
x
x
0
x
( ) W x

a
x
0
( ) W x

Ph lc


213


21. Phn
b modul
ca vct
nhiu
chiu
( )
( )
2
n 1
2
n / 2
2
x
2x exp
2
x 0
W x
n
2
2
0 x 0

>
=




<


n = 1, 2, 3,






( )
n
2
n
e
2
h x log
2
n 1 n
log
2 2




=






22. Phn
b
nakagami
( )
( )
m 2m 1 2
2m 2
2m x mx
exp x 0
W x
m
0 x 0



>

<








( )
( )
( )
m
m e
h x log
2 m
2m 1
log m
2

=




Phn b
Beta
( )
( )
( )( )
[ ]
[ ]
2
m M
4
M m
m M
m M
12
x x x
x x
W X
x x , x
0 x x , x






( )
( )
M m
x x
h x 1, 44ln
1, 26

=
0
n 1
x
( ) W x

( )
2m 1
2 2 m 2m 1
m 2e



0
2m1
x
( ) W x

m
x
0
x
( ) W x

Ph lc


214


CC A THC TI TIU CA CC PHN T TRONG TRNG
( )
m
GF 2 .
Sau y l danh sch cc a thc ti tiu nh phn cho tt c cc phn t trong cc trng
m rng ca trng nh phn t
( )
2
GF 2 ti
( )
10
GF 2 .
Cc dng k hiu c hiu nh sau: Dng 3(0, 2, 3) trong mc GF(8) tng ng vi a
thc
( )
2 3
m X 1 X X = + + c cc nghim l cc phn t lin hp
{ }
3 6 5
, , .
GF(4)
1 (0, 1, 2)
GF(8)
1 (0, 1, 3) 3 (0, 2, 3)
GF(16)
1 (0, 1, 4) 3 (0, 1, 2, 3, 4)
5 (0, 1, 2) 7 (0, 3, 4)
GF(32)
1 (0, 2, 5) 3 (0, 2, 3, 4, 5)
5 (0, 1, 2, 4, 5) 7 (0, 1, 2, 3, 5)
11 (0, 1, 3, 4, 5) 15 (0, 3, 5)
GF(64)
1 (0, 1, 6) 3 (0, 1, 2, 4, 6)
5 (1, 2, 5, 6) 7 (0, 3, 6)
9 (0, 2, 3) 11 (0, 2, 3, 5, 6)
13 (0, 1, 3, 4, 6) 15 (0, 2, 4, 5, 6)
21 (0, 1, 2) 23 (0, 1, 4, 5, 6)
27 (0, 1, 3) 31 (0, 5, 6)
GF(128)
1 (0, 3, 7) 3 (0, 1, 2, 3, 7)
5 (0, 2, 3, 4, 7) 7 (0, 1, 2, 4, 5, 6, 7)
9 (0, 1, 2, 3, 4, 5, 7) 11 (0, 2, 4, 6, 7)
13 (0, 1, 7) 15 (0, 1, 2, 3, 5, 6, 7)
M
x
Ph lc


215
19 (0, 1, 2, 6, 7) 21 (0, 2, 5, 6, 7)
23 (0, 6, 7) 27 (0, 1, 4, 6, 7)
29 (0, 1, 3, 5, 7) 31 (0, 4, 5, 6, 7)
43 (0, 1, 2, 5, 7) 47 (0, 3, 4, 5, 7)
55 (0, 2, 3, 4, 5, 6, 7) 63 (0, 4, 7)
GF(256)
1 (0, 2, 3, 4, 8) 3 (0, 1, 2, 4, 5, 6, 8)
5 (0, 1, 4, 5, 6, 7, 8) 7 (0, 3, 5, 6, 8)
9 (0, 2, 3, 4, 5, 7, 8) 11 (0, 1, 2, 5, 6, 7, 8)
13 (0, 1, 3, 5, 8) 15 (0, 1, 2, 4, 6, 7, 8)
17 (0, 1, 4) 19 (0, 2, 5, 6, 8)
21 (0, 1, 3, 7, 8) 23 (0, 1, 5, 6, 8)
25 (0, 1, 3, 4, 8) 27 (0, 1, 2, 3, 4, 5, 8)
29 (0, 2, 3, 7, 8) 31 (0, 2, 3, 5, 8)
37 (0, 1, 2, 3, 4, 6, 8) 39 (0, 3, 4, 5, 6, 7, 8)
43 (0, 1, 6, 7, 8) 45 (0, 3, 4, 5, 8)
47 (0, 3, 5, 7, 8) 51 (0, 1, 2, 3, 4)
53 (0, 1, 2, 7, 8) 55 (0, 4, 5, 7, 8)
59 (0, 2, 3, 6, 8) 61 (0, 1, 2, 3, 6, 7, 8)
63 (0, 2, 3, 4, 6, 7, 8) 85 (0, 1, 2)
87 (0, 1, 5, 7, 8) 91 (0, 2, 4, 5, 6, 7, 8)
95 (0, 1, 2, 3, 4, 7, 8) 111 (0, 1, 3, 4, 5, 6, 8)
119 (0, 3, 4) 127 (0, 4, 5, 6, 8)
GF(512)
1 (0, 4, 9) 3 (0, 4, 3, 6, 9)
5 (0, 4, 5, 8, 9) 7 (0, 3, 4, 7, 9)
9 (0, 1, 4, 8, 9) 11 (0, 2, 3, 5, 9)
13 (0, 1, 2, 4, 5, 6, 9) 15 (0, 5, 6, 8, 9)
17 (0, 1, 3, 4, 6, 7, 9) 19 (0, 2, 7, 8, 9)
21 (0, 1, 2, 4, 9) 23 (0, 3, 5, 6, 7, 8, 9)
25 (0, 1, 5, 6, 7, 8, 9) 27 (0, 1, 2, 3, 7, 8, 9)
29 (0, 1, 3, 5, 6, 8, 9) 31 (0, 1, 3, 4, 9)
Ph lc


216
35 (0, 8, 9) 37 (0, 1, 2, 3, 5, 6, 9)
39 (0, 2, 3, 6, 7, 8, 9) 41 (0, 1, 4, 5, 6, 8, 9)
43 (0, 1, 3, 6, 7, 8, 9) 45 (0, 2, 3, 5, 6, 8, 9)
47 (0, 1, 3, 4, 6, 8, 9) 51 (0, 2, 4, 6, 7, 8, 9)
53 (0, 2, 4, 7, 9) 55 (0, 2, 3, 4, 5, 7, 9)
57 (0, 2, 4, 5, 6, 7, 9) 59 (0, 1, 2, 3, 6, 7, 9)
61 (0, 1, 2, 3, 4, 6, 9) 63 (0, 2, 5, 6, 9)
73 (0, 1, 3) 75 (0, 1, 3, 4, 5, 6, 7, 8 ,9)
77 (0, 3, 6, 8, 9) 79 (0, 1, 2, 6, 7, 8, 9)
83 (0, 2, 4, 8, 9) 85 (0, 1, 2, 4, 6, 7, 9)
87 (0, 2, 5, 7, 9) 91 (0, 1, 3, 6, 8)
93 (0, 3, 4, 5, 6, 7, 9) 95 (0, 3, 4, 5, 7, 8, 9)
103 (0, 1, 2, 3, 5, 7, 9) 107 (0, 1, 5, 7, 9)
109 (0, 1, 2, 3, 4, 5, 6, 8, 9) 111 (0, 1, 2, 3, 4, 8, 9)
117 (0, 1, 2, 3, 6, 8, 9) 119 (0, 1, 9)
123 (0, 1, 2, 7, 9) 125 (0, 4, 6, 7, 9)
127 (0, 3, 5, 6, 9) 171 (0, 2, 4, 5, 7, 8, 9)
175 (0, 5, 7, 8, 9) 183 (0, 1, 3, 5, 8, 9)
187 (0, 3, 4, 6, 7, 8, 9) 191 (0, 1, 4, 5, 9)
219 (0,2, 3) 223 (0, 1, 5, 8, 9)
239 (0, 2, 3, 5, 6, 8, 9) 255 (0, 5, 9)
GF(1024)
1 (0, 3, 10) 3 (0, 1, 2, 3, 10)
5 (0, 2, 3, 8, 10) 7 (0, 3, 4, 5, 6, 7, 8, 9, 10)
9 (0, 1, 2, 3, 5, 7, 10) 11 (0, 2, 4, 5, 10)
13 (0, 1, 2, 3, 5, 6, 10) 15 (0, 1, 3, 5, 7, 8, 10)
17 (0, 2, 3, 5, 6, 8, 10) 19 (0, 1, 3, 4, 5, 6, 7, 8, 10)
21 (0, 1, 3, 5, 6, 7, 8, 9, 10) 23 (0, 1, 3, 4, 10)
25 (0, 1, 5, 8, 10) 27 (0, 1, 3, 4, 5, 6, 7, 8, 10)
29 (0, 4, 5, 8, 10) 31 (0, 1, 5, 9, 10)
33 (0, 2, 3, 4, 5) 35 (0, 1, 4, 9, 10)
37 (0, 1, 5, 6, 8, 9, 10) 39 (0, 1, 2, 6, 10)
Ph lc


217
41 (0, 2, 5, 6, 7, 8, 10) 43 (0, 3, 4, 8, 10)
45 (0, 4, 5, 9, 10) 47 (0, 1, 2, 3, 4, 5, 6, 9, 10)
49 (0, 2, 4, 6, 8, 9, 10) 51 (0, 1, 2, 5, 6, 8, 10)
53 (0, 1, 2, 3, 7, 8, 10) 55 (0, 1, 3, 5, 8, 9, 10)
57 (0, 4, 6, 9, 10) 59 (0, 3, 4, 5, 8, 9, 10)
61 (0, 1, 4, 5, 6 ,7, 8, 9, 10) 63 (0, 2, 3, 5, 7, 9, 10)
69 (0, 6, 7, 8, 10) 71 (0, 1, 4, 6, 7, 9, 10)
73 (0, 1, 2, 6, 8, 9, 10) 75 (0, 1, 2, 3, 4, 8, 10)
77 (0, 1, 3, 8, 10) 79 (0, 1, 2, 5, 6, 7, 10)
83 (0, 1, 4, 7, 8, 9, 10) 85 (0, 1, 2, 6, 7, 8, 10)
87 (0, 3, 6, 7, 10) 89 (0, 1, 2, 6, 7, 8, 10)
91 (0, 2, 4, 5, 7, 9, 10) 93 (0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10)
101 (0, 2, 3, 5, 10) 103 (0, 2, 3, 4, 5, 6, 8, 9, 10)
105 (0, 1, 2, 7, 8, 9, 10) 107 (0, 3, 4, 5, 6, 9, 10)
109 (0, 1, 2, 5, 10) 111 (0, 1, 4, 6, 10)
115 (0, 1, 2, 4, 5, 6, 7, 8, 10) 117 (0, 3, 4, 7, 10)
119 (0, 1, 3, 4, 6, 9, 10) 121 (0, 1, 2, 5, 7, 9, 10)
123 (0, 4, 8, 9, 10) 125 (0, 6, 7, 9, 10)
127 (0, 1, 2, 3, 4, 5, 6, 7, 10) 147 (0, 2, 3, 5, 6, 7, 10)
149 (0, 2, 4, 9, 10) 151 (0, 5, 8, 9, 10)
155 (0, 3, 5, 7, 10) 157 (0, 1, 3, 5, 6, 8, 10)
159 (0, 1, 2, 4, 5, 6, 7, 9, 10) 165 (0, 3, 5)
167 (0, 1, 4, 5, 6, 7, 10) 171 (0, 2, 3, 6, 7, 9, 10)
173 (0, 1, 2, 3, 4, 6, 7, 9, 10) 175 (0, 2, 3, 7, 8, 10)
179 (0, 3, 7, 9, 10) 181 (0, 1, 3, 4, 6, 7, 8, 9, 10)
183 (0, 1, 2, 3, 8, 9, 10) 187 (0, 2, 7, 9, 10)
189 (0, 1, 5, 6, 10) 191 (0, 4, 5, 7, 8, 9, 10)
205 (0, 1, 3, 5, 7, 10) 207 (0, 2, 4, 5, 8, 9, 10)
213 (0, 1, 3, 4, 7, 8, 10) 215 (0 , 5, 7, 8, 10)
219 (0, 3, 4, 5, 7, 8, 10) 221 (0, 3, 4, 6, 8, 9, 10)
223 (0, 2, 5, 9, 10) 231 (0, 1, 3, 4, 5)
235 (0, 1, 2, 3, 6, 9, 10) 237 (0, 2, 6, 7, 8, 9, 10)
Ph lc


218
239 (0, 1, 2, 4, 6, 8, 10) 245 (0, 2, 6, 7, 10)
247 (0, 1, 6, 9, 10) 251 (0, 2, 3, 4, 5, 6, 7, 9, 10)
253 (0, 5, 6, 8, 10) 255 (0, 7, 8, 9, 10)
341 (0, 1, 2) 343 (0, 2, 3, 4, 8, 9, 10)
347 (0, 1, 6, 8, 10) 351 (0, 1, 2, 3, 4, 5, 7, 9, 10)
363 (0, 2, 5) 367 (0, 2, 3, 4, 5, 8, 10)
375 (0, 2, 3, 4, 10) 379 (0, 1, 2, 4, 5, 9, 10)
383 (0, 2, 7, 8, 10) 439 (0, 1, 2, 4, 8, 9, 10)
447 (0, 3, 5, 7, 8, 9, 10) 479 (0, 1, 2, 4, 7, 8, 10)
495 (0, 1, 2, 3, 5) 511 (0, 7, 10)


Ti liu tham kho


219
TI LIU THAM KHO
[1] Nguyn Bnh, Trn Thng Qu. C s l thuyt truyn tin.
Hc vin K thut Qun s 1985.
[2] Nguyn Bnh, Trn Thng Qu. 100 bi tp l thuyt truyn tin.
Hc vin K thut Qun s 1988.
[3] Nguyn Bnh, Trng Nh Tuyn, Phm o. Bi ging L thuyt thng tin
Hc vin Cng ngh Bu chnh Vin thng 2000
[4] Nguyn Bnh. Gio trnh mt m hc
Nh xut bn Bu in 2004
[5] McEliece R.J. The theory of Information and coding.
Cambridge University Press 1985
[6] Wilson S.G. Digital modulation and Coding. Prentice Hall. 1996
[7] Sweeney P. Error control coding. An Introduction. Prentice Hall. 1997.
[8] Lin S. , Costello D.J. Error control coding: Fuldamentals and Applications. Prentice Hall.
2004.
[9] Moon T.K. Error correction coding. Mathematical Methods and Algorithms. Jhon Wiley
and Son 2005.
Mc lc

220
MC LC
LI NI U............................................................................................................................................ 1
CHNG I: NHNG VN CHUNG V NHNG KHI NIM C BN................................. 3
1.1. V TR, VAI TR V S LC LCH S PHT TRIN CA L THUYT THNG TIN
............................................................................................................................................................................ 3
1.1.1. V tr, vai tr ca L thuyt thng tin ..................................................................................... 3
1.1.2. S lc lch s pht trin ........................................................................................................ 4
1.2. NHNG KHI NIM C BN - S H TRUYN TIN V NHIM V CA N................... 5
1.2.1. Cc nh ngha c bn............................................................................................................. 5
1.2.2. S khi ca h thng truyn tin s (Hnh 1.2) .................................................................. 5
1.2.3. Nhng ch tiu cht lng c bn ca mt h truyn tin ...................................................... 10
CHNG II: TN HIU V NHIU.................................................................................................... 11
2.1. TN HIU XC NH V CC C TRNG VT L CA CHNG ................................. 11
2.2. TN HIU V NHIU L CC QU TRNH NGU NHIN.................................................. 11
2.2.1. Bn cht ngu nhin ca tn hiu v nhiu............................................................................ 11
2.2.2. nh ngha v phn loi nhiu .............................................................................................. 12
2.3. CC C TRNG THNG K CA TN HIU NGU NHIN V NHIU........................ 13
2.3.1. Cc c trng thng k ......................................................................................................... 13
2.3.2. Khong tng quan............................................................................................................... 15
2.4. CC C TRNG VT L CA TN HIU NGU NHIN V NHIU. BIN I
WIENER KHINCHIN .................................................................................................................................. 16
2.4.1. Nhng khi nim xy dng l thuyt ph ca qu trnh ngu nhin - mt ph cng sut16
2.4.2. Cp bin i Wiener Khinchin .......................................................................................... 18
2.4.3. B rng ph cng sut........................................................................................................... 19
2.4.4. M rng cp bin i Wiener Khinchin cho trng hp R( ) khng kh tch tuyt i
.................................................................................................................................................................... 20
2.5. TRUYN CC TN HIU NGU NHIN QUA CC MCH V TUYN IN TUYN
TNH................................................................................................................................................................ 21
2.5.1. Bi ton ti thiu................................................................................................................... 21
2.5.2. Bi ton ti a ....................................................................................................................... 26
2.6. BIU DIN PHC CHO TH HIN CA TN HIU NGU NHIN TN HIU GII HP
.......................................................................................................................................................................... 31
2.6.1. Cp bin i Hilbert v tn hiu gii tch.............................................................................. 31
2.6.2. Tn hiu gii rng v gii hp ............................................................................................... 35
Mc lc

221
2.7. BIU DIN HNH HC CHO TH HIN CA TN HIU NGU NHIN............................. 37
2.7.1. Khai trin trc giao v biu din vecteur ca tn hiu........................................................... 37
2.7.2. Mt xc sut ca vecteur ngu nhin - Khong cch gia hai vecteur tn hiu................ 39
2.7.3. Khi nim v my thu ti u................................................................................................. 43
BI TP ............................................................................................................................................... 45
CHNG 3 - C S L THUYT THNG TIN THNG K....................................................... 47
3.1. THNG TIN - LNG THNG TIN XC SUT V THNG TIN N V O THNG
TIN................................................................................................................................................................... 47
3.1.1. nh ngha nh tnh thng tin v lng thng tin................................................................ 47
3.1.2. Quan h gia bt nh v xc sut.................................................................................... 48
3.1.3. Xc nh lng thng tin....................................................................................................... 50
3.2. ENTROPIE V CC TNH CHT CA ENTROPIE ................................................................52
3.2.1. Tnh cht thng k ca ngun ri rc v s ra i ca khi nim entropie........................... 52
3.2.2. nh ngha entropie ca ngun ri rc.................................................................................. 52
3.2.3. Cc tnh cht ca entropie mt chiu ca ngun ri rc ....................................................... 53
3.2.4. Entropie ca ngun ri rc, nh phn .................................................................................... 55
3.2.5. Entropie ca trng s kin ng thi .................................................................................. 56
3.3. ENTROPIE C IU KIN. LNG THNG TIN CHO TRUNG BNH............................. 57
3.3.1. Entropie c iu kin v mt trng tin ny khi r mt tin nht nh ca trng tin kia 57
3.3.2. Entropie c iu kin v trng tin ny khi r trng tin kia .......................................... 58
3.3.3. Hai trng thi cc oan ca knh truyn tin.......................................................................... 60
3.3.4. Cc tnh cht ca entropie c iu kin................................................................................. 61
3.3.5. Lng thng tin cho trung bnh........................................................................................... 63
3.3.6. Tnh cht ca I(A,B) ............................................................................................................. 63
3.3.7. M hnh ca knh truyn tin c nhiu................................................................................... 64
3.4. TC PHT. KH NNG PHT. THA. KH NNG THNG QUA CA KNH
RI RC.......................................................................................................................................................... 65
3.4.1. Tc pht ca ngun ri rc............................................................................................... 65
3.4.2. Kh nng pht ca ngun ri rc .......................................................................................... 65
3.4.3. tha ca ngun ri rc..................................................................................................... 65
3.4.4. Cc c trng ca knh ri rc v cc loi knh ri rc........................................................ 66
3.4.5. Lng thng tin truyn qua knh trong mt n v thi gian............................................... 67
3.4.6. Kh nng thng qua ca knh ri rc.................................................................................... 67
3.4.7. Tnh kh nng thng qua ca knh nh phn i xng khng nh, ng nht ..................... 68
3.4.8. nh l m ho th hai ca Shannon .................................................................................... 69
Mc lc

222
3.4.9. Kh nng thng qua ca knh nh phn i xng c xo ..................................................... 70
3.5. ENTROPIE CA NGUN LIN TC. LNG THNG TIN CHO TRUNG BNH TRUYN
QUA KNH LIN TC KHNG NH......................................................................................................... 71
3.5.1. Cc dng tn hiu lin tc...................................................................................................... 71
3.5.2. Cc c trng v tham s ca knh lin tc.......................................................................... 71
3.5.3. Knh lin tc cha trong knh ri rc................................................................................... 72
3.5.4. Entropie ca ngun tin lin tc (ca mt qu trnh ngu nhin lin tc) .............................. 73
3.5.5. Mu vt l minh ho s ln v hn ca entropie ca ngun lin tc.................................... 74
3.5.6. Lng thng tin cho trung bnh truyn theo knh lin tc khng nh................................ 75
3.6. ENTROPIE VI PHN C IU KIN. TNH CHT CA CC TN HIU GAUSSE........... 76
3.6.1. Entropie vi phn c iu kin ............................................................................................... 76
3.6.2. Entropie vi phn ca nhiu Gausse....................................................................................... 77
3.6.3. Lng thng tin cho trung bnh truyn theo knh Gausse .................................................. 78
3.6.4. Tnh cht ca cc tn hiu c phn b chun ........................................................................ 80
3.7. KH NNG THNG QUA CA KNH GAUSSE.................................................................... 82
3.7.1. Kh nng thng qua ca knh Gausse vi thi gian ri rc.................................................. 82
3.7.2. Kh nng thng qua ca knh Gausse vi thi gian lin tc trong mt gii tn hn ch...... 83
3.7.3. Kh nng thng qua ca knh Gausse vi thi gian lin tc trong gii tn v hn .............. 84
3.7.4. nh l m ho th hai ca Shannon i vi knh lin tc .................................................. 85
3.7.5. V d: Kh nng thng qua ca mt s knh thc t ........................................................... 85
BI TP............................................................................................................................................... 86
CHNG IV C S L THUYT M HA.................................................................................. 90
4.1. CC NH NGHA V KHI NIM C BN.......................................................................... 90
4.1.1. Cc nh ngha c bn........................................................................................................... 90
4.1.2. Cc khi nim c bn............................................................................................................ 91
4.1.3. Kh nng khng ch sai ca mt b m u nh phn.......................................................... 93
4.1.4. M u nh phn khng c tha....................................................................................... 94
4.2. M THNG K TI U............................................................................................................. 94
4.2.1. di trung bnh ca t m v m ha ti u..................................................................... 95
4.2.2. Yu cu ca mt php m ha ti u.................................................................................... 95
4.2.3. nh l m ha th nht ca Shannon (i vi m nh phn)............................................... 95
4.2.4. Thut ton Huffman.............................................................................................................. 96
4.3. CC CU TRC I S V M TUYN TNH..................................................................... 99
4.3.1. Mt s cu trc i s c bn................................................................................................ 99
4.3.2. Cc dng tuyn tnh v m tuyn tnh................................................................................. 101
Mc lc

223
4.3.3. Cc bi ton ti u ca m tuyn tnh nh phn .................................................................. 104
4.4. VNH A THC V M XYCLIC......................................................................................... 105
4.4.1. Vnh a thc ....................................................................................................................... 105
4.4.2. Ideal ca vnh a thc......................................................................................................... 107
4.4.3. nh ngha m xyclic .......................................................................................................... 109
4.4.4. Ma trn sinh ca m xyclic.................................................................................................. 110
4.4.5. Ma trn kim tra ca m xyclic ........................................................................................... 110
4.5. M HA CHO CC M XYCLIC............................................................................................ 111
4.5.1. M t t m ca m xyclic h thng ................................................................................... 111
4.5.2. Thut ton m ha h thng................................................................................................ 112
4.5.3. Thit b m ha.................................................................................................................... 112
4.5.4. To cc du kim tra ca m xyclic .................................................................................... 114
4.5.5. Thut ton thit lp t m h thng theo phng php nhn..............................................116
4.6. GII M NGNG................................................................................................................... 117
4.6.1. Hai th tc gii m .............................................................................................................. 117
4.6.2. Gii m theo Syndrom......................................................................................................... 117
4.6.3. H tng kim tra trc giao v c kh nng trc giao .......................................................... 118
4.6.4. Gii m ngng da trn h tng kim tra trc giao .......................................................... 119
4.6.5. Gii m ngng da trn h tng kim tra c kh nng trc giao ...................................... 122
4.7. GII M THEO THUT TON MEGGIT............................................................................... 123
4.8. GII M XYCLIC THEO THUT TON CHIA DCH VNG.............................................. 126
4.8.1. Nhim v ca thut ton gii m......................................................................................... 126
4.8.2. Gii m theo thut ton chia dch vng............................................................................... 127
4.8.3. V d.................................................................................................................................... 127
4.9. GII M LI. .......................................................................................................................... 128
4.9.1. Trng thi v gin li ................................................................................................... 128
4.9.2. Gii m li......................................................................................................................... 132
4.10. M HAMMING V M C DI CC I ................................................................... 138
4.11. CC M KHI DA TRN S HC CA TRNG HU HN...................................... 139
4.11.1. Trng hu hn c nguyn t GF(p) ............................................................................... 139
4.11.2. Cc trng m rng ca trng nh phn. Trng hu hn GF(2
m
)................................. 140
4.11.3. Biu din a thc cho trng hu hn GF(2
m
) ................................................................. 141
4.11.4. Cc tnh cht ca a thc v cc phn t ca trng hu hn .......................................... 142
4.11.5. Xc nh cc m bng cc nghim.................................................................................... 145
4.11.6. M Hamming..................................................................................................................... 146
Mc lc

224
4.11.7. M BCH............................................................................................................................ 146
4.11.8. Cc m Reed Solomon (RS) ........................................................................................... 149
4.12. CC M CHP ........................................................................................................................ 150
4.12.1. M u v mt s khi nim c bn. ................................................................................ 150
4.12.2. Cc m Turbo.................................................................................................................... 154
BI TP............................................................................................................................................. 156
CHNG V L THUYT THU TI U....................................................................................... 160
5.1. T BI TON V CC VN C BN ......................................................................... 160
5.1.1. Thu tn hiu khi c nhiu l mt bi ton thng k............................................................. 160
5.1.2. My thu ti u..................................................................................................................... 161
5.1.3. Th chng nhiu.................................................................................................................. 161
5.1.4. Hai loi sai lm khi chn gi thuyt.................................................................................... 161
5.1.5. Tiu chun Kachennhicov................................................................................................... 161
5.1.6. Vic x l ti u cc tn hiu.............................................................................................. 161
5.1.7. Xc sut gii sai v quy tc gii ti u................................................................................ 162
5.1.8. Hm hp l.......................................................................................................................... 163
5.1.9. Quy tc hp l ti a........................................................................................................... 163
5.2. X L TI U CC TN HIU C THAM S BIT. KHI NIM V THU KT HP
V THU KHNG KT HP........................................................................................................................ 164
5.2.1. t bi ton......................................................................................................................... 164
5.2.2. Gii bi ton........................................................................................................................ 164
5.2.3. Khi nim v thu kt hp v thu khng kt hp ................................................................. 168
5.3. PHT TN HIU TRONG NHIU NH B LC PHI HP TUYN TNH TH NG.. 169
5.3.1. nh ngha b lc phi hp tuyn tnh th ng ................................................................ 169
5.3.2. Bi ton v b lc phi hp ................................................................................................ 169
5.3.3. c tnh bin tn v c tnh pha tn ca b lc phi hp ................................................. 172
5.3.4. Phn ng xung ca mch lc phi hp .............................................................................. 173
5.3.5. Hng ng ra ca mch lc phi hp................................................................................. 174
5.4. L LUN CHUNG V THU KT HP CC TN HIU NH PHN.................................... 175
5.4.1. Lp s gii ti u mt tuyn .......................................................................................... 175
5.4.2. Xc sut sai khi thu kt hp tn hiu nh phn .................................................................... 176
5.5. X L TI U CC TN HIU C THAM S NGU NHIN THU KHNG KT HP
........................................................................................................................................................................ 182
5.5.1. Cc tham s ca tn hiu l cc tham s ngu nhin........................................................... 182
5.5.2. X l ti u cc tn hiu c tham s ngu nhin bin thin chm...................................... 183
Mc lc

225
5.5.3. Xc sut hu nghim ca tn hiu c cc tham s thay i ngu nhin............................... 183
5.5.4. X l ti u cc tn hiu c pha ngu nhin........................................................................ 184
5.5.5. So snh thu kt hp vi thu khng kt hp......................................................................... 187
5.5.6. Ch thch............................................................................................................................. 188
5.6. M KHI KHNG GIAN , THI GIAN (STBC).....................................................................188
5.6.1. K thut thu phn tp. ......................................................................................................... 188
5.6.2. M khi khng gian thi gian da trn hai my pht....................................................... 190
BI TP ............................................................................................................................................. 193
PH LC................................................................................................................................................ 196
BT NG THC BUNHIACOVSKI-SCHWAZT........................................................................ 196
BIN I HILBERT ......................................................................................................................... 197
NH L KACHENNHICOV.......................................................................................................... 198
LUT PHN B CHUN ................................................................................................................ 201
LOGARIT C S HAI CA CC S NGUYN T 1 N 100 .................................................. 202
HM V ENTROPIE CA NGUN NH PHN............................................................................ 203
ENTROPIE H(X) CA CC LUT PHN B RI RC. ............................................................. 204
ENTRIPIE VI PHN H(X) CA CC LUT PHN B LIN TC. ........................................... 207
CC A THC TI TIU CA CC PHN T TRONG TRNG . ....................................... 214
TI LIU THAM KHO..................................................................................................................... 219
MC LC............................................................................................................................................... 220















BI GING
L THUYT THNG TIN
M s : 492LTT340

Chu trch nhim bn tho
TRUNG TM O TO BU CHNH VIN THNG 1

You might also like