NGN HNG CU HI THI T U N

Tn hc phn: thuyt thng tin M hc phn: ELE 1319

Ngnh o to: T-VT, -T, CNTT Trnh o to: i hc

Ng n hng c u h i thi
C u h i loi im
Cu hi 1.1: Nu nh ngha v tnh cht ca entropy ca ngun ri rc A sau:

a1 a2 ... as
A
p a1 p a 2 ... p as

Cu hi 1.2: Nu nh ngha v tnh cht ca khong cch gia 2 t m in v jn ca mt

m u d in , jn .

Cu hi 1.3: Trng s ca mt t m w in : nh ngha v tnh cht.

Cu hi 1.4: Pht biu 2 nh l v kh nng pht hin sai v kh nng sa sai ca mt b m

u nh phn c tha (D>0).
Cu hi 1.5: Tnh entropy ca ngun ri rc nh phn sau:

a a2
A 1
p 1 p
Cu hi 1.6: Nu nh ngha v tnh cht ca Entropy c iu kin H(A/B).
Cu hi 1.7: Nu nh ngha v tnh cht ca lng thng tin cho.
Cu hi 1.8: Nu nh ngha v tnh cht ca kh nng thng qua ca ngun ri rc.
Cu hi 1.9: Pht biu nh l m ha th nht ca Shannon
Cu hi 1.10: Nu 2 yu cu ca php m ha ti u.
Cu hi 1.11: nh ngha m xyclic
Cu hi 1.12: nh ngha m Hamming xyclic
Cu hi 1.13: nh ngha m xyclic c di cc i.
Cu hi 1.14: Cp bin i Wiener - Kinchin v ngha.
Cu hi 1.15: Cp bin i Hilbert v ngha
Cu hi 1.16: Trong phn m ha ngun Nn d liu, chng ta ni rng cc b m s dng
cho nn d liu thng l cc b m khng u. Hy gii thch mt cch r rng nht c th
v kt lun trn.

1
Cu hi 1.17: Hy xem xt v phn loi b m (m suy bin, khng suy bin, .) vi cc b
m sau :

Cu hi 1.18: Cho bit m ha knh c s dng trong h thng truyn tin vi mc ch

g? M ha knh c xy dng da trn nguyn tc g? Hy v d mt s loi m ha knh
m em bit.
Cu hi 1.19: Cho m tuyn tnh (7,4,3). Hy tnh xc sut thu sai 1 t m khi truyn tin qua
knh i xng nh phn c xc sut thu sai 1 du m l p 0 .

Cu hi 1.20: Cho m tuyn tnh (7,3,4). Hy tnh xc sut thu sai mt t m khi truyn tin
qua knh i xng nh phn c xc sut thu ng 1 du m l p 0 .

Cu hi 1.21: Cho hai knh BSC c mc ni tip nh hnh :

Pe1 Pe2

Pe1 Pe2

BSC1 BSC2

Xc sut li bit khi truyn trn knh BSC1 v BSC2 tng ng l pe1 v pe2. Tnh xc sut li
bit khi truyn qua hai knh ny.
Cu hi 1.22: Tnh entropy vi phn ca bin ngu nhin X c hm phn b xc sut:

a 1 (0 x a)
p( x) vi hai trng hp:
0 ( x )

a. a=1
b. a=4
Cu hi 1.23: Cho mt ngun ri rc khng nh (DMS) nh sau.

a) Tnh lng thng tin trung bnh thng k ca ngun.

b) Tm gi tr cc i ca , ch r iu kin c cc i ny.
Cu hi 1.24: Cho knh nh phn i xng BSC vi xc sut li bit pe = 0,01.
a) Tnh xc sut nhn c m bit sai trong n bit truyn i (m<n).
2
 b) Tnh xc sut nhn c chui 15 bit trong c t hn 3 bt sai

C u h i loi 2 im
Cu hi 2.1: Mt thnh ph n c 1% dn s l sinh vin. Trong s sinh vin c 50% l nam
thanh nin. S nam thanh nin trong thnh ph l 32% dn s. Gi s ta gp mt nam thanh
nin. Hy tn lng thng tin cha trong tin khi bit rng l mt nam sinh vin.
Cu hi 2.2: Mt bnh ng gm hai vin bi en v ba vin bi trng. Thc hin ly hai ln
lin tip mt cch ngu nhin ra mi ln mt vin bi, bi c ly ra th khng b li vo bnh.
Quan st th t mu cc vin bi ly c. Gi A l thng ip (tin) cho chng ta bit ly
c vin bi th hai l vin bi en. Hy tnh lng tin mang li ca thng ip A.
Cu hi 2.3: Mt bnh ng gm hai vin bi en v ba vin bi trng. Thc hin ly hai ln
lin tip mt cch ngu nhin ra mi ln mt vin bi, bi c ly ra th khng b li vo bnh.
Quan st th t mu cc vin bi ly c. Gi A l thng ip (tin) cho chng ta ly c 2
vin bi trng. Hy tnh lng tin mang li ca thng ip A.
Cu hi 2.4: C 2 hp ng bt ch, mi hp ng 20 bt ch. Hp th nht c 10 bt ch
trng, 5 bt ch en v 5 bt ch . Hp th 2 c 8 bt ch trng, 8 bt ch en, 4 bt ch .
Thc hin cc 2 php th ly h ho mt bt ch t mi hp. Hi rng php th no trong hai
php th ni trn c bt nh ln hn.
Cu hi 2.5: Tnh Entropy vi phn ca cc qu trnh ngu nhin lin tc X c phn b hm s
m f ( x) e x ( x 0) vi hng s > 0.

Cu hi 2.6: Tnh rng gii thng ca 1 knh v tuyn truyn hnh truyn hnh nh en
trng vi 5.105 im nh (pixel)/nh ; 25 nh/s v c 8 mc sng ng xc sut, vi t s
S 2s
tn/tp 15 . Coi rng nh v tuyn truyn hnh xem nh 1 dng tp m trng.
N G 0F

Cu hi 2.7: Tn hiu thoi c bng tn W=3,4kHz.

a. Tnh kh nng thng qua ca knh vi iu kin SNR=30dB
b. Tnh SNR ti thiu cn thit knh c th truyn tn hiu thoi s c tc 4800bps.
Cu hi 2.8: Trong mt b t l kh 52 qun bi (khng k phng teo), A rt ra 1 mt qun
bi bt k. Tnh s cu hi trung bnh ti thiu m B cn t ra cho A xc nh c qun
bi m A rt (cu hi c dng tr li c khng hoc ng sai). Nu thut ton hi Gi
s A rt ra 3 tp, hy nu cc cu hi cn thit ca B, cc cu hi tr li tng ng ca A
v phn on tng ng ca B.
Cu hi 2.9: Mt thit b in t gm 16 khi c gi tr nh nhau v tin cy v c mc
ni tip. Gi s c mt khi hng. Hy s dng mt thit b o tn hiu ra xc nh khi
hng. Tnh s ln do trung bnh ti thiu cn thc hin bng thit b o ny c th xc nh
c khi hng. Nu thut ton o? Gi s khi hng l khi th 5 hy ch ra cc ln o cn
thitv kt qu o tng ng, cc phn on a ra sau mi ln o?
3
Cu hi 2.10: Trong 27 ng xu ging nhau c mt ng xu gi nh hn. Gi s ta dng mt
cn a thng bng (c 2 a cn) xc nh ng xu gi. Hy tnh s ln cn trung bnh ti
thiu c th xc nh c ng xu gi. Nu thut ton cn.

Cu hi 2.11: Cho m xyclic (7,4) c a thc sinh g(x ) 1 x x 3 . Hy xy dng ma trn

sinh G v ma trn kim tra H dng h thng ca m ny.

Cu hi 2.12: Cho m xyclic (7,3) c a thc sinh g(x ) 1 x x 2 x 4 . Hy xy dng ma

trn sinh G v ma trn kim tra H dng h thng ca m ny.

Cu hi 2.13: Cho m xyclic 7, 4 c g x 1 x 2 x 3 . Hy xy dng ma trn sinh G v

ma trn kim tra H dng h thng?

Cu hi 2.14: Cho m xyclic 7,3 c g x 1 x 2 x 3 x 4 . Hy xy dng ma trn sinh G

v ma trn kim tra H dng h thng?

Cu hi 2.15: Cho m cyclic (9,3) c g ( x) 1 x 3 x 6 . Hy xy dng ma trn sinh G v

ma trn kim tra H dng h thng?

Cu hi 2.16: Cho m cyclic (9,6) c g ( x) 1 x3 . Hy xy dng ma trn sinh G v ma

trn kim tra H dng h thng?

Cu hi 2.17: Cho m cyclic (15,7) c g ( x) x 8 x 7 x 6 x 4 1 . Hy xy dng ma trn

sinh G v ma trn kim tra H dng h thng?

Cu hi 2.18: Cho m cyclic (15,8) c g ( x) x 7 x 6 x 4 1 . Hy xy dng ma trn sinh G

v ma trn kim tra H dng h thng?
Cu hi 2.19: Xt m khi nh phn tuyn tnh dng h thng (5,2) c ma trn sinh c dng :

.
a) Lit k tt c cc t m ca b m.
b) B m ny c kh nng pht hin v sa bao nhiu sai?

Cu hi 2.20: Hy phn tch nh thc x 7 1 thnh tch ca cc a thc bt kh qui v m t

tt c cc m xyclic c di n 7 trn vnh a thc 2 x / x 7 1

Cu hi 2.21: Hy phn tch nh thc x 15 1 thnh tch ca cc a thc bt kh qui v tnh s

lng cc m xyclic c di n 15 trn vnh a thc 2 x / x 15 1 .

Cu hi 2.22: Cho m xyclic (7,4,3) c g(x ) 1 x x 3 . Gi s t m nhn c ca b m

trn c dng: v x x 6 x 5 x 4 x 3 0001111

Hy s dng thut ton chia dch vng (by li) tm li t m pht?

Cu hi 2.23: Cho m xyclic (7,4,3) c g(x ) 1 x 2 x 3 . Gi s t m nhn c ca b m

trn c dng: v x x 6 x 5 x 4 x 2 0010111

4
Hy s dng thut ton chia dch vng (by li) tm li t m pht?

Cu hi 2.24: Cho m xyclic (7,3,4) c g(x ) 1 x x 2 x 4 . Gi s t m nhn c ca b

m trn c dng: v x x 3 x 2 x 0111000

Hy s dng thut ton chia dch vng (by li) tm li t m pht?

Cu hi 2.25: Cho m xyclic (7,3,4) c g(x ) 1 x 2 x 3 x 4 . Gi s t m nhn c ca

b m trn c dng: v x x 6 x 4 x 2 0010101

Hy s dng thut ton chia dch vng (by li) tm li t m pht?

Cu hi 2.26: Cho g ( x) x 8 x 6 x 4 x 2 1 l a thc trn trng nh phn.

a. Tm m cyclic c t l m r k / n nh nht vi a thc sinh l g (x) .

b. Tm khong cch Hamming ca b m cu a.

Cu hi 2.27: Xt a thc g ( x) x 1 trn trng nh phn.

a. Chng minh rng a thc ny c th to ra mt m cyclic vi n bt k. Tm k tng ng.

b. Tm dng h thng ca G v H ca m c to nn bi g(x) cu a.
C u h i loi 3 im
Cu hi 3.1 : Cho s mt knh ri rc khng nh (DMC) trong ngun pht X gm hai
tin x1 v x2 ; ngun Y gm hai tin v y2 . Bit p(x1)=1/2, p(y1/x1)=1, p(y1/x2)=,
p(y2/x1)=0, p(y2/x2)=1-.
a) Hy tnh H(X), H(Y), H(X,Y).
b) Tm iu kin ca H(Y) t gi tr cc i. Khi , gi tr ca I(X,Y) bng bao
nhiu (dn gii mt cch chi tit nht c th c c kt qu ).
Cu hi 3.2 : Xt mt knh ri rc nh phn i xng khng nh c ma trn knh cho nh
1
sau: . Bit u vo knh l mt ngun ri rc nh khng nh X 0,1 vi
1
p(0) 1/ 2 , u ra knh l mt ngun ri rc nh phn khng nh Y 0,1 .

a) Hy tnh H(X), H(Y), H(X,Y) v I(X,Y).

b) Xc nh cc gi tr ca dung lng ca knh t cc i, v cc tiu.
Cu hi 3.3: Cho knh nhiu Gaussian trng cng c u ra Y = X +N X l u vo
1
.e n / 2 n . Ga s X cng c phn
2 2
knh v N l nhiu vi hm phn b xc sut f ( x)
2 n2
b Gauss vi E ( X ) 0; E ( X 2 ) x2 .

a. Tnh entropy vi phn ca nhiu N

b. Tnh lng thng tin cho I(X,Y)

5
Cu hi 3.4 : Cho cc ngun ri rc vi bng phn b xc sut hp p( xk , yl ) nh hnh v.
Hy tnh H(X), H(Y), H(X,Y), H(X/Y), H(Y/X), I(X,Y).

Cu hi 3.5: Cc tn hiu x1 v x2 c xc sut xut hin tin nghim tng ng l

p( x1 ) 3 / 4 v p( x2 ) 1/ 4 c truyn theo knh nh phn ri rc i xng khng nh c
nhiu c xc sut chuyn sai pe 1/ 8 . Tnh:

a) Lng tin tc ring c iu kin I ( x2 / y2 )

b) Lng tin tc cho I (x 2 ; y2 )

c) Cc i lng H ( X / y1 ), H (X), H ( X , Y ), H ( X / Y ), I ( X ; Y )

Cu hi 3.6: Cho s knh nh hnh v. Bit p( x1 ) 2 / 3 , hy tnh cc i lng H(X),

H(Y), H(X,Y), H(X/Y), H(Y/X), I(X,Y).

Cu hi 3.7 : Cho s knh ri rc khng nh nh hnh v, tnh dung lng ca knh :

Cu hi 3.8: Cho s knh ri rc khng nh nh hnh v, tnh dung lng ca knh:

6
Cu hi 3.9 : Cho s knh ri rc khng nh (DMC) nh hnh v. Bit thi hn cc k
hiu pht v u l .

c) Hy tnh dung lng ca knh.

d) Kho st s b (phc ha bin thin) dung lng knh theo gi tr ca .
e) Gii thch r ngha ca cc cc i, cc tiu (nu c).
y1
x1
1
y3
1
y2
x2

Cu hi 3.10: Cho s knh ri rc khng nh (DMC) nh hnh v. Bit thi hn cc k

hiu pht v u l .

a) Hy tnh dung lng ca knh.

b) Trong trng hp knh nh phn i xng ( 0) dung lng knh bng bao nhiu?

Cu hi 3.11: Cho s knh ri rc khng nh (DMC) nh hnh v. Bit thi hn cc k

hiu pht v u l .

a) Hy tnh dung lng ca knh.

b) Trong trng hp knh nh phn c xa ( ( 0) , dung lng knh bng bao nhiu?

7
Cu hi 3.12 : Xt mt m cyclic nh phn tuyn tnh h thng (9,3) c a thc sinh
g ( x) 1 x 3 x 6 .

a) Xy dng mch lp m h thng cho m theo thut ton chia.

b) M t hot ng ca mch, tm t m u ra tng ng vi khi tin vo a = 101.
c) Kim tra kt qu cu b) bng thut ton tng ng.

Cu hi 3.13: Xt mt b m khi nh phn tuyn tnh h thng (8,4) . T m ca b m c

dng c a1a2 a3a4 a5a6 a7 a8 trong cc du mang tin l a1 a4 , cc du kim tra l a5 a8 .
Bit cc du kim tra c xc lp theo cc mi quan h:

a) Xy dng ma trn sinh ma trn kim tra cho m ny

b) Chng minh rng khong cch m cc tiu (khong cch m ti thiu, khong cch m
Hamming ti thiu) ca m d min 3 .

Cu hi 3.14: Cho m xyclic (7,4) c a thc sinh g(x ) 1 x x 3 . Hy m t s chc

nng ca thit b m ho h thng cho b m ny theo phng php chia. Gi s a thc
thng tin a (x ) 1 x 2 x 3 . Hy tm t m u ra ca thit b v kim tra li bng thut ton
4 bc to t m h thng.

Cu hi 3.15: Cho m xyclic (7,4) c a thc sinh g(x ) 1 x 2 x 3 . Hy m t s chc

nng ca thit b m ho h thng cho b m ny theo phng php chia. Gi s a thc
thng tin a (x ) x 2 x 3 . Hy tm t m u ra ca thit b v kim tra li bng thut ton 4
bc to t m h thng.

Cu hi 3.16: Cho m xyclic (7,3) c a thc sinh g(x ) 1 x x 2 x 4 . Hy m t s

chc nng ca thit b m ho h thng cho b m ny theo phng php chia. Gi s a thc

8
thng tin a (x ) x x 2 . Hy tm t m u ra ca thit b v kim tra li bng thut ton 4
bc to t m h thng.

Cu hi 3.17: Cho m xyclic (7,3) c a thc sinh g(x ) 1 x 2 x 3 x 4 . Hy m t s

chc nng ca thit b m ho h thng cho b m ny theo phng php chia. Gi s a thc
thng tin a (x ) 1 x 2 . Hy tm t m u ra ca thit b v kim tra li bng thut ton 4
bc to t m h thng.

Cu hi 3.18: a. Xy dng m cyclic (6,2) trn trng Z 2 [ x] / x 6 1 .

b. Tm ma trn G dng h thng ca m ny v tm tt c cc t m ca b m.

c. M ny c th sa bao nhiu li ?
Cu hi 3.19: Hy thc hin m ho Huffman cho ngun ri rc A sau:

a1 a 2 a 3 a 4 a5 a6 a7 a8 a9 a10
A 1 1 1 1 1 1 1 1 1 1


2 8 8 8 32 32 32 64 128 128
nh gi hiu qu ca php m ho
Hy thc hin gii m cho dy bit nhn c c dng:
1 0 1 1 0 0 1 1 1 0 1 0 1....
Cu hi 3.20: Hy thc hin m ho Huffman cho ngun ri rc A sau:

a1 a 2 a 3 a 4 a 5 a 6 a7 a8 a 9 a10 a11
A 1 1 1 1 1 1 1 1 1 1 1


2 8 8 16 16 16 64 64 64 128 128
nh gi hiu qu ca php m ho
Hy thc hin gii m cho dy bit nhn c c dng:
1 0 1 1 0 0 1 1 1 0 1 0 1....
Cu hi 3.21: Hy thc hin m ho Huffman cho ngun ri rc A sau:

a1 a 2 a 3 a 4 a 5 a 6 a 7 a8 a9 a10 a11
A 1 1 1 1 1 1 1 1 1 1 1


4 4 4 16 16 16 32 128 128 128 128
nh gi hiu qu ca php m ho
Hy thc hin gii m cho dy bit nhn c c dng:
1 0 1 1 0 0 1 1 1 0 1 0 1....
Cu hi 3.22 : Hy thc hin m ho Huffman cho ngun ri rc A sau:

a1 a 2 a 3 a 4 a5 a6 a7 a8 a 9 a10 a11
A 1 1 1 1 1 1 1 1 1 1 1


4 4 8 8 16 16 32 32 32 64 64
9
nh gi hiu qu ca php m ho
Hy thc hin gii m cho dy bit nhn c c dng:
1 0 1 1 0 0 1 1 1 0 1 0 1....
Cu hi 3.23 : Hy thc hin m ha Huffman cho ngun ri rc sau :

a a2 a3 a4 a5 a6 a7 a8
A 1
0, 25 0, 20 0,15 0,12 0,10 0,05 0,08 0,05
nh gi hiu qu ca php m ha
Hy thc hin gii m cho dy bit nhn c c dng : 11001110101000111...
C u h i loi 4 im

Cu hi 4.1: Cho m xyclic t trc giao (7,3,4) c a thc sinh g(x ) 1 x x 2 x 4 . Hy

thit lp h tng kim tra trc giao cho du m v 6 v xy dng s chc nng b gii m a
s tng ng.

Hy thc hin gii m cho t m nhn c sau: v x x 3 x 2 x 0111000

Cu hi 4.2: Cho m xyclic t trc giao (7,3,4) c a thc sinh g(x ) 1 x 2 x 3 x 4 . Hy

thit lp h tng kim tra trc giao cho du m v 6 v xy dng s chc nng b gii m a
s tng ng.

Hy thc hin gii m cho t m nhn c sau: v x x 6 x 4 x 2 0010101

Cu hi 4.3: Cho m xyclic t trc giao (7,3,4) c a thc sinh g(x ) 1 x 2 x 3 x 4 . Hy

thit lp h tng kim tra trc giao cho du m v 6 v xy dng s chc nng b gii m a
s tng ng.

Hy thc hin gii m cho t m nhn c sau: v x x 6 x 5 x 2 0010011

Cu hi 4.4 : Mt vn bn c vit t cc k t t , bit tn sut xut hin ca cc

k t trong vn bn ln lt l: 1200; 2400; 9600; 2400; 9600; 2400; 1200; 9600; 9600;
38400; 9600; 9600; 9600; 38400 (ln).
a) Hy thc hin m ha Huffman cho vn bn.
b) nh gi hiu qu ca php m ha xy dng trong cu a.
c) Kim tra bt ng thc kp v di trung bnh t m. C nhn xt g?
d) Hy tnh t s nn thu c khi s dng b m xy dng phn a so vi khi s dng m
ASCII vi rng 1 Byte.
Cu hi 4.5 Gi tr mc xm ca mt khi (block) nh 8 8 nh trong ma trn sau.

10
Ngi ta cn thc hin nn nh ny. Mt cch n gin nht l p dng cch m ha cc mc
xm theo phng php m ha Huffman
a) Hy xy dng b m biu din cc gi tr mc xm ca nh theo phng php m ha
Huffman
b) nh gi tnh hiu qu ca b m thu c.
c) Gi s nh c quyt zig-zag theo ng t nt, vi dy bt nhn c nh sau
0100110100111010101 hy khi phc li cc gi tr mc xm ca gc nh ng vi dy bt
cho.
d) So vi vic m ha trc tip cc gi tr mc xm bng m ASCII ( rng 1Byte), phng
php m ha Huffman tit kim c bao nhiu phn trm dung lng.

Cu hi 4.6 : Cho m cyclic (15,7) v a thc g ( x) x 8 x 7 x 6 x 4 1

a) Chng minh rng g(x) c th l a thc sinh ca m cyclic (15,7)

b) V s to m theo phng php chia v gii thch ngn gn nguyn l hot ng
ca mch.
c) Xc nh t m dng h thng tng ng vi bn tin m( x) x 3 x (theo thut ton)
d) a thc d ( x) x14 x12 x8 x 1 c phi l mt t m ca b m khng? V sao?

Cu hi 4.7: Cho m cyclic (15,8) v a thc g ( x) x 7 x 6 x 4 1

a) Chng minh rng g(x) c th l a thc sinh ca m cyclic (15,7)

b) V s to m theo phng php chia v gii thch ngn gn nguyn l hot ng
ca mch.
c) Xc nh t m dng h thng tng ng vi bn tin m( x) x 3 x (theo thut ton)
d) a thc d ( x) x14 x12 x8 x 1 c phi l mt t m ca b m khng? V sao?

Cu hi 4.8: Cho x15 1 (1 x)(1 x x 2 )(1 x x 4 )(1 x 3 x 4 )(1 x x 2 x 3 x 4 ) .

a. Tm m cyclic (15,3) trn vnh Z 2 x/ x15 1 .

b. Lit k 2 t m bt k ca b m (15,3) trn vnh ny.

11
 c. V s to m cyclic (15,3) bng phng php chia.
d. S dng thut ton tm t m u ra bit bn tin u vo m = 1+x

Cu hi 4.9: Cho x15 1 (1 x)(1 x x 2 )(1 x x 4 )(1 x 3 x 4 )(1 x x 2 x 3 x 4 ) .

a. Tm m cyclic (15,2) trn vnh Z 2 x/ x15 1 .

b. Lit k cc t m ca b m (15,2) trn vnh ny.

c. V s to m cyclic (15,2) bng phng php chia.
d. S dng thut ton tm t m u ra bit bn tin u vo m = 1+x

12