L thuyt thng tin

ThS Phm Minh Nam Ho Chi Minh City University of Industry

M hnh h thng thng tin s

1.1 Gii thiu m ho

Chuyn i cc phn t ca mt tp i lng ny thnh mt tp i lng khc nhm mc ch tin li cho vic lu tr v trao i thng tin Php bin i cu trc tin ti ni pht nhm thu c tin ti ni thu trung thc hn, c tin cy cao hn V d: A/D, BCD, ASCII

Entropy

i lng c trng cho tnh mang thng tin, th hin c tnh mi m, c ngha v c tin cy ca thng tin. VD: Ngun tin X n x1 , x2, ,...,xN N 0,1,... c xc sut xut hin tng ng P(i) N P (i) 1

o
o

Nu cc tin l ng xc sut th P (i ) 1 N Khi 1/P(i) cng ln , P(i) cng b th bt ng tin cng ln, tin cng c ngha, lng tin ca x i cng ln v ngc li.
Khi P(i) = 1, th bt ng tin mang li bng 0. Tin nhn c khng c ngha. Lng tin ca

i 1

xi

c nh ngha l logarit ca 1/p(i)

I(i) = log2 [1/p(i)] = - log2 p(i) [bit]

V d v Entropy

Tnh lng tin mang li khi truyn chui Cong_hoa_xa_hoi_chu_nghia_Viet_Nam ?

1.2 Phn loi m ho

M ho ngun:
Bin i tp i lng ngun ny thnh mt tp i lng ngun khc tin li cho vic lu tr v bo mt.

C 3 loi:
M ho th hin ASCII, A/D M ho nn WinZip, MP3, JPEG M ho bo mt (mt m ho) A5, DES

1.2 Phn loi m ho (2)

M ho knh (channel code):

Bin i tp d liu ngun ny thnh mt tp i lng khc tin li cho vic kim tra v sa li trn ng truyn

C nhiu loi khc nhau:

Parity M khi tuyn tnh M xon

1.2 Phn loi m ho (3)

M ho ng truyn (line-code):
Bin i tp i lng ngun ny thnh mt tp i lng in tin li cho vic truyn dn thng tin.

C 2 loi:
M ho ng truyn dy nn RZ, NRZ, HDB3, B8SZ M ho ng truyn bng iu ch AM, FM, PSK, FSK

1.3 Mt s loi m ho ng truyn(1)

Line code

Unipolar

Polar

Bipolar

NRZ

RZ

Biphas e

AMI

B8ZS

HDB3

NRZ-L

NRZ-I

Manchester

Diffential Manchseter

Unipolar: Mc cao l in p dng (+A Volt), Thp l zero Polar: Mc cao in p dng, thp l in p m, khng tnh zero Bipolar: Mc thp l zero, mc cao l cc xung dng m xen k nhau c chu k nh hn hay bng 1 bit. RZ: (return zero) v zero mt na ca chu k bit NRZ: Non Return zero: Gi nguyn mc gia chu k bit Biphase: Tn hiu chuyn mc ti im gia mi bit nhng khng v zero

1.3 Mt s loi m ho ng truyn(2)

1.3 Mt s loi m ho ng truyn(3)

AMI: Mc thp l zero, mc cao o mc so vi mc cao trc . B8ZS: 8 bit thp lin tip c thay th bng cm 000+-0-+ nu xung in p ca bit 1 trc l dng, ngc li s l cm thay th 000-+0+- HDB3: thay th 4 bit thp lin tip bng cm 000V hay B00V sao cho s B gia hai V lin tip lun l (V l bit vi phm)

1.3 Mt s loi m ho ng truyn(4)

CMI NRZ-L in p dng cho bit 0 v m cho bit 1 v c th ngc li NRZ-I in p s thay i i vi mi bit 1 . Ring bit 0 khng thay i

RS232

1.3 Mt s loi m ho ng truyn(5)

o o

M ho bng iu ch:
iu ch tng t FM, PM iu ch s: BPSK, QPSK
Tn hiu trc iu ch dng s.

1.4 M ho ngun (1)

M ho biu din s vt hin tng

V d1: M ho ASCII V d 2: M ho nh phn u v khng u
M u: AD 8 bit Khng u:

x1 00

x2 01

x3 100

x4 x5 1010 1011

1.4 M ho ngun Shannon-Fano(2)

M ho nn d liu

M Shannon-Fano
Sp xp cc ngun tin theo xc sut gim dn Chia thnh 2 nhm sao cho xc sut xp x nhau Gn cho mi nhm k m 0 hay 1 Coi mi nhm nh ngun tin mi. Quay tr li t bc 2. T m l cc t hp k m c ly tng ng t nhm ln n nhm nh.

u khuyt
u: Vi cch chia nhm ng xc sut, s lp m thng k ti u ng thi cng l m prephic. Khuyt: Khng cho php lp m duy nht. Cn bit trc xc sut xut hin ca tng k m

1.4 M ho ngun Shannon-Fano(3)

Lp tin P(i) X1 0.25 X2 0.125 X3 0.0625 X4 0.0625 X5 0.25 X6 0.125 X7 0.0625 X8 0.0625

S ln chia nhm
Xi

T m 4

di ni

P(i)

X1 X5
X2 X6 X3

0.25 0.25
0.125 0.125 0.0625

0 1
1 0 0 1 1 0 0

00 01
100 101 1100

2 2
3 3 4

X4 X7
X8

0.0625 0.0625
0.0625

1 1 0
1

1101 1110
1111

4 4
4

1.4 M ho ngun Lempel-zig(4)

M Lempel-Zig
L pp nn d liu trc tip dng cch tra t in Ngun tin c chia thnh cc khi c di khc nhau gi l cc cu hay chui c s Nu ngun tin xut hin t hp mi cha c trong t in th to chui c s mi da trn chui c bng cch ly a ch t hp xut hin di nht trong chui mi c trong t in ghp vi bit cui cng ca chui sp a vo V d: 10101 10100 10011 10101 00001 10011 10101 10001 1011 (44 bit) 1,0,10,11,01,00,100,111,010,1000,011,001,110,101,10001,1011

1.4 M ho ngun Lempel-zig(5)

STT V tr trong t in 0000 1 2 3 0001 0010 0011 1 0 10 00001 00000 00010 Ni dung chui T m

4
5 6 7 8

0100
0101 0110 0111 1000

11
01 00 100 111

00011
00101 00100 00110 01001

9
10 11 12 13

1001
1010 1011 1100 1101

010
1000 011 001 110

01010
01110 01011 01101 01000

14
15 16

1110
1111

101
10001 1011

00111
10101 11101

1.4 M ho ngun Lempel-zig(6)

u: Khng cn thit lp trc cc t m v bit trc xc xut xut hin cc k m, t m to ra t ng trong qu trnh truyn tin. Khuyt: Nu c qu nhiu chui c s sinh ra s dn n mt lng b nh ln, vic truy xut d tm rt kh khn v tn thi gian.

1.4 M ho ngun (7)

M ho bo mt
nhm lm m i ni dung bn trong ngun tin khi truyn tin ch c ni nhn c thng tin b sung mi gii m c. V d:

PC files: Password Mobile: thut ton A5 Stream data: DES (Data Encryption Standard )

1.5 M ho knh (1)

Bin i tp d liu ngun ny thnh mt tp ilng khc tin li cho vic kim tra v sa li trn ng truyn Thng s dng cc k thut sau
Yu cu lp li t ng ARQ (Automatic Repeat-reQuest) Sa li trc FEC (Forward Error Correction)

1.5 M ho knh (2)

Yu cu lp li t ng ARQ (Automatic Repeat-reQuest) Khi thy li my thu s yu cu truyn li khi b li

ARQ thng dng vi cc h thng c

o o o

Knh truyn song cng tr ng truyn nh

Truyn s liu non-realtime

ARQ khng dng vi cc h thng c

o o o

Knh truyn n cng tr ng truyn ln Truyn s liu realtime

1.5 M ho knh (3)

Sa li trc FEC (Forward Error Correction) S liu c m ho khi truyn i (thm cc redundancy) cho my thu c th pht hin v sa li
o o

Pht hin li : Dectection Sa li: Correction

FEC thng dng trong cc h thng

o o

C tnh cht truyn thoi v realtime Nu truyn k bit thng tin v (n-k) bit redundancy th t l m FEC l k/n v thng vit l C(n,k)

1.5 M ho knh (4)

Sa li trc FEC (Forward Error Correction) s dng M khi tuyn tnh (Linear Block Codes)
nh x k bit mang tinh thnh n bit truyn. Thnh phn mang tin v redundancy l ring bit nhau khi truyn

M xon (Convolution Codes)

nh x k bit mang tinh thnh n bit truyn. Cc k hiu u ra ph thuc vo k k hiu u vo v v k hiu ca b nh.

nh gi h thng