‫א‬‫א‬

‫א‬
 ‫א‬

٩
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 
 K‫א‬‫א‬‫א‬‫א‬‫א‬W‫א‬‫א‬
 
 W‫א‬‫א‬‫א‬‫א‬W‫א‬‫א‬
 
 K‫א‬‫א‬ J 
 
 K‫א‬‫א‬ J
 
 K‫א‬ J 
 
 K‫א‬ J 
 
 K‫א‬‫א‬ J 
 
 K٤W‫א‬‫א‬
 
 
 W‫א‬‫א‬
  J١
 ‫א‬‫א‬‫א‬‫א‬ J٢
 ‫א‬‫א‬ J٣
 
 W‫א‬‫א‬
 ‫א‬‫א‬

-١٦٩-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 ‫א‬ J٩

Source Coding

 ١ J٩
 
،‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬،‫א‬‫א‬
‫א‬   K‫א‬  ‫א‬     ،‫א‬  ‫א‬   
E‫א‬F‫א‬‫א‬،‫א‬
‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
 ‫א‬  ،‫א‬ ‫א‬‫א‬    K‫א‬ ‫א‬ ‫א‬    
 KEADCF
 
 W‫א‬‫א‬
 
 K‫א‬‫א‬‫א‬‫א‬EData ReductionF‫א‬W‫א‬
 K‫א‬‫א‬‫א‬EData CompressionF‫א‬W‫א‬
،‫א‬‫א‬‫א‬‫א‬
 K‫א‬
E Memoryless SourcesF‫א‬W‫א‬
 K‫א‬‫א‬‫א‬
 
Huffman Coding٢ J٩
 

-١٧٠-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
،E ١٩٥٢‫א‬F‫א‬‫א‬E David Huffman‫א‬F
Shannon F‫א‬‫א‬،‫א‬‫א‬،‫א‬‫א‬
 ‫א‬‫א‬KEBound
K‫א‬‫א‬‫א‬‫א‬‫א‬ERedundancyF
‫א‬‫א‬‫א‬،‫א‬‫א‬‫א‬
‫א‬E Codeword LengthF‫א‬K‫א‬
 K‫א‬‫א‬‫א‬‫א‬‫א‬K‫א‬
 
 W‫א‬‫א‬‫א‬
 K‫א‬‫א‬ESymbolsF‫א‬M
 
K‫א‬‫א‬ K١
K‫א‬‫א‬10‫א‬‫א‬‫א‬ K٢
KM-1‫א‬‫א‬
 ‫א‬ ‫א‬    ‫א‬ ‫א‬ ‫א‬   ‫א‬ ‫א‬ ‫א‬   K٣
K‫א‬‫א‬10
K10٢‫א‬ K٤
 ‫א‬  ‫א‬  ،E Huffman Code Tree F ‫א‬   ‫א‬  K٥
 K‫א‬‫א‬
‫א‬    ‫א‬ ‫א‬      ‫א‬ ‫א‬  
L E Average or Expected LengthF ‫א‬  ‫א‬ ‫א‬  K ‫א‬ ‫א‬
‫א‬‫א‬،E‫א‬‫א‬‫א‬‫א‬F
 W‫א‬‫א‬
 
 

-١٧١-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
N
L l  P
i 1
i i (1-9)

‫א‬‫א‬Pi،i‫א‬‫א‬‫א‬liW
 K‫א‬
‫א‬ ‫א‬      ‫א‬    ،  ‫א‬ 
 K
 
 ١ J٩
 K١ J٩ ‫א‬  ‫א‬  ‫א‬         
 K‫א‬
 
 ١ J٩
‫א‬‫ א‬ ‫א‬
 0.3 X1
 0.22  X2
 0.2  X3
 0.12  X4
 0.1  X5
 0.04  X6
 
 W‫א‬
 
K١ J٩‫א‬P(X)‫א‬X‫א‬ K١
K0.1 + 0.04 = 0.14‫א‬‫א‬X6X5‫א‬ K٢
K0.14 + 0.12 = 0.26‫א‬‫א‬X4EX6X5F‫א‬ K٣
K0.2 + 0.22 = 0.44‫א‬‫א‬X3X2‫א‬ K٤
‫א‬‫א‬٣EX3X2F‫א‬ K٥
 K0.26 + 0.44 = 0.7

-١٧٢-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
K0.7 + 0.3 = 1.0‫א‬‫א‬X1 ٥‫א‬ K٦
K‫א‬‫א‬‫א‬‫א‬‫א‬ K٧
،‫א‬‫א‬‫א‬‫א‬‫א‬،‫א‬ K٨
 K101W‫א‬‫א‬X3
 
 WE١ J٩F‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬

L = 1 × 0.3 + 3×( 0.22 + 0.2 + 0.12 ) + 4 ( 0.1 + 0.04 ) = 2.48 bits.

X P(X) Codeword

0
X1 0.3 0

0
X2 0.22 1.0 100
0.44 0

X3 0.2 101
1 0.7
0
X4 0.12 1 110
0.26
0 1
X5 0.1 1110
0.14
1
X2 0.04 1111
  1
 
 ١ J٩‫א‬E١ J٩F‫א‬

 
Hamming Coding٣ J٩
 

-١٧٣-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 ‫א‬ ‫א‬  ‫א‬ E Richard Hamming ‫א‬  F   
K‫א‬،‫א‬‫א‬،
E Hamming DistanceF‫א‬‫א‬‫א‬
‫א‬‫א‬‫א‬K‫א‬
‫א‬،KEF
 KRAM‫א‬‫א‬‫א‬
E Control BitsF‫א‬‫א‬‫א‬
‫א‬FEData BitsF‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
 K ‫א‬‫א‬E2
،‫א‬‫א‬ m،E m , nF‫א‬‫א‬
   E 8 , 7 F   ،   K‫א‬    n  
 k‫א‬‫א‬ K 7  8
 W‫א‬‫א‬n‫א‬
 
n  2k  k  1 (2-9)
 
‫א‬‫א‬‫א‬
 
m=k+n
 K‫א‬‫א‬‫א‬،‫א‬
 
 ٢ J٩
 W‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
  2, 3, 4, 5, 6, 10
 
 W‫א‬
 ٢ J٩‫א‬‫א‬،٢ J٩‫א‬‫א‬

-١٧٤-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 ٢ J٩
m،‫א‬‫א‬ n،‫א‬ k،‫א‬
 3  1  2
 7  4  3
 15  11  4
 31  26  5
 63  57 6
 1023  1013 10
 ٣ J٩
 K100110111010101
 K‫א‬
 
 W‫א‬
 K2‫א‬،‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
 
 W
 
F2‫א‬EParity BitsF‫א‬‫א‬‫א‬ K١
KEKKK،16،8،4،2،1‫א‬
KEKKKK،7،6،5،3F‫א‬‫א‬ K٢
‫א‬‫א‬‫א‬‫א‬ K٣
W‫א‬

KE1,3,5,7,9,11,…..F‫א‬‫א‬W1 
KE2,3,6,7,10,11,14,15…..F ‫א‬W2 
KE4,5,6,7,12,13,14,15,…..F W4 
KE16-31,48-63,80-95,…..F 1616W16 
 K‫א‬‫א‬‫א‬
 
-١٧٥-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
?1?‫א‬0،‫א‬‫א‬?1?‫א‬1‫א‬ K٤
K ‫א‬‫א‬
 
،7‫א‬E7 , 4F،،
 K4‫א‬3‫א‬
 K‫א‬‫א‬W
Kp1, p2, and p41, 2, 4W‫א‬‫א‬ K١
 
d3, d5,d6 and d7E3,5,6,7F‫א‬‫א‬ K٢
K٣ J٩‫א‬
 
‫א‬‫א‬٣ J٩
Bit position 1 2 3 4 5 6 7
Encoded data bits p1 p2 d1 p4 d2 d3 d4
p1 X X X X
Parity
bit p2 X X X X
p4 X X X X

 
W‫א‬‫א‬‫א‬‫א‬ K٣

p1  d 3  d 5  d 7
p2  d 3  d 6  d 7 (3-9)
p4  d 5  d 6  d 7
 
‫א‬‫א‬ XOR‫א‬‫א‬K‫א‬E XORF  
 W‫א‬
 
 X1 X2 Output
-١٧٦-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 0  0  0
 0  1  1
 1  0  1
 1  1  0
 
K٤ J٩‫א‬E7‫א‬F‫א‬ K٤
 
 K12‫א‬‫א‬‫א‬‫א‬
 W‫א‬1100‫א‬
  
p1  d 3  d 5  d 7  1  1  0  0  
p2  d 3  d 6  d 7  1  0  0  1  
p4  d 5  d 6  d 7  1  0  0  1  
 W7‫א‬‫א‬‫א‬
 
0111100
 
‫א‬‫א‬E1, 2 and 4‫א‬F‫א‬‫א‬‫א‬‫א‬
 KE3, 5, 6 and 7‫א‬F‫א‬
 
E7,4F٤ J٩
‫א‬ ‫א‬‫ א‬ ‫א‬
Data Word Decimal Value Code Word
 0 0 0 0  0  0000000
0001  1  1101001
0010  2  0101010
0011  3  1000011
 0 1 0 0  4  1001100
0101  5  0100101
0110  6  1100110
0 11 1  7  0001111
-١٧٧-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
1000  8  1110000
1 0 01  9  0011001
1010  10  1011010
1011  11  0110011
1100  12  0111100
11 0 1  13  1010101
1110  14  0010110
1111  15  1111111

 K6‫א‬‫א‬‫א‬
 W‫א‬0110‫א‬
  
p1  d 3  d 5  d 7  0  1  0  1

  p2  d 3  d 6  d 7  0  1  0  1
p4  d 5  d 6  d 7  1  1  0  0
 W7‫א‬‫א‬‫א‬
 
 1 1 0 0 1 1 0
 W‫א‬
 W‫א‬‫א‬E6‫א‬F‫א‬‫א‬
 
1110110
 
 ‫א‬‫א‬‫א‬‫א‬
 
p1  d 3  d 5  d 7  1  1  0  0
p2  d 3  d 6  d 7  1  0  0  1
p4  d 5  d 6  d 7  1  0  0  1
 

-١٧٨-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
‫א‬ ‫א‬  ‫א‬     ،‫א‬   ‫א‬  ،‫א‬  
،‫א‬KE p3‫א‬ p1‫א‬‫א‬‫א‬F‫א‬‫א‬‫א‬
‫א‬‫א‬E 1 + 2 =3F‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
 K‫א‬‫א‬01
K‫א‬‫א‬
‫א‬‫א‬‫א‬
 K‫א‬‫א‬
Gray Coding‫א‬٤ J٩
 
 ‫א‬‫א‬‫א‬‫א‬EFrank Gray‫א‬F‫א‬
‫א‬‫א‬‫א‬‫א‬E Reflected Binary CodeF
‫א‬‫א‬K‫א‬‫א‬
 W‫א‬‫א‬‫א‬‫א‬‫א‬
 
 KE‫א‬‫א‬F‫א‬‫א‬‫א‬  J
KEADCF‫א‬‫ א‬ J
K‫א‬‫א‬  J
K‫א‬‫א‬  J
 
 W‫א‬‫א‬‫א‬‫א‬
 
 W‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
 
 K‫א‬‫א‬ K١
K‫א‬‫א‬‫א‬EMost Significant BitF‫א‬‫א‬ K٢

-١٧٩-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
‫א‬‫א‬‫א‬‫א‬‫א‬E Modulo 2‫א‬F K٣
K‫א‬‫א‬‫א‬
    ‫א‬ ‫א‬      ٣  ‫א‬ K٤
K‫א‬
 
 
 ٤ J٩
 K‫א‬1 0 0 1 0 0 1 ‫א‬‫א‬

1001001‫א‬ K١
E‫א‬‫א‬F1←1E‫א‬F‫א‬‫א‬ K٢
1←10‫א‬‫א‬‫א‬1 K٣
0←00‫א‬‫א‬‫א‬0 K٤
   1←11‫א‬‫א‬‫א‬0
  1←10‫א‬‫א‬‫א‬1
  0←00‫א‬‫א‬‫א‬0 
 E‫א‬‫א‬F1←11‫א‬‫א‬‫א‬0
 
 1 1 0 1 10 1W‫א‬‫א‬‫א‬‫א‬
 
 
 ٥ J٩
 K‫א‬K4
 
 W‫א‬
 K٥ J٩‫א‬‫א‬‫א‬،‫א‬‫א‬‫א‬
 

-١٨٠-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 W‫א‬E‫א‬‫א‬‫א‬F1101
 
 1‫א‬‫א‬
 
 W‫א‬‫א‬
1 + 1 = 0 → 0, 1 + 0 = 1 → 1, 0 + 1 = 1 → 1
 
 1 0 1 1‫א‬
 
 EN = 4 BitsF‫א‬٥ J٩
 ‫א‬  ‫א‬‫א‬ ‫א‬‫א‬
Gray Code Binary Value Decimal Value
0000 0000 0
0001 0001 1
0011 0010 2
0010 0011 3
0110 0100 4
0111 0101 5
0101 0110 6
0100 0111 7
1100 1000 8
1101 1001 9
1111 1010 10
1110 1011 11
1010 1 10 0 12
1011 1101 13
1001 1110 14
1000 1111 15
 

-١٨١-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 W‫א‬‫א‬‫א‬‫א‬
 
 W‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
 K‫א‬‫א‬ K١
K‫א‬‫א‬‫א‬EMost Significant BitF‫א‬‫א‬ K٢
‫א‬‫א‬‫א‬‫א‬‫א‬E Modulo 2‫א‬F K٣
K‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬
‫א‬    ‫א‬       ٣  ‫א‬ K٤
 K‫א‬
 ٦ J٩
 K‫א‬1 1 0 1 1 0 1 ‫א‬‫א‬
 
 W‫א‬
 
1 1 0 1 1 0 1‫א‬ K١
E‫א‬‫א‬F1← 1E‫א‬F‫א‬‫ א‬K٢
0← 01‫א‬‫א‬1 K٣
0← 00‫א‬‫א‬0 K٤
   1←11‫א‬‫א‬0
  0←01‫א‬‫א‬1
 0←00‫א‬‫א‬0 
 E‫א‬‫א‬F1←11‫א‬‫א‬0
 
 1 0 0 1 0 0 1W‫א‬‫א‬‫א‬‫א‬‫א‬
 

-١٨٢-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 
 
‫؟‬‫א‬‫א‬‫א‬ K١
‫؟‬‫א‬‫א‬‫א‬ K٢
‫؟‬‫א‬‫א‬‫א‬ K٣
‫؟‬‫א‬‫א‬ K٤
K٦ J٩‫א‬‫א‬ K٥
K‫א‬
 ٦ J٩
‫א‬‫ א‬ ‫א‬
 0.24 X1
 0.21  X2
 0.2  X3
 0.12  X4
 0.1  X5
 0.08  X6
0.04 X7
0.01 X8
 
K‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬‫א‬‫ א‬K٦
K‫א‬‫א‬ K٧
K‫א‬ K٨
W‫א‬‫א‬ K٩
 
m،‫א‬‫א‬ n،‫א‬ k،‫א‬
     2
    5

     7
     8
-١٨٣-
 ‫א‬‫א‬  ٢٣١  ‫א‬
 ‫א‬  ‫א‬‫א‬  ‫א‬ 
 
 K‫א‬K01011101110101010 K١٠
W‫א‬ ‫א‬‫א‬ K١١
 
‫א‬ ‫א‬‫ א‬ ‫א‬
Data Word Decimal Value Code Word
 0 0 0  0  
001  1  
010  2  
011  3  
 1 0 0  4  
101  5  
110  6  
11 1  7  

‫؟‬‫א‬ K١٢
‫؟‬‫א‬ K١٣
 K‫א‬1 1 0 1 0 1 1 ‫א‬‫א‬ K١٤
 K‫א‬1 0 0 0 1 0 1 ‫א‬‫א‬ K١٥
W‫א‬‫א‬ K١٦

 ‫א‬  ‫א‬‫א‬ ‫א‬‫א‬

Gray Code Binary Value Decimal Value
0 0 0 0
0 0 1 1
0 1 0 2
0 1 1 3
1 0 0 4
1 0 1 5
1 1 0 6
1 1 1 7
-١٨٤-