Professional Documents
Culture Documents
QUE-1 (1). Prove the statement stated as under: “If a receiver knows the message being transmitted, the amount
of information carried will be zero”.
(2). What is the Entropy? Write down the properties of entropy. (5)
QUE-2 (1). What is the Shannon–Fano Coding? Write down the procedure of this coding? Apply the Shannon–
Fano coding procedure for a given ensamble message.
X x1 , x2 , x3 , x4 , x5 , x6 , x7 , x8 , Assume M=2.
P 1 4,1 8 ,1 16 ,1 16,1 16,1 4,1 16,1 8
(2). Apply the Huffman coding procedure for the given ensamble message-
X x1 , x2 , x3 , x4 , x5 , x6 , x7
, Assume M=2 (5)
P 0.4, 0.2, 0.12, 0.08, 0.08, 0.08, 0.04
QUE-3. (1). What is the Binary Symmetric Channel (BSC)? Calculate the formula of capacity of Binary Symmetric
(2). What do you mean by Mutual Information? Write down the properties of Mutual Information.
(3). Explain the source coding theorem. (5)