Department of Electronics & Communication Engineering

Course Code: (BECE-521)

Course Title: Information Theory & Coding
Assignment: 5 Total marks: 24
Note:
1. Part (A) consists 4 questions each of 01 marks
2. Part (B) consists 3 questions each of 02 marks.
3. Part (C) consists 2 questions each of 04 marks.
4. Part (D) consists 1 question of 06 marks.

Sr. No. Part (A) Marks

1 What is the condition of Kraft inequality? 1

2 Write down the condition of uniquely decodable codes. 1
3 Define efficiency of code. 1
4 Draw11000110 in Polar Quaternary NRZ format. 1

Part (B)
5 Write down the steps involved in construction of Shannon-fano algorithm . 2
6 What is the significance of split phase is preferred in line coding. 2
7 What is universal coding? 2

Part (C)
8 Explain encoding and decoding process for the sequence xyxxyxyyzx using 4
LZW technique.
9 There are four symbols a, b, c and d with the probabilities of .40, .30, 0.20, & 4
0.10 respectively. Find out the codeword assign to each symbol with Shannon
Fano Elias Coding.
Part (D)
10 Four symbols emitted from a source have the probabilities 1/2, 1/4, 1/8, and 1/8. 6
Find the optimum code using Huffman algorithm. Calculate the coding
efficiency and the average length of the code.