Digital Communications (EEN-321)

Assignment # 2 Date: 22nd -09-2019

Q1. a) Design a ternary Huffman code using 0,1,and 2 as letters, for a source with output
alphabet probabilities given by {a=0.05, b=0.15, c=0.1, d=0.13, e=0.22, f= 0.17, g=0.18}.

b) What is the resulting average codeword length Lavg ?

c) Compare the average codeword length with the entropy of the source? (In what base
would you compute the logarithms in the expression for the entropy for a meaningful
comparison?)

7+2+6 Marks
Q2. Determine the capacities of the channels shown below: 7.5+7.5 Marks

1/2

1/2
1/2

1/2 1/2

1/6
1/3

1/2 1/6
1/2
1/2

1/3

1/2 1/3
1/2 1/6

1/2

Q3. a) Use hamming (7, 4) to encode the following bit stream 1010 10+10 Marks
b) Decode the received sequence 1110 by determining the syndrome. Identify the bit in
Error. Also correct that error.
Q4. Consider a RV X, Which can take one of seven values as per probabilities below:
P(x1=0.49), P(x2=0.26), P(x3=0.12), P(x4=0.04), P(x5=0.04), P(x6=0.03), P(x7=0.02)
a. Find Huffman code for X
b. Find the average codeword length using the code found in (a)
c. Compare answer of (b) with Entropy of X
d. Compute Kraft’s inequality for this random variable
10+3+3+4=20Marks

NOTE:

1. Submission deadline 29-Nov-2019, 01:15 PM Sharp.

2. Late assignments will not be accepted.
3. Theory covered in assignments will be a part of quizzes/exams.
4. Plagiarized assignments will straightly be marked to zero.