Assignment –I

Subject: information Theory and Coding (DEEC-14607)

Date of allotment: 18.3.2020

Date of submission: 25.3.2020

Q1. (a) The probability matrix of the channel with binary input is given below.
Find H(X), H(Y), H(X/Y), H(Y/X) and H(X,Y).

P ( x , y )= 1 /4 1/4
[ 1 /4 1/4 ]
[hint: p(x1)=p(x2)=1/2]

(b)Determine the Lampel-ZIV for the following bit stream

11101001100010110100.

Q2. (a) Find the capacity of the channel shown in figure

(b) Concept the (7,4) LBC, the parity information is given by

b 0=m 0 ⊕ m1 ⊕ m2

b 1=m0 ⊕m2 ⊕ m3

b 2=m 1 ⊕m 2 ⊕ m 3

Give the code word for the message vector 1110 and correct the error if the
error had occurred in the position c 5 of the code word.
Course outcomes achieved:-

CO1 Apply the knowledge of various channel coding techniques for effective
communication in digital systems.
CO2 Construct the linear block codes for detecting error while transmission of
data in digital communication system