Code: 15EC1125 /2015 R-2015 A1

GAYATRI VIDYA PARISHAD COLLEGE OF ENGINEERING

Madhurawada, Visakhapatnam

( An Autonomous Institution, Affiliated to JNTUK, KAKINADA)

B.Tech VI-Semester Regular examinations, April-2019

INFORMATION THEORY AND CODING

Professional Elective

[Electronics and Communication Engineering]

Time: Three hours Max. Marks: 70M

1. Answer ONE Question from each unit.

2. All parts of a question must be answered in one place to get valued
3. All Question carry equal marks

_______________________________________________________________________________________

UNIT-I

1. a Define Mutual Information. Explain the Properties of Mutual 7M

Information.

b A binary source with B(0)=0.25 B(1)=0.75 the binary source is 7M

extended in such a way to generate 3 rd extension calculate the
entropy of extended source s3 and verify using extension property.

(OR)
2. a Define entropy. What are the properties of entropy? Explain the 7M
Joint and Conditional Entropies.

b Source S1 and S2 emits symbols x1, x2, x3 and y1, y2, and y3 in 7M
accordance with the following joint probability density for P(x,y).
Find H(x),H(y),H(y/x) and H(x,y)
3 / 40 1/40 1/40
1/20 3/20 1/20
1/8 1/8 3/8
¿
rli
¿
¿
|¿||¿|¿
P ( x i , y i ) =¿ ¿
¿

UNIT-II

3. a Explain the channel coding theorem. 6M

b Given a binary channel shown in figure (i) find the channel matrix 8M
of the channel (ii) Find P(y1) and P(y2) when P(x1)=P(x2)=0.5 (iii) Find
the probabilities P(x1,y2) and P(x2,y1) when P(x1)=P(x2)=0.5
 0.9
P(x1) x1 y1
0.1

0.2
P(x2) x2 y2
0.8
(OR)
4. a Derive the channel capacity for water filling channel 6M
b A channel has following channel matrix 8M

1-p p 0
0 p 1-p
¿
righ
¿
¿
¿
[ ¿ ] ¿
P ( Y | X )= ¿ ¿
¿

Draw the channel diagram, If source has equally likely outputs,

compute the probabilities associate with the channel outputs for
p=0.2

UNIT-III

5. a Develop Huffman code for a source which emits 8 symbols. 7M

X= { x1, x2, x3, x4, x5, x6 , x7, x8}

P= {0.25,0.25,0.125,0.125,0.0625,0.0625,0.0625,0.0625} Find the

efficiency of this code

b Explain the hamming code with suitable example 7M

(OR)
6. a Consider Lempel Ziv encoding for quaternary data ( symbols: 7M
0,1,2,3) Encode the following quaternary data: 1 3 3 0 0 2 0 2 1 1
1 3 0 0 0 0 2 2 1 2 2 2 3 3. What is the compression ratio.

b Explain the bandwidth limits of Shannon Hartley/ Shannon’s 7M

capacity theorem.
 UNIT-IV

7. a What are cyclic codes and briefly describe the different classes of cyclic 7M
codes
b A rate 2/3 convolution code is described by g1= [1011], g2=[1101], 7M
g3=[1010], Draw the encoder, code tree
(OR)
8. a 6M
Define and clearly explain the following
(i) Generator matrix
(ii) Systematic linear block codes
(iii) Parity check matrix
b Draw and explain a decoder diagram for a (7,3) cyclic code whose 8M
generator polynomial g(x)=1+x+x3

UNIT-V

9. a Explain the Reed-solomon encoding 7M

b State and explain the Vierbi algorithm 7M
(OR)
10. a Explain the principal and significance of turbo codes 6M
b Explain the terms i) LDPC codes ii) Galois fieds 8M

***