Siddaganga Institute of technology, Tumkur-03 A1 Dept of Telecommunication Engineering Sub: Information Theory and Coding Faculty: Naveenkumar M Date:

Quiz No: 1 USN/Name: Max. Marks: 15 Duration: 30 mins

1. Define self information and write equation for the same. (1-M)

2. A universal set consists of numbers 1 to 10. Let A ={1,2,3} , B={3,4,5,6} and C={1,5,7,8}. List the numbers of the following sets. (2-M) a) b)

3. Explain Mutually Exclusive property with an example.

(2-M)

4. A code is composed of dots and dashes. Assume that the dash is 3 times as long as the dot and has one-third the probability of occurrence. (i) Calculate the information in dot and that in a dash; (ii) Calculate the average information in dot-dash code; and (iii) Assume that a dot lasts for 10 ms and this same time interval is allowed between symbols. Calculate the average rate of information transmission. (4-M)

5. For the Markoffs source shown below, calculate i) Entropy of the source ii) Draw tree diagram for 2 symbol sequences iii) Calculate probabilities of messages of length 1 and 2 iv) information content of messages of length two, v) Average information content per symbol in messages of length two. (6-M)