PES INSTITUTE OF TECHNOLOGY

BANGALORE SOUTH CAMPUS,

HOSUR ROAD, ELECTRONIC CITY, BANGALORE – 560100
LESSON - PLAN
INFORMATION THEORY AND CODING
Subject Code : 15EC54 IA Marks : 20
Hours/Week : 04 Exam. Hours : 03
Total Hours : 50 Exam. Marks : 80
Faculty: Dr. Prashant Wali
Class Module No Topic to be Covered % of portions
/Chapter names covered
Ref. Cum
1. Module -1 Introduction, Measure of information 20% 20%
2. Information Information content of message
3. Theory Problems
4. Average Information content of symbols in Long
Independent sequences
5. Problems
6. Average Information content of symbols in Long
dependent sequences, Markov Statistical Model of Information
Sources.
7. Problems
8. Problems
9. Entropy and Information rate of Markoff Sources
10. Problems

11. Module-2 Source coding theorem, Prefix Codes 20% 40%

12. Source Coding Kraft McMillan
Inequality property – KMI
13. Encoding of the Source Output

14. Shannon’s Encoding Algorithm

15. Shannon Fano Encoding Algorithm, Huffman codes

16. Extended Huffman
coding, Arithmetic Coding
17. Lempel – Ziv Algorithm
18. Problems
19. Problems
20. Problems

21. Module -3 Communication Channels 20% 60%

22. Channel Models, Channel Matrix
23. Joint probabilty Matrix, Binary
 Symmetric Channel
24. Information System Entropies, Mutual Information, Channel
Channels Capacity
25. Channel Capacity of : Binary Symmetric Channel, Binary
Erasure Channel
26. Muroga,s Theorem, Contineuos Channels
27. Problems
28. Problems
29. Problems
30. Problems

31. Module -4 Introduction, Examples of Error control coding 20% 80%

32. Error Control methods of Controlling
Coding & Errors, Types of Errors
33. types of Codes, Linear Block Codes
34. Binary Cyclic Matrix description of Linear Block Codes, Error Detection and Error
Codes Correction
Capabilities of Linear Block Codes
35. Single Error Correcting hamming
Codes
36. Table lookup Decoding using Standard Array
37. Algebraic Structure of Cyclic Codes, Encoding using
an (n-k) Bit Shift register
38. Syndrome Calculation, Error Detection and
Correction
39. Problems
40. Problems
41. Module -5 Golay Codes, BCH Codes
42. Some Important Convolution Encoder, Time domain approach 20% 100%
43. Cyclic Codes Transform domain approach .
44. & Code Tree, Trellis and State Diagram
45. Convolution Problems
46. Codes Problems
47. Problems
48. The Viterbi Algorithm
49. The Viterbi Algorithm
50. Problems

Text Books:
Title & Author

Text Digital and analog communication systems, K. Sam Shanmugam, John Wiley
India Pvt. Ltd, 1996
Text Digital communication, Simon Haykin, John Wiley India Pvt. Ltd, 2008
Reference Information Theory and Coding, Muralidhar Kulkarni, K.S. Shivaprakasha, Wiley
India Pvt. Ltd, 2015, ISBN:978-81-265-5305-1.