BIRLA INSTITUTE OF TECHNOLOGY AND SCIENCE, Pilani

Pilani Campus

Instruction Division
First Semester, 2023-2024
Course Handout (Part II)
Date: 10.01.2024
In addition to Part I(General Handout for all courses appended to the Time Table), this
portion gives further specific details regarding the course.

Course No : ECE F344

Course Title : Information Theory and Coding
Instructor-in-charge : K. K. GUPTA
Tut. Instructors : Sainath Bitragunta, K. K. Gupta

1. Course Description: 3 0 3
Information source and source coding theorem, Kraft inequality, Shannon-Fano
codes, Huffman codes, Arithmetic codes, Lempel-Ziv-Welch algorithm, universal source
codes; Channel capacity: channel capacity; noisy channel coding theorem for discrete
memory less channel; error control coding; linear block codes and their properties, low
density parity check codes, BCH codes, Reed-Solomon codes, Cryptography: basic
concepts on cryptography and crypto analysis, security issues; private-key encryption
algorithms stream ciphers, block ciphers, RSA cryptosystem.

2. Scope & Objective:

The course covers source coding, channel coding & encryption. The former deals
with error correction in noisy channel, and the latter deals with secrecy of
communication. Channel coding, which constitutes the major portion of the course, will
introduce a number of important classes of error-detecting and error-correcting codes
and their decoding. Finally, the course will give an introduction to encryption &
decryption of data for secret communication.

3. Text Books:
Information theory, Coding and Cryptography, 3rd Ed., Ranjan Bose, Tata McGraw
Hill, 2016.

4. Reference Books:
1. Element of Information Theory, Thomas M Cover, John Wiley & Sons, 2004
2. Error Correction Coding, Todd K. Moon, Wiley, 2006.
3. Information Theory, Inference and Learning Algorithms, David Mackay,
Cambridge University Press, 2003.

5. Course Plan:
Lecture Learning Objectives Topics to be covered Reference to

Please Consider Your Environmental Responsibilities

Do Not Print Unless Necessary
 BIRLA INSTITUTE OF TECHNOLOGY AND SCIENCE, Pilani
Pilani Campus

No. Text Book

1-2 Introduction to information Measure of Information 1.1 to 1.2
Theory
3-5 Average Mutual Information Concept of Binary Symmetric 1.3
and Entropy channel, conditional entropy,
differential entropy.
6-7 Source coding Theorem Fundamental of source coding 1.6
8 -9 Huffman coding, Shannon- To introduce Universal coding 1.7, 1.8
Fano-Elias coding
10 - 11 Arithmetic coding, The To introduce optimal codes 1.9 - 1.13
Lempel-Ziv algorithm, run
length encoding, rate
distortion function
12 - 13 Channel capacity and To understand channel 2.1 - 2.9
Models capacity & noisy coding
theorem
14 - 16 Block codes for error Introduction to error correcting 3.1 - 3.2
correction codes
17 - 20 Matrix description of linear Parity check matrix, decoding 3.3 to 3.6
block codes of a linear code
21 Syndrome decoding Design of decoders for error 3.7
control
22 Hamming Codes, LDPC Examples of algebraic error 3.10 - 3.11
control codes
23 - 25 Cyclic codes Division algorithm for cyclic 4.1 - 4.3
codes
26 - 27 Matrix description of cyclic Generator and parity check 4.4 - 4.5
codes matrix
28 - 29 BCH codes, Reed-Solomon Generator polynomials, 5.1 - 5.8
code Minimal polynomials
30 - 35 Convolution codes, Viterbi To introduce the important 7.1 7.11
decoding, turbo codes class of convolution coder and
decoders
36 - 38 Cryptography; Models, goals Overview of encryption 9.1 - 9.7
and early cipher systems techniques, symmetric key
cryptography
39 - 40 Public Key Cryptosystems The RSA algorithm 9.8 - 9.9
and some examples
Asymmetric key
Cryptography

Please Consider Your Environmental Responsibilities

Do Not Print Unless Necessary
 BIRLA INSTITUTE OF TECHNOLOGY AND SCIENCE, Pilani
Pilani Campus

6. Evaluation Scheme:

Evaluation Duration Weightage Date, Time Remarks

Component
Mid-semester 90 Minutes 30% Closed Book
Test
Quizzes best 3 30 Minutes 15% Closed Book
of 4
Study of Four weeks 15% To be announced in class Open Book
advance topics
Comprehensive 3 Hours 40% Partly open
Examination book

7. Chamber Consultation Hour: To be announced in the class.

8. Notices: Notices concerning the course will be put up on the NALANDA notice board
only.

Instructor-in-Charge
ECE F344

Please Consider Your Environmental Responsibilities

Do Not Print Unless Necessary