You are on page 1of 2

# EE-850 Information Theory & Coding

Fall 2011 Class MS Electrical Engineering (Telecom) Pakistan Navy Engineering College National University of Sciences & Technology

Introduction
Information Theory is the branch of knowledge which tries to determine answers to questions like: What is the information carrying capacity of a communication channel? How many bits are required at a minimum to represent a certain type of information? How secure is an encryption algorithm? Information is a loaded word information means many different things in different contexts. Internet is now a part and parcel of our life: packets carry information across the globe. Cellular phones are ubiquitous: we can't think of life without them. DVD, Flash, Hard Disk: allow us to carry tremendous amounts of information. Email: has changed the nature of business and personal communication. Instant Messaging: has made presence awareness and collaboration real-time. Even in the military arena terms like Information Warfare, Psychological Operations, Network Centric Warfare and Situational Awareness are all the contexts in which information is playing a critical role. In this course we shall remain confined to the mathematical and engineering aspects of information measurement and representation. We shall understand the principles behind theoretical limits on compression, error control and encryption coding techniques. The list of topics to be covered is given below: Introduction to Information Theory Mathematical Background Entropy and Shannon's Measure of Information Huffman Coding Lempel-Ziv Coding Deflate Arithmetic Coding Run Length Encoding JPEG Image Compression Speex Audio Codec Finite Fields Complexity Theory Error Control Principles Parity CRC Hamming Codes Reed Solomon Codes RSA Diffie-Hellman Elliptic Curve Cryptography Data Encryption Standard Advanced Encryption Standard

Textbook
Information Theory Coding & Cryptography Ranjan Bose Tata McGraw-Hill Publishing Company

## EE-850 Information Theory & Coding Course Outline

Page 1 of 2

Class Timings
Monday: 18:00-21:00, PG-008 or PGPC Lab, Center for Postgraduate Studies

Homeworks Quizzes Hourly Tests Final Exam 10% 10% 30% 50%

Quizzes shall be surprise and frequent. Homeworks will be due at the beginning of the class. No late homework will be accepted. Final course grades shall be assigned based on the relative grading system in practice at Pakistan Navy Engineering College.

## Hourly Test Schedule

Test No. 1. 2. 3. Day Monday Monday Monday Date October 24, 2011 November 28, 2011 December 19, 2011

Plagiarism Policy
All work assigned to students is to be undertaken and submitted in individual capacity. Any evidence of plagiarism will be severely dealt with as per NUST Policy.