Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Standard view
Full view
of .

INTRODUCTION
INFORMATION MEASURE
SELF-INFORMATION, UNCERTAINTY
ENTROPY
SOURCE CODING
ENGLISH LANGUAGE
ENTROPY OF A SOURCE
ENTROPY RATE
THE SOURCE CODING PROBLEM
ELEMENTARY PROPERTIES OF CODES
SOURCE CODING THEOREM
COMPRESSION ALGORITHMS
SHANNON-FANO ALGORITHM
HUFFMAN ALGORITHM
LZ 78 ALGORITHM
LZW ALGORITHM
COMMUNICATION CHANNELS
CHANNEL CAPACITY
THE NOISY CHANNEL THEOREM
ERROR CORRECTING CODES
CONSTRUCTION
NEAREST NEIGHBOUR DECODING
LINEAR CODES
GENERATOR MATRIX
PARITY-CHECK MATRIX
EXERCISES
INFORMATION MEASURE EXERCISES
EXERCISE 1
EXERCISE 2
SOURCE CODING EXERCISES
COMMUNICATION CHANNEL EXERCISES
ERROR CORRECTING CODE EXERCISES
SOLUTIONS
INFORMATION MEASURE SOLUTIONS
SOURCE CODING SOLUTIONS
ERROR CORRECTING CODES SOLUTIONS
BIBLIOGRAPHY
INDEX
0 of .
Results for:
P. 1
Basic Concept in Information Theory

# Basic Concept in Information Theory

Ratings: (0)|Views: 5 |Likes:
Most scientists agree that information theory began in 1948 with Shannon’s famous article. In
that paper, he provided answers to the following questions :
- What is “information” and how to measure it?
- What are the fundamental limits on the storage and the transmission of information?
The answers were both satisfying and surprising, and moreover striking in their ability to reduce complicated problems to simple analytical forms. Since then, information theory has kept on designing devices that reach or approach these limits.
Most scientists agree that information theory began in 1948 with Shannon’s famous article. In
that paper, he provided answers to the following questions :
- What is “information” and how to measure it?
- What are the fundamental limits on the storage and the transmission of information?
The answers were both satisfying and surprising, and moreover striking in their ability to reduce complicated problems to simple analytical forms. Since then, information theory has kept on designing devices that reach or approach these limits.

Published by: deepiiitbhu on Jun 27, 2013

### Availability:

Read on Scribd mobile: iPhone, iPad and Android.
See more
See less

09/20/2013

pdf

text

original

You're Reading a Free Preview
Pages 4 to 87 are not shown in this preview.
You're Reading a Free Preview
Pages 91 to 111 are not shown in this preview.

## Activity (1)

You've already reviewed this. Edit your review.