Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Save to My Library
Look up keyword or section
Like this
1Activity

Table Of Contents

INTRODUCTION
INFORMATION MEASURE
SELF-INFORMATION, UNCERTAINTY
ENTROPY
SOURCE CODING
ENGLISH LANGUAGE
ENTROPY OF A SOURCE
ENTROPY RATE
THE SOURCE CODING PROBLEM
ELEMENTARY PROPERTIES OF CODES
SOURCE CODING THEOREM
COMPRESSION ALGORITHMS
SHANNON-FANO ALGORITHM
HUFFMAN ALGORITHM
LZ 78 ALGORITHM
LZW ALGORITHM
COMMUNICATION CHANNELS
CHANNEL CAPACITY
THE NOISY CHANNEL THEOREM
ERROR CORRECTING CODES
CONSTRUCTION
NEAREST NEIGHBOUR DECODING
LINEAR CODES
GENERATOR MATRIX
PARITY-CHECK MATRIX
EXERCISES
INFORMATION MEASURE EXERCISES
EXERCISE 1
EXERCISE 2
SOURCE CODING EXERCISES
COMMUNICATION CHANNEL EXERCISES
ERROR CORRECTING CODE EXERCISES
SOLUTIONS
INFORMATION MEASURE SOLUTIONS
SOURCE CODING SOLUTIONS
ERROR CORRECTING CODES SOLUTIONS
BIBLIOGRAPHY
INDEX
0 of .
Results for:
No results containing your search query
P. 1
Basic Concept in Information Theory

Basic Concept in Information Theory

Ratings: (0)|Views: 5 |Likes:
Published by deepiiitbhu
Most scientists agree that information theory began in 1948 with Shannon’s famous article. In
that paper, he provided answers to the following questions :
- What is “information” and how to measure it?
- What are the fundamental limits on the storage and the transmission of information?
The answers were both satisfying and surprising, and moreover striking in their ability to reduce complicated problems to simple analytical forms. Since then, information theory has kept on designing devices that reach or approach these limits.
Most scientists agree that information theory began in 1948 with Shannon’s famous article. In
that paper, he provided answers to the following questions :
- What is “information” and how to measure it?
- What are the fundamental limits on the storage and the transmission of information?
The answers were both satisfying and surprising, and moreover striking in their ability to reduce complicated problems to simple analytical forms. Since then, information theory has kept on designing devices that reach or approach these limits.

More info:

Published by: deepiiitbhu on Jun 27, 2013
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

09/20/2013

pdf

text

original

You're Reading a Free Preview
Pages 4 to 87 are not shown in this preview.
You're Reading a Free Preview
Pages 91 to 111 are not shown in this preview.

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->