Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Save to My Library
Look up keyword
Like this
1Activity
0 of .
Results for:
No results containing your search query
P. 1
Lecture 10

Lecture 10

Ratings: (0)|Views: 3 |Likes:
Published by samaher hussein
Dr. Samaher Hussein Ali
Dr. Samaher Hussein Ali

More info:

Published by: samaher hussein on Jan 25, 2013
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

05/08/2014

pdf

text

original

 
College
 
of 
 
Information
 
Technology,
 
University
 
of 
 
Babylon,
 
IraqSamaher_hussein@yahoo.com
ByDr.
 
Samaher
 
Hussein
 
Ali
LECTURE 
 
NOTES
 
ON 
 
INFORMATION 
 
THEORY 
 
 AND
 
FIVE 
 
TYPES
 
OF 
 
ENTROPY 
Department
 
of 
 
SoftwareThe
 
University
 
of 
 
Babylon
26
 
November
 
2012
 
Dr.
 
Samaher
 
Hussein
 
Ali
Information
 
Theory
Notes
 
of 
 
Lecture
 
10
26
 
November
 
2012
The concept of information is related to the signal transmitted through acommunication system. Every signals which converges information can bedescribed as uncertain or unpredictable. But not every signals which has thisdescription necessarily contain information. The information associated withoccurrence of an event is define as:I(
Xi
) = Log (
.
)I(
Xi
) = Log (

)=
Log(P(xi))whereI(
Xi
) self information associative the occurrence of an event{x} = {x 1, x2,…….xm}

)=
1
),
2
), ……….,

)
 
Dr.
 
Samaher
 
Hussein
 
Ali
Information
 
Theory
Notes
 
of 
 
Lecture
 
10
26
 
November
 
2012

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->