SYLLABUS

Course Type Elective

Course Code EE623
Course Name Korean
Course Name English Information Theory
Name Hye Won Chung
Lecture:Exp.:Credit(Homework) 3:0:3
Mutually Recognized Course(BS/MS) : ( X ) Term : Fall
This course is a graduate-level introduction to information theory. Information theory is one of the most
elegant mathematical theories, with a direct and significant impact to our lives in the information age. In
Descriptions
this class, we will learn how to model the information transmission/processing system, with applications
of Courses
of data science as well as communications, and analyze the model from information-theoretical
perspectives to derive fundamental limits on what is possible on the system.

Schedule
Period Topics Remarks
Motivation and applications of information theory;
Week 1
Definitions and properties of information-theoretic quantities
Week 2 Operational meanings of info-theoretic quantities; Weak AEP
Week 3 Data compression
Week 4 Method of types and strong AEP
Week 5 Large deviations and exponential family
Week 6 Error exponents
Week 7 Information theory and statistics I
Week 8 Mid-term exam

Week 9 Discrete memoryless channel; Channel coding theorem

Week 10 Alternative proof of channel coding theorem
Week 11 Error exponent, Forneys proof of channel coding theorem
Week 12 Linear codes
Week13 Information theory and statistics II
Week 14 Rate distortion theorem
Week 15 Feedback channels; network information theory
Week 16 Final exam

* Laboratory topics should be given in Remark for courses with lab hours.

Name of Professor : Hye Won Chung Sign

Chairman : Sign