Communications and Knowledge Engineering

Institute of Engineering
Paschimanchal Campus
Lamachour , Pokhara

Er. Santosh Kumar Baral

Er. Suraj Basant Tulachan
 1.Objectives of Course
 2. Course Outline
 3. Marking Scheme
 4.References
◦ Fundamentals and elements of Digital
Communication System
◦ Concepts of Digital Transmitters, Modulation and
Transmission through band limited channels
◦ Concepts on Random Processes
◦ Concepts and properties of Random Wireless
Channels
◦ Concepts on Information sources and source coding
Theories
◦ Digital Transmission through AWGN channel
◦ Detection and Estimation of signals, optimum
receivers, Rake Receivers, Equalization
◦ Current Trends in Communication System
◦ Principles and performance requirements for a real
world Communication System
◦ Course Code:
◦ Credit Hours: 4
◦ Lecture Hours: 60 Hrs
◦ Attendance : 80% minimum
◦ Class Activity:
 Group Activity
 Lecture
 Presentation of Technical Papers (once a month)
 By Lecturer
 By Student
 Home Assignments (carry certain internal Marks)
 Internal Assessments (40 Marks divided)
 External Exam (60 Marks)
1. Entropy and Mutual Information
2. Rate Distortion Theory
3. Souce Coding and Information Theory
4. Channel Characterization
5. Detection and Estimation of signal through
Gaussian, Releigh and Ricial Channels
6. Digital Modulation Schemes
1. BPSK, QPSK,TCM,GMSK
7. Digital Transmission of Signal over
1. Band Limited Channels
2. Fading Channels
8. Digital Receiver Techniques
1. Equalizers
2. Rake Receivers
3. Optimum Receivers
 Definitions:
◦ probability, union, intersection, Axioms of probability, joint
events and joint probabilities, conditional probabilities, Baye’s
Theorem, Statistic independence, Random variables Discrete
Random variables, Finite Random variable, continuous Random
Variable
 Useful Discrete Random Variables
◦ Bernouli Random Variable, Geometric Random variable,
Binomial Random variable, Pascal Random variable, Discrete
Uniform Random variable, Poisson Random Variable
 Probability Mass Function(PMF), Cumulative
Distribution Function (CDF), Probability Density
Function(PDF)
 Multiple Random Variables, Conditional Probability
Distribution Function,
 Functions of Random Variables
 Statistical Averages of Random Variables
 Variance
 Standard Deviations
 Covariance
 Correlation
 Characteristic Functions
 Useful Continuous Random Variables
 Uniform Random Variable
 Erlang Random Variable
 Gaussian Random Variable
 Chi-Square Distributed Random variable
 Rayleigh Random Variable
 Rician Random Variable
 Nakagami m-distributed Random Variable
 Multivariate Gaussian Distribution
 ◦ Upper Bounds on the Tail Probability
◦ Central Limit Theorem
◦ Sum of Random Variables and Central Limit Theorem

 Stochastic Process
 Definition,
 Stationary Stochastic Process
 Averages of stochastic Process
 Power Density Spectrum
 LTI Response to a Random Input Signal
 Cyclostationary Process
 Basic Digital Communication System
 Information Sources
 Source Entropy
 Joint and Conditional Entropy
◦ Average Mutual Information
◦ Properties of Mutual Information
◦ Relationship between Entropy and Mutual Information
◦ Conditional Mutual Information
◦ Entropy Rate
◦ The Asymptotic Equipartition Property (AEP)
◦ Differential Entropy
◦ AEP for Random Variables
 Properties of Differential Entropy, Relative Entropy and
Mutual Information
◦ Source Coding
 Source Coding Theorem
 Variable Length coding
 Huffman Coding Algorithm
 Lampel Ziv Algorithm
◦ Channel Coding
 Channel Capacity
 Modeling channels
 Rate Distortion Theory
 Calculation of Rate Distortion Function for Binary and
Gaussian Source
 Coding for Analog Source-Optimum Quantization
 Quantization
 Scalar quatization
 Vector quantization
 Optimum Receiver For Signals With AWGN
 Matched Filter
 Optimum Detector
 Maximum Liklihood Sequence Detector
 Signal Parameter Estimation
 Carrier Recovery and Symbol Synchronization
 Carrier Phase Estimation
◦ MLE Carrier Phase Estimation
◦ Phase Locked Loop (PLL)
◦ Effect of Additive Noise on Phase Estimate
◦ Decision Directed Loops (DLL)
◦ Decision Feedback PLL (DFPLL)
◦ Non Decision Directed Loops
◦ Squarring Loops
◦ Costas Loop
◦ MLE Timing Estimation
 Symbol Timing Estimation
◦ Maximum Likelihood Timing Estimation
 Signal Design for Band Limited Channel
◦ Nyquist Pulse Shaping criteria
◦ Representation of Band Pass Signals and Systems
◦ Representation of White Noise
◦ Correlation Demodulator
◦ Matched Filter Demodulation
◦ Optimum Detector
◦ MLE Sequence Detection
 1. John G Proakis , Digital Communications, Fifth Edition, Tata
MCGraw-Hill companies, Inc-2008
 2. John G Proakis and Masoud Salehi, Communication System
Engineering, Second Edition, Prentice Hall- 2002