MACHINE LEARNING

FOR
SIGNAL PROCESSING
19-1-2022
Sriram Ganapathy
Electrical Engineering, Indian Institute of Science,
sriramg@iisc.ac.in

Debarpan Bhattacharya Hariom Choudhary Praneeth Linga Reddy

EE, IIIS, CSA, IISC ECE, IISC
debarpanb@iisc.ac.in hariomc@iisc.ac.in praneethl@iisc.ac.in

http://leap.ee.iisc.ac.in/sriram/teaching/MLSP22/

 Whitening the Data

Original Data Standardization Whitening

PRML - C. Bishop (Sec. 12.1)

PCA for High PRML Book

Dimensional Data
12.1.4
Linear Discriminant Analysis
(PRML 4.1.4)

Without the Within Class Factor

 Linear Discriminant Analysis
Find a linear transform with a criterion which
maximizes the class separation

• Maximize the between class distance in the projected space

while minimizing the within class covariance

❖ Generalized Eigenvalue problem

❖ Eigenvectors of PRML - C. Bishop (Sec. 4.1.4, Sec. 4.1.6)

 Linear Discriminant Analysis

Projecting on line joining means Fisher Discriminant

PRML - C. Bishop (Sec. 4.1.4, Sec. 4.1.6)

PCA versus LDA
PCA versus LDA

PCA
LDA

PRML - C. Bishop (Sec. 4.1.4, Sec. 4.1.6)

Representations of data
 Knowledge based representations

❖ Text representations
❖ Audio representations
 Text representations

❖ Bag of words model

❖ Term frequency - inverse document frequency