Professional Documents
Culture Documents
I Unsupervised Learning
I Dimensionality Reduction
I K-means Clustering
Agenda
Clustering
2
What is Unsupervised Learning
Unsupervised Learning
3
Unsupervised Learning
I Examples:
I Clustering - Grouping observed data into unlabeled clusters
I identifying social circles, summarizing observed data etc.
5
Dimensionality Reduction - Applications
7
Dimensionality Reduction - Toy Example
8
Dimensionality Reduction - Toy Example - Findings
9
Dimensionality Reduction - Principle Component Analysis
10
Dimensionality Reduction - PCA (contd. . . )
N
1 X 2
Var({x̃n }N
n=1 ) = x̃n − E[x̃n ]2
N
n=1
N
X N
X
x̃2n − E[x̃n ]2 = u| xn x|n u
n=1 n=1
|
Note that N
P
n=1 xn xn is the covariance matrix X of
I
1 |
Var({x̃n }N
n=1 ) = u Xu
N 11
Dimensionality Reduction - PCA (contd. . . )
u∗ = arg max u| Xu
u:||u||=1
14
PCA Example
15
PCA Example
16
Clustering
Clustering
17
Clustering (contd. . . )
Hierarchical
Clustering 20
Clustering - Popular Algorithms
I Spectral clustering
I etc.
21
Clustering - k-Means
Limitations of k-Means: