Professional Documents
Culture Documents
SPSS Tutorial Cluster Analysis
SPSS Tutorial Cluster Analysis
Cluster analysis
Lecture / Tutorial outline Cluster analysis Example of cluster analysis Work on the assignment
Cluster Analysis
It is a class of techniques used to classify cases into groups that are relatively homogeneous within themselves and heterogeneous between each other, on the basis of a defined set of variables. These groups are called clusters.
Steps to Cluster
1. 2. 3. 4.
conduct a Analysis
Select a distance measure Select a clustering algorithm Determine the number of clusters Validate the analysis
x
k 1
ki
xkj
Dij distance between cases i and j xki value of variable Xk for case j Problems: Different measures = different weights Correlation between variables (double counting) Solution: Principal component analysis
Clustering procedures
Hierarchical procedures
Agglomerative (start from n clusters, to get to 1 cluster) Divisive (start from 1 cluster, to get to n cluster)
Agglomerative clustering
Agglomerative clustering
Linkage methods
Single linkage (minimum distance) Complete linkage (maximum distance) Average linkage
Wards method
1. 2. Compute sum of squared distances within clusters Aggregate clusters with the minimum increase in the overall sum of squares The distance between two clusters is defined as the difference between the centroids (cluster averages)
Centroid method
K-means clustering
1. 2.
The number k of cluster is fixed An initial set of k seeds (aggregation centres) is provided
First k elements Other seeds
3.
Given a certain treshold, all units are assigned to the nearest cluster seed 4. New seeds are computed 5. Go back to step 3 until no reclassification is necessary Units can be reassigned in successive steps (optimising partioning)
Suggested approach
1. First perform a hierarchical method to define the number of clusters 2. Then use the k-means procedure to actually form the clusters
Defining clusters:
n
Stage Number of clusters 0 12 1 11 2 10 3 9 4 8 5 7 6 6 7 5 8 4 9 3 10 2 11 1
of (1)
Stage Cluster First Cluster Combined Appears StageCluster 1 Cluster 2CoefficientsCluster 1 Cluster 2Next Stage 1 4 7 .015 0 0 4 2 6 10 .708 0 0 5 3 8 9 .974 0 0 4 4 4 8 1.042 1 3 6 5 1 6 1.100 0 2 7 6 4 5 3.680 4 0 7 7 1 4 3.492 5 6 8 8 1 11 6.744 7 0 9 9 1 2 8.276 8 0 10 10 1 12 8.787 9 0 11 11 1 3 11.403 10 0 0
6 4 2 0 11 10 9 8 7 6 5 4 3 2 1 Number of clusters
SPSS Example
MATTHEW
LUCY JENNIFER
.5
NICOLE
-1.0
Component2
-1.5
FRED
Component1
Agglomeration Schedule Stage Cluster First Cluster Combined Appears Stage Cluster 1 Cluster 2 Coefficients Cluster 1 Cluster 2 Next Stage 1 3 6 .026 0 0 8 2 2 5 .078 0 0 7 3 4 9 .224 0 0 5 4 1 7 .409 0 0 6 5 4 10 .849 3 0 8 6 1 8 1.456 4 0 7 7 1 2 4.503 6 2 9 8 3 4 9.878 1 5 9 9 1 3 18.000 7 8 0
Number of clusters: 10 6 = 4
1.5
1.0
.5
NICOLE
Cluster Number of Ca
4 3
Component2
-1.0
Component1
Analyse / Classify
Untick this
Number of clusters
Identify the step where the distance coefficients makes a bigger jump
118
120
122
124
126
128
130
132
134
136
138
140
142
144
146
Step
148
Number of clusters
Number of cases 150 Step of elbow 144 __________________________________ Number of clusters 6
K-means
Thick here
Final output
Cluster membership
Component (tutorial
1. Old Rich Big Spender
Monthly amount spent Meat expenditure Fish expenditure Vegetables expenditure % spent in own-brand product Own a car % spent in organic food Vegetarian Household Size Number of kids Weekly TV watching (hours) Weekly Radio listening (hours) Surf the web Yearly household income Age of respondent
meaning week 5)
4. Organic radio listener
5 .173 -5.95E-02 .140 5. Vegetarian .199
a Component Matrix
Component 3. Vegetarian TV 1 2 3 4 lover .810 -.294 -4.26E-02 .183 2. Family shopper .480 -.152 .347 .334 .525 .192 .646 -.206 -.345 -.281 .619 -.186 -9.24E-02 .612 .663 -9.53E-02 .406 -.271 -4.75E-02 -5.64E-02 -.475 -.127 -.134 -.102 .190 .647 .135 .247 .462 -.349 .182 -7.46E-02 -6.73E-02 -4.35E-02 .383 -.239 -.172 .460 -.287 -6.12E-02 .184 .232 .559 -5.61E-02 -.197 -.228
.536 .492 1.784E-02 .649 .369 .124 2.989E-02 .443 .908 .891
6.008E-02 .342 .507 -3.29E-03 1.694E-02 -.529 -8.14E-02 -.465 -3.26E-02 6.942E-04
Final Cluster Centers Cluster 1 REGR factor score 1 for analysis 1 REGR factor score 2 for analysis 1 REGR factor score 3 for analysis 1 REGR factor score 4 for analysis 1 REGR factor score 5 for analysis 1 -1.34392 .38724 -.22215 .15052 .04886 2 .21758 -.57755 -.09743 -.28837 -.93375 3 .13646 -1.12759 1.41343 -.30786 1.23631 4 .77126 .84536 .17812 1.09055 -.11108 5 .40776 .57109 1.05295 -1.34106 .31902 6 .72711 -.58943 -1.39335 .04972 .87815
1
1
Cluster Number of Ca
0 6 5 -1 4 -2 3 2 -3 -3 -2 -1 0 1 2 1
1 for analysis