Q. No. CS - 821/ 057 B. Tech./Even 2016-17/Reg 2016-17 PATTERN RECOGNITION CS - 821 Full Marks : 70 Time : Three Hours The figures in the margin indicate full marks. Answer any five questions from the following. 1. (a) What do you mean by the likelihood of an event? What is likelihood function L(6) on unknown parameter 9 and what is the idea behind maximum likelihood method? (b) Let X;, X, .... X, be a set of random samples, where X, = 0 if a randomly selected student does not own a bicycle, and X,=1 if a randomly selected student does own a bicycle. Assume that X;s are independent Bernoulli random variables with unknown parameter 0. Find the maximum likelihood estimator of 0. 6+8 2. (a) What type of learning is associated respectively with Self-Organizing Map (SOM) Network and Multi-Layer Perceptron (MLP) Network? Write the algorithm for any one of them. P.T.O. W/14/60- 100(2) (b) What do you mean by topology preservation in SOM? 9+5 Or, Describe the architecture of Radial Basis Function (RBF) Network. What is the importance of the spread in the activation function @ of RBF hidden node? Show by examples and figures that when mapped into the feature space (91, 2) (hidden layer) in a RBF network, XOR problem becomes linearly separable. 44+4+6 3. (a) Write the algorithm for Fuzzy C-means clustering. Does it consider both intra-cluster and inter-cluster distances? (b) In which scenario it will be transformed into k-means clustering? Justify your answer. (c) What are the limitations of k-means clustering? 74344 Or, (a) What do you mean by hierarchical clustering? What is dendrogram? (b) Compare and contrast between divisive and agglomerative clustering? (c) Discuss various types of agglomerative clustering. 4+4+6 4. (a) Define classification error. Find an expression for Bayes minimum error. (3) (b) Write an expression for conditional risk. Show by example(s) that classifier for Bayes minimum error and classifier for Bayes minimum risk are not same. 5+9 5. (a) Explain the components of a typical pattern recognition system. (b) What is the difference between classification and clustering? (c) Differentiate between ‘training’ and ‘testing’ of a classifier. What do you mean by overfitting in learning? How it can be solved? 443+7 6. (a) What are linear discriminant functions? What are their advantages and disadvantages? (b) With a suitable example explain how Fisher linear discriminant function works? (c) How can the Parzen window method be used to estimate the densities? 4+6+4 W/14/60- 100