Research Trends in Machine

Learning

Muhammad Kashif Hanif

5/28/21
 Acknowledgement
• Slides contents are based on Introduction to Machine
Learning with Python by Andreas C. Müller and Sarah
Guido
• Examples are taken from scikit

2
 Today’s Topic
• Review
• Parameter setting
• Grid search

3
 Training and Testing Data
• Supervised machine learning models
– Split data into training and test sets
– Build model on training set using fit method
– Evaluate the model on test data
• We measure how our model predicts to the data
which is not used for training the model.

4
 Parameters of a model
• How to find values of important parameters
• Grid search
– All possible combination of the parameters of interest
• For example, for kernel SVM with an RBF two
important parameters are
– Kernel bandwidth gamma
– regularization parameter C
– To check values of parameters for SVM
• gamma = 0.001, 0.01, 0.1, 1, 10, and 100
• C = 0.001, 0.01, 0.1, 1, 10, and 100
• There will be 36 possible combinations

5
 Parameters of a model
• How to find values of important parameters
• Grid search
– All possible combination of the parameters of interest
• For example, for kernel SVM with an RBF two
important parameters are
– Kernel bandwidth gamma
– regularization parameter C
– To check values of parameters for SVM
• gamma = 0.001, 0.01, 0.1, 1, 10, and 100
• C = 0.001, 0.01, 0.1, 1, 10, and 100