Support Vector Machine (SVM)

Presented By

Khin Than Nyunt

PhD(CE-IT) 7

5/7/2022 1
Outline
What is Support Vector Machine (SVM)?

How does it work?

Applications Area of SVM in Real World

Pros and Cons Associated with SVM

How to implement SVM in Python?

5/7/2022 2
1. What is Support Vector Machine?
Support Vector Machine” (SVM) is a supervised machine learning algorithm that can be used for both classification or

regression challenges. However, it is mostly used in classification problems.

The goal of SVM is to divide the datasets into classes to find a maximum marginal hyperplane (MMH) in an N-

dimensional space. The dimension of the hyperplane depends upon the number of features.

If the number of input features is two, then the hyperplane is just a line. If the number of input features is three, then the

hyperplane becomes a 2-D plane. It becomes difficult to imagine when the number of features exceeds three.

5/7/2022 3
2. How does it work?
As shown in the graph below, we can achieve exactly

the same result using different hyperplanes (L1, L2,

L3).

we plot each data item as a point in n-dimensional

space with the value of each feature being the value of a

particular coordinate. Then, we perform classification

by finding the hyper-plane that differentiates the two

classes very well.

5/7/2022 4
1. What is Support Vector Machine?

5/7/2022 5
2. How does it work?
Support Vectors − Datapoints that are closest to the hyperplane is called support vectors. Separating line will be

defined with the help of these data points.

Hyperplane − It is a decision plane or space which is divided between a set of objects having different classes.

Margin − It may be defined as the gap between two lines on the closet data points of different classes. It can be

calculated as the perpendicular distance from the line to the support vectors..

5/7/2022 6
 2. How does it work?
Large margin is considered as a good margin and

small margin is considered as a bad margin.

Finding maximal margin, we need to maximize the

margin between the data points and the hyperplane.

First, SVM will generate hyperplanes iteratively that

segregates the classes in best way. Second, it will

choose the hyperplane that separates the classes

correctly.
5/7/2022 7
3. Applications Area of SVM in Real
World
SVMs depends on supervised learning algorithms. The aim of using SVM is to correctly classify unseen data. SVMs

have a number of applications in several fields.

1. Face detection
2. Text and hypertext categorization
3. Classification of images
4. Bioinformatics
5. Protein fold and remote homology detection
6. Handwriting recognition
7. Generalized predictive control(GPC)

5/7/2022 8
 4. Pros and Cons Associated with SVM
Pros:

Suited for classes that have clear separation margins.

Also works well when total dimensions are more than samples.

It’s more efficient in spaces which are high dimensional.

It uses a subset of training points in the decision function (called support vectors), so it is also memory efficient.

5/7/2022 9
 4. Pros and Cons Associated with SVM
Cons:

Doesn’t work well when every data point's total features exceed total training data samples. Also for larger data sets, it’s

algorithm isn’t suited.

When target classes overlap or there’s more noise in a data set, it starts to lag. Plus there’s a lack of probabilistic

explanation for support vector classifier's classification.

SVM doesn’t directly provide probability estimates, these are calculated using an expensive five-fold cross-validation.

5/7/2022 10
5. How to implement SVM in Python?

5/7/2022 11
 References
1. https://data-flair.training/blogs/applications-of-svm/

2. https://www.kdnuggets.com/2020/03/machine-learning-algorithm-svm-explained.html

3. https://www.geeksforgeeks.org/support-vector-machine-algorithm/

4. https://www.geeksforgeeks.org/support-vector-machine-algorithm/

5. https://www.analyticsvidhya.com/blog/2017/09/understaing-support-vector-machine-example-code/

6. https://towardsdatascience.com/support-vector-machine-introduction-to-machine-learning-algorithms-934a444fca47

7. https://jpt.spe.org/top-machine-learning-algorithm-explained-support-vector-
machines?gclid=Cj0KCQjwyMiTBhDKARIsAAJ-9VuwJBPCUCXBpZaKiZg-dCvNwFzdJlN7jgEfzDdyYcTfkrukwj-
OvS4aAs-FEALw_wcB

8. https://www.quora.com/What-are-some-pros-and-cons-of-Support-Vector-Machines

5/7/2022 12
THANK YOU SO MUCH!

5/7/2022 13