FACIALDynamic

K Selfie
• Facial
Filters Using ML
keypoints can be used in a variety of machine learning
applications from face and emotion recognition to commercial
applications .The image filters get popularized by Snapchat and
millions of people are using to make their selfies more graceful.
• In the project we have used OpenCV ,keras with tensorflow backend
to produce desirable results. We have used CNN as our algorithm.
• This machine & deep learning application in python can put various
SUBMITTED BY:
sunglasses on a detected face ( am calling them 'Selfie Filters') by
Ruchika Gupta
finding the Facial Keypoints (15 unique points). These keypoints mark
important areas of the face - the eyes, corners of the mouth, the
nose, etc. Mansi Bansal
Renu Kant
Deepika Joshi
INTRODUCTION
• Facial key points can be used in a variety of machine learning
applications from face and emotion recognition to commercial
applications .The image filters get popularized by Snapchat and
millions of people are using to make their selfies more graceful.
• In the project we have used OpenCV ,keras with tensorflow backend
to produce desirable results. We have used CNN as our algorithm.
• This machine & deep learning application in python can put various
sunglasses on a detected face ( am calling them 'Selfie Filters') by
finding the Facial Keypoints (15 unique points). These keypoints mark
important areas of the face - the eyes, corners of the mouth, the
nose, etc.
USE OF TERMS
OpenCV
OpenCV (Open Source Computer Vision) is a library of programming
functions mainly aimed at real-time computer vision. In simple language
it is library used for Image Processing. It is mainly used to do all the
operation related to Images.

Keras
Keras is an Open Source Neural Network library written in Python that
runs on top of Theano or Tensorflow. It is designed to be modular, fast
and easy to use. It was developed by François Chollet, a Google engineer.
Cont…
CNN
• A Convolutional Neural Network (CNN) is a multilayered neural network with a special architecture
to detect complex features in data. CNNs have been used in image recognition, powering vision in
robots, and for self-driving vehicles. An image classifier CNN can be used in myriad ways, to
classify cats and dogs, for example, or to detect if pictures of the brain contain a tumor.Once a
CNN is built, it can be used to classify the contents of different images. All we have to do is feed
those images into the model.
STAGES OF PROJECT
• Face Detection : The first step works like this: Given an input image or video frame, find out all
present human faces and output their bounding box (i.e. The rectangle coordinates in the form: X,
Y, Width & Height).

• Facial Landmarks : This is the next step in our analysis phase and works as follows: For each
detected face, output the local region coordinates for each member or facial feature of that face.
This includes the eyes, bone, lips, nose, mouth,… coordinates usually in the form of points (X,Y).
IMAGE PROCESSING
Now that the face has been detected, Snapchat can use Image Processing to apply features onto a
full face. However, they chose to go one step further and they want to find your facial features. This
is done with the aid of the Active Shape Model.

The Active Shape Model is a facial model that has been trained by the manual marking of the
borders of facial features on hundreds to thousands of images.

Input Face Detect Landmark Filter Output

SOFTWARE REQUIREMENTS

Platforms: Anaconda Navigator, Spyder, OpenCV

Operating System: Windows or Linux

ABOUT DATASET
IMAGE PROCESSING
We have taken our dataset from Kaggle. It consist of train and
test files. Now that the face has been detected, Snapchat can use Image
Processing to apply features onto a full face. However, they
chose to go one step further and they want to find your facial
features. This is done with the aid of the Active Shape Model.

The Active Shape Model is a facial model that has been trained
by the manual marking of the borders of facial features on
hundreds to thousands of images.
FUTURE SCOPE
The Facial key point detection can be based on the application of deep learning as
three stage process :
• Face Detection
• Face Alignment
• Face key points

Above three stages has been use in this generation and it will move further as a
security or protect data.