AAER`S

ASIAN COLLEGE OF SCIENCE AND COMMERCE,

DHYARI PUNE, 41.
(Affiliated to SPPU & Approved by Government of Maharashtra)
ACCREDITED BY NAAC WITH “B+” GRADE
2023-24

Project By : Shweta D. Nagarkar

Project Guide Name : Latika Chame

1
*Introduction
❀ The process of identifying human emotion is known as emotion recognition.

Facial expressions are among the most common ways that individuals
communicate.

❀Humans have traditionally found it simple to identify emotions from facial

expressions, but it is far more difficult for a computer system to do the same. It is
now possible to identify emotions from photographs thanks to recent
developments in computer vision and machine learning.

2
 Objective
❀The idea is to replicate the human thought process based on training data
(in the form of images and videos of humans).

❀Computer systems today can work with digital images and videos to
understand and emotionally identify the characteristics of contents.

❀If computers able to keep track of the mental state of the user, robots can
react upon this and behave appropriately.

❀Focusing on the objective, using neural network based AI systems

recognizing emotion of humans through pictures of him or her.
3
 *Existing System
 In Emotion recognition using brain activity the developer Robert
Horlings has used brain activities which is toughest task to do.

 As it become expensive, complex and also time consuming when

we try to measure human brain with Electroencephalography.

 Emotions are not easy to disguise and can cause differences

in electroencephalography (EEG) signals.

 EEG is a reliable and costly technology used to measure

brain activity

4
*Proposed system
The proposed system is capable of performing automatic facial
expressions of 5 basic emotions.

We'll determine the length of training data, which will include 5

different types of emotions: happy😄, sad☹, angry😠, surprise😲,
and neutral😐

Using the Harcascade Frontal Face, capturing the face by deleting

the undesired sections of the image, facial expression analysis, and
emotion recognition.

5
* Convolutional Neural Network

Deep Learning has established itself as a very potent tool over the last few
decades due to its capacity for handling massive amounts of data.

Hidden layer technology is much more popular than conventional methods,

particularly for pattern recognition. Convolutional Neural Networks are
among the most widely used deep neural networks.

Convolutional neural networks (CNN/ConvNet) are a class of deep neural

networks used most frequently to interpret visual data in deep learning.

6
 Basic Expressions

Happy Neutral Angry Sad Surprised

 *Requirements
Software Requirements :

 Python 3

 Operating system: Linux- Ubuntu 16.04 and

above
 Windows 10 and above

Hardware Requirements :
 System with Intel Pentium Core i3 and above

 Webcam USB supported

8
 *Technology used
 Convolutional Neural Networks (CNN)

 Python using Jupyter Notebook

 TensorFlow library

 Keras library

 Open CV library

 Matplotlib library

 Matplotlib.pyplot library

 Numpy library 9
*Feasibility study
*Technical feasibility
 This study is carried out to check the technical feasibility, that is, the
technical requirements of the system.

 Any system developed must not have a high demand on the available
technical resources. This will lead to high demands being placed on the
client.

 The developed system must have a modest requirement, as only minimal or

null changes are needed for implementing this system

11
 *Economical feasibility

This study is carried out to check the economic impact the

system will have on the organization.

The expenditures must be justified.

Thus, the developed system as well within the budget and this

was achieved because most of the technologies used are freely

available.

12
*Operational feasibility

The aspect of study is to check the level of acceptance of the

system by the user.

This includes the process of training the user to use the system
efficiently.

The level of acceptance by the users solely depends on the

methods that are employed to educate the user about the
system and to make him familiar with it.

13
Workflow

14
 E-R
Diagram

15
Sequence
Diagram

16
*I/O screens
Emotion: Happy

18
Emotion: Neutral

19
Emotion: Sad

20
Emotion: Angry

21
Emotion: Surprise

22
*Applications
It can be used in healthcare to detect depression.

In education field, to detect student engagement.

It can also be used in entertainment to detect audience emotions.

In entertainment industry, to detect audience emotions.

Content creators to sell products e.g. Affectiva company(Affectiva is

a software company that builds artificial intelligence that

understands human emotions)

23
 *Future scope

Multiple Objects / face detection and Emotion Recognition is

implemented in the application.

We will work to add other complex emotions such as fear, empathy,

sarcasm and irony.

Some bug fixes for any issues which may occur while implementing.

24
*Conclusion
We used the power of Artificial Intelligence to work on Cognitive Science and
dealt with human faces, this term is generally referred to as Computer
Vision. We were able to extract emotions out of photos and videos of human
faces.
This was our project about “Human Emotion Detection” developed based on
Python programming language.
We assume this system gave numerous delight to everyone. although every
task is never said to be ideal in this development field even more
improvement can be viable in this application.
We discovered so many things and received plenty of information about
development field. we are hoping this could prove fruitful to us.

25
 *Acknowledgement

We would like to thank our teacher Miss. Latika Chame who continuously

guided us during the whole course of project.

Her assistance and constructive feedback throughout the project help us a

lot.

26
 *Reference
 https://machinelearningmastery.com/how-to-use-transfer-learning-when-developing-
convolutional-neural-network-models/
 https://towardsdatascience.com/transfer-learning-using-mobilenet-and-keras-
c75daf7ff299
 http://ieeexplore.ieee.org/document/7013165/
 https://www.analyticsvidhya.com/blog/2018/08/a-simple-introductionto-facial-
recognition-with-python-codes
 https://realpython.com/face-recognition-with-python/
 http://web.stanford.edu/class/ee368/Project_Autumn_1617/Reports/
report_pao.pdf
 https://sci-hub.se/10.1109/INCET49848.2020.9154121
 https://link.springer.com/article/10.1007/s42452-020-2234-1

27
Thank You.
28