See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/346733135

Animal Emotion Detection and Application

Article in Midas · December 2020

CITATION READS

1 2,991

4 authors, including:

DP Sharma Abel Adane

Associated to MSRDC-MAISM (RTU) AMUIT MOEFDRE under UNDP, Expat Services t… Arba Minch University
145 PUBLICATIONS 314 CITATIONS 9 PUBLICATIONS 25 CITATIONS

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Internet Governance: A Global RoadMap View project

Intranet Paradigms View project

All content following this page was uploaded by DP Sharma on 08 December 2020.

The user has requested enhancement of the downloaded file.

 Animal Emotion Detection and Application

Bhupesh Kumar Singh1, Tanu Dua2, Durga Prasad Sharma3, Abel Adane Changare4
1,3,4Faculty of Computing and Software Engineering, 2Department of Computer Science
1,2,3,4Arba Minch University, Satyug Darshan Institute of Engineering & Technology
1dr.bhupeshkumarsingh@amu.edu.et,2tanudua08@gmail.com,
3sharma.dp@amu.edu.et,4abel.adane@amu.edu.et,

Abstract. Emotion Detection in human beings is one of the widely used applications of
Machine Learning from websites to software’s, gaming to education and businesses to
healthcare. In earlier times it was only used to judge or detect the human emotions. Many
computational methodologies such as Hidden Markov Chains, Bayesian networks,
Gaussian Mixture models have been developed to recognize the facial expressions man-
ually and automatically. Emotions are not just extracted from the muscle movements, but
they can also be detected from texts, speech, body movements, gestures, and images. The
objective of this review is to examine and compare how emotions are linked and
apparent in humans and other animals, with the intent to highlight possible new
behavioral approaches and research perspectives. The author also discusses the
importance and the applications of animal emotion recognition and role played by the
body movements which can make difference in analyzing the correct emotion with higher
accuracy.

Keywords: Emotion Detection, Machine Learning, Hidden Markov Chain,

Bayesian network, Animal Emotion.

1 Introduction

Emotion has number of definitions varying in the different domains. The word emo-
tion can't be explained within a single definition. Emotion is a way to have an effective
communication between two people. Emotion Detection characterizes the capability to
encrypt a collaborative of sensory provocations providing information about the emo-
tional state of others. This capability is not unique to humans. An increasing number of
studies suggest that many aspects of higher order social functions, including emotion
recognition, might be present in species ranging from primates to rodents, indicating a
conserved role in social animals. The evidence from human emotion recognition, and
latest advances in the development of nonhuman animal behavioral tests, using or im-
plying the use of this cognitive function. The differential implication of sensory modal-
ities used by animals to communicate and decipher emotional states is also discussed
in [1]. Detecting the basic emotions is quite easier when it comes to comparing them
with the complex or mixed emotions. The best way to express the internal emotional
states in humans and other primates is using facial expressions [2]. But the body parts
and their movements have own importance in the detection of accurate emotions in
many animals. The facial expressions in chimpanzees can indicate their internal
2

emotional states and play an important role in communication [3] whereas, in the ani-
mals like dogs and other mammals, correct emotions can’t be only expressed by the
movement of their facial muscles. There are many different purposes of our facial ex-
pressions in our day to day interpersonal interaction. Through our face, we can express
communicative signals of intent, express inner emotional states, activate emotions and
regulate communication [4].

As automation in human emotion detection has attracted a lot of attention in recent

years [5] because of its applications in real world. Nature inspired algorithms such as
Bees Algorithm, Genetic Algorithm, Cuckoo Search, Firefly Algorithm etc. that are
used for the optimization of several benchmark functions, the multi-objective optimi-
zation, and other real-life problems. Interdisciplinary in nature it combines image pro-
cessing, computer vision and machine learning and can be applied in large number of
applications especially in human-computer-interaction (HCI). Exploding with invest-
ment and technological advances, the world of emotion detection and recognition tech-
nology will change the face of marketing in the years to come. People those who don’t
feel emotions, find it difficult to make decisions. User interfaces for computer systems
are evolving into an intelligent multimodal interface. In addition to keyboards and mice,
more natural modes of interaction including visual, audio, and other sensorial means
are expected to be used for communication between humans and computers.

It is very well said by Winkler that adding emotion recognition systems to the secu-
rity can play an important part, “It can identify people in a crowd, monitor citizens for
suspicious behavior by tracking identity, age, gender, and current emotional state. It
can be used to preemptively stop criminals and potential terrorists,” he said.

Please note that the first paragraph of a section or subsection is not indented. The first
paragraphs that follows a table, figure, equation etc. does not have an indent, either.

2 Literature Review

Emotion is defined in two ways as prescriptive and descriptive. Descriptive

definitions delineate the ways in which the word emotion is used in everyday life.
Prescriptive definitions are used to pick out the set of events that scientific theories of
emotion purport to explain [6].

Recent research scenarios in four different domains such as software engineering,

website customization, education, and gaming with the aim of assess the possibility of
emotion recognition in these fields. Various problems of defining sets of emotions were
recognized. The multimodal inputs such as physiological sensors, video, depth sensors
and standard input devices proved to provide more information to the recognition pro-
cess. The use of emotion detection in software engineering has mainly two applications
that are usability testing and development process improvement which include various
scenarios such as first impression test, task-based usability test, free interaction test,
 3

comparative test, productivity and emotions, code quality and emotions, tele and office
working comparison and IDE usability comparison. The scenarios discussed in e-edu-
cation were Emotional templates of educational tasks, Emotional stereotypes of learn-
ers, Evaluation of educational resources and usability testing of educational tools.

It also has different using scenarios in enhancing the website customization and
video games [7]. The use of multi-level approach to assess the sheep's pain level. It
began with sheep face detection, facial landmark localization, normalization, and then
facial feature extraction. These were defined using Oriented Gradient Histogram and
then categorized using Support Vector Machines which showed 67 percent accu-
racy. extended strategies for recognizing facial expressions to encompass facial mo-
tion devices in sheep are there, that can then facilitate automated estimation
of pain levels.

The Face Detection System for Viola Jones object detection has been used and Cas-
cade Pose Registration is used to identify facial landmarks. Localization was imple-
mented to ensure that faces are recognized and comparable from different points of
view. The Oriented Gradient Histogram (HOG) was used to define the characteristics
of the sheep's eyes. Upon HOG's removal, Activity was marked. Sheep Pain Facial
Expression Scale (SPFES) which can easily identify the accurate level of pain from the
healthy sheep. The scale was used to identify the pain level in context with the rotation
of ears, change in nostril shape i.e. from Shallow U (Pain Level-1) to Extended V (Pain
Level-2), and the narrowing of eyes in Fig. 1. This scale gave the intensity of pain level
from 0-2 in which 0 means less pain in [8].

Facial expressions are important for communication especially in the NHP. A com-
putational framework was established for their automatic facial recognition in Fig. 2.
This was carried out through a 3 step algorithm: 1) Facial Image Registration(detected,
aligned and scaled); 2) formation of ordered Eigen Facial-Expression Image (EFI) dic-
tionary of facial images for different facial segments using a two layered clustering
algorithm; 3) extraction of dynamical temporal-spectral features and recognition of the
facial expressions. The feasibility of their expressions was verified using video record-
ings of NHP under different behavioral conditions. The results were compared to the
observations of three human experts which showed an agreement of more than 82%
accuracy with the minimal assumptions about the physiology of facial expressions [2].

This represents the two phases for the emotion prediction in this case. The phases
are data collection, and Real Time analysis. In the first stage data collection is done in
frames from the video stream to form the facial- expressions Images (EFI’ s). The sort-
ing is done according to their similarity. The second stage can work in real time and on
Multiple facial areas to find the most likely facial image from the EFI dictionary that
matches the instantaneous video frame.

The Rat Grimace Scale was presented to demonstrate the utility of the spontaneous
pain in mice using blind coding of facial expressions. Grimace Scale consists of the
4

four facial “action units” (orbital tightening, nose/cheek bulge, ear position, and
whisker change). Scored on a 0-2 scale. It was stated that in three popular algesimeter
assays (intraplanar complete Freund's adjuvant intra-articular kaolin / carrageenan, and
laparotomy), the production of the Rat Grimace Scale (RGS) and its ability to measure
pain. The four main Action Units observed were orbital tightening, nose/ cheek flatten-
ing, ear changes and whisker changes [9]. The scale measured the pain in context with
the changes in Nose/Cheek, Ears, Orbital and whisker. When the rats are in pain their
orbital area gets narrowed, eyes (partial or complete) closure, bulging of nose and
cheek, ears tend to fold or curl, their whiskers move forward or outwards resulting in
the pointed shape in Fig.3. The average accuracy achieved by the scorers for the inac-
curate pain/no pain conditions was 81.6%.

The researcher provided evidence about cats’ ability to recognize cross-modally con-
specific and human emotional expressions. Cats spontaneously looked at the congruent
facial expressions for longer when hearing the conspecific emotional vocalizations of
“hiss” and human emotional vocalizations of “happiness” and “anger”, suggesting that
they integrated visual and auditory signals into a cognitive representation of conspecif-
ics’ and humans’ inner states. Moreover, the behavioral results demonstrated that cats
respond in a functional way to human “anger” and conspecific “hiss” emotions, since
behavioral expression of their stress levels were higher when responding to these emo-
tional stimuli than in response to human “happiness” and conspecific “purr” [10].

3 Application of Human Emotion Detection

3.1 Software usability testing

Research has already proved that in a web page design first impression is a good
predictor of 10-minute [11] usability opinion. The quality indicators can be improved
indefinitely, but there is a point to stop optimizing – it’s a customer satisfaction. Meas-
uring this satisfaction with questionnaires may be misleading. Software developers pre-
dict the user’s emotions on a screen or software, using this feature in their software.
These emotions are taken as the feedback and then it is improved accordingly after
analyzing the.

3.2 Development process

Software development is deeply dominated by human factors [12]. Emotional states

of the developers not just improve the development process, also enhances the quality
of software. Employers require high work efficiency and high-quality code. Unfortu-
nately, these two requirements are often in conflict, as a computer program developed
under time pressure is usually of low quality.
 5

3.3 Education and Professional Sector

This feature is used in the cameras to detect the emotions of the students in the
schools, classrooms, offices, and other workplaces. In Teaching learning process
emotion recognition play an important role specially while sketching a sketch discussed
in [14][15][16]. Sketching tools and websites use this feature to make them more user-
friendly and eye-catching. Emotion recognition algorithms can help to explore this
phenomenon by making assessments of learner emotional states more objective than
typical questionnaire-based investigations. Reactions like disinterest, bored and
unhappy can be extracted to improve the facilities and productivity for both ends.

3.4 Improving Website Features

Emotion aware systems can create effective, trustworthy and persuasive web
applications [5]. Websites capable of Sensing and reacting to user’s emotional state by
adjusting their context and their look & feel (L&F) can be used by e-companies as
powerful recommendation and advertisement tools or by website designers as a
medium to increase user satisfaction [5].

3.5 Online and offline Computer Games

In these games this feature is used to discriminate between the users based upon their
facial expressions and the biometric signals [4]. The reactions are accessed through the
device’s camera. Nowadays, user interfaces are used for many different characteristics.
They have simply evolved into the multi-modal interfaces [4]. Facial expressions such
as wide eyes, shape of mouth and eyebrows and many more features are captured to
know the user’s reactions such as surprise, anger, sad, happy and fear. This is used to
improve the gaming experience.

4 Why animals’ emotions detection is important?

The emotions of humans and animals are correlated and have evolved from the same
mechanism. Animals are divided into different groups such as Fishes, Mammals, In-
vertebrates, Insects, Amphibians and Reptiles. Scientists have already been working on
the animals to detect their emotions. Many different technologies and methodologies
have been developed for Identifying and quantify pain for subsequent diagno-
sis and pain relief in animals [12].

When confined in an animal shelter, cats and dogs experience a wide range of emo-
tions that profoundly affect their emotional health in the short term and may also have
6

long-term impacts. This is particularly true if they become sensitized to people, places
or things that trigger their fear or frustration on an ongoing basis, or when stress and its
associated negative emotional states are prolonged. Daily horses handling is associated
with a risk of injury. The researcher discusses that horses in the happy situation seek
more proximity than in anger situation in [13]

It's easier to read and understand the feelings of animals such as primates, because
their gestures and experiences are like humans. But recognizing the emotions of the
creatures like fish, whales, penguins, tortoise, and many more weird species of the do-
mestic animals may be difficult as they are not similar to human beings. Some of the
symptoms, that can be considered such as the depressed horses close their eyes even
when they are not resting, fearful cows lay their ears flat on their heads, angry dogs
have stiff body posture whereas happy dog has relaxed eyes and comfortable ears.
There is a clear difference between the bark of an angry dog defending its home and
the happy bark of the same animal while playing. We simply assume the barking of dog
as the symptom of anger, Meows of a cat as the symptom of hunger but there are many
more factors and symptoms on which their emotions are dependent. Primates such as
chimpanzees can make 32 sounds with distinct meanings.

These are some symptoms of just a couple of animals. More data for the animals
should be collected and then it can be further automated with the computational meth-
odologies.

Detecting their emotions are important and there are various applications that can be
simply applied in our daily life based upon their emotions which can even save many
people from getting harmed.

5 Why animals’ emotions detection is important?

5.1 Predicting the Pain level Intensity

Humans are the creatures who feel pain but the animals like fish don’t as interna-
tional team of neurobiologists have already proved that. Estimating the pain level of
animals is important to provide medication or to give them proper treatment. After see-
ing the painful condition of human beings, they are sent to emergency, similarly, should
be there in the case of the animals. The pain level of the sheep predicts the diseases
such as footrot and mastitis. Though their behaviour can be an indication to the extent
of pain they are suffering. But that can’t be justified because of the lack of communi-
cation or their capability to express emotions like human beings. Rats are used in ma-
jority of preclinical pain researches and identification of the extent of their pain can
help researchers in researches as well as saving them from death or health issues [9]

The doctors assume the pain of animals that are brought to them for treatment if they
have the improved prediction of intensity of animal’s pain and their emotions it
 7

becomes easy to give them medication and treatment. Dosage can be limited as per the
pain intensity and they can be prevented from heavy dosages. Many drugs are being
tested on animals such as bulls, rats, and many more without knowing the intensity of
pain and the emotions they have. This can be solved, and they can be treated at that
moment which can save their lives. Pain level is predicted using the facial movements,
but it also depends on the sound they make when in pain. Some disorders such as de-
pression, mental illness and many more can only be prevented by the emotional support.
In animals, not knowing these can be dangerous for the owners as well as the animals
as it may lead to death and other mental disorders in Fig. 4.

5.2 Animal Protection

Animal rescue teams or other people who try to protect the animals from threats or
to keep them in protected areas but end up getting harmed by them occasionally. They
can use the emotion detection applications installed in their mobile phones and check
the emotions of the Wild as well as domestic animals and wait till they get calmed
down, while capturing them for their protection. Knowing the feelings of animals can
become convenient which can decrease the chances of getting harmed by them. Most
of the time rescue teams get hurt because the animals assume them as preys which has
hazardous effects on animals as well as the people trying to protect them. The crimes
such as cruelty of animals/Animal abuse can be declined, and the protection teams can
take them to the shelter homes safely and their unspoken words can be known better.

5.3 Communication Easier

Effective or an easy communication is the bridge of understanding the feelings of

anyone doesn’t matter, if it's between humans, animals and or between humans and
animals. Human beings can discern the subtle differences between their emotions.
Animal lovers are capable to understand the emotions of animals whereas for the non-
animal lovers or the people who have neutral emotions for animals it becomes difficult
for them to understand their feelings and the effects of these are seen in many cases on
a daily basis. Animals express their emotions mostly with their actions which can be
differentiated when all the symptoms are well known for eg- if a dog is scratching that
means hunger or it’s an indication for something wrong whereas if it is jumping over
you that doesn’t indicates that it is trying to attack you because they jump in happiness
too.

5.4 Security

One of the most important applications is security. Many of the domestic animals
are not just a part of our family but also, they protect our houses in our presence as well
as absence. Animal Emotion detection systems can be installed in the security cameras
8

at homes and workplaces, which can predict the change in behaviour of pets. Weird
behaviour can indicate the owner about the mis happenings or threats happening around
them or inside their houses and immediate action can be taken.

Fig.1. SPFES based taxonomy describing Sheep facial

 9

Fig. 2. Facial Classification from video

Fig.3. Rats pain scale

10

Fig.4. Applications of Emotion Detection in Animals Medication and Treatment

6 Conclusion

In this paper, need and applications of animal emotion detection are mentioned
which can be further researched and applied along with the prediction of pain level
intensity of animals, medication, treatment, protection, security and the most important
is easy communication between humans and animals. Different Machine Learning
frameworks have already been used in implementing the different supervised and un-
supervised learning algorithms for studying animal behaviour. Researchers from the
University of Arizona have estimated that there are roughly 2 billion living species on
Earth in the paper published “The Quarterly Review of Biology (September 2017)”.
The exclusion of the endangered species, extinct species, bacteria, insects, the species
that are about to get endangered or are rarely found have lesser applications compared
to the domestic animals or easily found animals, can make the work easier and more
convenient. any other applications can be found and explored with the above existing
applications. The emotion detection which is done using the facial expressions should
be predicted using the complete body movements on which the real emotions of the
animals depends.
 11

References
1. Ferretti, V, Papaleo, F. Understanding others: Emotion recognition in humans and other an-
imals. Genes, Brain and Behavior. 2019; 18:e12544. https://doi.org/10.1111/gbb.12544
2. Gaddi Blumrosen, David J Hawellek, Towards Automated Recognition of Facial Expres-
sions in Animal Models, Conference Paper · October 2017,
3. Flecknell P., Analgesia from a veterinary perspective, BJA: British Journal of Anaesthesia,
19 April 2008
4. Kiyhoshi Nosu, Tomoya Kurokawa, Hiroto Horita Yoshitarou Ohhazama, Hiroki Takeda,
Real Time Emotion- Diagnosis of Video Game players from their Facial Expressions and
its Applications to Voice Feed-Backing to Game Players, IEEE, 2007
5. O.B. Efremides, From Emotion Recognition to Website Customizations, (IJACSA) Interna-
tional Journal of Advanced Computer Science and Applications, Vol. 7, No. 7, 2016
6. Elizabeth S. Paul, Michael T. Mendl, Animal emotion: Descriptive and prescriptive defini-
tions and their implications for a comparative perspective, Applied Animal Behaviour Sci-
ence, Volume 205, 2018, Pages 202-209, ISSN 0168-1591, https://doi.org/10.1016/j.ap-
planm.2018.01.008.
7. A. Landowska, M. Szwoch, W. Szwoch, M.R. Wróbel, A. Kołakowska, Emotion recogni-
tion and its applications, Springer International Publishing, 2014, DOI: 10.1007/978-3-319-
08491-6_5
8. Yiting Lu, Marwa Mahmoud and Peter Robinson, Estimating Sheep Pain Level Using Facial
Action Unit Detection, 2017 IEEE
9. Susana G Sotocinal, Robert E Sorge, Austin Zaloum, Alexander H Tuttle, Loren J Martin,
Jeffrey S Wieskopf, Josiane CS Mapplebeck, Peng Wei, Shu Zhan, Shuren Zhang, Jason J
McDougall, Oliver D King, and Jeffrey S Mogil, The Rat Grimace Scale: A partially auto-
mated method for quantifying pain in the laboratory rat via facial expressions, Sage Publi-
cations, 2011 Jul 29. doi: [10.1186/1744-8069-7-55]
10. Quaranta, A.; d’Ingeo, S.; Amoruso, R.; Siniscalchi, M. Emotion Recognition in Cats. Ani-
mals 2020, 10, 1107.
11. Linggaard, G., Fernandes, G., Dudek, C., Brown, J., Attention web designers: You have 50
milliseconds to make a good first impression. Behaviour and Information Technology, 2011
Mar 04
12. Alan MacCormack, Chris F. Kemerer, Michael Cusumano, Bill Crandall, Trade-offs be-
tween Productivity and Quality in Selecting Software Development Practices, IEEE Com-
puter Society, 2003
13. Schrimpf, A.; Single, M.-S.; Nawroth, C. Social Referencing in the Domestic Horse. Ani-
mals 2020, 10, 164.
14. B. K. Singh and M. Luthra, "Freehand Sketching an Essential Tool for Unified Modelling
Diagrams in Object Oriented Approaches," 2018 Second International Conference on Green
Computing and Internet of Things (ICGCIoT), Bangalore, India, 2018, pp. 560-564, doi:
10.1109/ICGCIoT.2018.8753004.
15. G.Sahoo & Bhupesh Kumar Singh, “MAHII :Machine And Human Interactive Interface”
International Journal of Image Processing, Volume (2), Issue (3), 2008 PP. 1-10.,
16. Bhupesh Kumar Singh, Meghna Luthra. Parser for Generating Sketch Description. Journal
of Software Engineering Tools & Technology Trends. 2015; 2(1): 9-18p.

View publication stats