International Journal on Recent and Innovation Trends in Computing and Communication ISSN: 2321-8169

Volume: 4 Issue: 12 16 21
________________________________________________________________________________
Finding Patterns in Biological Parameters
Suja Panicker
Shruti Bhujange
Assistant Professor, Dept. of Computer Engineering
Dept. of Computer Engineering
Maharashtra Institute of Technology, Pune
Maharashtra Institute of Technology, Pune
Pune, India
Pune, India
suja.panicker@mitpune.edu.in
shrutibhujange@gmail.com

Shraddha Karne Reshma Kadam

Dept. of Computer Engineering Dept. of Computer Engineering
Maharashtra Institute of Technology, Pune Maharashtra Institute of Technology, Pune
Pune, India Pune, India
shraddhakarne33@gmail.com kadam.reshma700@gmail.com

AbstractChanges or variation occur in physiological parameters of the body when a person is going through a tough time or he
is extremely happy. These changes in physiological parameters can be used for detecting emotions. Emotional computing is a
field of Human Computer Interaction(HCI) where we detect human emotions. Emotion recognition based on affective
physiological changes is a pattern recognition problem, and selecting specific physiological signals is necessary and helpful to
recognize the emotions. In this paper, we have discussed various research papers analysing that how emotions are detected from
physiological signals using non-invasive methods. Developers use various Data Mining techniques for developing such results.
Heart Rate Variability(HRV), Skin Temperature(ST), Blood Volume Pulse(BVP) are the main highlights as these are key
parameters in Physiological signals.

Keywords- Data Mining, Emotion Detection, Physiological signals.

__________________________________________________*****_________________________________________________

I. INTRODUCTION variety of physiological signals can be used for emotion

Ability of computer to understand human emotions and
perform appropriate action is one of the key focus areas of
research in Human Computer Interaction(HCI). Making
computers understand human emotions will make HCI more
meaningful and easier. For example, when a robot interacts
with a Human, it will be able to guess the emotions and react
accordingly. A psychologist can diagnose the disease easily
with the help of patients emotional state. Several researches
have been done to recognize emotions using physiological
signals like
Electrocardiogram(ECG),Electroencephalography(EEG), Skin
Temperature and also other modalities like Facial images,
Gestures, Speech.
The physiological signals have proved to give accurate
results for emotion detection. In this paper, recent
advancements in emotion research using physiological signals
is presented, making use of latest Data mining techniques for
preprocessing, feature extraction and classification. The goal
of this review is to study the various techniques available for
the study of physiological signals to detect emotions. Section
II gives brief introduction of the papers we studied.
II. LITERATURE SURVEY
For the purpose of tracking advancement in emotion detection
using physiological signals, we have considered 15 papers
from year 2015 and 2016. As learned from these papers, vast
detection, viz, Electroencephalography (EEG), Electro-
cardiogram (ECG), Galvanic Skin Response (GSR), Skin
temperature, Blood Volume Pressure (BVP), RESpiration
(RES) and Electrodermal activity(EDA). The result is
presented in tabular form, one row per paper, in descending
order of their acceptance date. Analysis is done considering
the type of physiological signals used, Algorithms applied,
Advantages and Limitations of the approach used, Results
achieved and Future scope.
Some papers mentioned here made use of standard datasets
like DEAP while some papers used real time data gathering
techniques using wearable sensors and non-invasive methods.
The data preprocessing is done in order to remove errors.
Preprocessed data is used for classification of signals, the Data
mining techniques mainly used are Support Vector Machine
(SVM), k-Nearest Neighbor (kNN), Naive Bayes. These
techniques are used to classify the emotions based on the data
acquired. Entries in few columns of the table are marked with
--, this is to indicate that the particular entry could not be
found in that research paper.
Summary of reviewed research papers is as follows:

16
IJRITCC | December 2016, Available @ http://www.ijritcc.org
_________________________________________________________________
International Journal on Recent and Innovation Trends in Computing and Communication ISSN: 2321-8169
Volume: 4 Issue: 12 16 21
________________________________________________________________________________

Sr. Name of the Month Algorithms Advantages Limitations Result Future

No. paper & Year Used Work

1 Inside the Feb, Support Real-time, Relies on 95% --

Mind of the 2016 Vector Reveal valuable users wearing accuracy
Insider: Machine knowledge the headset in
Towards classifier about the order to
Insider using k-fold malicious continuously
Threat cross behaviours, monitor the
Detection validation Effective signals,
Using solution for Privacy issues
Psychophysi detecting insider of monitoring
ological threats bio-signals
Signals
(ACM)

2 Recognition March, RBF kernel Non-invasive Reluctance on 90% Real time

of emotions 2016 function methods used. wearing the accuracy analysis will
in autistic device. need to be
children developed.
using Android
physiologica application
l signals that harnesses
(Springer) the power of
neural
networks

3 Designing a 2016 -- Colour change Sensors may -- Include BVP

Smart Scarf of scarf depicts cause and other
to Inuence change of mood, inaccurate signals,
Group helps in team readings. conduct an
Members work. evaluation
Emotions in with high
Ambience: fidelity
Design prototype
Process and
User
Experience
(Springer)

4 Recognizing 2016 -- System could Due to the fact Classificatio Conduct

Emotional recognize the that it was a n for more user
States Using emotional states huge dataset, 1] two- studies where
Physiologica with high it was not class: J48 & we will use
l Devices. accuracy using possible for IBK with physiological
(Springer) few number of WEKA accuracies of data and
physiological application to 97.7584 % facial
devices. process the & 95.4684 expressions
data of all 24 % for
participants respectively. recognizing
together. 2] six- these
class: emotional
J48 and states.
IBK with
accuracies of
96.5014 %
& 91.9333
%
respectively. 17
IJRITCC | December 2016, Available @ http://www.ijritcc.org
_________________________________________________________________
International Journal on Recent and Innovation Trends in Computing and Communication ISSN: 2321-8169
Volume: 4 Issue: 12 16 21
________________________________________________________________________________

5 Emotion 2016 k-means Effective feature Histogram- Maximum Sophisticated

Recognition clustering. extraction by type feature recognition feature
Based on codebook used is accuracy representation
Physiologica approach, soft restrictive 54.3%. s can be
l assignment and as it only investigated.
Sensor Data feature fusion represents the Test the
Using approaches distribution of Fisher kernel
Codebook useful for pre-defined approach.
Approach. smoothed code-words,
(Springer) distribution of & not the
code-words. variation of
code-words.

6 Association 2016 Association Experimental The rules It is possible Promote the

Rules on rules mining. paradigms will regarding to infer a accuracy of
Relationship become more mental state of learners the predicting
s Between convenient as Shame, pride mental states rules by
Learners EEG has much from the employing
Physiologica instruments are variations that learners more types of
l currently its physiologica data on
Information becoming less difficult to l information teachers
and Mental expensive predict their together speeches and
States and more existence. with the behaviours &
During sophisticated in EEG & pulse teachers pay
Learning function. volume speech acts more
Process. excluded due if the attention to
(Springer) to missing learners the changes
values. mental states of learners
are that of mental states.
Enjoyment
or Anxiety.

7 A More 2016 Naive Bayes The Naive There is a The Apply it to

Complete classifier, Bayes classifier need for more combination large data set
Picture of SVM. gave higher research into of as well as
Emotion accuracy when fusion of Electrocardi cross subject
Using combining ECG physiological ogram/Electr data.
Electrocardi and fNIRS data to boost odermal
ogram and Data. the accuracy Activity
Electroderm levels. and
al Activity cognitive
to data (fNIRS)
Complement provides
Cognitive higher
Data. accuracy
(Springer) than
Electrocardi
ogram/Electr
odermal
Activity
alone.

8 Dissimilarity January, Detrended The -- -- Needs further

measure 2016 Fluctuation implemented investigation,
based on Analysis, method can can be
ordinal Multiscale successfully applied to
18
IJRITCC | December 2016, Available @ http://www.ijritcc.org
_________________________________________________________________
International Journal on Recent and Innovation Trends in Computing and Communication ISSN: 2321-8169
Volume: 4 Issue: 12 16 21
________________________________________________________________________________
pattern for Entropy characterize the other
physiologica Analysis.Acc unique physiological
l signals ordingtothera underlying pat- signals
(Elsevier) nkandfreque terns of subjects
ncyofordinal at similar
patternsfortw physiologic
otime series. states.

9 Smoothenin 2016 TVD-MM Successfully de- -- Accuracy More

g and approach, noised ECG increases accurate
Segmentatio Iterative signals with results may
n of ECG merge increase in be obtained
Signals number of by proper
Using Total segments selection of
Variation polynomials
Denoising - for
Minimizatio approximatio
n- n of sections.
Majorization Individual
and sections may
Bottom-Up provide better
Approach results for
(Elsevier) TVD-MM
techniques

10 Stress in 24 May Incremental ISRC It did not Classificatio To enlarge

interactive 2016 Stress algorithm employ any n our dataset in
applications: Region improves the feature accuracy; order to
analysis Construction classification selection from 5.4 % investigate
of the (ISRC) accuracy. techniques, for C-SVM the effect (if
valence- algorithm. which might to 24.9 % for any) of
arousal improve the KNN. gender on the
space based classification identified
on accuracies. stress
physiologica Furthermore, region(s) in
l signals the dataset the VA space.
and self- included VA Investigating
reported blocks with no the reported
data. ratings. stress regions
(Elsevier) using
additional
physiological
signals.

11 From June, Decision tree System was able Physiological 98% Conduct user
Physiologica 2016 classifier(J48 to recognize the sensor has to accuracy studies using
l data to ), k-Nearest aforementioned be fixed facial
Emotional Neighbours(I emotional states properly on expressions
States: BK) by using the for
Conducting classifier, physiological participants recognizing
a User Study WEKA. devices and skin in order emotional
and machine to predict their states
Comparing learning emotional
Machine classifiers (i.e. states
Learning J48 and IBK) successfully
Classifiers with high
(Sensors & accuracies
Transducers)

19
IJRITCC | December 2016, Available @ http://www.ijritcc.org
_________________________________________________________________
International Journal on Recent and Innovation Trends in Computing and Communication ISSN: 2321-8169
Volume: 4 Issue: 12 16 21
________________________________________________________________________________
12 A July Random The Autonomic A more Random Voting
Comparison 2016 Forest (RF) Nervous System comprehensiv Forest using majority
of Random is more useful e and the selected could be used
Physiologica Forest with for emotion exhaustive attributes to improve
l Signal attribute classification validation from the the accuracy
Analysis selection than the Central with more dataset of each class
Techniques (ASC) Nervous data could combining independently
and Random System is have been GSR and , which could
Classifiers Forest with supported by. performed to HRV lead to better
for Multi-Class get even more signals: global results
Automatic Classifier reliable 87.62%
Emotional (MCC) and results. accuracy
Evaluation Bagging (Best
of Audio (BAG) accuracy)
Visual
Contents
(frontier in
computation
alneuroscien
ce)

13 Short-term 2015 Time domain -- -- 50 % More subjects

Analysis of analysis accuracy will be
Heart Rate Frequency recruited to
Variability domain analyse the
for analysis more
Emotion parameters of
Recognition ECG.
via a
Wearable
ECG Device
(IEEE)

14 The First 2015 A hybrid Multimodality is -- -- --

Affect decision- a key to achieve
Recognition fusion based high
Challenge on Support performance in
Bridging Vector the prediction of
Across Regression emotional
Audio, (SVR) and arousal and
Video, and Neural valence from
Physiologica Networks spontaneous
l Data (NN) recordings, as
(ACM) all modalities
contribute to the
prediction of
emotion

15 Cluster Decembe ODAC Best suited in Attack from 96% Risk levels
Based r, (Online healthcare network accuracy alert can be
Wireless 2015 Divisive- domain failure or sent to the
Mobile Agglomerati network expert
Healthcare ve congestions diagnosis
System for Clustering), system.by
Physiologica K-means which first
l Data algorithm, aid diagnosis
Monitoring Online can be
(Elsevier) Distribution informed to
Resource the patients
20
IJRITCC | December 2016, Available @ http://www.ijritcc.org
_________________________________________________________________
International Journal on Recent and Innovation Trends in Computing and Communication ISSN: 2321-8169
Volume: 4 Issue: 12 16 21
________________________________________________________________________________
Aware before
(ODRA) physician
Clustering reaches.

Contents, frontiers in Computational Neuroscience, 2016

III. CONCLUSION Jul 15.
In this paper, various techniques that are used to perform data [11] Han Wen Guo, Yu Shun Huang, Jen ChienChien,
JiannShingShieh,Short-termAnalysis of Heart Rate
mining task on datasets consisting of physiological signals are
Variability for Emotion Recognition via a Wearable
studied. Different physiological signals and their features are ECGDevice, IEEE, 28-30 Nov. 2015.
explored. Various filtering and pre-processing methods [12] Sagar B. Tambe, Ravindra C. Thool, Vijaya R. Thool,
applied on datasets to get a refined dataset for further Cluster Based WirelessMobile Healthcare System for
processing are studied. This paper analyses results as well as Physiological Data Monitoring, ElseVier,
advantages and limitations of existing projects and the ProcediaComputer Science Volume 78, 2016, Pages 40-47
improvements that can be made in future. It outlines the basic 1st International Conference onInformation Security and
tasks undertaken to analyse physiological signals and detect Privacy 2015
emotions to form user profile. [13] Chao Li, Chao Xu, Zhiyong Feng, Analysis of
physiological for emotion recognition with the IRS model,
Neurocomputing Volume 178, 20 February 2016,Pages
IV. REFERENCES 103111 Smart Computing for Large Scale Visual Data
Sensing and Processing Selected papers from the 2014
[1] Yessir Hashem, Hassan Takabi, Mohammad GhasemiGol, International Conference on Smart
and Ram Dantu, Inside the Mind of the Insider: Towards Computing(SMARTCOMP 2014)
Insider Threat Detection Using Psychophysiological [14] Wanhui Wen, Guangyuan Liu, Nanpu Cheng, Jie Wei,
Signals, The 7th ACM CCS International Workshop on PengchaoShangguan,Wenjin Huang, Emotion Recognition
Managing Insider Security Threats (MIST15), Denver, Based on Multi-Variant Correlation ofPhysiological
Colorado, USA, Feb 2016. Signals, IEEE, 04 June 2014.
[2] Niranjana Krupa, KarthikAnantharam, Manoj Sanker, [15] Baha Sen, Musa Peker, Abdullah Cavusoglu, Fatih V.
Sameer Datta,John Vijay Sagar, Recognition of emotions Celebi, A ComparativeStudy on Classification of Sleep
in autistic children using physiological signals, IUPESM Stage Based on EEG Signals Using Feature Selection and
and Springer-Verlag Berlin Heidelberg, July 2016. Classification Algorithms,SpringerLink, Journal of
[3] Ali Mehmood Khan, Michael Lawo, Recognizing Medical SystemsMarch 2014
Emotional States Using Physiological Devices, Springer
International Publishing Switzerland 2016, 22 June 2016.
[4] KimiakiShirahama, Marcin Grzegorzek, Emotion
Recognition Based on Physiological Sensor Data Using
Codebook Approach, Springer International Publishing
Switzerland 2016, 26 May 2016.
[5] KazumaTakehana, TatsunoriMatsui,Association Rules on
Relationships Between Learners Physiological Information
and Mental States During Learning Process, Springer
International Publishing Switzerland 2016, 21 June 2016.
[6] DanushkaBandara, Stephen Song, Leanne Hirsheld,
SenemVelipasalar, A More Complete Picture of Emotion
Using Electrocardiogram and Electrodermal Activity to
Complement Cognitive Data, Springer International
Publishing Switzerland 2016, 21 June 2016.
[7] Jing Wanga, PengjianShangb, WenbinShib, Xingran Cui,
Dissimilarity measure based on ordinal pattern for
physiological signals, Elsevier, August 2016.
[8] Alexandros Liapis, Christos Katsanos, Dimitris G.
Sotiropoulos, Nikos Karousos, Michalis Xenos,Stress in
interactive applications: analysis of the valence-arousal
space based on physiological signals and self-reported
data, International Conference on Computational
Modeling and Security (CMS 2016) , 11 June 2016.
[9] Ali Mehmood Khan, Michael Lawo, From Physiological
data to Emotional States and Transducers by IFSA
Publishing, S. L., Vol. 201, Issue 6, June 2016, pp.
[10] Adrian ColomerGranero, Felix Fuentes-Hurtado, Valery
Naranjo Ornedo, JaimeGuixeresProvinciale, Jose M. Ausin,
and Mariano Alcaniz Raya, A Comparisonof
Physiological Signal Analysis Techniques and Classifiers
for Automatic Emotional Evaluation of Audio Visual

21
IJRITCC | December 2016, Available @ http://www.ijritcc.org
_________________________________________________________________