See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/354046870

Vision based Hand gesture pattern recognition enabled home automation

system using Internet of Things

Article  in  Design Engineering (Toronto) · August 2021

CITATIONS READS

0 147

4 authors, including:

Bhuvaneswari Anbalagan
VIT University
26 PUBLICATIONS   75 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Improving Diversity in Video Recommender Systems and the Discovery of Long Tail View project

All content following this page was uploaded by Bhuvaneswari Anbalagan on 21 August 2021.

The user has requested enhancement of the downloaded file.

 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

Vision based Hand gesture pattern

recognition enabled home automation system
using Internet of Things
R Jayanthi1, A Bhuvaneswari2, S Rajkumar3, K P Rama Prabha4
1,2
Assistant Professor Senior, Vellore Institute of Technology, Chennai, India
3
Associate Professor, Vellore Institute of Technology, Chennai, India
4
Assistant Professor Senior, Vellore Institute of Technology, Vellore, India
Email : bhuvana.cse14@gmail.com

Abstract— Controlling electric home appliances and gadgets with the help of switches is
difficult for old and disabled people. The main motive of this paper is to help them by
automating the control of electrical home appliances using hand gestures and applaud patterns.
This paper presents a Support Vector Machine (SVM) and Convolution Neural Network (CNN)
based hand gesture recognition system to automate various home devices like lights, fans, etc.
This system uses real time image processing for hand gestures recognition by using a simple
android-based application and Arduino UNO microcontroller. The captured real-time image by
the android application will be processed using the computer application. The proposed system
perform image processing algorithm based on SVM and CNN is used to recognize the input hand
gesture. A pre-trained CNN network Resnet50 is used for feature extraction. The CNN feature
extraction technique is very powerful, and it outperforms existing hand-crafted feature extraction
techniques like HOG,LBP and SURF. The CNN and SVM used together results in more accurate
gesture recognition which improves the performance of the system. The system offers an
additional applaud pattern recognition module which also can be used by the user for controlling
the home appliances.

Keywords— Home Automation; SVM; CNN; Hand gestures; Applaud pattern;

I. INTRODUCTION

Gestures are a type of communication which is non verbal and are conveyed with the help of
body parts like hands,legs,face,arms etc. Gesture recognition is a process in which gestures made
by the user are recognised and are used to control various appliances. The motive of this project
is to develop a system to control the devices like fans,lights, etc by using hand gestures and
applaud patterns given by the user. The hand gesture recognition is done by using of an android
app. The application uses android mobile camera to read the hand gesture made by the user and
will send the image to a computer that uses the input gesture to automate various home
appliances. The computer consist of a application which is based on SVM and CNN. The CNN is
used for to recognise the received input gesture from the android application. After recognising

[8975]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

the input hand gesture a result is generated and it is communicated with the arduino
microcontroller board to turn ON or OFF the required home appliance. The home automation
system also provides the user with an additional applaud pattern recognition module for
controlling the home appliances which the user can enable or disable, and use the feature if the
hand gesture recognition module is not working properly due to some environmental constraints.
Gesture Controlled Home Automation for Differently Challenged People[2] Proposed: This
paper proposes a Hand gesture controlled home automation system using an accelerometer,in
which a glove circuit consisting of a 3-axis accelerometer, flex sensors, and EMG sensors is
designed to capture the gestures. Observation: The flex sensors are used to capture the finger
bending data of each finger while the trajectories of hand motion are obtained with the help of an
accelerometer. Neural networks are used for classification after the local features are extracted
from American Sign Language (ASL) alphabets. Zigbee is then used to transfer the finger
bending data to the driver circuit for controlling the appliances. Paper Title: Bluetooth Based
Home Automation System Using Cell Phone [3] Proposed: This paper presents an automation
using Bluetooth system that has two important components: cell phone and the Arduino BT
board, which facilitate the controlling of appliances. The cell phone hosts the python script to
interface with the Arduino board and creates ad-hoc protocol for communication between the
devices that enables the user to control the required home appliance. Observation: This system
enables controlling the appliances without an internet connection.

II.LITERATURE SURVEY

Home Appliances control using SMS[1] used Global System for Mobile Communication(GSM)
is used for controlling the appliances through Short Message Service(SMS).The system uses the
function of GSM convention to enable control of the appliances with the help of frequency
bandwidths. Observation: The system is based on the concept of serial communication and AT-
commands.Home Automation through EMail using Raspberry Pi[4] Proposed : In this system the
subject of the email sent by the user is read with the help of a developed algorithm which is fed
into the Raspberry-pie which allows controlling of the required appliance. Observation:The
algorithm was developed by using python which is the default programming language of
raspberry pi. An acknowledgment is sent to the user maid id if the required device is controlled
successfully. Paper Title:Voice Recognition Based Wireless Home Automation System[5].
Proposed :This paper proposes a Voice recognition based home automation system.It is a
wireless system used for the automation of various appliances,and has been built and
implemented with the help of Microsoft speech APIs which facilitates automatic speech
recognition. Observation: In this paper Zigbee RF module is used to make the system wireless
and efficient.

Home automation system using Zigbee[6] Proposed: The system uses Zigbee for monitoring and
controlling of home appliances. A common home gateway is used to integrate the Zigbee system
with the Wifi network. Observation:The home gateway provides the system with remote

[8976]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

access,web interactivity and an easy and adaptable user interface. A committed virtual home is
established to provide security and safety.Paper Title: Home Automation and Security System
Using Android ADK[7] Proposed: The paper presents a home automation system using Android
ADK(Accessory Development Kit).In this system all the appliances are interfaced with the
ADK, and a protocol for communication is created with the android mobile device or tablet. The
devices are interfaced with the ports of the embedded system board and their present status is
shared with the ADK. Observation:This apparatus allows us to monitor and control home
appliances via android phone or tablet.

Paper Title: Home Automation system using Wifi and wireless sensor including Internet of
Things (IoT). Proposed: The system is designed to use a Wireless Fidelity (Wi-fi) based Wireless
Sensor Network(WSN) for the purpose of controlling and monitoring environmental safety and
electrical parameters of a smart interconnected home[8]. Observation: The user can use the
system to control the home appliances via an Android application based Graphical User Interface
(GUI) on a smartphone. Paper Title: Using cloud with sensor networks for monitoring and
managing home appliances[9]. Proposed: In this system, a home gateway is designed and
implemented to collect metadata from the connected home appliances and send it to the cloud-
based data server to store in the Hadoop Distributed File System(HDFS). Observation: The home
gateway provides the system with remote access,web interactivity and an easy and adaptable user
interface.A committed virtual home is established to provide security and safety. Paper Title:
Ubiquitous smart home control on a raspberry pi embedded system[10]. Proposed: This paper
proposes a Konnex-Bus based home automation system using raspberry pi. A raspberry pi
embedded system serves as a communication gateway between the Konnex-Bus (KNX) home
automation system and the mobile devices [11].

Observation: The Session Initiation Protocol (SIP) and the Presence Service are used to increase
the access control, communication, and security of the system.

III.EXISTING SYSTEM

Due to the advancement of technology many new innovations have taken over our lives and have
made it simple and easy. Home automation is one such innovation that helps us to control home
appliances smartly by reducing human effort.There are many existing systems with respect to
home automation that are already present in the market.Most of the existing home automation
systems with gesture recognition use hand crafted techniques like Speeded up Robust Features
(SURF), Histogram of Oriented Gradients(HOG) and Local Binary Patterns (LBP) for the
purpose of feature extraction [12]. Histogram of Oriented Gradients: It is a feature descriptor
technique used in image processing for object detection. It is parallel to edge orientation
histogram and it counts gradient orientation in the localized portions of the image. In the HOG
technique, the image is divided into interconnected small regions called cells [13]. For improved
accuracy, the image is computed on a compact grid of uniformly spaced cells and overlapping

[8977]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

contrast normalization is used on it. Local Binary Patterns: LBP is a very old algorithm which is
used for feature extraction. It is a type of feature descriptor used in computer vision for
classification problems. The operator in LBP defines every pixel of the image by its gray level
and with respect to its neighboring pixels[14]. The value of each pixel is set to one or zero,
depending on whether the adjacent pixels are higher or equal. Speeded up Robust Features:
SURF is used as a feature detector and a descriptor in computer vision. In SURF the images are
initially transformed into coordinates, and then it applies the multiple resolution pyramid
technique to duplicate the original image with Pyramidal Gaussian or in some cases Laplacian to
achieve a final image with the actual size but with a smaller bandwidth[15]. This causes a
noteworthy blurring impact on the original image which is termed as the Scale-space, and it
ensures that the points of intersections are scale variants. The approximated Hessian blob
detector is then used to identify the intersection points[16], [17], [18], [19] which also makes it
capable of calculating three integer operations utilizing a precalculated internal image. The
feature detector present in SURF is the summation of the Haar wavelet response around the
intersection point, due to which it is effective to compute with the help of an internal image [20].

Fig 1. Existing technologies for home automation

IV.PROPOSED SYSTEM

The Home Automation system proposed offers the user two types of methods to control the
home appliances.The user can either use hand gestures or clap patterns to turn on/off the required
home appliances .The proposed system uses CNN for feature extraction which is very powerful
and outperforms hand-crafted feature extraction techniques like HOG ,LBP or SURF.The system

[8978]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

consists of four main modules which enables it to automate the control of home appliances for
the user.The four main modules are Android Application, Hand Gesture Recognition, Applaud
pattern Recognition and the Appliance Controller. Android Application : The android application
helps the user in accessing the camera for capturing the hand gestures. The captured image is
then sent to the MATLAB computer application for processing and recognizing the hand gesture.
The android application generates an IP address that is used to connect the MATLAB application
with the android mobile through a mobile hotspot. Hand Gesture Recognition: The hand gesture
recognition is implemented using MATLAB. The MATLAB application consists of an image
processing algorithm based on SVM and CNN. SVM is an algorithm in machine learning which
is supervised and it is mainly utilized for classification and regression testing.

The main goal of the SVM model is to construct an optimal hyperplane in the training data such
that it can divide the training vectors into classes. The hyperplane acts as a decision surface, and
it is constructed in such a way that it maximizes the margin of separation between classes in the
data. CNN is a powerful deep learning algorithm. The two fundamental parts of CNN are
classification and extraction of features. The classifier typically consists of fully bridged layers,
while the feature extraction consists of many convolution layers accompanied by maximum
pooling and an activation function. CNN's are trained using large collections of diverse images
from which they can learn feature-rich representations for a wide variety of images. A formerly
trained CNN called "ResNet-50" is used for the purpose of feature extraction, training, and
testing the dataset.ResNet-50 is a fifty layers deep network and it is pre-trained with millions of
images belonging to almost a thousand categories from the ImageNet database. The dataset used
for this application is generated manually by capturing many pictures of various hand gestures
with the help of a camera. Images from the hand gestures dataset are classified into various
gestures with the help of multiclass linear SVM which has been trained with CNN features
extracted from the hand gesture images.

[8979]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

Fig 2. Block diagram of the proposed system

After training the classifier, it is applied to the input image received from the android
application, and the category of the input hand gesture is predicted. After the hand gesture is
recognized, an output threshold value is generated and sent to the Arduino board. Applaud
pattern Recognition: The clap recognition module is implemented by interfacing a sound sensor
with the Arduino board.When the sensor detects any sound loud enough to cross the threshold
value, the output goes LOW. To make sure the sound is due to clapping and not due to other
background noises we wait for 25 milliseconds. If output remains LOW for more than 25
milliseconds, we declare that the clap is detected and the appliances are controlled accordingly.
Appliance controller is the appliance controller consists of an Arduino UNO microprocessor and
relay boards which are connected to the home appliances the user intends to control. The coding
of the Arduino board is done using the Arduino IDE. The algorithm implemented in the IDE uses
the output value received from the Hand Gesture and Applaud Pattern Recognition Module as an
input to control the behavior of the Arduino board, and thus controlling the required appliance.

V. Hand Gesture Recognition Techniques

Image Processing: Image processing is a technique that involves digital manipulation, analysis,
and processing of images. The first step in image processing is to acquire the image using image
acquisition tools. The second step involves analyzing, processing, and manipulating the image
according to our needs. The final step involves outputting the desired form and format of the
image or generating a report based on the analysis done on the image.

[8980]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

Image Enhancement: This process does not add any extra details to the image. It just improves
the quality of the image by enhancing the brightness and contrast or by decreasing the noise
content and sharpening the details of the image. Image Restoration: This process is used to
improve the image from known degradations such as noise repetition, distortion of geometry,
bad image focus, etc. Image Analysis: This process is very important in areas of machine vision
applications. They produce graphical and numerical interpretation/information of the image. The
analysis mainly relies on image statistics and the image is broken into smaller objects before they
are classified. Image Synthesis: This process allows the synthesis of the required image from
non-image or image data. It generally helps in synthesizing images which are difficult to acquire
using physical methods. Image Compression: This process helps in reducing the data content of
the image. It reduces and removes all the redundant information from the image and keeps only
the required data content neded to describe the image.

Convolution Neural Networks: CNN's are generally used for achieving breakthrough results.
They are used to obtain feature maps by convolving signals from the image by using kernels. A
unit from the feature map uses the weights of the kernel to connect with the previous layers. The
kernel weights are calculated during the training phase by using techniques like back-
propagation which improves the input attributes. These networks have lesser weights and are
very easy to train because the kernels belonging to the same maps are shared among each other.
Due to the convolution of the same kernels over the whole image, it enables the detection of the
same features without the local invariance of translation. The usage of kernels gives important
context information by collecting them from the neighborhood layers. A type of non-linear
activation function is applied to the result of each unit present in the network. The extracted
features will become more abstract if we penetrate deeper into the CNN. For example, the first
layer of the CNN will enhance features like edges which are further clustered in the next layers
as objects or parts. Initialization: It is required for achieving convergence. It allows the
maintenance of gradients and activations at appropriate levels which prevents the explosion of
back propagated gradients. Activation function: This function is responsible for the non-linear
transformation of data. The alpha in the function is defined as the leakiness parameter. Pooling:
It helps in combining nearby spatial features present in the feature map by using max or average
pooling method. This process helps in the more compact representation of the details which were
insignificant. Regularization: This process helps in reducing the overfitting. While training it
removes nodes from the CNN network in each step so that each layer learns better representation
of the data. Data Augmentation: This process helps in increasing the training set size and also
reduces the over-fitting. The training set size can be increased by rotating the original patch to
produce new patches. Loss Function: This function must be kept to minimal while training our
data. Support Vector Machines: SVM is used to solve non-linear and linear problems by
creating models for regression and classification. The main concept behind SVM is to generate a
hyper lane to separate the dataset into classes. It takes data as input and generates a line that

[8981]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

separates the classes in the dataset. The algorithm generates a hyper lane in such a way that it is
close to all the data classes present in the dataset.

VI. HARDWARE DESCRIPTION

Arduino UNO: It is an open source circuit board which consists of a microcontroller and can be
easily programmed with the help of Arduino Integrated Development Environment which is also
known as Arduino IDE. The programming is done in the Arduino IDE and it is uploaded to the
arduino board. A simplified version of the C++ is used to write programs in the IDE. Sound
Sensor: It is a module used to identify and detect sound along with its intensity. It is generally
used in the areas of monitoring, appliance switching, and security. The accuracy of the sensor is
modifiable for easy usage and it consists of a microphone for getting input and it also supports
amplification along with detection. The general usage of the sensor is to detect a sound like a
clap and send an output voltage as a signal to a microcontroller like an arduino to achieve the
required processing. Relay Board: It is a switch that is operated electrically and it enables the
user to control electronic devices like bulbs, fans, etc. The main objective of the relay is to
enable the microcontroller to handle high voltage devices. The relay will protect the devices
which are connected to it from causing electrical damages to each other by eliminating the
connection between the high power circuit and the low power circuit. Each relay channel
consists of three main connections namely NO, COM, and NC. The jumper cap is placed
depending on the trigger in the input signal to close the NO switch for high-level inputs.

VII. SOFTWARE DESCRIPTION

Matlab: It is a matrix based programming software used by engineers, scientists, and developers
for various purposes like image processing, mathematical computations, machine learning, etc. It
has many predefined built-in mathematical functions that are easy to access and can be used
while developing various algorithms. It provides us with features like Data Analyzation,
Algorithm Development, Inbuilt functions, Predefined packages, Application Development.
Simulink: It is a software used for simulation and designing of models. It is bundled with
MATLAB software and incorporates the developed algorithms for further simulation and
analysis.It also provides various additional features like Graphical display of analyzed data,
Hierarchical block diagram management, Data management tools, Easy conversion of algorithms
into models, Predefined tools for model analysis, etc. Arduino IDE: The software is used to
program the Arduino board to define its functions and behavior. It consists of an editor for
writing code and a console for showing results and errors. The programme written in this IDE is
called sketch. The sketches are written with simplified versions of C or C++. After the sketches
are finished it is saved in INO format and uploaded to the board. The toolbar present in the IDE
allows us to create, open, save and upload programs. The bootloader present in the arduino board
enables us to upload the programmed sketch to the microcontroller without the need for any
extra hardware. The arduino board must be reset every time before a new sketch is uploaded. The

[8982]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

IDE provides us with various features and advantages like automatic formatting, inbuilt libraries,
sketch-book, tools for editing sketch, management tools, sharing and predefined functions.

VIII.RESULTS AND OBSERVATIONS

The results and observations recorded after implementing the proposed methodology is exhibited
in the below figures.

Fig 3. Input image

Fig. 3, is the input real time image captured by using the android application which is connected
to the computer running the MATLAB program.The android application generates an IP address
which is used to connect to the computer with the help of Wifi and hotspot.

[8983]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

Fig. 4. Output image

After connecting to the computer,the real time hand gesture is captured and sent as an input
image to the MATLAB program by the android application.

Fig. 5. Performance Graph

[8984]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

The SVM classifier which has been trained using features extracted from the dataset by the
pretrained CNN network Resnet50,is used to predict and recognize the input image received. Fig.
4,is the output of the recognized hand gesture by the MATLAB program. Fig. 5.,is the graphical
representation of the results noted after checking the algorithms with the dataset. The feature
extraction percentage is represented by the x-axis of the graph and the number of images is
represented by the y-axis of the graph.From this graph, we can spot that the CNN feature
extraction outperforms hand-crafted feature extraction algorithms like HOG,LBP and SURF.

Fig. 6.Accuracy comparisons of different methods

Fig. 6, shows the predicating accuracy of different models. The percentage of validated images is
shown by the x-axis of the graph and the average predicting accuracy of each model is shown by
the y-axis of the graph. Using the graph, we can devise that CNN and SVM together result in
more accuracy than CNN and SVM used alone. This is because the SVM classifier is trained
more efficiently from the features extracted by CNN which leads to more accuracy than using
CNN and SVM alone.

[8985]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

Fig. 7. Snapshot of the hardware implementation

Fig. 7, shows the setup of the implemented system. The system running the MATLAB
application and the sound sensor is connected to the arduino board. When the system is running
in hand gesture recognition mode,the recognized hand gesture is used to control the required
home appliance with the help of serial communication. When the system is running in clap
recognition mode, analog communication is used to control the required home appliances.

Fig. 8. Working of the system

[8986]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

Fig. 8, show the working of the implemented system. The LED, DC fan and buzzer are
controlled by using the recognized hand gesture and clap pattern.

IX. CONCLUSION

A home automation system using hand gesture or applaud pattern recognition is proposed to help
the old and disabled people.The hand gesture recognition is implemented by using MATLAB.An
android application is used to capture the input real time hand gestures made by the user and
send it to the computer. The MATLAB application consisting of an image processing algorithm
based on SVM and CNN is used to recognize the input hand gesture. A pre-trained CNN
network Resnet50 is used for feature extraction.The CNN feature extraction technique is very
powerful,and it outperforms existing hand-crafted feature extraction techniques like HOG,LBP
and SURF.The CNN and SVM used together results in more accurate gesture recognition which
improves the performance of the system.An additional applaud pattern recognition is also present
in the system,which allows the user to automate the control of appliances using clap patterns.The
applaud pattern control is offered as an extra feature in the system which the user can enable or
disable,and use the feature if the hand gesture recognition module is not working properly due to
some environmental constraints.The applaud pattern recognition is implemented using a clap
detection circuit.After the hand gesture or applaud pattern is recognized by the system a
threshold value is generated and shared with the arduino microcontroller to switch ON or OFF
the required appliances.

X.FUTURE ENHANCEMENT

Home appliances like buzzers, fans, lights, etc. are controlled using applaud patterns and hand
gestures. MATLAB is the software used for developing the hand gesture recognition application.
After detecting and recognizing a gesture using the developed MATLAB application, the
program must be run again to recognize the next hand gesture. Further research is taking place to
enhance the system and control all the appliances by running the program only once. The future
development will be built on IoT, we will be able to automate our appliances from any place in
the world with the assistance of the Internet of Things. Additional future enhancements will be to
modify the system to control more complex things like television, air conditioners, software
application, cars, etc. , and also perform complex tasks like changing television channels,
increasing or decreasing volume, controlling the speed of the fan, controlling the temperature of
the air conditioner, etc.

REFERENCES

1. Teymourzadeh, R., Ahmed, S. A., Chan, K. W., & Hoong, M. V. (2013, December). Smart
gsm based home automation system. In 2013 IEEE Conference on Systems, Process &
Control (ICSPC) (pp. 306-309). IEEE.

[8987]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

2. Prabhuraj, R., & Saravanakumar, B. (2014). Gesture controlled home automation for
differently challenged people. International Journal of Research in Electronics, 1(2), 1-6.
3. Piyare, R., & Tazil, M. (2011, June). Bluetooth based home automation system using cell
phone. In 2011 IEEE 15th International Symposium on Consumer Electronics (ISCE) (pp.
192-195). IEEE.
4. Jain, S., Vaibhav, A., & Goyal, L. (2014, February). Raspberry Pi based interactive home
automation system through E-mail. In 2014 International Conference on Reliability
Optimization and Information Technology (ICROIT) (pp. 277-280). IEEE.
5. Alshu'Eili, H., Gupta, G. S., & Mukhopadhyay, S. (2011, May). Voice recognition based
wireless home automation system. In 2011 4th International Conference On Mechatronics
(ICOM) (pp. 1-6). IEEE.
6. Anbalagan, Bhuvaneswari, and C. Valliyammai. "# ChennaiFloods: Leveraging Human and
Machine Learning for Crisis Mapping during Disasters Using Social Media." In 2016 IEEE
23rd International Conference on High Performance Computing Workshops (HiPCW), pp.
50-59. IEEE, 2016.
7. Javale, D., Mohsin, M., Nandanwar, S., & Shingate, M. (2013). Home automation and
security system using Android ADK. International journal of electronics communication and
computer technology (IJECCT), 3(2), 382-385..
8. Vikram, N., Harish, K. S., Nihaal, M. S., Umesh, R., Shetty, A., & Kumar, A. (2017,
January). A low cost home automation system using Wi-Fi based wireless sensor network
incorporating Internet of Things (IoT). In 2017 IEEE 7th International Advance Computing
Conference (IACC) (pp. 174-178). IEEE.
9. Cui, Y., Kim, M., Gu, Y., Jung, J. J., & Lee, H. (2014). Home appliance management system
for monitoring digitized devices using cloud computing technology in ubiquitous sensor
network environment. International Journal of Distributed Sensor Networks, 10(2), 174097.
10. Gebhardt, J., Massoth, M., Weber, S., & Wiens, T. (2014). Ubiquitous smart home control on
a raspberry pi embedded system.
11. Bhuvaneswari, A., Thomas, J.T.J. and Kesavan, P., 2019. Embedded Bi-directional GRU and
LSTMLearning Models to Predict Disasterson Twitter Data. Procedia Computer Science,
165, pp.511-516.
12. Brush, A. B., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S., & Dixon, C. (2011, May). Home
automation in the wild: challenges and opportunities. In proceedings of the SIGCHI
Conference on Human Factors in Computing Systems (pp. 2115-2124).
13. Al-Ali, A. R., & Al-Rousan, M. (2004). Java-based home automation system. IEEE
Transactions on Consumer Electronics, 50(2), 498-504.
14. Wimsatt, W. (2006). U.S. Patent No. 7,047,092. Washington, DC: U.S. Patent and
Trademark Office.
15. Bhuvaneswari. A., Karthikeyan, M., Lakshminarayanan, T., “Improving diversity in video
recommender systems and the discovery of long tail”, Journal of Theoretical and Applied
Information Technology, Vol.37, Issue.2, pp. 224-233, 2012. ISSN: 1992-8645

[8988]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

16. Yuksekkaya, B., Kayalar, A. A., Tosun, M. B., Ozcan, M. K., & Alkar, A. Z. (2006). A
GSM, internet and speech controlled wireless interactive home automation system. IEEE
Transactions on Consumer Electronics, 52(3), 837-843.
17. Alheraish, A. (2004). Design and implementation of home automation system. IEEE
Transactions on Consumer Electronics, 50(4), 1087-1092.
18. Ghazal, B., & Al-Khatib, K. (2015). Smart home automation system for elderly, and
handicapped people using XBee. International Journal of Smart Home, 9(4), 203-210.
19. Van Der Werff, M., Gui, X., & Xu, W. L. (2005). A mobile-based home automation system.
20. Bennett III, R.W., Bossemeyer Jr, R.W., Liebrecht, D.B. and Sullivan, B.J., AT&T
Intellectual Property I LP, 2011. Home gateway system for home automation and security.
U.S. Patent 7,912,447.
21. Bhuvaneswari, A., and C. Valliyammai. "Information entropy based event detection during
disaster in cyber-social networks." Journal of Intelligent & Fuzzy Systems 36, no. 5 (2019):
3981-3992.
22. Naresh, D., Chakradhar, B., & Krishnaveni, S. (2013). Bluetooth based home automation and
security system using ARM9. International Journal of Engineering Trends and Technology
(IJETT)–Volume, 4, 4052.
23. David, N., Chima, A., Ugochukwu, A., & Obinna, E. (2015). Design of a home automation
system using arduino. International Journal of Scientific & Engineering Research, 6(6), 795-
801.
24. Bennett III, R. W., Griffith, L. M., & Lund, A. M. (2012). U.S. Patent No. 8,242,900.
Washington, DC: U.S. Patent and Trademark Office.
25. Lee, W. S., & Hong, S. H. (2009, May). Implementation of a KNX-ZigBee gateway for
home automation. In 2009 IEEE 13th International Symposium on Consumer Electronics
(pp. 545-549). IEEE.
26. Gárate, A., Herrasti, N., & López, A. (2005, October). GENIO: an ambient intelligence
application in home automation and entertainment environment. In Proceedings of the 2005
joint conference on Smart objects and ambient intelligence: innovative context-aware
services: usages and technologies (pp. 241-245).
27. Smith, G. H., & Holley, E. (2017). U.S. Patent No. 9,838,736. Washington, DC: U.S. Patent
and Trademark Office.
28. Wilson, B. B., Brown, C. L., Multach, J., & Hubscher, M. B. (2017). U.S. Patent Application
No. 13/937,896.
29. Bhuvaneswari, A., R. Jayanthi, and A. Lakshmi Meena. "Improving Crisis Event Detection
Rate in Online Social Networks Twitter Stream using Apache Spark." In Journal of Physics:
Conference Series, vol. 1950, no. 1, p. 012077. IOP Publishing, 2021.
30. Valliyammai, C. and Bhuvaneswari, A., 2019. Semantics-based sensitive topic diffusion
detection framework towards privacy aware online social networks. Cluster Computing,
22(1), pp.407-422.

[8989]
 ISSN: 0011-9342 | Year 2021
Design Engineering Issue: 7 | Pages: 8975-8990

31. Upadhyay, Y., Borole, A., & Dileepan, D. (2016, March). MQTT based secured home
automation system. In 2016 Symposium on Colossal Data Analysis and Networking (CDAN)
(pp. 1-4). IEEE..
32. Lyman, J. (2019). U.S. Patent No. 10,274,909. Washington, DC: U.S. Patent and Trademark
Office.

[8990]

View publication stats