2020 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO)
Amity University, Noida, India. June 4-5, 2020
A Review on Smart Gloves to Convert Sign to
Speech for Mute Community
Khan Sohelrana Syed Faiyaz Ahmed
Associate professor, ECE UG Student, ECE Department
Department ISL Engineering College
ISL Engineering College Hyderabad, India
Hyderabad, India Sd.faiyaz99@gmail.com
rana.engg.2224@gmail.com
Abstract— The mute community all over the globe facing
many problems while communicating. The normal and dumb
people can communicate only in one way i.e. sign language, but
many times communicating with normal persons they noticed
difficulty. Therefore, there always exists communication
barrier. This communication barrier is seen because a speech
impaired person uses gesture to commune with common
human being which is not suitable. We are implementing this
project to reduce the barrier between dumb and normal
person. This device design is based on the embedded system.
Flex sensor and NodeMCU are the key components.
Keywords— Flex sensor; NodeMCU; Accelerometer; sign
language; Android; Embedded System.
I. INTRODUCTION
The peoples who cannot able to speak they come across
many problems while communicating with other persons.
The speech impaired person uses sign language instead of
speaking to represent themselves. Deaf persons can
communicate only by using gestures. The significant
drawback of sign language is that only the dumb person can
understand gesture but not normal person. This gadget
transforms gesture into speech i.e., gives voice to silent
community who cannot speak [1-3, 8].
In this project, Flex Sensor plays a big role. The hand
glove is stitch with the flex sensors, which is shown in the
Fig.1. The flex sensors deliver output in the shape of voltage
variation that varies with the degree of bend. The
Microcontroller contain ADC channel, which receives output
from flex sensor. It processes the output and converts it from
analog to digital signal. Furthermore, the process information
is dispatched in a wireless way to the receiver section. The
gesture is diagnosed in this phase, therefore corresponding
output is displayed in the LCD, and concurrently speech
output is playback via speaker. The major advantage of this
assignment is its portability. Thus, the difficulties humans
face in interacting with society can be greatly reduce with the
assist of this project [6].
This paper is prepared as follow section II contains
Literature review of the project. In section III design
consideration is discussed. Section IV consists of Future
scope and discussion of the project. Section V concludes the
paper.
978-1-7281-7016-9/20/$31.00 ©2020 IEEE
Authorized licensed use limited to: Carleton University. Downloaded on September 21,2020 at 07:23:40 UTC from IEEE Xplore. Restrictions apply.
Shaik Sameer Ollepu Ashok
UG Student, ECE Department UG Student, ECE Department
ISL Engineering College ISL Engineering College
Hyderabad, India Hyderabad, India
sksameer80960@gmail.com ashokmunna889@gmail.com
Fig. 1. Gloves with sensors.
II. LITERATURE SURVEY
Earlier hand gesture device was developed by numerous
ways,
Anagha J. Jadhav and Mandar P. Joshi developed a
system, which converts hand gesture to voice. In this system,
they are using Data glove, Flex sensor, Accelerometer, op-
amp, AVR microcontroller and Playback voice module. To
get more samples they are using AVR Microcontroller to
achieve maximum range of voltage. The system output is
generating via speaker [3].
R. Balakrishnan, Rahul H, Santosh BK, Sunil Anthony,
Shivkumar are presented a hand talk assisting system, which
is based on the embedded system. This system provides
voice to those who cannot speak. Arduino Microcontroller is
using to process the data and the process data will send to
android phone where it works as a voice module. This model
contains both hardware and software [2].
Dr. Amardeep Sing Mandeep and Kaur Ahuja are
introduced a device which recognize hand gestures by using
PCA (Principal Component Analysis). This system proposed
a scheme by using database driven which recognize hand
gestures, which is totally based on skin color model and
effective template matching which includes threshold
approach. In this process, first they acquired the image and
then it will segment the hand from whole image and finally
gesture recognition take place where PCA is used to
minimize dimensionality of image. This system is
implemented on MATLAB [4].
Ashish Sethi, Kuldeep Kumar, Hemanth S, Bhaskara Rao
N and Krishnan R are founded an application called SignPro
for mute community. This application converts the real-time
gestures to text conversion this system projected a set of
image processing techniques. The conversion process
contains gesture extraction, matching of gestures and text to
gesture conversion [5].
1262
 Dhawal L, Parmeshwar P. More, Paraful A. Landge,
Harshal S. Tapase and Prof. A.P. Bagade presented a device
for disable persons, which convert gesture to pre-recorded
voice and text. It is also has facility to control home
appliance. In this, the data will process by Arduino
microcontroller and the output will be generate on LCD
display and speaker [6].
Karibasappa R, Ishana M E, Choodarathnakara A L,
Bsavaraju M K, Thanuja C and Sunitha C proposed a device,
which converts gesture to the voice. In this heart of the
gadget is ARM controller which processes all data and it has
GSM module it is used in the emergency circumstance [7].
We referred many other papers where radiation effect on
human body is analysed. [10-13]
III. METHODOLOGY
A. Block Diagram
The system contains both hardware part and software part
where as hardware part include Flex sensors, Arduino Mega,
16*2 LCD Screen, APR33A3 Voice Playback Module
Transmitter, Receiver with Electronic Switches and software
part include programming of Arduino. The microcontroller is
major component of the system. Block diagram of this
system is shown below [6].
Fig. 2. Block Diagram of System
B. Flowchart
Fig. 3. Flowchart
1263
Authorized licensed use limited to: Carleton University. Downloaded on September 21,2020 at 07:23:40 UTC from IEEE Xplore. Restrictions apply.
C. Working
The each finger of glove is stitch up with the flex sensor
and the sensors are directly connected to the Microcontroller.
Whenever the finger movement is take place then the analog
output value will be increases. The microcontroller will
convert analog signal to the digital signal and thus sensor
value will be generate for the bent. For sensing the gestures
the three axis accelerometer is used. Accelerometer is a small
device, which is used to sense the force of it. Based on
sensor values in Arduino a sketch is written using software to
allot characters so that when a human shows a particular
gesture, a specific character will get. The output, which is
obtained form Arduino, is fed to the LCD display and
speaker [1].
D. Hardware Equipments
1) Flex sensor: The speech impaired people uses sign
language to communicate with others. The Flex sensor is
usually used to sense the motion of the hand. Whenever the
hand shows the gesture its resistance equivalently varies
from bending of the sensor. Output will be generated based
on that value [1].
2) Arduino ATMEGA 2560: The system works on the
microcontroller. In this system Arduino AT mega 2560 is
used which has inbuilt ADC. The input of microcontroller is
analog which is converted to digital. Then the data is fed to
LCD display and speaker [2].
3) Three axis Accelerometer: It is a device used for
measuring the acceleration of an in motion or vibrating
body. It will help the flex sensor to give accurate value. It
has three directions i.e. X-axis, Y-axis and Z-axis [1].
4) LCD Display: In this system 16*2 LCD display is
used. It is a used in almost DIYs. 16*2 means it has 16
characters to display in 2 lines. The output is displayed in it
[1].
5) Speaker: Speaker is one of the most popular gadget
for output. In this paper small speaker is used which is
connected to the microcontroller. It will give the sound
which is preloaded [9].
6) Power supply: The total system will work on the 5
volts and 9 volts which is provided by the power supply.
The Arduino required 5 volts , 1 amp to work [1].
E. Software
In this system Arduino IDE software is used to program
the microcontroller. The Arduino programming is similar to
C programming.
IV. FUTURE SCOPE AND DISCUSSION
In this project we are using a battery so it can be potable
and we are processing data with NodeMCU so we can reduce
the size of the system. After implementing this device will be
more reliable and user friendly. Regarding future scope of
this device is introducing many languages to obtain the
flexibility. It can be enhance precision of the device by using
total ten flex sensors.
V. CONCLUSIONS
This system design and implementation of smart glove
will help speech-impaired persons to express their feelings in
voice. By the help of this project normal peoples also can
understand disable person.
ACKNOWLEDGMENT
We would like to thank our Honorable Chairman and
Principle of ISL Engineering College, Mr. Salman
Ahmed and Dr. Masood for supporting and motivation of
this unexpected work. Moreover, heartily thanks to our
faculties and friends for their support and motivation.
REFERENCES
[1] H. Kala, S. R. S., S. Pal, U. S. K., and S. Chakma, “Development of
Device for Gesture to Speech Conversion for the Mute
Community,” 2018 International Conference on Design Innovations
for 3Cs Compute Communicate Control (ICDI3C), pp. 97–99, 2018.
[2] R. Balakrishnan, Santosh BK, Rahul H, Shivkumar, Sunil Anthony,
“Embedded Based Hand Talk Assisting System for Dumb Peoples on
Android Platform,” 4th National Conference on Design Innovations
for 3Cs “Compute-Communicate-Control,” Bangalore, India, pp. 24-
28.
[3] A. J. Jadhav and M. P. Joshi, “AVR based embedded system for
speech impaired people,” 2016 International Conference on
Automatic Control and Dynamic Optimization Techniques
(ICACDOT), pp. 844–848, 2016.
[4] Mandeep Kaur Ahuja, Dr. Amardeep Singh, “Hand gesture
recognition using PCA,” IJCSET (www.ijcse.net) , july 2015, vol 2,
Issue 7, pp. 267-271.
[5] Ashish Sethi, Hemanth S, Kuldeep Kumar, Bhaskara Rao N,
Krishnan R, “SignPro-An Application Suite for Deaf and Dumb,”
IJCSET, May 2012, vol 2, Issue 5, pp. 1203-1206.
1264
Authorized licensed use limited to: Carleton University. Downloaded on September 21,2020 at 07:23:40 UTC from IEEE Xplore. Restrictions apply.
[6] Dhawal L. Patel, Harshal S. Tapase, Paraful A. Landge, Parmeshwar
P. More, Prof. A.P. Bagade, “Smart hand gloves for disable people,”
International Research Journal of Engineering and Technology
(IRJET), volume: 05, Apr-2018, www.irjet.net, pp. 1423-1426.
[7] Karibasappa R, Choodarathnakara A L, Ishana M E, Thanuja C,
Basavaraju M K, Sunitha C, “Smart glove based gesture vocalizer for
deaf and dumb,” International Jouranal of Management, Technology
And Engineering, volume 8, issue XI, November/2018, pp. 817-824.
[8] S.Jeya Anusuya, M.Mary Grace Neela, R.Preethi, G.Ramya,
A.Sophia Packia Selvi, R.Suganya, “Gesture to speech converter for
the mute community using IOT,” Iternational Journal of Innovative
Research in Science, Engineering and Technology, www.ijirset.com,
vol. 8, special issue 2, March 2019, pp. 133-116.
[9] “Speakers Definition”, Techterms.com, 2020. [Online]. Available:
https://techterms.com/definition/speakers. [Accessed: 25- Jan- 2020]
[10] Khan, S.R., Ajij, S. Communication on SWIPT and EH Using
Electromagnetic Behaviour for Power Allocation in Wireless
Networks. J. Inst. Eng. India Ser. B 98, 599–616 (2017)
doi:10.1007/s40031-017-0285-5
[11] K. S. Rana and D. S. Ajij, "Design and simulation of NFC printed
antenna in near field wireless communication for SDC," 2016 IEEE
Distributed Computing, VLSI, Electrical Circuits and Robotics
(DISCOVER), Mangalore, 2016, pp. 247-251.
doi: 10.1109/DISCOVER.2016.7806249
[12] Khan Sohel Rana & Sayyad Ajij, “Behavior of Electromagnetic
Waves at Antenna Boundary in Wireless Communication System: A
tutorial”, 2nd International Conference on Cognitive Knowledge
Engineering ICKE 2016, Dr. Babasaheb Ambedkar marathwada
University, Aurangabad.
[13] K. S. Rana, "Contemporary work in energy harvesting & importance
of radiation free future 5-G WCN," 2018 Conference on Signal
Processing And Communication Engineering Systems (SPACES),
Vijayawada, 2018, pp. 12-15.
doi: 10.1109/SPACES.2018.8316305