JNTUA

COLLEGE OF ENGINEERING
PULIVENDULA
SIGN TO SPEECH CONVERTER GLOVES FOR DEAF
ANDDUMB PEOPLE

Under the guidance of Head of the dept

Sri K.Ravindra Reddy Smt Shaik Taj Mahaboob
PRESENTED BY
D.HARITHA 15191A0412
R.MOSHINI 15191A0439
M.JOY PRADEEPA 15191A0433
S.JAYASURYA 15191A0444
CONTENTS
 ABSTRACT
 INTRODUCTION
 EXISTING METHOD
 DRAW BACKS OF EXISTING METHOD
 PROPOSED SYSTEM
 BLOCK DIAGRAM
 REQUIREMENTS
HARDWARE
SOFTWARE
 EXPECTED OUTCOME
 ADVANTAGES
 DISADVANTAGES
 APPLICATIONS
ABSTRACT
 Speech and gestures are expressions, which are mostly used in
communication between human beings getting the data is the
first step.
 The second step is that recognizing the sign or gesture once it
has been captured is much more challenging, especially in a
continuous stream.
 In fact currently, this is the focus of the research.
 The objective of this project is to design a simple embedded
system based communicating device for deaf and dumb people.
INTRODUCTION
 In our day to day life most of the task we carryout involves
speaking and hearing.
 The deaf and dumb or paralyzed people have difficulty in
communicating with others who cannot understand sign
language and miss-interpreters.
 In this project, we designed a simple embedded system based
device for solving this problem.
EXISTING METHOD
 A sign language is a language, which uses hand gestures, and
body movement to convey meaning,as opposed to accoustically
conveyed sound patterns.
 Research in the sign language system has two well known
approaches are image processing technique and a data glove.
 The image processing technique uses the camera to capture the
image or video, and another approach is sign language
recognition system using a data glove.
DRAW BACKS OF EXISTING
METHOD
 The main drawback of vision based sign language recognition
system image acquisition process has many environmental
apprehensions such as the place of the camera, background
condition and lightning sensitivity.The user always needs
camera forever and cannot implement it in public place.
 By using data glove approach, detection of hand is eliminated
by the sensor glove consists of a flex sensor an accelerometer.
PROPOSED METHOD
 In this, we have suggested a wearable glove for people who
face difficulty in communicating verbally due to various
different reasons (be it deaf or dumb).
 With the possession of this device, they can exhibit their basic
requirements via their gestures and those gestures will be
converted to speech for the hearer to understand what is he or
she trying to say.
CONT…
 In this system, MEMS (Micro Electro Mechanical systems)
will be connected to the dumb person’s hand.
 The moment person gives the signs, MEMS sensor X, Y &
Z values vary for each and every sign.
 Based on those signs controller reads the data of X, Y & Z
and as per software program it commands Voice module
pins.
 APR9600 is the voice module which can be able to store
and play back upto 8 different voices. LCD can be used to
display the functionality of the whole system.
 Arduino UNO is the microcontroller which plays main role
of the system.
BLOCK DIAGRAM
 REQUIREMENTS
HARDWARE SOFTWARE
 Ardunio Uno Controller-l  Arduino C Language
 Power Supply-l  Ardunio-IDE
 LCD-l
 MEMS(Micro Electro
Mechanical Systems)-l
 Voice Play Back
Module(APR9600)-l
 Speaker-l
EXPECTED OUTCOME
 The moment person gives the signs, MEMS sensor X, Y & Z
values vary for each and every sign.
 Based on those signs controller reads the data of X, Y & Z and
as per software program it commands Voice module pins.
 It becomes easy for the hearer to understand what is he or she
trying to say.
ADVANTAGES
 The text and voice output being in English. So, this device
provides efficient way of communication for both deaf-dumb
and normal people.
 Requires fewer components so its cost is low.
 It is small in size; due to the small size we can place its
hardware on our hand easily.
 The whole apparatus carries less weight. Hence they are
portable and flexible to users.
 The use of this glove eliminates the necessity to learn sign
language for communication with speech and hearing impaired.
DISADVANTAGES
 Requires well structured hardware
 Requires reliable sensors to work accurately for long time.
APPLICATIONS
 A Smart Glove Controller is designed which senses hand
movement, and programs it to recognize a set of predefined
gestures, for use in sign language to speech translation
applications.
 For disabled people.