GST - Bengaluru Campus

Department of Computer Science and Engineering

Smart communication framework for visually

impaired people
Project Phase-I (Review-3) Presentation
Under the guidance of Presented by
N.Revanthi 322010305050
Dr. Sowmya
B.Vedasya 322010306056
Assistant Professor
R.Premitha 322010306038
P.Ashok Reddy 322010306019
02/05/2024 1
 CONTENTS
• Abstract
• Introduction
• Problem definition
• Literature Survey
• Hardware Components
• Block Diagram
• Overall Workflow Diagram
• Module Implementation
• Advantages
• Conclusion
• References
2
 ABSTRACT

• The device tailored to meet the unique needs of visually impaired individuals .
• We have come up with an idea called smart glove that will convert hand
movements into text and allow the visually impaired to express themselves and to
control the home appliances.
• The device can carefully sense each resistance and each movement made by the
hand.
• This device helps dumb ,deaf and impaired people to communicate easily.
 INTRODUCTION

• The idea behind this is to make secure and comfortable for impaired people .
• Blind/paralyzed people face lot of issues while navigating around places by
always depend on others. They have high Risk of falls, fractures, and injuries.
• To overcome those challenges a lot of technologies have been implemented, but
because of drawbacks they don't reach to the people. So we implemented a glove
which can help blind and paralyzed people.
• We came up with an idea which is extended work of our project. The project is to
develop a cost-effective system which can give voice to voiceless people with the
help of Smart Glove.
 Problem Definition

• This project aims to develop a Smart Hand Talk Glove based on

Microcontroller to provide a better solution for impaired people.
 Literature Survey
S. Title of Paper Abstract
N
O
1 Hand Gesture Interacting with physical
world using expressive body
Recognition using PCA movements is much easier
and effective than just
speaking. Gesture recognition
turns up to be important field
in the recent years.
Communication through
gestures has been used since
early ages not only by
physically challenged persons
but nowadays for many other
applications.
Outcome
the medical experts to pass the
instruction to the robotic hands
remotely to add the accuracy in
the operations. But the proposed
model is not capable of working
with the images containing hands
of other than skin color. The
proposed model does not evaluate
the images clicked in other light
colors where the hand gestures
has been clicked and the model
work only with static gesture .In
future the system can be upgraded
to support dynamic gestures and
an application for controlling
medical operations can be
developed using the system.
Methodology
• Image Acquisition: Images are
acquired using the 13 megapixel
real-aperture camera in
controlled background as well as
by varying the lightning
conditions.
• B. Hand Segmentation: The
main and basic step in hand
gesture recognition is to
segment the hand from the
whole image so that it can be
utilized for recognition. In our
proposed color skin color
segmentation is applied to
segment the hand.
• Conversion from RGB to YCbCr :
The proposed skin color
segmentation in applied to
YCbCr color space.
Research Gap
The database collected in the
ideal conditions has proved to
be the most efficient database
in terms of accuracy and gives
100% accuracy and when the
lightning conditions are
changed the accuracy
decreases as compare to the
previous one. The system
shows 91.43% with low
brightness images .The hand
images have been obtained
for the purpose of human
computer interactions for the
operation theatre robots,
which must understand the
hand language in order to
take the actions
2 Real time detection and
recognition of Indian and
American sign language using sift
in
A real time sign language
detector is a significant step
forward in improving
communication between the
deaf and the general
population. We are pleased to
showcase the creation and
implementation of sign
language recognition model
based on a
Convolutional Neural
Network(CNN).We utilized a
Pre-Trained SSD Mobile net V2
architecture trained on our own
dataset in
order to apply Transfer learning
to the task.
a robust model that
consistently classifies Sign
• Image preprocessing: The
image is first preprocessed to
The system is able to
recognize selected Sign
language in majority remove noise and enhance Language signs with the
of cases. Additionally, this
strategy will be extremely
the features of the hand.
• Hand segmentation: The hand
accuracy of 70-80% without a
controlled background with
beneficial to sign language region in the image is then small light.
learners in terms of segmented from the
practiceing sign language background.
• feature extraction: Features
are extracted from the hand
region. Sift recognition.
• Classification: The extracted
features are then classified to
determine the hand gesture
being performed.

3 An efficient frame work for Hand gesture recognition

Indian sign language recognition
using Wavelet
transform(ISLR system)
system is considered as a way
for more intuitive and proficient
human
computer interaction tool. The
range of applications includes
virtual prototyping, sign
language
analysis and medical training
An automated ISLR system
based on DWT is presented in
this paper. DWT sub-band
energies extracted from
the hand gesture images are
used as features along with
the area of the segmented
hand gesture region. Otsu
thresholding and
morphological operators are
used for the segmentation
procedure.
• Image preprocessing: The
input image is preprocessed to
remove noise and enhance
the features of the hand.
• Hand segmentation: The hand
region in the image is
segmented from the
background using a skin color
segmentation algorithm.
• Feature extraction: SIFT
features
• Gesture recognition: A
support vector machine (SVM)
classifier is trained on a
labeled dataset of ISL and ASL
gestures.
The nearest neighbour -
classifier used for the
classification provides 99.23%
accuracy while using the
cosine distance metric. The
proposed
framework is centralized the
efforts of hand gesture and
computer vision algorithms
which in turn develop a low
cost and effective ISLR
system.
 Technical Specification
(Hardware Components)

LM353OP Amplifier
PIC Microcontroller

Flex Sensor

HC05 Bluetooth Module 16*2LCD Display

Module Implementation
BLOCK DIAGRAM
 WORK FLOW

Flex sensors is used Through amplifier it With the help of

To sense the Converts gestures into microcontrollers
gestures text It converts text to speech

Through Lcd display it also

display the text and provides
audio through speakers

Should connect Bluetooth for

the device
02/05/2024 12
Sign Language Gestures
 Modules with description

1. Text-to-Braille Conversion: This module converts digital text into Braille, which can
be read by a tactile display. Visually impaired people can use text-to-Braille
conversion software to generate Braille output from speech. This allows them to
communicate with others using speech-to-text software, and to receive Braille transcripts
of conversations.
2. Object Recognition :This module helps identify objects in the environment and
provides audio or tactile descriptions .We can identify person , object, surroundings
for impaired people. As object recognition algorithms continue to improve, we can
expect to see even more innovative and helpful applications in the future.
 Advantages
• Reduce cost of Assistive Technologies
• Increase the availability of Assistive Technologies
• Empower visually impaired people with their own solutions
• Able to improve their safety , independence , access to education and
employment , and social participation
 Conclusion
• The project targets one of the most prominent problems of current Society . Our Motivation is to lesson their
hardship and make the world bit easier for them . This System can work in both indoor and outdoor environment
effectively
• This Project includes the use of Arduino , Flex Sensor to convert hand gesture into audible speech as well as an
android application is used to covert speech to text which will be displayed on LCD screen and control home
appliances . In this message can also displayed in the form of text on the LCD screen
• This project aims to lower the dependence of blind/paralyzed people on the normal people and also help people
to increase their independence and quality of life
 References
[1] Hand Gesture Recognition using PCA J. P. Sahoo S. Ari and D. K. Ghosh "Hand
gesture recognition using PCA(PRINCIPAL COMPONENT ANALYSIS)" IET Image
Processing vol. 12 no. 10 pp. 1780-1787 Oct. 2018

[2] Hand gesture dumb people it is a digital image processing. Swaroop, Abhishek,
Kishor, Ravindra Prasad ,Anisha Vol-8 Issue-9 2021

[3] An efficient frame work for Indian sign language recognition using Wavelet
transform(ISLR system) Madhavan Suresh Anand, Nagaraju Mohan Kumar ,Angappan
Kamarasan Department of computer Science Anna University Vol.7 No.8,June 2016