Presentation by

Mr. Basavaprabhu P USN : 4PM18EC009

Ms. Gagana H M USN : 4PM18EC021
Ms. Meghana P H USN : 4PM18EC041
Mr. N M Kirankumar USN : 4PM18EC046

7th Semester, Dept. of E&CE,

PESITM, Shivamogga.

Under the Guidance of

Mr. Nithin H V
Assistant Professor
Dept. of E&CE, PESITM, Shivamogga.
 Introduction

 Motivation

 Literature Survey

 Problem Statement

 Objectives

 Methodology

 Expected Outcome

 References

Dept. of E&CE, PESITM, Shivamogga.

• The world's deaf and dumb population is estimated to be around nine million
individuals. Communication between deaf and hearing people poses a major difficulty.

• Communication being such an important ,this leaves them with very little room.

• Blind people can communicate freely using conventional language, however deaf
people use sign language, which is a manual-visual language.

• Sign language is a non-verbal means of communication used by deaf people all over
the world.

• A Deaf-Mute communication interpreter is a technology that converts hand signals

into spoken language.
2

Dept. of E&CE, PESITM, Shivamogga.

• To make disabled people feel confident in their communication part.

• To get rid of their fear or kind of awkwardness while communicating with others.

• Cost-efficient when compared to other technologies in this modern world.

Dept. of E&CE, PESITM, Shivamogga.

  Name of the Journal  Title Vol. No & Month & Year International/
Sl.NO National
Issue.
No
  International Journal of Hand Assistive Device for Deaf and  Vol 7,  June- 2018  International
Advanced Research (IJAR)
1 Dumb People Issue 8
 
1. Translating the moment of Hand to Electric signal to control the home appliances.

  International Research Speaking Microcontroller for Deaf Vol 6,  June - 2019  International
  Journal for Engineering and and Dumb People Issue 6
2 Technology (IRJET)

1. In this paper they used two input keys via button and when the buttons are pressed the output is displayed on LCD.

    Assistive sign language converter Vol 4,   International

3 IEEE Xplore for Deaf and Dumb Issue 7 2020

1. The sign language of the user are captured through camera and which are converted into audio and text format.

Dept. of E&CE, PESITM, Shivamogga.

  Name of the Journal  Title Vol. No & Month & Year International/
Sl.NO National
Issue.
No
  Journal of Emerging Assistive System for Deaf, Dumb or  Vol 7, July - 2020  
4 Technologies and Blind Issue 7 National
Innovative Research
(JETIR)
1. The device will convert text/image to voice for blind, speech to text conversion for deaf and conversion of hand
gestures to text for dumb people.
    System Based Sensory gloves for  Vol 5,  July -2018  
5 IEEE Xplore Sign Language Recognition Issue 7 International

1. SLR based on sensory gloves are significant innovations that aim to procure data on the shape or movement of the
human hand.
    Smart Wearable Hand Device for  Vol 18,  February - 2018  
6 IEEE Sensors Journal Sign Language Interpretation Issue 6 International
System with Sensors Fusion
 
1. An android based mobile application was developed with a text-to-speech function that converts the received text into
audible voice output.

Dept. of E&CE, PESITM, Shivamogga.

Recognition of sign language is a problem that has been studied for many years. It is
still difficult for sign language speakers to communicate with non-sign language
speakers. The conversation of sign language speakers was incomprehensible to non-
sign language speakers. As a result, there was no mutual understanding between sign
language users and non-sign language users.

Dept. of E&CE, PESITM, Shivamogga.

1. To create our own dataset, label the images.

2. To convert Hand Gestures into regional language, based on different locations.

3. The deaf people will recognize the gesture by seeing the LCD and the normal people
will listen to the speech from speaker.

Dept. of E&CE, PESITM, Shivamogga.

Figure 1: Block Diagram of the gesture translator system 8

Dept. of E&CE, PESITM, Shivamogga.

•The camera is activated when the accelerometer sensor detects a movement.
•Then we supply input in the form of hand gestures using camera module.
•The gesture is then detected and sent to raspberryPi for preprocessing.
•The feature extraction is then carried out using machine learning techniques such as the
CNN algorithm.

•The retrieved image is then compared to the training database.

•Output is in the form of text on LCD display and speech from the audio output of speaker.

Dept. of E&CE, PESITM, Shivamogga.

The Gloves represents the sign language letters as a text on LCD and outputs as an
audio through the speaker which helps in limiting the communication barrier
between Deaf and Dumb with Vocal people..
[1] Yogeesh M, Sivakumar B “Implementation Of A New Methodology For Personal Communication System Using
Raspberry-Pi”, International Journal of Recent Scientific Research, July, 2019.Atlantis Highlights in Computer Sciences,
volume 4
[2] Farahanaaz Shaikh, Shreya Darunde, Nikita Wahie and Swapnil Mali, “Sign Language Translation System for Railway
Station Announcements”, 2019 IEEE Conference (IBSSC).
[3] Karmel A, Anushka S, Muktak P, Diksha, “Iot Based assistive device for deaf, dumb and blind people”, ICRTAC 2019.
[4] S.Shareef, M.M Hussain, A.Gupta, Aejaz A, “Hand Gesture Recognition System for Deaf and Dumb”, International
Journal of Multidisciplinary and Current Educational Research (IJMCER) 2020.
[5] Rajam, P. Subha and Dr. G Balakrishnan, “Real Time Indian Sign Language Recognition System to aid Deaf and Dumb
people”, 13th International Conference on Communication Technology (ICCT), pp. 737- 742, 2011.
[6] N. Praveen, N. Karanth and M. M. S, “Sign Language Interpreter Using A Smart Glove,” in International Conference on
Advances in Electronics Computers and Communications, 2014.
[7] R Suganya, T. Meeradevi, “Design of a communication aid for physically challenged.”, 2015.
[8] L. Anusha, Y. Usha Devi, “Implementation of Gesture Based Voice and Translator for Dumb People”, 2016.
[9] Noor Ibraheem and Rafiqul Khan, “Survey on Various Gesture Recognition Technologies and Techniques”
International Journal of Computer Applications, Vol.50, 7 July 2012, pp.38-44.
[10] Pallavi Verma, S.L.Shimi and S. Chatterji, “Design of Smart Gloves” International Journal of Engineering Research &
Technology (IJERT), Vol.3, Issue 11, November-2014, pp.210-214.
11

Dept. of E&CE, PESITM, Shivamogga.