Click to edit Master title style

Smart Glasses For Visually Challenged Person

Major project presentation

Submitted by:
Submitted to: T Mohan Kumar

Dr Cheruku Sandesh kumar T Thrinadh

1
Click to edit Master title style
Introduction

• There is a group of people that the world doesn’t seem to care

about but we do and we want them to feel normal as much as we
can , there is blind people in every country but we want to start in
Final Project: Smart blind glasses

• The idea will make a big difference, not only for blind but the
people that’s around them as well, our idea is not 100% new but I
sure you it’s promising 

• We want blind people to see, not literally but make life a little bit
easier for them and that’s going to be our goal 

2 2
Click to edit Master title style
Main Objective

• In this project, we will be making a prototype of a smart

eyeglass that can help a visually challenged person to
recognize the person in front of him and learn about obstacles
ahead.

• This will be enabled by face recognition and distance detection

features.

3 3
Click to edit Master title style
Requirements

HARDWARE SOFTWARE
• Raspberry
Python PI 4
• Library:
Camera opencv
• Ultrasonic sensor
• USB cable
• Wires
• Glasses
• Earphones
• Battery

4 4
Click to edit
Raspberry PIMaster
4 title style

• The Raspberry Pi 4 Model B (Pi4B) is the first

of a new generation of Raspberry Pi computers
supporting more RAM and with significantly
enhanced CPU, GPU and I/O performance; all
within a similar form factor, power envelope
and cost as the previous generation Raspberry
Pi 3B+.

• The Pi4B is available with either 1, 2 and 4

Gigabytes of LPDDR4 SDRAM

5 5
Click to edit Master title style
Working

• Ultrasonic sensor measures the distance of obstacles and alert the user using voice output. We
can also add a vibration motor for haptic

• If it detects an object close to the user, it will automatically inform the person by giving audio
and haptic feedback

• Camera is to recognise the person in front of the user

• We have to create different arrays for known faces and their names. We must write the image
file name for the face recognition of that member

6 6
Click to edit Master title style

IMAGE DECTECTION
OBSTACL
E
DISTANCE

SMART
GLASSE
S

INDENTIFYING OBJECT
PERSONS DETECTION

7 7
Click to edit Master title style

8 8
Click to edit Master title style
Coding

• For this project we will make two different codes in Python .

• Code 1: To tell the distance of obstacles ahead .

• Code 2: This is to recognise the person in front of the user (known or unknown)

9 9
Click to edit Master title style
Code 1
• Here we need two modules – time and
espeak. We will import both the modules in
code.
• After that we created a distance function
where we import the GPIO and set the pins
for distance sensor.
• If it detects an object close to theuser, it will
automatically inform the person by giving
audio and haptic feedback.
Code 2
• This is to recognise the person in front of the
user (known or unknown).
• Here in this code we will import 3 modules:
face recognition, cv2 and numpy.
• We have to create different arrays for known
faces and their names. We must write the
image file name for the face recognition of
that member
1010
Click to edit Master title style
OUTPUTS

1111
Click toEnhancement
Future edit Master title style

• We can enhance this project to recognise the currency notes using Image detection.

• We can enhance this project to recognise the colour.

1212
Click to edit Master title style
Conclusion

• We are gaining a lot of information's about sensors and we realized that

we are surrounded by them, they are basically the five senses of the
human being but as a machine or device to reveal what is going on in the
world while humans are busy doing something more important.

• A big thank you for all the teachers who helped us.

1313
Click to edit Master title style

Thank You

14
REFERENCES
Click to edit Master title style

• W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld,“Face recognition: A literature survey,” ACM Computing Surveys, 2003, vol. 35, no. 4, pp. 399-
458.
• Herbert Bay, Andreas Ess, Tinne Tuytelaars, and Luc Van Gool. Surf: Speeded up robust features. Computer Vision and Image Understanding (CVIU),
110(3):346–359.
• Rajendran, P.S., Krishnan, P. and Aravindhar, D.J., 2020, November. Design and Implementation of Voice Assisted Smart Glasses for Visually Impaired
People Using Google Vision API. In 2020 4th International Conference on Electronics, Communication and Aerospace Technology (ICECA)  (pp. 1221-
1224). IEEE.
• Kotalwar, G., Prajapati, J., Patil, S., Moralwar, D. and Jewani, K., 2018, December. Smart Navigation Application for Visually Challenged People in Indoor
Premises. In International conference on Computer Networks, Big data and IoT (pp. 998-1004). Springer, Cham.
• Paul, I.J.L., Sasirekha, S., Mohanavalli, S., Jayashree, C., Priya, P.M. and Monika, K., 2019, February. Smart Eye for Visually Impaired-An aid to help the
blind people. In 2019 International Conference on Computational Intelligence in Data Science (ICCIDS) (pp. 1-5). IEEE.
• DHANESH, D.L., DINESH, B.S.P.P.S., KUMAR, S.K. and NIVIN, K., 2021. SMART GLASS FOR VISUALLY IMPAIRED PERSONS.
• Kumar, P.M., Gandhi, U., Varatharajan, R., Manogaran, G., Jidhesh, R. and Vadivel, T., 2019. Intelligent face recognition and navigation system using
neural learning for smart security in Internet of Things. Cluster Computing, 22(4), pp.7733-7744.
• Bhuiyan, A., Islam, M.A., Shahriar, M.H., Supto, T.H., Kasem, M.A. and Daud, M.E., 2020, June. An Assistance System for Visually Challenged People
Based on Computer Vision and IOT. In 2020 IEEE Region 10 Symposium (TENSYMP) (pp. 1359-1362). IEEE.
• Hu, M., Chen, Y., Zhai, G., Gao, Z. and Fan, L., 2019. An overview of assistive devices for blind and visually impaired people.  International Journal of
Robotics and Automation, 34(5), pp.580-598.

15
Click to edit Master title style
REFERENCES
• Chen, X. and Yuille, A.L., 2005, September. A time-efficient cascade for real-time object detection: With applications for
the visually impaired. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(CVPR'05)-Workshops (pp. 28-28). IEEE.
• Tapu, R., Mocanu, B. and Zaharia, T., 2017. DEEP-SEE: Joint object detection, tracking and recognition with application
to visually impaired navigational assistance. Sensors, 17(11), p.2473.
• Afif, M., Ayachi, R., Said, Y., Pissaloux, E. and Atri, M., 2020. An evaluation of retinanet on indoor object detection for
blind and visually impaired persons assistance navigation. Neural Processing Letters, pp.1-15.
• Wong, Y.C., Lai, J.A., Ranjit, S.S.S., Syafeeza, A.R. and Hamid, N.A., 2019. Convolutional neural network for object
detection system for blind people. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 11(2),
pp.1-6.
• Afif, M., Ayachi, R., Pissaloux, E., Said, Y. and Atri, M., 2020. Indoor objects detection and recognition for an ICT
mobility assistance of visually impaired people. Multimedia Tools and Applications, 79(41), pp.31645-31662.
• Patil, M. and Kagalkar, R., 2015. An Automatic Approach for Translating Simple Images into Text Descriptions and
Speech for Visually Impaired People. International Journal of Computer Applications, 118(3), pp.14-19.
• Tosun, S. and Karaarslan, E., 2018, September. Real-Time Object Detection Application for Visually Impaired People:
Third Eye. In 2018 International Conference on Artificial Intelligence and Data Processing (IDAP) (pp. 1-6). Ieee.

1616