JERUSALEM COLLEGE OF ENGINEERING, CHENNAI-100

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

JCS1731 PROJECT WORK PHASE – 1

BLIND DETECTION SYSTEM: REAL TIME OBJECT DETECTION WITH DISTANCE
AND VOICE ALERTS

DATE: 14/09/2003
BATCH NO: 13
ZEROTH REVIEW

PRESENTED BY SUPERVISED BY
1. SUKESH P J RAJESH PUSHPA
2. THARUN KUMAR K
3. SRI ARUN S
Department of CSE Jerusalem College of Engineering Sep 30, 2023 1
 OBJECTIVE

 IT’S A KNOWN FACT THAT ESTIMATED NUMBER OF VISUALLY IMPAIRED PERSON IN

THE WORLD IS ABOUT 285 MILLION, APPROXIMATELY EQUAL TO THE 20% OF THE
INDIAN POPULATION.
 INTEGRATED MACHINE LEARNING SYSTEM WHICH ALLOWS THE BLIND VICTIMS
TO IDENTIFY AND CLASSIFY REAL TIME BASED COMMON DAY-TO-DAY OBJECTS
AND GENERATE VOICE FEEDBACKS AND CALCULATES DISTANCE WHICH
PRODUCES WARNINGS WHETHER HE/SHE IS VERY CLOSE OR FAR AWAY FROM THE
OBJECT.
 THE SAME SYSTEM CAN BE USED FOR OBSTACLE DETECTION MECHANISM.
Department of CSE
Sep 30, 2023 2
Jerusalem College of Engineering
 PROJECT DOMAIN

 INITIALLY, WE TRIED TO IMPLEMENT THE SYSTEM ON AN IOT BASED VERY FAMOUS HARDWARE MODULE
POPULARLY KNOWN AS RASPBERRY-PI , BUT AMID LOCKDOWN PERIOD COULDN’T MAKE IT.
 BUT FOR THE TIME BEING WE HAVE IMPLEMENTED THAT VIA THIRD PARTY APPLICATIONS. HENCE, THE
SYSTEM IS SET UP IN SUCH A WAY WHERE AN ANDROID APPLICATION(ASSUMING YOU ARE IMPLEMENTING IT
ON A ANDROID DEVICE) WILL CAPTURE REAL-TIME FRAMES AND WILL SEND IT TO A LAPTOP BASED
NETWORKED SERVER WHERE ALL THE COMPUTATIONS TAKE PLACE.
 THE LAPTOP BASED SERVER WILL BE USING A PRE-TRAINED SSD DETECTION MODEL TRAINED ON
COCO DATASETS. AFTER TESTING WITH THE HELP OF VOICE MODULES THE CLASS OF THE OBJECT WILL BE
CONVERTED INTO A DEFAULT VOICE NOTES WHICH WILL THEN BE SENT TO THE BLIND VICTIMS FOR THEIR
ASSISTANCE.
 ALONG WITH THE OBJECT DETECTION , WE HAVE USED AN ALERT SYSTEM WHERE APPROXIMATE WILL GET
CALCULATED. IT USES RESNET BASED ARCHITECTURAL APPROACH.
Department of CSE
Sep 30, 2023 3
Jerusalem College of Engineering
 EXISTING SYSTEM

 EFFICIENT IMPLEMENTATION OF THIS MODEL DEPENDS UPON THE COMPATIBILITY WITH

PYTHON AND LIBRARY INSTALLATION HURDLES. THANKFUL TO STACKOVERFLOW AND
.
PYTHON UNOFFIICIAL BINARY RELEASES FOR HAVING PRE-BUILDED FILES UPLOADED
AND YOU CAN JUST DOWNLOAD IT FROM HERE AS PER YOUR SYSTEM’S COMPATIBILITY.
 WE HAVE IMPLEMENTED IT BY USING TENSORFLOW APIS. THE TENSORFLOW OBJECT
DETECTION API IS BASICALLY A STRUCTURE BUILD FOR CREATING A DEEP LEARNING
NETWORK THAT SOLVES THE PROBLEMS FOR OBJECT DETECTION.
 THIS INCLUDES A COLLECTION OF COCO DATASET, THE KITTI DATASET, AND THE OPEN
IMAGES
Department of CSEDATASET. HERE, WE ARE PRIMARILY FOCUSED ON COCO DATASETS.
Sep 30, 2023 4
Jerusalem College of Engineering
 PROPOSED SYSTEM

 NOW WE’LL BE HEADING UPON CHOOSING THE MODEL FOR OUR PROPOSED SYSTEM.
 NOW, A BUNCH OF PRE-TRAINED MODELS ARE WITH TENSORFLOW . YOU CAN USE ANY ONE OF
THEM. THEY ARE PRETTY GOOD AND DEPENDING UPON YOUR SYSTEM SPECIFICATIONS YOU
CAN CHOOSE ONE. FOR A FASTER ACCURACY YOU CAN GO WITH SSD DETECTION AND FOR
BETTER ACCURACY YOU CAN GO WITH MASK RCNN BUT MOST OF THE SYSTEM SHOWS
SMOOTH PERFORMANCE WITH SSD MOBILE_NET DETECTION . SO, I’LL ELABORATE SSD
ALGORITHM.
 MODELS:
1. SSD ARCHITECTURE, 2. ANCHOR BOX, 3. ZOOM LEVEL, 4. MOBILENET, 5. DEPTH
ESTIMATION
Department of CSE Jerusalem College of Engineering Sep 30, 2023 5