Professional Documents
Culture Documents
Abstract- For blind persons it is very essential to recognize The task of finding and identifying objects is still a
a product of their daily use so we implied a method to identify challenge for computer vision systems. It is noted that
product in their everyday routine by use of camera. To approach used for object recognition is feature extraction.
separate a object from un-necessary background, movement
based technique is used to spot object of concern from the
video by instructing person to shake the object that gives
A. Features extraction
moving object area by K-means clustering background When we used features instead of raw pixel data
separation technique. After detection of moving area feature classification becomes easier [10]. Visual substitution
extraction SIFT technique is used to take out key points of that systems generally exploit a single camera to capture image
product and that key-point is matched with the data base data. Further processing for Recognition is then processed
images if it matches efficiently then it identify a product and based on different features extracted from that data.
produce name of that product to blind persons in speech. Features extraction is the process by which interesting parts
Instead of OCR we used SIFT because in OCR orientation of of an image are detected and represented for further
camera must be towards label of product and for blind person processing. It is important step in most computer vision and
it is very tough to locate label efficiently whereas in SIFT
product orientation is not a big deal as key-points can be
image processing solutions because it marks the transition
matched from any position. from pictorial to non pictorial (alphanumerical, usually
quantitative) data representation [11]. Types of features
Index terms-Blind, Feature extraction, OCR, SIFT. extracted from image depend on the type of image (e.g.
binary, gray-level, or color), the level of granularity
I. INTRODUCTION (complete image or individual regions) desired, and the
According to the World Health Organization, 314 context of the application. The features which are extracted
million people in the world are visually impaired and out of are usually represented in an alphanumerical way for further
them 15% blind. 13% of visually impaired people reside in processing. The actual representation based on the technique
developed countries. Recently, several electronic assisting used.
devices [2], [3], [4], [5], [6], [7], [8] & [9] developed for
these persons but they cannot handle product recognition B. Features extraction based SIFT
efficiently. For example, moveable bar code readers used to Scale Invariant Features Transform approach [12] was
assists visually impaired people to recognize different designed to match pictures or objects of a different scene.
products but to find the position of the bar code and to point The features are partially invariant to illumination and 3D
the bar code reader at the bar code efficiently is not easy for camera viewpoint and invariant to scale and rotation. There
blind people. are two important steps to extract SIFT features: localization
The majority of existing systems are for mobility and key-points by extreme scale space detection and generation
obstacle detection but still blind people face big problem to of descriptors of points of interest. SIFT algorithm is applied
identify of their environment and its components [10]. to object recognition. First, key-points are extracted from a
Identifying and locating objects is the need for mobility of reference image and stored in the database. Then objects in
blind people by travel assistance and aid to navigation. For the target image are compared with the stored references
this reason, we were interested in the evaluation of an based on Euclidean distance between features vectors. The
efficient algorithm for fast and Robust computer vision to object is identified by the matching between key-points.
identify and locate objects in a video scene .We aim to In principle, SIFT works like a multi-scale corner
describe our method [10] to identify the nearby object for detector with sub-pixel positioning accuracy and a rotation-
blind people by proposing an approach for analyzing video invariant features descriptor attached to each candidate point
scenes based on feature extraction. [1].
SIFT features carry with the location of key-points,
II. OBJECTS RECOGNITION USING FEATURES scale, and orientation. Lowe uses a four-dimensional
EXTRACTION similarity transformation as the original Hough banning
structure, thus each bin denotes a particular location for the
object center, scale, and in-plane rotation. Each matching
Fig. 1. Our proposed approach for object recognition for blind people
2016 World Conference on Futuristic Trends in Research and Innovation for Social Welfare (WCFTR’16)
Data base images shown in Figure 3, after
preprocessing and foreground and background separation
SIFT algorithm is performed and key-point of input image is
drawn and that is matched with the features of database
image after successful matching image recognition takes
place. Distinct features can be find by SIFT even in the
small objects for efficient recognition of object we have to
improve the rate of object recognition. For efficient
matching we will use SIFT in object recognition.
In the above operation 564 key-points found, object
detected as bourn vita and processing time is 5.35 ms
similarly various objects are recognized using same
algorithm efficiently.
V. CONCLUSION
In recent years, some solutions have been devised to
help blind people or visual impaired in recognizing objects
in their environment But it is not that efficient to recognize
surrounding objects our purpose is to provide a robust and
easy system for blind people to recognize their surrounding
objects. Our proposed system uses a single camera to
capture images of the view in front of the user. Different
features are then extracted from those images and objects in
the scene are recognized by comparing these features with
those of known database objects. We have evaluated SIFT
Fig. 3 . Database images algorithm for feature extraction. Our future work consists
on to increase the object recognition rate, to use our system
for different application like obstacle detection and to find
distance information between camera and object.
REFERENCES