Department of Information Science and Technology,

Anna University, Chennai.

Motion Tracking of Humans under An analysis of BoVW and cBoVW based
Occlusion Using blobs Image Retrieval
Introduction
Introduction
The growth of Internet, extensive usage of Social Media and Mobile
An automatic video surveillance has been emerged where people/objects Phones, accessing images are becoming mandatory, thereby need to
could be identified and tracked effectively. While tracking the movement of retrieve images both accurately and efficiency. This paved the way for a
the objects, Occlusion, a challenging issue may arise. Occlusion means new research area namely Content Based Image Retrieval(CBIR), where
hiding the target object/person either partially or fully. This occurs when two given an image as a query, the system returns all the matched images from
persons cross each other or person crossing an object. A particular the stored image databases based on their similarity score.
person/object may fail to get tracked under occlusion. This research made a
special attempt to track the blob of few objects even under occlusion. Here,
Particle filter has been integrated along with the blob tracking approach to BoVW and CBoVW Image Retrieval
track the particular object/person effectively under occlusion conditions.
Bag-of-Visual Word (BoVW),an image representation model, is a sparse
Proposed Tracking Algorithm vector model based on the occurrence count of the visual words extracted
from image features.
OBJECT DETECTION One of the major limitations of BoVW model is the quantization error that
1. Adaptive Background Modelling
2.Background up-dation
is caused mainly because of false matches.Here,
3. Foreground Segmentation a) The BoVW model based Image Retrieval is performed and analyzed
for various visual word size and vocabulary sizes.
b) Based on the assumption that objects of our interest covers mostly the
centre part of the images and thus the features belonging to the centre
OBJECT part of the images are given attention (cBoVW)
REPRESENTATION OBJECT TRACKING
1. Contour Formation 1. Blob Tracking Algorithms
2. Feature Selection 2. Particle Filter

a)Image Retrieval using BoVW

Figure. 1. Object Tracking Process
To predict the positions of known objects under occlusion blob tracking approach
has been proposed. Initially, a centre point of the contour has been considered as
centroid, and assuming a threshold radius from the centroid, circle has been
drawn inside the contour. In each and every frame, the circle has been tracked
continuously. If the circles get overlapped in consecutive frames, then the blob
has been considered as the same or existing object. The same person has been
moving in continuous frames.
P2
P1
1. Extract features 𝑓𝑗𝑖 where j is the jth feature f of image i from SIFT descriptors to get 128 bit feature
vectors.
2. For codeword generation, apply clustering over the features to get the visual words 𝑣𝑤1 , 𝑣𝑤2 , … 𝑣𝑤𝑐
where c is number of visual words and 𝑣𝑤𝑖𝑐 is the visual words and thereby constituting a visual
dictionary vd= 𝑣𝑤𝑐 where vd is collection of visual words.
3. For training Images in the database, hard quantize the features of each image to the nearest visual words.
ℎ𝑞𝑖 = ℎ𝑞𝑖1 , ℎ𝑞𝑖2 , … ℎ𝑞𝑖𝑛 ,ℎ𝑞𝑖𝑛 = 𝑛𝑒𝑎𝑟𝑒𝑠𝑡 𝑣𝑤𝑐
4. For testing a query image, compare the database images using similarity measure
ℎ𝑖𝑔ℎ 𝑠𝑐𝑜𝑟𝑒, 𝑖𝑓 𝑠𝑖𝑚𝑖𝑙𝑎𝑟
𝑆𝑐𝑜𝑟𝑒𝑞𝑑 = where q is the query image, d is the database image and evaluate
𝑙𝑜𝑤 𝑠𝑐𝑜𝑟𝑒, 𝑖𝑓 𝑑𝑖𝑠𝑠𝑖𝑚𝑖𝑙𝑎𝑟
them by finding the Mean Average Precision (MAP), Average Precision (AP).

Figure.2. Person 1 and 2 walking in the same direction

P2
P1

P1
P2
Figure 1.MAP for BoVW based Image Retrieval
Figure.3. Person 1 and 2 walking in the opposite direction b)Image Retrieval using cBoVW
The radius of the circle and centroid has been considered as features of each Keeping the first three steps as same, modification is done only in the step
sample. Each sample in the particle filter has the features of the blob. In 4 as follows
Particle filter, Conditional state density p(Xt|Zt) for the set of samples has
been given by, S= {S(n),π(n)} Where S(n) represents the sample set and π(n) 4. a. For the given query image take the central area of the image.
represents the sampling probability . b.Fix the number of circles 𝑐1 , 𝑐2 , … 𝑐𝑘 , k is the number of circles where the location and the radius of the
circles are fixed.
c.Find the features that belongs to these fixed circles and use these features to compare with the database
images. Convensional BoVW Modified BoVW

90

80

70

60
Percentage

Figure.4. Person 1 and 2 in the input frame and their representation 50

40

30

20

10

0
Butterfly Horse Bike Mushroom Airplane
Category Title

Figure. 5. Evolution of state densities and estimated states using Particle Figure 2.Comparison of BoVW and cBoVW
filter for a single person and for two persons during occlusion
Conclusion
Conclusion
An automated tracking system has been developed using blob and particle Thus the features belonging to the central area of each image are
filters. The proposed algorithm has been applied to CAVIAR dataset and the considered for matching and a small improvement in retrieval accuracy
user generated datasets. This can be effectively used under occlusion also. In as well as computational efficiency for image matching has been
future, along with the detection of full occlusion, multiple object tracking, obtained. Thereby this also lowers (scale down) the quantization error.
activity and behaviour of the person can also be identified.
M.Sivarathinabala, Research Scholar, P.Arulmozhi, Research Scholar,
sivarathinabala@gmail.com, arulmozhikec@gmail.com,
9791246302 9789470805