ATHARVA EDUCATIONAL TRUST'S

ATHARVA COLLEGE OF ENGINEERING

(Approved by AICTE, Recognized by Government of Maharashtra
& Affiliated to University of Mumbai - Estd. 1999 - 2000)

Paper Id / Submission Id :____

Paper id (easychair id):___ Author s Name : Akansha Bhargava,Gauri

Salunkhe,Kishor Bhosale
Institute Name: Atharva College of Engineering
Presentation given by: Akansha Bhargava
Paper Title: A Comprehensive Study and Detection of Anomalies for
Autonomous Video Surveillance Using Neuromorphic
Computing and Self Learning Algorithm
PDFeXpID: 233

2020, International Conference on Convergence to Digital World – Quo Vadis (ICCDW 2020 )
 Abstract

Video Analytics is widely applied in the field of surveillance.

Recently, with the advent in technology deep learning
network has been incorporated in the video action
detection. Traditional CNN is employed to extract 2D spatial
features of image but for video it is required to exploit CNN
for temporal information. In this work we propose to do
instance segmentation in video bytes and predicting the
actions with the help of deep learning. And, we aim to
present an implementation of an algorithm that can depict
anomalies in real time video feed.

Date:
2020, International Conference on Convergence to Digital World – Quo Vadis (ICCDW 2020)
Problem Definition/ Objective

Implementation of an algorithm that can depict anomalies

in real time video feed.
Introduction

The proposed system aims to address this limitation by

using incremental learning. Video content analysis
includes, motion detection, shape recognition, style
detection, tamper detection, video tracking[1-24].Detection
of intruders or pattern classification is still a challenge for
automated CCTV cameras and having a human operator is
an inefficient way to monitor vigilantly . Humans loses their
95% of ability to concentrate after twenty five minutes . In
this research, we propose a video content analysis
technique that can use the human analysis method but
also overcome the shortcomings of human behavior.
Literature Survey

An analysis of semantic features is discussed in [7]. In

this, any human activity is broken down into smaller
elements which gives better results with complex data.
Though it did not come up with any solution for activities
having a resemblance in appearances. Abnormal motion
detection algorithm has been implemented in [11] that
uses macroblock motion vectors to analyze real time
behaviors.In [12] MPEG motion vectors and human
detection and posture recognition have been used for
activity recognition. However, the real time detection has
not been done in that.
Theory ( Proposed
work/Implementation/Algorithm etc.)

Deep neural network provides a solution to analyze the video

content using unsupervised learning. We propose a deep
belief network for learning.DBN is an unsupervised method
to train an unlabelled data. DBNs have the potential to
extract features and to categorize them that finds applications
in various image processing fields. They can be extended to
do the feature extraction in video bytes too. RBM are the
basic blocks for constituting DBN. RBM has two layers
namely hidden and visible and they can be heaped on top of
each layer. These layers are disjoint in nature and they are
trained with different representation of data.
Results and Discussions

The proposed algorithm will facilitate an

unsupervised learning methodology that will
discern essential characteristics or feature set
from the given video frame to provide advance
assistance in surveillance field. The algorithm
will be based on a self-learning algorithm that
would help to design a better system that could
adapt to changing environment.
Future Scope

1) The standpoint issue it can survey the entire

area of interest.
2) Background reduction
3) Individual semblance
4) The available datasets have simple actions
defined which are not able to distinguish
between the certain human emotions.
References

[1] D. Gowsikhaa, S. Abirami, and R. Baskaran, “Automated human behavior analysis from surveillance videos: a survey,” Artificial Intelligence Review,
vol. 42, no. 4, pp. 747–765, Dec. 2014.

[2] Rashmika Nawaratne, Tharindu Bandaragoda, Achini Adikari, Damminda Alahakoon, Daswin De Silva “Incremental Knowledge Acquisition and Self-
Learning for Autonomous Video Surveillance”, in 2017 43rd Annual conference of the IEEE Industrial Electronics Society.

[3] A. B. Sargano, P. Angelov, and Z. Habib, “A Comprehensive Review on Handcrafted and Learning-Based Action Representation Approaches for
Human Activity Recognition,” Applied Sciences, vol. 7, no.1, p. 110, Jan. 2017.

[4] D. D. Silva and D. Alahakoon, “Incremental knowledge acquisition and self learning from text,” in The 2010 International Joint Conference on Neural
Networks (IJCNN), 2010, pp. 1–8.

[5] D. D. Silva, X. Yu, D. Alahakoon, and G. Holmes, “Semi-supervised classification of characterized patterns for demand forecasting using smart electricity
meters,” in 2011 International Conference on Electrical Machines and Systems, 2011, pp. 1–6.

[6] D. D. Silva, X. Yu, D. Alahakoon, and G. Holmes, “Incremental pattern characterization learning and forecasting for electricity consumption using
smart meters,” in 2011 IEEE International Symposium on Industrial Electronics, 2011, pp.

6
807–812.

[7] T. Bandaragoda, D. De Silva, and D. Alahakoon, “Automatic event detection in microblogs using incremental machine learning,” Journal of the
Association for Information Science and Technology, Apr.2017.

[8] Z. Xu, H. R. Wu, X. Yu, and Z. Man, “Adaptive surveillance video noise suppression,” in 2011 24th Canadian Conference on Electrical and Computer
Engineering(CCECE), 2011, pp. 000985–000988.

[9] Z. Xu, H. R. Wu, X. Yu, and Z. Man, “Modeling of Surveillance Video Noise,” presented at the Signal Processing, Pattern Recognition, and Applications /
722: Computer Graphics and Imaging, 2011.
References
[10] S. Zha, F. Luisier, W. Andrews, N. Srivastava, and R. Salakhutdinov, “Exploiting Image-trained CNN Architectures for Unconstrained Video
Classification,” ArXiv150304144 Cs, Mar. 2015.

[11] N. Kiryati, T. R. Raviv, Y. Ivanchenko, and S. Rochel, “Real-time abnormal motion detection in surveillance video,” in 2008 19th International
Conference on Pattern Recognition, 2008, pp. 1–4.

[12] B. Ozer, W. Wolf and A.N. Akansu, Human activity detection in MPEG sequences, Workshop on Human Motion pp. 61, 2000.

[13] J. M. Grant and P. J. Flynn, “Crowd Scene Understanding from Video: A Survey,” ACM

Transactions on Multimedia Computing, Communications, and Applications, vol. 13, no. 2, p. 19:1–19:23, Mar. 2017.

[14] Z. Wu, T. Yao, Y. Fu, and Y.-G. Jiang, “Deep Learning for Video Classification and Captioning,” ArXiv160906782 Cs, Sep. 2016.

[15] “Comparing image tagging services: Google Vision, Microsoft Cognitive Services, Amazon

Rekognition and Clarifai,” Filestack Blog, 14-Mar-2017.

[16] “Cognitive Services—Intelligence Applications | Microsoft Azure.” [Online]. Available:

https://azure.microsoft.com/enus/services/cognitive-services/. [Accessed: 24-Jun-2017].

[17] L. Shi et al., "Development of a neuromorphic computing system," 2015 IEEE International Electron Devices Meeting (IEDM), Washington, DC,
2015, pp. 4.3.1-4.3.4.

doi: 10.1109/IEDM.2015.7409624

[18] N. Noceti and F. Odone, “Unsupervised Video Surveillance,” in Computer Vision – ACCV 2010

Workshops, 2010, pp. 84–93.

Thank You