Intelligent Surveillance System

Group Members:
Hamza Nawaz , FA17-EEE-049
M Hamid Sadiq , FA17-EEE-087
M Abid , FA17-EEE-108
Supervisor: Dr. Aamir Shahzad
Co Supervisor: Dr. Imran Shahzad
Domain: Electronics/Computer

Department of Electrical & Computer Engineering CUI,

ATD 1
Project Outline
 Introduction
 Applications
 Problem Statement
 Goals and Objectives
 Method/Technique
 Block Diagram
 Hardware Components
 Results

Department of Electrical & Computer Engineering CUI,

ATD 2
Introduction
An Intelligent Surveillance is a technique in which
traditional security devices like cameras or sensors are used
in such a way that they not only record or capture an
irregularity but also responds to it.[1]

Department of Electrical & Computer

Engineering CUI, ATD 3
Applications
Can be installed in
 Military Bases

 Banks

 Secured premises

Department of Computer and Electrical Engineering CUI,

ATD 4
Problem Statement
 A traditional surveillance system can only record the
malicious objects but can not respond to them.
 As a result an extras pair of eyes is always required to
respond to such activities.

Department of Electrical & Computer Engineering CUI,

5
ATD
Goals and Objectives
 The goal of this project was to detect malicious objects
automatically during surveillance. This includes
detection of weapons.
The objectives are as follows:
 To detect weapons in the secured premises.

 To respond against criminal activity using alarms.

Department of Electrical & Computer Engineering

CUI, ATD 6
 Proposed Method
Object detection algorithm choices must be made in
context depending on whether speed or accuracy takes
priority.
For detecting malicious activity and malicious objects we

are using YOLO V3 algorithm.

YOLO means “You Only Look Once ”

• Looks at the part of image which have high

probabilities of containing the object.

Department of Electrical & Computer Engineering

CUI, ATD 7
Why YOLO?
Model Speed of Detection(Single
Frame)
Faster RCNN 300ms
Masked RCNN 350ms
YOLO 10ms

• YOLO predicts the class (which in our case a knife

or a gun) and a bounding box around the specified
object within a given image or a video .

Department of Electrical & Computer

Engineering CUI, ATD 8
YOLO V3 Architecture

Department of Electrical & Computer Engineering CUI,

ATD 9
YOLO V3 Architecture Description

Department of Electrical & Computer

Engineering CUI, ATD 10
Working of YOLO V3
 YOLO first takes an input image
 The framework then divides the image into grids.
 Image classification and localization is applied on each
grid.
 YOLO then predicts their corresponding class for objects
which is gun and knife in our case.

Department of Electrical & Computer

Engineering CUI, ATD 11
Limitation
 YOLO algorithm struggles a lot with small
objects within the image

Department of Electrical & Computer Engineering CUI,

ATD 12
Block Diagram

Department of Electrical & Computer

Engineering CUI, ATD 13
Software/Training
For software purpose we used
 Python

 Open CV

For training of the dataset we used

 Google colab.

Department of Electrical & Computer

Engineering CUI, ATD 14
Cont..
 As we are detecting malicious objects so we used the
datasets of weapons which are guns and knife.
 We trained the custom dataset for real time detection
which are as follows:

Total No. of No. of Accuracy

Images Images we Images for (%)
Trained Testing
605 484 121 85.67

Department of Electrical & Computer

Engineering CUI, ATD 15
Hardware Components
 Raspberry Pi 3
 1.5GHz Quad-Core ARM Cortex –A53
 2GB RAM.
 64 Bit CPU
 Pi Camera
 8 Mega Pixel Sony image sensor.
 Fixed focus lens.
 Alarm
 LED

Department of Electrical & Computer Engineering CUI,

ATD 16
Advantages
 Increased sense of security.
 Lowered chances of crime.
 More accurate than humans.
 Reduce Cost and Scale more easily.
 Easier Installation and more effective implementation.

Department of Electrical & Computer Engineering CUI,

ATD 17
Results

Department of Electrical &

Computer Engineering
CUI, ATD 18
Cont..

Department of Electrical & Computer

Engineering CUI, ATD 19
Cont..

Department of Electrical & Computer

Engineering CUI, ATD 20
References
1. Qian, Huihuan, Wu, Xinyu, Xu, and Yangsheng, “Intelligent
Surveillance System”, January 2011
2. Rohith Vajhala, Rohith Maddineni and Preethi Raj Yeruv, “Weapon
Detection in Surveillance System ” Electrical Engineering with
Emphasis on Signal Processing, July 2016
3. V. Babanne, N. S. Mahajan, R. L. Sharma, and P. P. Gargate, “Machine
learning based smart surveillance system,” in Proceedings of the 2019 Third
International Conference on I-SMAC (IoT in Social, Mobile, Analytics and
Cloud)(I-SMAC), pp. 84–86, IEEE, Palladam, India, December 2019.

Department of Electrical & Computer Engineering

CUI, ATD 21
Department of Electrical & Computer
Engineering CUI, ATD 22