Smart video surveillance system

Roman Yeriskin Kamalanathan Shanmugam Muhammad Ehsan Rana

Asia Pacific University of Technology
and Innovation
Technology Park Malaysia, Bukit Jalil
Kuala Lumpur, Malaysia
tp056096@mail.apu.edu.my
Asia Pacific University of Technology
and Innovation
Technology Park Malaysia, Bukit Jalil
Kuala Lumpur, Malaysia
kamalanathan@apu.edu.my
Asia Pacific University of Technology
and Innovation
Technology Park Malaysia, Bukit Jalil
Kuala Lumpur, Malaysia
muhd_ehsanrana@apu.edu.my

Abstract: A smart video surveillance system is mainly built
into smart homes, which allows you to be confident in your
safety, but in a compartment with a smart energy saving system,
it is also much cheaper. Smart homes are currently very common
in the world. People are building not only personal smart homes,
but also residential complexes fully equipped with a smart video
surveillance system. The video surveillance system can be
controlled via a smartphone, as well as simply observe and
configure various parameters.
Keywords— smart video surveillance system;smart energy
saving;
I. INTRODUCTION
Intelligent video surveillance systems are a hardware
and software complex that is used for automated collection of
information from streaming video. In their work, these
systems rely on various algorithms for image recognition,
systematization and processing of the received data. To date,
conventional surveillance cameras are used everywhere, from
speed cameras on the roads to cameras that stand in the
entrance of houses. Recently, intelligent video surveillance has
become popular in various fields of activity. By introducing
smart video surveillance systems, it became possible to control
the entire system directly from a smartphone, if the user
installs such a system for personal use. But there are many
ways to use this system. [1]
Video surveillance is an effective tool for obtaining
operational information. The smart system can perform many
functions, such as: object detection, tracking, classification
and statistical analysis, recognition, detection of alarming
situations. The most extensive application of smart video
surveillance is considered to be a city security system, thanks
to which it is possible to track accidents on the roads, find
criminals using face recognition. This system is also used for
personal purposes, for example, the installation of video
surveillance near public buildings or private houses for
personal use. In this case, this system can provide such
functions as: perimeter control, automatic counting of
employees, duplication of functions of the fire alarm system,
identification of a paired intersection of an automatic
checkpoint, control of personnel work. Intelligent video
surveillance systems are also used in transport to prevent
accidents or as an ordinary DVR, but with a more extensive
set of functions. [2]
For each individual goal, its own software is created, tailored
specifically for the fulfillment of a specific goal. It is much
easier to set up a home video surveillance system because it
does not have a lot of functions, but it is more convenient to
use for the user because there are many special attachments
for a smart phone that can be installed and use all the
functionality and settings. It is much more difficult in the other
case, since servers and an experienced team are needed to
create an entire ecosystem of intelligent video surveillance.
In this paper, we will study how much a conventional video
surveillance system can be improved, determine the range of
use, and also find out how much safer it is to use this
particular system.
II. LITERATURE REVIEW
A. Software and hardware complexes
This papre goes through the capabilities and uses of
intelligent video surveillance systems in further depth. Using
certain algorithms, an intelligent video surveillance system is
developed on a single network device. Its functionality is built
on picture recognition technologies and software modules that
organise and handle information flows. An intelligent video
surveillance system may be developed in a variety of ways and
with a variety of parameters. It might be similar to exterior
cameras, wireless, moving, and so on. Various categories are
used for various objects:
Data processing mechanism on the server. The key feature
is centralised video analysis on your PC or server. The
programme runs on a graphics processor and may be enhanced
with new algorithms and modules. The biggest problem of
server systems is that they constantly transmit massive amounts
of high-definition video data, which significantly overloads the
connection channel.
Algorithms for data analysis are built in. The video
information processing software module is built directly into
the video surveillance camera in this situation. The key
advantage of this strategy is that it can lower the strain on the
communication channel by up to 10-100 times. The data is
completely or partially processed before being delivered to the
central server. The primary drawbacks of these intelligent
systems are their high equipment costs and restricted analytical
capabilities. [3]
Intelligent distributed system This method makes
advantage of complicated data processing. The camera does
basic simple information analysis. When delivering video
streams, this helps to lessen the burden on the communication
channel. Server capacity is incorporated in the task if more
serious information processing is necessary.
B. Analysis and algorithms
The collecting and analysis of streaming video data and its
subsequent usage to perform specified tasks is one of the major
functions of intelligent video surveillance systems. In other
words, the equipment isn't always employed to keep the
premises safe.
Intelligent video security cameras can solve particular
standard and highly specialised jobs by utilising various
information processing methods. The most often used software
modules, however, are:
Territorial boundary analysis This option is used to secure
large partitions. This technology can detect movement, pass
through control zones, and respond to the speed and location of
an item. The mistake rate of this analytical algorithm is
considerable. Passing bikers or other little modifications in the
frame frequently activate the mechanism. [4]
An examination of the problem. The technology is used in
public utilities and maintenance, commercial companies, and
public areas. The quantity of workers is analysed using
algorithms, and excess flow density is reported.
Analytics for issue resolution in business. Business owners
actively utilise intelligent video surveillance systems to boost
efficiency, manage personnel, improve customer service, and
collect data for marketing research. The algorithm includes a
large number of functions and can generate a wide range of
reports.
Biometric evaluation. The software modules' functioning is
dependent on the identification of a person's unique biological
traits. This strategy is centred on the employment of a
biometric access control system and the pursuit of offenders.
The algorithm for identifying automobile, waggon, and
other vehicle licence plates.
Object trajectory analysis This system tracks the movement
of individuals or vehicles using many security cameras.
Technical operations analysis This technology is used to
automate procedures in businesses that manufacture a wide
range of items. Surveillance cameras enable you to spot faulty
items on the assembly line and do a qualitative study of the
forms. This minimises the amount of full-time staff while also
lowering the possibility of human mistake. [6]
Tamper is a hardware and software system that assures the
steady operation of video surveillance cameras. The system
checks the equipment on a regular basis to prevent lens
darkening and glare, image replacement, technical condition
check, fault reporting, and fault prevention.
Thanks to the development of technology, the analytical video
surveillance system could be used even in marketing, for
example, in queues in stores. The store owner receives the
collected information using the program and builds a
development strategy based on its result.
C. Application of intelligent video surveillance systems
Intelligent video surveillance systems provide major
economic benefits to both large and small enterprises. The
adoption of software and hardware complexes improves
labour productivity and safety by partially or totally
automating industrial processes and reducing the number of
permanent staff. Intelligent video surveillance systems enable
us to solve the most critical jobs in a variety of economic
sectors.
Identification of licence plates, detection of abandoned
luggage, detection of foreign items on the tracks, passenger
counting, and recording of speeding when cars are moving are
all examples of transportation infrastructure.
City Security: Use face recognition technologies to look for
criminals, discover clusters of suspicious people, detect
unauthorised meetings, and identify fights, scuffles, and other
illegal behaviour among residents.
Closed high-security facilities include perimeter
monitoring, staff work control, fire detection and alerting, and
identification of paired junctions at the checkpoint.
Catering establishments, retail establishments, and public
services: queue length analysis, visitor counting, customer
service evaluation, detection of congestion, theft, and other
illegal actions, identification of VIPs for whom special service
protocols are provided. [5]
A wide range of current equipment for the organisation of
intelligent video surveillance allows you to discover acceptable
solutions for practically every application in transportation,
industry, trade, and services. This system's undeniable benefit
is its simplicity of operation, administration, and user-friendly
interface. Most manufacturers provide solutions that do not
require any specific understanding from the user, can be
configured in minutes, and can be deployed with the push of a
button.
III. PROPOSED SYSTEM
We identified various types of intelligent video
surveillance systems from the literature analysis in section 2,
and in this part we will investigate the system from the inside
and how it works. One of the issues that an intelligent system
may assist alleviate is traffic congestion. It is common for an
accident to occur and the culprit of the crime to simply hide,
but this problem has been overcome thanks to Intelligent
detectors. Because of video surveillance's intelligent features,
you may transform your typical video surveillance system into
a powerful tool for automatic analysis of all video pictures
received from your cameras. Intelligent technology can track
moving, receding, or appearing things, assess movement
trajectories, abnormal human behaviour, and automatically
detect potentially harmful objects. [7]
Furthermore, intelligent video surveillance detects vehicle
numbers without stopping, captures traffic offences, and
automatically records non-standard road incidents (accidents,
traffic jams, etc.). Notify system operators and trigger alarms.
A. Intelligent security environment
A sophisticated set of intelligent hardware and software may
be used to organise a single intellectual security environment.
Integrate all existing subsystems, such as video surveillance
systems, systems for determining the location of moving
objects, access control and management, geoinformation
systems, and so on, to provide automatic or semi-automatic
responses to all new events; Event handling control Analytics
and statistics for decision-making and improving the
efficiency of a single smart environment.

Figure 1: Identify the area

As shown in Figure 1, the intelligent system sees a moving
object in the form of a person and marks it with a special color,
as well as builds a path of movement. The placement of
network video servers with video analytics around the
perimeter of the video surveillance network clearly improves
performance compared to centrally organized video Figure 2: Interface
surveillance systems. Provides the ability to process video
images in real time, increasing the accuracy of video
analysis.Loitering mode — determines when a person or Figure 2 shows an interface where you can select a zone
vehicle stays in a certain area longer than the time set by the that can be monitored separately and that the information is
operator of the video surveillance system. Effective real-time analyzed only in this zone. The use of software and hardware
notification of suspicious activity at ATMs, storefronts, stairs, to identify and automatically remedy infractions of traffic laws
educational institutions, detection of crowds.Fights that reflect and the number of cars passing through control points is an
quick motions of a person over a short period of time are important use of intelligent video surveillance systems.
examples of fixed forms of aberrant behavior;Repairing broken
people and restoring those who lie;Take an object out of the
controlled area.;Items remained or reappeared.
B. Interface
The simple user interface enables end users to simply and
rapidly install and configure intelligent functionalities based
on their individual requirements.

Figure 3: Post frontier

The heart of the system is arranged with the
appropriate number of megapixel cameras, rotatable
cameras, software and hardware control systems and
image processing, communication channels to
accomplish the work of "intelligent crossing" or
"border" traffic control zones.
 Intelligent traffic infraction detection, automated car
number recognition, and fixation system features:
The state number of automobiles going through the control
zone is automatically recognised and fixed.
This activity is carried out on automobiles by sending and
receiving data via recognised licence plates and electronic tags
for interaction with departmental databases. [8]
Figure 4: Data base
In the figure above, the database of cars that the camera
recorded, after intelligent analysis, the system understands
where the violation was detected and can automatically add
violators to another database, as well as atomically send a fine.
Such a smart system saves a lot of time and resources, because
the database contains all the information about the owner of the
car at once, and so on, as shown below in the figure.
Figure 5: Car info
C. Аdvantages and disadvantages
Intelligent video surveillance, like any high-tech system,
has advantages and disadvantages. The following are the
primary benefits of gadgets using analytical algorithms:
Functionality is virtually limitless;great precision and
dependability,а wide range of real-world circumstances for
equipment utilization,user-friendly interface; extensive
analytical methods; ongoing development of new software and
hardware packages
The hardware and software complex, which is based on the
introduction of deep learning technologies and neural
networks, enables you to tackle the most complicated and
narrow-profile jobs at any facility.
The high cost of equipment and software modules is the
biggest downside of intelligent video surveillance.
Implementing the system in a major facility or production line
might cost millions of rubles.
Another drawback is the high rate of false positives. This
is usual for algorithms that monitor and assess boundary
conditions. The accuracy and functionality of software
modules are always being improved by manufacturers.
Less serious drawbacks include: increased communication
channel stress owing to big data transfers; and archiving of
"empty, junk" material. [9]
Database security is insufficient.
You should thoroughly consider the possibilities of
conducting an event before establishing an intelligent video
surveillance system. When analytical algorithms assist to
boost productivity, reduce the amount of human errors, drive
business development, and increase sales, the expenses of
purchasing, installing, and maintaining technology quickly
pay off.
If the owner of a small item decides to build an intelligent
system to guard the area from intruders, go for a less
expensive choice and buy ordinary video surveillance
cameras. Perhaps it's worthwhile. It is not always acceptable
to invest a lot of money on the implementation of analytical
algorithms in such cases.
I. CONCLUSION
At the end of this study, we found out that there are a lot of
applications of intelligent video surveillance systems that can
be used not only at home but also in urban areas. This system
has a huge range of applications and as technology develops,
new ways to protect yourself and automate even more will
appear. There is also a very flexible system of program
settings, which, with proper configuration, can be controlled
from a smartphone if these are home cameras in a frequent
house or automate all the work if these are cameras on the
roadway.

REFERENCES
[1] Blau, C. (2022, September 1). What is an Intelligent
Video Surveillance System? EPIC IO.
https://epicio.com/what-is-an-intelligent-video-
surveillance-system/
[2] Sreenu, G., & Saleem Durai, M. A. (2019). Intelligent
video surveillance: a review through deep learning
techniques for crowd analysis. Journal of Big Data,
6(1). https://doi.org/10.1186/s40537-019-0212-5
[3] Intelligent video surveillance: Recent trends and what
lies ahead. (n.d.). Allied Telesis. Retrieved November
12, 2022, from
https://www.alliedtelesis.com/my/en/blog/intelligent-
video-surveillance-recent-trends-and-what-lies-ahead
[4] Dice, J. (2021, March 22). What is Intelligent Video
Surveillance. Security Alarm; Security Alarm
Corporation. https://www.securityalarm.com/blog/what-
is-intelligent-video-surveillance/
[5] Sung, C.-S., & Park, J. Y. (2021). Design of an
intelligent video surveillance system for crime
prevention: applying deep learning technology.
Multimedia Tools and Applications, 80(26–27), 34297–
34309. https://doi.org/10.1007/s11042-021-10809-z
[6] Dufour, J.-Y. (2012). Intelligent Video Surveillance
Systems: Dufour/Intelligent Video Surveillance
Systems (J.-Y. Dufour, Ed.). ISTE Ltd and John Wiley
& Sons. https://doi.org/10.1002/9781118577851
[7] Penfold, A. (2020, May 20). Forget CCTV (as you
know it) - here comes smart video surveillance.
Azena.com. https://www.azena.com/insights/forget-
cctv-smart-video-surveillance
[8] Turner, B. (2022, July 14). Best home video
surveillance of 2022: smart security for your property.
TechRadar; TechRadar pro.
https://www.techradar.com/best/best-home-video-
surveillance
[9] Sinopoli, J. (2010). Video Surveillance Systems. In
Smart Building Systems for Architects, Owners and
Builders (pp. 83–90). Elsevier.