Professional Documents
Culture Documents
Digital Object Identifier: Zeeshan Kaleem is with COMSATS Institute of Information Technology, Wah Campus;
10.1109/MWC.2018.1700152 Mubashir Husain Rehmani is with Waterford Institute of Technology.
FIGURE 1. Drone applications: construction monitoring, public-safety, and traffic and railway monitoring.
developed the SkyDroner product, which has the as a benchmark analysis scheme for ADr motion
capability to detect, distract, and disable any ADr detection using the MDr camera.
from flying into a security-sensitive area. Hence, The existing motion detection algorithms
numerous ADr surveillance solutions exist in the have problem of high computational cost and
industry, but to improve their efficiency and accu- less robustness because of changing extrinsic
racy, more research and development is desired. and intrinsic camera parameters. These changing
parameters include pan, tilt, translation, rotation,
Research and Development Aspects and zooming. Hence, very accurate and cost-ef-
Detection techniques can be classified mainly by fective motion detection algorithms are desired
features, appearance, or motion. Based on these to take care of these parameters. To fill this gap,
characteristics, here we first discuss the motion adaptive algorithms using hybrid approaches need
detection scheme. In the literature [2], motion to be proposed for efficient motion detection.
detection schemes are categorized as: Thus, in general there must be two main parts of
1. Background subtraction the motion detection algorithm: first, the concept
2. Spatio-temporal filtering of artificial flow should be introduced based on
3. Optical flow the movement of the camera, and second, it must
Among these methods, background subtraction be compared with the real optical flow to cover
algorithms are most popular, because they are the image discrepancies. The choice of using two
relatively simple in computing a static scene. optical flows is motivated by the need to enhance
However, the background is assumed to be static the differences produced by dynamic objects.
in this method. Thus, shaking cameras, waving Moreover, machine learning algorithms using the
trees, and lighting changes quite probably cause characteristics of electromagnetic waves, sound,
serious problems to a background subtraction and images are also desired to efficiently detect
model. In addition, a successful background sub- the ADr.
traction method needs to model the background The next major step after detecting an ADr is
as accurately as possible and to adapt quickly to localization and tracking of the ADr and an intrud-
changes in the background. These requirements er. To accurately estimate the position of the ADr
add extra complexity to the computation of the and its intruder, 3D position estimation algorithms
model. Spatio-temporal filtering considers the are desired to be developed for more accurate
motion pattern of the moving object through- position estimation of the ADr. Existing works uti-
out the frame sequence, but is highly sensitive lized Kalman filtering to accurately determine the
to noise and variations in the movement pattern. position of the drones in case of global position-
The optical-flow-based approach is robust to the ing system (GPS) failure [4]. The importance of
motion of a camera and ADr movement because using Kalman filtering is highlighted in these works.
in this approach relative movements between Moreover, the utilization of the commercial fre-
the observer and the scene are considered. The quency bands for MDr also possess the challeng-
optical flow transforms one image into the next es of interference management with the existing
image in a sequence of images. Moreover, it indi- system.
cates how images in a sequence change to cre- The last important step after detection, local-
ate the next image. It is therefore necessary to ization, and tracking is the jamming and hunting
have two subsequent images to calculate opti- of the ADr. The detailed steps, which include the
cal flow. Hence, in [3] optical flow is suggested detection, localization, tracking, jamming, and
FIGURE 2. Amateur drone capturing system step-wise representation: a) data collection by using an MDr;
b) ground control station for detection and jamming signal generation; c) jamming and capturing of an ADr.
hunting of ADrs, is depicted in Fig. 2. The details Monitoring Drones Payload: An MDr carries
of jamming and hunting are also discussed later in payloads in terms of various types of sensors,
this article. thermal cameras, and other control information
processing units. These sensors are operated and
Potential Architectures and Deployment controlled from the ground. The data obtained is
utilized for accurate detection, tracking, and jam-
Scenarios for Monitoring Drones ming of ADrs.
A suitable architecture for deployed MDrs is nec- Internet Backhaul/Wireless Backhaul: A wired
essary for monitoring ADrs in no-fly zones. The Internet link such as Ethernet or fiber optics can
MDr architecture should be dynamic and can be be utilized to carry the data received from a wire-
created in an ad hoc manner anywhere and any- less radio access network (RAN) to the GCS, as
time with or without the help of any centralized shown in Fig. 3. This wired link can be replaced
infrastructure. The distinctive feature of the pro- by a wireless link by using high frequency, which
posed architecture is that its functional capabilities would have the capability to carry more data and
are tailored for the context of meeting different also can be more reliable because of less inter-
security situations, as well as efficient utilization of ference as it will operate in a different frequency
the available spectrum. This architecture has the band as the RAN link. Thus, the concept of flex-
potential to work in a centralized and distributed ible backhaul can be used, which is one future
manner. Based on this classification, we divide the research direction. Moreover, we discuss the four
MDr architecture into four main kinds: architectures mentioned above with their applica-
• Point-to-point (P2P) architecture with only a tions and suitability for different monitoring situa-
GCS for line-of-sight (LOS) communication tions.
(GCS-P2P)
• GCS with cellular or satellite stations assisted GCS-P2P: Point-to-Point Architecture with
network architecture (GCS-C/SA)
• GCS with mesh-network-based infrastructure Ground Control Station
(GCS-MA) The P2P architecture is proposed for MDrs, which
• GCS with software-defined networking-based only has an LOS communication link between
architecture (GCS-SDN) the MDr and the GCS shown in Fig. 3a. This
The important entities of these architectures are architecture can be deployed for the monitor-
introduced below. ing of less security-sensitive areas. For example,
Ground Control Station (GCS): MDr can P2P-GCS architecture is the simplest architecture
operate with different levels of controls, but usu- and is suitable when the MDr is located in LOS
ally they are remotely controlled from a GCS. The position and near the GCS, and only one MDr
GCS works as a central managing point of activ- would be enough to detect, control, and track
ity during MDr missions and provides necessary the ADr because of less security sensitivity of
capability to plan and execute security-sensitive the area. In this scenario, connectivity is main-
missions. The GCS has functions, such as mission tained over dedicated links to the MDr, so the
planning, image processing, modules for mobile control signal is more reliable with low latency.
and satellite communications management, and But unfortunately, the GCS-P2P architecture is not
displays to monitor progress. The GCS encap- suited for dynamically varying environments and
sulates high-speed processors for signal storage, non-line-of-sight (NLOS) communication. It is not
processing, and analysis of data received from suitable for NLOS communication because P2P
MDrs. It also generates alarm and jamming com- architecture is designed for low-range LOS com-
mands based on security alerts. munications. For NLOS communication, the walls
FANETs.
Op
Applications
MME/
P-GW
S-GW Policy RRM
& charging controller
Promising Key Technologies for
API ADr Monitoring
Virtualized control plane
Operational Frequency Bands for MDr Deployment
According to the latest reports from the Federal
SDN controller Aviation Administration (FAA) [8], there is a fore-
cast for 2020 that 7 million drones will fly in the
United States. This will result in intense competi-
tion for spectrum usage because drones are clas-
sified into two types based on their applications:
Software-defined networking based
ground control station (SDN-GCS) MDr and ADr. Thus, the frequency band selec-
tion for MDrs is more important for their secure
(b)
operation from jammer attacks and to have less
FIGURE 4. MDr deployment scenarios: a) conventional deployment scenario; interference from nearby drones. Moreover, there
b) SDN assisted MDr deployment scenario. are two main types of communication links: one
is for control commands, and the other is for pay-
load/data communications between MDrs and
have the benefits of low cost, high coverage, low GCSs. The control commands usually require low
latency, scalability, and high reliability as compared data rate communications links, whereas for pay-
to GCS-P2P and GCS-C/SA architectures. load communications high data rate is desired to
transfer information like videos and sensor data.
GCS-SDN: Software-Defined Networking Based Currently, no specific frequency allocations have
Ground Control Station Architecture for MDrs been made on an international level for control
and payload communications. Thus, the precise
The GCS for the three architectures discussed selection of operational frequency band for MDr
above has distributed control on all MDrs where deployment is too important as it can be differ-
each MDr controls its behavior as shown in Fig. ent according to the MDr deployment situation.
4a. The deployment of MDrs in a security-sensitive Usually, for less security-sensitive areas, MDrs can
area will be more beneficial if it can be controlled operate on freely available industrial, scientific,
and managed centrally rather than independently. and medical (ISM) frequency bands of 2.4 or
This deployment would facilitate flexible deploy- 5.8 GHz and remote control bands (433 MHz,
ment and management of new services and will 800 MHz) [9] for both control and payload/
help to have an overall view of the network situ- data communications. Since ISM band is used
ation. Previously, deployment of software-defined for wireless networks, it sometimes results in loss
networking (SDN) was focused on the infrastruc- of control over the MDrs in densely populated
ture-based static deployment scenario because areas because of interference with other wireless
it was believed that SDN was suitable only for signals.
static networks. But recent research results [6] For highly sensitive areas, it is recommended
proved that the SDN deployment is beneficial that MDr control and payload communication use
for a dynamically changing environment with the dedicated licsensed bands such as IEEE L-band
moving/flying base stations. Thus, based on these and IEEE S-band [10] to avoid interference among
results we propose to deploy SDN-based GCS other wireless communications systems. Addition-
1575.42 MHz (GPS L1) • Less interference with existing wireless communications system • Ionosphere and troposphere leads to slowdown of signal
1227.6 0MHz (GPS L2)[9] • High coverageavailable free of charge without any subscription or license propagation speed
ally, if governmental organizations want to use sat- desired for the proposed architecture discussed
ellites to control their drones far from their own above for ADr detection.
territories, then in this case, MDr global positioning Linear Predictive Coding-Based Sound Detec-
services (GPS) bands (GPS L1 1575.42 MHz, GPS tion Scheme: Drones have distinct sound as com-
L2 1227.60 MHz) [9] can be used for MDr con- pared to the sound of cars, thunder, and other
trol and payload operation. The pros and cons of flying or moving objects. Thus, based on these
utilizing different frequency bands for MDrs are differentiating factors, sound can be used for ADr
summarized in Table 1. Moreover, we conclude detection. The main challenge in application of
that there is no dedicated spectrum available for sound detection schemes for ADr detection is
MDr deployment yet for security-sensitive areas, the noisy and complex environment because ADr
and thus based on the deployment situation, it can sound may not be easily separable from the noise.
be adopted. Hence, to internationally accommo- The existing sound detection scheme uses the
date the usage of MDrs for surveillance of ADrs, linear predictive coding (LPC) scheme for sound
significant efforts and research is desired to prop- detection. The LPC scheme is frequently used for
erly allocate the spectrum for MDr. Moreover, the speech recognition and works on the principle
frequency band could be decided in upcoming of detecting spikes in the frequency spectrum.
(2019) World Radio Communication conferences Drones have spikes as well; thus, it was chosen
(WRC), organized by the International Telecommu- as the basis for sound detection. The LPC is used
nication Union (ITU) every four years. such that the sound at a point can be approxi-
mated in time from past samples. These approx-
Detection Technologies for ADr Monitoring imated coefficients are called LPC coefficients,
Drones with numerous applications and their and can be trained for various speeds in time and
possible security threats are discussed above in stored in a database. Still, there is a chance that
detail. Hence, on-time detection of ADrs in no-fly similar sounds like drones could be falsely detect-
zones or national security-sensitive area is the first ed. To solve this problem, the authors in [11] also
and most important step of security. The detec- considered the slope of the frequency spectrum
tion schemes can be broadly divided into three to decrease the number of false alarms, and they
major groups: electromagnetic-wave-based detec- proved it was beneficial in terms of false alarm
tion, sound wave detection for drones that do reduction.
not emit any radio/electromagnetic waves, and Sound Feature Detection and Classifica-
drone detection using thermal imaging cameras. tion Algorithms: The sound detection scheme
These techniques can have the ability to detect works in two main phases. First, there is feature
small drones in low-flying zones and non-coop- extraction and then feature classification by using
erative targets in high clutter environments. The machine learning algorithms. For sound fea-
efficiency and range of detection schemes can ture extraction, the algorithms such as harmon-
be increased if sound sensing, imaging methods, ic line association (HLA), mel-frequency cepstral
and radio wave detection are properly com- coefficient (MFCC), and wavelet-based feature
bined. Conventional radar cannot be used for extraction are frequently used in audio signal pro-
ADr detection because it is usually designed for cessing. HLA arranges spectrum peaks with levels
large aircraft. Moreover, ADrs are mostly made of greater than noise level into families of harmoni-
plastic material that has dielectric property close cally related lines that exceed the noise level into
to air, and thus has little or no reflection back to families of harmonically related narrowband lines.
the transmitter. Hence, efficient algorithms are Thus, the HLA algorithm is also suitable for ADr
Power/frequency (dB/Hz)
Power/frequency (dB/Hz)
15 -80 15
Frequency (kHz)
Frequency (kHz)
-90 -80
-100
10 10 -100
-110
-120 -120
5 -130 5
-140 -140
-150 0
0 1 2 3 4 5 6 7 8 9
1 2 3 4 5 6 7 8 9
Time (s) Time (s)
(b) (c)
x104
2
-40
-60
1.5
Frequency (Hz)
-80
1 -100
-120
0.5
-140
0
1 2 3 4 5 6 7 8 9
Time (s)
(d)
FIGURE 5. Machine-learning-based sound detection scheme and spectrograms for sound classifications: a)
sound detection using machine learning; b) drone spectrogram; c) car spectrogram; d) thunder spec-
trogram.
sound detection because ADrs also emit strong three different sounds — drone, car, and thunder
harmonic lines produced by propellers, and these — are plotted in Fig. 5. The horizontal axis of each
harmonic lines will prove the presence of ADrs. spectrogram represents time, the vertical axis is fre-
Similarly, MFCC is frequently used in speech rec- quency, and the intensity bar represents the ampli-
ognition systems, and increasingly finds uses in tude of a particular frequency in time.
applications such as sound similarity measures, These spectrograms can be analyzed through
which can be useful for feature detection. the HLA feature extraction algorithm by extract-
To detect and classify different sounds based on ing a set of feature vectors and comparing them
their features, short-time Fourier transform (STFT) against the acoustic target database to find the
is used to obtain the spectrogram of the drone, label of the object (i.e., ADr sound, car sound,
car, and thunder sounds stored in our database. or thunder sound). For classifying the extracted
The variations in spectrum of frequencies can be feature from the spectrogram, we use machine
seen by the spectrogram, which gives a visual rep- learning (ML) algorithms. In ML, different set of
resentation of the frequencies. By using these fre- algorithms are programmed in GCS that analyze
quencies we can extract features of sounds; this the data obtained from MDrs and try to make
can help to detect drones. The spectrograms of predictions about it. These algorithms are classi-