You are on page 1of 5

Proceedings of the Fourth International Conference on Inventive Systems and Control (ICISC 2020)

IEEE Xplore Part Number: CFP20J06-ART; ISBN: 978-1-7281-2813-9

IoT based Automatic Fault Identification and


Alerting System for Unmanned Aerial Vehicles
1st Vamsi krishna Varigonda 2nd Bhavya Agrawal 3rd Vinoth Kumar Annamalai
Dept. of Electronics and Dept. of Information Dept. of Aerospace Engineering
communication Technology
SRM Institute of Science and Technology SRM Institute of Science and Technology SRM Institute of Science and
Technology
Kattankulathur, India Kattankulathur, India Kattankulathur, India
vv922 2@ srmist.ed u.in bhavya13agarwal@gmail.com vinothk a@ srmist.e du.in

Abstract— This research paper proposes an automatic fault control from the ground station is high, and UAVs are not re-
identification and alerting system to improve the reliability of liable for crucial tasks. Many of UAVs used for civilian
UAVs. In general, due to its less reliable nature, they are not being applications are commercial off the shelf actuators [2] these
deployed in populated areas. The low reliability in UAVs is due to
the high failure rates in the operations. Most of these fai lures can UAVs do not have fault detection and black box systems. In
be avoided if the operator is alerted in time about the faults in this paper, automatic fault identification and alerting system
the UAV. The proposed system will identify faults in UAVs and are designed and implemented on a multi-rotor unmanned
alert the operator, wherein he can take the required action to aerial vehicle. The goal of the research is to create a system
avoid the damage to the UAV. The system fetches the real- time that keeps track and observe the flight conditions, detect
flight parameters of the UAV from the flight controller and gets a
sense of surroundings using external obstacle detecting sensors. obstacles, analyze the flight parameters from on-board flight
These parameters are analyzed by the processing board on the controller for any possibility of faults, i.e., system failure,
drone for any anomalies. The parameters displayed in an components malfunctions, signal loss, and environmental
android application where the live status of the drone can be parameters like wind speed, rain. Consequently, alert the
monitored and all the parameters are stored in a database for operator regarding the anomalies in the flight parameters
future analysis. An alert is sent to the operator on the mobile
application in case of any anomalies or early signs of faults thereby allowing the operator to take the necessary actions to
detected by the algorithm. The system also locates all the drones avoid failure or crash. Secondly, rogue drones are potential
flying in that region which can be utilized for air traffic threats to the nation. In 2018, tens of thousands of passengers
monitoring and to locate rogue drones which are a huge security have been disrupted by drones flying over one of the UK’s
threat in airports and unauthorized areas. busiest airports [16]. The rogue drones are small, have less
Index terms—UAVs, IoT, fault detection, alerting system
radar surface area leading to greater difficulty in locating
them. We propose a centralized location system wherein all
I. INT RODUCT ION the drones carrying the proposed system will send the
Drones are quite popular in the present era and are used location, altitude, speed to a separate database which can help
in various commercial applications as well as in research. the authorities to improve the air traffic control and monitor
Between 2016 and 2020, goldman s achs forecasted a 100 all the drones flying in that region.
billion market opportunity for drones [15]. In operations
II. M E T HODOL OGY
involving search and res cue, aerial photography, structural
inspections, and military surveillance, it is critical for the UAV A. Setup
to perform the mission and return back. In a report given by the 1) Unmanned Aerial Vehicle: Considering ease of use and
Department of Defense (DoD) of the United States of America accessibility a basic frame called the DJI450 frame is selected
[1], concludes that small unmanned aerial vehicles (UAV) or along with 1000 kV brush-less dc (BLDC) motors, and 30 amp
drones have tremendous failure rates. The requirement by the electronic speed controllers (ESC), a pixhawk flight controller
Federal Aviation Administration of the United States (FAA) is with a primary 3 cell lipo battery. This is the most common

to have the failure rate of an aerial vehicle is 10 9 failures-per- setup of UAV. The setup is shown in figure 1.
flight-hour, but the unmanned vehicle (UAV) has a failure rate 2) Processing board: A raspberry pi 3b processing board

at 10 2 failures-per-flight-hour. This being the reason many running on raspbian software is used. A serial connection
local government agencies, researchers who owned UAVs had between the pixhawk flight controller and raspberry pi is
to abandon the use of UAVs due to liability, reliability, and established via a micro USB connection.
privacy concerns [5] [17,18]. This concludes when flying in a 3) GSM Module: A smartElex module is used to establish
long-range, the likelihood of the drone to either crash or loses internet connectivity to the system, which enables the data
transfer to the servers. It is a combination of GPRS and GNSS.

978-1-7281-2813-9/20/$31.00 ©2020 IEEE 20

Authorized licensed use limited to: Cornell University Library. Downloaded on August 20,2020 at 06:16:45 UTC from IEEE Xplore. Restrictions apply.
Proceedings of the Fourth International Conference on Inventive Systems and Control (ICISC 2020)
IEEE Xplore Part Number: CFP20J06-ART; ISBN: 978-1-7281-2813-9

Fig. 1. T est UAV with the fault identification system

The GNSS engine is a single receiver integrating GPS and


GLONASS.
4) Additional sensors: Infrared (IR) sensor, combined with Fig. 2. Data collection and processing in the fault identification system
ultrasonic sensors, is used to find obstacles in the flying en-
vironment. This combination is used to increase the precision
of the measurement of an obstacle. As ultrasonic sensors give queries for inserting, updating, deleting, or adding data are
false readings in regions with s moke, fog and IR sensors give not required. This back-end service is implemented using an
a false reading when direct light is incident on the receiving API that is provided to the application developer. This API
unit of the sensor. ensures the synchronization of data between cloud storage and
the client’s interface on a real-time basis. The complete
B. Design of system process flow of the mobile/web application is shown in figure 3
libraries can be integrated with android, IOS, and javas cript
The design of the system is divided into three major parts as
applications to allow the usage of these services. By using the
follows.
authentication service that can authenticate users using client-
1) Fault Identification System (FIS) design: The fault
side code the mobile/web application can be secured. The fault
identification system is an on-board processing board, which
declared by the fault identification system is displayed by push
continuously fetches the flight parameters from the flight
notification to alert the user. The specific parameter which
controller using micro aerial vehicle commands (mavlink) and
causes fault is also shown by allowing the user to make the
simultaneously data from the obstacle detecting sensors are
required rectifications.
fetched. The flight parameters include altitude, IMU values,
acceleration, GPS location, telemetry strength, battery voltage.
These are then analyzed by an algorithm that constantly C. Centralized Locating system
compares all the parameters with the safety limit for any In this research the GPS coordinates, altitude, speed of all
anomalies. As shown in 2, once the processing is done, these the drones flying in a given region are stored in a centralized
are then stored in a real-time database. The database also acts database. The databases serve as an index to the real-time
as data-logger or black box, which stores all the data with a fight details bounded in given area coordinates. There are three
timestamp. If any parameter is above the safety limit, it is approaches in order to start for location identification in a UAV
declared are fault by the system. This fault is displayed to the [10] they are, Tracking way-point, simulation tracking, and
user in the mobile application which is discussed in the next flight based records.
section. The user can avert the damaging or probably crashing 1) Tracking way-point: The local tracking strategy can be
of the UAV by taking the required action to rectify the fault. best enhanced to a global system. [11] Research clearly
2) Alerting system design: The end-user interface of the discusses the architecture of a global flight tracking system.
alerting system is handled by a mobile/web application that This study proposes a divided back end system of several mod-
has a record of the real-time values of the flight parame- ters. ules which includes in-range communication medium channel,
These values can be checked and audited on a real- time basis, to establish a connection; a real-time database, to store flight
thus keeping track of every data changed. The database for statistics; and a ground station to keep a check on the flight
this system can be deployed on any real-time database stats. The common way-points considered while tracking
supporting models such as firebase. It stores the data in multiple UAVs in bounded airspace can be GPS coordinates,
JavaScript Object Notation (JSON) format in which speed and the altitude of the flight.

978-1-7281-2813-9/20/$31.00 ©2020 IEEE 21

Authorized licensed use limited to: Cornell University Library. Downloaded on August 20,2020 at 06:16:45 UTC from IEEE Xplore. Restrictions apply.
Proceedings of the Fourth International Conference on Inventive Systems and Control (ICISC 2020)
IEEE Xplore Part Number: CFP20J06-ART; ISBN: 978-1-7281-2813-9

Fig. 4. Schematic diagram of the fault identification system

2) Dronekit: Dronekit [9] is a python API that enables


simple interfacing of the mavlink protocol. By using dronekit,
complete autonomous navigation can be developed. We have
extensively used Dronekit to fetch various flight parameters.
3) Detecting the faults in UAV: The raspberry pi processing
board will be running the program with Dronekit in a loop
to continuously fetch the data. The flight parameters include
IMU readings, battery voltage, vertical and horizontal velocity,
Fig. 3. data flow between fault identification system and app
current altitude, GPS coordinates, satellite lock, radio signal
strength (RSSI value). A check is done on the fetched flight
2) Simulation based tracking: The research [12] parameters with respect to the threshold values to detect any
demonstrates an exhaustive search method that simulates to possibility of anomalies. The schematic diagram is displayed
assess the state of the flight in the future and to judge its path. in the 4. Connectivity with the server is provided by the GSM
module connected to the raspberry pi 3b board controlled by
Alternative tracking paths can be obtained mapping the
AT commands. All the values are then displayed in the app
position and velocities of the flights airborne.
and If any fault is detected, a pop notification appears on the
3) Flight-based Records: The system proposes a data log-
mobile application.
ger both at the global and local levels. A black box or an in-
4) Client-Server interaction: A Python Firebase API, called
flight data recorder is proposed to be installed on UAVs in
Pyrebase, is used as a client that sends data from the
order to track the overall set of data for different factors
processing to the cloud storage. A separate database is used
pertaining to a flight leading to an abnormality. In-flight data
for the centralized location system where the GPS coordinates,
such as altitude, battery voltage, horizontal and vertical
altitude, speed of the drone. Any change in values in the fault
velocities, relative wind speed, and IMU values are gathered
identification system is directly reflected in the cloud storage.
and compressed by a Data Acquisition Unit(DAU) [13] and is
These values are then fetched by the mobile application. As
into binary data. The study [14] idealizes a realistic app roach
flight checks are completed, the data gets updated, and the user
to realize a Flight Data Recorder (FDR) for a system. .
can get real-time values from the fault identification system.
5) Android Application: The app has been developed using
D . Functioning of the System
the android studio SDK as a development tool. The user
The functioning of the complete system is dependent on authorization and sign-in validation are done at the client-side
multiple segments which are explained in detail below. using firebase services in the mobile application. The
1) Mavlink protocol: The pixhawk flight controller stack authorized user can view the parameters in the mobile
runs on an open-source software specially designed for de- application. Parameters from DIS are fetched from a real-time
velopers and researchers. The Mavlink (Micro Aerial Vehicle database deployed on the firebase. A pop notification appears
link) protocol [8] is used to get various real-time vehicle whenever the algorithm detects any possibility of failure. This
parameters like GPS position, altitude, speed, battery voltage, alerts the pilot wherein he can take the required action to
and discharge, etc. Mavlink protocol is utilized for the avoid the fault which might lead to a crash of UAV. This
communication between the Pixhawk flight controller and the application is tool when flying the UAV beyond LOS
processing board.

978-1-7281-2813-9/20/$31.00 ©2020 IEEE 22

Authorized licensed use limited to: Cornell University Library. Downloaded on August 20,2020 at 06:16:45 UTC from IEEE Xplore. Restrictions apply.
Proceedings of the Fourth International Conference on Inventive Systems and Control (ICISC 2020)
IEEE Xplore Part Number: CFP20J06-ART; ISBN: 978-1-7281-2813-9

Fig. 6. Battery voltage Vs. T ime log of the flight test

Fig. 5. Flight parameters displayed in the application

(Line of Sight) without any FPV (first-person view) system.


III. FLIGHT TEST
Flight test phases are divided into take-off, system
implementation, and landing. In the implementation phase, the
pilot flies the copter by carrying the fault identification on
board. The total flight time was around 12 minutes per flight.
An average distance of 500 meters at 13 meters altitude was
covered by the test copter. A total of three test flights were
carried out in different conditions, as mentioned: 1. Low
altitude casual flying conditions with Line of sight 2. Wind y
conditions and medium range. 3. Long-range
Fig. 7. Altitude Vs. T ime log of the flight test
I V. RESULT
From the three flight tests conducted, results were obtained.
All the flight parameters were logged and evaluated. The app
has displayed all the flight parameters , which can be used for
further analysis. All the flight parameters are stored in a server
that is displayed in the application. From the data obtained two
graphs were obtained, a voltage vs. time 7 and altitude vs.
time graph 7.
The mobile application will notify the pilot whenever the
parameters are beyond the threshold values. During the test
flight, the pilot was alerted regarding the low voltage. This
avoids critical damage to the copter. Notifications are sent by
using the mobile applications in order to alert the pilot
regarding low voltage is shown in the figure 8.

V . CONCLUSION
In this paper, we have developed a fault identification,
alerting and a tracking sys tem for unmanned aerial vehicle Fig. 8. Notification alerting the pilot
platform that can be implemented to increase the reliability of

978-1-7281-2813-9/20/$31.00 ©2020 IEEE 23

Authorized licensed use limited to: Cornell University Library. Downloaded on August 20,2020 at 06:16:45 UTC from IEEE Xplore. Restrictions apply.
Proceedings of the Fourth International Conference on Inventive Systems and Control (ICISC 2020)
IEEE Xplore Part Number: CFP20J06-ART; ISBN: 978-1-7281-2813-9

UAV. We have conducted various flight tests with the fault


identification and alerting system on board. This system can be
used to reduce failures in UAVs and also to effectively track
the UAVs that can be used for air traffic monitoring and
control. Fault reduction is achieved by alerting the pilot after
analyzing the flight parameters of UAV regarding the
possibility of any failure. The implemented system can avoid
potential damage by warning the pilot regarding a fault in the
mission. This results in a better reliability of UAVs in various
applications and improves the aerial security.
V I. FUT URE SCOPE
The current system proposed in this research limits and its
implementation on specific flight controllers of UAVs. To
make the system proposed in this research capable of
implementation that remains irrespective of the hardware. To
create a centralized system that monitors all the UAV traffic
and communicates with the airports authority. To create a
tracking system that detects any rouge UAVs that are entering
into unauthorized areas.
REFERENCES
[1] ”Unmanned Aircraft System Roadmap 2005–2030”, D. of Defence.
[2] R. J. Carlson, A. Dorobantu, B. T aylor, P. J. Seiler, ”Analysis of
Modeling T echniques for Low-Cost Actuators,” AIAA Atmos. Flight
Mech. Conf, pp. 1-11, Aug. 2013.
[3] R. Venkataraman and P. J. Seiler, ”Model-Based Detection and Isolation
of Rudder Faults for a Small UAS, ” AIAA Guid. Navig. Control Conj,
pp. 1-18, Jan. 2015.
[4] J. F. Murtha, ”An evidence theoretic approach to design of reliable low-
cost UAVs,” Master’s thesis, Virginia Polytechnic Institute, 2009
[5] E. D. Mccormack, ”The Use of Small Unmanned Aircraft by the Wash-
ington State Department of Transportation by, ” Seattle, Washington,
2008.
[6] Sahwee, Zulhilmy ,Rahman, Nazaruddin , Sahari, Ksm. (2015). ”Ex-
perimental evaluation of actuator fault accommodation for small UAV”.
32-37. 10.1109/IRIS.2015.7451582.
[7] M. Young, The T echnical Writer’s Handbook. Mill Valley, CA: Univer-
sity Science, 1989.
[8] H. David Mathias. 2016. ”An autonomous drone platform for student
research projects”. J. Comput. Sci. Coll. 31, 5 (May 2016), 12-20
[9] ”DroneKit-python”, [online] Available: http://python.dronekit.io/
[10 ] J. Kwak and Y. Sung, ”Autonomous UAVFlight Control for GPS-Based
Navigation,” in IEEE Access, vol. 6, pp. 37947-37955, 2018.
[11 ] M. Chen, P. Wang, F. R. Pei, Z. Zhang and X. Jin, ”Design and
implement of global flight tracking system based on satellite-based
ADS-B,” 2018 Integrated Communications, Navigation, Surveillance
Conference (ICNS), Herndon, VA, 2018, pp. 4F4-1-4F4-10.
[12 ] F. Kamrani and R. Ayani, ”Simulation-aided path planning of UAV,”
2007 Winter Simulation Conference, Washington, DC, 2007, pp. 1306-
1314.
[13 ] D. A. Putra, S. M. Nasution and F. Azmi, ”Analysis of flight data
recorder compression reliability for airplane on demand blackbox data
transmission,” 2017 International Conference on Control, Electronics,
Renewable Energy and Communications (ICCREC), Yogyakarta, 2017,
pp. 143-147.
[14 ] M. Xu, R. Bodik and M. D. Hill, ”A ”flight data recorder” for
enabling full-system multiprocessor deterministic replay,” 30th Annual
International Symposium on Computer Architecture, 2003. Proceedings.,
San Diego, CA, USA, 2003, pp. 122-133
[15 ] G. Sachs, Drones: Reporting for work.
[16 ] (20 December 2018) ”Gatwick Airport: Drones ground flights” BBC
news reterived from https://www.bbc.com/news/uk-england-sussex-
46623754
[17 ] Smys, S., Jennifer S. Raj, and Nixon Augustine. "AUT ONOUMOUS
VEHICLE NAVIGAT ION IN COMMUNICAT ION CHALLENGED
ENVIRONMENT S-A SIMULAT ION APPROACH." (2011).
[18 ] Z. Sahwee, N. A. Rahman and K. S. M. Sahari, ”Experimental eval-
uation of actuator fault accommodation for small UAV,” 2015 IEEE
International Symposium on Robotics and Intelligent Sensors (IRIS),
Langkawi, 2015, pp. 32-37. doi: 10.1109/IRIS.2015.7451582

978-1-7281-2813-9/20/$31.00 ©2020 IEEE 24

Authorized licensed use limited to: Cornell University Library. Downloaded on August 20,2020 at 06:16:45 UTC from IEEE Xplore. Restrictions apply.

You might also like