You are on page 1of 15

Forest Ecology and Management 551 (2024) 121530

Contents lists available at ScienceDirect

Forest Ecology and Management


journal homepage: www.elsevier.com/locate/foreco

Review

Exploring artificial intelligence for applications of drones in forest ecology


and management
Alexander Buchelt a,b , Alexander Adrowitzer b , Peter Kieseberg b , Christoph Gollob a ,
Arne Nothdurft a , Sebastian Eresheim b,c , Sebastian Tschiatschek c , Karl Stampfer a ,
Andreas Holzinger a,d,∗
a
Human-Centered AI Lab, Institute of Forest Engineering, University of Natural Resources and Life Sciences, Vienna, Austria
b
University of Applied Sciences St. Poelten, Austria
c
University of Vienna, Austria
d
XAI-Lab, Alberta Machine Intelligence Institute, Edmonton, Canada

A R T I C L E I N F O A B S T R A C T

Keywords: This paper highlights the significance of Artificial Intelligence (AI) in the realm of drone applications in forestry.
Artificial intelligence Drones have revolutionized various forest operations, and their role in mapping, monitoring, and inventory
Machine learning procedures is explored comprehensively. Leveraging advanced imaging technologies and data processing
Drones
techniques, drones enable real-time tracking of changes in forested landscapes, facilitating effective monitoring
Unmanned aerial vehicles
of threats such as fire outbreaks and pest infestations. They expedite forest inventory by swiftly surveying
Forestry
Forest ecology large areas, providing precise data on tree species identification, size estimation, and health assessment, thus
supporting informed decision-making and sustainable forest management practices. Moreover, drones contribute
to tree planting, pruning, and harvesting, while monitoring reforestation efforts in real-time. Wildlife monitoring
is also enhanced, aiding in the identification of conservation concerns and informing targeted conservation
strategies. Drones offer a safer and more efficient alternative in search and rescue operations within dense
forests, reducing response time and improving outcomes. Additionally, drones equipped with thermal cameras
enable early detection of wildfires, enabling timely response, mitigation, and preservation efforts. The integration
of AI and drones holds immense potential for enhancing forestry practices and contributing to sustainable
land management. In the future explainable AI (XAI) improves trust and safety by providing transparency in
decision-making, aiding in liability issues, and enabling precise operations. XAI facilitates better environmental
monitoring and impact analysis, contributing to efficient forest management and preservation efforts. If a drone’s
AI can explain its actions, it will be easier to understand why it chose a particular path or action, which could
inform safety procedures and improvements.

1. Introduction and motivation for research borious, costly and hazardous. In this review, what these are and how
drones can be leveraged to alleviate these downsides, will be shown.
Forestry can be broadly categorized into forest monitoring, forest
Forests are vital in today’s climate, especially in mitigating global inventory, forest management, wildlife monitoring as well as search
warming. Not only do forests bind CO2 , but they help with water and rescue and wildfire monitoring. Forest monitoring and inventory
quality, can help regulate the temperature in urban areas, and also im- are rather closely related as this describes the branch that is concerned
portantly, they are the home to many wildlife species. Forestry efforts with gathering and harmonizing data from Forests. For example tree
are comprised of a plethora of tasks. Some of them concern themselves height, tree diameter, tree species, and also the number of trees of a
especially with keeping forests healthy and making them realize their certain species and so on. These efforts are made to firstly keep an
full potential, but for that a lot of tasks are necessary. Currently, this overview of what state the forest is currently in but also to see how it
work is mostly done manually, which makes forest operations rather la- is developing and to inform forest management efforts. In forest man-

* Corresponding author at: Human-Centered AI Lab, Institute of Forest Engineering, University of Natural Resources and Life Sciences, Vienna, Austria.
E-mail address: andreas.holzinger@boku.ac.at (A. Holzinger).

https://doi.org/10.1016/j.foreco.2023.121530
Received 2 July 2023; Received in revised form 24 October 2023; Accepted 26 October 2023
Available online 9 November 2023
0378-1127/© 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

agement, the concern is to act upon the monitoring data to ensure the Has t o f a l l i n t o a t l e a s t one o f the f i v e use
protection and maintenance of forested areas. This is done by pruning case categories
diseased vegetation or reforestation to name a few. Wildlife monitor-
ing intuitively describes tasks to keep track of the wildlife that inhabits Criteria for inclusion
forests. Search and Rescue as well as wildfire monitoring falls more in Uses A r t i f i c i a l I n t e l l i g e n c e
a crisis management category as it is here where usually an accident methods
or a natural disaster has taken place and efforts are made to either lo- Can be improved by A r t i f i c i a l I n t e l l i g e n c e
cate people in need of assistance or keep damages to the forest at a methods
minimum. In recent years drones have become not only more accessi- Has t o be r e l e v a n t t o the o b j e c t i v e s o f t h i s
ble but also more capable and affordable. This opens the question of review
how drones can aid forestry efforts like the practices described above. The work can be improved by the a p p l i c a t i o n o f
Drones equipped with technology fit to take a variety of image data drones
on multiple spectra or other means of gathering data like LiDAR build Uses methods t h a t r e p r e s e n t the c u r r e n t s t a t e −
the basis for being integrated into forestry efforts. In combination with of −the −a r t
constantly evolving machine learning and computer vision algorithms, As the premise this review explores is rather broad, papers that were
a host of advantages can be observed. to be included had to fulfill all of the general criteria. Concerning the
With evolving drone platforms, they are not only confined to obser- criteria for inclusion, papers that fulfilled one or more of these criteria
vation but can also take part in more actionable tasks involved in forest were added to the review.
management. In the following section, this paper gives an overview of As mentioned in the introduction this work explores five predefined
how the current state-of-the-art leverages drones and their benefits to categories for use-cases of drones in the context of forestry. 1) Forest
further improve forestry conservation efforts as well as research in the Monitoring and Inventory; 2) Forest Management; 3) Wildlife Monitor-
field. Current limitations and problems are discussed as well as where ing; 4) Search and Rescue; and 5) Wildfire Monitoring.
future work could focus their efforts in order to mitigate and overcome Web of Sciences and Google Scholar tools were used to search for rel-
these limitations. Section 2 declares what the motivation behind this evant publications over the past 15 years, that fall into these disciplines.
review is. Section 3 gives an overview of what resources were used to The timeline was chosen to be fairly recent as artificial intelligence and
research publications in the field. In this section, a detailed explanation drone technology are constantly evolving, so in order to show the state-
is given, on what search terms were used and what criteria were used of-the-art and possible use cases thereof have to be recent. The search
to analyze publications. In section 5 we discuss the publications found was also limited to publications that either use some form of artificial
regarding what field the work was published in, as well as what was intelligence as described in section 6 or that could benefit from imple-
accomplished with the methods used. Section 6 explains the machine menting more sophisticated methods. Keywords included but were not
learning methods that are relevant to the work discussed. The review limited to “drones in forestry”, “remote sensing” and “drones AND for-
is rounded off in section 7, by summarizing the findings, as well as the est monitoring”. We discuss what methods the authors of the resulting
commonalities between the included publications and an overview of publications used, and what use cases were achieved as well as what
future directions that should be explored is given. trends emerge and how they may be used to inform future research
efforts.
2. Objectives A Web of Sciences search using “drones in forestry” resulted in 243
publications for the period of 2008 to 2023. After refining the citation
The overall goal of this review is giving an overview of the existing topics meso to only include “Remote Sensing”, “Forestry”, “Zoology &
literature on the current usage of drones in forestry. Specifically, this Animal Ecology” and “Computer Vision & Graphics” and the citation
work attempts to (1) show what drone survey methods have been pub- topics micro to “Lidar”, “Forest Fires”, “Species Conservation”, “Deep
lished, (2) explain which AI techniques can be applied to each of these, Learning”, “Deforestation” and “Forest Management”, the results were
(3) identify future research directions. The specific goals were set in an narrowed to 99 publications.
effort to serve a number of purposes. The first is to show parts of the Another Web of Sciences search using “drones AND forest monitor-
forestry community that may have not had a lot of contact with arti- ing” resulted in 319 publications over the same period. After applying
ficial intelligence or its application in conjunction with drones, why it the same refinement 125 were left. Using “drones AND forest invento-
can be beneficial to think about incorporating them. The second is to ry” produced 65 publications after refinement. “drones AND wild fires”
deliver an overview, to the part of the forestry community that already and “drones AND search and rescue” resulted in 4 and 24 publications
incorporates artificial intelligence in their work, of what has been and respectively after refinement. In summary 317 publications were con-
is currently being worked on as well as functioning as a starting point sidered from the Web of Sciences.
to motivate possible future use cases. Lastly, having expertise in both The same Keywords were then used for a Google Scholar search to
forestry as well as artificial intelligence this review attempts to act as supplement, especially areas such as Wildfire detection. The resulting
an overview for the artificial intelligence community, to show how their publications were then analyzed for their application and relevance to
expertise can be garnered to aid crucial forestry efforts, as it is our opin- the review, according to the previously defined criteria. After analyzing
ion that interdisciplinary research will propel research. the temporary corpora, 87 publications were included in section 5.
The main focus of section 6 is to give a clear surface-level expla-
3. Search methods and analysis nation of the included artificial intelligence methods, thus the origin
publications where these methods were first introduced were used, as
Before starting the search, the criteria publications had to fulfill to well as publications that highlight either current advancements of said
be considered, as well as the criteria for inclusion in this review were methods or their importance as in the case of explainability in Artifi-
defined as follows. cial Intelligence. In total, this resulted in 100 publications referenced
within this review.
General C r i t e r i a
Has t o have been p u b l i s h e d between 2008 and 2023 4. Results
Has t o have been p u b l i s h e d i n an SCI l i s t e d
Journal − Table 1 depicts the methods used by the publications, spread across
or with a r e l e v a n t p u b l i s h e r ( e . g . MDPI) the defined use-case categories. Note that though Convolutional Neural

2
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

Fig. 1. Illustration of the search and analysis process to find the final publication corpus.

Table 1
Table showing the number of publications per use-case category, listed by the methods used.

Methods Forest Monitoring Forest Wildlife Search and Wildfire


and Inventory Management Monitoring Rescue Monitoring

Computer 27 2 4 3 7 43
Vision
Traditional ML 3 0 1 1 0 5
Methods
Deep learning 1 1 0 0 1 3
without CNN
No AI 12 4 3 1 1 21
43 7 8 5 9 72

Networks (CNNs) leverage Deep Learning principles and architectures, results shown in Table 1, indicate that the potential benefits of applying
for the purpose of this review however, they are included as Computer DL should be explored, see also Fig. 1.
Vision methods, as that is the context in which they are used. Deep Fig. 2 shows the number of publications in the field of drones in
Learning (DL) methods in the context of Table 1 are therefore defined forestry per year that do apply at least some sort AI. It clearly shows
as not including CNNs. Table 1 indicates that computer vision methods a surge from 2018 to 2020 with a sudden decrease in the last two
are the most adopted field of AI when drones are applied in the for-
years again. Fig. 3 further splits this data into different application ar-
est domain. This makes intuitive sense as a lot of approaches explore
eas within forestry and shows that most of the research was done in the
challenges related to some form of remote sensing in conjunction with
field of forest monitoring and inventory. However, there seems to be a
drones usually being fit with cameras at the time of purchase. There-
recent interest in wildfire monitoring, whereas there has not been new
fore many of the tasks that are described by the publications in this
review try to detect something or estimate a variety of measurements research in the fields of search & rescue and wildlife monitoring using
from images. It is also noteworthy that DL methods are rather under- AI powered drones since 2017. Fig. 4 depicts the publications grouped
represented. In current times DL is too often applied to use cases that by AI methods that were paired with drones in the forest domain. While
do not need these complex methods but could also be handled by using there seems to be a rather constant trend using drones without any AI,
less sophisticated but more easily computable methods. However, the AI methods have been increasingly applied since 2019, see Fig. 5.

3
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

performance, caused by the approaches relying on the search of lo-


cal maxima. The authors, therefore, propose an approach that uses
LiDAR-based 3D-shape modeling to mitigate these problems. They show
promising results on an example of a Hazel farm.
To maximize the cost reduction aspect of drones for monitor-
ing purposes, efficient image gathering is an important consideration.
Wierzbicki (2018) showed an approach that uses a multi-camera setup
that increases the field of view that is being recorded. The images of all
cameras at a given point are then merged by mosaic, therefore reduc-
ing the number of images that need to be processed while maintaining
better coverage with a single pass.
Forest monitoring plays an important role in enhancing forest con-
servation efforts, by providing vital data. Santos et al. (2019) outlined
that current deep-learning-based CV object detection lends itself to aid
in these efforts. The authors were able to classify specimens of an endan-
gered tree species in Brazil to a promising degree of average precision
Fig. 2. Amount of papers across all use cases that apply AI methods with drones of 92% while maintaining a processing time of around 32 milliseconds.
in the forest domain. Among others, monitoring leaf phenology is an important task, as in
fall it indicates the end of leaf growing season, impacting tree crowns
5. Discussion and therefore photosynthetic seasonality and others. Wu et al. (2021)
point out that if tried only with satellite imagery, this is a non-trivial
Having motivated why it is important to look into ways of aiding task because of the lack of spacial resolution leading to difficulty identi-
forestry operations, this section gives a more in-depth overview of what fying individual tree crowns as well as temporal availability of the data.
work is currently done, what advantages can be observed as a result, The authors, therefore, propose a method that integrates PlanetScope,
and what limitations still remain to be overcome. This is done in an a constellation of satellites with high spatial resolution and near-daily
effort to animate current research to take action in directions that can refresh rates, with drone observations. They show that by enhancing
leverage drones to their full potential while further developing how PlanetScope data with near-ground drone imagery in which individual
forests are taken care of, to reach solutions that help them realize their crowns are detectable, the authors were able to predict accurately what
full potential. part of their phenology a tree is in when compared to current state-of-
the-art phenocams. Similar work has been done by Park et al. (2019)
5.1. Forest monitoring and inventory showing that RGB imagery taken by drones produces promising results
in predicting phenological development, with their algorithm predict-
Monitoring is a very prevalent topic for drone usage in natural sci- ing individual trees with an R2 of 0.82 and a mean absolute error (MAE)
ence in general. Zhang et al. (2016) showed in their work how micro of 8.1% and species with an R2 of 0.89 and an MAE of 6.0%.
drones with predetermined flight paths can be used as a cost-effective Tang and Shao (2015) identify the time-critical availability and
monitoring method for a variety of ecological measures like canopy stand-level data as the two key problems for already established re-
height, canopy closure and species richness, just to name a few. The mote sensing and monitoring methods such as satellite and airplane
authors showed the usefulness of drones for this type of use case on imagery which can be alleviated by drones as they are not affected by
a 20-ha part of a nature reserve in China. The work mentions that by cloud coverage and are able to deliver fast real-time video and image
leveraging ground sensors and other already in-use methods with aerial streams, as well as being more cost-effective in both purchase and op-
drone imagery of the canopy, drones can contribute majorly to under- erating expenses. The authors note that drones can carry a variety of
standing the biodiversity of a given forest plot. sensing equipment like visible light, near-infrared (NIR), shortwave in-
The importance of monitoring in forestry is further supported by frared (SWIR), thermal infrared (TIR), Radar, and LiDAR. They propose
Mayr et al. (2018) who have found that disturbance, most commonly four specific applications, for drones within the field of monitoring,
by wildlife grazing and fires, has an impact on general tree growth. with reference to various researchers’ work. Forest surveying can give
The authors showed this by evaluating and validating tree height data great benefits in monitoring human activities, wildlife activities, and
derived from drone images for the example of the Namibian savannah. identifying flora (Koh and Wich, 2012; Paneque-Gálvez et al., 2014).
Another approach that uses a GPS-powered autonomous flight suite Mapping canopy gaps is an important application because it can show
is shown by Kellner et al. (2019). The work highlights how low-altitude disturbances and affects forest diversity and productivity (Frolking et
drones equipped with LiDAR technology can be used to monitor and al., 2009; Getzin et al., 2012). Monitoring forest canopy height is a
scan forests. The authors show that this method is capable of achieving critical indicator in forest quantification, Tang et al. use various experi-
similar results to earthbound lidar scans while being able to cover more ments (Siebert and Teizer, 2014; Lisein et al., 2013; Zarco-Tejada et al.,
ground effectively and reducing cost. It is mentioned that a prevalent 2014; Dandois and Ellis, 2013) to reinforce the claim, that drones are an
use case for this is the scanning of individual trees, as the point cloud alternative to more costly and complex LiDAR systems while not com-
scan can be used to calculate above-ground biomass. Similarly, Kuželka promising on performance. Drones can also be used to track wildfires.
et al. (2020) showed that they were able to accurately detect two differ- In this case, drones can give real-time data on a wildfire’s status and, in
ent tree species using a multitude of methods. Kuželka et al. also used doing so, can inform a strategy to fight wildfires while minimizing the
high-density point cloud data taken from sub-canopy drone-mounted risk to humans (Wing et al., 2013).
LiDAR scanners. Hyyppä et al. (2020) show that a similar LiDAR-based A very important topic when it comes to forest monitoring is the de-
approach works for detecting trees and even stem curves. Again by us- tection, prevention, and treatment of tree illnesses. The reason for this
ing data that was collected from a LiDAR sensor deployed on a manually importance lies in nature conservation, if illnesses are not detected early
flown drone at under-canopy height in a boreal forest. Additionally on they can have broader impacts on a forest which leads to the neces-
Fletcher and Mather (2020) show how solar elevation, among others, sity of rather costly nature conservation measures. Kocer et al. (2021)
impacts the quality and reproducibility of these point cloud data. describe this premise to further detail in their work. They also describe
Balsi et al. (2018) note however that a sizeable amount of work that, in broad terms, drones can help in this effort by placing sensors on
currently done on the topic of forest monitoring has shortcomings in trees either by means of launching them or placing them more carefully.

4
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

Fig. 3. Amount of papers grouped by forest use cases that apply AI methods with drones.

Another way is for drones to act as sensors themselves either through can be, among others, forest height, canopy density, tree species diver-
visual physical means i.e. video and image or by perching themselves sity, and biomass. Drones can play a vital role in taking and monitoring
on trees. Drones might also come into play for collecting leaf samples forest inventory as they can be utilized to gather imagery without the
to aid in the diagnosis and detection of certain diseases. A very interest- need to use human resources to accomplish the same. In their work
ing use-case that Kocer et al. describe is an object detection pipeline in Kotivuori et al. (2020) show that so-called drone image point clouds
which the drone scans leaves and is able to detect on its own if a tree is (DIPC) can be used the same way as existing methods like airborne
likely to be healthy or bares signs of bacteria. A similar approach would laser scanning (ALS). They furthermore show that DIPC can be regarded
be to use drones to detect crown loss as an indicator of tree and forest as a good alternative to ALS in some regards like estimating measure-
health. As with other describe use cases, the benefit of using drones in ments and metrics for the top layers of forests. Kotivuori et al. conclude
the ways described by Kocer et al. lies in its rather good cost efficiency that DIPC can be used in conjunction with ALS for existing models to
but also primarily in reducing the risk for human operators as current enhance the accuracy of estimations in both top-level as well as the
methods do pose non trivial risks. lower-level forest metrics. A further advantage DIPC has over ALS that
As the research shows, drones are currently deployed above the the authors mention is that ALS usually takes a lot of time between up-
canopies using photogrammetric or LiDAR technology to take measure- dates of the inventory, here drones can be leveraged to shorten these
ments in the majority of current work. While the choice of technology intervals giving a more timely overview of current forest inventory.
seems to make little difference (Ganz et al., 2019; Moe et al., 2020), In the vein of having forest inventory for tree species diversity pur-
even though LiDAR can have challenges in certain cases (Hastings et poses, Nezami et al. (2020) show that by using RGB and hyperspectral
al., 2020), the need for estimating or interpolating the ground beneath drone imagery, they were able to classify tree species. In their exper-
the forest canopy (Graham et al., 2019, 2020) still remains. Theoret- iments, they compare different data and architectures but conclude
ically, these problems could be mitigated by deploying drones below that a combination of RGB and hyperspectral camera data collected
the canopy line and therefore gathering more accurate measurements by drones perform best. The authors showed this for a classification of
of the same. This assumption appears to be supported by Krisanski et three different tree types found in the forests of Finland. This is fur-
al. (2020), who make similar claims. ther supported by Schiefer et al. (2020) who were able to classify trees
The field of forest inventory is closely interlinked with monitoring a by deploying semantic segmentation approaches like U-net on high-
forest as it concerns itself with acquiring auxiliary forest metrics. This resolution RGB imagery taken by UAVs as well as Picos et al. (2020)

5
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

Fig. 4. Amount of papers grouped by AI methods.

biomass, growth, and wood properties. This can be traced to the canopy
consisting of the chloroform-filled foliage of a tree which directly con-
tributes to these factors. Lou et al. mention that current analyses lack
distinctly in one part which is the measurement of tree width, con-
ventional methods that are widely in use are rather laborious and can
differ significantly in accuracy as they are influenced by factors like
ground coverage, location, surrounding height levels, etc. In their work,
they also mention that current methods to estimate tree width among
other metrics, use LiDAR and multispectral remote sensing which can be
rather cost-intensive, have trouble with individual trees, and is some-
what limited to areas without multiple canopy layers as for these ac-
curacies vary. Lou et al. showed, on the example of loblolly pine in
Texas USA, that drone images when used in conjunction with object
detection can increase the accuracy of the estimation or measurement
of the previously mentioned forest inventory metrics. Since Lou et al.
only used high-altitude drone images, and small drones can be used
for low-altitude imagery close to ground level, we theorize by utilizing
this capability further improvements can be made. Along similar lines
Jevšenak et al. (2023) showed that satellite imagery is well-suited to
enhance tree growth estimations. The authors note that there is a dis-
Fig. 5. Venn-Diagram of the included papers on whether they use drones and AI
in the field within the application domain forest. Note that AI methods without
parity for species-specific metrics on satellite images, which poses the
the use of drones is out of scope of this paper. question if these problems could be circumvented by using drone im-
agery on a near-ground level.
Another work that studied tree canopies was published by Petersen
who were able to classify individual Eucalyptus trees by using LiDAR et al. (2023) where airborne laser scans were used to monitor changes
and performing a buffer based and kernel density based estimation ap- in tree canopy development. More specifically the authors found that
proach on the resulting point cloud data. Yu et al. (2020) note that moose have a negative impact on canopy height and above-ground
hyperspectral images taken by drones are prone to errors by being biomass. The experiments were conducted over 100 paired exclosure-
susceptible to wind, GPS errors, and the like, and therefore show an control plots distributed across boreal biomes. The work clearly shows
approach that intends to minimize these errors by applying a novel im- that moose have a drastic impact on the development of a forest. Con-
age registration method. sidering the importance that boreal forests have in global carbon cy-
Wang et al. (2019) classified and enumerated individual oil palm cling, the work done by Petersen et al. underlines the necessity of this
trees. What makes this work interesting however is the use of more tra- field of research and how drones can aid in these efforts.
ditional machine learning methods like SVM and histogram of oriented Tree canopies are also being studied from the standpoint of gap dy-
gradient (HOG) to achieve their approach. Foregoing the use of deep namics. Hagemann et al. (2022) conducted a pilot study on airborne
learning bares the potential of reducing inference time and computa- laser scanning data taken from northern Sweden in 2006 and 2016.
tional intensity and duration of the training phase. The authors Boolean model for reference to assess the statistical signif-
Analyzing tree canopies is an important task, as Lou et al. (2022) icance of canopy gap dynamics for being an indicator of damage and
describe tree canopies to give a good measure for the estimation of irreversible trends in forests. Hagemann et al. showed that data col-

6
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

lected from drones even in moderate resolutions are a viable tool for to better biomass prediction in the here discussed experiments, without
monitoring canopy gap dynamics. the necessary need for major developments.
Along tree canopies, measuring tree growth is an important indica- A similar approach was shown by Sumnall et al. (2023). The au-
tor, informing forest management. Dempewolf et al. (2017) note that thors used existing experiments in Pinus taeda L. plantations containing
usually measurements are taken annually or even per decade, for this a variety of planting types and densities. The work shows that UAV
reason the authors showed that drone imagery lends itself to increase laser scanning data lends itself to achieving quite accurate predictions
the frequency of this data to within-season measurements. They were regarding individual tree crowns as well as estimations concerning the
able to measure tree growth with an accuracy that agrees with pub- diameter at breast height. This was demonstrated by using a backward-
lished field observations for Norway spruce, Scots pine, Silver birch, and stepwise linear multiple regression and a random forest model, both
European beech while taking advantage of cost reductions that come achieving competitive results. A random forest model does preserve the
with drones. Similarly, Krause et al. (2018) showed that photogram- extra bonus of allowing for easier explainability.
metric tree height measurements taken by drones are a viable option for In their work, Aasen et al. (2015) show an approach that uses hy-
forest monitoring and inventory, by comparing their results to manually perspectral snapshot cameras to create images of vegetation. They show
made in-field measurements. Interestingly the authors also noticed that that the data gathered from a lightweight UAV is sufficient to create a
in-situ measurements tend to be overestimated and photogrammetric model that is very close to in-field measurements in terms of biomass,
UAV measurements are commonly underestimated. Another interesting plant height, and chlorophyll. The authors showed this for the example
point is raised by Huang et al. (2019), wherein the authors found out of a barley field, we hypothesize however that this could be leveraged
that the absence of leaves during fall seasons leads to an underestima- to keep an inventory of a forest as well.
tion of tree height measured from UAV images. Another reason why forest inventory is taken is to find and monitor
Taking inventory of forests has a multitude of important uses, one diseases that affect trees and to take countermeasures, this is usually
of which is the estimation of biomass. This can for example be used done by removing affected trees. It is also important to keep track of
to estimate the amount of carbon stored by trees. Jones et al. (2022) how a forest develops with the disease i.e. the spread or how much
sought to explore the possibility to do this using drone imagery. The au- of the inventory had to be removed and so on. Currently to accom-
thors did this in a small subplot of mangroves in southern Australia. The plish this, rather expensive satellite images and field measurements are
specific mangrove was an Avicennia marina. Currently, measurements needed, drones represent a way of gathering the required data in a more
needed to estimate biomass are usually measured in situ by measuring affordable and resource-saving way. Yu et al. (2021) showed this on
tree height, canopy area, and tree diameter at breast height. With these the example of pine wilt disease (PWD) on a small subplot of forest in
measures being taken in-situ this brings with it a non-trivial amount of eastern China. They used multi- and hyper-spectral imagery gathered
needed resources and hazards, for mangroves, these are for example dis- from a UAV at a considerable altitude. These images were prepared and
eases carried by mosquitoes and predatory wildlife, of course depending fed through mainly two current and regularly used machine learning
on the geographic location, though the examples are specific to man- (ML) algorithms, a Random Forest classifier and a support vector ma-
groves in the area covered by the mentioned article, the main points chine (SVM). The authors showed that it is possible to classify PWD
of resource intensity and hazards do translate to other geographic lo- using their gathered aerial data in conjunction with commonly used ML
cations and types of forests. Jones et al. mention that at the moment methods. They showed this regardless of the stage the disease is in. Oide
if these measures cannot be taken, a default value is used. It is agreed et al. (2022) took this approach a step further by proving that visible
upon, that these default values lack both in accuracy and adequacy. The color imagery (i.e. RGB Video) is enough to provide data for accurate
authors used images from an unmanned aerial vehicle (UAV) in order PWD detection while being obtained in a rather low-cost fashion. They
to map a point cloud as well as make a georectified orthomaosaic with proved this for a small forest area in Japan. They showed that RGB im-
manually digitized canopies to compute the canopy area in m2 . Jones et agery can be used by a variety of ML methods to accurately predict PWD
al. showed that for the tree height, the estimations taken from UAV im- infection. This notion is further backed by Xia et al. (2021) who were
agery was very accurate and close to reality. When trying to predict the able to detect PWD by using deep learning segmentation methods on
biomass the authors encounter a few troubles. The authors used their es- images taken from a fixed-wing drone. The authors do however note,
timated measures of tree height, canopy area, and diameter with current that their work as well as previous work in the same field has prob-
field standard allometric estimations to determine biomass. They found lems when the disease is sparsely spread in a rather small area or when
that these methods are heavily reliant on tree diameter, which is the it comes to classifying individual trees. Again it is shown that UAVs
measure that they were least successful in gathering from their method present a way of achieving or enhancing critical tasks while being able
of UAV image gathering. Jones et al. boil this down to mangroves very to reduce cost and labor, also our previously mentioned hypothesis of
often having multi-trunked vegetation structures which leads to miscal- near-ground drone imagery being the missing link in order to enhance
culating the diameter based on height and canopy area. They conclude current methods as well as solving some of the problems, researchers
however, that if the estimation of biomass were to be steered and devel- are currently facing, again arises.
oped in a more hybrid measure direction, relying less on diameter and Wang et al. (2021) showed how drones can be leveraged to perform
more on all measures available, the large advantages of drone-based forest inventory through LiDAR measurements. In their work, they car-
forest inventory, like very fast, large and resource-conserving inven- ried out a drone mission in which they were able to scan approximately
tory coverage and the elimination or at least reduction of hazards to 0.5 ha of forest in around 10 minutes of flight. What makes the work
humans, could be realized in a major way. Di Gennaro et al. (2020) very interesting is that they combined both above- and under-canopy
concerned themselves with the estimation of biomass reduction after flight in order to measure every aspect of the forest and generate a
pruning. They showed that UAV-gathered multispectral imagery lead complete picture from their measurements. Their results showed that
to a viable estimation of biomass reduction in a chestnut orchard in this approach represents an excellent basis on which to build auton-
Italy. Di Gennaro et al. also mention this to feed into a more sustain- omy as their measurements for stem diameter and height were rather
able economy as this can be used to estimate the by-product of pruning accurate achieving a minimal margin of error.
namely wood material that can be used by production within a supply A similar problem was tackled by Zhang et al. (2022) who performed
chain. Jones et al. and Di Gennaro et al. show a rather promising proof various ultra-low flying scans of different forest plots of differing sizes
of concept, given future developments. We hypothesize, however, that in Japan. The authors created understory measurements to generate
if the flight height of 40 m that the authors used were to be reduced models that were able to predict understory biomass, tree stem volume,
to a more near-ground altitude the diameter estimation based on the and height. They showed by measuring the understory directly with
UAV point cloud could drastically be improved. This in turn could lead drones these predictors yielded acceptable results while being able to

7
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

save on resources, thus showing the value of being able to deploy drones of picking up seeds from the drone station, if none are carried at that
as measuring tools not only to monitor forests above the canopy but moment, scouting an optimal location for reforestation, and dropping
rather how vital the advancements can be by deploying drones in the their seeds. The agents learn this while keeping track of their battery
understory to have an accurate picture of the vegetation. Further, we level which is crucial in order to prevent battery-related unrecoverable
hypothesize that the advantages implied by this work can be expanded failure. The agents learn not only to keep track of their battery charge
by setting a focus on deploying drones autonomously. but also to act accordingly i.e. keeping in mind that the power level
has to be enough to return to the recharge station and noticing the
5.2. Forest management need to recharge and doing so upon their next visit to the drone sta-
tion. The agents for Siedler’s work are set up in a way where drones
Forest Management in broader terms, concerns itself with every-
that are within 200 m of each other can be understood as a graph, uti-
thing that is needed to maintain a forest. This includes tasks like refor-
lizing a GNN communication layer the agents can, within said distance,
estation, pruning, taking care of, and containing the spread of diseases.
exchange messages. This fosters collaboration, which leads to more
This field is increasing in importance as forests become more and more
exploration i.e. more ground discovered and covered. Siedler showed
endangered by global warming and society’s greed for industrially used
areas to which more often than not forests are destroyed. Maintaining that agents that were trained on a multitude of environments outper-
and growing forests, ensuring their health, and species variety gain im- form those who were trained on a single environment. The work also
portance. Drones can play a vital role in aiding this cause, especially shows that having the ability to communicate not only leads to more
in treacherous or unreachable terrain. To this end, data and its subse- exploration but also outperforms agents that were not able to send and
quent transportation is needed, in order to make decisions about which receive messages in general. It has to be said that the environment is
actions need to be taken when for example. Farinha et al. (2020) show rather abstracted, which is to mean not necessarily close to reality in
that Wireless Sensor Networks (WSNs) can be used for this. In their terms of physics and drone control, which very obviously still brings
work, they propose a novel a new form of placing such a WSN using the simulation to reality gap into play. Siedler however mentions these
drones as well as how sensors should be structured and protected while to be the fields that the work can be improved upon in future work.
saving resources as no interaction is needed to build the WSN while be- Even though the experiments show a simulated not necessarily close to
ing deployable in terrain that is unreachable to humans or would carry reality, approach, it has to be noted that this still is a very interesting
a lot of risk to be reached. We believe that this work can be a crucial direction to take this task in and should in our opinion be explored fur-
basis on which to build further UAV use cases, especially with auton- ther as methods of agent training and environment interpretation could
omy. be utilized in a variety of tasks not only for reforestation.
Another important task in the field of forest management is the The critical task of reforestation also needs a means to monitor their
planting of seeds. This can be done in an effort of previously men- success. Goodbody et al. (2018) show how drones can be used as a
tioned reforestation or to bind carbon by increasing vegetation which
cost-effective alternative to current yearly measurements of growth. To
also leads to increasing the nutrient levels within the soil. Fortes (2017)
achieve this, drones were deployed equipped with RGB cameras. The re-
shows a proof of concept on how drones can be utilized to aid these ef-
sulting images were converted to digital aerial photogrammetric (DAP)
forts. In their work, they show that they were able to fit a drone with
point clouds on which a number of indices were computed to estimate
a global positioning system (GPS) to navigate the drone via an autopi-
the forest’s status of regeneration.
lot on preplanned missions, a seed dispenser and a seed controller that
controlled when to release the seeds from the dispenser. Though the re- The before mentioned task of pruning trees in a forest mainly con-
sults of Fortes’s work were not entirely successful the work does show a sists of cutting parts like branches off trees or other plants. This is done
viable approach that can be modified and built upon to garner greater for a variety of reasons. It can be used in the early stages of growth in
results as well as the feasibility of such drone-based solutions as a cost order to ensure good stem quality or in the example of eucalyptus to
and resource-effective alternative to manual labor in these efforts. maximize harvest. It can also be necessary to reduce canopy density to
A different but very promising proof of concept is provided by ensure enough penetration of sunlight. In order to know which branches
Dampage et al. (2020). In their work the authors show a sewing mech- to prune when careful considerations, which are usually driven by data
anism that can be fitted to a quadcopter drone that is able to control gathered in the field, have to be made. Wallace et al. (2014) propose a
shutter speed and takes time delay and sewing angle into account in method to leverage ASL data gathered by small UAV in order to estimate
order to generate an optimal sewing interval and size. The drone is fit- the need for pruning. They show on the example of Tasmanian eucalyp-
ted with GPS and in order to make it able to carry out sewing missions tus that it is feasible to use UAV in order to generate data that has
autonomously, a mission planning software was used. In the proposed good enough quality to result in rather accurate predictions that lead to
approach the drone is aware of its home base and the farmer has to the right pruning decisions. Their work showed that a lot of human re-
mark the boundaries of the field that is to be cultivated by the drone. sources can be saved and risks can be averted by using these methods,
By marking the boundaries the drone can then take care of the sewing without losing performance. Ishigure et al. (2013) proposed a proof of
in an optimal fashion, should a critical situation, like low battery levels concept for a tree-mounted robot fitted with a low-power chainsaw that
arise, the drone will automatically return to its home base to prevent
is capable of climbing a tree and pruning branches. We hypothesize that
unrecoverable failure. Dampage et al. showed this to work sewing rice
with current advances in technological equipment, it could be possible
in a paddy field. We however venture to propose the hypothesis that
to fit a drone in order to be capable of achieving these same tasks, even
this seed dispensing technique could be elaborated upon in terms of
if this is not the case, with the mentioned advances it should be possi-
mission planning by using AI methods. Furthermore, we think that the
ble to fit a ground robot with the equipment to autonomously find trees
dispensing system could be used for a variety of seeds and applications.
Siedler (2022) shows a very novel and interesting approach. They in- and branches that have been marked for pruning and carrying out this
terpreted the reforestation task as a multi-agent reinforcement learning task. In our opinion, these two works show a substantial basis on which
(RL) problem rather than most works that explore single drone solu- autonomous forest management can be built. A point has to be made
tions. In their work, they use an environment created in unity that is that these two approaches if reworked to use near-ground drone images
procedurally generated. It includes information like height, ground fer- and autonomous pruning robots, whether this is a drone or another type
tility displayed by green grass, and land features like trees and ponds. of robot, form a very crucial use case for drones and autonomy in forest
Also included is a drone station that acts as a spawn point, recharge sta- management, as this would lower human resources, hazards to humans,
tion, and seed silo. In this environment the task for the agents consists and general cost significantly.

8
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

5.3. Wildlife monitoring counter inventory of an endangered species of crocodiles. While not
necessarily using a novel computer vision approach they were able to
Wildlife plays a vital role in a forest’s ecology. To ensure an ecosys- show, that remote counts taken via UAV render the same results on av-
tem’s health this needs to be managed carefully. Keeping track of erage while being able to cover significantly more ground in less time.
Wildlife and monitoring is a crucial part of this, in order to make well- The authors’ approach, therefore, proves that drones are a great alter-
informed management decisions and take optimal measures. native to manual methods for counting wildlife as they can be more
Using drones to keep track of animal population is gaining in use resource- and time effective when used correctly, without having to ac-
recently, but the validity of these methods was questioned in the begin- cept the loss in performance.
ning. Hodgson et al. (2018) sought to clarify this in their work. They
used drone imagery taken from various heights in order to prove that 5.4. Search and rescue
drones are not only more cost-effective but can also produce better re-
sults. In the example of the seabird population, the authors showed
Forests do not only hold wildlife but also humans in the form of
that counts taken from drone imagery are on average significantly more
hikers, and forestry workers just to name examples. Unfortunately like
accurate when compared to more traditional methods. Hodgson et al.
anywhere, accidents happen here as well. Search and rescue, therefore,
were able to prove this for manual counts as well as semi- and fully-
is a very important task that usually is very time critical. If a person
automated statistical counting methods where computer vision was
needs to be found often times large search parties roam the forest in
used to count birds on the gathered images.
and around the last known location. Below we explore how drones can
Lyons et al. (2019) show an approach that uses drone imagery taken
be applied to aid in these tasks.
from higher altitudes to count nesting bird populations. In their work,
Schedl et al. (2021) used a drone equipped with intelligent path
the authors compare manual and automated machine learning-based
planning to fly autonomously (Chen et al., 2020; Radmanesh et al.,
counting methods. They show that drone imagery in conjunction can be
2018; Mengying et al., 2017) as the basis for their work. In their ex-
leveraged to gain similar results as existing counting methods while re-
periments, they fitted the drone with thermal imaging hardware and
ducing labor costs as well as being able to cover more ground in shorter
segmented the search area into a grid. Each sector got assigned a like-
time spans. Lyons et al. also mention that with this approach it is possi-
lihood of finding the missing person. The novelty in the author’s work
ble to monitor wildlife in places that are hard or impossible to reach or
comes from implementing a dynamic search pattern where the drone
traverse for humans, making drones an excellent cost-efficient alterna-
decides itself which grids to search, and in what order based on finding
tive.
An approach based on the agricultural sector is given by Xu et al. probabilities. This approach showed acceptable results and therefore
(2020). In their work, the authors show a computer vision-based deep builds a great basis on which future advancements in the field can be
learning approach that is able to classify livestock in near real-time made.
on minimal computing power. The authors show promising results not Yong and Yeong (2018) implement an object detection algorithm ca-
only in the classification of livestock but also in counting. Xu et al. pable of detecting humans in forest environments. Their approach uses
mention this to be a labor-effective alternative to manual counting, es- computer vision enabled by deep learning. The authors show reason-
pecially in remote and rugged terrain that is hard to reach for humans. ably good results, by being able to detect humans without deterrence
Even though the work shows the validity of this approach with an agri- by trees and other noise in the images. Yong and Yeong note that their
cultural example, we hypothesize that the masking algorithms in use work can be extended by implementing autonomous drone flight, as in
should be applicable to a forest setting as well. their work the drone is controlled remotely. Even though the goal of
Different to computer vision-based approaches, Aulia Rahman and the work is to implement object detection for surveillance, detecting
Setiawan (2020) explored a thermal image-based approach. In their trespassing and illegal activity, we hypothesize that it can also build
work, they tested this on various canopy densities in the rainforests the foundation in the field of search and rescue. Good human detection
of Indonesia. The authors found that at an altitude of <50 m the re- builds a crucial component for carrying out search and rescue missions.
sults were best and animals were best visible on the images, this also Currently, drones are not necessarily used to find missing persons,
kept noise pollution to a seemingly tolerable level. Not surprising how- during search and rescue operations, by themselves. They are also lever-
ever their results were very dependent on the time of day as when the aged as a tool to gather information quickly over large surface areas.
sun heated the canopy, thermal images of animals started being inter- The captured images are then scanned manually by search parties to
fered with. The authors concluded that their work builds a good basis find signs of the missing persons to inform searchers where to look.
for remote wildlife monitoring, especially in areas that are not easy or This is done in an effort to speed up the search, as time is a cru-
impossible for humans to reach. The best results were achieved during cial component for success. Scanning this material manually can be
the early morning or evening, we hypothesize however when used in a very times consuming. That is why Weldon and Hupy (2020) explored
less warm climate, the time of day concern may vary. how computer-assisted interpretation compares to the current manual
An important consideration when pairing wildlife with drones is method. In their work, they found mixed results. While humans were
noise pollution. The aim should be monitoring without interfering. able to find signs of missing persons more accurately, machine-assisted
Scobie and Hugenholtz (2016) conducted experiments concerning this methods are able to go through more material in a fraction of the
topic. They show that interference depends on altitude, species and time. The work shows good potential for machine assistance, and ef-
frequencies. While not giving specific thresholds, their work is an im- forts should be made to evolve these methods even further to a point
portant basis that shows that these considerations are important to be where they can also detect humans more accurately, therefore reducing
made. Another option to reduce noise levels significantly in certain ap- the time it takes to find missing persons greatly.
plications is the use of blimps, airships without a rigid inner structure. Another search and rescue scenarios are natural disasters. Mishra
Studies have been conducted already 10 years ago on how this technol- et al. (2020) show that current computer vision models are not ade-
ogy can drastically reduce noise pollution (Liew and Yairi, 2013). The quate for finding signs of life after a natural crisis. Therefore the authors
rise in multi-rotor drone technology and the inherent poor performance propose their own object detection algorithm based on state-of-the-art
under windy conditions and the complexities in overcoming this limita- data sets that shows better results for finding humans on imagery cap-
tion (Furukawa and Shimada, 2014) moved blimps out of the scope for tured by autonomous drones. Advancements like these show two things.
most applications. Firstly they are not solely applicable to natural disasters but to all ar-
Thapa et al. (2018) compared wildlife counts conducted on aerial eas of search and rescue missions as well as any other scenario where
imagery taken by a fixed wing drone with on-site manual visual en- human detection is needed. Secondly, they show the importance of fur-

9
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

ther work in the field, marking the importance of exploring how society Rashid et al. (2020) present a novel and very interesting approach,
can benefit from interaction with intelligent systems. that they have coined CompDrone. In this approach, the authors use a
A less artificial intelligence-heavy approach is shown by Valsan et combination of social-media-driven drone sensing (SDS) and computa-
al. (2020). In their work they fitted a drone with various sensors, the tional wildfire modeling to predict wildfire propagation. The framework
most important of which being a Passive Infra-Red (PIR) sensor. The shown in this work uses social media posts to initially alert on the ex-
drone is flown over sites of natural disasters via GPS and Obstacle sen- istence of a forest fire and dispatches drones to this location to get a
sors. If the PIR sensor detects human movement a signal is sent to an verified and more informed view of the situation. The framework then
Arduino controller, that activates a buzzer or an LED indicating that uses the information gathered by the drones to inform the wildfire prop-
help is needed. As well as finding persons in need, the drone is also de- agation model to predict how the fire is going to evolve so that actions
ployed to monitor rescue efforts to aid a secure and speedy recovery that contain it can be taken. Contrastly Merino et al. (2012) showed
of people who need medical attention or are in dangerous situations. a more intuitive approach wherein a number of drones is deployed to
The authors mention that the focus of their work was to find a solution gain as much data about the fire, through infrared and normal RGB
that is very cost-effective and easy to deploy in areas that are prone to cameras. The data is then communicated to a central station that makes
natural disasters. a prediction of the fire’s development.
Another novel approach to detecting forest fires is proposed by Ghali
5.5. Wildfire detection and intervention et al. (2022), who have used existing deep CNN architectures and com-
bined them in an ensemble, showing this to outperform current state-of-
the-art detection approaches. The authors have used transformer-based
With the current state of global warming and the, therefore, chang-
architectures to further segment fires, shown in UAV imagery, on a pixel
ing climates, wildfires proportionally gain traction as an area of con-
basis thus detecting the shape of fire very accurately.
cern. With higher frequency of occurrence and more devastating conse-
Ul Ain Tahir et al. (2022) show a different but equally promising
quences and magnitudes of disaster, naturally, a lot of research efforts
method of detection. In their work, the authors use a CNN architecture
are taken to mitigate forest fires. Particularly work is done in the field
commonly used in object detection as the basis for their deep learn-
of detecting, monitoring, containment and prevention.
ing approach to detecting wildfires. Their proposed model achieves
In order to achieve wildfire prevention a lot of data to train mod-
high accuracy in real-time fire detection, making it a viable solution
els on is needed. Viseras et al. (2019) present a dataset containing data
for drone-based wildfire monitoring.
from controlled burns. The images were collected from drones at vary-
ing heights and with both optical and thermal cameras. The authors 6. Artificial intelligence and explainability
show that on the thermal cameras hotspots as small as 15 cm are visi-
ble. By making this data publicly available this work can be used to aid In this review, we have presented a variety of works that utilize
researchers in their efforts to develop deep learning-based methods. methods that can be categorized in one or several of the subfields con-
Kinaneva et al. (2019) conceptualize an approach that is concerned tained within Artificial Intelligence (AI). Goodfellow et al. (2016) give a
with the early detection of wildfires, as doing so could be crucial in brief surface-level definition wherein AI can be understood as the broad
deploying measures to keep the fire from ever spreading and causing field that encompasses all the others. A broadly accepted definition for
havoc. The authors propose achieving this by deploying fixed-wing and this field is that it encompasses every computer system that is made to
multi-copter drones at varying heights. These drones are to be equipped mimic any human-like intelligence, which is to mean it usually finds us-
with onboard computing capabilities to deploy computer vision technol- age in classification, object recognition, decision making or translation
ogy. The images that are taken by the mounted cameras and thermal tasks.
imagery equipment are used to detect smoke plumage, amber, and fire. This section gives a broad overview of methods that build the basis
These UAVs are proposed to forest areas to raise awareness in case a of some AI methods and also the major subcategories within AI that
fire is imminent. were used by the presented works.
Another interesting way to facilitate monitoring via drones is pro-
posed by Afghah et al. (2019). In their work, they propose the concept 6.1. Mission planning related concepts
of deploying drones in a distributed coalition format. A number of
drones are clustered to a coalition having one UAV as the coalition Use cases like Dampage et al. (2020) and Fortes (2017) have shown
leader that monitors and directs observer drones equipped with dif- that autopiloted mission planning software can be viable for rudimen-
ferent monitoring equipment over areas of interest. In doing so the tary projects. At the base of this type of software are two root concepts,
authors hope to leverage drone capabilities to achieve more area cov- path planning and mapping. In order for mission planning software to
erage and on-demand monitoring, which is hardly achievable through work a map needs to be provided in order to plan a path that should be
current satellite-based solutions. In essence, the authors also hope to taken to carry out the mission.
minimize human intervention specifically in remote areas, therefore, In path planning, there are a number of accepted algorithms one of
reducing the risk to humans by being exposed to unmonitored wildfires which is the Rapidly-exploring Random Tree (RRT). The basis for this
and hazardous areas that are hard to reach. is the Probabilistic Roadmap (PRM) Algorithm. PRM works by random
An issue that arises in wildfire detection as well as any other field sampling points in free space (the map on which to find a path) and
in computer vision is the availability and quality of training data. To edges between them, basically constructing a graph that maps feasible
mitigate these problems, transfer learning can be applied, which is also paths through space. This method however has two downsides. Firstly
the approach that Treneska and Risteska Stojkoska (2021) propose in it is computationally intensive because a roadmap for the whole space
their paper. The authors show that by utilizing transfer learning they is calculated and scales in complexity with the number of degrees of
were able to train various CV architectures on a fire dataset achieving freedom. Secondly desired start- and endpoints are not considered. To
good results, particularly for ResNet50. The authors propose this work combat these downsides RRT (LaValle, 2018) was introduced. It works
be deployed on UAVs. A similar approach with a similar goal in mind is on the same premise as PRM, but differs in that it builds a tree rather
shown by Gupta et al. (2022). Instead of transfer learning the authors than a graph. This is to mean that there is a single root node and every
trained a CNN to be able to accurately identify a fire in a forest con- subsequent node is connected to only one parent node. On a base level,
text. In order to mitigate overfitting, the CNN was trained on a variety the algorithm builds a tree by again random sampling the free space
of images of fire-like nature ranging in various aspects like day- and but in a loop where after a sample is taken, the nearest node attached
nighttime while producing promising results. to the tree is determined and connected. If a start- and endpoint are

10
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

to be considered two separate RRT’s are constructed with both start- methods as they are used to learn. That is to say, usually, they are used
and endpoint being the root. Both trees are grown until they can be by an algorithm to check its prediction and adjust its decision bound-
connected, thus finding a path that goes from one to the other. Though ary accordingly. Unsupervised learning methods differ in that they are
this approach alleviates the before mentioned problems it is still not used whenever there are no response variables. Typically this would fall
the most optimal way of finding a path and therefore works to improve into what is known as clustering. Rather than classifying the data, this
upon it is still being done, as demonstrated by Rodriguez et al. (2006) is usually used to explore the relations between the features contained
who used obstacle information to optimize the direction the tree grows in the data by finding similar instances, clusters, and analyzing what
in. features they have in common (James et al., 2013).
Another popular path-planning algorithm is the A* algorithm. This
algorithm works by assigning a cost to every available path from start 6.3. Support vector machines - SVM
to goal and taking the least costly. This is done by calculating two vari-
ables commonly denoted as g and h, where g is the distance to the next Among the before mentioned supervised learning algorithms are the
node on the graph and h is the distance to the goal. These variables are Support Vector Machines. They were first introduced by Cortes and
usually calculated through either determinate or approximate heuris- Vapnik (1995) and are most often used in binary class classification.
tics. Where g can usually be measured, h tends to be approximated via As an example, if a dataset had data points on an x, and y plane that
a Manhattan distance for example. The previously mentioned cost can belonged to two different classes and these classes were linearly sepa-
be understood as a weighted sum of g and h at every step of the path rable, then an SVM puts a hyperplane in place that best separates the
until the goal is reached. Once the cost for every path is calculated the data points belonging to the different classes. In this simplified example
most efficient, according to the implemented heuristics, is chosen. As the hyperplane can be understood as a linear decision boundary. The
with RRT, researchers constantly work on improving the A* algorithm SVM finds the optimal hyperplane by maximizing the distance between
and adapting it to new fields as shown by Erke et al. (2020), Tang et al. the hyperplane and the closes data points, the support vectors, of each
(2021) and Ju et al. (2020). class. This distance or area is called the margin.
Even though there are a number of algorithms in path planning the However, data usually is not as neatly separable as the above ex-
last we are going to mention is Dijkstra’s algorithm. This algorithm ample implies. This is the specialty of SVMs. If the data points are not
works by calculating the shortest path from a source node to every linearly separable then a kernel function is applied, introducing a new
other node in a graph. This is done by saving tables for every node dimension. In the above example, this would mean the introduction of
and their associated cost which can be understood as the distance. In a z-axis. In doing so there is more space to separate the data, which
the end the path with the least associated cost to get from the starting leads to the data points being more easily classifiable. In this case, the
point to the goal is chosen. It is quite intuitive, that a method like this is hyperplane acting as the decision boundary runs parallel to the x-axis,
rather inefficient from a computational standpoint, which is why there so when plotted on a two-dimensional plot this hyperplane might be
are constant improvements made, one of which is the before mentioned presented as a circle.
A* algorithm. More recently this is demonstrated by Mirahadi and Mc- Wang et al. (2019) show that even with wide spread deep learning
Cabe (2021). methods, supervised ML methods can still be superior. The authors def-
All of the mentioned path-finding algorithms have in common, that initely could have used deep learning to achieve their proposed goals,
they only work if there is some form of a representation of the environ- however with the data being properly structured and labeled, they
ment which would usually be a map. This runs into problems however leverage the preferable computing time that is associated with most
when there is no representation available of the environment a ground ML methods over deep learning. In doing so the authors have kept their
vehicle or drone is in. To combat this a method called simultaneous lo- computing time low while achieving acceptable results.
calization and mapping (SLAM) is used. SLAM as a theoretical problem
was introduced in 1986 and since has been worked on to find firstly a 6.4. Deep- and reinforcement learning
theoretical solution but more recently also practical use in the before
mentioned ground and aerial vehicles but also in the realm of self- Deep Learning (DL) is a subfield of ML and is able to process un-
driving cars and many more. SLAM describes a method in which a robot structured data and requires less to no human intervention, which is the
or a drone maps the environment it is unfamiliar with and places itself biggest distinction to classical machine learning methods. Deep Learn-
within it. With this method, the vehicle can map its surroundings as ing in broad terms typically uses so-called Neural Networks (NN) that
well as its position in them. The mapping part can be achieved through can be understood as a fully connected network of neurons that given an
RGB cameras but also by more advanced sensors like Radar or LiDAR. input, either forwards a signal or not, through the network and accord-
While the localization can be achieved by onboard hardware, taking ing to the signals that make it through, gives a probability for different
measurements along the drone’s trajectory which are used to calculate classes, if used as a classification, at the end.
its position, that can lead to inaccuracies. To combat this the Global Lastly, reinforcement learning can be understood as, on a surface
Navigation Satellite System (GNSS) or GPS can be used, however, the level, a subfield of ML where an agent (the model) interacts with an
great thing about SLAM is, that it works even in the absence of these environment. The environment provides the agent with a representation
(Alsadik and Karam, 2021). Due to these capabilities, SLAM could have of its current state and possible actions. The agent decides on an action
great applications in fields like forestry where GPS and the like, can be and gets a reward or a punishment, which reinforces desired behavior
problematic depending on the density of the forest. thought to achieve the envisioned goal. Reinforcement learning agents
can also use algorithms found in deep learning, this overlap is typically
6.2. Machine learning concepts called Deep RL.

Machine Learning is a subfield of AI that typically uses statistical 6.5. Convolutional neural networks - CNN
algorithms at the core. ML requires a lot of human intervention in the
way of extracting relevant features and putting the data in the necessary While the topic of computer vision encompasses a variety of con-
structure before a model can be fed with it and start learning. cepts and methods, such as calculating vanishing lines or finding land-
Machine learning methods can be separated into supervised and un- marks in images, for this review the focus is on Convolutional neural
supervised learning. For supervised learning methods, the data contains networks, because it finds the most use in the field of drone applica-
observations that consist of features or predictor measurements and tions. This is made evident by the previously presented works of Santos
labels or response variables. The response variables are vital to these et al. (2019), Gupta et al. (2022) and Ghali et al. (2022).

11
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

Convolutional neural networks are an adapted version of neural net- important in autonomous drone flight in forestry, where understand-
works that were discussed at the beginning of this section. They were ing the decision-making process significantly impacts multiple areas.
introduced by LeCun et al. (1989) and were invented specifically with The ability to rationalize and articulate AI decisions fosters trust among
image classification in mind. The main functionality lies in the convolu- stakeholders, which includes forestry professionals, policymakers, and
tions that take for example 3x3 frames of pixel values and reduce them the general public, and ensures that the AI systems controlling the
to a single value going forward, by performing a matrix multiplication drones are reliable. Also, the operational safety, a paramount concern
with a filter matrix. In doing so, the input images are reduced more and in the unpredictable environment of a forest, is substantially improved
more and what remains are significant features oftentimes edges. The by XAI. When a drone’s AI can elucidate its decisions, it facilitates un-
values that remain are then transposed from an input matrix to an in- derstanding of its choice of path or action, potentially contributing to
put vector and fed into a neural network which, as described previously, the development of safety protocols and improvements. In the event
outputs a probability for the input to belong to a certain class. of unforeseen circumstances or accidents, XAI’s ability to articulate the
drone’s behavior becomes invaluable for establishing liability, comply-
6.6. Deep Q-networks - DQN ing with regulations, and assuring ethical standards. By comprehend-
ing the ‘why’ behind an action, experts can finetune and optimize the
Deep Q-Networks are an iteration of Q-Learning algorithms. In Q- drone’s AI, boosting its efficiency and effectiveness over time. In preci-
learning an agent learns to traverse a maze for example by iteratively sion forestry, where high-precision activities such as selective logging,
calculating q-values for every action given a state. This is optimized by disease detection, and wildlife tracking are the norm, understanding the
making use of the Bellman equation that can give an expected value for decision-making process can fine-tune AI algorithms for better results.
an optimal policy or an optimal q-value for a specific state-action pair. Furthermore, XAI plays a significant role in environmental impact
Intuitively these calculations are rather time intensive, which is why analysis. Drones, often employed for environmental monitoring within
q-learning is best suited for smaller state spaces. To solve this Mnih forestry, can provide a comprehensive understanding of why certain
et al. (2015) proposed an architecture now known as DQN. It works environmental changes, like deforestation patterns, tree disease spread,
by not calculating a q-value table as previously described but rather or wildlife movements, are occurring with the aid of XAI. Such insights
using a neural network or CNN to approximate the q-values for every are invaluable for understanding and conserving our natural habitats.
action given a state. In doing so the agent learns faster and is able As the role of AI and ML expands in our world, transparency and under-
to handle larger state spaces that may even be represented by images. standing of these systems become imperative. In fields like drone flight
Through backpropagation, the neural network is optimized with the in forestry, the explainability of AI ensures that the systems are not only
loss calculated against the Bellman equation, which in turn makes it safe, efficient, and trusted but also aid rather than impede preservation
possible to approximate the optimal q-function. and conservation efforts in the name of automation. The importance of
explainability in this context is intuitively evident from the use cases
6.7. Explainable AI - XAI outlined in this paper, underlining the need for human-in-the-loop al-
gorithms that offer operators an understanding of actions such as why a
certain tree was pruned and the ability to intervene or guide the train-
The current success of AI is due to three main reasons: (i) The sig-
ing process. This symbiosis of humans and AI is crucial to ensuring that
nificant progress in statistical ML and particularly of DL (for a rough
drones genuinely enhance our ability to manage and protect our forests.
overview of the differences between AI, ML, DL see Holzinger et al.
Consequently, fostering both explainability and robustness can
(2023)), (ii) the ready availability of substantial amounts of training
enhance reliability and trust, ensuring that human control remains
data, and (iii) the available networked computational capacity. For
paramount. It suggests a partnership model that complements human
certain tasks, modern algorithms can surpass even human-level perfor-
intelligence with AI, rather than a substitution - which is the central
mance. Regrettably, the most potent ML methodologies (in particular
goal of the human-centered AI concept (Holzinger et al., 2022a).
DL) encounter challenges in robustness and explainability.
The most performing ML models are susceptible to trivial pertur-
bations in the input data, which can drastically impact the output, 7. Conclusion
leading to entirely different results. This sensitivity is critically signifi-
cant in sectors where data quality is less than ideal. One viable strategy Conducting this review showed that there is a lot of work already
to enhance AI’s robustness involves marrying statistical learning with being done with promising results, using a multitude of approaches.
knowledge representation. In certain contexts, employing a human in The common theme as to how drones can benefit forestry, most pre-
the loop could be beneficial. A human expert, although not always, dominantly the benefits are the reduction of cost, labor, and dangers to
can occasionally introduce experience, domain-specific knowledge, and humans, as well as providing more data that is gathered faster and more
conceptual understanding into the AI workflow (Holzinger et al., 2019). up to date. Interestingly a majority of the reviewed papers use higher
The most performing ML models are so complex, so high-dimensional altitude drone imagery, which offers the hypothesis that the use of near-
and so non-linear that they remain difficult to interpret, which makes ground imagery gathered by drones flying through a forest rather than
it practically impossible to retrace and to explain how a result has been over, could potentially lead to leaps in usefulness and analogously im-
achieved. This not only is a legal concern, but often the understanding prove the quality of estimations made based on the same. Furthermore,
of ‘why’ over a mere classification outcome in many application areas this new way of gathering images could lead to use cases that have
is more important than the result itself (Pearl, 2019). so far not been tried or thought of. This forms a very pressing rea-
This necessity has given rise to the field of Explainable AI (XAI) son, therefore to focus research in the direction of near-ground-level
(Cabitza et al., 2023). In the past, the use of DL has been predominantly drone flight in forests with the added importance of autonomy stem-
hindered by their black-box nature, obscuring the internal processes ming from the benefits found for human resources, safety, and cost.
that link inputs to outputs in a given decision or classification. XAI Future work, therefore, could be directed to explore autonomous drone
seeks to shed light on these opaque processes by illuminating the con- flight beneath the canopies as well as exploring how to make the whole
tribution of specific features or combinations thereof in decision-making system autonomous meaning, drone battery charges, and the transfer
(Holzinger et al., 2022b). of data, therefore needing minimal human interaction. For the second
The fundamental aim of XAI is to produce models that are com- point, explainability becomes an important consideration as with most
prehensible to humans to mitigate the likelihood of catastrophic errors systems that require next to no human interaction, understanding what
or unwanted behaviors (Saranti et al., 2022). We find this particularly decisions have been made and why has to be a priority. This makes ex-

12
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

plainability another avenue to be explored in combination with drone calibration to quality assurance. ISPRS J. Photogramm. Remote Sens. 108, 245–259.
flight in forest operations. https://doi.org/10.1016/j.isprsjprs.2015.08.002.
Afghah, F., Razi, A., Chakareski, J., Ashdown, J., 2019. Wildfire monitoring in re-
mote areas using autonomous unmanned aerial vehicles. In: IEEE INFOCOM 2019
Abbreviations - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS),
pp. 835–840.
• 2D = Two-dimensional Alsadik, B., Karam, S., 2021. The simultaneous localization and mapping (slam)-an
• 3D = Three-dimensional overview. Surv. Geosp. Eng. J. 2, 34–45. https://doi.org/10.38094/sgej1027.
Aulia Rahman, D., Setiawan, Y., 2020. Possibility of applying unmanned aerial vehi-
• ALS = Airborne Laser Scanning
cle and thermal imaging in several canopy cover class for wildlife monitoring -
• AI = Artificial Intelligence preliminary results. E3S Web Conf. 211, 04007. https://doi.org/10.1051/e3sconf/
• CNN = Convolutional Neural Network 202021104007.
• DAP = Digital Aerial Photogrammetric Balsi, M., Esposito, S., Fallavollita, P., Nardinocchi, C., 2018. Single-tree detection in
• DIPC = Drone Image Point Clouds high-density lidar data from uav-based survey. Eur. J. Remote Sens. 51 (1), 679–692.
https://doi.org/10.1080/22797254.2018.1474722.
• DL = Deep Learning
Cabitza, F., Campagner, A., Malgieri, G., Natali, C., Schneeberger, D., Stoeger, K.,
• DQN = Deep Q-Network Holzinger, A., 2023. Quod erat demonstrandum?-towards a typology of the concept
• GNN = Graph Neural Network of explanation for the design of explainable ai. Expert Syst. Appl. 213 (3), 118888.
• GPS = Global Positioning System https://doi.org/10.1016/j.eswa.2022.118888.
• HOG = Histogram of Oriented Gradient Chen, X., Zhao, M., Yin, L., 2020. Dynamic path planning of the uav avoiding static and
moving obstacles. J. Intell. Robot. Syst. 99 (3), 909–931. https://doi.org/10.1007/
• LiDAR = Light detection and ranging
s10846-020-01151-x.
• ML = Machine Learning Cortes, C., Vapnik, V., 1995. Support-vector networks. Mach. Learn. 20, 273–297. https://
• NN = Neural Networks doi.org/10.1007/BF00994018.
• NIR = Near-Infrared Dampage, U., Navodana, M., Lakal, U., Warusavitharana, A., 2020. Smart agricul-
• PGM = Probabilistic Graphical Model tural seeds spreading drone for soft soil paddy fields. In: 2020 IEEE Interna-
tional Conference on Computing, Power and Communication Technologies (GUCON),
• PIR = Passive Infra-Red pp. 373–377.
• PRM = Probabilistic Roadmap Dandois, J.P., Ellis, E.C., 2013. High spatial resolution three-dimensional mapping of
• PWD = Pine Wilt Disease vegetation spectral dynamics using computer vision. Remote Sens. Environ. 136,
• Radar = Radio detection and ranging 259–276. https://doi.org/10.1016/j.rse.2013.04.005.
Dempewolf, J., Nagol, J., Hein, S., Thiel, C., Zimmermann, R., 2017. Measurement
• RGB = Read Green Blue color channel imagery
of within-season tree height growth in a mixed forest stand using uav im-
• RL = Reinforcement Learning agery. Forests 8 (7). https://doi.org/10.3390/f8070231. https://www.mdpi.com/
• RRT = Rapidly-Exploring Random Tree 1999-4907/8/7/231.
• SDS = Social-media-driven Drone Sensing Di Gennaro, S.F., Nati, C., Dainelli, R., Pastonchi, L., Berton, A., Toscano, P., Matese, A.,
• SLAM = Simultaneous Localization and Mapping 2020. An automatic uav based segmentation approach for pruning biomass estima-
tion in irregularly spaced chestnut orchards. Forests 11 (3). https://doi.org/10.3390/
• SVM = Support Vector Machine
f11030308. https://www.mdpi.com/1999-4907/11/3/308.
• SWIR = Shortwave Infrared Erke, S., Bin, D., Yiming, N., Qi, Z., Liang, X., Dawei, Z., 2020. An improved a-star based
• TIR = Thermal Infrared path planning algorithm for autonomous land vehicles. Int. J. Adv. Robot. Syst. 17
• UAV = Unmanned Aerial Vehicle (5), 1729881420962263. https://doi.org/10.1177/1729881420962263.
• WSN = Wireless Sensor Network Farinha, A., Zufferey, R., Zheng, P., Armanini, S.F., Kovac, M., 2020. Unmanned aerial
sensor placement for cluttered environments. IEEE Robot. Autom. Lett. 5 (4),
• XAI = Explainable AI
6623–6630. https://doi.org/10.1109/LRA.2020.3015459.
Fletcher, A., Mather, R., 2020. Hypertemporal imaging capability of uas improves pho-
CRediT authorship contribution statement togrammetric tree canopy models. Remote Sens. 12 (8). https://doi.org/10.3390/
rs12081238. https://www.mdpi.com/2072-4292/12/8/1238.
AH initiated the work and was responsible for the funding acquisi- Fortes, E.P., 2017. Seed plant drone for reforestation. Grad. Rev. 2 (1), 13–26. http://
vc.bridgew.edu/grad_rev/vol2/iss1/7.
tion. AB and AH wrote the first draft of the paper. Consequently, all
Frolking, S., Palace, M.W., Clark, D.B., Chambers, J.Q., Shugart, H.H., Hurtt, G.C., 2009.
authors contributed to the investigation, analysis, writing, editing and Forest disturbance and recovery: a general review in the context of spaceborne
review of this paper. All authors read and approved the final version of remote sensing of impacts on aboveground biomass and canopy structure. J. Geo-
this paper. phys. Res., Biogeosci. 114 (G2). https://doi.org/10.1029/2008JG000911. https://
agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2008JG000911.
Furukawa, H., Shimada, A., 2014. Wind-disturbance-based control approach for blimp
Declaration of competing interest
robots. Electron. Commun. Jpn. 97 (2), 52–59. https://doi.org/10.1002/ecj.11498.
https://onlinelibrary.wiley.com/doi/abs/10.1002/ecj.11498.
The authors declare that they have no known competing financial Ganz, S., Käber, Y., Adler, P., 2019. Measuring tree height with remote sensing—a
interests or personal relationships that could have appeared to influence comparison of photogrammetric and lidar data with different field measurements.
the work reported in this paper. Forests 10 (8). https://doi.org/10.3390/f10080694. https://www.mdpi.com/1999-
4907/10/8/694.
Getzin, S., Wiegand, K., Schöning, I., 2012. Assessing biodiversity in forests using very
Data availability high-resolution images and unmanned aerial vehicles. Methods Ecol. Evol. 3 (2),
397–404. https://doi.org/10.1111/j.2041-210X.2011.00158.x. https://besjournals.
No data was used for the research described in the article. onlinelibrary.wiley.com/doi/abs/10.1111/j.2041-210X.2011.00158.x.
Ghali, R., Akhloufi, M.A., Mseddi, W.S., 2022. Deep learning and transformer approaches
for uav-based wildfire detection and segmentation. Sensors 22 (5). https://doi.org/
Acknowledgements
10.3390/s22051977. https://www.mdpi.com/1424-8220/22/5/1977.
Goodbody, T.R., Coops, N.C., Hermosilla, T., Tompalski, P., Crawford, P., 2018. Assessing
The Authors declare that there are no conflicts of interests. This the status of forest regeneration using digital aerial photogrammetry and unmanned
work does not raise any ethical issues. Parts of this work have been aerial systems. Int. J. Remote Sens. 39 (15–16), 5246–5264. https://doi.org/10.1080/
funded by the Austrian Science Fund (FWF), Project: P-32554 explain- 01431161.2017.1402387.
Goodfellow, I., Bengio, Y., Courville, A., 2016. Deep Learning. MIT Press.
able Artificial Intelligence.
Graham, A., Coops, N.C., Wilcox, M., Plowright, A., 2019. Evaluation of ground surface
models derived from unmanned aerial systems with digital aerial photogrammetry in
References a disturbed conifer forest. Remote Sens. 11 (1). https://doi.org/10.3390/rs11010084.
https://www.mdpi.com/2072-4292/11/1/84.
Aasen, H., Burkart, A., Bolten, A., Bareth, G., 2015. Generating 3d hyperspectral informa- Graham, A.N.V., Coops, N.C., Tompalski, P., Plowright, A., Wilcox, M., 2020. Effect of
tion with lightweight uav snapshot cameras for vegetation monitoring: from camera ground surface interpolation methods on the accuracy of forest attribute modelling

13
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

using unmanned aerial systems-based digital aerial photogrammetry. Int. J. Remote Krisanski, S., Taskhiri, M.S., Turner, P., 2020. Enhancing methods for under-canopy un-
Sens. 41 (9), 3287–3306. https://doi.org/10.1080/01431161.2019.1694722. manned aircraft system based photogrammetry in complex forests for tree diameter
Gupta, V., Roy, S., Jaiswal, V., Bhardwaj, K., Rana, P.S., 2022. Drone assisted deep learn- measurement. Remote Sens. 12 (10). https://doi.org/10.3390/rs12101652. https://
ing based wildfire detection system. In: 2022 Seventh International Conference on www.mdpi.com/2072-4292/12/10/1652.
Parallel, Distributed and Grid Computing (PDGC), pp. 162–166. Kuželka, K., Slavík, M., Surový, P., 2020. Very high density point clouds from uav laser
Hagemann, N., Magdon, P., Schnell, S., Pommerening, A., 2022. Analysing gap dynamics scanning for automatic tree stem detection and direct diameter measurement. Re-
in forest canopies with landscape metrics based on multi-temporal airborne laser mote Sens. 12 (8). https://doi.org/10.3390/rs12081236. https://www.mdpi.com/
scanning surveys – a pilot study. Ecol. Indic. 145, 109627. https://doi.org/10.1016/ 2072-4292/12/8/1236.
j.ecolind.2022.109627. LaValle, S.M., 2018. Rapidly-exploring random trees: a new tool for path planning. Annu.
Hastings, J.H., Ollinger, S.V., Ouimette, A.P., Sanders-DeMott, R., Palace, M.W., Ducey, Res. Rep. Math.
M.J., Sullivan, F.B., Basler, D., Orwig, D.A., 2020. Tree species traits determine LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel,
the success of lidar-based crown mapping in a mixed temperate forest. Remote L.D., 1989. Backpropagation applied to handwritten zip code recognition. Neural
Sens. 12 (2). https://doi.org/10.3390/rs12020309. https://www.mdpi.com/2072- Comput. 1 (4), 541–551. https://doi.org/10.1162/neco.1989.1.4.541.
4292/12/2/309. Liew, C.F., Yairi, T., 2013. Quadrotor or blimp? Noise and appearance considerations in
Hodgson, J.C., Mott, R., Baylis, S.M., Pham, T.T., Wotherspoon, S., Kilpatrick, A.D., designing social aerial robot. In: 2013 8th ACM/IEEE International Conference on
Raja Segaran, R., Reid, I., Terauds, A., Koh, L.P., 2018. Drones count wildlife Human-Robot Interaction (HRI), pp. 183–184.
more accurately and precisely than humans. Methods Ecol. Evol. 9 (5), 1160–1167. Lisein, J., Pierrot-Deseilligny, M., Bonnet, S., Lejeune, P., 2013. A photogrammetric work-
https://doi.org/10.1111/2041-210X.12974. https://besjournals.onlinelibrary.wiley. flow for the creation of a forest canopy height model from small unmanned aerial
com/doi/abs/10.1111/2041-210X.12974, 2018. system imagery. Forests 4 (4), 922–944. https://doi.org/10.3390/f4040922. https://
Holzinger, A., Plass, M., Kickmeier-Rust, M., Holzinger, K., Crisan, G.C., Pintea, C.-M., www.mdpi.com/1999-4907/4/4/922.
Palade, V., 2019. Interactive machine learning: experimental evidence for the human Lou, X., Huang, Y., Fang, L., Huang, S., Gao, H., Yang, L., Weng, Y., Hung, I.-K., 2022.
in the algorithmic loop. Appl. Intell. 49 (7), 2401–2414. https://doi.org/10.1007/ Measuring Loblolly pine crowns with drone imagery through deep learning. J. For.
s10489-018-1361-5. Res. 33 (1), 227–238. https://doi.org/10.1007/s11676-021-01328-6.
Holzinger, A., Saranti, A., Angerschmid, A., Retzlaff, C.O., Gronauer, A., Pejakovic, V., Lyons, M.B., Brandis, K.J., Murray, N.J., Wilshire, J.H., McCann, J.A., Kingsford, R.T.,
Medel, F., Krexner, T., Gollob, C., Stampfer, K., 2022a. Digital transformation in smart Callaghan, C.T., 2019. Monitoring large and complex wildlife aggregations with
farm and forest operations needs human-centered ai: challenges and future directions. drones. Methods Ecol. Evol. 10 (7), 1024–1035. https://doi.org/10.1111/2041-210X.
Sensors 22 (8), 3043. https://doi.org/10.3390/s22083043. 13194.
Holzinger, A., Saranti, A., Molnar, C., Biececk, P., Samek, W., 2022b. Explainable ai meth- Mayr, M.J., Malß, S., Ofner, E., Samimi, C., 2018. Disturbance feedbacks on the height of
ods - a brief overview. In: XXAI. In: Lecture Notes in Artificial Intelligence LNAI, woody vegetation in a savannah: a multi-plot assessment using an unmanned aerial
vol. 13200. Springer, pp. 13–38. vehicle (uav). Int. J. Remote Sens. 39 (14), 4761–4785. https://doi.org/10.1080/
Holzinger, A., Keiblinger, K., Holub, P., Zatloukal, K., Müller, H., 2023. Ai for life: trends 01431161.2017.1362132.
Mengying, Z., Hua, W., Feng, C., 2017. Online path planning algorithms for unmanned
in artificial intelligence for biotechnology. New Biotechnol. 74 (1), 16–24. https://
air vehicle. In: 2017 IEEE International Conference on Unmanned Systems (ICUS),
doi.org/10.1016/j.nbt.2023.02.001.
pp. 116–119.
Huang, H., He, S., Chen, C., 2019. Leaf abundance affects tree height estimation derived
Merino, L., Caballero, F., Martínez-de Dios, J.R., Maza, I., Ollero, A., 2012. An unmanned
from uav images. Forests 10 (10). https://doi.org/10.3390/f10100931. https://www.
aircraft system for automatic forest fire monitoring and measurement. J. Intell. Robot.
mdpi.com/1999-4907/10/10/931.
Syst. 65, 533–548. https://doi.org/10.1007/s10846-011-9560-x.
Hyyppä, E., Hyyppä, J., Hakala, T., Kukko, A., Wulder, M.A., White, J.C., Pyörälä, J., Yu,
Mirahadi, F., McCabe, B.Y., 2021. Evacusafe: a real-time model for building evacuation
X., Wang, Y., Virtanen, J.-P., Pohjavirta, O., Liang, X., Holopainen, M., Kaartinen, H.,
based on Dijkstra’s algorithm. J. Build. Eng. 34, 101687. https://doi.org/10.1016/j.
2020. Under-canopy uav laser scanning for accurate forest field measurements. ISPRS
jobe.2020.101687.
J. Photogramm. Remote Sens. 164, 41–60. https://doi.org/10.1016/j.isprsjprs.2020.
Mishra, B., Garg, D., Narang, P., Mishra, V., 2020. Drone-surveillance for search and
03.021.
rescue in natural disaster. Comput. Commun. 156, 1–10. https://doi.org/10.1016/j.
Ishigure, Y., Hirai, K., Kawasaki, H., 2013. A pruning robot with a power-saving chain-
comcom.2020.03.012.
saw drive. In: 2013 IEEE International Conference on Mechatronics and Automation,
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves,
pp. 1223–1228.
A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al., 2015. Human-level control
James, G., Witten, D., Hastie, T., Tibshirani, R., 2013. An Introduction to Statistical Learn-
through deep reinforcement learning. Nature 518 (7540), 529–533. https://doi.org/
ing, vol. 112. Springer.
10.1038/nature14236.
Jevšenak, J., Klisz, M., Mašek, J., Čada, V., Janda, P., Svoboda, M., Vostarek, O., Treml, Moe, K.T., Owari, T., Furuya, N., Hiroshima, T., 2020. Comparing individual tree
V., van der Maaten, E., Popa, A., et al., 2023. Modelling secondary tree growth of height information derived from field surveys, lidar and uav-dap for high-value tim-
European forests based on high resolution satellite observations and climate data. ber species in northern Japan. Forests 11 (2). https://doi.org/10.3390/f11020223.
Tech. Rep., Copernicus Meetings. https://www.mdpi.com/1999-4907/11/2/223.
Jones, A.R., Raja Segaran, R., Clarke, K.D., Waycott, M., Goh, W.S.H., Gillanders, B.M., Nezami, S., Khoramshahi, E., Nevalainen, O., Pölönen, I., Honkavaara, E., 2020. Tree
2022. Estimating mangrove tree biomass and carbon content: a comparison of for- species classification of drone hyperspectral and rgb imagery with deep learn-
est inventory techniques and drone imagery. Front. Mar. Sci. 6. https://doi.org/10. ing convolutional neural networks. Remote Sens. 12 (7). https://doi.org/10.3390/
3389/fmars.2019.00784. https://www.frontiersin.org/articles/10.3389/fmars.2019. rs12071070. https://www.mdpi.com/2072-4292/12/7/1070.
00784. Oide, A.H., Nagasaka, Y., Tanaka, K., 2022. Performance of machine learning algorithms
Ju, C., Luo, Q., Yan, X., 2020. Path planning using an improved a-star algorithm. In: for detecting pine wilt disease infection using visible color imagery by uav remote
2020 11th International Conference on Prognostics and System Health Management. sensing. Remote Sens. Appl. Soc. Environ. 28, 100869. https://doi.org/10.1016/j.
PHM-2020, Jinan, pp. 23–26. rsase.2022.100869.
Kellner, J.R., Armston, J., Birrer, M., Cushman, K., Duncanson, L., Eck, C., Falleger, C., Paneque-Gálvez, J., McCall, M.K., Napoletano, B.M., Wich, S.A., Koh, L.P., 2014. Small
Imbach, B., Král, K., Kruček, M., et al., 2019. New opportunities for forest remote drones for community-based forest monitoring: an assessment of their feasibility
sensing through ultra-high-density drone lidar. Surv. Geophys. 40, 959–977. https:// and potential in tropical areas. Forests 5 (6), 1481–1507. https://doi.org/10.3390/
doi.org/10.1007/s10712-019-09529-9. f5061481. https://www.mdpi.com/1999-4907/5/6/1481.
Kinaneva, D., Hristov, G., Raychev, J., Zahariev, P., 2019. Early forest fire detection using Park, J.Y., Muller-Landau, H.C., Lichstein, J.W., Rifai, S.W., Dandois, J.P., Bohlman, S.A.,
drones and artificial intelligence. In: 2019 42nd International Convention on Infor- 2019. Quantifying leaf phenology of individual trees and species in a tropical forest
mation and Communication Technology, Electronics and Microelectronics (MIPRO), using unmanned aerial vehicle (uav) images. Remote Sens. 11 (13). https://doi.org/
pp. 1060–1065. 10.3390/rs11131534. https://www.mdpi.com/2072-4292/11/13/1534.
Kocer, B.B., Ho, B., Zhu, X., Zheng, P., Farinha, A., Xiao, F., Stephens, B., Wiesemüller, F., Pearl, J., 2019. The seven tools of causal inference, with reflections on machine learning.
Orr, L., Kovac, M., 2021. Forest drones for environmental sensing and nature conser- Commun. ACM 62 (3), 54–60. https://doi.org/10.1145/3241036.
vation. In: 2021 Aerial Robotic Systems Physically Interacting with the Environment Petersen, T.K., Kolstad, A.L., Kouki, J., Leroux, S.J., Potvin, L.R., Tremblay, J.-P., Wall-
(AIRPHARO), pp. 1–8. gren, M., Widemo, F., Cromsigt, J.P.G.M., Courtois, C., Austrheim, G., Gosse, J., den
Koh, L.P., Wich, S.A., 2012. Dawn of drone ecology: low-cost autonomous aerial vehi- Herder, M., Hermanutz, L., Speed, J.D.M., 2023. Airborne laser scanning reveals uni-
cles for conservation. Trop. Conserv. Sci. 5 (2), 121–132. https://doi.org/10.1177/ form responses of forest structure to moose (alces alces) across the boreal forest
194008291200500202. biome. J. Ecol. https://doi.org/10.1111/1365-2745.14093.
Kotivuori, E., Kukkonen, M., Mehtätalo, L., Maltamo, M., Korhonen, L., Packalen, P., Picos, J., Bastos, G., Míguez, D., Alonso, L., Armesto, J., 2020. Individual tree detec-
2020. Forest inventories for small areas using drone imagery without in-situ field tion in a eucalyptus plantation using unmanned aerial vehicle (uav)-lidar. Remote
measurements. Remote Sens. Environ. 237, 111404. https://doi.org/10.1016/j.rse. Sens. 12 (5). https://doi.org/10.3390/rs12050885. https://www.mdpi.com/2072-
2019.111404. 4292/12/5/885.
Krause, S., Sanders, T.G., Mund, J.-P., Greve, K., 2018. Uav-based photogrammetric tree Radmanesh, M., Kumar, M., Guentert, P.H., Sarim, M., 2018. Overview of path-planning
height measurement for intensive forest monitoring. Remote Sens. 11 (7). https:// and obstacle avoidance algorithms for uavs: a comparative study. Unmann. Syst. 06
doi.org/10.3390/rs11070758. https://www.mdpi.com/2072-4292/11/7/758. (02), 95–118. https://doi.org/10.1142/S2301385018400022.

14
A. Buchelt, A. Adrowitzer, P. Kieseberg et al. Forest Ecology and Management 551 (2024) 121530

Rashid, M.T., Zhang, Y., Zhang, D., Wang, D., 2020. Compdrone: towards integrated com- Viseras, A., Marchal, J., Schaab, M., Pages, J., Estivill, L., 2019. Wildfire monitoring and
putational model and social drone based wildfire monitoring. In: 2020 16th Interna- hotspots detection with aerial robots: measurement campaign and first results. In:
tional Conference on Distributed Computing in Sensor Systems (DCOSS), pp. 43–50. 2019 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR),
Rodriguez, S., Tang, X., Lien, J.-M., Amato, N., 2006. An obstacle-based rapidly-exploring pp. 102–103.
random tree. In: Proceedings 2006 IEEE International Conference on Robotics and Wallace, L., Watson, C., Lucieer, A., 2014. Detecting pruning of individual stems using
Automation. ICRA 2006, 2006, pp. 895–900. airborne laser scanning data captured from an unmanned aerial vehicle. Int. J. Appl.
Santos, A.A.d., Marcato Junior, J., Araújo, M.S., Di Martini, D.R., Tetila, E.C., Siqueira, Earth Obs. Geoinf. 30, 76–85. https://doi.org/10.1016/j.jag.2014.01.010.
H.L., Aoki, C., Eltner, A., Matsubara, E.T., Pistori, H., Feitosa, R.Q., Liesenberg, V., Wang, Y., Zhu, X., Wu, B., 2019. Automatic detection of individual oil palm trees from
Gonçalves, W.N., 2019. Assessment of cnn-based methods for individual tree detec- uav images using hog features and an svm classifier. Int. J. Remote Sens. 40 (19),
tion on images captured by rgb cameras attached to uavs. Sensors 19 (16). https:// 7356–7370. https://doi.org/10.1080/01431161.2018.1513669.
doi.org/10.3390/s19163595. https://www.mdpi.com/1424-8220/19/16/3595. Wang, Y., Kukko, A., Hyyppä, E., Hakala, T., Pyörälä, J., Lehtomäki, M., El Issaoui, A.,
Saranti, A., Hudec, M., Minarikova, E., Takac, Z., Großschedl, U., Koch, C., Pfeifer, B., Yu, X., Kaartinen, H., Liang, X., Hyyppä, J., 2021. Seamless integration of above- and
Angerschmid, A., Holzinger, A., 2022. Actionable explainable ai (axai): a practical under-canopy unmanned aerial vehicle laser scanning for forest investigation. For.
example with aggregation functions for adaptive classification and textual explana- Ecosyst. 8 (1), 10. https://doi.org/10.1186/s40663-021-00290-3.
tions for interpretable machine learning. Mach. Learn. Knowl. Extr. 4 (4), 924–953. Weldon, W.T., Hupy, J., 2020. Investigating methods for integrating unmanned aerial
https://doi.org/10.3390/make4040047. systems in search and rescue operations. https://doi.org/10.3390/drones4030038.
Schedl, D.C., Kurmi, I., Bimber, O., 2021. An autonomous drone for search and rescue Wierzbicki, D., 2018. Multi-camera imaging system for uav photogrammetry. Sensors 18
in forests using airborne optical sectioning. Sci. Robot. 6 (55), eabg1188. https:// (8). https://doi.org/10.3390/s18082433. https://www.mdpi.com/1424-8220/18/8/
doi.org/10.1126/scirobotics.abg1188. 2433.
Schiefer, F., Kattenborn, T., Frick, A., Frey, J., Schall, P., Koch, B., Schmidtlein, S., 2020. Wing, M.G., Burnett, J., Sessions, J., Brungardt, J., Cordell, V., Dobler, D., Wilson, D.,
Mapping forest tree species in high resolution uav-based rgb-imagery by means of 2013. Eyes in the sky: remote sensing technology development using small un-
convolutional neural networks. ISPRS J. Photogramm. Remote Sens. 170, 205–215. manned aircraft systems. J. For. 111 (5), 341–347. https://doi.org/10.5849/jof.12-
https://doi.org/10.1016/j.isprsjprs.2020.10.015. 117. https://academic.oup.com/jof/article-pdf/111/5/341/23179677/2895.pdf.
Scobie, C.A., Hugenholtz, C.H., 2016. Wildlife monitoring with unmanned aerial vehi- Wu, S., Wang, J., Yan, Z., Song, G., Chen, Y., Ma, Q., Deng, M., Wu, Y., Zhao, Y., Guo, Z.,
cles: quantifying distance to auditory detection. Wildl. Soc. Bull. 40 (4), 781–785. Yuan, Z., Dai, G., Xu, X., Yang, X., Su, Y., Liu, L., Wu, J., 2021. Monitoring tree-crown
https://doi.org/10.1002/wsb.700. https://wildlife.onlinelibrary.wiley.com/doi/abs/ scale autumn leaf phenology in a temperate forest with an integration of planetscope
10.1002/wsb.700. and drone remote sensing observations. ISPRS J. Photogramm. Remote Sens. 171,
Siebert, S., Teizer, J., 2014. Mobile 3d mapping for surveying earthwork projects using 36–48. https://doi.org/10.1016/j.isprsjprs.2020.10.017.
an unmanned aerial vehicle (uav) system. Autom. Constr. 41, 1–14. https://doi.org/ Xia, L., Zhang, R., Chen, L., Li, L., Yi, T., Wen, Y., Ding, C., Xie, C., 2021. Evaluation of
10.1016/j.autcon.2014.01.004. deep learning segmentation models for detection of pine wilt disease in unmanned
Siedler, P.D., 2022. Dynamic collaborative multi-agent reinforcement learning communi- aerial vehicle images. Remote Sens. 13 (18). https://doi.org/10.3390/rs13183594.
cation for autonomous drone reforestation. https://doi.org/10.48550/ARXIV.2211. https://www.mdpi.com/2072-4292/13/18/3594.
15414. https://arxiv.org/abs/2211.15414, 2022. Xu, B., Wang, W., Falzon, G., Kwan, P., Guo, L., Sun, Z., Li, C., 2020. Livestock classi-
Sumnall, M.J., Albaugh, T.J., Carter, D.R., Cook, R.L., Hession, W.C., Campoe, O.C., Ru- fication and counting in quadcopter aerial images using mask r-cnn. Int. J. Remote
bilar, R.A., Wynne, R.H., Thomas, V.A., 2023. Estimation of individual stem volume Sens. 41 (21), 8121–8142. https://doi.org/10.1080/01431161.2020.1734245.
and diameter from segmented uav laser scanning datasets in pinus taeda l. Plan- Yong, S.-P., Yeong, Y.-C., 2018. Human object detection in forest with deep learning
tations. Int. J. Remote Sens. 44 (1), 217–247. https://doi.org/10.1080/01431161. based on drone’s vision. In: 2018 4th International Conference on Computer and
2022.2161853. Information Sciences (ICCOINS), pp. 1–5.
Tang, L., Shao, G., 2015. Drone remote sensing for forestry research and practices. J. For. Yu, R., Lyu, M., Lu, J., Yang, Y., Shen, G., Li, F., 2020. Spatial coordinates correction
Res. 26 (4), 791–797. https://doi.org/10.1007/s11676-015-0088-y. based on multi-sensor low-altitude remote sensing image registration for monitor-
Tang, G., Tang, C., Claramunt, C., Hu, X., Zhou, P., 2021. Geometric a-star algorithm: ing forest dynamics. IEEE Access 8, 18483–18496. https://doi.org/10.1109/ACCESS.
an improved a-star algorithm for agv path planning in a port environment. IEEE 2020.2968335.
Access 9, 59196–59210. https://doi.org/10.1109/ACCESS.2021.3070054. Yu, R., Luo, Y., Zhou, Q., Zhang, X., Wu, D., Ren, L., 2021. Early detection of pine wilt
Thapa, G.J., Thapa, K., Thapa, R., Jnawali, S.R., Wich, S.A., Poudyal, L.P., Karki, S., disease using deep learning algorithms and uav-based multispectral imagery. For.
2018. Counting crocodiles from the sky: monitoring the critically endangered gharial Ecol. Manag. 497, 119493. https://doi.org/10.1016/j.foreco.2021.119493.
(gavialis gangeticus) population with an unmanned aerial vehicle (uav). J. Unmann. Zarco-Tejada, P., Diaz-Varela, R., Angileri, V., Loudjani, P., 2014. Tree height quantifica-
Veh. Syst. 6 (2), 71–82. https://doi.org/10.1139/juvs-2017-0026. tion using very high resolution imagery acquired from an unmanned aerial vehicle
Treneska, S., Risteska Stojkoska, B., 2021. Wildfire detection from uav collected im- (uav) and automatic 3d photo-reconstruction methods. Eur. J. Agron. 55, 89–99.
ages using transfer learning. In: Proceedings of the 18th International Confer- https://doi.org/10.1016/j.eja.2014.01.004.
ence on Informatics and Information Technologies. Skopje, North Macedonia, Zhang, J., Hu, J., Lian, J., Fan, Z., Ouyang, X., Ye, W., 2016. Seeing the forest from drones:
pp. 6–7. https://www.researchgate.net/publication/353732371_Wildfire_detection_ testing the potential of lightweight drones as a tool for long-term forest monitoring.
from_UAV_collected_images_using_transfer_learning. Biol. Conserv. 198, 60–69. https://doi.org/10.1016/j.biocon.2016.03.027.
Ul Ain Tahir, H., Waqar, A., Khalid, S., Usman, S.M., 2022. Wildfire detection in aerial Zhang, Y., Onda, Y., Kato, H., Feng, B., Gomi, T., 2022. Understory biomass measure-
images using deep learning. In: 2022 2nd International Conference on Digital Futures ment in a dense plantation forest based on drone-sfm data by a manual low-flying
and Transformative Technologies (ICoDT2), pp. 1–7. drone under the canopy. J. Environ. Manag. 312, 114862. https://doi.org/10.1016/
Valsan, A., P., B., V. D., G.H., Unnikrishnan, R., Reddy, P.K., V. , A., 2020. Unmanned j.jenvman.2022.114862.
aerial vehicle for search and rescue mission. In: 2020 4th International Conference
on Trends in Electronics and Informatics (ICOEI), vol. 48184, pp. 684–687.

15

You might also like