Professional Documents
Culture Documents
Abstract— A 5.8-GHz continuous-wave (CW) radar was devel- terrestris) [8]. Approximately, 80% of global pollination
oped and integrated on a compact printed circuit board (PCB) services are attributed to honeybees, making them a key
for near-hive monitoring of honeybees. It supported noninvasive component of the ecosystem [9], [10], [11].
detection of free-flying honeybees at 2 m and micro-Doppler
extraction of bee wingbeat signatures at a closer range using Recent findings show that the combinational exposure of
both a double-balanced mixer and an in-phase/quadrature (IQ) stressors inflicts detrimental effects on colony health, hive
mixer. An original technique combining full-wave simulations performance, and their population level [12]. For example,
and Doppler-radar monitoring of pendulum motion was used for: honeybee absconding, a significant cause of colony loss in pol-
radar calibration through spherical targets of different material linators, has been linked to intracolony food pattern changes
and size; precise extraction of bee radar cross section (RCS)
at 5.8 GHz; and estimation of detection range enhancement and foraging stresses [13]. The development of monitoring
through partial silver coating of targets. Finally, the CW radar technologies for real-time assessment of insect activity is a
was integrated with machine learning (ML) to allow automated key element in studies to further increase our understand-
classification of incoming, outgoing, and hovering honeybees. ing [14], [15], [16] and manage populations of Apidae.
Different ML approaches were tested, where the highest accuracy
Multiple sensors can be used for real-time probing of
of 93.37% was found in ternary classification via support vector
machine acting on line spectral frequencies. hive internal or in situ parameters, such as temperature,
humidity, weight, and activity [17]. Radio telemetry, har-
Index Terms— Continuous-wave (CW) radar, Doppler radar,
machine learning (ML), micro-Doppler.
monic radars, and radio-frequency identification (RFID) tags
have also enabled insect tracking and potentially support
I. I NTRODUCTION statistical analysis of their behavior over the entire forage
range [16], [18], [19]. Nevertheless, there has been concern
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
TABLE I
5.8-GHz R ADAR PARAMETERS
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
To retrain such a network requires a large quantity of 1) estimator count between 100 and 1000, in increments of
data on par with MobileNet’s original work. Audio (rather 100;
than spectrogram) processing was a feasible alternative as all 2) split criterion of either Gini impurities or entropy for
the 5.8-GHz output radar signals contained relevant informa- information gain;
tion at sub-1-kHz frequencies. Audio files were subdivided 3) the number of features to consider for a split being either
into 0.4-s segments, with each being vetted for a minimum the square root or log2 of the total number of features.
signal. Additionally, the SVM hyperparameters were from the
The window of 0.4 s was deemed a suitable tradeoff in view following possibilities:
of the system application as a real-time monitor. This window 1) a regularization parameter between 1e-6 and 100;
matched our initial observation of the smallest complete event 2) kernel coefficient of 1e-6 to 100;
in the dataset. Subdividing this event further would risk failing 3) polynomial kernel function degree between 1 and 5;
to supply complete information to the ML. Larger windows 4) a kernel choice of either linear, polynomial, radial basis
did not offer sufficient improvements in accuracy to combat function, or sigmoid.
the additional cost in terms of samples. For rapid in-and- Initial experiments showed that the MFCC and LSF
out signals, the window of 0.4 s emerged as a threshold approaches were the strongest predictors with both achieving
between clear separation and overlapped, unusable samples. approximately 85% accuracy. Mel-frequency in MFCC refers
Some windows without sufficient information, such as tail to the melodic scale used to attune audio to match how it
ends of a signal (representing less than 5% of the length of the is processed by the human ear. The simplest form of this is
sample), were discarded. This created approximately 700 bee- expressed as
in to 600 bee-out signals.
To generate more data, augmentation approaches were F
Fm = C ∗ log10 1 + (8)
investigated. These included adding artificial noise, time- D
shifting, and pitch shifting. The sensitive, RF nature of our where Fm is the Mel-frequency of natural frequency F, the
data meant that noise and pitch alteration could not be enacted constant (C) is 2595, and the denominator (D) is 700 in the
without compromising the ability for predictions, and thus, original equation.
time-shifting was used. Though this gave relatively reliable results, it has little
As each signal was 0.4 s long, shifting could be affected at to do with MFCCs original use of approximating human
0.1, 0.2, and 0.3 s, allowing for a fourfold volume increase, ear perceived frequency. Our data were from the radar and,
in addition to balancing the dataset. Support vector machine while stored as audio, did not represent physical sound. The
(SVM), random forest, and NN were learning algorithms to two primary parameters of the equation (the constant and
generate the augmented dataset [37], [38], [39]. A standard the denominator) allowed for tuning and subsequent impact
train-test split ratio of 4:1 was used, with the NN tak- assessment on the final algorithm precision.
ing an additional 10% of the training data as a validation The parameters were changed to 1250 for C and 175 for
set. D as a test point. These were chosen to maintain the new
Data quantized by the above methodologies were much curve close to the original MFCC curve but emphasized
smaller than spectrogram images and therefore did not need frequencies below 500 Hz, where most activity was observed.
the raw predictive power associated with MobileNet’s capa- The resulting estimate is demonstrated in Fig. 6(a) and resulted
bilities. A smaller sequential model was chosen, using two in a 2% accuracy improvement for the random forest model.
densely connected layers of 32 neurons each, activated by At each point, the random forest was retrained and tested on
a scaled exponential linear unit (SELU) function. Although the data five times, with each iteration having a bootstrapped
rectified linear unit (RELU) was first used as an activation randomized copy of the data. This ensured that only a mean
function, we noted that SELU performed slightly better across accuracy was used, and the results would be replicable. The
all datasets. This difference was small (<2% accuracy) but generated grid gave a clear indication of the optimal parame-
significant enough to warrant the change. The final layer had ters to be used as demonstrated in Fig. 6(b), though it is noted
a dropout rate of 0.5 to minimize risk of overfitting from the that Fig. 6(b) has been smoothed via a Gaussian filter to allow
smaller than ideal number of samples. improved parsing. The results suggest that the best parameters
The model itself was optimized using the Adam algo- in our case were a constant (C) of 2325 and a denominator
rithm due to the number of parameters (∼1400 in the of 260 (D).
case of the MFCC/bee-frequency Cepstral coefficient (BFCC) When these parameters were returned into the equation for
approach) [40]. Larger networks were also tried, both increas- testing, it showed an increased accuracy of 91.1%, an improve-
ing the layer and neuron count, but it was found that the ment even on the more computationally expensive spectrogram
network quickly reached a point of overfitting even when approach. The hyperparameters found to achieve these results
increasing the dropout rate significantly. were 900 estimators, entropy as a split criterion, and the
For comparison, the random forest and SVM used runtime square root of total feature count being used as a baseline
hyperparameter tuning. For each data quantization method, when looking for the best split. A full breakdown of results
the hyperparameters were chosen via Bayesian optimiza- including all algorithms used alongside each quantization
tion, which was done on fourfold cross-validation with each method is presented in Table II. The strength of this BFCC
cross-validator running five times. The random forest used technique is that the original experiment can now serve as a
values from the following possible hyperparameters: testbed for when the dataset size is increased. Sample points
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
TABLE II
ACCURACY AND L OSS B REAKDOWN FOR D IFFERENT L EARNING
A LGORITHM AND C LASSIFICATION A PPROACH
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
not only assist bee farms in hive surveillance tasks; it would [21] E. Feuerbacher, J. H. Fewell, S. P. Roberts, E. F. Smith, and
also empower soft fruit industry stakeholders with innovative J. F. Harrison, “Effects of load type (pollen or nectar) and load mass
on hovering metabolic rate and mechanical power output in the honey
means to monitor biological pollinator behavior and efficiency beeApis mellifera,” J. Experim. Biol., vol. 206, no. 11, pp. 1855–1865,
at relevant locations and/or the impact of specific flower Jun. 2003, doi: 10.1242/jeb.00347.
patches and polytunnels settings to increase the overall yield. [22] J. Kim, M. Jung, H. G. Kim, and D.-H. Lee, “Potential of harmonic
radar system for use on five economically important insects: Radar
R EFERENCES tag attachment on insects and its impact on flight capacity,” J. Asia–
Pacific Entomology, vol. 19, no. 2, pp. 371–375, Jun. 2016, doi:
10.1016/j.aspen.2016.03.013.
[1] C. A. Hallmann et al., “More than 75 percent decline over 27
[23] H. Aumann, B. Payal, N. W. Emanetoglu, and F. Drummond, “An index
years in total flying insect biomass in protected areas,” PLoS ONE,
for assessing the foraging activities of honeybees with a Doppler sensor,”
vol. 12, no. 10, Oct. 2017, Art. no. e0185809, doi: 10.1371/jour-
in Proc. IEEE Sensors Appl. Symp. (SAS), Mar. 2017, pp. 7–11, doi:
nal.pone.0185809.
10.1109/SAS.2017.7894090.
[2] F. Sánchez-Bayo and K. A. G. Wyckhuys, “Worldwide decline of the
entomofauna: A review of its drivers,” Biol. Conservation, vol. 232, [24] R. Hajovsky, A. Deam, and A. LaGrone, “Radar reflections from
pp. 8–27, Apr. 2019, doi: 10.1016/j.biocon.2019.01.020. insects in the lower atmosphere,” IEEE Trans. Antennas Propag.,
[3] D. H. Morse, “The insectivorous bird as an adaptive strategy,” Annu. vol. AP-14, no. 2, pp. 224–227, Mar. 1966, doi: 10.1109/TAP.1966.
Rev. Ecology Systematics, vol. 2, no. 1, pp. 177–200, Nov. 1971, doi: 1138665.
10.1146/annurev.es.02.110171.001141. [25] H. M. Aumann, “A technique for measuring the RCS of free-flying
[4] E. Öckinger and H. G. Smith, “Semi-natural grasslands as population honeybees with a 24 GHz CW Doppler radar,” in Proc. 12th Eur. Conf.
sources for pollinating insects in agricultural landscapes,” J. Appl. Antennas Propag. (EuCAP), 2018, pp. 1–4, doi: 10.1049/cp.2018.0540.
Ecology, vol. 44, no. 1, pp. 50–59, Nov. 2006, doi: 10.1111/j.1365- [26] W. W. Wolf, C. R. Vaughn, R. Harris, and G. M. Loper, “Insect
2664.2006.01250.x. radar cross-sections for aerial density measurements and target clas-
[5] J. Ollerton, R. Winfree, and S. Tarrant, “How many flowering plants are sification,” Trans. ASAE, vol. 36, no. 3, pp. 949–954, 1993, doi:
pollinated by animals?” Oikos, vol. 120, no. 3, pp. 321–326, Mar. 2011, 10.13031/2013.28420.
doi: 10.1111/j.1600-0706.2010.18644.x. [27] N. Aldabashi, S. Williams, A. Eltokhy, E. Palmer, P. Cross, and
[6] L. H. Yang and C. Gratton, “Insects as drivers of ecosystem pro- C. Palego, “Integration of 5.8 GHz Doppler radar and machine
cesses,” Current Opinion Insect Sci., vol. 2, pp. 26–32, Aug. 2014, doi: learning for automated honeybee hive surveillance and logging,” in
10.1016/j.cois.2014.06.004. IEEE MTT-S Int. Microw. Symp. Dig., Jun. 2021, pp. 625–628, doi:
[7] The Regional Report for Africa on Pollinators and Pollination and Food 10.1109/IMS19712.2021.9574826.
Production, IPBES and FAO, Bonn, Germany, 2016, pp. 1–49. [28] R2018A, MATLAB, MathWorks, Natick, MA, USA, 2018.
[8] A.-M. Klein et al., “Importance of pollinators in changing landscapes
for world crops,” Proc. Roy. Soc. B, Biol. Sci., vol. 274, no. 1608, [29] V. C. Chen, F. Li, S.-S. Ho, and H. Wechsler, “Micro-Doppler effect
pp. 303–313, 2007, doi: 10.1098/rspb.2006.3721. in radar: Phenomenon, model, and simulation study,” IEEE Trans.
[9] N. Carreck and I. Williams, “The economic value of bees in the Aerosp. Electron. Syst., vol. 42, no. 1, pp. 2–21, Jan. 2006, doi:
UK,” Bee World, vol. 79, no. 3, pp. 115–123, Jan. 1998, doi: 10.1109/TAES.2006.1603402.
10.1080/0005772X.1998.11099393. [30] M. J. King, S. L. Buchmann, and H. Spangler, “Activity of asynchronous
[10] S. G. Potts, J. C. Biesmeijer, C. Kremen, P. Neumann, O. Schweiger, and flight muscle from two bee families during sonication (buzzing),”
W. E. Kunin, “Global pollinator declines: Trends, impacts and drivers,” J. Experim. Biol., vol. 199, no. 10, pp. 2317–2321, Oct. 1996.
Trends Ecology Evol., vol. 25, no. 6, pp. 345–353, Jun. 2010, doi: [31] M. A. Jankauski, “Measuring the frequency response of the honey-
10.1016/j.tree.2010.01.007. bee thorax,” Bioinspiration Biomimetics, vol. 15, no. 4, 2020, doi:
[11] T. H. Ricketts et al., “Landscape effects on crop pollination services: 10.1088/1748-3190/ab835b.
Are there general patterns?” Ecology Lett., vol. 11, no. 5, pp. 499–515, [32] A. B. Carlson, Communication Systems, 3rd ed. New York, NY, USA:
May 2008, doi: 10.1111/j.1461-0248.2008.01157.x. McGraw-Hill, 2000.
[12] G. Kairo et al., “Nosema ceranae, fipronil and their combination compro- [33] F. Itakura, “Line spectrum representation of linear predictor coefficients
mise honey bee reproduction via changes in male physiology,” Sci. Rep., of speech signals,” J. Acoust. Soc. Amer., vol. 57, no. S1, p. S35,
vol. 7, no. 1, pp. 1–14, Aug. 2017, doi: 10.1038/s41598-017-08380-5. Apr. 1975, doi: 10.1121/1.1995189.
[13] S. S. Schneider and L. C. McNally, “Factors influencing seasonal
[34] D. O’Shaughnessy, “Linear predictive coding,” IEEE Potentials, vol. 7,
absconding in colonies of the African honey bee,Apis mellifera scutel-
no. 1, pp. 29–32, Feb. 1988, doi: 10.1109/45.1890.
lata,” Insectes Sociaux, vol. 39, no. 4, pp. 403–423, 1992, doi:
10.1007/BF01240624. [35] R. Vergin, D. O’Shaughnessy, and A. Farhat, “Generalized mel fre-
[14] J. L. Woodgate et al., “Harmonic radar tracking reveals that honeybee quency cepstral coefficients for large-vocabulary speaker-independent
drones navigate between multiple aerial leks,” iScience, vol. 24, no. 6, continuous-speech recognition,” IEEE Trans. Speech Audio Process.,
Jun. 2021, Art. no. 102499, doi: 10.1016/j.isci.2021.102499. vol. 7, no. 5, pp. 525–532, Sep. 1999, doi: 10.1109/89.784104.
[15] J. Shearwood et al., “C-band telemetry of insect pollinators using [36] M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen,
a miniature transmitter and a self-piloted drone,” IEEE Trans. “MobileNetV2: Inverted residuals and linear bottlenecks,” in Proc.
Microw. Theory Techn., vol. 69, no. 1, pp. 938–946, Jan. 2021, doi: IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2018,
10.1109/TMTT.2020.3034323. pp. 4510–4520, doi: 10.1109/CVPR.2018.00474.
[16] J. Shearwood, D. M. Y. Hung, P. Cross, S. Preston, and C. Palego, [37] L. Breiman, “Random forests,” Mach. Learn., vol. 45, no. 1, pp. 5–32,
“Honey-bee localization using an energy harvesting device and power 2001, doi: 10.1023/A:1010933404324.
based angle of arrival estimation,” in IEEE MTT-S Int. Microw. Symp. [38] G. Klambauer, T. Unterthiner, A. Mayr, and S. Hochreiter, “Self-
Dig., Jun. 2018, pp. 957–960, doi: 10.1109/MWSYM.2018.8439173. normalizing neural networks,” in Proc. Adv. Neural Inf. Process. Syst.,
[17] A. Zacepins, V. Brusbardis, J. Meitalovs, and E. Stalidzans, “Challenges 2017, pp. 1–10.
in the development of precision beekeeping,” Biosystems Eng., vol. 130,
pp. 60–71, Feb. 2015, doi: 10.1016/j.biosystemseng.2014.12.001. [39] H. Drucker, C. J. C. Burges, L. Kaufman, A. Smola, and V. Vapnik,
[18] M. Hagen, M. Wikelski, and W. D. Kissling, “Space use of bumblebees “Support vector regression machines,” in Proc. Adv. Neural Inf. Process.
(Bombus spp.) revealed by radio-tracking,” PLoS ONE, vol. 6, no. 5, Syst., vol. 9, 1997, pp. 1–7.
May 2011, Art. no. e19997, doi: 10.1371/journal.pone.0019997. [40] D. P. Kingma and J. L. Ba, “Adam: A method for stochastic opti-
[19] J. L. Woodgate, J. C. Makinson, K. S. Lim, A. M. Reynolds, and mization,” in Proc. 3rd Int. Conf. Learn. Represent. (ICLR), 2015,
L. Chittka, “Life-long radar tracking of bumblebees,” PLoS ONE, pp. 1–15.
vol. 11, no. 8, pp. 1–22, 2016, doi: 10.1371/journal.pone.0160333. [41] E. A. Capaldi et al., “Ontogeny of orientation flight in the honeybee
[20] A. M. Reynolds, J. L. Swain, A. D. Smith, A. P. Martin, and revealed by harmonic radar,” Nature, vol. 403, no. 6769, pp. 537–540,
J. L. Osborne, “Honeybees use a Lévy flight search strategy and odour- Feb. 2000, doi: 10.1038/35000564.
mediated anemotaxis to relocate food sources,” Behav. Ecology Socio- [42] K. B. Duan and S. S. Keerthi, “Which is the best multiclass SVM
biology, vol. 64, no. 1, pp. 115–123, Nov. 2009, doi: 10.1007/s00265- method? An empirical study,” in Proc. Int. Workshop Multiple Classifier
009-0826-2. Syst., 2005, pp. 278–285, doi: 10.1007/11494683_28.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
Nawaf Aldabashi (Member, IEEE) received the Edward Palmer is currently the Group Technical
B.Eng. degree in computer systems engineering Director and the Business Development Manager
and the M.Sc. degree in electronic engineering and also leads the Research and Development Team,
from Bangor University, Bangor, U.K., in 2013 and S&A Produce UK Ltd., Hereford, U.K. He has
2016, respectively, where he is currently pursuing extensive experience in all areas of agriculture
the Ph.D. degree at the Department of Electronic having driven market outperformance with leading
Engineering. global retailers. He is currently pioneering and lead-
His research interests are the design, integration, ing other innovative and industry-leading projects
and application of continuous wave and frequency- around robotics and clear sustainable plant-based
modulated continuous-wave radar in addition to nan- packaging solutions. He is a Key Advocate for
otechnology and microfabrication. accurate tracking technology which allows bees to
behave as naturally as possible, while promoting investigation of human
impact and cohabitation strategies.
Authorized licensed use limited to: ANNA UNIVERSITY. Downloaded on June 06,2023 at 03:26:49 UTC from IEEE Xplore. Restrictions apply.