Professional Documents
Culture Documents
Abstract
Crop yield is made by several components, like genotype, climate, and actions.
Therefore, it's necessary to understand the dependence between yield and other
variables, and to come up with accurate predictions requires big data and well-
developed algorithms. In this study, a machine learning-based model is developed to
predict crops. The paper has proposed a machine learning algorithm, i.e., GATE-Neural
Network, which is implemented by using the three features vectors such as
Standardized Precipitation Index (SPI), Vegetation Condition Index (VCI) and
Normalized Difference Vegetation Index (NDVI). The model is also compared with the
Spiking Neural Network and has achieved the prediction accuracy of 95.005%, which
is much better than the other states of the art algorithms. The parameters used for the
evaluation of the proposed model other than accuracy are MBE (Mean Bias Error),
MAE (Mean Absolute Error), RMSE (Root Mean Square Error), Time etc. GATE-
Neural Network model has achieved better results than other existing models in terms
of these evaluation parameters.
1. Introduction
2. Literature Survey
Predicting crop yield is extremely relevant to farmers and local authorities at the
national and regional levels. A yield for crop analysis model can dramatically boost
agriculturalist decisions. There are various methods for forecasting crop yields. This
section will explore the use of ML in yield for crop analysis. Chlingaryan et al. [10] did
an article on machine learning methods to estimate nitrogen status. The article
concludes that automation and machine learning can create new technical solutions that
will be cost-effective for agriculture. Elavarasan et al. [11] conducted a publication
survey of ML models on yield for crop analysis correlated with environmental
parameters. The paper suggests creating a broader scope to review yield. A
documentary exploring the application of ML in agriculture industries was released
recently. The study analyzed the literature on crops, animals, water, and soil
conservation.
Li et al. [12] have done comprehensive research for ripeness points to
determine the optimal harvest time and prediction of the yield. Mayuri and Priya [13]
discussed the agricultural applications and the difficulties faced in image processing
and machine learning in the management of plant diseases. Somvanshi and Mishra [14]
explored various machine learning techniques and their plant biology applications.
Gandhi and Armstrong on agricultural sectors carried out an analysis of data mining
applications. They concluded that more research needs to be done before data mining
becomes realistic for handling the sizeable agricultural data sets [15]. Beulah found that
using data mining, the project of crop yield prediction could be solved [16].
Chen and Cournede [17] focus are on determining how best to predict maize yield
from the weather. Liakos et al. [18] describes the use of agricultural machinery learning
and the artificial neural networks was applied in this work. This study has shown that
machine learning models are used in several fields, mainly in crop production and
management decisions.
Priya et al [19] discuss about using the random forest algorithm to predict and
improve crop yields. For yield production, a random forest algorithm was used using a
four-character or parameter dataset. Training set for the training of the algorithm rules
applied to the remainder of the data sets. The results demonstrated that the random
forest algorithm allows us to achieve a precise crop yield prediction. The Random
Forest Algorithm achieves the lowest model crop yield models. In agricultural planning,
it is suitable for large crop yield prediction.
Table 1. Comprehensive table of literature Survey
Author Year Methodology Limitations
3. Proposed Scheme
In this section, the focus is on the proposed model i.e., GATE Neural Network, this has
also covered the spiking neural network and the comparison of the spiking neural
network with the GATE neural network.
Pritam Bose and his students developed the first SNN model for crop yield
estimation [23]. The study used both remote sensing and Landsat to monitor the crops
and land use changes that were taking place during the study period and produced a
report on its results.
3.1.1. Spiking Neuron Model
It is assumed that the time of spikes instead of the type of spikes carries information
in the overriding majority of spiking neurons. Thus, splitting neurons and efficient
neuronal synapses contribute to contemporary thought, choice and learning.
The unit of the SNN is the neuron, which is created to be the one similar to
biological. This neuron processes the information that had arrived from the pre-synaptic
neurons (PrSyN) and it sends the train of spikes (sequence of spikes) to the postsynaptic
neurons (PoSyN) through the axon. The probability that the neuron will fire increases
with the increasing of the membrane potential: here we say that a spike is to be
generated, only if the membrane potential reaches a threshold (called spike threshold)
[24].
.
Figure 1: Representation of an action potential
From the above figure 1, we can see that the approximate plotting of a neuron's spike.
The depolarization occurs when the input stimulus is higher enough to reach the spike
threshold. When this happens, the action potential rises and, until the ending of the
repolarization, the neuron is in the absolute refractory period, in which it cannot fire
again. When the repolarization state gets over the crossing of the resting potential, the
hyperpolarization starts where it is more difficult that the neuron fires, but it is possible.
This time period is called the relative refractory period. In the end, the cell returns to
resting potential.
Some of the neuron models are as mentioned below:
1. Hodgking-Huxley (HH) [25]
2. Leaky integrate-and-fire (LIF) [26]
3. Spike response (SRM)
4. Izhikevich neuron (IZK)
In this work we have used the LIF neuron model as taken in the previous work [23].
3.1.2 Spiking Neural Network Components
Leaky-Integrate-and-Fire neurons and plastic synapses are fundamental units of the
SNNs and are also biologically feasible computational elements. The dynamics of LIF
Here
. The input current, I(t), is a weighted summation of pre-spikes at each time stage and
is given by.
𝑛𝑙
Here
here
neuron, θi(t − tk),, the effect of each pre-spike is modified by the associated synaptic
weight (wi). Remember, there is no name for the units. The input current is built into
the post-neuronal membrane potential (Vmem), which leaks with time constant
exponential over time. The neuron produces a pulse and adjusts its membrane potential
to previous state if the membrane potential reaches a threshold (Vth). The Fig. 2 gives
Notations Meaning
𝜣 Spike even
𝑥 Sum of pre-spike events over time
𝑤 Synaptic wright
𝑉𝑚𝑒𝑚 Membrane potential
𝑉𝑡ℎ Neuronal firing threshold
𝐼 Input current at each time step
𝑛𝑒𝑡 Total current influx over time
𝑎 Activation of spiking neuron
E Loss function
δ Error Gradient
3.2 SNN for Crop Yield prediction
These models successfully identify and forecast the crop yield. The training and
testing algorithms work according to the need efficiently. To remedy the problems, we
must take three-step solution.
The first step involved transforming the digital image into vectors so that any
vectors became an image candidate for a row pixel. The software chain was integrated
into several parts in the second phase to perform the reduction in image size. A small
amount of the image is specified in every element in an array. The training layer
includes learning, output spike firing, and a win-take-all network rivalry through
inhibitory neuron modification. Moreover, a mathematical model is applied to deal with
ambiguity from related circumstances.
The architecture of SNN is shown as in Fig. 3, which basically includes the three
components, first is a neural spike generator, second is the segmentation of image, and
third is the learning phase and output pattern generation. The brief and implementation
process is being explained further.
Pre-Processing:
First and Second Layers
First Layer
N- N-
1 ….. K-1 K K+1 K+2 2K-1 2K
K+1 K+2
N
STDP
Third Layer
Inhibition
Class label
3.4 Brief explanation for Training and testing for yield prediction of
wheat crop in the selected region for this work was performed
using SNN
The study has proposed the hybrid model termed as GATE Neural Network that is
combination of Genetic Algorithm, teaching learning-based optimization (TLBO)
algorithms and Error Back propogation algorithm.
The proposed model’s block diagram is shown in figure 4. The proposed model
consists of certain steps such as generating the population, iterative steps, teacher and
student phase, cluster representation and finally the neural network. Let discuss these
steps in details:
1. Generate Population: The population is generated by using the features contained
in the dataset.
2. Iterate: The iteration process is done across the generated population
3. Teaching–learning-based optimization: The sampled population is passed through
teaching learning-based optimization algorithm. In this algorithm two important phases
are there; one is student phase and the other one is teacher phase.
(i) Teacher Phase
Suppose we have two classes of curves, curve 1 and curve 2. MA andMB represents
the mean marks obtained by the learners for the curve 1 and curve 2 respectively.
According to a good teacher, the average class increases fromMA toMB , good teacher is
someone who brings its students to their knowledge level. However, in practice this is
not possible and only depending on the capacity of the class can a teacher move the
mean of one class to a certain extent [28]. This takes place at random depending on a
number of factors.
Let Ax be the average, and the teacherTx at any iteration x. Tx tries to pull the
Ax to its side. The solution is updated according to the difference between the new
average Anew and the existing average.
Mean_Differencex = ri (Anew − Tf Ax )
Next the updation of the problem is done by:
Pnew,x = Pold,x + Mean_Differencex
Figure 5: Comparative graph between SNN and GATE-NN in terms of wheat crop
yield prediction.
Table 5: Comparative table between SNN and GATE-NN in terms of RMSE
9000
8000
7000
6000
5000
4000
3000
2000
1000
0
2013 2014 2015 2016 2017
SNN 4531.126423 3862.979352 2881.659039 8868.785924 3129.080252
GATE-NN 248.983 297.9 1184.668 4752.328 2826.788
SNN GATE-NN
2013 19.71563596
23.99743
2014 2.327384366
4.994911
2015 15.72708239
12.18321
2016 74.00155903
41.11097
2017 7.649597 46.41320393
Table 7: Comparative table between SNN and GATE-NN in terms of Training Time
Improvement comparison in
Year Training Time
Percentage
SNN GATE-NN SNN& GATE-NN
0.25
0.2
0.15
0.1
0.05
0
2013 2014 2015 2016 2017
SNN 0.0013785 0.0013558 0.0012949 0.001226 0.0012394
GATE-NN 0.183717 0.240022 0.237696 0.082106 0.161405
SNN GATE-NN
Hence by using the one feature vector value: NDVI, the GATE-NN performed better
than SNN in terms of execution time taken and the wheat crop yield prediction.
3.5.2 The training and testing of the data was found on the following
parameters R, RE, RSME, MAE, MBE, time taken and wheat crop yield
prediction and % of efficiency using 3 features- NDVI, VCI and SPI.
3.5.2.1 Comparison of results of SNN with GATE-NN obtained using three
feature values (NDVI, VCI, SPI):
i. Comparison between SNN and GATE-NN in terms of yield
prediction
Table 9 : Comparison between SNN and GATE-NN in terms of yield prediction in metric tonnes
Years Truth Ground Value SNN GATE-NN
2013 12937 21219.6 14378.27
2014 17103.9 21593.9 14183.69
2015 17688.7 25413.5 14413.96
2016 17939.33 20126.5 14084.82
2017 15910.8 20951.7 14307.84
26.25147876
2014 1.741708032
43.67121726
2015 6.697324714
12.19198
2016 26.49111
31.68207552
2017 17.76648649
60
50
40
30
20
10
0
2013 2014 2015 2016 2017
SNN 64.02253441 26.25147876 43.67121726 12.19198 31.68207552
GATE-NN 1.924578 1.741708 6.697325 26.49111 17.76649
SNN GATE-NN
Figure 11: Comparative graph between SNN and GATE-NN in terms of RE
Table 12. Comparative table between SNN and GATE-NN in terms of Training Time
0.25
0.2
0.15
0.1
0.05
0
2013 2014 2015 2016 2017
CNN 0.2005263 0.2606407 0.261101 0.10418 0.1898385
GATE-NN 0.183717 0.240022 0.237696 0.082106 0.161405
CNN GATE-NN
Figure 12: Comparative graph between SNN and GATE-NN in terms of Training
Time
4. Discussion
This study has proposed a method for crop yield production. The method used for
yielding the crop is based on the deep learning models. Mainly neural networks
are used with different layers, and the neurons with different weights are
implemented. There are 3 different types of datasets used while building the
model, and neural networks such as Spiking Neural Network and Gate Neural
Network are applied to the particular dataset to perform the analysis. Furthermore,
different parameters are used to evaluate the models, such as training and testing
time, accuracy, precision and many more.
In this paper, the understanding of SNN for crop yield prediction was
done through explaining steps, diagrams. The work was also tried to make
understandable through step-by-step explanation. The results obtained from SNN using
NDVI alone and then by using NDVI, VCI and SPI values were then compared with
GATE-NN in terms of evaluation parameters. From the results obtained and that are
shown in tables and in the analytical graphs, it is concluded that the proposed GATE-
NN has improved results in all terms of evaluation parameters, from crop yield
prediction to execution time, specially using three feature vector value input. Results
has indicated that the value obtained for RMSE and RE value of GATE-NN is lesser as
compared SNN except for year 2016. Hence the proposed GATE-NN performed better
than SNN.
Nowadays, capsule convolutional neural network has also used for the analysis
purpose. So, in the future work, the crop prediction can also be done with the help of
capsule network and it might happen that it can generate good prediction accuracy as
compared to GATE Neural Network.
It has been observed from table 4 that, the proposed GATE-NN
developed for crop yield prediction using three features works well as
compared to the previous method SNN. From table 4, it is observed that
the RMSE value of GATE-NN is also found to be less for every test year.
Similarly, from table 6, it is observed that the RE value of GATE-NN is
also found to be less.
Next, the results obtained by the use of three feature vector value
(NDVI, VCI and SPI), the proposed GATE-NN performed better than
SNN in almost all the evaluation parameters and the close results to truth
value of crop production was found using GATE-NN. The execution
time was also found to be lesser in GATE-NN.
Also, a comparison of results in terms of Crop yield
predicted values was done for GATE-NN using single feature and three
features. It was found the proposed GATE-NN when implemented with
three featured values performed better. In the future some more
implementation will be done on crop image dataset using different types
of Convolution Neural Network algorithms, Currently, images are
mostly used for the analysis purpose, so in the future we will also focus
on the image analysis through deep learning models.
Acknowledgements
We are very thankful to RGPV and Vellore Institute of Technology for their
continuous support and encouragement.
References
[1] S. Khaki and L. Wang, “Crop yield prediction using deep neural networks,”
Frontiers in Plant Science, 10: 621, 2019, doi: 10.3389/fpls.2019.00621.
[2] N. Heslot, D. Akdemir, M. E. Sorrells, and J. L. Jannink, “Integrating
environmental covariates and crop modeling into the genomic selection
framework to predict genotype by environment interactions,” Theoretical and
Applied Genetics, 127(2):463-80, 2014, doi: 10.1007/s00122-013-2231-5.
[3] J. Burgueño, J. Crossa, P. L. Cornelius, and R. C. Yang, “Using factor analytic
models for joining environments and genotypes without crossover genotype x
environment interaction,” Crop Science, 48(4): 1291-1305, 2008, doi:
10.2135/cropsci2007.11.0632.
[4] J. Burgueño, J. Crossa, J. M. Cotes, F. S. Vicente, and B. Das, “Prediction
assessment of linear mixed models for multienvironment trials,” Crop Science,
51(3): 944-954, 2011, doi: 10.2135/cropsci2010.07.0403.
[5] A. Braun, M. Kohler, and A. Krzyzak, “Analysis of the rate of convergence of
neural network regression estimates which are easy to implement,” arXiv. 2019.
[6] O. Marko et al., “Portfolio optimization for seed selection in diverse weather
scenarios,” PLoS ONE, 12(9): e0184198, 2017, doi:
10.1371/journal.pone.0184198.
[7] Y. Lecun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, 521:436–
4442015. doi: 10.1038/nature14539.
[8] G. M. Gandhi, S. Parthiban, N. Thummalu, and A. Christy, “Ndvi: Vegetation
Change Detection Using Remote Sensing and Gis - A Case Study of Vellore
District,” 57: 1199-1210, 2015. doi: 10.1016/j.procs.2015.07.415.
[9] E. Stromatias, M. Soto, T. Serrano-Gotarredona, and B. Linares-Barranco, “An
event-driven classifier for spiking neural networks fed with synthetic or
dynamic vision sensor data,” Frontiers in Neuroscience, 2017, doi:
10.3389/fnins.2017.00350.
[10] A. Chlingaryan, S. Sukkarieh, and B. Whelan, “Machine learning approaches
for crop yield prediction and nitrogen status estimation in precision agriculture:
A review,” Computers and Electronics in Agriculture. 151: 61-69, 2018. doi:
10.1016/j.compag.2018.05.012.
[11] D. Elavarasan, D. R. Vincent, V. Sharma, A. Y. Zomaya, and K. Srinivasan,
“Forecasting yield by integrating agrarian factors and machine learning models:
A survey,” Computers and Electronics in Agriculture. I55:257-282, 2018. doi:
10.1016/j.compag.2018.10.024.
[12] B. Li, J. Lecourt, and G. Bishop, “Advances in non-destructive early
assessment of fruit ripeness towards defining optimal time of harvest and yield
prediction—a review,” Plants. 7(1):3, 2018. doi: 10.3390/plants7010003.
[13] M. K. P and V. C. Priya, “Role of Image Processing and Machine Learning
Techniques in Disease Recognition, Diagnosis and Yield Prediction of Crops:
a Review,” International Journal of Advanced Research in Computer Science,
9(2), 2018.
[14] P. Somvanshi and B. N. Mishra, “Machine learning techniques in plant
biology,” in PlantOmics: The Omics of Plant Science, 2015. doi: 10.1007/978-
81-322-2172-2_26.
[15] N. Gandhi and L. Armstrong, "Applying data mining techniques to predict yield
of rice in humid subtropical climatic zone of India," 2016 3rd International
Conference on Computing for Sustainable Global Development (INDIACom),
2016, pp. 1901-190.
[16] R. Beulah, “A Survey on Different Data Mining Techniques for Crop Yield
Prediction,” International Journal of Computer Sciences and Engineering,
7(1), 2019, doi: 10.26438/ijcse/v7i1.738744.
[17] X. Chen and P.-H. Cournède, “Model-Driven and Data-Driven Approaches for
Crop Yield Prediction: Analysis and Comparison,” International Journal of
Mathematical and Computational sciences, 11(7), 2017.
[18] K. G. Liakos, P. Busato, D. Moshou, S. Pearson, and D. Bochtis, “Machine
learning in agriculture: A review,” Sensors (Switzerland)., 18(8), 2674, 2018.
doi: 10.3390/s18082674.
[19] Priya, Muthaiah, and Balamurugan, “Predicting yield of the crop using machine
learning algorithms,” International journal of engineering sciences and
reseach technology, 7(4), 2018.
[20] P. J. Ramos, F. A. Prieto, E. C. Montoya, and C. E. Oliveros, “Automatic fruit
count on coffee branches using computer vision,” Computers and Electronics
in Agriculture, 137, 2017, doi: 10.1016/j.compag.2017.03.010.
[21] E. Khosla, R. Dharavath, and R. Priya, “Crop yield prediction using aggregated
rainfall-based modular artificial neural networks and support vector
regression,” Environment, Development and Sustainability, 22(6), 2020, doi:
10.1007/s10668-019-00445-x.
[22] P. Nevavuori, N. Narra, and T. Lipping, “Crop yield prediction with deep
convolutional neural networks,” Computers and Electronics in Agriculture,
163, 2019, doi: 10.1016/j.compag.2019.104859.
[23] P. Bose, N. K. Kasabov, L. Bruzzone and R. N. Hartono, "Spiking Neural
Networks for Crop Yield Estimation Based on Spatiotemporal Analysis of
Image Time Series," in IEEE Transactions on Geoscience and Remote Sensing,
54(11): 6563-6573, Nov. 2016, doi: 10.1109/TGRS.2016.2586602.
[24] L. Wang, H. Wang, L. Yu, and Y. Chen, “Spike-threshold variability originated
from separatrix-crossing in neuronal dynamics,” Scientific Reports, 6, 31719,
2016, doi: 10.1038/srep31719.
[25] P. Vázquez-Guerrero, J. F. Gómez-Aguilar, F. Santamaria, and R. F. Escobar-
Jiménez, “Design of a high-gain observer for the synchronization of chimera
states in neurons coupled with fractional dynamics,” Physica A: Statistical
Mechanics and its Applications, 539:122896, 2020, doi:
10.1016/j.physa.2019.122896.
[26] H. M. Huang et al., “Quasi-Hodgkin–Huxley Neurons with Leaky Integrate-
and-Fire Functions Physically Realized with Memristive Devices,” Advanced
Materials, 31(3), 2019, doi: 10.1002/adma.201803849.
[27] W. Bian and X. Chen, “Smoothing neural network for constrained non-lipschitz
optimization with applications,” IEEE Transactions on Neural Networks and
Learning Systems, 23(3): 13, 2012, doi: 10.1109/TNNLS.2011.2181867.