Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)

IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1

Tomato Leaf Disease Detection using

Convolutional Neural Network with Data
Augmentation
Nithish kannan E, Kaushik M, Prakash P, Ajay R, Veni S
Department of Electronics and Communication Engineering
Amrita School of Engineering, Coimbatore
Amrita Vishwa Vidyapeetham, India
Email: cbekaushik@gmail.com, s_veni@cb.amrita.edu.
Abstract-This project briefs the detection of diseases present in a
tomato leaf using Convolutional Neural Networks (CNNs) which is a
class under a deep neural network. As an initial step, the dataset is
segregated before the detection of tomato leaves. The concept of
transfer learning is used where a pre-trained model (ResNet-50) is
imported and adjusted according to our classification problem. To
increase the quality of the ResNet model and to enhance the result as
close to the actual prevailing disease, data augmentation has been
implemented. Taking all these into consideration, a tomato leaf
disease detection model has been developed using PyTorch that uses
deep - CNNs. Finally, the testing dataset is processed for validation
based on the learned parameters from the ResNet 50 model. Six most
prevailing diseases in tomato crops have been taken for
classification. Data augmentation has been introduced to increase the
data set to 4 times the actual data and the model has shown an
accuracy of 97%.
Key Words - Convolutional Neural Networks (CNN),
Classification, deep learning, Data Augmentation, ResNet 50,
Tomato Leaf Diseases.
I.INTRODUCTION
Diseases caused in plants can alter the whole social,
economic, and ecological balance and directly affect agriculture.
In India, Tomato is the most widely used crop, so early detection
of the disease is essential to increase the cultivation. Plant disease
if undetected or left uncured soon enough, can bring significant
loss for the farmer. Effective disease management includes a vital
step of early detection of disease and treating in natural ways.
Detecting and classifying diseases in an exact and timely manner
is of high importance.
Early Blight is caused by fungi Alternaria Tomatophila and A.
Solani in tomatoes present on the foliage at any stage of the
growth cycle. Characteristics of this disease are irregular lesions
near the ground, expanding yellow-colored spots become dark
with concentric black rings and may have a chlorotic area around
the lesion. This disease kills all the foliage and spreads faster to
other crops.
Septoria Leaf Spot is caused by fungus Septoria Lycopersici.
Characteristics of this disease are small circular water-soaked
spots; these spots enlarge with brown and black borders and with
gray centers that are covered with small black fruiting bodies.
This affects the strength of the plant and decreases the size and
quality of the fruit.
Bacterial Spot is caused by bacteria Xanthomonas Vesicatoria,
small dark brown colored and as well as black colored circular
Spots, water-soaked, and become angular and it may have a
yellow halo. This disease damages fruit and leaves in the plant.
Tomato Yellow Leaf Curl Virus is not a seed-borne but this is
also
transmitted by whiteflies. The plant exhibits upward and inward
rolling of leaf margins, leaflets turning yellow, smaller leaf than
normal, dropping off flowers, and raised to scabby spots. There
may be no fruit formation.
Tomato Mosaic virus causes the leaves to fall at a premature
stage. The distorting leaflets, the formation of tiny leaves, leaves
turning yellow, and systemic necrotic patterns are formed.
Growth and the quality of fruit are affected.
The rate of success achieved in deep learning is much higher than
machine learning in many models. Deep learning is favored in the
case of classifying big data sets with its advantage of providing
faster results efficiently. Machine learning is also used in similar
image classification applications, however, the input images
should undergo preprocessing where images can either be in
grayscale or some color scheme like RGB.
In the proposed work, a deep learning technique is used
which has a built-in preprocessing stage known as transform and
augmentation. This technique improves the generalization
performance of the model eradicating the chances of overfitting.
Besides, transfer learning is also used which adds extra benefit to
the model. Moreover, it also has more optimization options to fit
the model to the required target. The proposed model yields 97%
accuracy after fine-tuning the weights for the ResNet model. The

978-1-7281-5371-1/20/$31.00 ©2020 IEEE 1125

Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
 Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)
IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1
pre-trained ResNet 50 architecture with 50 layers is used. In the
first 49 layers, all the activations of the network are kept as such
and only the last layer is modified for the proposed system. This
model presents satisfying results with less time for training and
tuning parameters. The system specification used for this model is
Intel(R) Core(TM) i7-8750 processor clocked at 2.2GHz, 16GB
RAM with a dedicated 4 GB NVIDIA GeForce GTX 1050 Ti
graphics card and 250GB of SSD. A good model is the one which
is small in size, has low errors, and also less CPU and GPU
inference time. In comparison to various models like VGG-19,
AlexNet, ResNet25, GoogleNet, ResNet18, etc., ResNet50 is
powerful and has the quality of a good pretrained model as
mentioned above.
The paper is briefed in the remaining sections as follows.
Section I states about the introduction. Section II elaborates
related work addressed by various researchers. Section III reviews
concepts such as CNN, resnet, and data augmentation. Section IV
describes the methodology. Section V deals with results and
discussions. Section VI talks about future work. References are
given in section VII.
II.RELATED WORKS
Melike Sardogan [1], designed a CNN for automatic feature
extraction as well as classification. They used a learning vector
Quantization (LVQ) for plant disease detection where the data set
Contained 500 images of diseased tomatoes. Supervised learning
neural networks are used as an algorithm that uses a competitive
learning strategy. To improve accuracy, a slight change in the
CNN model called LeNet is used to detect and classify different
diseases in tomato leaves.
Transfer learning which is a machine learning technique
is used for pre-training the model where new classes are
classified. When the pre-trained models of AlexNet and VGG16
net were put to test with a dataset of approximately 13,000 images,
the accuracy obtained was 97.29% for VGG16 and 97.49% for
AlexNet. These models classify objects into 1000 categories with the
provided augmented data sets [2].
Image processing which on top of deep learning has
numerous intakes of data, raising the stakes of time and cost. This
process is exhausting and in some cases unfeasible. Kenichi
Kobayashi et.al [3] clarified the relationship between Frechet
inception distance (FID) and diagnostic accuracy. Studies show
that the method of rotation gets the connection between FID and
diagnostic accuracy.
S.Veni et.al. [4], proposed a Computer-Aided model that
can detect and classify diseased brinjal leaves from the healthy
leaves. For thermal and visible light images they used image
processing techniques to classify between healthy leaves and a
diseased Solanum Melongena (brinjal) leaves. Datasets are
collected using Thermal and RGB cameras. With colour and
temperature as features, they obtained 90.9% accuracy with SVM
and 89.1% with ANN. From this experiment, they have proved
that SVM has high accuracy when compared to ANN.
Jiachun Liu [5], proposed an idea of classification of
978-1-7281-5371-1/20/$31.00 ©2020 IEEE
Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
plant leaf by using ten-layer CNN. In this system, a ten-layer
CNN was created for the classification of the plant leaf. The
results on a dataset of Flavia leaf with 4,800 images and 32 kinds
gave the overall 87.92% accuracy. Neural network leads to
automatic feature extraction which aids the classification of the
input dataset leaf image into its respective independent classes
with an accuracy of 94-95%.
Peng Jiang Jiang et.al. [6] implemented a real-time
detection model of an apple leaf disease using an improved deep
convolutional neural network. GoogLeNet Inception structure and
Rainbow concatenation introduced as a training model. In real-
time, this approach can automatically extract features and be able
to identify five types of disease classes with high accuracy.
Hoo-Chang Shin [7], the study of this paper gave three
important steps of implementing deep convolutional neural
networks by introducing a computer-aided detection system that
solves the lung disease such as thoraco-abdominal lymph node
and interstitial lung disease. This system studies and evaluates
different models of CNN architectures. The next step is to
evaluate the dataset scale and performance of the spatial image.
The last step is to introduce transfer learning from pretrained
ImageNet by using fine-tuning. The result of this study shows that
it achieves 85% accuracy at 3 false positives per patient in the
mediastinal LN detection.
Fatih Ertam and Galip AydÕn [8], compared the effects
of multiple activation functions such as tanH, ReLu, sigmoid,
soft plus on classification. ReLu activation function has a high
accurate classification rate and this has achieved 98.43%
accuracy. This experiment results show that an increase in the
number of iterations or epochs leads to an increase in the
accuracy values.
The Automated Image capturing system is studied and
implemented by [9] Robert G. de Luna. to identify the Tomato
leaf diseases such as Phoma Rot, Target Spot, Leaf Miner, and
healthy leaves with 4,923 dataset images. By using Transfer
learning this model has achieved 95.75% accuracy whereas,
another system of automated capturing of images has achieved
91.67% accuracy in identifying different diseases of the tomato
plant leaf.
Santhana Hari [10], proposed a new model of CNN
called the Plant Disease Detection Neural Network ( PDDNN).
This model was used to extract certain features from the leaf
images of different crops. The 16-layered CNN network with
32*32 filters, dropout, and max pool layers have achieved an
overall higher accuracy. With a dataset of augmented 14810
images, the accuracy achieved was 86%. The results were
compared with a Mobilenet 50 network where the PDDNN model
had increased accuracy by nearly 7%.
A deep learning approach on MRI images of brain
cancer using residual networks was implemented by Sarah Ali
Abdelaziz Ismael [11] and he has proposed an approach for
classifying different types of brain tumors using Residual
1126
 Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)
IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1
Networks. This approach has achieved 99% accuracy and was
considered to be an excellent result compared to all other previous
works.
Skip-connections in residual networks are explained by
Vinit Bodhwani in [12]. This paper explained the methodology
and implementation of deep learning using residual networks. A
50-layer popularly known as ResNet-50 was used as a deep
residual framework consisting of a total of five stages, which has
been implemented for the large-scale classification of plants.
Skip-connections in residual networks help in the Vanishing
Gradient problem and this leads to 93% accuracy.
The work by Arpan Jain et.al [13] provides an accurate
idea of the characteristics of performances in Deep Learning
Networks such as ResNet and DNN. Comparisons were made
between the CPU configuration such as V100 GPUs, NVIDIA
K80, and P100. Difference between GPU vs CPU helps to
overcome handling large datasets.
Aravinth J et.al. [14], implemented a python-based
project on the classification of the urban objects from HSR-HTIR
data using CNN and Random Forest Classifier. Random Forest
Classifiers have been evaluated on the standard of classification
accuracies. CNN shows high accurate results with a 10% training
dataset and Random Forest classifiers reduced the number of
misclassified pixels. This study shows the performance of
different classifiers based on the dataset and its classification
algorithms.
Transfer learning was done using the ResNet 50 model
[15] for the classification of different types of malware. They use
byte plot grayscale images and have used the pre-trained model
which has been trained on the ImageNet dataset. The weights
have been frozen for the initial layers and the final fully
connected layer has been fine-tuned to adapt to the malware
classification. The model which they built could successfully
classify with the accuracy of 98.62%.
Dr. T. Vijayakumar [16] compares the working and
efficiency of capsule neural networks with convolutional neural
networks.
Capsule neural network recognizes low-quality images by
hierarchically classifying into subsections compared to CNN.
CNN gives no importance for reconstructing damaged structures
that are effectively done by capsule networks. Though with all
these advantages CNN is preferred over capsule neural networks
due to its effective handling capacity of large datasets routing to
higher accuracy.
From the above studies, it was observed that CNN with
the ResNet model was found to be better among other existing
models. Hence, the ResNet model is used to help in training and
to enhance the quality of the result. Also, to improve the result as
close to the actual prevailing disease, data augmentation has been
implemented.
978-1-7281-5371-1/20/$31.00 ©2020 IEEE
Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
III. OVERVIEW
A.Data Augmentation
Data augmentation is a technique used to artificially
amplify the proportions of Training datasets. Large datasets are
important for imposing a deep learning model. However, the
version can be enhanced with the aid of augmentation with the
available data. It will not be wrong to state that artificial
intelligence (AI) has emerged again only due to the provision of
massive computing power (GPUs) and significant quantities of
facts on the Internet [4]. Some of the frequently used
augmentation strategies are scaling, flipping, cropping, rotating,
padding, and translation [10][3]. Different types of augmentation
strategies improve performance since accuracy is increased due to
the above process. Therefore, it is valuable to understand these
functions that can alter the model’s performance. Among the
various augmentation techniques available, shear, scale, translate,
and rotate have a high degree of performance. The augmentation
methods in ascending order of improvements are as follows [3]:
(1) Equalize, Auto Contrast, Invert, Color balance, (2) Rotate, (3)
Translate, Scale and Shear.
B.CNN
Deep Learning, a subgroup of machine learning, works
through a sequence of layers. Each layer’s input is the output of
the preceding layer. The advantages of a deep learning model are
predominantly due to automatic feature extraction and
classification which takes place as a single process. Important
features are acquired through its multi-layered network [1][5][16]
which are the convolutional layer, pooling, activation function
layer, and fully connected(FC) layer. Convolution layer performs
a series of mathematical operations to extract these required
features from the input image. By using filters, a new reduced
image is created by the summation of input image values
multiplied by filter values. A new matrix is generated by using the
input image. Using several pooling functions the output image
size is reduced. Some of the pooling functions include Max
pooling, Average pooling, and L2 norm pooling. The activation
layer acts as a link between the input and the output layers. The
presence of the activation layer affects the overall performance of
the network. ReLU activation function has the most accurate rate
of classification [8] and through this function, negative values are
taken as zero and positive values are taken as one. The fully
connected layer takes the matrix as an input which is the total
output process of convolution, pooling, and activation layers.
C.Residual Network
In recent days, CNN has reached the real-time level of
classification of images. Deep networks extract multi-level
features ranging from low to high and can classify as different
classes. As the number of layers increases the quality of features
also increases. When a neural network tends to converge, issues
1127
 Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)
IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1

such as degradation arise with the increase in the number of

layers and also the saturation of accuracy. The latter issue seems
to contradict the concept of CNN. This problem is due to
overfitting (reaches the highest point of accuracy and degrades) or ×3
underfitting (due to an insufficient number of datasets) or
vanishing gradient problem (when gradients are back propagated Conv3_x 28×28
in deep neural networks repeatedly, it makes gradients very
small). Hence, it is essential to optimize the deep network. ×4
ResNets are easy to optimize whereas plain networks show an
increase in training error with increasing depth. Results have Conv4_x
shown that ResNet gains more accuracy with an increase in depth. 14×14
Plain networks follow the below-given rules -
a. Convolution layers mostly have 3 x 3 filters. ×6
b. Feature map size is nearly halved and to save time
complexity of each layer the number of filters is Conv5_x 7 ×7
doubled.
c. The layers tend to have the exact amount of filters for a
similar output. ×3
Fig. 1 Skip connection seen in Residual Network
1 ×1 average pool, 1000_d fc,
With the neural network going deeper, dataset training softmax
becomes more and more difficult. This problem is eradicated
when a residual network is used. The most unique property of FLOPS 3.8× 109
Resnet is the “identity short-cut connection” which skips one or
more layers by the residual block. The skip connection between If the shortcut goes across more than two sizes of feature maps,
the layers adds the output of the previous layers to the outputs of then the function performs a stride of two. ResNet50 follows the
the stacked layers (Fig. 1). If the previous layer output and the first option for increasing dimension. Each ResNet block is 3
next layer have the same resolution then filter depth may remain layers deep (Table. 1). 3.8× 109 operations are performed in the
the same. If the previous layer output’s resolution and the next model. The ResNet50 has a faster convergence compared to its
layer output’s resolution have a halved feature map size then the late
filter depth is doubled. The ResNet model has lower complexity
and has less number of filters. IV. METHODOLOGY
ResNet has shortcut connections inserted that change the
neural network into its equivalent version of ResNet. The identity Figure 2 depicts the block diagram of a proposed system for
function F(x{w}+x) is implemented when the input has the same tomato leaf disease detection. The steps used for the system are (i)
dimension as the output. When the dimension increases, residual
Dataset collection (ii) Data augmentation (iii) Model Creation (iv)
networks have two options to choose from. The first one being,
the shortcut in F(x{w}+x) is used to select similar dimensions Training and Validation (v) Classification using CNN.
where 1 x 1 convolutions are performed. Another option that
introduces no additional parameter is that the zero paddings are
done by identity mapping by using a shortcut method for the
increase of dimensions.

Table 1 Layers in ResNet 50

Layers Output size ResNet50

Conv1 112× 112 7×7, 64, Stride-2

Conv2_x 56×56 3×3 max pool, Stride-2

978-1-7281-5371-1/20/$31.00 ©2020 IEEE 1128

Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
 Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)
IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1

RandomResizedCrop crops the given image to a random size of

0.08 to 1.0 and with a given aspect ratio. The random cropping of
image over-center cropping is used. Finally, the third method
combines the first and second operations using the compose
function. This function will aid in chaining different transforms
together. After the above three methods, our dataset is expanded
from 9801 to 39204 which four times the original size. The
naming of the augmented images has been given using the first
letters of the function name used. The overfitting problem occurs
when the model is trained only with the training set of images and
unable to classify new images. Thus, the above technique will
help the model learn as many different patterns as possible. This
avoids overfitting and underfitting and improves the overall
performance of the model.

Fig. 2 Block Diagram

(i) Dataset:
Datasets are required for all processes in the project. A
higher number of images available helps in training the model
finer and better at predicting diseases. A data set of 12,206
images are collected from the vast repository of
PlantVillage.Tomato diseases which are used as datasets are
Bacterial spot, Early blight, Septoria leaf spot, Tomato yellow
leaf curl virus, Tomato mosaic virus (Fig. 3). The healthy leaf is
also included as one of the classes in the five classes of disease.
The image datasets are divided into 80% and 20% for training and
validation respectively.
Fig. 4 Leaf images after data augmentation for Bacterial Spot
(ii) Data augmentation:
This paper’s most important factor is to train the model (iii) Transfer learning using ResNet-50(Model Creation)
of the network by extracting features that can differentiate In this model, the concept of transfer learning using the
between classes. Therefore, Data augmentation has been applied pretrained model known as Resnet-50 is implemented [12] and
to images that result in a higher chance of extracting appropriate
modified it. There are two different ways of implementing
features [10]. Pytorch [13] provides a very useful library called
(torchvision.transforms) that contains many methods that help in transfer learning on CNN. Fine-tuning a CNN or by using CNN
the process of data augmentation. This helps in expanding the size as a fixed feature extractor. The feature extractor approach was
of the dataset by creating images that are modified versions of the used by maintaining all the default weights of CNN except those
originals. Due to this variation, the model will be able to in the final layer.
generalize what they have learned and perform better.
9801 images which belong to the training set of data are ResNet-50 is incorporated into our image datasets as follows:
taken for augmentation. In this proposed work, three methods
1. The pre-trained model has been introduced as an initial
have been implemented which are, RandomRotation,
RandomResizedCrop, and combining the above two which is step.
RandomRotation and ResizedCrop(Fig 4).RandomRotation 2. Reshaping the final layer of the ResNet-50 model which
function transforms the images either left or right by 30 degrees. is the fully connected layers and replacing it by 6 fully

978-1-7281-5371-1/20/$31.00 ©2020 IEEE 1129

Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
 Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)
IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1

connected SoftMax layers to have the outputs as the the numeric real value logits into probabilities by taking the
same quantity of classes in our dataset. exponents of each output and normalizing each output number by
3. The weights and other parameters are frozen in the the sum of those exponent value. The non-positive values are
convolutional layers and training is done on the model to taken as positive by the exponential function where the
classify the different types of tomato diseases. probability values are taken between zero and one. The sum of the
4. Initialize the optimization algorithm whose parameters probability values must be equal to one. In the given function
are to be updated during the training process (Equation 1) Zi is the input logit value from ith class and 𝜎(𝑍)i
The main purpose of using transfer learning is to reduce the
gives the probability of the particular class and K is the total
redundancy for creating a new model each time for different
purposes. So, to overcome this problem, a pretrained model is number of classes. The soft-max layer outputs a value of
used which has already been trained over thousands of images probability distribution which sums to 1. The class carrying the
[15]. Since the concept of image classification, the ResNet model highest probability can become the resultant class. Here class
also known as the base network would have already extracted refers to anyone's disease among the others.
some features of images such as corners, edges, and shapes. So,
the feature extraction part is done in the bottleneck block and only 𝑒 𝑧𝑖
the classification part is left. When the model is imported, the σ(𝐳)𝑖 = 𝑧𝑗 𝑓𝑜𝑟 𝑖 = 1, … , 𝐾 𝑎𝑛𝑑 𝐳 = (𝓏1 , … . , 𝓏𝐾 ) ∈ ℝ𝐾
∑𝐾
𝑗=1 𝑒
weights remain freeze, bias, and other hyper parameters since our
classification tasks are different. The last layers in the model are -------------------- (1)
modified which are the fully connected layers [11]. V.RESULTS AND DISCUSSIONS.
(iv) Training the model
The proposed model described in section IV is
The ResNet model’s final channel output before the fully
implemented and its performance is evaluated using quantitative
connected layers is 2048. Based on this, a sequential is defined,
metrics such as accuracy and F1-score. Based on the measures,
which consists of fully connected layers with the ReLU activation
the ROC curve is plotted as an observation of the results. At the
function [8], Dropout with 20% probability, and an output Log
first level, the model will classify between a healthy and
SoftMax function. The features obtained in the bottleneck block
unhealthy leaf. If first-level classification results in an unhealthy
are given as an input to the 6 fully connected layers since it has
leaf, the second level of classification will predict the type of
six different classes. Now, the 6 fully connected SoftMax layers
disease among five diseases elaborated in Figure 3. Data
are trained to replace the existing fully-connected layers by the
augmentation has been applied to increase the number of images
one trained by us. Gradients have been turned off for all layers
in the training dataset which could make the model more
except the last newly added layer. So, backpropagation will occur
powerful. The model’s accuracy has also been improved due to
only for these last layers, and weights will be updated. The
the increase in the diversity of the data without collecting more
optimizer used is Adam optimizer and it trained the model for 20
data.
epochs. The learning rate is set initially at 0.001 and momentum
At the time of training the model, after each iteration,
is 0.1. The loss criterion used here is NLLLoss and pass this as an
the loss occurred is calculated, gradients are backpropagated
output to correct existing labels.
concerning the loss and model parameters, and at last, the
(v) Classification using CNN
required parameters are updated with the optimizer (Adam). The
The softmax function is the last stage of operation in a
default value of the torch deep learning library for the learning
network since it takes unnormalized log probabilities as inputs
rate (𝛼) is 0.001. After fixing the default learning rate, the value
and it returns the probability distribution over the target classes. It
has been adjusted from high to low and to slow down the rate
is an activation function used for multiclass-classification since
while getting closer to an optimal solution. At the final layer, the
our system classifies five different kinds of tomato leaves disease.
ResNet-50 outputs the value which was taken as an input to the
Hence, it is used in a logistic regression model. The logits layer is
softmax function. Fig.5 gives the log-probabilities of each class as
known as the last neuron layer of the neural network for
compared with the targets. The log-probability distribution is
classification which outputs raw data of real numbers. In our
compared concerning each class and the largest probability
model, these six classes have their respective logits values from
accounts to be a resultant class of an input training image.
the logits layer. To identify the correct class, probabilities must be
calculated using the softmax function. A discrete probability
distribution function is used to calculate each outcome. It turns

978-1-7281-5371-1/20/$31.00 ©2020 IEEE 1130

Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
 Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)
IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1

Fig. 5 Log probability distribution.

Two sets of experiments are carried out to analyze the

model for their performance such as before and after the
expansion of the dataset. From Fig.6, It can be observed that the
loss occurred during the training, and validation is indirectly
proportional to the number of epochs. Training loss is the error
which is calculated during the training of the model with the train
set of data after each iteration and validation loss is calculated
while running the test datasets through the trained model. Loss is
calculated using a criterion known as Negative Log-Likelihood
(Equation 2) with the function NLLLoss, where x is the output
value and y is the predicted value of the given model from the
equation. In this criterion, a forward pass is made through the
network, the network output is used to calculate the loss and
finally, a backward pass is performed through the network to
calculate the gradients. Steps are taken with the optimizing to
update the weights. Loss is calculated at the end of each epoch. Fig. 7 Receiver operating characteristics (Plot: true positive rate against
𝑙𝑜𝑠𝑠(𝑥, 𝑦) = −㏒ 𝑦 false positive rate) before and after data augmentation.
-------------------- (2) A graphical way of representing is used to know how well our
From Fig.6, it can be noticed that the loss decreases eventually as model could differentiate between diseases which are the ROC
the number of iterations increases. The training loss becomes curve (Receiver Operating Characteristics in Fig.7). It is a
stable after 10 epochs before and 5 epochs after data validation method to check the performance of any classification
augmentation. mode and has been plotted against the true positive rate and the
false positive rate. It has been observed that, the proposed
model’s curve lies in the top left corner indicating better
performance. From this, it has been inferred that the proposed
model can predict most of the disease accurately without any
error. So, having area under the curve (AUC) higher results in
better classification
A training model’s accuracy can be estimated using a confusion
matrix. In Table 2, the accuracy of each disease is shown. An
overall accuracy of 94.61% has been achieved for the prediction of
six classes for the model before data augmentation and an accuracy
value of 97.01% for the model after augmentation.

Table 2 Overall Confusion Matrix for all Six (6) Classes before and after
Fig. 6 Plot of training and validation loss against epochs before and after
data augmentation. data augmentation.

978-1-7281-5371-1/20/$31.00 ©2020 IEEE 1131

Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
 Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)
IEEE Conference Record # 48766; IEEE Xplore ISBN: 978-1-7281-5371-1
VI. CONCLUSIONS AND FUTURE WORK
A tomato leaf disease detection model has been
developed using PyTorch that uses deep-CNNs. A deep learning
technique with transform and augmentation was used to overcome
the overfitting problem and also improved the model’s
performance. Besides, transfer learning was also used which adds
extra benefit to the model i.e., it also has more optimization
options available that fit the model to the required target. The
proposed model yields 97% accuracy after fine-tuning the weights
for the ResNet model. Thus, the above model can be used as a
tool for farmers to identify the diseases that are present in the
leaves of tomato plants. Gaining an accuracy of 96-97%, this
model can detect leaf diseases accurately within the shortest
period. However, the training of the model requires high
configuration hardware due to the number of layers present in the
ResNet 50 model. So, the training of the model for a new dataset
will take more time. These are the major drawbacks of the
proposed system. To reduce the training time, it is necessary to
tune the parameters which can be the future scope of the research
work. Also, the model can be applied for identifying diseases in
other plants like Apple, Potato, Cucumber, Brinjal, etc.
VII. REFERENCES
[1] Melike Sardogan, Adem Tuncer, Yunus Ozen. “Plant Disease
Detection and Classification Based On CNN with LVQ Algorithm.” 3rd
international Conference on computer science and engineering, pp. 382-
385, IEEE, 2018.
[2 ] Aravind Krishnaswamy Rangarajan, Aniirudh Ramesh and Raja
Purushothaman, “Tomato crop disease classification using pre-trained
deep learning algorithm ”, International Conference on Robotics and
Smart Manufacturing (RoSMa2018), SASTRA Deemed University, pp.
1040–1047,2018.
[3] Kenichi Kobayashi, Masato Noto and Junpei Tsuji. “Evaluation of
Data Augmentation for Image-Based Plant-Disease Detection.”
International Conference on Systems, Man, and Cybernetics, IEEE,
2018.
978-1-7281-5371-1/20/$31.00 ©2020 IEEE
Authorized licensed use limited to: Government College University Faisalabad. Downloaded on August 01,2022 at 08:19:51 UTC from IEEE Xplore. Restrictions apply.
[4] S.Veni, Aishwarya Mala, P.M. Vishnu Priya, R. Anusha and Ashwini
Kayartaya. “Computer Aided System For Detection and Classification Of
Brinjal Leaf Diseases Using Thermal and Visible Light Images.” Journal
of Theoretical and Applied Information Technology, JATIT, Department
of Electronics and Communication Engineering, Amrita Vishwa
Vidyapeetham, 2017.
[5] Jiachun Liu, Shuqin Yang,Yunling Cheng and Zhizhuang Song,
“Plant Leaf Classification Based on Deep Learning.” Proceedings 2018
Chinese Automation Congress (CAC 2018), IEEE, pp.3165-3169, 2018.
[6] Peng Jiang, Yuehan Chen, Bin Liu, Dongjian He and Chunquan
Liang. “Real-Time Detection of Apple Leaf Diseases Using Deep
Learning Approach Based on Improved Convolutional Neural
Networks.”, IEEE, pp.59069-59080, 2019.
[7]Hoo-Chang Shin, Mingchen Gao, Holger R. Roth, Le Lu, Ziyue Xu,
Jianhua Yao, Isabella Nogues, Ronald M. Summers and Daniel Mollura.
“Deep Convolutional Neural Networks for Computer-Aided Detection:
CNN Architectures, Dataset Characteristics and Transfer Learning.”,
IEEE Transactions on Medical Imaging, IEEE, pp.1285-1298, 2016.
[8] Fatih Ertam and Galip Aydonn. “Data Classification with Deep
Learning using Tensorflow.” 2rd International Conference on computer
science and engineering, UBMK 2017, IEEE, pp.775-758, 2017.
[9] Robert G. de Luna, Elmer P. Dadios and Argel A. Bandala.
“Automated Image Capturing System for Deep Learning-based Tomato
Plant Leaf Disease Detection and Recognition.” Proceedings of
TENCON 2018, IEEE, pp.1414-1419, 2018.
[10]S.SanthanaHari, M.Sivakumar, P.Renuga, S.karthikeyan, S.Suriya,
“Detection Of Plant Disease By Leaf Image Using Convolutional Neural
network”, International Conference on Vision Towards Emerging Trends
in Communication and Networking (ViTECoN), IEEE, 2019
[11] Sarah Ali Abdelaziz Ismael, Ammar Mohammed, Hesham Hefny.
“An Enhanced Deep Learning Approach For Brain Cancer MRI Images
classification Using Residual Networks.”, Department of Computer
Science, Volume 102, January 2020.
[12] Vinit Bodhwania , Umesh Bodhwania, D. P. Acharjya.
“Deep Residual Networks for Plant Identification.”,International
Conference on Pervasive Computing Advances and Applications
(PerCAA)2019, Procedia Computer Science, pp.186–194, 2019.
[13] Arpan Jain, Quentin Anthony, Ammar Ahmad Awan, Dhabaleswar
Panda and Hari Subramoni.“Performance Characterization of DNN
Training Using Tensorflow and Pytorch on Modern Clusters.”, IEEE
International Conference on Cluster Computing, ICCC, 2019.
[14] Aravinth J, Harikrishna K, Anush Bharadwaj and Natarajan
Vignajeeth. “Classification of Urban Objects from HSR-HTIR data using
CNN and Random Forest Classifier”, International Conference on
Communication and Electronics Systems (ICCES 2018), Department of
Electronics and Communication Engineering, Amrita Vishwa
Vidyapeetham, 2018.
[15] E. Rezende, G. Ruppert, T. Carvalho, F. Ramos and P. d. Geus,
“Malicious Software Classification using Transfer Learning of ResNet-
50 Deep Neural Network,” in 16th IEEE International Conference on
Machine Learning and Applications, 2017.
[16]. T. Vijayakumar, “Comparative Study of Capsule Neural Network in
Various Applications,” Journal of Artificial Intelligence and Capsule
Networks, Volume 1, pp. 19-27, 2019.
1132