STORE ACTIVITY RECOGNITION BASED ON

RASPBERRY PI

1st Kahlil Muchtar*
Department of Electrical and Computer
Engineering, Universitas Syiah Kuala
Telematics Research Center (TRC)
Universitas Syiah Kuala
Aceh, Indonesia
kahlil@usk.ac.id (corr.author)
2nd Muhammad Jurej Al Hamdi
Department of Electrical and Computer
Engineering, Universitas Syiah Kuala
Aceh, Indonesia
chairuman@mhs.unsyiah.ac.id
3rd Wildan Al Mumtaz
Department of Electrical and Computer
Engineering, Universitas Syiah Kuala
Telematics Research Center (TRC)
Aceh, Indonesia
mayafitria@unsyiah.ac.id

4th Nizam Albar 5th Teuku Abrar Mifta 6th Jamalul Ridha
Department of Electrical and Computer Department of Electrical and Computer Department of Electrical and Computer
Engineering, Universitas Syiah Kuala Engineering, Universitas Syiah Kuala Engineering, Universitas Syiah Kuala
Aceh, Indonesia Aceh, Indonesia Aceh, Indonesia

Abstract— Tomatoes are a horticulture product with
the potential to be developed since they have a high
economic value and are in high demand by industry and
consumers. Tomato plants, on the other hand, still need
to be handled carefully in order to boost yield harvest.
Furthermore, susceptibility of the tomato plants to
Septoria leaf spot disease, which arises due to Septoria
Lycopersici Speg fungal infection, is being one of the
challenges in escalating tomato production itself.
Regarding the problem, this study aims to detect
Septoria leaf spot on tomato plants by developing a tool
utilizing deep learning and Convolutional Neural
Network (ConvNets or CNN) model. CNN model
conducted in this work is a supervised learning
technique that extensively operated for solving linear
and non-linear problems. Moreover, Raspberry Pi
microcontroller and Intel Movidius Neural Computing
Stick (NCS) are employed in this work, in order to
accelerate the computing process and to ease the
detection process considering its portability, speed, and
accuracy. The precise detection range is from 84.22
percent to 100 percent, with an average accuracy rate of
95.89 percent.
Keywords— Septoria, Deep learning, Raspberry pi,
CNN, Intel Movidius Neural Computing Stick (NCS)
based optimization framework to detect recognized shop
activity..
II. RELATED WORK
Previous research by Mark Sandler, et al. [1] discusses
the advanced performance of mobile models on many tasks
and benchmarks and across a spectrum of different models
size. We also describe an efficient way to implement
this mobile model to object detection in a new framework
we call it SSDLite. But as described in [2-3], they
demonstrated how to build a mobile semantic segmentation
model via a reduced form of DeepLabv3 which we call
Mobile
DeepLabv3. In [4], the authors discuss based on the
inverse residual structure where shortcut connections exist
between the thin layers of the bottle neck. Intermediate
expansion layer uses light depth convolution to filter
features as source of non-linearity, in [5], suggests that this
improves performance and provides the tuition leading to
this design.
Finally, our approach allows separation of the
input/output domains from the expressiveness of trans
formations, which provides a convenient framework for
further analysis. We measure our performance ImageNet
classification (6) COCO object detection (1) VOC image
segmentation.

I. INTRODUCTION III. PROPOSED APPROACH

In this task we will focus on the project called " Store
Activity Recognition Based on Raspberry Pi”. This project
aims to know the number of visitors to a supermarket and
detect customer interest in purchasing groceries. One of the
shopping goods logistics management strategies and
commodity layout to increase demand from customers.
In this study, the authors propose a hardware and
software design that can run on the Raspberry Pi system.
Therefore, the prototype is designed using a lightweight and
simple architecture using ssdmobilenetv2, a Bounding Box
The input from the system is the image captured by the
camera. While the output is in the form of an image that has
been labeled or boxed whether it is identified as entering the
shopping area. The system can recognize how many visitors
visit the shopping area in real time with the help of datasets.
The dataset used in this study is a collection of digital
images obtained from the COCO Dataset. This dataset is
then used to train the system to recognize human
movements and objects. This study uses MobilenetV1 and a
bounding box to recognize human movement quite well.
 Fig 1. Model optimization flow using the OpenVINO
Gambar diatas salah.
Fig 2. Tomato normal leaf and septoria spot leaf
Disease.
This study selects a model that was trained using
InceptionV3 [6]. There are several things proposed, such as
the concept of RMSProp Optimizer and Label Smoothing.
The concept of label smoothing is an attempt to prevent
overfitting, in which a regularizing component will be added
to the loss formula. The purpose of the inception model is to
act as a multi-level feature extractor by calculating filter
convolutions in the same module. The results of these filters
are then stacked into the channel dimensions before being
inserted into the next layer [6]. The model that has been
successfully trained will be converted into an Intermediate
Representation (IR) using OpenVINO. Ultimately, this
model can be used on the OpenVINO inference engine
inside Intel Movidius NCS. The results of model
optimization using OpenVINO will provide an .xml file
containing topology, layers, connectivity, and parameters as
well as the file containing weight and bias.
IV. EXPERIMENTAL RESULTS
The resulting system is used to detect the number of
visitors to a store based on a collection of images that have
been trained in the previous step.
Fig.3. The proposed hardware components.
The system is run by receiving inputs (input) in the
form of a tomato leaf image acquired from the camera. The
results of the detection of septoria leaf spot disease on tomato
plants can be seen in Fig. 4.
Fig.4. The result
The percentage of detection accuracy can achieve
between 84.22% to 100%. The calculation results show that
the average detection accuracy obtained with 30 samples of
tomato leaves is 95.85%.
V. CONCLUSION
This research has succeeded in creating a deep learning
system to detect septoria leaf spot disease on tomato plants
based on Intel NCS and using the InceptionV3 model. The
existing problems that affect the detection accuracy are the
intensity of the lighting when the image is acquired and the
distance of the camera to the object being captured.
ACKNOWLEDGMENT
We thank the Master of Electrical Engineering Study
Program and Erasmus+ Industry 4.0 Program, for supporting
this research.
REFERENCES
[1] Verma, Shradha, Anuradha Chug, and Amit Prakash Singh.
"Prediction models for identification and diagnosis of tomato plant
diseases." 2018 International Conference on Advances in Computing,
Communications and Informatics (ICACCI). IEEE, 2018.
[2] Brahimi, Mohammed, Kamel Boukhalfa, and Abdelouahab
Moussaoui. "Deep learning for tomato diseases: classification and
symptoms visualization." Applied Artificial Intelligence 31.4 (2017):
299-315..
[3] Fuentes, Alvaro, et al. "A robust deep-learning-based detector for
real-time tomato plant diseases and pests recognition." Sensors 17.9
(2017): 2022.
[4] Durmuş, Halil, Ece Olcay Güneş, and Mürvet Kırcı. "Disease
detection on the leaves of the tomato plants by using deep
learning." 2017 6th International Conference on Agro-
Geoinformatics. IEEE, 2017.
[5] Rangarajan, Aravind Krishnaswamy, Raja Purushothaman, and [6] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens and Z. Wojna,
Aniirudh Ramesh. "Tomato crop disease classification using pre- "Rethinking the inception architecture for computer vision," in
trained deep learning algorithm." Procedia computer science 133 Proceedings of the IEEE conference on computer vision and pattern
(2018): 1040-1047. recognition, Las Vegas, Nevada, 2016.