Optical Caliper Tablet Application

Aref Soleymani

supervisor’s:
Sam & Fidelis

Master Next Level Engineering

De Haagse Hoge Schol Delft

Institution

2024
 Table of Contents

Introduction................................................................................................................................3
Background and context.........................................................................................................3
Problem statement...................................................................................................................3
Research questions..................................................................................................................3
Relevance and importance of the research.............................................................................3
Literature review........................................................................................................................3
Key concepts, theories and studies.........................................................................................3
Key debates and controversies................................................................................................3
Gaps in existing knowledge....................................................................................................3
Research design and methods....................................................................................................3
Aims and objectives................................................................................................................3
Methods and sources...............................................................................................................3
Practicalities and potential obstacles......................................................................................3
Implications and contributions to knowledge............................................................................3
Practical implications..............................................................................................................3
Theoretical implications.........................................................................................................3
Reference list..............................................................................................................................4
Research schedule......................................................................................................................5
Research phase........................................................................................................................5
Objectives...............................................................................................................................5
Deadline..................................................................................................................................5
 Introduction
Dutch greenhouse horticulture, renowned for its innovation and efficiency, plays a pivotal role in the global food supply
chain. With the ever-increasing global population and the consequent pressure on food safety and sustainability, the
sector's researchers and entrepreneurs are at the forefront of enhancing agricultural practices through technology. The
integration of sensors, data analytics, and precise monitoring techniques underscores a paradigm shift towards more
sustainable and efficient farming methods, addressing both the economic and environmental aspects of agriculture. This
project, situated within this context, aims to revolutionize how growth and yield are monitored in the greenhouse
horticulture sector by focusing on plant-centric data acquisition. Monitoring the growth of plants is crucial for optimizing
crop yields, ensuring sustainable use of resources, and improving agricultural productivity by enabling timely
interventions for health and growth management.

Despite these advancements, many projects around the world for the maintenance of plants continue to struggle and
even fail due to a lack of monitoring. On the beautiful island of Luzon in the Philippines, volunteers planted over a
million mangrove seedlings [1] as part of a world-renowned restoration effort. Unfortunately, 98% of these seedlings did
not survive, or they were washed away [2], because there was no follow-up monitoring and evaluation. Similarly, in
2019, the province of Çorum in Turkey made headlines with a massive restoration initiative that aimed to plant
approximately 300,000 trees in just one hour [3]. However, a staggering 90% of these plants died [4] due to inadequate
monitoring and evaluation.

The challenge at hand lies in the current limitations of plant monitoring technologies. Traditional methods, often
invasive, risk harming the plant while existing non-invasive technologies either lack precision or are prohibitively
expensive for widespread adoption. This gap in the technology landscape hinders the ability of growers to effectively
manage crop cultivation, directly impacting yield and operational costs.

This research proposes the development and application of an Optical Caliper for non-invasive, accurate, and cost-
effective monitoring of crop growth parameters, specifically stem thickness. By enhancing precision to 0.1 micrometers
and integrating the technology with mobile devices. The devices need to increase the precision because some of the
plants need to be measured twice a day. Additionally, some of the plants grow only 0.1 millimeters per day, so we need
to bring down the precision to 0.1 millimeters. this project addresses a crucial need for more accessible and efficient
monitoring tools. Such advancements are not only vital for improving crop management and yield but also have broader
implications for sustainable agriculture practices worldwide.

Problem Statement

Despite significant advancements in agricultural technology, the absence of effective and sustainable monitoring tools
remains a substantial barrier to optimizing crop yield and resource utilization. Existing methods either compromise the
plant's integrity or do not offer the necessary precision and affordability. This project seeks to address these challenges
by focusing on the development of an innovative solution that combines accuracy, non-invasiveness, and cost-
effectiveness in crop monitoring.

Research Questions

Can smartphones/tablets be used as a replacement for optical calipers, considering their widespread
availability?

Sub Questions

1. Are the modules of Optical Caliper available on smartphones or tablets?

2. Can the Android use the phone camera to measure plant stems?

3. How can we improve the precision of the camera of smartphones and tablets to measure stem thickness to
0.1mm?
Relevance and Importance

This research is poised to deliver critical insights into precision agriculture, specifically through the development of a
tool that enables growers to monitor crop growth more accurately and non-invasively. By addressing the current
technological gaps, this project has the potential to significantly impact the global agricultural sector, offering solutions
that can lead to better crop management, reduced environmental impact, and improved sustainability practices.
Furthermore, the project's emphasis on affordability and accessibility aligns with the broader goals of inclusive
technological advancement in agriculture, making it a valuable contribution to the field. By achieving the outlined
objectives, this research will fill a significant gap in the domain of precision farming, high-precision Optical Caliper,
compatible with mobile devices, represents a advance in agricultural technology, offering growers an unprecedented
ability to monitor crop growth accurately and efficiently. This innovation is particularly relevant to the Dutch horticulture
sector, known for its global leadership in sustainable and productive farming practices. The idea is to develop an app in
the tablet/mobile device for this purpose. The app should work on tablets/phones and have the capability to perform
the task of the optical caliper on its own. In this respect, the camera and the sensors from tablet should be used to
perform the task of an optical caliper. This development will enhance the applicability of the device, making advanced
crop monitoring accessible to a broader range of users. Through these contributions, the project stands to significantly
impact the efficiency of global food production, sustainability efforts, and the technological advancement of agricultural
practices.

Literature Review (Key Concepts, Theories, and Studies)

Today more than ever our agriculture is engaged with technology to in improving the growth quality
of corp. This paradigm shift towards innovative agricultural practices is embodied in the utilization of
diverse technologies ranging from ubiquitous sensor networks[5] and optical recording systems [6] to
autonomous robotic systems [7] and advanced 3D imaging [14]. These technologies, grounded in the
principles of efficiency, accuracy, and minimal physical intervention, represent a significant departure
from traditional methods, offering real-time[27][15][5] insights into plant growth parameters such as
stem thickness without the need for direct contact. This literature review commences with an
exploration of the various methodologies that have been developed and implemented across the
agricultural sector, highlighting their contribution to the field's ongoing evolution towards more
sustainable and precise farming practices. Through a comprehensive analysis of current tools and
techniques, including ultrasonic methods[9] and atmospheric pressure remote plasma treatment[10],
this review aims to underscore the transformative potential of these advancements, setting the stage
for a discussion on their practical applications, inherent challenges, and the broader implications for
the future of agriculture.
The research discussed in this article aims to explore the literature on measuring the thickness of stem
plants with sub-millimeter precision, which is crucial for monitoring the growth of plants like
tomatoes. The device that can measure the thickness of stems with such accuracy is called a caliper.
There are two types of calipers - contact-based and contactless. In the following paragraphs, we
explain the principle behind calipers.

Key concept:
 - Calipers
calliper or calliper are an instrument used to measure the dimensions of an object; namely, the diameter or depth of a
hole. The word “calliper” comes from Latin roots meaning precise pincer. Many
types of calliper permit reading out a measurement on a ruled scale, a dial, or an
electronic digital display [17,18,19].

- Optical Calliper
Optical caliper is a device for measuring linear dimensions. The optical calliper generally consists of two circularly
mounted mirrors whose angular positions are monitored by an autocollimator, and that are capable of independent
angular rotation. Optical calliper are capable of measuring the diameter of screw threads, the dimensions of wires, and
the length of gauge blocks, and other apertures on the scale of a mm. Microcalipers are used for measurements on the
micron scale.[20]

These devices are contact-based, which is unsuitable for measuring delicate objects like plant stems. Non-contact
measurements are required for such use cases:

- Non-contact optical Calliper

We changed some part and add modules instead of traditional calliper. Instead of using a traditional detector behind
the device to detect the laser, this design relies on image processing techniques to analyse the images captured by the
camera module. The laser and LED illumination improve the image quality and contrast, enabling the software to
accurately determine stem thickness by analysing the images without the need for a physical detector on the opposite
side.
The Optical calliper utilizes principles of optics and digital image processing. It captures images of plant stems using a
camera module and calculates stem thickness from these images without physical contact. Calibration procedures
ensure measurement accuracy by relating pixel dimensions in images to real-world dimensions.
The laser module, emitting a red light at 650 nm, is used for precise distance measurement. It helps in defining a
consistent measurement area and enhances the accuracy of stem thickness measurements by providing a reference
point on the stem.
Green LEDs, with a wavelength of 570 nm, are chosen for illuminating the stem because green light can enhance the
contrast of the stem against the background. This wavelength is effective in distinguishing plant material in images,
facilitating more accurate edge detection in the digital image processing steps.

Various non-contact and non-invasive technologies and tools have been utilized so far for measuring plant growth or
stem thickness.

Below, we will discuss the primary contributions of the field.

The following are methods used by companies and researchers to measure plant growth without physical contact:

- Computer and machine Vision Based Autonomous Robotic System and 3D imaging system :
Several reference have investigated Computer and machine Vision Based Autonomous Robotic System and 3D
imaging system [14] focusing on enhancing efficiency, precision, and automation in farming practices. They
 cover the development and application of non-contact optical measurement systems for detailed
environmental monitoring and plant growth analysis. These innovations demonstrate the potential to
revolutionize agricultural practices by improving resource management, facilitating robotics integration for crop
and livestock management, and enabling precise monitoring and analysis of plant health and development[7]
[13][14][15][16]..

- Planet growth measurement based on ubiquitous sensor:

In [5], an advanced, non-contact method for measuring plant growth using infrared sensors and ubiquitous
sensor network (USN) technology. This system allows for the real-time monitoring of plant growth parameters
such as stem diameter, without damaging the plants. It represents a significant advancement in agricultural
technology by automating the growth measurement process, providing a more efficient, accurate, and non-
invasive means of monitoring plant health and development[5].

- Electrical activity in situ using optical record:

a ground-breaking method for high-resolution, non-contact measurement of plant electrical activity using
optical recording techniques. By applying voltage-sensitive dyes and utilizing a cooled CCD camera, the study
enables the simultaneous recording of action and variation potentials in plants, particularly in Helianthus
annuus. This approach surpasses traditional methods by allowing for the visualization of bioelectrical signals
across various plant tissues, offering new insights into plant physiology and the mechanisms of electrical signal
transmission within plants, highlighting the phloem's role in signal propagation[6].

- Ultrasonic technique:
novel method for studying plant leaves using high-frequency ultrasonic pulses without contact. This technique
allows for the non-destructive, rapid measurement of plant water status across various leaf types, overcoming
limitations of the resonant ultrasonic spectroscopy method that is not applicable to all plant species. The
method benefits from high-frequency pulses to achieve greater resolution and accuracy, potentially serving as a
universal tool for plant leaf analysis by providing critical insights into leaf water content and structure[9][12].

- Atmospheric pressure remote plasma treatment:

This method combines atmospheric pressure remote plasma treatment with the detection of biophotons
emitted from plants, which can characterize the germination state of seeds. The study demonstrates how
plasma irradiation promotes growth and affects the emission of biophotons, offering insights into the
mechanisms behind plasma agriculture and its potential applications in enhancing plant growth and
development[10].

- Infrared sensors:
It employs infrared sensors to measure plant dimensions and uses GSM technology to transmit this data to a
remote server or user. The system aims to provide precise, user-friendly, and cost-effective monitoring of plant
growth parameters, enhancing agricultural research and management by automating data collection and
analysis processes[11].
Overall, all these technologies have their pros and cons. However, in agriculture, there are three significant problems
that need to be addressed. These problems, in order of importance, are:
1. highly costs
2. Complexity ( require specialized knowledge for setup and maintenance )
3. Environmental sensitivity( The sensitivity of device components to environmental conditions means that weather and
inappropriate environments can impact results )

In the following, I will discuss two technologies that solve the previously mentioned issue by utilizing Android-based
measurements.

- Android based measurement

Good but organize and give main message.
Need for laser and camer, but no laser in tablet or mobile
In [] and [], use of laser is replaced by a reference point
None of the non-contact measurement devices and researches have been compatible with Android devices except for
one (A Review from Caliper to Machine Vision with Deep Learning ), however can observe several problems on this
technology.

 It is not contactless
 It can’t measure completely autonomous (need a reference on
background)
 It is not measure with hight precision
 Always must carry A4 flat surface to use it as background
 It just works as fruit size measurement
 It is dependent on light condition
 Can’t take a picture of some fruits that are middle of the tree

Also this product is already exist that can measure thickness of plants with
android phone[30].
Please take note of the issues that this device is currently experiencing:
 It is not contactless
 It is not measure with hight accuracy.
 It can’t measure completely autonomous (need a reference on
background)
 Always must carry holder to use it as background.
 Hight price

Gaps in Existing Knowledge:

The Challenges/problems with the above mentioned state-of-the-arts can be summarized as fllows:

1. Technical Complexity:
require specialized knowledge for setup and maintenance.
Smart farming technologies are advanced and can be complicated to set up and keep running. They often need someone
with technical skills to manage them, which can be a barrier for farmers who aren't tech experts [5][6][9][13][7][14][8].

2. Dependence on Technology:
Relies on consistent sensor performance and GSM connectivity.
These systems heavily rely on the continuous performance of sensors and a stable internet connection. Any glitch in
technology can lead to significant disruptions in monitoring and managing crops [11][9][6].

3. Environmental Sensitivity:
Measurement accuracy could be affected by varying environmental conditions.
The precision of these technologies can be affected by changes in the environment, such as weather fluctuations. This
variability can make it challenging to rely on them for consistent data [5][6][8][9][10][11][13][15].

4. Focus on specific parts of a plant:

Many smart farming tools concentrate on particular aspects of a plant, like leaf size or fruit weight, potentially
overlooking other critical indicators of health or growth [8][9][13].

5. The economic justification for adopting high-cost in agriculture:

The initial investment for smart farming can be steep, making it difficult for smaller farms to afford. The cost-benefit
ratio needs to be clear to justify such investments, especially when the financial returns aren't immediate [15][13][8][5].

Objective: Based on the challenges mentioned above that exist in the state of the art, the objective of my project is to
develop an optical caliper based on Android devices. Ideally, I will use the camera, sensors, and the processor of the
phones/tablets to process and measure autonomously.

I'm excited to share my vision for an innovative project that aims to elevate the Dutch greenhouse horticulture sector's
already impressive standards. We're looking at a world where the demand for food safety and sustainability is
constantly growing, and I believe that our research can significantly contribute to meeting these needs through
technological advancements. Specifically, I'm proposing to develop an Android app that works in tandem with our
existing optical caliper device, enabling us to monitor plant growth more accurately and efficiently than ever before.

Our project is not just about improving crop management and yields; it's a step towards more sustainable agricultural
practices globally. By making our tool accessible through a mobile app, we're ensuring that more growers can benefit
from our technology, making advanced crop monitoring a reality for a wider audience. This is particularly crucial for the
Dutch horticulture sector, known for its leadership in sustainable farming.

I've looked at various technologies and methods used in plant growth monitoring, and it's clear that while they have
their advantages, they also come with significant drawbacks like high costs, complexity, and environmental sensitivity.
Our approach aims to overcome these challenges, providing a practical, user-friendly solution. Moreover, the existing
solutions have not fully embraced mobile compatibility, which we see as a game-changer for the field.
In summary, I'm convinced that this project is a critical step in the right direction. By bridging the gap with an Android
app that can measure stem thickness like our optical Caliper, we're not just enhancing plant growth monitoring; we're
setting a new standard for precision agriculture.

Implications and contributions to knowledge:

In our exploration of integrating advanced technologies such as AI and robotics into agriculture, we find ourselves at a
critical crossroads. This juncture is defined by the exciting prospects of technological breakthroughs as well as the ethical
imperatives that accompany such advancements. The breadth of research in this domain highlights several core themes,
including the management of data, the equitable distribution of power, environmental considerations, and the broader
socio-economic ramifications on society. These insights compel us to adopt a mindful approach to technology
deployment, advocating for the creation of ethical guidelines and conduct codes that promise equitable benefits from
agricultural AI and robotics, thereby cultivating trust and collaboration among all involved parties[21][22][23][24].

Practical implications:

In direct response to the ethical challenges outlined, our development of an innovative optical caliper device stands as a
testament to our commitment to ethical technology integration. This device is meticulously designed to prioritize data
privacy, ensuring that farmers maintain ownership of their data, thereby empowering them with critical information
without compromising their autonomy. By coupling this technology with an accessible Android app, we democratize the
benefits of precision agriculture, bridging the technological divide and enhancing crop monitoring for a wider
audience[25][26].

Theoretical implications:

Moreover, our focus on developing a non-invasive and accurate monitoring tool advocates for sustainable farming
methods. The device is engineered to require minimal infrastructural modifications, facilitating its adoption across
various farming scales without demanding significant changes to the natural landscape or traditional farming
methodologies. This approach not only champions environmental conservation but also embodies the principles of
responsible innovation, paving the way for an agricultural future that is inclusive, sustainable, and ethically
responsible[27]28][29].

As we navigate the integration of ethical considerations with technological advancements in agriculture, it becomes
clear that a balanced strategy is essential—one that respects the potential benefits and acknowledges the challenges of
AI and robotics. The commitment to responsible innovation, underscored by the development of ethical guidelines,
reflects our collective dedication to addressing the complex implications of digital farming comprehensively. Moving
forward, embedding ethical considerations in the design and implementation of agricultural technologies is crucial,
ensuring that the evolution of AI and robotics in agriculture serves the greater good, leading to a more equitable,
sustainable, and ethically aligned future for all stakeholders involved.

Hardware:
The hardware is based on:
1. Raspberry Pi Zero 2 board
2. 1.54 inch LCD-Module from Waveshare to display plant image
3. Camera module from Waveshare with 4 mm manual-focus lens,
based on a 5 MegaPixel CMOS sensor OV5647
4. Two Leds for illumination (green 570 nm) of stem from Multicomp MCL053GD
5. Laser module (red 650 nm, point, 5V) for distance measurement
6. Hat-PCB to interface all components with the PI Zero 2 board
(Own development)
7. Enclosure (3D printed)
(Own development)
8. Power-Bank 5V 5200mAh, Q-link
 References

1. Monitoring | The Forest and Landscape Restoration Mechanism | Food and Agriculture

Organization of the United Nations. (z.d.). https://www.fao.org/in-action/forest-landscape-

restoration-mechanism/our-work/gl/monitoring/en/

2. Wodehouse, D. (2020). Towards successful community mangrove management and

rehabilitation (Doctor of Philosophy). Bangor University.

3. Most trees planted by a team in one hour. (z.d.-b). Guinness World Records.

https://www.guinnessworldrecords.com.br/world-records/most-trees-planted-simultaneously

4. Kent, S. (2020b, januari 30). Most of 11m trees planted in Turkish project “may be dead”.

The Guardian. https://www.theguardian.com/world/2020/jan/30/most-of-11m-trees-planted-

in-turkish-project-may-be-dead

5. Suk, J., Kim, S., & Ryoo, I. (2011). Non-Contact Plant Growth Measurement Method and

System Based on Ubiquitous Sensor Network Technologies. Sensors, 11(4), 4312–4334.

https://doi.org/10.3390/s110404312

6. Zhao, D., Chen, Y., Wang, Z., Lin, X., Mao, T., Liu, Y., & Wang, Z. (2015). High-resolution

non-contact measurement of the electrical activity of plants in situ using optical recording.

Scientific Reports, 5(1). https://doi.org/10.1038/srep13425

7. Computer Vision Based Autonomous Robotic System for 3D Plant Growth Measurement.

(2015, 1 juni). IEEE Conference Publication | IEEE Xplore.

https://ieeexplore.ieee.org/abstract/document/7158932

8. Eguchi, T., Araki, T., & Kitano, M. (2007). Non-contact Measurements of Storage Organ

Growth in Fruit and Root Crops. Environmental Control in Biology, 45(4), 251–258.

https://doi.org/10.2525/ecb.45.251
9. Fariñas, M. D., Sancho‐Knapik, D., Peguero‐Pina, J. J., Gil‐Pelegrín, E., & Álvarez-Arenas,

T. G. (2022). Contact-less, non-resonant and high-frequency ultrasonic technique: Towards a

universal tool for plant leaf study. Computers And Electronics in Agriculture, 199, 107160.

https://doi.org/10.1016/j.compag.2022.107160

10. Takahashi, G., Hirata, T., & Mori, A. (2021b). Non-contact and non-invasive monitoring of

plant growth combining atmospheric pressure remote plasma treatment and detection of plant-

derived biophotons. Japanese Journal Of Applied Physics, 60(10), 100905.

https://doi.org/10.35848/1347-4065/ac22eb

11. Gupta, S., Mudgil, A., & Soni, A. (2012). Plant Growth Monitoring System Using Infrared

Sensors. International Journal of Engineering Research & Technology (IJERT), 1(4).

12. Meyer, G. E., & Davison, D. A. (1987). An electronic image plant growth measurement

system. Transactions Of The ASAE, 30(1), 0242–0248. https://doi.org/10.13031/2013.30434

13. A Machine Vision System for Continuous Field Measurement of Grape Fruit Diameter. (2008,

1 december). IEEE Conference Publication | IEEE Xplore.

https://ieeexplore.ieee.org/abstract/document/4739925?casa_token=ftw7P0-

2LdEAAAAA:ioUBnHNaVjjiV-CXdRU3Jnmb4Oe-JfOZnP-

MmkWufdtJ90UBGqU0M4ZxaiWgRtW6xn7dI0AJ1fWNLA

14. Smith, L., Zhang, W., Hansen, M. F., Hales, I. J., & Smith, M. L. (2018). Innovative 3D and

2D machine vision methods for analysis of plants and crops in the field. Computers in

Industry, 97, 122–131. https://doi.org/10.1016/j.compind.2018.02.002

15. Neupane, C., Pereira, M., Koirala, A., & Walsh, K. B. (2023). Fruit Sizing in Orchard: A

Review from Caliper to Machine Vision with Deep Learning. Sensors, 23(8), 3868.

https://doi.org/10.3390/s23083868
16. Vázquez-Arellano, M., Griepentrog, H. W., Reiser, D., & Paraforos, D. S. (2016). 3-D

Imaging Systems for Agricultural Applications—A Review. Sensors, 16(5), 618.

https://doi.org/10.3390/s16050618

17. https://www.merriam-webster.com/dictionary/caliper

18. https://www.collinsdictionary.com/us/dictionary/english/caliper

19. https://dictionary.cambridge.org/us/dictionary/english/calipers

20. https://www.photonics.com/EDU/optical_caliper/d5764#:~:text=A%20device%20for

%20measuring%20linear,capable%20of%20independent%20angular%20rotation

21. Ryan, M. (2019). Ethics of Using AI and Big Data in Agriculture: The Case of a Large

Agriculture Multinational. ORBIT Journal, 2(2). https://doi.org/10.29297/orbit.v2i2.109

22. Sparrow, R., & Howard, M. (2021). Robots in agriculture: prospects, impacts, ethics, and

policy. Precision Agriculture, 22(818-833).

23. Van der Burg, S., Bogaardt, M.-J., & Wolfert, S. (2019). Ethics of smart farming: Current

questions and directions for responsible innovation towards the future. NJAS - Wageningen

Journal of Life Sciences, 90–91, 100289.

24. Ryan, M. (2022). The social and ethical impacts of artificial intelligence in agriculture:

mapping the agricultural AI literature. AI & Society, 38(2473-2485).

25. Balafoutis, A. T., Van Evert, F. K., & Fountas, S. (2020). Smart Farming Technology Trends:

Economic and Environmental Effects, Labor Impact, and Adoption Readiness. Agronomy,

10(5), 743.

26. Patnaik, S., Sen, S., & Mahmoud, M. S. (Eds.). (2020). Smart Village Technology: Concepts

and Developments. Springer Nature Switzerland AG.

27. Javaid, M., Haleem, A., Singh, R. P., & Suman, R. (2022). Enhancing smart farming through

the applications of Agriculture 4.0 technologies. International Journal of Intelligent

Networks, 3, 150–164.

28. Mohamed, E. S., Belal, A. A., Abd-Elmabod, S. K., El-Shirbeny, M. A., Gad, A., & Zahran,

M. B. (2021). Smart farming for improving agricultural management. The Egyptian Journal

of Remote Sensing and Space Sciences, 24(2021), 971–981.

29. Moysiadis, V., Sarigiannidis, P., Vitsas, V., & Khelifi, A. (2021). Smart Farming in Europe.

Computer Science Review, 39, 100345.

30. https://zjtop17.en.made-in-china.com/product/sOuJFjQySrkS/China-Crop-Angle-and-Stem-

Thickness-Meter.html