Dec 28, 2021, China

2021 International Symposium on Efficient Production

of
Value-added Plants (EPVP2021)

High-resolution Plant Data for

Intelligent Environmental Control
in Greenhouse

Toyohashi University of Technology

Graduate School of Engineering
Ehime University
Graduate School of Agriculture
Prof. Dr. Kotaro Takayama
Toyohashi University of
 Technology
Electronics-Inspired Interdisciplinary
Research Institute (EIIRIS)
Research facilities

Prominent institute of TUT

6 professors
5 associate
professors
1 lecturer
2 spec. app. assoc. profs
2 spec. app. assisc. profs
7 technical staffs
Established in 2010
✔Mission is to realize a LSI
unique fusion between factory
electronics technology
(sensors, LSI, photonics
devices) and state-of-the art
applied research such as life
sciences, medical care,
environment, robotics, and
agricultural science, Research center for agrotechnology
 and biotechnology

Ehime University
Research center
for
high-technology
greenhouse
plant production
Research facilities
One of the main RC
of
Ehime University
9 professors
2 invited professors
5 associate professors
1 assistant professors
6 technical support
staffs

Established in 2008
supported by
MAFF/METI
Mission is to promote
agricultural production in
plant factory and intelligent
greenhouse with sensing,
ICT and automation. greenhouse
0.8 ha semi-commercial

Topics
1．Current situation and outlook of plant
factory and intelligent greenhouse 2．
Speaking plant approach for
sophisticated greenhouse production ①
Chlorophyll fluorescence imaging robot ②
Photosynthesis monitoring chamber
3．Optimization of agricultural production in
greenhouse based on daily plant data 4．
 Conclusion and prospective
5
Introduction: Structural change occurring
Drastic change of Agriculture in
JP JP Yen/person・

year
Family business/small scale vegetables
Accelerated decrease in
farmerʼs population
Low income

Increasing demand for fresh

 270 240 210
▲) Annual of fresh vegetable Plant
260.1
decrease( Factory
98 99 00 01 02 03 04
○) Farmerʼs 05 06 07 08 09 10 11 野菜をめぐる情勢（農林
in this 12 13 14 15 16 17 ⽔産省 平成31年4⽉)
251.4 209.7 Ministry of Agriculture,
population( 19 16 13
decade Forestry and Fisheries
239 Purchase price (×10,000)
(×10,000) 226.6

180 150
7

Large scale
192.2 10 Intelligent
H23 H24 H25 H26 H27
H28 11 12 13 14 15 16 施設園芸をめぐる情勢
（農林⽔産省 平成31年3⽉)
Ministry of Agriculture, Forestry and Fisheries

At least,
the half will
stop farming in 5-10
years Commercially
profitable PF/IGH
are getting popular

GreenHouse
Background: Sustainable fresh vegetable supply
 Profitable agricultural production
Under Artificial Environment
stable/safe food production

Plant Factory Intelligent GreenHouse

Fully controlled agricultural production under artificial lighting
Large-scale agricultural production
under sunlight
Background: Artificial lighting production

Market-oriented plant factory

International chain of
convenience stores
 Indispensable︕

Ensure a stable
lettuce supply
Background: Intelligent greenhouse

Large scale intelligent greenhouse

Commercially
profitable
 Hiroshima 8.5 ha Kagome Inc.
-1
40,000 tomato day

Over 1 ha of cultivation area ->

Getting popular This type of plant
production has been popular in NL, Korea, China
9

Trend in facility for 5-10 years

❖ Full control of ventilation,
Semi-closed Outflow homogeneous air flow→Precise
environmental control
 ❖ Positive air pressure→Low pest/disease risk

Air conditioning room

Higher Circulation
air Mixing
pressure

window

Inflow
air
Filter for insects

Homogeneity

Air duct
 ＋[High CO2× good
humidity]
Humidification and CO2 enrichment

Fan

Stable/mild environment
10

Newcomers from other

business fields are active
Computer and ICT

Industrial plant
4 ha tomato/paprika/leaf cabbage 6 ha tomato/baby leaf

Printing and marketing 3.6 ha high brix

tomato
Heavy electrical machinery

4 ha strawberry/2.3 ha paprika
 Topics
1．Current situation and outlook of plant factory
and intelligent greenhouse 2．Speaking plant
approach for sophisticated greenhouse production
① Chlorophyll fluorescence imaging robot ②
Photosynthesis monitoring chamber 3．
Optimization of agricultural production in
greenhouse based on daily plant data 4．
Conclusion and prospective
12
New challenges: Urgent task for higher productivity
Turning point for next generation
beyond the human intellect
New instrumentations
Inter canopy
supplemental lighting
with LEDs
 on a daily basis according to
the plantʼs growth status

The ability of plant

diagnosis/monitoring
is strongly required
Semi-closed

High power
CO2 enrichment

HOW to Use

Setting values should be

APPROPRIATELY UPDATED
Precise VPD control

Sensor + Robot & IoT, ICT, AI

Plant monitoring should

be
supported/strengthen
by
 observation &
experience
based judgement
Remaining
CRITICAL ISSUE!

Growerʼs eye
13
New challenges: Urgent task for higher productivity
Indispensable concept for
environmental control in greenhouse
conditions should be achieved by
Speaking Plant monitoring the plantʼs
physiological status
Approach
The optimal crop cultivation
Sensor + Robot & IoT, ICT, AI

Hashimoto(1989), Udink ten Cate et al.(1978), Takakura et

 al.(1974) Sensor

PLANT DIAGNOSIS

Statistic judgement
Business judgment Robot
Plant growth
monitoring robot for optimum
crop management University-launched
startup company

Background: aim of environmental control

Maximization of photosynthesis
 and balanced distribution
※A small part for root
Balanced growth
CO2 Monitoring of
photosynthetic function
Light
Maximization Net
photosynthesis
Chlorophyll
Carbohydrate Fluorescence Imaging
Robot for practical use
Balanced
Distribution

Stem Leaf Fruits

Background: basics of chlorophyll fluorescence Chl
16

fluorescence measurement for

evaluation of photosynthetic function
 Light CO2
Precise measurement of Chl
fluorescence allows us to evaluate
the status of photosynthetic functions
Photosynthesis
without touching the plants.

Light

〜83％
Chlorophyll
Chlorophyll fluorescence 0.6
〜3％
F

HP
 Photosynthesis (Photochemical
reaction)

Heat
Easy & Simple
17
Background: basics of chlorophyll
fluorescence

Excitation-Emission matrix of
Chl fluorescence
600
Omasa and Takayama, Springer-Verlag.,
2002

Excitation
Excitation

wavelength

(nm)

wavelength
(nm)
500
 400
Chl fluorescence emission

300

300 400 500 600 700 800 Emission

wavelength (nm)
Emission wavelength (nm)
Background: basics of chlorophyll fluorescence
Induction method to assess the
photosynthetic function Omasa et al. (1987)

Chlorophyll fluorescence
induction phenomenon Chl fluorescence induction imaging
 M/
Chl

fluores S
cence S
M
intensi I D
T
ty P P/S
(r.u.)
Excitation light

intensity 1 10 100

Tomato
Light on
Time (s)
shoot apex
van Kooten and Snel (1990) etc.
Background: basics of chlorophyll fluorescence
 Origin of Chl fluorescence
Plant cell
Cross section of a chloroplast

Stroma

Thylakoid

Cross section of a thylakoid

Chloroplast Photosystem I Membrane

Photosystem II
ATP synthetase
Background: basics of chlorophyll fluorescence
Photochemical reaction, electron
transport and Chl fluorescence
Electron transport chain
H+
fluorescen
Ligh
t ce
PSⅡ
Ligh
t
NADP+ and
H+ NADPH Thylakoid
Chl

2×e
2×H+ H+ H+ PSⅠ
H+
H2O Lumen
0.5×O2 H+
 H+
ADP and P
Thylakoid membrane
H+
enzyme ATP
ATP synthesis H+H+
Background: basics of chlorophyll fluorescence
Induction phenomenon and electron
transport activity
Reduction of EA1
Fluorescenc decreases the Initial electron
e Xanthophyll
percentage of light
energy used for
acceptors (EA1)
LHC photochemical reaction
Light CO2
(EA2) Calvin cycle
cycle

Chl e
Chl NADP＋
Heat
fluorescence e
Photo +
y Secondary EAs H e
intensit O
 2H+
e

M
P H2O 0.5O2
Following EAs (EA3)
O→I: Reduction of
EA1
e- NADPH
S
I→D: Oxidation of EA1 by electron transport from

EA1 to EA2 T
I
D
Time(s) P→S: Re-Oxidation of EA1 by
Dark electron transport to EA3 S→M:
Stable excitation light intensity Reduction of EA1, EA2 and EA3
M〜: Electron transport to EA3
D→P: Strong reduction of EA1
and activation of heat
and EA2
dissipation process (stress indicator)
Excitation light on
22
Background: basics of chlorophyll fluorescence

Lab. scale evaluation of

invisible
photosynthetic dysfunction
 Exp.2
electron transport
stress
Exp.1
Effect of DCMU Inhibitor of Recovery from light
5 60min
↘↗
0
Chlorophyll
fluorescence
PS
intensity
15
Before
P/S ↘ P/S
After

10 PS
M M
(r.u.) PPFD 1000 μmol m-2s-1 for

0.01 0.1 1 10 100 Time (s)

Takayama et al., J-SHITA, 2001

Takayama et al. Eco-Engineering, 2009

P/S is very
 sensitive to various stresses
environmental
Blue LED panel
Commercially
available CFI
robot
LED
0.6 m

0.6 m
 CCD camera
2.1m
panel

120°
CCD
camera PC

1.5 m

Blue excitation light

operation cart

Tomato plant

Chl fluorescence image

PC in the automatic

CFI robot in a tomato production

commercial greenhouse
 ❖ Demonstrative measurement during daytime
25

Distribution of photosynthetic function of

tomato plant across 1.3 ha
 P/S (photosynthetic
activity)
63 measuring points in 1.3ha

76m
170m
(9 points): 63 measuring points
High

76m
Invisible ! Low

170m
Feb 15 2013
N-S interval at 10 m (7 points) × E-W interval at 16 m Heterogeneous distribution
Application of CFI robot to the
evaluation of growth balance
CO2 Light
Maximization

Carbohydrate
Balanced
Distribution

Stem Leaf Fruits ※A small

Net photosynthesis part for root

Chl
Fluorescence
Imaging Robot
for practical use
 Stem elongation
monitoring

An example

Balanced growth
27
Daily growth monitoring with CFI
robot in commercial greenhouse
 Daily growth monitoring
that can not be done by human

Detection ratio 50〜75％

Error ratio 0％
28
Outline: Monitoring of fruits setting and maturing AI-based
image analysis for management Tomato
 fruits detection
with AI(deep learning) Inspired
by

Will be
installed by

Promoted
by

Conducted
by

Web application
Harvesting prediction

Topics
1．Current situation and outlook of plant
factory and intelligent greenhouse 2．
Speaking plant approach for
sophisticated greenhouse production ①
Chlorophyll fluorescence imaging robot ②
Photosynthesis monitoring chamber
3．Optimization of agricultural production in
greenhouse based on daily plant data 4．
Conclusion and prospective
 University-launched
startup company

Photosynthesis
and transpiration

monitoring chamber
31
Solution: Canopy level photosynthesis
Photosynthesis and
transpiration real-time
 monitoring chamber
robust, and low-cost

3 port
magnetic valve
Fan
Air pump

CO2 sensor

Outflow of air
Simple,

Timer

H2O sensor

Air flow
CO2 H2O

Stomata

Air tube
Open bottom
chamber

Inflow of air
 32
Solution: Canopy level
photosynthesis
Commercial prototype is available
Web app ”Photo[synthesis] Review” for multidevice
 Total conductance
Photosynthesis
stomatal opening
 Transpiration

CO2
Multi-device
 Stomata

H2O
33
Practical use: Commercially available 10th Sept. 2019
Press release and use
cases in Japan
 Nihon Keizai Shimbun
10 Sept. 19 Web

The Japan Agri News 10 Sept. 19

NHK TV news 9 Sept. 19 Asahi shinbun 10 Sept. 19

Press release informing the photosynthesis monitoring system for agricultural production was gathering much attention

Paid service in Japan

38 use cases
 Flower
Cucumber Strawberry Chrysanthemum Greenhouse horticulture of WUR

Topics
1．Current situation and outlook of plant factory
and intelligent greenhouse 2．Speaking plant
approach for sophisticated greenhouse production
① Chlorophyll fluorescence imaging robot ②
Photosynthesis monitoring chamber 3．
Optimization of agricultural production in
greenhouse based on daily plant data 4．
 Conclusion and prospective
35
Outline: MAFF project with plant growth monitoring
Optimization of labor management
Ministry of Agriculture, Forestry and Fisheries
Optimization of management of agricultural
Photosynthesis
monitoring chamber Labor management
Photosynthesis
production in greenhouse with AI 2017-2022
Distribution (Growth)

based on plant
growth
Optimization

Leaf
Stem
Fruits

Green fruits

Harvest

Red fruits
 More than 10% of labor

Plant imaging robot

cost can be reduced
36
Outline: MAFF project with plant growth monitoring
Optimization of harvesting with the robot
Color imaging by the robot
Red fruit area can be used as an
index of harvesting

5
 200000 160000 120000 Previous method red area (pixels)
Developed method

Harvesting[↑]
Yield (kg) y = 5E-05x
4 R² = 0.7275

0 30000 60000 90000

Red fruit area (Pixel) 2 0 120000 Decrease in
1
allows us to reduce the labor cost
80000

40000

0
9-Jan 15-Jan 21-Jan 27-Jan 2-Feb 8-Feb more than 10%
Date
Optimized assignment of labor
37
Prospective: Activities in the
Netherlands
Plant growth monitoring
techniques
based collaboration in NL

Commercial greenhouse
 Greenhouse horticulture of WUR

38
 agricultural production Standardized
measurement protocol provides big data
of plant growth

20

15

10

Plant growth monitoring

Conclusion
and prospective
AI in AG
Plant growth Agriculture

monitoring
210 310 410 510

indispensable for profitable

Enough reliability management of 20

・For daily
 characteristics can be growth monitoring and
found optimum supply chain

crop, labor, and energy DX of AG

Big
15

・For SDGs
10 Remote/Auto/Robot ・
data New digital strategy for
5

agricultural production
210 310 410 510

Breeding Machine
learning
Accurate ・AI for
phenotyping ・New plant
Thank you for your attention