Professional Documents
Culture Documents
Drying Technology
Publication details, including instructions for authors and subscription information:
http://www.informaworld.com/smpp/title~content=t713597247
To cite this Article Martynenko, A. I.(2006) 'Computer-Vision System for Control of Drying Processes', Drying
Technology, 24: 7, 879 — 888
To link to this Article: DOI: 10.1080/07373930600734067
URL: http://dx.doi.org/10.1080/07373930600734067
This article may be used for research, teaching and private study purposes. Any substantial or
systematic reproduction, re-distribution, re-selling, loan or sub-licensing, systematic supply or
distribution in any form to anyone is expressly forbidden.
The publisher does not give any warranty express or implied or make any representation that the contents
will be complete or accurate or up to date. The accuracy of any instructions, formulae and drug doses
should be independently verified with primary sources. The publisher shall not be liable for any loss,
actions, claims, proceedings, demand or costs or damages whatsoever or howsoever caused arising directly
or indirectly in connection with or arising out of the use of this material.
Drying Technology, 24: 879–888, 2006
Copyright # 2006 Taylor & Francis Group, LLC
ISSN: 0737-3937 print/1532-2300 online
DOI: 10.1080/07373930600734067
and moisture content was used for online estimation of actual moist-
ure content. A relationship between color intensity and quality was significant changes in the shape, color and texture of apple
used for online estimation of quality degradation. slices, produced by drying. However, the gap between
Experimental study of the CVS for ginseng drying showed image attributes and physical parameters of drying (moist-
advantages of computer-vision for online monitoring of important ure, quality) essentially limits the use of computer vision
state variables, such as moisture content and material quality. Color
measurements demonstrated high sensitivity of quality to drying for control of drying processes.
conditions: drying at 50C resulted in significant color changes The objective of this study was to develop a CVS for
and unacceptable quality degradation. The quality of roots in automated control of a drying process with practical appli-
three-stage (38-50-38C) drying process was compatible with recom- cation for ginseng root drying. Ginseng root is a good
mended isothermal (38C) drying due to significant (30–40%) example of temperature-sensitive biomaterial,[18] which
reduction of drying time. This control strategy was used in a pilot
batch dryer for temperature control with respect to quality. Testing requires careful thermal processing. The best temperature
of a pilot dryer with embedded CVS proved stability and robustness for ginseng root has been reported as 38C;[19,20] however,
of control strategy, combined with high accuracy in the estimation of drying at this temperature to target moisture 0.1 g=g (db)
moisture content (8–14% of error with 95% confidence). The takes about two weeks. Increasing the temperature to
composite moisture measurements at the endpoint demonstrated 45–50C essentially accelerates drying; however this results
uniform drying of root mixture to target moisture content 0.1 g/g
(db) with minor variations between individual roots in the range of in undesirable browning.[19] To avoid quality degradation
0.07–0.12 g/g. Li[21] proposed a three-stage temperature control 38-50-
38C; changing air temperature according to the critical
Keywords Color; Ginseng; Machine-vision; Moisture; Quality; root moisture content. As highlighted by Davidson
Shrinkage et al.,[22] a lot of complex mechanisms are involved in qual-
ity changes, which make it difficult to control.
INTRODUCTION A ginseng quality is specified as a desirable color, tex-
The use of computer-vision for industrial control keeps ture, and moisture content.[23] All of these variables are
on growing.[1,2] Recent advances in software development measurable with computer-vision. It follows that appropri-
essentially extended the area of computer-vision applica- ate control of ginseng drying can be developed on the
tions for fruit grading,[3] cereal grain classification,[4–7] basis of computer vision and online image processing. To
apple slices dehydration,[8] and food inspection.[9–11] achieve the objective, the procedures of image segmen-
Computer-vision offers a tremendous resolution for the tation, feature extraction, and data analysis for ginseng
roots were developed. Relationships between image
Correspondence: A. Martynenko, School of Engineering, attributes and physical parameters of drying (moisture
University of Guelph, Guelph, ON, Canada N1G 2W1; E-mail: and quality) were established.
omartyne@uoguelph.ca
879
880 MARTYNENKO
index about 95%. Image capturing, processing, and sub- IMAQ 6.1 enabled the quantification of surface area,
sequent analysis were performed online using a LabVIEW length, width, radius, shape factor, and their statistical
graphical interface. (mean and variance) characteristics. Length-to-width
ratio was used for the identification of object orientation
in the XOY plane. To distinguish the object area from
Image Analysis isolated small clusters of pixels, the procedure of multi-
An image analysis included image segmentation, threshold filtering with next particle analysis was applied.
features extraction, and data analysis. Image segmentation Object area was determined as the largest object on the
was designed to separate region of interest (ROI) from binary image. Overall surface area was obtained by the
background. Extraction of morphological, color, and conversion of ‘‘1’’ pixels of binary image into area
textural features was provided every hour with the library through the conversion coefficient of 0.01 mm2=pixel with
of virtual instruments, embedded in NI-IMAQ6.1. Image the next multiplication by p for cylindrical geometry.
features, determined as time-dependent variables, were
Color Features. Color features were extracted as means
used further in data analysis to calculate physical (moisture
and variances of red (R), green (G), and blue (B) channels
and quality) and rate (drying rate, quality degradation)
in RGB color space and color intensity (I) in HSI color
parameters of drying.
space. To avoid effects of size sampling on color intensity
distribution, the number of pixels for each intensity line
Image Segmentation was normalized with respect to the overall number of
The first step of the image analysis was image segmen- pixels in the extracted area. The histogram of color
tation. This algorithm, based on edge detection, operated intensity was treated as a fuzzy variable with lightness
by finding the optimal threshold in RGB color space that as a support. Average color intensity was calculated from
maximizes the difference between images. The output intensity histogram on the basis of center-of-gravity
[0,256] gray image was then converted into binary [0,1] defuzzification.[24] Means and variances were used to test
image with 1 assigned to the object and 0 assigned to the statistical hypothesis (F-test) of color changes on each
background. This binary image was used for two purposes: interval of observation.
(a) estimation of morphological features (area) and (b) The flow chart of features extraction is shown in Fig. 2.
masking original color image for extraction of color and
textural features. Multiplication of the original image on
its binary mask enabled a conversion of all background Drying Chamber
pixels to zero intensity pixels and elimination this class Drying of ginseng roots was carried out in a specially
from next calculations. designed drying chamber (Fig. 3). For automated monitoring
COMPUTER-VISION SYSTEM FOR CONTROL OF DRYING PROCESSES 881
Samples
FIG. 2. Flow chart of feature extraction.
The ginseng roots were obtained from Hare Farms
(Waterford, Ontario) in October 2004. Both harvests were
taken from four-year ginseng plots. Ginseng population
contained roots of different shapes and sizes in the range
of visual color and area changes during drying the
from 4 to 40 mm in diameter. Fresh ginseng roots were
chamber was made from a 190-cm-long Plexiglas tube with
stored in a refrigerator at 5 2C during the experimental
an inside diameter of 40 cm. It was connected to an air
study period (3 months). Prior to each drying experiment,
conditioning unit that produced constant airflow with regu-
roots were washed and care was taken to drain the roots
lated temperature and humidity. Temperatures of air and
and remove surface water.
root were measured with identical T-type thermocouples
with a spherical junction 0.85 mm in diameter. Measure-
ments with the thermocouples were made using an interface Data Analysis
card NI PCI-6220 (National Instruments) with built in Data analysis was provided to relate the set of morpho-
cold-junction compensation in the control computer. Based logical, color, and textural features with the set of physical
on the calibration, absolute error associated with the parameters of drying (moisture, quality). Moisture content
882 MARTYNENKO
was calculated from continuous weighing on a dry matter was tested on the basis of Fisher criteria with 0.95 confi-
basis (g=g): dence level. The average moisture content and color of
mðtÞ mdm ginseng roots in each batch were determined on the basis
X¼ ð1Þ of composite sample measurements.
mdm
The dry matter weight (mdm) was determined after each
experiment based on 24-hour oven drying at 102C. Aver- RESULTS AND DISCUSSION
age moisture values were estimated at hourly intervals.
An exponential equation was used to describe moisture Image Segmentation
changes over time: The first step in image analysis was image segmentation.
The original color images of the ginseng batch at the begin-
X ðtÞ ¼ Xe þ ðX0 Xe Þekt ð2Þ ning (a) and at the end of drying (b) are shown in Figs. 4a
and b. Images represent the random mixture of ginseng
or in dimensionless form: roots without a contrast background, so it makes difficult
X ðtÞ Xe to segment underlying layers by simple filtering.[8] Hence,
wðtÞ ¼ ¼ ekm t ð3Þ the special algorithm of image segmentation, relevant to
X0 Xe
physical shrinkage of ginseng roots, was developed. Pre-
Equilibrium moisture content (Xe, g=g db) was determined vious experiments showed that the area shrinkage of
from ginseng sorption isotherms.[21] The effect of root fully-exposed ginseng roots at the end of drying is about
maturity on equilibrium moisture content was neglected. 0.5 0.5 of the initial area.[25] This knowledge was used
The initial moisture content (X0) was verified based on as the reference point to normalize area ratio in the range
the mass measurements at the end of the experiment and [1,0] with 1 assigned to the initial state (fresh roots) and
0 to the final state (dried roots).
Downloaded At: 03:29 21 January 2011
by Fernandez et al.[8]
individual roots (0.55–0.45). Area shrinkage n(t) was calcu- The relationship between dimensionless values of
lated as a time-dependent dimensionless variable, changing shrinkage and moisture content is shown in Fig. 6. It was
from 1 (initial state) to 0 (dried state): linear in the range from 0.9 to 0.1 of moisture content:
Ai Ae
ni ¼ ð4Þ w ¼ an þ b ð6Þ
A0 Ae
The example of area shrinkage of ginseng roots during with a ¼ 1.0124, b ¼ 0.0755, standard error 0.016, and
100 h of drying at temperature 38C, relative humidity R2 ¼ 0.99. The linear relationship between shrinkage and
12% and air flow rate 1 m=s is presented in Fig. 5. Kinetics moisture ratio in this range could be related to the phenom-
of shrinkage followed exponential behavior in all experi- enon of free water evaporation.[26] A small deviation from
ments over the range of experimental conditions from linearity at the beginning of drying (1–0.9) can be explained
38C to 50C, from 12 to 25% relative humidity, and air
velocity from 1 m=s to 3 m=s. In time domain it could be
expressed as an exponential model:
TABLE 1
Averagea color intensity of fresh and dry roots in RGB
color space
Fresh Dry Difference p-Value
Red (R) 250 2.5 249 12.5 1 0.7645
Green (G) 185 15 151 17.5 34 0.0189
Blue (B) 50.5 8.8 44 10.4 6.5 0.4141
a
Mean values and standard deviations (95% confidence) were
calculated from four identical drying experiments (38C tempera- FIG. 6. Relationship between area shrinkage and moisture ratio (trian-
ture, 1 m=s air velocity, and 12% relative humidity). gles, 38C; circles, 50C; line, regression).
884 MARTYNENKO
by the effect of quick collapse of porous cellular structure. be used as a process variable for monitoring of quality
Deviation from linearity at the end of drying (below 0.1) degradation in ginseng drying process.
can be related to critical water content 0.25–0.3 g=g (db).
Below this critical point the area shrinkage is not correlated
EVALUATION OF THE CVS PERFORMANCE FOR
with moisture losses.
FEEDBACK CONTROL
Performance of the CVS for control of drying processes
Color Features (Color Intensity) was tested in industrial conditions on pilot batch dryer.
Color intensity was extracted as a mean value of histo- Since the bulk average moisture content cannot be mea-
gram of color intensity distribution in HSI color space. sured directly, it was estimated using CVS observer. Esti-
Kinetics of color changes during drying at different air mated moisture content was used as a global feedback
temperatures are presented in Fig. 7. parameter for the identification of the drying stage and
It follows that color degradation was proportional to dry- adjustment of the drying conditions according to the speci-
ing time and air temperature. The rate of color degradation fied control strategy. Subsequently, the control system
was 0.056 h1 at the temperature 38C, and 0.29 h1 at the consisted of three modules: CVS observer, estimator, and
temperature 50C. The increase of rate with temperature controller (Fig. 8).
can be explained with Arrhenius-type temperature depen- CVS observer identified area shrinkage n(t) and color
dence of non-enzymatic browning.[27] From drying experi- C(t) of ginseng roots in the batch as a time-dependent pro-
ments at the recommended temperature 38C it was cess variable. The estimator was a real-time module, which
concluded that the acceptable level of ginseng browning is used the information from the CVS observer about shrink-
above 158 of color intensity. However, 40 h drying at age at a particular temperature T to estimate the rate con-
50C resulted in unacceptable browning of ginseng roots stant ks,T by fitting to the exponential model (Eq. (5)). It
(color intensity 154). Three-stage drying (38-50-38C) was running in a regime of continuous loop execution in
Downloaded At: 03:29 21 January 2011
provided color intensity at the end of drying at the threshold the range i ¼ 3, . . . , 1, delivering a dynamic set of coeffi-
value 158. It seems that three-stage drying can be a good cients {n0, ks, ne} of shrinkage model.
alternative of isothermal drying, providing acceptable From inputs ks,T, Xe, and Xc1,2,3 the estimator calculated
material quality, which is compatible with isothermal 38C current bulk average moisture content Xi (Eq. (2)) and time
drying. estimate test to the next critical control point Xc:
Color changes measured by image analysis and standard
colorimeter gave high average correlation with R2 ¼ 0.95. 1 Xi Xe
test ¼ ln ð7Þ
These results were similar to those, reported for chromatic ks;T Xc Xe
parameters ‘‘a’’ and ‘‘b’’ in lab color space, reported by
Krokida et al.[28] and Fernandez et al.[8] It follows that The estimate of moisture and time {Xi, test} were used as
color intensity of root surface, measured with CVS, can an input to the digital controller to adjust the drying tem-
perature according to moisture content.A three-stage strat-
egy of ginseng drying[21] entailed online identification of
three critical control points: bulk average moisture content
Xc1 ¼ 1.0 g=g (db) to change the drying temperature from
38 to 50C; bulk average moisture content Xc2 ¼ 0.25 g=g
db to turn back from 50 to 38C; and bulk average moist-
ure content Xc3 ¼ 0.1 g=g db to stop drying. Observer and
controller were developed as reconfigurable LabVIEW
to both predicted and experimental data. 38C (coefficient of determination R2 ¼ 0.93 and
RMSE ¼ 0.0008 h1). However, for high temperature
Testing of Accuracy in Moisture Estimation (50C) there was no linear relationship between the esti-
The shrinkage=moisture relational model (Eq. (6)) was mated ks-values and experimental km. At 50C the drying
used to predict moisture content in the critical control rate was slower than shrinkage kinetics. It can be con-
points with the bulk moisture content Xc1 ¼ 1.0 g=g, cluded that for high (50C) temperature the shrinkage-
Xc2 ¼ 0.25 g=g, Xc3 ¼ 0.1 g=g (db). The real values of bulk moisture model has a tendency to overestimate the real
average moisture content were determined from balance kinetics of moisture transfer.
readings in three-stage batch drying experiments (Fig. 9). Taking into account the temperature 38C for the third
Prediction error was calculated as a sum of squared errors stage of drying, the shrinkage-moisture relational model
(SSE) with respect to each control point. It followed that was used for estimation of average moisture content at
moisture content in the critical control point could be pre-
dicted with a standard error of 4–6%. Results of calculation
FIG. 9. Estimation of moisture in critical control points with CVS for FIG. 10. Relationship between estimated ks and km and for three-stage
nine three-stage batch drying experiments. batch drying at 38C (circles) and 50C (squares).
886 MARTYNENKO
TABLE 3
Moisture content at the endpoint of drying: estimation vs.
experiment
Average bulk
moisture content
Composition Measured
Experiment of root sizes Estimate value Deviation
10 ‘‘Normal’’ 0.1 0.13 0.03
11 0.1 0.14 0.04
12 ‘‘Small’’ 0.1 0.09 0.01
13 0.1 0.07 0.03
14 0.1 0.09 0.01
15 ‘‘Large’’ 0.1 0.11 0.01
16 0.1 0.10 0.00
17 0.1 0.11 0.01
the endpoint. The results of the experimental estimation of FIG. 11. Estimation of time in critical control points with CVS for
average moisture content and direct moisture measure- three-stage batch drying experiments.
ments at the endpoint of drying are summarized in Table 3.
The discrepancy between the estimated and measured
values of bulk average moisture content may be related
Downloaded At: 03:29 21 January 2011
first critical control point t1 and an overestimation at the controller (Lab View 7.0). Experiments showed the
second point t2. At the endpoint of drying, the estimation stability and robustness of the control system, combined
of t3 was close to the prediction. with high accuracy in the estimation of drying time
The error in estimating the critical control points was (8–14% of error with 95% confidence). The discrepancy
not evenly distributed on the drying cycle. For the first between the estimation of moisture from the shrinkage=
critical control point (Xc1 ¼ 1.0 g=g), the error of time moisture relational model and direct measurements did
prediction was greatest (11%). For the second critical point not exceed 20%. Composite moisture measurements at
(Xc2 ¼ 0.25 g=g), the error was about 8%. The minimal the endpoint demonstrated the uniform drying of root
error 5% occurred at the endpoint of drying (Xc3 ¼ mixture to the average moisture content of 0.1 g=g, with
0.1 g=g). It follows that towards the end of drying the accu- minor variations between individual roots in the range of
racy of time prediction increases. The moisture content 0.07–0.12 g=g.
estimate X(t) was used as a dynamic variable in global con- The results demonstrated the feasibility of CVS as an
trol loop, providing observability of the drying process. accurate online tool for a closed-loop food drying. Data
Color degradation was estimated as an independent extracted from image analysis represent both quality
dynamic variable with another model (see Fig. 7). This factors perceived by consumers (color, texture) and process
estimate was used to prevent quality degradation below parameters (moisture content, drying rate), important for
specified threshold. Errors for estimation of moisture con- the development of ‘‘smart’’ drying technologies.
tent and quality were calculated as discrepancy between
estimation from the observer and direct measurements.
Additionally, the user-friendly graphical interface was ACKNOWLEDGMENTS
developed. The operator was able to specify drying con- I would like to express my gratitude to Dr. Valerie
ditions (temperatures for each stage of drying, relative Davidson and Dr. Ralph Brown, who helped me very
much with valuable comments. I would like to express spe-
Downloaded At: 03:29 21 January 2011
13. Lotch, P. Full color image analysis as a tool for quality control and 21. Li, X. Improved Ginseng Drying with Three-Stage Temperature
process development in the food industry. In 1997 ASAE Annual Control; M.Sc. Thesis. University of Guelph: Guelph, ON, 2002.
International Meeting Technical Papers, Paper No. 973006, 1997. 22. Davidson, V.J.; Li, X.; Brown, R.B. Forced-air drying of ginseng
14. Tao, Y.; Heineman, P.H.; Varghese, Z.; Morrow, C.T.; Sommer, H.J., roots: 1. Effects of air temperature on quality. Journal of Food Engin-
III. Machine vision for colour inspection of potatoes and apples. eering 2004, 63, 361–367.
Transactions of the ASAE 1995, 38 (5), 1555–1561. 23. Grade and Quality Standards of Products of Processed American
15. Sonka, M.; Hlavac, V.; Boyle, R. Image Processing, Analysis, and Ginseng; The State Standard of People’s Republic of China GB=T
Machine Vision; PWS Publishing: CA, 1999. 17356.1-98, 1998.
16. Da Fontoura, L.; Marcondes, R., Jr. Shape Analysis and Classi- 24. Jang, J.S.R.; Sun, C.T.; Mizutani, E. Neuro-Fuzzy and Soft Comput-
fication: Theory and Practice; CRC Press: NJ, 2001. ing; Prentice-Hall.
17. Du, C.J.; Sun, D.W. Learning techniques used in computer vision for 25. Martynenko, A.I. Computer-Vision Control System for Ginseng
food quality evaluation: A review. Journal of Food Engineering 2006, Drying; Ph.D. Thesis. University of Guelph: Guelph, ON, 2005.
72, 39–55. 26. Ratti, C. Shrinkage during drying of foodstuffs. Journal of Food
18. Kudra, T.; Strumillo, C. Thermal Processing of Biomaterials; Gordon Engineering 1994, 23, 91–105.
and Breach Science Publishers: Amsterdam, 1998. 27. Labuza, T. Water Activity and Sorption Isotherms; IFT Short Course,
19. Li, Y.R.; Morey, R.V. Thin-layer drying rates and quality of cultivated University of Minnesota.
American ginseng. Transactions of ASAE 1987, 30 (3), 842–847. 28. Krokida, M.K.; Maroulis, Z.B.; Saravacos, G.D. The effect of the
20. Sokhansanj, S.; Bailey, W.G.; van Dalfsen, K.B. Drying of North method of drying on the colour of dehydrated products. International
American ginseng roots (Panax quinquefolius L.). Drying Technology Journal of Food Science and Technology 2001, 36 (1), 53–59.
1999, 17 (10), 2293–2308.
Downloaded At: 03:29 21 January 2011