Professional Documents
Culture Documents
Development of Real-Time Vision-Based Fabric Inspection System
Development of Real-Time Vision-Based Fabric Inspection System
Abstract—Quality inspection of textile fabric products is an im- fabric defects is critically important in the textile industry. In
portant problem for fabric manufacturers. This paper presents an particular, if there is a defect, it reduces the price of the fabric
automatic vision-based system for the quality control of web tex- by 45%–65%. To increase the overall quality, homogeneity of
tile fabrics. Typical web material is 1–3 m wide and is driven with
speeds ranging from 20 to 200 m/min. At present, the quality in- fabric, and reliability, an automated visual inspection system is
spection process is manually performed by experts. However, they needed for better productivity. A typical web material is 1–3 m
cannot detect more than 60% of the overall defects for the fabric wide and is driven with speeds ranging from 20 to 200 m/min.
if it is moving faster than 30 m/min. To increase the quality and Even in the best cases, experts can detect no more than 60%
homogeneity of fabrics, an automated visual inspection system is of the real defects, and they cannot deal with fabric wider than
needed for better productivity. Currently, the existing inspection
systems are too expensive for small companies. In this paper, a 2 m and moving faster than 30 m/min. Many attempts have
PC-based real-time inspection system is proposed with benefits of been made to solve these problems. For example, Cohen et
low cost and high detection rate. The proposed algorithm showed al. [6] used Markov Random Field (MRF) models for defect
good results for several types of fabric defects. inspection of fabric surfaces. Chen and Jain [7] used a structural
Index Terms—Automated inspection, fabric defects, textile approach to detect defects in textured images. Dewaele et al.
fabric inspection, vision-based system. [8] used signal processing methods to detect point defects and
line defects in texture images. Atalay [9] has implemented
an MRF-based method on a TMS320C40 parallel-processing
I. INTRODUCTION
system for real-time defect inspection of fabrics. The majority
Authorized licensed use limited to: Pontificia Universidad Catolica Del Peru. Downloaded on April 03,2023 at 15:59:48 UTC from IEEE Xplore. Restrictions apply.
1074 IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL. 52, NO. 4, AUGUST 2005
Authorized licensed use limited to: Pontificia Universidad Catolica Del Peru. Downloaded on April 03,2023 at 15:59:48 UTC from IEEE Xplore. Restrictions apply.
CHO et al.: DEVELOPMENT OF REAL-TIME VISION-BASED FABRIC INSPECTION SYSTEM 1075
Authorized licensed use limited to: Pontificia Universidad Catolica Del Peru. Downloaded on April 03,2023 at 15:59:48 UTC from IEEE Xplore. Restrictions apply.
1076 IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL. 52, NO. 4, AUGUST 2005
Authorized licensed use limited to: Pontificia Universidad Catolica Del Peru. Downloaded on April 03,2023 at 15:59:48 UTC from IEEE Xplore. Restrictions apply.
CHO et al.: DEVELOPMENT OF REAL-TIME VISION-BASED FABRIC INSPECTION SYSTEM 1077
2
Fig. 8. (a) Gray-level fabric image f (i; j ) (200 200) with three defects. (b) Binary image B (i; j ) obtained as a result of thresholding operator. (c) Binary
f g
image obtained after filtering of image B (i; j ) by erode operation B = 1; 1; 1 . (d) Binary image obtained after labeling. (e)–(g) Defect subimages obtained
from input image f (i; j ).
on morphology is indicated as A B which means the erosion applied. During a labeling process, other information of defects
of A by B (structuring element). When B passes through the (such as area, position, and width vertical size, etc.) can be ob-
image from the top left to the bottom right, it convolutes B with tained. At this step, we found the areas and the number of de-
some area of the image. If the convoluted result is 1 in all scopes fects. If the labeling number is 1 or above, it is stored in queue
of B, the center pixel of convoluted image area marks in 1. If no, memory until it becomes 0 in the successive images. This is the
it marks 0. The size of structuring element B influences the cal- reason that there is a high probability to be continuously found
culation speed. Therefore, a structuring element is decided on in the next image if any defect is found in one line image. If no
by the maximum size of a noise and minimum size of a defect. more defects appear in the next image, a size and kind of de-
Fig. 8(c) shows the resulting image after the erosion process. fect are extracted from the stored information. Fig. 8(e) and (f)
The structuring element B is . We can finally get ob- shows the stored images in the queue memory after the labeling
vious defects having a clear form through the binary, filtering, process.
and erosion process.
IV. EXPERIMENTAL RESULT
C. Defect Extraction
The proposed inspection system is for finding the contami-
To reduce the image-processing time, the mean value filter nation or defects of textile fabrics with fine web surface in the
and erosion algorithm are carried out on each line image. The industrial field. Because the minimum size of a defect is 1 mm ,
vertical noise component was not removed yet because of the the error will be detected in at least 25 pixels when the inspec-
processing time. To remove the vertical noise, the predefined tion resolution is set to 0.2 mm. According to the filtering al-
size filter is used, and it is defined as the size of a minimal defect gorithm for noise, the defect larger than the area of 0.64 mm
(i.e., 1 mm ). When is calculated as in (8), the detected composed of 16 pixels could be detected. The inspection algo-
defect is considered as a noise component if it is smaller than rithm was applied on the representative defects such as the warp
the size filter float, broken pick, hole, oil spot, and spot. Fig. 9 shows the ex-
perimental results applied on five different defects. Fig. 9(c)–(e)
Minimum horizontal size of defect after erosion represent the nearly perfect recognition rate on an oily spot and
process vertical length of defect (8) spot. However, Fig. 9(a) and (b) represents an 80% recognition
rate on the warp and pick float. The reason was that the den-
Generally, the size filter is carried out during the labeling sity of the defects was different from each other. The density of
process because it will increase the inspection time if it is carried the oily spot and plain spot were relatively high, but that of the
out after the labeling process. The labeling algorithm should find warp and pick float were low. Nevertheless, the recognition rate
all connected components in one image. If some components was more than 60% when compared with experts. If we want
are connected, it has the same labeling value. The labeling algo- to increase the recognition rate, it is necessary to decrease the
rithm used is row-by-row labeling. Fig. 8(d) shows the resulting low-frequency noise as shown in Fig. 7. To reduce the range of
image from the labeling process. The minor noise components threshold value between and , it is possible to use spe-
of Fig. 8(c) were removed when the labeling and size filter were cial lighting conditions such as a high-frequency fluorescent or
Authorized licensed use limited to: Pontificia Universidad Catolica Del Peru. Downloaded on April 03,2023 at 15:59:48 UTC from IEEE Xplore. Restrictions apply.
1078 IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL. 52, NO. 4, AUGUST 2005
Fig. 9. Detected (a) warp float, (b) broken pick, (c) hole, (d) oil spot, and (e) spot.
Authorized licensed use limited to: Pontificia Universidad Catolica Del Peru. Downloaded on April 03,2023 at 15:59:48 UTC from IEEE Xplore. Restrictions apply.
CHO et al.: DEVELOPMENT OF REAL-TIME VISION-BASED FABRIC INSPECTION SYSTEM 1079
Byeong-Mook Chung (M’02) was born in Busan, Moo-Jin Park was born in Uisung, Korea, in
Korea, in 1960. He received the M.S. and Ph.D. de- 1976. He received the M.S. degree in mechanical
grees in mechanical engineering from the Korea Ad- engineering from Yeungnam University, Gyoengsan,
vanced Institute of Science and Technology, Daejeon, Korea, in 2003.
Korea. He is currently with Textec Company, Ltd., Daegu,
From 1985 to 1995, he was with LG Electronics Korea, working in the field of textile machinery. His
Inc., working in the field of automation and com- present interests are factory automation, automated
puter-aided inspection. Since 1995, he has been a visual inspection, and knowledge-based control.
Professor in the Department of Mechanical Engi-
neering, Yeungnam University, Gyongsan, Korea.
In 1999, he was a Visiting Scholar for one year
at the University of California, Berkeley. His special interests are automatic
inspection and knowledge-based control.
Authorized licensed use limited to: Pontificia Universidad Catolica Del Peru. Downloaded on April 03,2023 at 15:59:48 UTC from IEEE Xplore. Restrictions apply.