You are on page 1of 10

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/342656783

Glass fissure and glass bubble defect detection in industrial pipeline in quality
control

Preprint · July 2020

CITATIONS READS

0 97

4 authors, including:

Ping Qiu
Xidian University
4 PUBLICATIONS   0 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Detection of defects on bottle View project

All content following this page was uploaded by Ping Qiu on 03 July 2020.

The user has requested enhancement of the downloaded file.


Glass fissure and glass bubble defect detection in
industrial pipeline in quality control
Xiaoli Sun, James Yang, Ping Qiu, Yanwen Hu
Xi’an Origin Image technology Group

Abstract: Nowadays, tube-like glass bottles and glasses containers are


very commonly used in storing chemical liquid in factory or edible food in
general stores. Two common quality issues with the glass containers or
bottles are glass fissures or glass bubbles or the ruptures. In this study,
we studies a few different existing methods to detect the brinks of glass
bottles for quality control. The methods uses 2D images and extract the
features from the images so that the features of the bottles defects can
be further analyzed. We compare the sensitivity of the detection of
defects on the brink. These methods all need further improvements for
direct usage in industry.

Keywords: image processing, feature extraction, defect detection,


contour, blob detection

I. Introduction
Food quality and safety is a big topic nowadays for both
government and ordinary people. Food quality is an important food
manufacturing requirement, because food consumers are susceptible
to any form of contamination that may occur during the manufacturing
process [1-2, 13-14]. If a bottle has defect, the safety and fresh quality
of the liquids held by this bottle cannot be ensured [3]. A good
container is a container that will go through the customer’s filling line
without causing any difficulty and will carry his product to the

1
consumer. Therefore, it is essential that before a container is released
for sale from the glass plant, it successfully passes an inspection with
standards set to meet the customer’s needs. There are approximately
one hundred defects which can develop in the container during the
production process, some beyond the control of the operator, for
example stones; but by far the largest number occur either in the
feeder or machine operation.
Detecting the bottle neck issues can be troublesome as they
usually need a lot of human interventions [4]. Image processing
methods can be widely used in detecting defects in industry. Federal
and medical image processing techniques really need help. Several
examples have been cited and discussed by other paper [18-21].
Usually, the first step in those image-based approaches is to take
2D photos of the region of interests [5-6]. There are tons of examples
of these framworks being implemented in the total merit of the image
processing techniques [3-8]. Several factories around the world start
to are replacing human labors by using robots and robot vision
replying on portable cameras and computer vision approaches to
detect the defects on their product, for instance the brink defect
detection. One example is at Xi’an No. 1 Industrial bottle supply line.
There are two major bottle defect: bottle brink fractures or bottle
bubbles. Example of the defect on the bottle neck brink is shown in
Figure 1.

2
Figure 1. Example of normal bottle top (right) and bottle top with defect
(left).

Bottle necks can be detected by many methods. However, the


methods for detecting the defects on the brink has some limitations
and need refinement. In our previous articles we have declared the

3
following methods: (1) Detect the contour of the bottle round shape
and analyze the roundness of it [12], or (2) use a template matching
method to compare the likelihood of an energy function [15-17].
In this research report, we compare the two methods in the recall
of accuracy of detection of bottle brink [16]. In the following
paragraphs we discuss the detail of our experiments and present the
results.

II. Methods
We collect glass bottles manufactured by a local factory from Xi’an
Origin Image group and Xi’an No 9 Factory for gas drink. The bottles
have three sizes: small, medium and large. The small and medium
bottles are used for storing drinkable liquids and sold by merchants
like restaurants, KTV, and soda bar on the streets. The larger bottle
is to store industrial liquid and has a higher requirement for safety
control. The average diameter of the small, medium and large bottles
are 5cm, 8cm and 14cm.
A snake energy based counter refinement method to extract the
contour of the bottle brink [7-8], and a template matching method from
a library of different images of bottle brinks [9] to try to extract the
circle on the bottle. Some deep learning methods [16] can also be
used to detect the locations of the bottle neck but we do not
implement them because the traditional image processing methods
are already good enough for our purpose.
The total procedures can be described as in Figure 2:
Region define

Snake energy Template matching

4
Contour extraction

Detect analysis

Figure 2. The experiment design

III. Results
We performed analysis on in total 444 bottles. Among the 444
bottles, 158 are small bottles, 106 are medium size bottles, and 180
are large bottles. The 444 bottles are gradually (within 5 months)
collected from 12 local merchants (including local restaurants, KTV,
juice bar, alcohol store, gas station, etc). There are 55 out of 158 small
bottles with defects on the brinks, 43 out of 106 medium size bottles
with defects on the brinks, and 145 out of 180 large bottles with
defects on the brinks. Large bottles tend to have more defects
because the region of interests is larger and they are usually used in
more complicated environment for more complex usages. The two
algorithms are implemented in Matlab on a computer installed
Windows 10. The algorithms are programmed with the open source
library OpenCV [10]. The results are shown below:
Table 1. Detection results.
Method 1 recall/ false Method 2 recall/false
positive number positive number
Large bottle 87% vs 9 28% vs 19
Medium size 91% vs 8 88% vs 16
Small bottle 88% vs 8 81% vs 4

5
From the Table matrix we can see that it is significant that method
1 is more robust when detecting defects on larger bottles. This is because
the method in method 1 does not rely on the size [11-12]. Method 2 only
has a library of small sized bottle brink pictures so it has less reliable
results in all three different sizes. Further analysis are needed [11].

IV. Conclusion
In this paper we presented a comparison between two methods for
detecting the defects on the glass bottle brink. We use image processing
algorithms and use a USB-camera to capture pictures of the bottle from
the top. We found out that the algorithms that use snake based method
is more reliable because it is not related with the actual size of the
objective bottles.

Acknowledgement: We received bottles from Xi’an No 9 factory for gas


drinks and Xi’an yule gas station. We would like to thank their kindness
for supporting this research.

References
[1]. U.S. Food & Drug Administration, Bottled Water Everywhere:
Keeping it Safe. Food and Beverages. April, 2019.
https://www.fda.gov/consumers/consumer-updates/bottled-water-
everywhere-keeping-it-safe.
[2]. 中国食品药品监督局. 《中华人民共和国药品管理法》 Aug 26, 2019.
[3]. LIU Guixiong, SHEN Baihua, FENG Yunqing, HU Cunyin, YI Jingrong.
Study of image segmentation based on improved Hough transform.
Optics and Precision Engineering. 2002.

6
[4]. F. Shafait, S. M. Imran and S. Klette-Matzat, "Fault detection and
localization in empty water bottles through machine vision," E-Tech 2004,
Karachi, Pakistan, 2004, pp. 30-34.
[5]. Hui-Min Ma, Guang-Da Su, Jun-Yan Wang and Zheng Ni, "A glass
bottle defect detection system without touching," Proceedings.
International Conference on Machine Learning and Cybernetics, Beijing,
China, 2002, pp. 628-632 vol.2.
[6]. James W. Snyder, Karen S. Benzing, Gina K. Munier, Grace D. Bostic,
Pamela S. Bozigar, Rami Hanna, Marcus J. Zervos. Clinical Comparison
of Nonvented Aerobic BacT/Alert Blood Culture Bottle and Standard
Aerobic Bottle for Detection of Microorganisms in Blood. Journal of
Clinical Microbiology Oct 2000, 38 (10) 3864-3866.
[7]. Yiyuan Zhao, Benoit M. Dawant, Robert F. Labadie and Jack H. Noble,
Automatic localization of closely spaced cochlear implant electrode
arrays in clinical CTs, Medical Physics. (2018).
[8]. Yiyuan Zhao, Benoit M. Dawant, and Jack H. Noble. "Automatic
selection of the active electrode set for image-guided cochlear implant
programming," Journal of Medical Imaging 3(3), 035001 (22 September
2016). https://doi.org/10.1117/1.JMI.3.3.035001
[9]. Ping Qiu et al. Image processing based method for checking defects
on bottle devices. XCVCOI Xi’an Computer Vision conference on
industrial, 2020. Vol 1, pp 3-8.
[10]. I. Culjak, D. Abram, T. Pribanic, H. Dzapo and M. Cifrek, "A brief
introduction to OpenCV," 2012 Proceedings of the 35th International
Convention MIPRO, Opatija, 2012, pp. 1725-1730.
[11]. A. Ishii, T. Mizuta and S. Todo, "Detection of foreign substances
mixed in a plastic bottle of medicinal solution using real-time video image
processing," Proceedings. Fourteenth International Conference on

7
Pattern Recognition (Cat. No.98EX170), Brisbane, Queensland,
Australia, 1998, pp. 1646-1650 vol.2.
[12]. Yiyuan Zhao, Benoit M. Dawant, and Jack H. Noble, "Automatic
localization of cochlear implant electrodes in CTs with a limited intensity
range", Proc. SPIE 10133, Medical Imaging 2017: Image Processing,
101330T (24 February 2017); https://doi.org/10.1117/12.2254569
[13]. Mayounga, A. T. (2018) "Antecedents of recalls prevention: analysis
and synthesis of research on product recalls." Supply Chain Forum: An
International Journal, 19(3).
https://doi.org/10.1080/16258312.2018.1530575
[14]. Monde Selection represents one of the oldest and most influential
organisations in terms of quality examination Archived 2 April 2012 at the
Wayback Machine, espiritu-de-chile.com
[15]. Zhao Y, Dawant BM, Labadie RF, Noble JH (2014) Automatic
localization of cochlear implant electrodes in CT. Med Image Comput
Comput Assist Interv 17:331–338
[16]. Yiyuan Zhao, Liang Zhao, Zhennan Yan, Matthias Wolf, and Yiqiang
Zhan "A deep-learning based automatic pulmonary nodule detection
system", Proc. SPIE 10575, Medical Imaging 2018: Computer-Aided
Diagnosis, 1057537 (27 February 2018);
https://doi.org/10.1117/12.2295368
[16]. i-Min Ma, Guang-Da Su, Jun-Yan Wang and Zheng Ni, "A glass
bottle defect detection system without touching," Proceedings.
International Conference on Machine Learning and Cybernetics, Beijing,
China, 2002, pp. 628-632 vol.2, doi: 10.1109/ICMLC.2002.1174411.
[17]. F. Shafait, S. M. Imran and S. Klette-Matzat, "Fault detection and
localization in empty water bottles through machine vision," E-Tech 2004,
Karachi, Pakistan, 2004, pp. 30-34, doi: 10.1109/ETECH.2004.1353840.

8
[18]. Yiyuan Zhao, Robert F. Labadie, Benoit M. Dawant, and Jack H.
Noble, "Validation of automatic cochlear implant electrode localization
techniques using μCTs," Journal of Medical Imaging 5(3), 035001 (24
September 2018). https://doi.org/10.1117/1.JMI.5.3.035001
[19]. Yiyuan Zhao, Robert F. Labadie, Benoit M. Dawant, and Jack H.
Noble, "Validation of cochlear implant electrode localization techniques",
Proc. SPIE 10576, Medical Imaging 2018: Image-Guided Procedures,
Robotic Interventions, and Modeling, 105761U (13 March 2018);
https://doi.org/10.1117/12.2293759
[20]. K. J. Pithadiya, C. K. Modi and J. D. Chauhan, "Comparison of
Optimal Edge Detection Algorithms for Liquid Level Inspection in
Bottles," 2009 Second International Conference on Emerging Trends in
Engineering & Technology, Nagpur, 2009, pp. 447-452, doi:
10.1109/ICETET.2009.55.
[20]. Yiyuan Zhao, Benoit M. Dawant, and Jack H. Noble "Automatic
electrode configuration selection for image-guided cochlear implant
programming", Proc. SPIE 9415, Medical Imaging 2015: Image-Guided
Procedures, Robotic Interventions, and Modeling, 94150K (18 March
2015); https://doi.org/10.1117/12.2081473
[21]. Z. Yepeng, T. Yuezhen and F. Zhiyong, "Application of Digital Image
Process Technology to the Mouth of Beer Bottle Defect Inspection," 2007
8th International Conference on Electronic Measurement and
Instruments, Xi'an, 2007, pp. 2-905-2-908, doi:
10.1109/ICEMI.2007.4350826

View publication stats

You might also like