Professional Documents
Culture Documents
ScienceDirect
Yong Jie Zhao, Yun Hui Yan, Ke Chen Song, Hao Nan Li *
School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China
Article history: Optical glass K9 is a critical kind of optical materials, however experiments have indicated
Received 4 May 2017 that the mechanical grinding of K9 easily led to subsurface damage (SSD). Although
Accepted 25 July 2017 substantial SSD measurement methods have been suggested, the problems including the
Available online 1 September 2017 prior knowledge of SSD and slow measurement speed still impede the reported method
applications. To this end, this paper has presented an image-process-based method that can
Keywords: identify and measure the grinding-induced SSD in K9 specimens. By performing grinding
Measurement trials, the method has been found to be able to accurately (with biggest relative error of 3.13%
Optical glass in comparison with the manually measured results) and quickly (with the measurement
Image processing speed of 1.68 s per image) measure SSD depths. Without any parameter presetting, the
Subsurface damage method enables automatic SSD measurements, allowing the users without SSD knowledge
Grinding to be able to use the method. Moreover, the method has shown the good robustness to the
input image size, illumination, tilted specimen placement, and material flaws. The method
is therefore anticipated to be meaningful for the industrial manufacturing, design and
application of optical glass.
© 2017 Politechnika Wrocławska. Published by Elsevier Sp. z o.o. All rights reserved.
* Corresponding author.
E-mail address: lhnlwfb@163.com (H.N. Li).
http://dx.doi.org/10.1016/j.acme.2017.07.009
1644-9665/© 2017 Politechnika Wrocławska. Published by Elsevier Sp. z o.o. All rights reserved.
archives of civil and mechanical engineering 18 (2018) 320–330 321
Fig. 3 – (a) The basic principle of the recognition of the ground specimen surface based on the dark region, (b) the converted
gray SSD micrograph, (c) the edge detection result by using the Canny edge detector, (d) the extraction of the bottom profile of
the dark region, (e) the morphological erosion, (f) the morphological reconstruction, (g) the linear fitting, and (h) the final
detection result of the ground specimen surface.
archives of civil and mechanical engineering 18 (2018) 320–330 323
(ii) Because from the cross-section view the ground surface refers to the dilation operation, i.e. [17]
should be, in theory, a profile with the micro-scale details ~ 2 Þ \ Hk Hk g:
Hk B2 ¼ fajðB (3)
a
(e.g. the roughness and waviness), the classic multi-scale
Canny edge detection algorithm [16] is therefore employed The SSD micrographs processed by the morphological
to the captured SSD micrographs so that the ground surface erosion and reconstruction algorithms are separately
profile (see 'A' in Fig. 3c) can be successfully detected. presented in Fig. 3(e) and (f), where the false detected
(iii) The next step to identify the ground surface is to extract ground surface pixels are effectively removed.
the upper part of the detected edges in Fig. 3(c) by keeping (v) The ground surface is approximately considered as the
the uppermost pixel of the detected edges in each pixel linear fitting result of the extracted uppermost pixels of
column of the micrograph and removing all the other the ground surface profile given in Fig. 3(f). The basic
detected edge pixels (Fig. 3d). fitting function form is set as y = ax + b, therefore the tilted
(iv) Some false ground surface pixels (see 'B' in Fig. 3d) may be angle b of the specimen can be expressed as b = arctan(a).
kept due to the discontinuity of the ground surface in
certain pixel columns. To fix this, the morphological 2.3. Recognition of the subsurface cracks
erosion-reconstruction algorithm is employed. Morpho-
logical erosion can be considered as an operation that can After the ground surface is recognized, the deepest SSD depth
effectively recognize certain specific features and then should also be determined by the following steps:
present the features by using the merged structure.
Suppose I is the binary data of Fig. 3(d), the morphological (i) The revised saliency estimation method is performed
erosion operation can be mathematically expressed as [17] to the converted gray images. The revised method is
similar to the classic one proposed in Ref. [18], but the
O ¼ IQB1 ¼ fajðB1 Þa Ig (1) difference is all the operations are performed to the gray
value of each pixel, rather than to the 3D color data in
where the structure element B1 is set as [1,1,1,1,1,1,1,1] to the CIELAB color space. When the image coordinate origin
recognize straight lines. is defined as the left-top corner of the image (see the
Morphological reconstruction can expand the erosion coordinate in Fig. 4), then the revised method can be
result by iteratively presenting certain features, i.e. [17] mathematically expressed as:
Pxþx0 Pyþy0
xx0 yy0 Gðx; yÞ
Hkþ1 ¼ ðHk B2 Þ \ I (2) Sðx; yÞ ¼ k Pðx; yÞk (4)
A
where Hk denotes the reconstructed result after the kth where G(x,y) is the gray value of the pixel locating at
iteration (k = 1, 2, 3. . .), the structuring element B2 is set as the coordinate (x,y), S(x,y) is the saliency value of this pixel,
2 3
1 1 1 P(x,y) is the pixel gray value filtered by the Gaussian filter,
4 1 1 1 5 to expand certain features, and the operator
A is the total number of the pixels within the neighboring
1 1 1
Fig. 4 – The results by performing the (a) revised saliency estimation, (b) threshold segmentation, (c) morphological erosion,
and (d) morphological reconstruction.
324 archives of civil and mechanical engineering 18 (2018) 320–330
Fig. 6 – (a) illustration of the scale bar region, bar length, digits and unit character, (b) results by using the sobel edge detector
[20], (c) recognition of the scale bar region and bar length, and (d) digits and unit characters are extracted by removing the
scale bar from the scale bar region.
the second and the third peaks in summed gray values among As seen in Fig. 7, all the grinding trials have been performed
all the columns in the image (see Fig. 6c). on the grinding machine tool (M7150, Shenyang Machine Tools
For the step (ii), the digits and the unit characters are Co.) by using the diamond grinding wheel (D120N100V751/8, JR
extracted by removing the scale bar from the scale bar region in Diamond Tools Co.). Before the trials, the wheel has been
the original image (see Fig. 6d). The digit and character dressed by another diamond wheel (D80S100V61/6, JR Diamond
recognition is implemented by using the template matching Tools Co.) with the dressing ratio of -0.6 and dressing depth of
technique [21] with the templates including the digits from 0 to 9 15 mm (10 times). During the trials, the K9 specimen has been
and the characters 'd', 'c', 'm' and 'm' so that all the possible units fixed on the jig, and a wide range of grinding parameters (see
automatically generated by the microscope can be captured. Table 1) have been used so that different depths of SSD can be
For the step (iii), assuming the recognized digit and the unit
is lc, the realistic SSD depth SSD can be expressed as:
lc
SSD ¼ SSDpixel : (11)
Nc
Fig. 8 – The comparison of the manually measured SSD values and the values obtained by the proposed method when
different grinding parameters have been used.
archives of civil and mechanical engineering 18 (2018) 320–330 327
Fig. 9 – The comparison between the SSD values reported in Ref. [13] and the ones detected by the proposed method.
obtained. The SSD measurement method has been completely from 24.27 mm to 34.71 mm. Among the comparisons of all the
the same as the one suggested in Refs. [9–11]. three SSD micrographs provided in Ref. [13], the biggest
relative error is only 4.71% while the smallest one even reaches
2.10%, proving the proposed method accuracy to a large extent.
4. Validation and discussion
4.2. Measurement speed and automaticity
By comparing the manually measured SSD values and the
values obtained by the proposed method, the method By measuring the SSD depths in the 12 micrographs given in
evaluation is performed from the following three aspects: Fig. 10, the total SSD measurement time is found to be 20.12 s
the measurement (i) accuracy, (ii) speed and automaticity, and (the employed computer is InterCore i7-6500U 2.5 GHz),
(iii) robustness. meaning the method measurement speed is 1.68 s per image.
It would be almost impossible for the manual measurement to
4.1. Measurement accuracy be faster than this speed, even for the highly skilled operators,
indicating the advance of the automatic SSD measurement.
4.1.1. For the micrographs captured in grinding trials It is also noteworthy that, as long as the original images are
Fig. 8 presents the validation result of the method accuracy. It inputted into the proposed algorithm, the method can
can find that, although a wide range of grinding parameters automatically measure SSD depths without the requirement
have been used and the SSD depths cover from 4.95 to of any parameter presetting. This high automaticity allows the
24.17 mm, a good agreement between the manually measured users, even without any prior professional knowledge about
SSD values and the values obtained by the proposed method is SSD, to be able to use the proposed method.
presented. The biggest relative error is only 3.13%, while for the
other three sets of comparisons the relative errors are all 4.3. Method robustness
smaller than 2%. Considering the SSD depths in the industrial
grinding process are commonly within the range from 5 to As mentioned above, the realistic SSD images may be various
15 mm [9,10], the proposed method is anticipated to be able to in terms of the image size, the surrounding illumination, the
measure SSD depths with high accuracy. tilted angle of the ground surface, and the material flaw
interference. Therefore the proposed method should be robust
4.1.2. For the micrographs reported in previous studies enough.
Fig. 9 presents the comparison between the SSD values
reported in Ref. [13] and the ones detected by the proposed 4.3.1. Robustness to the image size
method. It shows that, the subsurface cracks given in Ref. [13] Fig. 11 shows that the method robustness to the image sizes. It
can be accurately recognized, although the SSD values varied can find that, although for the shrinked images some details
328 archives of civil and mechanical engineering 18 (2018) 320–330
Fig. 10 – The original SSD micrographs and the images processed by the proposed method that are used to evaluate the
measurement speed.
are missing during the detection, the deepest crack depth as contain the investigation of more accurate measurement
well as the tilted ground surface is still accurately recognized. strategies for the low-resolution micrographs, although more
Among all the twelve sets of comparisons between the and more advanced microscopes that can output high-quality
manually measured SSD depths and the automatically- micrographs are produced.
detected ones (see Fig. 11a5–d5), only two relative errors are
more than 8.88%, indicating the good robustness of the
proposed method to the image resolution/size. 4.3.2. Robustness to the surrounding illumination
However, it should also note that, the relative errors It can also observe from Fig. 11(g1, g2, h1, h2, i1, i2, j1, j2, k1, k2)
increase when the image sizes are reduced. This may because that, although different surrounding illumination including
the scale bars in the low-resolution images have few pixels, the blue, green, yellow, and white light are used, the proposed
and therefore the failure detection of even one pixel would method is still capable of accurately recognizing and measur-
lead to considerable error. Therefore the future work may ing the SSD depths. This high robustness to the surrounding
archives of civil and mechanical engineering 18 (2018) 320–330 329