Professional Documents
Culture Documents
E-mail: ywy@hust.edu.cn
Abstract
Line-laser 3D scanning is a novel and promising automation technique for turbine blade
inspection. One key task encountered in line-laser 3D scanning is centerline extraction of the
laser stripes. In some regions, there is asymmetry of the line profiles caused by high curvature,
such as the leading and trailing edges of a blade. According to the asymmetric Gaussian
distribution line profile, this paper presents a new algorithm to extract the centerline of a laser
stripe based on sub-pixel boundary extraction and medial axis transformation. The candidate
boundary points of the laser stripe are extracted by zero crossing. Based on Taylor expansion
and interpolation, the gray gradient distribution of the boundary can be estimated accurately.
Following this, the accurate boundary points are extracted by extreme values of the gray
gradient, and the centerline is calculated by medial axis transformation of the accurate boundary
points. The proposed method can effectively reduce errors caused by the asymmetry of line
profiles in areas of high curvature. The effectiveness of this method is verified using simulation
and measuring experiments. The experiment results show that the extraction error of the
asymmetric Gaussian line profile is within ± 0.15 pixels, and the root mean square error in
measurement accuracy experiments does not exceed 0.015 mm.
Keywords: centerline extraction, laser stripe, turbine blade inspection
Trailing edge and eigenvectors of the Hessian matrix. Steger then further
analyzed the scale-space behavior of line profile and estab-
lished an error model [20, 21]. After removing the bias caused
Leading edge
by asymmetrical distribution of the line profile, the extraction
accuracy could be improved.
Pressure surface Turbine blades are complex surface parts, and the variety
of surface curvature changes greatly. Thus, the gray distri-
bution of the laser stripe on the surface may not be a single
distribution. It is therefore difficult for the conventional laser
Tolerance Suction surface stripe extraction method to realize accurate extraction. The
thresholding method depends on threshold selection, so the
Figure 1. Section profile of a turbine blade. result may contain a higher level of error caused by an unsuit-
able threshold. Due to giving only pixel-accurate results, it is
difficult to extract accurately with the image thinning method.
commercial optical non-contact 3D sensors, such as the ATOS The gray centroid method is an integration method, and the
series from GOM and the AICON 3D system from Hexagon, asymmetry of the laser stripe can result in bias of the center-
which are structured-light 3D scanners that can realize sur- line extracted. Thus, it is only applicable to a symmetrical line
face measuring with high accuracy. Due to the large amount profile. Steger gave three types of line profile and proposed
of data collected from a single sampling, the measurement effi- an extraction algorithm based on a Hessian matrix. The para-
ciency of structured-light 3D scanners is relatively low. Line- meter of the Gaussian kernel function in the Hessian matrix
laser profile scanners are based on the laser triangulation prin- method is related to the width of the laser stripe. Thus, the
ciple [6–8]. Compared with structured-light 3D scanners, they centerline position extracted by a Hessian matrix needs to be
only collect one section profile of an object measured at each compensated for with an offset value based on different para-
sampling. In the process of images, the algorithm only needs to meters. However, a complete description of the bias is com-
extract and reconstruct the feature of the laser stripe. Line-laser plex. The model of the bias must consider all combinations of
profile scanners therefore have higher accuracy and sampling parameters, such as width, asymmetry, and so on. The relation
frequency. They can also collect from the section of the turbine of the model parameters and quantities that can be extracted
blades directly. Chao et al [9] introduced an optical measur- from the image must be derived.
ing system which consists of two optical sensors based on the In this paper, a new extraction algorithm for the center-
laser triangulation method, to measure the leading and trailing line position of the laser stripe based on accurate boundary
edges of blades. Li et al [10] proposed a calibration method of extraction and medial axis transformation of boundary points
a line-laser profile scanner and a rotating platform for turbine has been carried out. The new method can achieve unbiased
blade inspection. centerline extraction of the laser stripe. The remaining sections
Due to the width of the laser stripe, the centerline is of this paper are arranged as follows. In section 2, the charac-
regarded as the position of the laser stripe. The centerline of teristics of line-laser profile scanner and laser stripe images
a laser stripe should be extracted first; the 3D points of the are analyzed. In section 3, the method of extracting the center-
centerline can then be solved by the camera imaging model line of the laser stripe is proposed, and the details of boundary
and laser plane equation. The centerline accuracy of the laser point and centerline extraction for the laser stripe image are
stripe is therefore a critical factor for measurement accuracy also presented. Both the extraction and measurement accuracy
[11, 12]. The centerline of the laser stripe can be extracted by experiments are carried out and analyzed in section 4. Finally,
intensity thresholding [13]. Based on threshold selection, the the discussion and conclusion are given in section 5.
centerline is extracted by threshold segmentation. The altern-
ative is image thinning [14, 15], to extract the skeleton of the
laser stripe. Image thinning deletes boundary points by an iter-
ative process and the pixel-deletion criteria. The connectivity 2. Characteristics of line-laser profile scanner and
of the points is preserved. Jang and Hong [16] extracted the laser stripe images
light center based on the Canny boundary detector and Euc-
lidean distance map. The centerline is extracted after remov- 2.1. Line-laser profile scanner
ing unnecessary skeletal points. All single transverse electric
mode diode lasers are considered to be near quasi-Gaussian. A line-laser profile scanner is mainly composed of a cam-
The laser beam can be accurately approximated by a Gaus- era and a diode line laser. The measuring principle of line-
sian distribution with a slightly narrower central maximum and laser profile scanners is shown in figure 2. The camera in the
longer tail. The gray centroid method is a useful method to line-laser profile scanner captures the images of laser stripe
extract the centerline from images [17, 18]. The method com- which is projected on measured object. Assume that one point
putes the centerline by centroid estimation of each transversal of laser plane in the world coordinate system {W} is W pi =
section. Steger [19] proposed a method based on differential (xi yi zi ) 1T . Point I pi = (ui vi 1)T is the corres-
geometric properties of the image function. The local normal ponding point in the image plane coordinate system {I}. Sym-
direction of each image point is calculated by the eigenvalues bol {C} denotes the camera coordinate system. Based on the
2
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
xi
ui αx γ u0 0 ( )
R t yi
I
pi = zi vi = 0
αy v0 0
0T 1 zi
1 0 0 1 0
1
= M 1 M 2 W pi (1)
intersection of the measured object and the laser plane, needs fsg (x) = e− 2w2 (3)
to be extracted. Thus, the extraction accuracy of the laser stripe
is the critical factor in improving the accuracy of line-laser pro-
file scanners. ( x2
e− 2w2 , x≤0
fag (x) = x2
(4)
−
2.2. Gray distribution of laser stripe a + (1 − a) e 2w2 , x>0
In an image collect mono camera, the information of the laser where a denotes the asymmetric degree of the laser stripe
stripe is expressed by the discrete gray distribution. Accord- shown in figure 4.
ing to luminous theory of a diode laser, the line profile along A practical image of blade inspection collected by the cam-
the normal direction in figure 3 can be approximated by a era of a line-laser profile scanner is shown in figure 5. In the
Gaussian distribution. The ideal symmetric Gaussian line pro- yellow box, the gray distribution of a profile along the nor-
file with width w is defined in equation (3). The surface of mal direction is shown in figure 6. Due to over-exposure of the
3
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
4
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
Ib (x, y) (x ∈ (xmin , xmax ) , y ∈ (ymin , ymax )) (11) ILoG (x, y) = ∇2 [G (x, y, s) ∗ IROI (x, y)] . (15)
5
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
Laplacian q
p
operator Mf = dx2 + dy2 ≈ rx 2 + ry 2 (18)
Zero-crossing
detection rx = Gx (x, y, s) ∗ IROI (x, y)
. (19)
ry = Gy (x, y, s) ∗ IROI (x, y)
Figure 10. Process of boundary pre-detection.
−1 −1 −1 −1 0 1
1
∂M
∂x = 6
0 0 0 ∗ Mf (x, y) ∂∂My = 61 −1 0 1 ∗ Mf (x, y)
1 1 1 −1 0 1
1 1 1 1 −2 1
1 ∗ Mf (x, y) ∂2M = 1 1 −2
∂M
= −2 −2 −2 1 ∗ Mf (x, y) . (24)
2
∂ x 6 ∂ y 6
1 1 1 1 −2 1
1 0 −1
∂M 1
0 0 0 ∗ Mf (x, y)
∂ xy = 4
−1 0 1
6
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
7
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
Figure 16. Result of centerline extraction (yellow points are In extraction accuracy experiments, the images used are gener-
centerline; red points are boundary points). ated based on an asymmetric Gaussian line profile fag (x, a, w).
The asymmetry parameter a changes from 0 to 0.5 at inter-
The process of centerline extraction is shown as follows.
vals of 0.01. The width parameter w is 1.5, 2.5, and 3.5,
(a) For an arbitrary point piel of left boundary Uel , an initial respectively. The width of the line in an image is the product
radius r0 is given. An inscribed circle Ciel can be calculated of the width parameter w and ten pixels. The image size is
by line width and normal direction. The center of the circle 320 × 240 pixels. A total of 50 images are generated for a
Ciel is oi . The nearest point pier of center oi in the set of right width used to extract the line position using the Hessian matrix
boundary points Uer can be found by a k-d tree search. method and the proposed method. The images generated with
(b) The point piel and its corresponding point per i
can form a width w = 2.5 and asymmetry a = 0, 0.15, 0.30 are shown in
i ′ figure 17.
pair. An inscribed circle Cel is calculated based on them.
′ ′ First, the Hessian matrix method is used to extract
A new center of the circle Ciel is oi . A new radius of the the centerline position CHavg . The extraction deviations
′ ′
circle Ciel is ri . eH1.5 , eH2.5 , eH3.5 are acquired by comparing with the theoret-
′
(c) Let point oi be the center to search for the nearest point ical value. Then, the proposed method uses the same images to
′
pier in the set Uer − pier . extract the line position CPavg and obtain the extraction devi-
(d) Repeat step (b) based on the point piel and its new corres- ations eP1.5 , eP2.5 , eP3.5 . The extraction results are shown in
′
ponding point pier ; a new radius can be calculated. Repeat figure 18.
step (c) and (d) until the radius of the inscribed circle gen- The errors of the proposed method compared with the Hes-
erated remain unchangeable. Now, the center of inscribed sian matrix method are shown in figure 19. The errors of the
8
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
9
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
Figure 18. Extraction results (blue points are the boundary; red points are the centerline extracted by the proposed method; yellow points
are the centerline extracted by the Hessian matrix method).
square error are −0.0203, 0.1212, and 0.0371 mm, respect- is more accurate. The line-laser profile scanner can achieve
ively. The three kinds of uncertainty are 0.0138 mm, higher precision measurement. The result shows the line-laser
0.0454 mm and 0.0955 mm, respectively. profile scanner based on the proposed method is suitable for
According to the experimental results, the accuracy of inspecting casting turbine blades with 0.1 mm ~ 0.3 mm cast-
the proposed method applied to a line-laser profile scan- ing tolerance.
ner developed by our research group is superior to the Hes-
sian matrix method. The results of the measurement accur-
4.3. Turbine blade measurement
acy experiment represent the measurement error of the exper-
iment device; the components of the error mainly include In the third experiment, a machined blade is measured
the line-laser scanner measurement error, the translating plat- and evaluated the profile errors. The size of the blade is
form motion error, and the translating direction calibration. 200 mm × 120 mm × 50 mm. During the measuring process,
In image processing, the second-order partial derivatives of the blade is fixed on the fixture of the rotating platform. Before
a Hessian matrix are Gaussian derivatives. Thus, the extrac- the experiment, the rotating platform is calibrated based on the
tion accuracy of the Hessian matrix method is sensitive to method in [10], which uses a Leica A901 MR laser tracker
the width of the laser stripe. Based on accurate estimation of with a T-probe. In the measurement, four sections of the blade
the boundary gray gradient distribution, the proposed method are measured, and the point clouds generated are shown in
does not need Gaussian derivatives, and centerline extraction figure 25. To acquire complete data of a section, the blade
10
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
Industrial
camera
axis
Diode line
laser
X-axis
Translating
platform
Line-laser
Figure 22. Experiment process of single standard sphere.
profile scanner
Blade
11
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
Table 3. Deviations of the Hessian matrix method compared with Table 6. Deviations of the Hessian matrix method compared with
the certified diameter. the certified standard center distance.
Sequence Diameter (mm) Deviation (mm) Sequence Center distance (mm) Deviation (mm)
Sphere 1 0.0010 mm
60.0865 mm
Sphere 2 0.0013 mm
Expanded uncertainty U = 0.0010
Coverage factor k=2
1 60.1023 0.0158
2 60.0678 −0.0187 Finally, the centerline position is calculated based on medial
3 60.0994 0.0129 axis transform of the sub-pixel boundary points. Due to accur-
4 60.0706 −0.0159 ate extraction of the boundary points, the proposed method can
5 60.0957 0.0092 achieve extraction of the laser stripe in turbine blade inspec-
6 60.0968 0.0103 tion. In addition, both an extraction and measurement accur-
7 60.0992 0.0127 acy experiment applied to the line-laser scanner developed by
8 60.0720 −0.0145 our research group are carried out. The simulation experiments
9 60.0772 −0.0093 observe that the extraction error of the asymmetric Gaussian
10 60.0756 −0.0109
line profile is within ±0.15 pixel. The root square mean error
Mean deviation (mm) −0.0008
applied to the line-laser scanning experimental platform does
Limit deviation (mm) 0.0345
Root mean square error (mm) 0.0134 not exceed 0.015 mm. The results indicate that the proposed
method can be used to extract line position when applied to
the inspection of casting turbine blades.
5. Conclusion
This paper deals with the problem of line position extraction Acknowledgments
for a line-laser scanner, in order to extract the sub-pixel center-
line of the laser stripe in the image. In the proposed method, This work is supported by the National Natural Science
the input image is first preprocessed to reduce the computation. Foundation of China (Grant Nos. 51535004, 51775214,
The boundary candidate points of the laser stripe are extrac- 51635007), the Technology Innovation Special Project of
ted based on an LoG operator and zero-crossing detection. Hubei Province (Grant No. 2019AAA008), and the Funda-
Based on Taylor expansion and interpolation, the gray gradi- mental Research Funds for the Central Universities (Grant No.
ent distribution of the boundary can be estimated accurately. 2019kfyXKJC046).
12
Meas. Sci. Technol. 31 (2020) 095403 C Jiang et al
Table 7. Measurement results of maximum gauge, leading edge and trailing edge in four sections.
Maximum gauge (mm) The radius of the leading edge (mm) The radius of the trailing edge (mm)
Section Measured value CMM value Error Measured value CMM value Error Measured value CMM value Error
Section 1 15.3345 15.5683 −0.2338 5.0676 5.0494 0.0182 3.5185 3.5764 −0.0579
Section 2 15.4597 15.6458 −0.1861 5.0791 5.0456 0.0335 3.5523 3.6105 −0.0582
Section 3 16.0195 16.1185 −0.0990 5.1373 5.0824 0.0549 3.6189 3.6378 −0.0189
Section 4 16.6733 16.5328 0.1405 5.1498 5.0929 0.0569 3.6591 3.6333 0.0258
13