You are on page 1of 13

Virtual and Physical Prototyping

ISSN: 1745-2759 (Print) 1745-2767 (Online) Journal homepage: https://www.tandfonline.com/loi/nvpp20

Review of reverse engineering systems – current


state of the art

Zhaohui Geng & Bopaya Bidanda

To cite this article: Zhaohui Geng & Bopaya Bidanda (2017) Review of reverse engineering
systems – current state of the art, Virtual and Physical Prototyping, 12:2, 161-172, DOI:
10.1080/17452759.2017.1302787

To link to this article: https://doi.org/10.1080/17452759.2017.1302787

Published online: 22 Mar 2017.

Submit your article to this journal

Article views: 1515

View related articles

View Crossmark data

Citing articles: 35 View citing articles

Full Terms & Conditions of access and use can be found at


https://www.tandfonline.com/action/journalInformation?journalCode=nvpp20
VIRTUAL AND PHYSICAL PROTOTYPING, 2017
VOL. 12, NO. 2, 161–172
https://doi.org/10.1080/17452759.2017.1302787

Review of reverse engineering systems – current state of the art


Zhaohui Geng and Bopaya Bidanda
Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, PA, USA

ABSTRACT ARTICLE HISTORY


Reverse engineering (RE) has been widely applied in many segments of industry when digital or Received 10 February 2017
geometric models of existing physical objects are unavailable. This paper details components of Accepted 2 March 2017
RE systems and describes the needs for RE in manufacturing industries. Commonly used contact
KEYWORDS
and non-contact scanning techniques are described. Possible interfaces with other manufacturing Reverse engineering; 3D
processes, especially 3D printing (3DP), are discussed. This paper also describes new trends in the printing; scanning
field that include increased speed, accuracy, and level of automation in the future. Finally, a techniques; 3D modelling;
discussion on two major tolerance issues in terms of integrating RE and 3DP are presented. tolerancing

Introduction . Design of new product: In most cases, design,


especially for products designed from model testing
Reverse engineering (RE) plays an important role in
(streamlined design, turbine blade design, injection
shortening the throughput time in the manufacturing
mould design, etc.) or products with aesthetic lines
cycle. Broadly speaking, RE can be defined as a systema-
or design often starts from a physical prototype
tic process that extracts design information from an
without CAD information.
existing product. While products in many different
. Modification of existing products: Designs are often
industries including software, defence systems,
iteratively modified in order to get higher functionality
medical and rehabilitation products, consumer elec-
or performances. However, CAD models for the product
tronics, etc., can be reverse engineered, our focus for
after modification will not be available and need to be
this paper is on geometric models from mechanical pro-
reverse engineered to store digital design data.
ducts. Unlike the traditional manufacturing sequence,
. Loss of product design data: In some instances, exist-
where 3D CAD modelling is usually time-consuming
ing parts need to be manufactured, but either the CAD
(Chua and Leong 2017), the RE process starts from an
model is no longer available or the data file is corrupt.
actual product and undertakes a sequence of measur-
. Verify the product: The RE system can be used to
ing and analysing steps to obtain the geometric
extract the dimensional information of the part and
model as can be seen in Figure 1. A wide variety of RE
compared with CAD model; this can then be used to
systems are available due to the multitude of geome-
determine the deviation from the design.
tries, materials, and tolerances that need to be reverse
engineered. Especially, industries like turbine manufac-
turing (Chintala and Gudimetla 2014, Kaplan et al. 2015), In this paper, we first introduce the overall RE process,
aerospace (Raja and Fernandes 2007), biomedicine the reminder of the paper is devoted to the review on
(Creehan and Bidanda 2006a, Chua and Yeong 2014), individual components of the RE processes. First, the
culture heritage (Segreto et al. 2013), farming (Viana current state-of-the-art digitisation/scanning techniques
et al. 2016), as well as membrane module manufactur- will be surveyed, and the taxonomy based on measuring
ing for desalination and water treatment (Lee et al. techniques will be provided. Next, the strategies to inter-
2016), the CAD files of interested parts are usually una- face RE with other manufacturing processes through
vailable or inaccessible. CAD platforms will be briefly reviewed. As in a survey,
This paper builds on a previous state-of-the-art survey we do not attempt to present each topic in detail;
published about 25 years (Motavalli and Bidanda 1991), instead, we primarily focus on important conceptual
and updates the current state of the field. RE needs issues. Interested readers will find the relevant research
can be categorised as follows: contributions in the reference list.

CONTACT Bopaya Bidanda bidanda@pitt.edu


© 2017 Informa UK Limited, trading as Taylor & Francis Group
162 Z. GENG AND B. BIDANDA

Figure 1. Traditional vs. RE manufacturing processes.

The reverse engineering process within the context of manufacturing automation for
communication and documentation within the digital
Compared to the traditional manufacturing sequence, in
world of design and manufacturing. Therefore, RE can
which a part is first designed and manufactured, RE starts
be broadly divided into two basic steps based on the
without a CAD file but from an existing part, and then
objectives: (1) to transform the target from the physical
clones or redesigns the part into a digital model that
world to the digital world and (2) to interface with
can be utilised to plan for the manufacture of the part.
other manufacturing processes, as shown in Figure 2.
The main assumption under RE is that the existing proto- In order to transform from physical world to digital
type or product embodies the major product specifica- world, RE starts with geometric information collection,
tions, like materials, processes, geometric information, or digitisation processes. Traditionally, the name ‘digi-
etc. Among these specifications, geometric information tisation’ comes from the process of taking discrete
is the most important when considering manufacturing points from 3D surfaces with specific machines, e.g.
processes selection and parameter designs. Current coordinate measuring machine (CMM). However, with
state-of-the-art manufacturing processes are usually the emergence of new technologies, such as stereo
computer aided, which makes translating the geometric vision, machine vision techniques, computed tomogra-
information to a computer identifiable version necessary phy (CT), etc., the digitisation process can be generally
and unavoidable. In order to achieve this objective, a summarised as the process of acquiring dimensional
CAD model of the part should first be acquired, data from undefined surfaces, synonymous with scan-
because a CAD model is a widely used ‘language’ ning. To improve scanning techniques, which are

Figure 2. Basic steps of RE.


VIRTUAL AND PHYSICAL PROTOTYPING 163

crucial for the quality of the 3D model, much recent objective accuracy. The next two sections will present
research has focused on developing strategies (path these two steps in detail.
planning, sampling, etc.) for better scanning.
After digitising the part, an essential process is to
Digitisation techniques
convert the point cloud to geometric forms that can
be used in CAD platforms to interface with other man- To achieve the part design information, accurate geo-
ufacturing processes; without this conversion, data are metric data collection, also known as digitisation, is
just a sea of coordinates with little meaning. The data invariably considered as the starting point for every RE
collected by digitisation have random in nature, that process. Digitisation is the process of collecting the
need preprocessing step to transform it into usable data of surfaces of the objects and converting the data
format and exclude the outliers. Then, different to a digital form. As the first stage of RE, digitisation pro-
surface representations are available to describe the cesses have serious impacts on each of the subsequent
outside surface of the target, which can be broadly steps based on the propagation of the accuracy of the
divided into algebraic forms and parametric forms. collected data points. Also, the digitisation step requires
Within each surface representation, external surfaces more time compared to the steps after it, since the next
can be fitted from data clouds, and, according to the steps are completed by a set of computer algorithms,
surfaces, a CAD model can be obtained. We combine which is usually faster. Therefore, in order to get the
these separate processes as a way to interface with data points with high accuracy and fast speed, digitis-
other manufacturing techniques. However, the auto- ation techniques have attracted much interest from
mation of this combined process with precision researchers during the past few decades.
remains a future challenge; although the surfaces can Effective digitisation can be achieved by employing
be easily identified by the human eye and brain, but several different techniques. Each uses a physical mech-
they are not obvious to a set of sensors and an intelli- anism to either directly or indirectly acquire the coordi-
gent set of algorithms. nates of specific part features. The taxonomy of
Although the steps in Figure 2 seem sequential, the currently available technologies is presented in Figure 3.
real RE processes are truly looped and several iterations These technologies can be broadly classified into three
may be required to get the final CAD model with categories based on whether there is physical contact

Figure 3. Taxonomy of RE technologies.


164 Z. GENG AND B. BIDANDA

of the surface or volume of the object of interest: contact, Coordinate measuring machine (CMM)
non-contact, and hybrid methods. Introduced as a machine that could inspect a part in
the early 1960s, the CMM is the first and still one of the
most popular equipment of RE. The CMM is a device
Contact methods measuring spatial points on the surface of a workpiece
using a contact stylus and translating into a 3D Cartesian
Considered as a more traditional method compared to coordinate system. The contact stylus is generally a
non-contact methods, contact-based methods have highly sensitive pressure sensing device that is triggered
been utilised for several decades. These methods by any contact with the part surfaces. Three issues of a
require mechanical contact between the interested sur- CMM that determine its measuring performance (i.e.
faces and a measuring device, usually in the form of a accuracy, flexibility, measurable workpiece dimension,
contact probe or stylus. Contact-based measurements throughput of measuring process, and costs), are types
can usually obtain more accuracy and higher quality of of configuration, control types, and fixture designs
surface finish, but are more time-consuming. (Figure 4).
CMM machines have been well researched in efforts
to improve their performance. Some researchers
Manual measurement
develop CMM planning algorithms in order to avoid col-
The contact methods can be traced back to manual
lision of CMM probes (Albuquerque et al. 2000, Lin and
measurement ages that occurred around half a century
Chen 2001). ElKott and Veldhuis (2005) and Yu et al.
ago. Several key dimensions across the parts are ident-
(2013) propose adaptive sampling methods to scan
ified by experienced workers and then can be used for
free-form surfaces using CMM. However, most of the
blueprint drawings. The instruments include calipers,
inspection methods are CAD correlated. A trend of
measuring gages, angle finders, etc. With the develop-
CAD-free, automation inspection path planning of
ment of computer-aided design systems, key points
CMM has emerged; this path planning first appeared in
from the measurement of a surface can be entered
the area of free-form surface inspection. Chiang and
into a CAD system, wherein curves and surfaces that
Chen (1999) propose a surface skinning method, incor-
interpolate these points can be generated, followed by
porating a software iterative procedure for RE of sculp-
the generation of a 3D CAD model. The manual measure-
tured surfaces. Li et al. (2013) and Li and Nomula
ment process is flexible, since the workers can determine
(2015) generate methods of both CAD-guided and
the key points by experience. However, the disadvan-
non-CAD-guided to increase the accuracy of CMM in
tages are significant: the poor accuracy of measurement
measuring external profiles of porous objects.
because of subjectivity, the limitation of the form of
surface or object, and the tremendous amount of man-
hours required. This manual method is rarely used Numerical control (NC)-based machine
today for a RE process, but might be helpful to generate Because the price of CMM are prohibitive, researchers
constraints in surface fitting steps. and practitioners intended to find substitution that

Figure 4. Fishbone diagram of casual factors of CMM measuring performance.


VIRTUAL AND PHYSICAL PROTOTYPING 165

could be modified into a scanning equipment. NC-based the principle of triangulating a measurement point on
machine was introduced in the 1940s and 1950s, which the part from a well-designed system including a
was intended to mount existing tools on a programma- source and a detector. Both single light triangulators
ble motor for automated manufacturing. Using NC- and laser strips share the same underlying principles.
based machine mounted with stylus is a practical sol- Figure 5 shows a typical system configuration. Points PL
ution, since NC-based machines are widely used in the and PC are the pin points of the exit of the laser source
industries and easily programmed. Besides of these, and the entrance pupils of a camera, S′ is the point
NC-based machine is easily changed with current state- reflected from point S of object. Also, the angle
of-the-art scanning techniques (Shen et al. 2000, Cheng between the points and the axes of rotary table is
et al. 2007) and up-to-date path planning algorithms known as α. Therefore, we have
(Milroy et al. 1995).
dl
zS = , (1)
B′ S′ + l tan (u)
Non-contact methods
and
Compared to the probe or stylus to contact the surface,
non-contact methods do not have mechanical contact xS = zS tan (u), (2)
with the part to be studied. Non-contact methods typi-
where zS and xS are the x and z coordinates of the point S
cally use a medium such as light, laser, sound, magnetic
in 3D system, d is the distance between PL and PC, u is the
fields, or X-rays, as the main tool for deducing surface
angle of between the laser beam and predefined z axis, l
information. Non-contact can be further divided into
is the distance between pupil and camera (Blais et al.
two subgroups – active and passive techniques.
1988).
Compare to contact method, non-contact techniques
The scanning process generally starts from either the
require less time for scanning process; however, these
bottom layer of the part and proceeds upwards to each
methods are limited in that hollow structures or small
layer or from a vertical line layer and then proceeds
features on the surface of transparent materials cannot
either right or left to each layer with user-defined inter-
be measured.
vals. Therefore, when the scanning process is complete,
the data are a collection of location of points organised
Active systems with equal interval cross-sectional layers, which can be
The active form methods operate by projecting energy used for further processing. Generally, laser scanning
onto a part by recording the transmitted or reflected technologies are able to produce accurate data repeata-
energy and translating it into geometric information. ble to less than 0.001 inch (Creehan and Bidanda 2006b).
Also, the laser scanner is the most common method used
Triangulation. This is a well-established active technol- in RE applications, because it is fast and robust relative to
ogy for accurate geometric data acquisition based on other methods (Gálvez et al. 2012, Lu and Wang 2015).

Figure 5. Representation of the triangulation principle.


166 Z. GENG AND B. BIDANDA

Structured light. Structured light-based systems share principles of nuclear magnetic resonance. This process
the same active approach as mentioned above. Instead utilises absorption and emission of energy by atomic
of a single beam or strip of light, structured light involves nuclei in a surrounding magnetic field, to generate
projecting patterns of light onto a surface of the part; the thin-section images of any part of the body, like
geometric information of the surface of interest can be organs, bones, and ligaments, from any angle and direc-
generated through analysing the resulting patterns pro- tion. The quality of image under MRI is closely related to
jected on the video camera. The projection of different the strength of the magnetic field. However, due to the
patterns in terms of accuracy and throughput time has nature of the magnetic field setting, measuring any met-
been extensively studied. Le Moigne and Waxman allic object is potentially inapplicable. On the other hand,
(1984, 1985) use multi-resolution grid pattern light pro- a CT scanner is another tool for viewing the internal
jected on the objects for robot vision. Morita et al. structure of the human body that does have the ability
(1988) proposed a pattern made from an M-array, to scan metallic subjects (Liu et al. 2016). The fundamen-
which is a 2D extension of a M-sequence, to correct tal principle of CT is to send a thin X-ray beam at the
pattern disorders. Maruyama and Abe (1993) present a target from multiple angles measuring the varying
method for acquiring range data by projecting multiple amounts of X-ray beams after attenuating by different
slits with random cuts. Also, some researchers (Srinivasan densities from the opposite side. Both the MRI and CT
et al. 1984, Tang and Hung 1990) have explored the pro- can now acquire data with high accuracy and can solve
jection of fringe patterns, which are particularly suitable difficulties when measuring holes or internal structures
to maximise the resolution of measurement with a faster of the target; however, the cost of these imaging tech-
speed. niques can be prohibitive.

Shape-from-shadows. The shape-from-shadows method Passive systems


is a variant of the structured light approach. Instead of Stereo scanning. The stereo scanning is the process of
obtaining geometric information through analysing the acquiring geometric data of an object by integrating
reflection of patterned light projected onto unknown the photographs concurrently captured by two or
parts, the 3D model can be rebuilt by capturing and ana- more cameras from different perspectives. With the
lysing the shadow of a predefined object projected onto same principle of triangulation, stereo scanning
the target with moving light (Fanany and Kumazawa requires no further equipment, e.g. specific light
2004, Yu and Chang 2005). Despite its low cost and sources, except for cameras, which give it advantages
simple equipment benefits, this method is rarely used in such as simplicity and low cost. However, stereo scan-
the RE field because of the low accuracy. ning often requires human participation or large com-
putational efforts to identify the common points
within the image pairs in order to reconstruct the 3D
Shape-from-shading. Similar to the shape-from- model. A significant amount of research has been pub-
shadows technique, the shape-from-shading approach lished in the area of stereo scanning (Tippetts et al.
also uses the shadow phenomena to obtain geometric 2016). Considerable advancements have enable the
information. However, the shape-from-shading requires development of new algorithms and the augmentation
directly projecting light onto the object of interest, of existing algorithms in order to produce more accu-
which will generate shading onto the background. The rate results and achieve real-time performance in
shading on the target surface will change according to obtaining these results. However, because of the
the varying of the position of the light source. A nature of this method, the quality of the shape extrac-
thorough review of algorithms able to extract the tion depends heavily on the sharpness of the surface
shape information from this type of methods can be texture, which is affected by surface reflectance.
found in the reference (Horn and Brooks 1989). Yet, Stereo scanning has significant applications in the
this approach has shortcomings in the accuracy areas which do not require high-precision acquisition
obtained, especially for a small scale of target and in data, like computer vision or robotics; its fast feature
the presence of external factors that influence the reflec- detection is more important in motion planning or col-
tance of surfaces (Wöhler and Hafezi 2005). lision avoidance.

Medical imaging. Magnetic resonance imaging (MRI) Texture gradients. The main idea behind surface recon-
and CT are utilised for acquisition of geometric infor- struction through texture gradients is based on two facts:
mation for biomedical purposes. MRI is a versatile, (1) the further away from an object one is, the smoother
powerful, and sensitive tool that incorporates the its surface will appear to be and (2) the image of certain
VIRTUAL AND PHYSICAL PROTOTYPING 167

texture elements (texels) relates to the surface orien- Li et al. (2014) present a tactile-optical system where a
tation (Szeliski 2010). Therefore, the distance of certain tactile probe was used to compensate the data from a
texels from a known viewpoint can be estimated by laser line scanner. Lu and Wang (2015) mount the
inspecting the perceived texture at that distance. This point laser probe next to CMM to scan next path and
method has simple, low cost equipment requirements. provide path planning for the contact scanning probe.
However, it has a limited performance on accuracy and
precision.
Commercial systems today
Shape-from-focus. Shape-from-focus techniques are RE systems, or more broadly, 3D scanning techniques,
based on using the focal properties of a lens to deter- have been used for decades in industrial and commer-
mine the depth and range information of the target cial applications ranging from surveying construction
(Nayar and Nakagawa 1994). A lens can be employed sites to measuring a machined part for redesign. Com-
as a range finder through the ‘depth of field’ phenom- panies, such as Nikon Metrology Inc., Mitutoyo Corpor-
enon where the image is blurred when it is located to ation, Creaform Inc., etc., have designed CMMs with an
a distance proportional between the points on target accuracy and resolution that ranges from 0.05 to 5 µm.
and the in-focus object plane. This technique has However, as 3D printing (3DP) has become more
evolved from a passive approach to an active scanning common with makers and designers, the desire to
technique in order to improve its resolution and accu- capture 3D CAD data of the real objects and transform
racy. This method is still inadequate for commercial RE them into printable models with higher flexibility in less
systems due to its low-accuracy and non-uniform time has grown. Non-contact scanning systems have
spatial resolution. gained market share because of high speed, affordable
price, and acceptable accuracy. Structured light and
laser triangulation are two major methods that are
Hybrid methods
used in commercial systems today, such as Artec’s
Each of the methodologies detailed earlier has ‘pros and Space Spider and FARO’s FocusS laser scanner, respect-
cons’. For example, contact digitisers, e.g. though CMMs ively. Overall, structured light systems have better resol-
are able to provide accuracy and reliable measurement ution and higher accuracy than the ones with laser
results, their data acquisition processes require a lot of triangulation. Due to the smaller and lighter nature of
time due to inefficiently planning; these contact digiti- non-contact systems, handheld products are popular
sers also depend upon human intervention. Non- in market and provide much user flexibility. These
contact digitisers, on the other hand, are capable of include systems from 3D scanner by XYZprinting Inc.,
medium to high-speed data generation and significant SenseTM 3D scanner by 3D Systems Inc., and even iSen-
time reduction; however, the level of accuracy is com- seTM 3D scanner (which is made to attach to a tablet) by
paratively lower than that of contact ones. Hybrid 3D Systems. Some high-end non-contact systems are
methods meet the increasing requirements of both fast even able to capture the colour of an object, for
scanning speed and high measurement accuracy, example, SCANIFY® by Fuel 3D Technologies Limited
together with the flexibility and high level of automation can provide high-quality scans and capture true to life
of the whole digitisation process. These methods which colours. Non-contact methods also provide a higher
incorporate two or more digitisation methods that scanning speed than CMMs, and usually complete the
provide ‘smart’ path planning with high-speed and scanning task within a few minutes; yet, the precision
high level of accuracy, are increasingly applied to RE and resolution is around 0.01–1 mm, which is signifi-
field. cantly lower than a CMM. On the software side, RE soft-
Current research on hybrid methods of RE mainly wares, such as Geomagic® DesignTM X, Geomagic® for
focus on sensor selection, scanning path planning, and SOLIDWORKS®, etc., are ready to use to convert 3D
coordinate system unification. Methods, such as, scan data into high-quality feature based models for
Bradley and Chan (2001), Carbone et al. (2001), Sładek further manipulation.
et al. (2011), and Li and Wei (2016), are proposed to inte-
grate non-contact scanning techniques onto a CMM; the
Interfacing RE with other manufacturing
non-contact methods are used for path planning and
processes
CMM is followed for accuracy data collection. Chan
et al. (2001) introduce a multi-sensor approach for The real power and flexibility of RE systems lie in their
rapid digitisation by integrating a CCD camera for path capability to be combined with other manufacturing pro-
planning and a laser scanner for accurate data collection. cesses to reproduce the products through CAD/CAM
168 Z. GENG AND B. BIDANDA

platforms. The digitisation processes will result in a ‘raw’ cavities, where it is impossible to acquire all parts of
data cloud has been acquired through a RE system; scanned surfaces. Various hole-filling algorithms have
however, this data cloud must be ‘massaged’, including been developed and many of these can be found in
preprocessing and transforming into specific forms in archival journals (Curless and Levoy 1996, Chui and Lai
order to be used by computer platforms (Bidanda et al. 2000, Liepa 2003, Jun 2005).
1991). At the beginning of the massaging process, the Another major option is curve and surface fitting of
raw data should be smoothed and outliers removed. the point cloud data. Chivate and Jablokow (1995)
Then, the data cloud is then typically transformed into provide a thorough but not up-to-date overview of
specific format that a CAD system can identify. The surface representations and fitting mechanisms. In
language of CAD is geometric-based. Broadly speaking, general, surface representations can be divided into
three major modelling techniques are widely used: two categories: algebraic forms and parametric forms.
wire-frame modelling, surface modelling, and solid mod- Algebraic forms assume that the target surface can be
elling (Xu 2009). Wire-frame, the most basic method and represented by an implicit equation f (x, y, z) = 0 in
first developed, is stored in a data file as a collection of three-space or by a homogeneous polynomial equation
points, lines, and types of curves. This method, which f (x, y, z, w) = 0 in a four-space (Boender 1991).
requires a low volume of data storage, was used for Under this representation, algorithms, such as least
data reduction for RE systems (Motavalli and Bidanda squares fitting or least median of squares, deals with
1991); however, wire-frame modelling techniques computing the coefficients of the equation. However,
cannot fully satisfy the increasing demand for customisa- due to the global nature of algebraic function, any modi-
ble, complex designs, and free-form objects. Further- fication of the data set would cause refitting of the whole
more, because RE includes digitisation of the surfaces surface.
of the target object, surface modelling techniques, Another type of surface/curve representation form is
which primarily consist of a set of faces, are more versa- the parametric form, including Bézier’s surface/curve, B-
tile and flexible, with the ability to model the edges and spline surface/curve, and non-uniform rational basis
surfaces. spline (NURBS) surface/curve. The reason this category
Multiple options for surface modelling from data is called parametric form is that the surfaces or curves
clouds exist, which is shown in Table 1. Polygonal are represented in terms of two parameters, u and v;
meshes offer the simplest option. The main idea for poly- the main differences among the above three represen-
gonal meshes is to convert the discrete data clouds into tations lie in the basic functions. Specifically, Bézier’s
piecewise smooth, continuous models through small surface/curve utilise Bernstein polynomials as its basis
patches. Polygonal meshes are important in computer function; B-spline surface/curve uses polynomials as its
graphics and animations due to their simplicity and flexi- basis function defined over a knot vector; and NURBS
bility, especially for free-form surfaces (Krishnamurthy surface/curve employ rational polynomials as its basis
and Levoy 1996, An et al. 2016). However, small gaps function. Fitting data cloud into these three surface rep-
between surface patches exist due to missing scanned resentations has attracted a great deal of interest. (Ma
data, especially when scanning a complex part, like and Kruth 1998, Sarfraz 2006, Gálvez et al. 2007, 2012,
Ülker and İşler 2007, Gálvez and Iglesias 2016).
With the state-of-the-art surface fitting algorithms,
Table 1. Comparison between surface modelling techniques in
RE. surface models generated from measured data can be
Modelling techniques Advantages Disadvantages obtained. A surface model inside CAD platforms can be
Polygonal meshes . Simple . Bulky storage rendered into a solid model; its versatility allows it to
mathematical . Difficulties for be used with finite-element analysis, fluid flow analysis,
model redesign or
reengineering
and NC part programming for CAM.
. Pore existence

Curve and Algebraic . Efficient . Any modification of Dimensional tolerance issues


surface forms computation data implies refitting
fitting . Closure the whole surface As shown above, RE is considered as the first step of com-
properties puter-aided manufacturing and engineering and an
important design task. In addition, RE is also treated as
Parametric . Easy to . Extensive
forms modification computation an input to additive manufacturing (AM) or 3DP, since
. ‘Robust’ to the input for AM and 3DP is CAD files and Surface Tessel-
outliers
lation (STL) files, both of which are RE’s output. The
process of moving a physical part to a 3D printed part
VIRTUAL AND PHYSICAL PROTOTYPING 169

helps to set up the process between RE and 3DP, and occurs often and is not easy to solve. Therefore, process
provides the trend for the future manufacturing and controlling techniques should be investigated through-
service industries. For example, in healthcare industry, out the entire process to make sure the superposition
customised product, for example organs, stem cells, error can be controlled under an appropriate tolerance
and tissues, can be reverse engineered through bioprint- level. In order to obtain a better reproduction and a
ing techniques (Chua and Yeong 2014). However, toler- more accurate representation, a more robust system
ance design, without which the geometric design may that includes tolerance stacking techniques may be
deteriorate product’s usefulness and functionality, must required to ensure the product is deliverable, reproduci-
be carefully observed throughout the whole process. ble, and feasible.
The consensus is that the manufacturing of the parts With the acceptance of variability in the manufactur-
whose dimension is exactly the same as the design is ing process and in support of the design’s basic function-
impossible; thus, manufacturing two parts that are ality and interchangeability for mass production,
exactly the same is not achievable. In our case, the final tolerance design has become an essential part of
bio-product should be within some certain geometric design and manufacturing. Generally, two ideas may
and biological requirements in order to fit the patients’ have the ability to overcome this problem. One of the
needs. ideas is similar to initial design or redesign processes.
The entire process, including design, manufacturing, By analysing the assembly to which the part belongs
RE, and AM, is shown in Figure 6. For example, a and the functionality of the part, a set of constraints
product whose size is A mm was designed for some could be generated for tolerance design. However, this
specific purpose that requires high precision with toler- method, which may be heavily dependent on the inter-
ance 2σ mm; therefore, the required output product vention of RE expertise, may cause an increase of
should be within A ± σ mm. After design and manufac- throughput time and costs. Another idea is to derive
turing, a manufacturing error is added to the initial an approximation to the initial tolerance design accord-
design A ± σM mm. In order to reproduce this product ing to the features of the part. Jamshidi et al. (2006)
without the original CAD file, an RE process is required propose a method that analyses the surface finish and
to gain the design information. Then after scanning, texture to identify the original manufacturing processes
data processing, and generating a CAD file, an RE error to help approximate dimensional and geometric toler-
is added to the model, which results in the measure of ances. Kaisarlis et al. (2000) present the idea of a knowl-
A ± σM ± σRE mm. The CAD file is then used for AM. edge-based system based on ISO, ANSI, and BS standards
After reproduction, an error of AM, σAM, is also added with functional requirements. Another method requires
to the final product, whose measure is A ± σM ± σRE ± dimensional analysis on multiple samples of the same
σAM mm. The product’s final measure is easily out of product to make inference on the tolerance information.
the range of the design requirements A ± σ mm, which The existence of only one product in a scenario, as well as
makes the whole reproduction process and final excessive time and high cost, makes this method a pro-
product not useful. blematic one. Therefore, systematic ways to reverse
Because of the highly unpredictable error in each step engineer the tolerance information of a general
of the RE manufacturing process, the superposition error product with theoretical support are urgently required

Figure 6. Process flow for product reproduction with error superposition.


170 Z. GENG AND B. BIDANDA

Figure 7. Smart and ‘integrated’ 3D printer – 3D ‘copier’ – design.

in order to both reduce throughput time and improve computer-aided tolerancing (CAT) techniques; however,
the level of the quality of final product produced this area has not received much attention especially as
through RE processes. applicable to RE.
Integrating with state-of-the-art 3DP techniques will
have a substantial impact on shorter life cycles for the
Conclusion new products and will possibly provide for customer per-
A broad range of technologies that can be used to sonalisation manufacturing. The next evolution in RE will
develop RE for manufacturing purposes has been likely be related to artificial intelligence (AI) or ‘smart
described. Two main parts of state-of-the-art RE are systems’ in both hardware and software. On the hard-
discussed: scanning/digitisation techniques and interfa- ware side, automating scanner operations will make
cing techniques with other manufacturing processes. scanning more accurate and shorten the time of scan-
Because both of the components are equally important ning. Development in the software arena could include
to the performance of a final CAD model generation, an integrated ‘automated process planner’. This
integrated systems of different combinations should be ‘planner’ has been the Holy Grail in manufacturing for
chosen based on specific circumstances. Also, these inte- decades and is quickly moving closer to reality. With
grated systems make it possible to reduce the product both of the above improvements, RE will eventually inte-
design throughput time by going from a physical part grate with other production systems, such as a 3DP
to a final deliverable. However, some bottlenecks, includ- system, with little human intervention. A general idea
ing the inaccessibility of the bottom side, internal struc- for a ‘3D copier’ is proposed in Figure 7, of which the
ture, or blind hole, still need further work in order to first generation was introduced to the market by some
coping with gaps in applicability and level of automation companies, such as Blacksmith Genesis, AIO Robotics
for RE. Inc. This ‘copier’ would make part ‘copying’ a two-step
Further research that addresses the tolerance issues of process, similar to a regular copier, where the original
RE could increase the benefits of the usability and indus- product is first placed inside a work envelope and then
trial applicability of the final products. State-of-the-art RE the geometry is quickly scanned. After removing the
processes put focus on the extracting geometric infor- part, the machine begins to re-create the said part. This
mation from the physical model to reconstruct the CAD further enhances data exchange between scanning and
model, but little research has been discussed about the 3D printer functions, enabling these new generation
procedure of RE the tolerance information. When one machines to reverse engineer and reproduce a part
product is reverse engineered, the part, in most cases, with minimal setup. Also, the idea can widen the
is only one sample from a distributed population, current definition of a RE system, which is integration
where the variation is unavoidable. Traditionally, the of 3D scanning and CAD reconstruction, into a thorough
trade-off between production cost and level of function- manufacturing process with an additional function of
ality and assembly can be balanced by well-designed reproduction.
VIRTUAL AND PHYSICAL PROTOTYPING 171

Disclosure statement Kamrani and E.A. Nasr, eds. Rapid prototyping: Theory and
practice. New York: Springer US, 87–106.
No potential conflict of interest was reported by the authors. Curless, B. and Levoy, M., 1996. A volumetric method for build-
ing complex models from range images. In: J. Fujii, ed.
Proceedings of the 23rd annual conference on computer
References
graphics and interactive techniques, New York: AMC, 303–312.
Albuquerque, V.A., Liou, F.W., and Mitchell, O.R., 2000. ElKott, D.F. and Veldhuis, S.C., 2005. Isoparametric line sampling
Inspection point placement and path planning algorithms for the inspection planning of sculptured surfaces. Computer-
for automatic CMM inspection. International Journal of Aided Design, 37 (2), 189–200.
Computer Integrated Manufacturing, 13 (2), 107–120. Fanany, M.I., and Kumazawa, I., 2004. A neural network for reco-
An, Y., et al., 2016. Self-adaptive polygon mesh reconstruction vering 3D shape from erroneous and few depth maps of
based on ball-pivoting algorithm. International Journal of shaded images. Pattern Recognition Letters, 25 (4), 377–389.
Computer Applications in Technology, 54 (1), 51–60. Gálvez, A., et al., 2007. Bézier curve and surface fitting of 3D
Bidanda, B., Motavalli, S., and Harding, K., 1991. Reverse engin- point clouds through genetic algorithms, functional net-
eering: an evaluation of prospective non-contact technol- works and least-squares approximation. In: O. Gervasi and
ogies and applications in manufacturing systems. M.L. Gavrilova, eds. Computational Science and Its
International Journal of Computer Integrated Manufacturing, Applications - ICCSA 2007, Heidelberg: Springer-Verlag
4 (3), 145–156. Berlin, 680–693.
Blais, F., Rioux, M., and Beraldin, J.A., 1988. Practical consider- Gálvez, A., Iglesias, A., and Puig-Pey, J., 2012. Iterative two-step
ations for a high precision 3-D laser scanner system. Proc. genetic-algorithm-based method for efficient polynomial B-
SPIE 0959, Optomechanical and Electro-Optical Design of spline surface reconstruction. Information Sciences, 182 (1),
Industrial Systems, 225. 56–76.
Boender, E., 1991. A survey of intersection algorithms for curved Horn, B.K. and Brooks, M.J., 1989. Shape from shading. Boston:
surfaces. Computers & Graphics, 15 (1), 109–115. MIT press.
Bradley, C. and Chan, V., 2001. A complementary sensor Gálvez, A. and Iglesias, A., 2016. Particle-based meta-model for
approach to reverse engineering. Journal of Manufacturing continuous breakpoint optimization in smooth local-support
Science and Engineering, 123 (1), 74–82. curve fitting. Applied Mathematics and Computation, 275,
Carbone, V., et al., 2001. Combination of a vision system and a 195–212.
coordinate measuring machine for the reverse engineering Jamshidi, J., Mileham, A.R., and Owen, G.W., 2006. Dimensional
of freeform surfaces. The International Journal of Advanced tolerance approximation for reverse engineering appli-
Manufacturing Technology, 17 (4), 263–271. cations. In: D. Marjanovic, ed. Proceedings of the 9th inter-
Chan, V.H., Bradley, C., and Vickers, G.W., 2001. A multi-sensor national design conference. Dubrovnik: The Design Society,
approach to automating co-ordinate measuring machine- 855–862.
based reverse engineering. Computers in Industry, 44 (2), Jun, Y., 2005. A piecewise hole filling algorithm in reverse engin-
105–115. eering. Computer-aided Design, 37 (2), 263–270.
Cheng, J.T., et al., 2007. Design of a servo motion system and an Kaisarlis, G.J., Diplaris, S.C., and Sfantsikopoulos, M.M., 2000.
image sampling and processing system on a 3D laser A knowledge-based system for tolerance allocation in
scanner. The International Journal of Advanced reverse engineering. In: D.R. Hayhurst, ed. Proceedings of the
Manufacturing Technology, 33 (11–12), 1143–1148. 33rd international matador conference. London: Springer-
Chiang, Y.M. and Chen, F.L., 1999. Sculptured surface recon- Verlag, 527–532.
struction from CMM measurement data by a software itera- Kaplan, A., et al., 2015. Reverse engineering design of a hydrau-
tive approach. International Journal of Production Research, lic turbine runner. In: S.I. Ao, et al., ed. Proceedings of the world
37 (8), 1679–1695. congress on engineering (Vol. 2). London: International
Chintala, G. and Gudimetla, P., 2014. Optimum material evalu- Association of Engineers, 1173–1176.
ation for gas turbine blade using reverse engineering (RE) Krishnamurthy, V. and Levoy, M., 1996. Fitting smooth surfaces
and FEA. Procedia Engineering, 97, 1332–1340. to dense polygon meshes. John Fujii, ed. In: Proceedings of
Chivate, P.N. and Jablokow, A.G., 1995. Review of surface rep- the 23rd annual conference on computer graphics and interac-
resentations and fitting for reverse engineering. Computer tive techniques. New York: ACM, 313–324.
Integrated Manufacturing Systems, 8 (3), 193–204. Le Moigne, J. and Waxman, A.M., 1984. Projected light patterns
Chua, C.K. and Yeong, W.Y., 2014. Bioprinting: principles and for short range navigation of autonomous robots. In:
applications. Singapore: World Scientific Publishing Co Inc. Proceedings of the 7th international conference on pattern rec-
Chua, C.K. and Leong, K.F., 2017. 3D printing and additive man- ognition, Vol. 1, 203–206.
ufacturing: principles and applications. 5th ed. Singapore: Le Moigne, J. and Waxman, A.M., 1985. Multi-resolution grid
World Scientific Publishing Co Inc. patterns for building range maps. Proceedings of the Vision
Chui, C.K. and Lai, M.J., 2000. Filling polygonal holes using cubic Conference, 8, 22–39.
triangular spline patches. Computer Aided Geometric Design, Lee, J.Y., et al., 2016. The potential to enhance membrane
17 (4), 297–307. module design with 3D printing technology. Journal of
Creehan, K.D. and Bidanda, B., 2006a. Computer-aided reverse Membrane Science, 499, 480–490.
engineering of the human musculoskeletal system. Virtual Li, Y., Surisetti, N.P., and Chen, J.C., 2013. Measuring external
and Physical Prototyping, 1 (2), 83–91. profiles of porous objects using CMM. The International
Creehan, K.D. and Bidanda, B., 2006b. Reverse engineering: A Journal of Advanced Manufacturing Technology, 64 (5–8),
review & evaluation of non-contact based systems. In: A. 875–887.
172 Z. GENG AND B. BIDANDA

Li, F., et al., 2014. Rapid and accurate reverse engineering of Raja, V. and Fernandes, K. J., 2007. Reverse engineering: an indus-
geometry based on a multi-sensor system. The trial perspective. London: Springer Science & Business Media.
International Journal of Advanced Manufacturing Sarfraz, M., 2006. Computer-aided reverse engineering using
Technology, 74 (1–4), 369–382. simulated evolution on NURBS. Virtual and Physical
Li, Y. and Nomula, P.R., 2015. Surface-opening feature measure- Prototyping, 1 (4), 243–257.
ment using coordinate-measuring machines. The Segreto, T., Caggiano, A., and D’Addona, D.M., 2013. Assessment
International Journal of Advanced Manufacturing of laser-based reverse engineering systems for tangible cul-
Technology, 79 (9–12), 1915–1929. tural heritage conservation. International Journal of Computer
Li, Y. and Wei, Y., 2016. Scanning data reduction and accuracy Integrated Manufacturing, 26 (9), 857–865.
enhancement through hybrid probing and bicubic surface Shen, T.S., Huang, J., Menq, C.-H., 2000. Multiple-sensor inte-
construction. The International Journal of Advanced gration for rapid and high-precision coordinate metrology.
Manufacturing Technology, 87 (1), 1–12. IEEE/ASME Transactions on Mechatronics, 5 (2), 110–121.
Liepa, P., 2003. Filling holes in meshes. In: L. Kobbelt, Sładek, J., et al., 2011. The hybrid contact–optical coordinate
P. Schröder, and H. Hoppe, eds. Proceedings of the 2003 measuring system. Measurement, 44 (3), 503–510.
eurographics/ACM SIGGRAPH symposium on geometry pro- Srinivasan, V., Liu, H.C., and Halioua, M., 1984. Automated
cessing. Switzerland: Eurographics Association Aire-la-Ville, phase-measuring profilometry of 3-D diffuse objects.
200–205. Applied Optics, 23 (18), 3105–3108.
Lin, Z.C. and Chen, C.C., 2001. Collision-free path planning for Szeliski, R., 2010. Computer vision: algorithms and applications.
coordinate measurement machine probe. International London: Springer Science & Business Media.
Journal of Production Research, 39 (9), 1969–1992. Tang, S. and Hung, Y.Y., 1990. Fast profilometer for the auto-
Liu, J., Dong, G.P., and Fan, Y.B., 2016. Personalized ring design matic measurement of 3-D object shapes. Applied Optics,
and rapid manufacturing based on reverse engineering and 29 (20), 3012–3018.
3D printing. Applied mechanics and materials, 851, 599–602. Tippetts, B., et al., 2016. Review of stereo vision algorithms and
Lu, K. and Wang, W., 2015. A multi-sensor approach for rapid their suitability for resource-limited systems. Journal of Real-
and precise digitization of free-form surface in reverse engin- Time Image Processing, 11 (1), 5–25.
eering. The International Journal of Advanced Manufacturing Ülker, E. and İşler, V., 2007. An artificial immune system
Technology, 79 (9–12), 1983–1994. approach for B-spline surface approximation problem. In: Y.
Ma, W. and Kruth, J.P., 1998. NURBS curve and surface fitting for Shi, et al., ed. International conference on computational
reverse engineering. The International Journal of Advanced science. Heidelberg: Springer-Verlag Berlin, 49–56.
Manufacturing Technology, 14 (12), 918–927. Viana, J.H., Hinduja, S., and Bártolo, P.J.S., 2016. Estimation of
Maruyama, M. and Abe, S., 1993. Range sensing by projecting biometric parameters from cattle rump using free-hand
multiple slits with random cuts. IEEE Transactions on scanning and a 3D data processing algorithm. Virtual and
Pattern Analysis and Machine Intelligence, 15 (6), 647–651. Physical Prototyping, 11 (3), 167–172.
Milroy, M.J., et al., 1995. G1 continuity of B-spline surface Wöhler, C., and Hafezi, K., 2005. A general framework for three-
patches in reverse engineering. Computer-Aided Design, 27 dimensional surface reconstruction by self-consistent fusion
(6), 471–478. of shading and shadow features. Pattern Recognition, 38 (7),
Morita, H., Yajima, K., and Sakata, S., 1988. Reconstruction of 965–983.
surfaces of 3-D objects by M-array pattern projection Xu, X, 2009. Integrating advanced computer-aided design, manu-
method. In: R. Bajcsy and S. Ullman, eds. Proceedings facturing, and numerical control: principles and implemen-
of the international conference on computer vision. tations. Hershey: IGI Publishing.
Washington: IEEE Computer Society Press, 468–473. Yu, M., Zhang, Y., Li, Y., and Zhang, D., 2013. Adaptive sampling
Motavalli, S. and Bidanda, B., (1991). A part image reconstruc- method for inspection planning on CMM for free-form sur-
tion system for reverse engineering of design modifications. faces. The International Journal of Advanced Manufacturing
Journal of Manufacturing Systems, 10(5), 383–395. Technology, 67 (9–12), 1967–1975.
Nayar, S.K., and Nakagawa, Y., 1994. Shape from focus. IEEE Yu, Y., and Chang, J.T., 2005. Shadow graphs and 3D texture
Transactions on Pattern Analysis and Machine Intelligence, reconstruction. International Journal of Computer Vision, 62
16 (8), 824–831. (1–2), 35–60.

You might also like