SN Computer Science (2023) 4:580

https://doi.org/10.1007/s42979-023-01956-1

ORIGINAL RESEARCH

Design and Implementation of Smart Manufacturing Systems Through

AR for Data‑Driven Digital Twin System
J. Ashok1 · N. Anil Kumar2 · David Winster Praveen Raj3 · J. Ashok3 · A. Vinay Bhushan4 · Swathi Edem5

Received: 21 January 2023 / Accepted: 26 May 2023

© The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd 2023

Abstract
Modification of size, residual stress, and surface roughness have an enormous impact on a complex mechanical product’s
final machining quality. Machine quality can be ensured using Digital Twin (DT) technology by checking the real-time
machining process. The virtual–real separation display method is the most modern DT System (DTS). It results in the inef-
fective transmission of the necessary restricting the use of the DTS by processing data on-site technicians to support field
processing. Augmented Reality (AR) monitoring the manufacturing process approach to solve this problem is proposed based
on the DT. First, the dynamic multi-view for AR is built using data from multiple sources. Second, real-time monitoring
of complex product’s intermediate processes incorporates AR to encourage communication between the users of the DT
machining system. The outcome of the system can prevent errors that cannot be fixed. An application case for observing
will be used to confirm the viability and the efficacy of the proposed method.

Keywords Digital twin · Machining technology · Monitoring application · Augmented reality · Effectiveness

Introduction system or component is called a DT. It can depict how a

As Industry 4.0 takes off in the modern world, the conven-
tional manufacturing industry is facing challenges globally
because of the quick advancement and the development of
digital technologies. While doing so, the idea of a “DT”—
the introduction—is being used more and more in manu-
facturing [1]. An actual time simulation of a manufacturing
This article is part of the topical collection “Research Trends in
Communication and Network Technologies” guest edited by Anshul
Verma, Pradeepika Verma and Kiran Kumar Pattanaik.
* J. Ashok
johnasmara984@gmail.com
1
Department of Electronic and Communication Engineering,
V. S. B. Engineering College, Karur, Tamil Nadu, India
2
Department of Electronics and Communication Engineering,
School of Engineering & Technology, Mohan Babu
University, Tirupati, Andhra Pradesh, India
3
School of Business and Management, CHRIST (Deemed
to be University), Bengaluru, Karnataka, India
4
Department of Business Analytics, Kirloskar Institute
of Management, Harihar, Karnataka, India
5
Computer Science and Engineering, Chaitanya Bharathi
Institute of Technology, Hyderabad, India
product performs, operates in an environment, and shaped,
and resources' current states are updated based on ongoing
data collection, and in comparison to its physical counter-
part, DT is a growing industry as well. Convergence between
information and physical space can be furthered with this
efficient real-time interaction method [2]. The manufactur-
ing environment has made extensive use of AR as one of the
key technologies in Industry 4.0 [3]. With AR, users can see
the real world while seeing virtual objects superimposed on
it, instead of replacing it entirely. Additionally, it permits
interaction between users and the outside world, where the
virtual objects' information helps people carry out tasks in
the real world [4].
Regarding the modeling of the ideal assembly, digital
assembly technology has advanced in several ways recently,
including analysis and simulation [1]. When used to simulate
intricate product assembly, DT and AR technologies present
new challenges and opportunities [5]. Researchers have tried
to use AR in the industrial sector for life cycle operations
like product design, planning, maintenance, and assembly
by fusing virtual objects with a physical setting to create an
environment for an augmented virtual fusion where product
characteristics and behaviors can be examined [6]. Technol-
ogy for assembling products using AR is, to some extent, a

SN Computer Science
Vol.:(0123456789)
580 Page 2 of 13
cutting-edge technique for Virtual Reality (VR) assembly
[7]. It gets around the laborious scene-construction steps
demanded by VR techniques using the virtual model and
actual objects in combination and plays a crucial part in
assisting users with assembly planning, design, and execu-
tion [8–10]. Through-life engineering services are compat-
ible with AR, which has such benefits. Technical documents
can now be accessed without paper manuals, and sensors
can accurately detect a product's status, guidance, assembly
maintenance, etc.
The characteristics, formation process, behavior, and effi-
cacy are described and modeled using DT of using digital
technology to represent physical objects [11, 12]. DT can
create virtual models without just relying on human knowl-
edge and theories, but also employ simulation technology
of digital models to delve into and forecast the uncharted
world to learn and identify improved techniques and strate-
gies [13]. There are numerous research areas in AR now, but
few academics have compiled a list of the most cutting-edge
technologies based on DT assembly [14]. The study assesses
and summarizes the recent advancements in AR technology
and methods for simulating assembly using AR, intending to
inspire R&D staff to analyze the research development and
hotspot trends of digital assembly based on DT to create AR
assembly systems [15–17].
Responses from visual detection systems or real-time sen-
sors are used in tracking processing reflecting the location
and condition of assembly parts in a better space [18–20].
The sensors' benefits include high accuracy, quick response
times, and minimal jitter, which can be used to track parts in
various assembly scenes, primarily electromagnetic sensors,
and optical sensors [21]. Unlabeled and labeled tracking are
the two categories under which the visual detection system
is broken down. Despite having issues with optical occlu-
sion, the former is accurate and robust [22]. Although it is
not constrained by markers, the latter has a limited capacity
for adaptation. When discussing interactive processing, it's
important to note that interactive AR systems like glove- and
desktop-based interactive devices are included to incorpo-
rate virtual components and a real assembly environment
[23].
Augmented Reality (AR) monitoring the manufactur-
ing process was proposed through DT. The dynamic multi-
view for AR is built using data from multiple sources and
then real-time monitoring of complex products through
intermediate processes. The incorporated AR encourages
communication between DT machining systems. The out-
come of the system can prevent errors that cannot be fixed.
In Sect. “Related Work”, literature survey was completed.
Sect. “Proposed System” proposed method and some notes
on AR were provided, and in Sect. “Result and Discus-
sions”, results and discussion section followed with finding
as conclusion.
SN Computer Science
SN Computer Science (2023) 4:580
Related Work
A Hand Exoskeleton Device can record assembly and hand
movement gestures in gloves that are interactive [24]. Inter-
active desktop software like Phantom tracks the user's hand
position and force during assembly, which developed the
Para Frustum interactive assembly system, and enabled users
to see intended assembly objects from suitable angles, the
issue of viewpoint occlusion is thus avoided. The analysis
of the assembly process uses digital assembly and a simu-
lation-based evaluation of the digital product model’s error
transfer to confirm that the assembly process and sequence,
and engineering requirements are met by part’s stress defor-
mation [25]. It is extremely helpful in providing direction
for the actual part assembly and manufacturing process, cost
reduction, and increased effectiveness in product develop-
ment [26]. Several aspects make up the current research on
the digital assembly of products using AR technology, such
as collaborative design for the assembly process, perception
of the assembly scene, navigation of the assembly operation,
and virtual and real fusion modeling [27].
For actual and virtual components to locate reality-based
virtual objects using a camera, fusion modeling is a crucial
technology. With the aid of a tracking technique, the ability
to instantly ascertain their motion state and to make sure
that the data between the two environments is consistent
to seamlessly incorporate virtual objects into their natural
surroundings. 3D registration technology is primarily used.
In manufacturing and assembling products using the AR
process, collaborative design is an effective tool, which inte-
grates manufacturing planning, part processing, and product
design and the way operators, planners, and other staff mem-
bers approach product assembly to make it easier for them
to communicate jointly [28]. Personal active assistants with
wireless connections to design workstations were proposed
by researchers to improve the content of the head-mounted
displays and worker’s information. To put it simply, building
parts and assembling twins with real characteristics using
twin data are extremely important to create design assembly
analysis techniques that work with twin models so that these
can precisely forecast how well your products will be assem-
bled and control on how actual products are assembled. The
physical model’s assembly state is synchronic with the vir-
tual model in real time using real data-driven assembly mod-
els. It is possible to predict how well the assembly will go
and to provide the best assembly procedure. Consequently,
the most fruitful course of development will be the combina-
tion of DT and AR, future advancements in high-precision
intelligent assembly technology will be most likely to go in
this direction.
SN Computer Science (2023) 4:580
Proposed System
Digital Twin
To forecast and analyze how an aircraft will behave and
perform based on its digital model, the aerospace industry
introduced the concept of the “DT” first. Different research-
ers from various perspectives have provided definitions of
“DTs”, and activities related to prognostics and diagnostics,
product lifecycle, and mission requirements management,
as well as a virtual part, a physical part, and the DT itself,
and the links between both digital and actual components.
A greater variety of complex products must be produced
with ever-shorter lead times to meet the demands of modern
industrial production on the global market. Because of this,
DT has been widely used in numerous industries. It may take
part in all phases of the product lifecycle, including product
manufacturing and design, using a product, and performing
repairs, maintenance, and overhauls. Cross-examining wit-
nesses in both the real and virtual worlds can assist designers
in quickly adjusting, validating, improving, and optimizing
the design. On the shop floor, the ultimate design will be
made available for production following the product design
phase. Using DT technology, the entire manufacturing pro-
cess—from the raw material to the finished product—can
be managed and optimized. But not just the raw materials
and goods needed to create their DTs, the environments of
manufacturing DT are also crucial, including the machin-
ery, workers, and other tools. Incorporating a CNC machine
tool with the DT concept, for instance, the real-time data
gathered from the physical world can be fully utilized by
DT, giving physical machine tools the ability to function
autonomously and intelligently.
Additionally, it makes it possible to precisely predict a
product's failure, remaining life, fatigue, etc. To create a
model of an aircraft's wings and to track and detect struc-
tural flaws and damages, a DT technique was also used. The
results are more accurate and efficient than those obtained
using more conventional techniques [29]. Additionally, a
high-fidelity digital representation of the products can accu-
rately pinpoint the issue, and a visual analysis and diagnosis
of the issue would be performed.
Table 1  Hardware AR features
Mobility
Registration of 3D space
Hands-free
Data transmission (Real-time)
Page 3 of 13 580
Augmented Reality
One of the foundational elements of Industry 4.0 AR enables
users to view the real world while also seeing virtual objects
blended into it. Olfactory, auditory, visual, somatosensory,
and haptic are just a few of the different sensory modalities
that are included. These three characteristics characterize
most AR technology: combining the physical and digital
worlds, real-time interaction, and space registration in 3D.
It can also be applied to at least six different classes of situa-
tions, including entertainment, visualization of the medical,
maintenance and manufacturing, military aircraft, process
planning, targeting, and movement.
Useful hardware comes in a variety of forms and can
provide users with AR. The ability to operate hands freely,
3D spatial registration, mobility of the hardware, and real-
time data transmission are the four main characteristics that
define AR hardware features [30]. Each significant catego-
ry’s embedded characteristic is listed in Table 1. All four
of these features are only found in head-mounted displays
(HMD) as a form of hardware compared to conventional
Human–Machine Interfaces and additional hardware types.
HMDs have some definite advantages in the manufactur-
ing environment. First, the mobility of HMDs can offer a
natural means of interacting with the virtual and real world
inside the manufacturing setting, from any angle and stance.
Without spending a lot of time in front of one control panel
or machine, operator flexibility is increased. Second, the
spatially registered 3D space can assist the AR hardware to
correctly integrate the virtual models with the real world by
first recognizing how the 3D environment is situated relative
to one another. Third, the ability to operate HMDs without
using your hands is very helpful in a manufacturing setting.
Through HMDs, the operator can see and observe the opera-
tion of the machines. They can also operate the machines
on the actual panels at the same time. Without interfering
with one another, these two processes can be completed
simultaneously.
AR in Manufacturing
Manufacturing is one of the fields where AR is currently
being used extensively, where AR can be used to advance
Head-Mounted Hand Held Monitors Projectors Smart
Display Devices glasses
2D
Yes Yes – – Yes
Yes Yes Yes Yes –
Yes – Yes Yes Yes
Yes Yes Yes Yes Yes
SN Computer Science
580 Page 4 of 13
current methods and offer potential future solutions. Given
the rapid advancement of manufacturing and computer
technologies, allowing operators and users to visualize and
interact with manufacturing data related to manufacturing
processes has become popular. Real-time information fusion
and physical world integration are both possible with AR.
The fabrication processes, assembly, design, maintenance,
and training are just a few examples of the many manufac-
turing tasks where this quality is especially helpful. Addi-
tionally, buyers can buy AR to customize their motorcycles
and see the final product before sending it to production. In
a training, AR can record the 3D environment and assem-
bly area before superimposing the 3D building instructions.
In addition, the fabrication process has been simulated
using AR. The user can intuitively observe and manage the
machining process using this high-fidelity simulation.
Research Gap
When it comes to a machining monitoring system with a
process focus to effectively communicate manufacturing
information, the real-time updates given to the field staff by
the data from the fusion production process must be con-
verted into that form. Prior work on the DT was primarily
concerned with system modeling, data gathering, etc. Con-
sequently, the DT-associated data monitoring techniques and
machining system continue to have some issues. The focus
of earlier studies was primarily on cutting and machine tools.
It is impossible to directly output significant product-related
information due to the paucity of research on processed
goods. The data from machine tools are primarily the focus
of earlier studies on observing the machining process. They
lack a powerful visualization technique to encourage col-
laboration between the system and the people. The in-depth
collaboration between people and technology is currently
not possible with industrial applications of AR because they
only display data. The goal of this study is to conduct an
extensive analysis of the aforementioned factors because the
development of machining process monitoring calls for it.
Process Monitoring Framework
There are three distinct stages in the development of the
manufacturing sector: Fig. 1 depicts the distinctions between
traditional, intelligent, and smart manufacturing. The three
stages have distinct monitoring techniques. In the initial
stages of conventional manufacturing, employees can keep
an eye on the machining operation by gathering observing
and field data collected in real time, including the evolving
state of the workpiece. Manual inspection is typically used
in the discrete manufacturing workshop or a straightforward
2D chart to track the status of development and processing.
It takes too long for it to respond to issues with product
SN Computer Science
SN Computer Science (2023) 4:580
Fig. 1  Development of machining monitoring
quality to achieve precise quality control. As a result, incom-
plete information about product quality is produced by man-
agement techniques and backward data display.
The physical object, the VR-based DT monitoring sys-
tem, the digital representation, and AR, are depicted in
Fig. 2. This framework has three components: P, pi, and Ti.
P stands for the processing procedure, pi for one of its pro-
cesses, and Ti for the time interval needed to carry out the
process pi. The function, dimension, and performance of a
machined object are represented in physical space as P—Sti
(t, k). The system conducted a comparison of DT data during
time segment t by comparing and analyzing the monitored
value, concept worth, and estimated value. The process is
then made visible and transparent using AR technology.
Finally, to aid in worker productivity, the information from
the virtual world is shown and registered on the designated
physical objects.
For HCI, information fusion results from data compari-
sons are sent to the AR system's module. There are two com-
ponents to the HCI: the DT human–computer interaction
cycle and the physical world human–computer interaction
cycle. Through the visualization of data and the analysis
and comparison of the data, it improves the system's abil-
ity to make digital decisions and our understanding of the
physical world.
The system for creating DTs in virtual space uses DTs as
a building block using data fusion and multi-sensor technol-
ogy. The system gathers state information about the geo-
graphical area, evaluates and the processing of forecasted
information, and then incorporates the pertinent into the DT
model, including text and images. Using virtual reality inter-
action improves control over the state of the product. The
system will also identify any potential issues with the current
SN Computer Science (2023) 4:580
Fig. 2  AR-based DTS architecture
processing in real time, based on the status of the products
under consideration, and to ensure efficient processing, sug-
gests the appropriate decision-making framework. AR inte-
grates the item with the item as a way of interacting between
the virtual and real worlds. The following are the specifics:
To create the data output that is appropriate for decision-
making, the product's process and model data are analyzed
Page 5 of 13 580
and processed. The system suggests the operator's preferred
view based on an analysis of the available processing tech-
nology. A multi-view representation for later display is cre-
ated after enough AR views have been combined.
The camera locates the product and identifies the DT
manufacturing model with it using the entity product or the
label object itself. After registration, the visualization system
SN Computer Science
580 Page 6 of 13
arranges the product's multidimensional data by the matching
pattern. To combine and update actual time product data, the
matching tracking algorithm is lastly implemented.
The DT machining system's prediction module assists in
outputting the appropriate processing data, and it is advised
to continue with the processing plan in place. Through voice
commands and gestures, the operator can operate the system.
The system continuously updates the view's data on the infor-
mation it has collected and the staff's working instructions.
An AR Creation Process
Grouping, data cleaning, and additional analysis are used to
create a state of the data, such as spindle state, machine state,
surface quality, and shaft state by simultaneously interpret-
ing the raw data produced by various sensors. To create a
data representation view in multiple dimensions, these data
and models are combined. Registration is used to display the
scene image and the superimposed view. A 3D cloud image
or 3D model, for example, will show the product's physical
and geometric state, whereas a live chart showing the equip-
ment data will be shown. Worker perception of the workplace
conditions and machining process can be improved through
the fusion of virtual reality so that the machining process can
be thoroughly controlled [31]. This is done using voice and
gesture control technology to select monitoring data. The
aforementioned information must be processed by the moni-
tors using DT technology to be displayed in AR. All AR View
Objects (ARVO) produced during the cutting-out procedure
are gathered by an AR Dynamic Multi-View (ARDMV), as
seen in Fig. 3. Numerous View Objects (VOs) are contained
within each AR view object. Both separate and simultaneous
displays of each view object are possible. They are made up
of two elements: the supporting and the primary element. The
primary element view in the dynamic multi-view AR displays
the data produced after fusion and selection. The added com-
ponent displays the text generated or symbol for the descrip-
tion after data selection.
ARDMV ⊆ VOf; VOs; VOr (1)
The VO condition of the system and the cutting-out pro-
cedure are all connected to the proposed view (VOr). It is
possible to employ a collaborative filtering algorithm to sug-
gest the following points of view by only taking the effect of
the process into account. Assume that up, v represents the
evaluation of a particular process p view v.
1 ∑
rP = ( ) rv (2)
vP v∈Vp
It is determined whether two processes are correlated
using the Pearson correlation coefficient. Formula (5) can
SN Computer Science
SN Computer Science (2023) 4:580
be used to determine how similar things are (w (p, p′)) using
the relationship between process p and other process p’s
rating vectors:
∑
x∈Xp ∩Xp� (rp,x − r̄ p ) (rp� ,x − r̄ p )
w(p, p� ) = �∑
2
∑ 2
v∈Xp ∩X � (rp,x − r̄ p ) ⋅ v∈Xp ∩X � (rp� ,x − r̄ p )
p p
(3)
The view sets for operations p are represented by Vp and
Vp′, respectively, in Eq. (4). The value of w (p, p′) is used to
determine how similar two scoring vectors are. According to
the pc p;v, where factor k is the standardized weight.
1
� �
p, p� rp� ,x − rp
�� �
Pcp,v = rp + ∑ (4)
p� ∈Pw (p, p� ) p� ∈Pw
Finally, Eq. (5) governs the choice of view objects in
VOr:
1
Pcp,v = rp + ∑
a∈Pw (m, a)
� � (5)
� �
w(m, p� ) rp� ,x − rp�
� �
Spx (rp,x − rp ) +
x∈Vs y∈p
The Fusion of Physical Object
ARDMV of the DT machining system can be dynamically
constructed using the aforementioned method. However,
given the dynamic environment change that occurs during
the machining process, it is difficult to implement AR visu-
alization accurately and intuitively. To address it, dynamic
tracking and registration techniques are proposed, as seen
in Fig. 4.
The system uses AR glasses to track the product’s posi-
tion and obtain the model's transformation matrix. The posi-
tion conversion algorithm can align the virtual twin approach
with the physical space marks. The physical model is then
disregarded in favor of referencing the geometric model's
location. The textual data on equipment status and product
monitoring data, and based on the viewpoint of humans, a
portion of the model must be coupled with the results of the
system's recommendations. The online and offline stages are
the two parts of the dynamic registration tracking method.
The DT generates the product multi-view image and multi-
process samples during the offline phase.
After calculating the samples’ inclinations gradually,
matching templates for the camera pose and description were
created. In the online stage, a method called line-mod template
matching is employed to determine. When a match is made,
the registering AR view objects in the appropriate place. The
tracking procedure involves fusing the data produced by the
SN Computer Science (2023) 4:580
Fig. 3  Process of creating ARMDW
magnetometer, accelerometer, and gyroscope to calculate the
equipment's attitude to prevent the recurrent registration issue
brought on by the reduction in the workpiece field of view.
Machining Process Information
The allocation of the gathered delivering data to the relevant
virtual world locations is done through the enhancement
Page 7 of 13 580
monitoring process. The processing information is then
accurately displayed. Operators can improve physical space
control while using the system simultaneously. The system
continuously modifies the equipment status and geometric
data. The operator receives recommendations for decisions
based on the system's recommendation of process informa-
tion. The operator can use voice commands, gestures, and
other methods to control the physical space while keeping an
SN Computer Science
 580 Page 8 of 13 SN Computer Science (2023) 4:580

Fig. 4  The virtual–real fusion process

SN Computer Science
SN Computer Science (2023) 4:580
eye on the process taking place on-site and the system’s rec-
ommended outcomes. Consequently, real-time monitoring
also includes control and observation, and operation update
and automatic update are thus two of the update modes. The
real manufacturing process status can be obtained through
real-time data transmission and update by getting the serv-
er’s and machine’s real-time data.
Real-time data extraction of the product's geometry is
what constitutes the automatic update component, which
updates the data for the AR model. To reflect the real-time
change in the product surface, the physical state informa-
tion is gathered. The text form of these data, including spin-
dle speed, feed rate, powerful cutting, etc., can be shown
in a real-time setting. The system also suggests current
Page 9 of 13 580
decision-making outcomes to enhance the machining pro-
cess using these data to analyze them in real-time. Follow-
ing the collection of complete and understandable visual
information during the process of enhancement. With the
aid of AR devices, users may benefit from this knowledge
to directly decide what to do and manage the physical sys-
tem. A closed-loop control will be established as soon as
the command is introduced into the control process, to
directly update and improve the data for the DT. On the AR
device, the data from there is always access to the updated
and enhanced DT. The monitoring system’s machining
process data real-time update method is thus condensed in
Algorithm 1.
SN Computer Science
580 Page 10 of 13
Fig. 5  DT-driven bicycle design
Results and Discussion
Test Environment
One of the potential future applications of driving product
design with DTs is demonstrated using the example of a
bicycle. The prototype in the end is acquired after going
through three stages, as shown in Fig. 5, and DT technol-
ogy is used the entire time. The bicycle's physical charac-
teristics, such as its size, material, color, and mechanical
properties, can be incorporated into the conceptual design
of the bicycle, and the installation of an assembly sen-
sor on the bicycle, which uses DT technology to collect
various environmental data, such as geographic informa-
tion and temperature, and it can accurately translate all of
the product's physical data into a virtual space. By exam-
ining the data included by the DT, such as riding time,
SN Computer Science
SN Computer Science (2023) 4:580
speed, and braking habits, designers can also learn about
the users' riding habits and enhance the design strategy.
Online reviews from customers are a valuable source of
reference data for designers, which, without a doubt, can
aid in the development of concepts for esthetic design and
market competition strategy.
The control of product costs, which has a direct impact on
business profits, needs to be decided at this point. Designers
can analyze market demand, product sales, features of com-
peting products, and user groups on the market using the old
information that the DT has integrated. Designers can direct
the choice of product materials, manufacturing techniques,
and pricing by taking into account the investment strategy,
to guarantee profit maximization. The design scheme will be
further improved during the detailed design stage using input
from customers and test results, and several issues with the
previous generation's use by consumers surfaced. Designers
SN Computer Science (2023) 4:580
may be influenced to select the right color combination, for
instance, to lower the likelihood of an accident by compil-
ing data on the likelihood of accidents involving bicycles of
various colors.
Additionally, adjustments need to be made based on
the various usage patterns, tire sizes, frame materials,
and braking capabilities. The right frame size, shape, and
relative placement of the seat and handlebars will all be
chosen by the designers. According to the riders' heights
and body types, the angle is of the seat surface, the width
is of the cushion, and the relative position is of the cush-
ion about the pedal. To make sure the design scheme
is workable during the detailed design stage, designers
must always conduct simulation verification, such as if
the components can work well together, the attractiveness
of the color combination, whether the method of energy
transmission is labor-saving, what is a reasonable setting
for the velocity gradient, etc. Designers can quickly fix
all these design flaws and deliver reasonably developed
prototypes of the products that will be put through a vir-
tual test later.
Product Manufacturing
Three factors handling of resources, a production schedule,
and regulating a process are primarily taken into consid-
eration during the process. First, resources like operators,
tools, equipment, materials, etc., should be prepared and
Fig. 6  The composition and
operation mechanism
Page 11 of 13 580
allocated based on the final product. Second, a production
plan needs to be developed to achieve goals like lowering
costs, cutting down on time, and raising quality to specify
the manufacturing procedure in advance, including machin-
ing, assembly, logistics, etc. Real-time conditions, such as
material storage, production schedule, and product quality,
must then be controlled and monitored during the execution
stage to guarantee precision, consistency, and high process
efficiency. The shop floor is the primary actor in the manu-
facturing process because it provides the resources and effi-
ciently arranges them to produce the final goods. Figure 6
illustrates the components of DTS, which includes the Vir-
tual Shop Floor (VS), Physical Shop Floor (PS), Shop Floor
DT Data (SDTD), and Shop Floor Service System (SSS). To
produce final products, PS is tasked with receiving prede-
fined orders and production tasks and strictly carrying out
those orders. VS, an incredibly accurate and fully digitalized
matching of PS, can simulate and forecast production plans
and processes and provide SSS with optimization strategies,
and also real-time manufacturing process monitoring and
control. SSS stands for a collection of service systems and
support that are used in product manufacturing. All PS, VS,
and SSS-related data and any data generated by fusing these
three components' data are referred to as SDTD, and this is
what gives DTS its motivation.Initial plans for allocating
resources to the materials, equipment, people, tools, etc. are
made whenever an SDTD-directed production task is about
to begin, and that are generated are compliant with the task
SN Computer Science
580 Page 12 of 13
requirements and constraints. In particular, SDTD involves
combining data using mining, data associations, fusion, and
other methods using data from PS, VS, various service sys-
tems, and data from PS and VS. The resource allocation
plans are created with the help of these data, which are more
thorough and useful, and relate to the present condition, the
future condition of the resources, and the overall interest
of the entire business. Plans for allocating resources can be
created in the form of services that offer orders for allocat-
ing resources to place them in the proper states. Resources
must be allocated while also being iteratively adjusted and
optimized due to PS's real-time changes.
The SSS services generate by outlining the actual process
for making a product in advance, and production schedules
can be made by resource allocation plans like a machine-
tooling strategy, manually operating, and a schedule for the
tools. These plans are sent to the VS, which consists of rule
models, behaviour models, and other elements. In order to
find any potential conflicts, VS runs virtual space simula-
tions based on the blueprints before the real manufacturing
process. VS can also provide feedback on service optimisa-
tion strategies through the analysis of forecast data, simula-
tion data, and rule data generated by various models. Correct
mistakes using optimisation techniques and send back the
modified plans for further verification of VS services in SSS.
Conclusions
To machining operation and aid the role of the process-
ing team in preserving product quality, this study uses AR
technology. To achieve the goal of tracking the progress of
the cutting-out procedure, this paper presents a machining-
specific method for human–computer interaction. To assist
the machining person in choosing the necessary processing
information, the interaction between multiple views, their
mechanism, and construction is investigated. This technique
examines and enhances the tracking and virtual registration
technique. A box with a carrying case is used to demonstrate
the method's viability. According to research, field operators
can instantly control product quality with the aid of virtual
and physical space systems. The involvement of humans by
machines is still in its early stages at the moment.
Funding The authors declare that no funding has been received to
carry out the work.
Declarations
Conflict of interest The authors declare that they have no conflict of
interest.
SN Computer Science
SN Computer Science (2023) 4:580
References
1. Li M, Feng X, Han Y. Brillouin fiber optic sensors and mobile
AR-based DTs for quantitative safety assessment of underground
pipelines. Autom Constr. 2022;144: 104617.
2. Liu S, Lu S, Li J, Sun X, Lu Y, Bao J. Machining process-oriented
monitoring method based on DT via AR. Int J Adv Manuf Tech-
nol. 2021;113(11):3491–508.
3. Zhang Z, Wen F, Sun Z, Guo X, He T, Lee C. Artificial intelli-
gence-enabled sensing technologies in the 5G/internet of things
era: from virtual reality/AR to the DT. Adv Intell Syst. 2022.
https://​doi.​org/​10.​1002/​aisy.​20210​0228.
4. Yi L, Glatt M, Ehmsen S, Duan W, Aurich JC. Process monitor-
ing of economic and environmental performance of a material
extrusion printer using an AR-based DT. Addit Manuf. 2021;48:
102388.
5. Kikuchi N, Fukuda T, Yabuki N. Future landscape visualization
using a city DT: integration of AR and drones with implementa-
tion of 3D model-based occlusion handling. J Comput Design
Eng. 2022;9(2):837–56.
6. Vidal-Balea A, Blanco-Novoa O, Fraga-Lamas P, Vilar-Montes-
inos M, Fernández-Caramés TM. Collaborative Augmented DT:
a novel open-source AR solution for training and maintenance
processes in the shipyard of the future. Eng Proc. 2021;7(1):10.
7. Ssin S, Suh M, Lee J, Jung T, Woo W. Science tour and business
model using DT-based AR. In: AR and Virtual Reality. Cham:
Springer; 2021. p. 267–76.
8. Moya B, Badías A, Alfaro I, Chinesta F, Cueto E. DTs
that learn and correct themselves. Int J Numer Meth Eng.
2022;123(13):3034–44.
9. Balamurugan K, Latchoumi TP, Ezhilarasi TP. Wearables to
improve efficiency, productivity, and safety of operations. In:
Smart manufacturing technologies for industry 4.0. Boca Raton:
CRC Press; 2022. p. 75–90.
10. Künz A, Rosmann S, Loria E, Pirker J. The potential of augmented
reality for digital twins: a literature review. In 2022 IEEE confer-
ence on virtual reality and 3D user interfaces (VR) 2022 (pp.
389-398). IEEE.
11. Yu C, Xu S. A DT-based AR assisted cloud additive manufactur-
ing framework in support of value co-creation for multi-stake-
holder. Available at SSRN 4210230. 2022.
12. Vidal-Balea A, Blanco-Novoa O, Fraga-Lamas P, Vilar-Montes-
inos M, Fernández-Caramés TM. A collaborative industrial AR
DT: developing the future of shipyard 4.0. In: International Sum-
mit Smart City 360. Cham: Springer; 2022. p. 104–20.
13. Lyons N. Deep learning-based computer vision algorithms,
immersive analytics and simulation software, and virtual reality
modeling tools in DT-driven smart manufacturing. Econ Manag
Financ Mark. 2022;17(2):67–81.
14. Anand M, Balaji N, Bharathiraja N, Antonidoss A. A controlled
framework for reliable multicast routing protocol in mobile ad hoc
network. Mater Today Proc. 2021. https://d​ oi.o​ rg/1​ 0.1​ 016/j.m
​ atpr.​
2020.​10.​902. (ISSN 2214-7853).
15. Jumani AK, Kumar K, Ameen Chhajro M. Systematic analysis
of virtual reality & augmented reality. Int J Inf Eng Electron Bus.
2021;13(1):36–43.
16. He F, Ong SK, Nee AY. An integrated mobile AR DT monitoring
system. Computers. 2021;10(8):99.
17. Jumani AK, Siddique WA, Abro A, Khan AA. Virtual reality
and augmented reality for education. In: Multimedia comput-
ing systems and virtual reality. Boca Raton: CRC Press; 2022. p.
189–210.
18. Shahzad M, Shafiq MT, Douglas D, Kassem M. DTs in built envi-
ronments: an investigation of the characteristics, applications, and
challenges. Buildings. 2022;12(2):120.
SN Computer Science (2023) 4:580
19. Mihai S, Yaqoob M, Hung DV, Davis W, Towakel P, Raza M,
Nguyen HX. DTs: a survey on enabling technologies, challenges,
trends and future prospects. IEEE Commun Surv Tutorials. 2022.
https://​doi.​org/​10.​1109/​COMST.​2022.​32087​73.
20. Wu K, Laghari RA, Ali M, Khan AA. A Review and State of
Art of Internet of Things (IoT). Archives Comput Methods Eng.
2021;2021:1–19.
21. Latchoumi TP, Ezhilarasi TP, Balamurugan K. Bio-inspired
weighed quantum particle swarm optimization and smooth sup-
port vector machine ensembles for identification of abnormalities
in medical data. SN Appl Sci. 2019;1:1137. https://​doi.​org/​10.​
1007/​s42452-​019-​1179-8.
22. Liu YK, Ong SK, Nee AYC. State-of-the-art survey on DT imple-
mentations. Adv Manuf. 2022;10(1):1–23.
23. Khan AA, Laghari AA, Shaikh AA, Shaikh ZA, Jumani AK. 8
Innovation in multimedia using IoT systems. In: Multimedia com-
puting systems and virtual reality. Boca Raton: CRC Press; 2022.
p. 171.
24. Hasan SM, Lee K, Moon D, Kwon S, Jinwoo S, Lee S. AR and
DT system for interaction with construction machinery. J Asian
Archit Build Eng. 2022;21(2):564–74.
25. Garg G, Kuts V, Anbarjafari G. DT for fanuc robots: industrial
robot programming and simulation using virtual reality. Sustain-
ability. 2021;13(18):10336.
26. Lian B, Zhu Y, Branchaud D, Wang Y, Bales C, Bednarz T,
Waite TD. Application of DTs for remote operation of membrane
capacitive deionization (mCDI) systems. Desalination. 2022;525:
115482.
27. Caiza G, Sanz R. Digital twin for monitoring an industrial pro-
cess using augmented reality. In 2022 17th Iberian Conference on
Page 13 of 13 580
Information Systems and Technologies (CISTI) 2022 (pp. 1-5).
IEEE.
28. Jumani AK, Laghari RA. Review and state of art of fog comput-
ing. Arch Comput Methods Eng. 2021;2021:1–13.
29. Sierla S, Azangoo M, Rainio K, Papakonstantinou N, Fay A,
Honkamaa P, Vyatkin V. Roadmap to semi-automatic generation
of DTs for brownfield process plants. J Ind Inf Integr. 2022;27:
100282.
30. Sneha P, Balamurugan K. Investigation on wear characteristics
of a PLA-14% bronze composite filament. In: Recent trends in
product design and intelligent manufacturing systems. Singapore:
Springer; 2023. p. 453–61.
31. Beisheim N, Rädle M, Reichwald J, Linde M, Otta T, Amann S,
Kastner K. Simultaneous interdisciplinary teamwork on digital
twins in a 3D collaborative environment. In Transdisciplinarity
and the Future of Engineering, Proceedings of the 29th Interna-
tional Society of Transdisciplinary Engineering (ISTE) Global
Conference, Cambridge, MA, USA, 5–8 2022 (pp. 380-389).
Amsterdam, The Netherlands: IOS Press Incorporated.
Publisher's Note Springer Nature remains neutral with regard to
jurisdictional claims in published maps and institutional affiliations.
Springer Nature or its licensor (e.g. a society or other partner) holds
exclusive rights to this article under a publishing agreement with the
author(s) or other rightsholder(s); author self-archiving of the accepted
manuscript version of this article is solely governed by the terms of
such publishing agreement and applicable law.
SN Computer Science