Professional Documents
Culture Documents
https://doi.org/10.1007/s12652-018-0911-3
ORIGINAL RESEARCH
Abstract
With the rapid development of virtual technology and data acquisition technology, digital twin (DT) technology was pro-
posed and gradually become one of the key research directions of intelligent manufacturing. However, the research of DT
for product life cycle management is still in the theoretical stage, the application framework and application methods are
not clear, and the lack of referable application cases is also a problem. In this paper, the related research and application of
DT technology are systematically studied. Then the concept and characteristics of DT are interpreted from both broad sense
and narrow sense. On this basis, an application framework of DT for product lifecycle management is proposed. In physical
space, the total-elements information perception technology of production is discussed in detail. In the information process-
ing layer, three main function modules, including data storage, data processing and data mapping, are constructed. In virtual
space, this paper describes the implementation process of full parametric virtual modeling and the construction idea for DT
application subsystems. At last, a DT case of a welding production line is built and studied. Meanwhile, the implementation
scheme, application process and effect of this case are detail described to provide reference for enterprises.
* Yu Zheng
yuzheng@sjtu.edu.cn
1
School of Mechanical Engineering, Shanghai Jiaotong
University, Shanghai 200240, China
13
Vol.:(0123456789)
Y. Zheng et al.
13
An application framework of digital twin and its case study
requirements. Therefore, it is necessary to study the appli- cloud-based CPS to identify various degrees of basic and
cation of DT system. hybrid computation-interaction modes.
In product design phase, NASA and US Air Force apply Literature review and application cases related to DT
the DT technology in vehicles development, so they can indicated that current research and application of DT is still
predict the future performance and status of vehicles by in its initial phase. It is still difficult to use the DT technol-
constructing ultra-high fidelity simulation models with ogy to realize synchronous fusion of virtual and physical
the parameters of material properties and Manufacturing space in the process of product manufacturing and service.
defects (Glaessgen and Stargel 2012). Siano et al. (2013) Because multi-scale high-precision simulation model and
proposed DSEMS to describe the designing method and virtual test model are deficient, the model uncertainties
testing method for presenting its simulation results and ver- quantitative technology is insufficient, predictive precision
ify its effectiveness. And many companies (eg., Autodesk, of sophisticated systems is low, and data acquisition and pro-
Siemens) are also interested to use the DT technology to cessing is still difficult. In addition, for industry a complete
provide a general guidance for the future design (Stackpole application framework is also needed to solve the problem
2015). at the system level.
In process design phase, DT is used to optimize toler-
ances, locator positions, clamping strategies, welding
sequence, etc. to obtain good geometrical quality in the final 3 Application framework of digital twin
product (Söderberg et al. 2017).
In product manufacturing phase, PTC aims to achieve Application framework of DT for product lifecycle manage-
real-time interconnection between physical products and vir- ment consists of three parts, physical space, virtual space
tual models to enhance the flexibility and competitiveness and information-processing layer. In the application pro-
of manufacturing system (Pardo 2015). And cyber-physical cess, the DT technology can realize the full-physical system
system is proposed to optimize energy efficient machining mapping, the life-cycle dynamic modeling and the whole
process (Li et al. 2018). With the virtual factory technology, process real-time optimization. The bidirectional mapping
a framework of simulation-based approach is proposed to and interoperability of physical space and virtual space are
guide simulation-based plant design and evaluation, opti- realized through data interaction. Intelligent decision is real-
mize plant layout and the production process (Zhang et al. ized through iterative optimization and regulatory interac-
2018). tion between two spaces. The application framework of DT
In product operation and maintenance phase, the US Air is shown in Fig. 1.
Force Research Laboratory applies the DT to predict aircraft
structural life to improve its safety and reliability (Tuegel 3.1 Physical space
et al. 2011). Tesla is working on developing a DT for every
car it produces, allowing for synchronous data transmission The physical space is a complex, diverse and dynamic pro-
between cars and its factory (Schleich et al. 2017). Li et al. duction environment, which consists of people, machines,
(2017) use the concept of a dynamic Bayesian network to material, rules and environment. Resources layer includes
build a versatile probabilistic model for diagnosis and prog- all kinds of objects related to product development and
nosis in order to realize the DT vision to fulfill airframe manufacturing, such as production resources (production
health monitoring. On the basis of the Gaussian–Bernoulli line equipment, etc.), product data resources, computing
deep Boltzmann machine (GDBM), Wang et al. (2018) dis- resources (high-performance computing clusters, etc.) and
cuss a deep neural network model to optimize the condition software resources. All kinds of objects are separated and
prognosis and to predict the future degradation status and distributed in different places, and they are needed to be con-
remaining service life of a machine. nected by IOT technology. Then the data of physical world
Besides, Canedo (2016) present a new vision on the will be collected, integrated and used for optimization.
industrial IoT lifecycle management and optimization at Taking manufacturing workshop as an example, intelli-
scale via DT. Rodič (2017) shows a new simulation model- gent sensor and communication equipment are used to col-
ling paradigm by using development of DT based on the lect and transmit multi-source heterogeneous data, including
widely available sensor technologies. Schleich et al. (2017) equipment attributes, status, process, fault, disturbance, etc.
propose a comprehensive reference model based on the These data will be collected by digital devices and trans-
concept of skin model shapes to describe model concep- ferred to the network. In addition, according to the feedback
tualization, representation, and implementation as well as instructions from virtual space, related physical devices will
applications along the product life-cycle. Alam and El Sad- also make timely intelligent reaction. The mapping (direct
dik (2017) present a DT architecture reference model for the mapping and indirect mapping) between data and device
13
Y. Zheng et al.
attributes makes the interaction between the physical and will be accessed in real-time. The real-time status data
the digital space possible. has to be integrated with information management system,
At the implementation level, the core of physical space such as PDM, ERP, and MES. In addition, the mapping
construction is mainly the total-elements information per- relationship between data and device attributes has to be
ception of physical production. established for the total-elements perception.
As shown in Fig. 2, the total-elements information per-
ception technology of physical production mainly includes
four levels, the physical layer, the technology layer, the 3.2 Information processing layer
data layer and the system layer. The perceived objects of
the manufacturing process include the manufacturing sta- The information processing layer is the channel connecting
tus of parts, environment, logistics, equipment, and labors. physical space and virtual space, the bidirectional mapping
Taking manufacturing process flow and control flow as and interoperation of physical space and virtual space are
the main line, perception includes status perception, loca- realized through the data interaction in this layer. There
tion perception and manufacturing quality perception. are three main function modules of this layer, data storage,
Through the barcode or QR code, RFID, IPC, position- data processing and data mapping (Fig. 3).
ing system, PLC and sensors, various status information
13
An application framework of digital twin and its case study
Physical objects
RFI
D
Technical approach
Perception
Perception of state perception of location
of processing quality
QR code RFID Manufacturing Digital image
Vision sense Environmental
application application location sensing of
technology monitoring
technology technology technology product quality
RFID Applicability Sm oke
Marking Sheet
packaging of scheme perception and
process Remote forming test
technology monitoring
wireless
RFID perception Calibration
Marking technology Toxic gas
recognition Seam tracking
System monitoring
technology
UWB Image
technology matching
RFID technology Flammable
Recognition Mottling
encryption gas
process detection
technology Feature monitoring
IGPS location detection
Dynamic technology
Recognition Other visual Other factor
manufacturing Sensor data
System proces s trac king inspection monitoring
optimization
Data Type
Production Equipment Service Environment
User data ...
data data data data
Database of Information
layer and Virtual space
Database Database Database Database ėė
The data that needs to be stored in this layer mainly con- Data processing in this layer consists of four steps: data
sists of two parts, data from physical space and data from acquisition, data preprocessing, data analysis and mining,
virtual space. and data fusion. Data source includes the different database
The data from physical space mainly includes produc- of MIS, PLCs, and manufacturing systems. The raw data is
tion data, equipment data, material data, labor data, ser- collected by ODBC interface and other technologies. Then
vice data, workshop environment data, etc. The data from sets of raw data are preprocessed, and the procedure mainly
virtual space mainly includes simulation data, evaluation includes the rule-based data cleaning, data structuring, and
and prediction data and decision data. primary clustering (Zhang et al. 2016). Thus, the noise in
13
Y. Zheng et al.
raw data is eliminated, and the accuracy, completeness and multi-scale transforming of time-sequence model, and time-
consistency of data are improved. Then sets of clean data varying regularity analysis.
are analyzed and mined. The normal procedures of target Data correlation is realized by using complex network
oriented data analysis include frequent patterns mining, clas- and data mining algorithm. Through the definition of data
sification, advanced clustering, and outlier detection. On the relation, and correlation rules of different data from the
basis of data acquisition, preprocessing, analysis and min- physical and virtual objects, the workshop data network
ing, multi-level data fusion from feature level and decision is built for the workshop status analysis and he mapping
level is possible. Thus, the quality and dimensions of data between the physical and virtual DT system.
are improved. There are two modes for data synchronization, real-time
synchronization and no real-time asynchronous. The core of
the real-time synchronization is to connect simulation model
3.2.3 Data mapping controller with the physical PLC controller, and the control-
ler can be verified by the virtual test system. In no-real-time
Data mapping supports the synchronous mapping of physical asynchronous data transition, the intermediate database is
data and virtual workshop operation based on the data stor- used as temporary storage in data transmit to the virtual
age module and data processing module. It mainly including space.
three parts, data time-sequence analysis, data correlation and
data synchronization. 3.3 Virtual space
The core of data time-sequence analysis is the mining
algorithm with sequence mode. According to the charac- 3.3.1 Working mechanism of virtual space
teristics of the data, a time-sequence data model is built
for the multidimensional and heterogeneous data, to reveal The virtual space consists of two parts, the virtual environ-
the evolution rules of manufacturing data. There are three ment platform (VMP) and the DT application subsystem
key points in this phase, fast index of data sequence set, (DTs) for product lifecycle management. The VMP is built
13
An application framework of digital twin and its case study
to establish a unified 3D virtual model for application and 2. Construction of the information model
to provide an operating environment for algorithms library.
There are interactions between VMP and DTs. VMP pro- First, the meta-models of physical objects are established
vides various virtual models for DTs, including polyphysical by analyzing the data structure of entity object and its rela-
model, workflow model, simulation model, etc. DTs accu- tion. According to the full parametric modeling method, the
mulates various models, methods and historical data that expression of all kinds of information involved in the model
are created during the operation into VMP. In virtual space, is defined to ensure the completion of meta-models. Then
the modeling of physical objects is available by obtaining the consistency check of the sub-model of the same layer is
the attributes of the virtual model from the database, and implemented. And the horizontal integration of the same
the feedback of 3D models will be stored in the database by hierarchical model is established. Meanwhile, the low-level
using corresponding interfaces. In the DT system, the real- sub-models are integrated into the high-level domain infor-
time and historical data of 3D virtual models and physical mation model. As a result, the global information model is
products are combined to drive the DTs running synchro- implemented.
nously. Meanwhile, the DT, as the real mapping of physical
entities, can not only realize the visualization of products, 3. Construction of the simulation model
but also realize the simulation of complex systems. When
conflicts and disturbances occur in physical space, virtual The key to construct the simulation model is to define
models can be tested in real time or even predict them, and the behavior logic for physical objects. Take the workshop
feed the information back to the physical space. DT as an example, the entity status, activities and events
Take the workshop as an example, the construction of that causes physical changes are defined. Then, the behavior
virtual space mainly includes the modeling of full paramet- logic of entity models is built by taking process flow and
ric virtual workshop and the construction of DT application other processes as the main line.
subsystems.
4. Fusion of models
3.3.2 Full parametric virtual modeling of workshop
The full parametric information models and the high
On the base of physical workshop prototype, the high preci- accurate simulation models should be integrated to ensure
sion digital simulation models of all kinds of equipment, the correct relationship of multi-level dimensions. The accu-
labors, fixtures, tools, products and other workshop elements racy and consistency of the final model should be checked.
are established. And based on UML and other information
modeling methods, the mapping information model for 3.3.3 Construction of digital twin application subsystems
total-elements of workshop is established. Then, the infor-
mation model and the simulation model are integrated and Based on the requirements and application targets, the DT
correlated, to synchronize the operation information of the application subsystems for product life cycle are built with
workshop, and to provide a basic environment for the 3D knowledge fusion, data management, algorithm optimiza-
simulation of workshop status. tion, status evaluation and prediction, plan and instruc-
The implementation process of full parametric virtual tion release and other functions. They can realize product
modeling includes four steps: analysis of a specific work- function analysis, product performance prediction, product
shop system, construction of the information model, con- testing, ergonomics analysis, production layout planning,
struction of the simulation model and the fusion of models, equipment status prediction, process implementation analy-
as shown in the Fig. 4. sis, plant operation optimization, and product maintenance
prediction, etc.
1. Analysis of a specific workshop system
13
Y. Zheng et al.
Begin
Step 1 Legend
Determine the composition of
Steps for
the workshop on all dimensions
information model
Steps for
Decompose the workshop simulation model
system into several subsystems
Steps for both
Y
Integrate the low-level sub-models into Establish the simulation model
the high-level domain information
model
Step 3
Check
Y Step 4
End
13
An application framework of digital twin and its case study
The virtual model of the welding production line was The kinematic data corresponds to the specific parameters
built and real-time data of production line monitoring was of the kinematic model. When the kinematics data received,
collected to achieve the mapping and interaction between the system sends the data to corresponding device, updates
real-time data and models. Therefore, it can form the real- all components positions in the device by kinematic pairs.
time interaction between the physical welding production Finally, geometric model of each device is updated in 3D
line and the virtual welding production line consistently. scene to realize the real-time 3D monitoring process.
Based on that, the operation time and the production cycle
of each station are analyzed, and the real-time status warning 4.3 Information perception and data acquisition
during the production process is realized. Figure 5 shows
the virtual model of the welding production line of the fac- The objects of data acquisition are mainly industrial robots
tory, from left to right, there are the welding machine for on the production line. The industrial robot has multi-DOF
weld assembly, the transporter for the delivery of finished and pretty high speed of movement. Its driving components
parts and the multi-layered warehouse for the storage of the
finished parts.
13
Y. Zheng et al.
are mostly installed on the mobile frame, such as the arm mode. Received data is parsed and put into the monitoring
and the turntable. In order to drive digital model in virtual data buffer. When the virtual scene is updated, the monitor-
environment in real time, it not only needs to obtain real- ing data is taken out from the data buffer and send to the
time status data of equipment in physical space, but also corresponding device (Table 1).
needs to pre-define the information of motion pair of 3D In the process, taking advantage of interface data to
model. As shown in Fig. 6, there are three prismatic pairs acquire the key data mentioned above, OPCUA and Socket
and two revolution joints in the carrier robot. communication mode are mainly adopted. Wide area net-
The key data collected in this case are as follows: work (WAN) adopts OPCUA communication mode, which
The device data is described in OPC protocol specifi- has high reliability and safety, while local area network
cation on an OPCUA (OPC Unified Architecture) server (LAN) adopts Socket communication mode to ensure better
which provides data services. Robots are connected to the transmission efficiency (Figs. 7, 8).
server to collect the monitoring data in the unified descrip-
tion method. When the 3D monitoring system turns on the 4.4 Process of data real‑time mapping
monitoring mode, a connection is established between the
system and OPCUA server. All monitoring data points in the After the objects and the methods of data acquisition are
current monitoring project are read and send to the OPCUA ascertained, the workflow of real-time data mapping is
server as a subscription data list. After that, an independent determined. It includes two steps, the first is using our own
monitoring thread is started to receive the real-time monitor- 3Dlayout to build the virtual environment according to the
ing binary data list sent by the OPCUA server in blocking realistic physical model, and the other is DT application sys-
tem development based on OPCUA, which can fulfill real-
time virtual-physical mapping. 3Dlayout is used to generate
Table 1 The key data of welding production line the virtual simulation environment of welding production
Equipment Data types Count line and generate the file of scene layout for DT application
system. The DT application system in this case is mainly
Welding machine Translation of mechanical arm 6
used in the realization of the real-time mapping between
Welding machine Rotation of mechanical arm 3
physical production line and the virtual production line.
Welding machine Rotation of welding table 2
Then the monitoring and status warning of the production
Transporter Rotation of mechanical arm 2
process are realized based on the real-time visualization of
Transporter Translation of mechanical arm 3
physical state data.
Multi-layered storehouse Translation 3
The key technologies demanded for the application
Total 19
case are lightweight of 3D models, dynamic scheduling of
Internet LAN
13
An application framework of digital twin and its case study
CAD model
Environmental
Equipment Data Kanban
model
3Dlayout
Exist or not
Information of joint
positions
Scene layout
Configuration files of
3DMonitoringSystem
Initialize OpcuaClient
OpcuaClient
Synchronous simulation
models, layout real-time visualization, etc. And the process model and 3D virtual model of the welding production line.
involves simplification of triangular mesh model, model Then remote, real-time, visual monitoring of the physical
smoothing, data real-time exchanging and algorithms In production process is realized. The manufacturing status of
the process of real-time mapping, data, algorithms, models the equipment is transparent, the reliability of the operating
and knowledge are accessed and called via corresponding equipment is interpretable, and the warning for the abnor-
library, and the mapping results are sent to the interface mal state is timely, to ensure reasonable machining process
database finally. by acquiring and processing the equipment status data and
comparing it with standard.
4.5 Application effect As shown in Figs. 9 and 10, the system can show 19 types
of key data of the production line in real time and make sure
The synchronous operation of virtual manufacturing sys- the delay for real-time online simulation is no more than 1 s.
tem is driven by the correlation and integration of physical At the same time, the real-time update rate of 4 million piece
13
Y. Zheng et al.
References
Alam KM, El Saddik A (2017) C2PS: a digital twin architecture refer-
ence model for the cloud-based cyber-physical systems. Access
IEEE 5:2050–2062
Boschert S., Rosen R (2016) Digital twin—the simulation aspect. In:
Hehenberger P, Bradley D (eds) Mechatronic futures. Springer,
Cham, pp 59–74
Canedo A (2016) Industrial IoT lifecycle via digital twins. In: 2016
International conference on hardware/software codesign and sys-
tem synthesis (CODES+ISSS), Pittsburgh, PA, pp 1
Damm M (2017) Industrie 4.0—an overview. https://sec.ipa.go.jp/
Fig. 10 Data real-time update users/seminar/seminar_yokohama_20170227-03.pdf. Accessed
20 Nov 2017
Glaessgen EH, Stargel D (2012) The digital twin paradigm for future
NASA and US Air Force vehicles. In: 53rd Structures, structural
models is stable at more than 50 times per second. And this dynamics, and materials conference: special session on the digital
DT system is able to ensure operation efficiency of equip- twin. Honolulu, HI, US pp 1–14. IOP Publishing Physics. https
ment in production line, as well as provides data for welding ://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20120008178.pdf
Grieves M (2014) Digital twin: manufacturing excellence through
quality of product. virtual factory replication. White paper. Ameritech Corporation,
Chicago
Grieves M, Vickers J (2017) Digital Twin: Mitigating Unpredictable,
5 Conclusion Undesirable Emergent Behavior in Complex Systems. In: Kahlen
FJ, Flumerfelt S, Alves A (eds) Transdisciplinary perspectives on
complex systems. Springer, Cham, pp 85–113
Digital twin technology is the key technology to realize the Haupert J, Xenia Klinge, Blocher A (2017a) CPS-Based Manufactur-
fusion of physical models and virtual models, a typical sys- ing with Semantic Object Memories and Service Orchestration
tem of cyber physical system for application. This paper for Industrie 4.0 Applications. In: Jeschke S, Brecher C, Song
H, Rawat D (eds) Industrial internet of things. Springer, Cham,
proposes both broad sense and narrow sense definition of pp 85–113
DT technology after analyses DT related essay and applica- Haupert J, Klinge X, Blocher A (2017b) CPS-based manufacturing
tion in detail at home and abroad, ascertaining the relation- with semantic object memories and service orchestration for
ship between the related concepts. Meanwhile, the appli- industries 4.0 applications. Industrial internet of things. Springer
International Publishing, Basel, pp 203–229
cation framework and model of DT for product lifecycle
13
An application framework of digital twin and its case study
Li C, Mahadevan S, Ling Y et al (2017) Dynamic bayesian net- Tao F, Zhang M, Cheng J et al (2017a) Digital twin workshop: a
work for aircraft wing health monitoring digital twin. AIAA J new paradigm for future workshop. Comput Integr Manuf Syst
55(3):930–941 23(1):1–9 (in Chinese)
Li XX, He FZ, Li WD (2018) A cloud-terminal-based cyber-physical Tao F, Cheng Y, Zhang L et al (2017b) Advanced manufacturing
system architecture for energy efficient machining process opti- systems: socialization characteristics and trends. J Intell Manuf
mization. J Ambient Intell Hum Comput. https://doi.org/10.1007/ 28(5):1079–1094
s12652-018-0832-1 Tao F, Cheng Y, Cheng J et al (2017c) Theories and technologies for
Pardo N (2015) Digital and physical come together at PTC live global. cyber-physical fusion in digital twin shop-floor. Comput Integr
http://blogs.ptc.com/2015/06/08/digital-and-physical-come-toget Manuf Syst 23(8):1603–1611 (in Chinese)
her-at-ptc-live-global/. Accessed 5 May 2018 Tuegel EJ, Ingraffea AR, Eason TG et al (2011) Reengineering aircraft
Reifsnider Kl, Majumdar P (2013) Multiphysics stimulated simulation structural life prediction using a digital twin. Int J Aerosp Engc.
digital twin methods for fleet management. In: 54th AIAA/ASME/ https://doi.org/10.1155/2011/154798
ASCE/AHS/ASC Structures, structural dynamics, and materials Wang J, Wang K, Wang Y et al (2018) Deep Boltzmann machine based
conference. https://doi.org/10.2514/6.2013-1578 condition prediction for smart manufacturing. J Ambient Intell
Rodič B (2017) Industry 4.0 and the New Simulation Modelling Hum Comput. https://doi.org/10.1007/s12652-018-0794-3
Paradigm. Organizacija 50(3):193–207. https://doi.org/10.1515/ Zhang J, Gao L, Qin W et al (2016) Big-data-driven operational analy-
orga-2017-0017 sis and decision-making methodology in intelligent workshop.
Rosen R, von Wichert G, Lo G et al (2015) About the importance of Comput Integr Manuf Syst 22(5):1220–1228 (in Chinese)
autonomy and digital twins for the future of manufacturing. IFAC- Zhang Z, Wang X, Wang X et al (2018) A simulation-based approach
Papers Online 48(3):567–572 for plant layout design and production planning. J Ambient Intell
Schleich B, Anwer N, Mathieu L et al (2017) Shaping the digital twin Hum Comput. https://doi.org/10.1007/s12652-018-0687-5
for design and production engineering. CIRP Ann Manuf Technol Zhuang C, Liu J, Xiong H et al (2017) Connotation, architecture
66(1):141–144 and trends of product digital twin. Comput Integr Manuf Syst
Siano P, Graditi G, Atrigna M, Piccolo A (2013) Designing and test- 23(4):753–768 (in Chinese)
ing decision support and energy management systems for smart
homes. J Ambient Intell Hum Comput 4(6):651–661 Publisher’s Note Springer Nature remains neutral with regard to
Söderberg R, Wärmefjord K, Carlson JS et al (2017) Toward a Digital jurisdictional claims in published maps and institutional affiliations.
Twin for real-time geometry assurance in individualized produc-
tion. CIRP Ann Manuf Technol 66(1):137–140
Stackpole B (2015) Digital twins land a role in product design. http://
www.digitaleng.news/de/digital-twins-land-a-role-in-product-
design/. Accessed 25 May 2018
13