Professional Documents
Culture Documents
Ares(2019)7935390 - 31/12/2019
Dissemination level
PU: Public X
PP: Restricted to other programme participants
RE: Restricted to a group specified by the consortium
CO: Confidential, only for members of the consortium
Disclaimer:
This document’s contents are not intended to replace consultation of any applicable legal
sources or the necessary advice of a legal expert, where appropriate. All information in
this document is provided “as is” and no guarantee or warranty is given that the information
is fit for any particular purpose. The user, therefore, uses the information at its
sole risk and liability. For the avoidance of all doubts, the European Commission has no
liability in respect of this document, which is merely representing the authors’ view.
TABLE OF CONTENTS
Versioning and contribution history .......................................................................................... 2
Disclaimer: ......................................................................................................................................... 2
About COMPOSELECTOR ........................................................................................................................ 4
Task and Deliverable descriptions from the project proposal ........................................ 5
Compliance with the work-programme NMBP-23-2016 ................................................... 5
Executive Summary ........................................................................................................................ 5
COMPOSELECTOR Business Layer .......................................................................................................... 6
End-user Testing ................................................................................................................................... 10
Methodology ........................................................................................................................................ 10
Functional Requirements Testing ................................................................................................. 11
Structural Requirements Testing .................................................................................................. 12
End-user Testing and Evaluation .......................................................................................................... 13
Feedback of the Demo testing of the business Layer ........................................................................... 24
Conclusion ............................................................................................................................................ 24
Appendix A: Automatic Business Layer Report............................................................................. 25
1. Diagram: Decision Process ........................................................................................................... 26
1.1. Process: Business layer .................................................................................................................. 26
1.1.1. Process Elements ................................................................................................................ 26
1.2. Process: Engineering layer ............................................................................................................ 28
1.2.1. Process Elements ................................................................................................................ 28
1.3. Process: Simulation layer .............................................................................................................. 31
1.3.1. Process Elements ................................................................................................................ 31
2. Complementary Definitions and Elements: definitions ................................................................... 35
2.1. Messages ....................................................................................................................................... 35
Appendix B: Customer Product Design Specification for the Leafspring ................................... 36
LIST of Figures
Figure 1: COMPOSELECTOR BDSS components ..................................................................................... 5
Figure 2: The Business Layer Architecture. ............................................................................................ 6
Figure 3 Identification of decision-makers and roles definitions ........................................................... 7
Figure 4: The web-based -business layer environment. https://business.composelector.eu. .............. 8
Figure 5: The business process and business decisions defined with BPMN and DMN standards. The
BPMN process workflow foe eligibility/approval of a customer order, including MuPIF simulation
and decision making activities based on market and DB information ............................................ 9
Figure 6 : Decision process modelled with DMN .................................................................................... 9
Figure 7: Testing and Validation: Venn Diagram. ................................................................................. 10
Figure 8: Testing and validation methodology ..................................................................................... 11
Figure 9: The testing and validation components. Each of the states in the protocol underwent
individual structural testing as did each module. ......................................................................... 11
Figure 10: Basic BPMN model for structural testing. ........................................................................... 12
Figure 11: BPMN model for Data Object and DMN decision table structural testing. ......................... 12
Figure 12: Workflow describing the composite leafspring part manufacturing. ................................. 13
Figure 13: Schematic representation of the workflow of the material and process selection for
composite leaf-spring. .................................................................................................................. 14
Figure 14: BPMN Process Leafspring.. .................................................................................................. 14
About COMPOSELECTOR
The mission of COMPOSELECTOR is to develop a Business Decision Support System (BDSS),
which integrates materials modelling, business tools and databases into a single end-user’s
workflow to support the complex decision process involved in the selection and design of
polymer-matrix composites1. An overview of the Composelector BDSS platform is presented
in Figure 1. The Business Layer (BPMN based tool) interacts with Material Layer (database
and workflow manager system). The Simulation Layer (MuPIF) provides an infrastructure for
defining and executing distributed simulation workflows, consisting of several linked/coupled
models designed for defined Key Performance Indicators (KPIs). The individual models are
connected to the platform by implementing standardized APIs, allowing for model steering,
data/metadata exchange, distributed and remote computation, monitoring, etc. The
metadata structure is defined by a schema where the metadata can be attached to any
component and validated against this schema. Since the metadata are encapsulated in the
individual components, they can be passed together with the data in one consistent package.
This novel development is also key for the management of the metadata linked to modelling
and simulation tasks.
1
https://doi.org/10.1016/j.compstruct.2018.06.121
Executive Summary
The aim of this work is to evaluate and demonstrate the capabilities of COMPOSELECTOR
business layer. The proposed validation includes both functional and structural testing. The
Figure 2: The Business Layer Architecture.
Technology: The business layer will be based on two well-defined standards: BPMN 2.0, the
last version of the Business Process Model Notation standard defined by the Object
2
OMG, Business Process Model and Notation (BPMN) version 2.0, ISO/IEC 19510:2013 (2011).
http://www.omg.org/spec/BPMN/2.0/
3
OMG, Decision Model and Notation (DMN) version 1.1, (2016).
http://www.omg.org/spec/DMN/
4
BPMN implementers list. http://www.bpmn.org/#tabs-implementers
5
D. Campagna et al. Leveraging the BPMN standard to govern engineering processes in a
collaborative environment., IEEE International Symposium, pages 318-323, (2015)
The workflow: In the developed business layer, a single graphical workflow includes standard
BPMN task nodes, plus an activity node specifically designed to interact with the MuPIF
simulation layer, task nodes to perform queries to databases (like Granta’s MI) and human
interaction task nodes specifically design to interact with COMPOSELECTOR business decision
makers. Decision nodes, supporting the DMN standard, are implemented in order to
implement decision models in terms of business rules. The workflow presented in Figure 5 is
an example of a business process which represents a decision manager process for
“eligibility/approval” of a customer order, which requires simulation analysis and market
information to determine its current business opportunity. The process starts with a human
interaction step, in which the right person is presented with an order from a customer. This
person gets a request on his tablet or smartphone to connect to a secure web page by using
a web link. When connecting with his web browser using his credentials, he gets the data of
the order and prepares two scenarios for simulation. When he closes his tasks, two simulation
activities in MuPIF are started, may be executed on a cluster or distributed system. When
both simulations finish, a decision maker is contacted, may be selected based on the customer
importance, and all information is presented to him. A set of business rules have been defined
by using DMN (explained later), which guide his decision process, in order to present him only
relevant information. This information can include the results of the simulation and results
obtained from queries to databases (specific like Granta’s DB) and/or price information
coming directly from real-time market sites. Based on that information, the decision maker
takes a guided decision (implemented in terms of DMN) in order to determine the processing
of the customer order.
Decision making: The decision-making node implements a decision process in DMN (Figure
6). Decisions are represented in terms of business rules, which automates the most common
decisions and promote consistent results when used many times.
Figure 6 : Decision process modelled with DMN
Based on this decision model, the decision maker is provided with all the information that is
required to take a decision in this particular case, no more and no less. By automating the
procedure, it will not happen that a decision maker could eventually “forget” a step or consider
only partial data, providing a more fair and consistent decision making process across time
and company sectors. Of course, other business process workflows which involve decision
activities for risk evaluation, opportunity analysis, maximizing impact or profit, can be
represented in terms of business process workflows (BPMN 2.0) and decision making rules
(DMN). During the project, the nodes that will interact with the MuPIF simulation
environment will be developed, together with nodes to interact with specific
COMPOSELECTOR databases. The human interaction nodes will be enhanced in order to
support the interaction model required by COMPOSELECTOR business users and DMN
compatible decision making nodes will be implemented. The platform will also be enhanced
to support the innovative concept of “Apps” introduced by COMPOSELECTOR, which are BDSS
tools defined in terms of business process workflows, available to and usable by decision
makers, implementing repeatable decisions activities that are central to the core business of
End-user Testing
The validation of the business layer requires attention to a large number of details. To ease
the validation process, we implemented a business layer testing plan which will be to
continuously improve the quality of the COMPOSELECTORE BDSS and business layer
component prior to release. The process of documenting and standardizing the testing and
validation methods are important steps toward meeting recognized international quality
standards in term of quality, design requirements and robustness. Figure 7 shows the
“interaction space” in which the business layer designers, the implementation team and
testers (end-users) must work. The goal of testing is to minimize the operations which were
designed and implemented but not tested.
Structural Functional
Testing Testing
The testing is based on a verification and validation document prepared during the design
phase of business layer. Examples of validation of the business layer includes End-user
agreement, business layer design agreement, quality improvement and outcome
improvement. The testing the business layer involves generating scenarios in which the end-
user duplicates business processes encountered in real world use. Emphasis is placed on
evaluating the business layer on not only accuracy but also on the "appropriateness of its
approach and scope.
The business layer is validated on simple use cases developed in collaboration with industrial
partners, based on the workflows defined in Deliverable 3.3 and decision support apps. A
preliminary validation of business decision quality based on real KPIs guided by simplified
scenarios will also take place. These simplified scenarios will be used to create example demos
that can, then, be used for documentation, dissemination and marketing purposes.
Methodology
We created a verification and validation document, which described, in detail, methods to be
used in testing and standards for developing testing plans (Figure 8). The testing plan contains
different parts (Figure 9)designed to test both the knowledge base, its implementation and
its usability.
no
Definition
Scenario
DB, interoperability,
Business Decision
Figure 9: The testing and validation components. Each of the states in the protocol
underwent individual structural testing as did each module.
Structural Testing: The structural testing involves testing the function of the business layer
by testing the approach and method of implementation. This testing requires specific and
detailed knowledge of the structure of the Business layer. To test the Business layer modules,
we verify the operation of each state using a combination of robust and worst cast testing.
Functional Testing: Functional testing is concerned with testing the functionality of a business
layer without regard to the method of implementation. Test cases for functional testing are
inspired by real world observations and derived from business layer design specifications.
Test Case Selection: Our test case is chosen to perform both structural and functional testing.
Error Handling: An incident report is created which notes the observed effect, the test
conditions which lead to the error and the probable location of the error. Testing on al
modules which may be affected by the erroneous module is stopped until corrections can be
made.
Figure 10: Basic BPMN model for structural testing.
Figure 11: BPMN model for Data Object and DMN decision table structural testing.
The BPMN model in Figure 10 is a basic example that tests the correct operation of different
modules: model repository, BPMN engine (process and script execution), User task web
module, BPMN & DMN management and execution.
The BPMN model in Figure 11 focus on testing the integration of BPMN with DMN and the
use of Data Objects. The Business Rule task in the model is connected to a DMN decision
table. Data Objects are used to retrieve the output of the first User Task and to provide inputs
Resin
Part
Infusion Curing
performance
Figure 12: Workflow describing the composite leafspring part manufacturing.
Initial Process
Modelling
Design (RTM, HP-RTM)
Preform
and KPIs Fibre
Permeability
Preform
Cycle Time,
Processing Cost, Value
Business KPIs Conditions, Modelling
Materila
Usage
Figure 13: Schematic representation of the workflow of the material and process selection for
composite leaf-spring.
For the testing of the BDSS Business-Layer with the composite leafspring we considered 2 of
the KPI’s (Figure 13): The first one is the mass requirement of the leafspring and the second
KPI the stiffness requirement. Figure 14 shows the business, engineering and simulation layer
for the leafspring use case. For each of the user tasks (Figure 15) the input and output is
described below.
Figure 14: BPMN Process Leafspring..
6: Prepare 4: Assess
5: Select Modeling
Simulation & Run Simulation to
Workflow
Simulation perform
7: Prepare KPI
data
Figure 15: User Tasks: Testing and Validations steps
1) Translate Requirement:
Input:
Customer Product Design Specification for leafspring (Document which includes all of the
required product performance, part pricing, timing, required production volumes, list of
released materials, released manufacturing processes. Part of the specification is Table 1 on
released materials and Table 2 on released manufacturing processes. Appendix B shows part
of the original Customer Product Design Specification document for the leafspring.
Table 1: Released Materials (typically with released material manufacturers and production
locations and material specifications)
Output:
1.1. Table of KPI’s in the shape of the dashboard (table 4)
For the request of baseline design in CAD (to product development department): Baseline
design includes geometry, materials selected, material placement (fibre layers/orientation)
for specified/selected manufacturing process. Baseline materials and processes selected out
of the lists in Table 1 and Table 2. As mentioned we choose 2 KPI’s for evaluation in this
validation: The Part Mass and the Part Stiffness.
For the Part Mass: this one is obtained from the CAD model with the selected materials and
the state of concept design of the leafspring.
For Part Stiffness: this will be obtained through running simulation workflows for the
leafspring. Different MODA’s (Figure 17) to be considered to generate data on the leafspring
stiffness and will be driven by the required level of uncertainty for the. Stiffness of the
leafspring.
Minimum
Target
KPI Unit Acceptable Importance Linked to KPI
Performance
Performance
Part Mass kg 4,5 4,8 High cost, NPV
Part Stiffness N/mm 300 285 High
Cost, NPV, Part
Cycle time sec 280 300 High
Mass
Cycle Time, Part
Part Cost Euro 50 52,5 Critical
Mass, NPV
Table 5 is created for the above selection of modelling workflows. In addition, Figure 17
provides the MODA for the leafspring use case:
The value of the processed stiffness is fed into the KPI dashboard (table 4)
Table 3: selected baseline material option and manufacturing process
Manufacturing Process
Process HP-RTM
Select Fiber Type GF - NCF
Fiber Volume part Vf 30%
Fiber Type E-glass manufacturer: Seartex
Fiber Form UD-NCF. 985 g/m2
Resin Type Thermoset
Resin Formulation Epoxy DER 330 epoxy manufacturer: Olin
Hardener TETA - DEH 24 manufacturer: Olin
Resin:Hard. ratio:
Ratio 1:1
Minimum
Target
KPI Unit Acceptable Importance Linked to KPI
Performance
Performance
Part Mass kg 4,5 4,8 High cost, NPV
Part Stiffness N/mm 300 285 High
Cost, NPV, Part
Cycle time sec 280 300 High
Mass
Cycle Time, Part
Part Cost Euro 50 52,5 Critical
Mass, NPV
Modelling of impregnation
Continuum model (#5) Infusion pattern, Infusion
- Type of infusion Stress field and
time, Fibre displacement
Fluid mechanics Displacements
Temperature
Modelling of curing
Continuum model (#6)
Displacement Cure time, Cure development,
Type of curing field
Solid mechanics Residual stress, Distortion
Modelling component
- Material (Resin type; Fiber Displacement, Mechanical response
type) Forces & (Deformation, Stress, Strain, Failure
Solid mechanics
- Performance conditions (Load Internal variables and Damage)
Conclusion
We have implemented testing plan which has helped up meet our continuous quality
improvement goals of the business layer and the whole BDSS. Systematic, through testing of
the business layer prior to release to general users is a critical aspect of high quality of the
business modelling and the BDSS. Omission of this step may lead to potentially wrong
business workflows and fatal mistakes relying on a business process with outputs of unreliable
quality. Thorough testing for validation requires and significant effort mainly because the
tools required to facilitate testing of the business layer and the complete business decision
support system (BDSS) are not available.
Created
December 30, 2019 - 11:19 AM
Translate requirements
USER TAS
Incoming Outgoing
START EVENT MESSAGE INTERMEDIATE THROW EVENT
startEvents_9b92822a-a5fb-1fb3-f3fa- Request KPIs evaluation
f4b256fa1cd3
Attributes
IMPLEMENTATION
##unspecified
Incoming Outgoing
USER TASK MESSAGE INTERMEDIATE CATCH EVENT
Translate requirements Evaluation completed
MESSAGE START EVENT
KPIs evaluation received
Evaluation completed
MESSAGE INTERMEDIATE CATCH EVENT
Incoming Outgoing
MESSAGE INTERMEDIATE THROW EVENT USER TASK
Request KPIs evaluation Select material
MESSAGE END EVENT
KPIs evaluation completed
Attributes
MESSAGE REFERENCE
Evaluation data
Select material
USER TASK
Incoming Outgoing
MESSAGE INTERMEDIATE CATCH EVENT END EVENT
Evaluation completed endEvents_dd795916-117f-b7f3-a659-
4fb4d6cb1ea1
Attributes
IMPLEMENTATION
##unspecified
endEvents_dd795916-117f-b7f3-a659-4fb4d6cb1ea1
END EVENT
Incoming
USER TASK
Select material
Incoming Outgoing
MESSAGE INTERMEDIATE THROW EVENT USER TASK
Request KPIs evaluation Select baseline material and process
Attributes
MESSAGE REFERENCE
KPIs evaluation request
Incoming Outgoing
MESSAGE START EVENT USER TASK
KPIs evaluation received Define baseline CAD design
Attributes
IMPLEMENTATION
##unspecified
Incoming Outgoing
USER TASK USER TASK
Select baseline material and process Assess simulation to perform
Incoming Outgoing
USER TASK EXCLUSIVE GATEWAY
Define baseline CAD design Parallel Gateway_451
Attributes
IMPLEMENTATION
##unspecified
Incoming Outgoing
USER TASK MESSAGE INTERMEDIATE THROW EVENT
Assess simulation to perform Request simulation
USER TASK
Reassess simulation
Request simulation
MESSAGE INTERMEDIATE THROW EVENT
Incoming Outgoing
EXCLUSIVE GATEWAY EVENT BASED GATEWAY
Parallel Gateway_451 Event Based Gateway_420
MESSAGE START EVENT
messageStartEvents_4b06e959-1a57-
0803-8ca8-35cab337b796
Attributes
MESSAGE REFERENCE
Simulations request
Attributes
MESSAGE REFERENCE
No workflow available
Incoming Outgoing
EVENT BASED GATEWAY USER TASK
Event Based Gateway_420 Prepare KPIs data
MESSAGE INTERMEDIATE THROW EVENT
Simulation data ready
Attributes
MESSAGE REFERENCE
Simulation Data
Reassess simulation
USER TASK
Incoming Outgoing
MESSAGE INTERMEDIATE CATCH EVENT EXCLUSIVE GATEWAY
No workflow available Parallel Gateway_451
Attributes
IMPLEMENTATION
##unspecified
Incoming Outgoing
MESSAGE INTERMEDIATE CATCH EVENT MESSAGE END EVENT
Simulation data ready KPIs evaluation completed
Attributes
IMPLEMENTATION
##unspecified
Incoming Outgoing
USER TASK MESSAGE INTERMEDIATE CATCH EVENT
Prepare KPIs data Evaluation completed
Attributes
MESSAGE REFERENCE
Evaluation data
Incoming Outgoing
MESSAGE INTERMEDIATE THROW EVENT BUSINESS RULE TASK
Request simulation Select modeling workflow
Attributes
MESSAGE REFERENCE
Simulations request
Incoming Outgoing
MESSAGE START EVENT EXCLUSIVE GATEWAY
messageStartEvents_4b06e959-1a57- Modeling workflow available?
0803-8ca8-35cab337b796
Attributes
IMPLEMENTATION
Modeling_Workflow
Incoming Outgoing
BUSINESS RULE TASK USER TASK
Select modeling workflow Prepare simulation
through Yes
MESSAGE END EVENT
No workflow available
through No
Prepare simulation
USER TASK
Incoming Outgoing
EXCLUSIVE GATEWAY SCRIPT TASK
Modeling workflow available? Run simulation
through Yes
Attributes
IMPLEMENTATION
##unspecified
Incoming Outgoing
EXCLUSIVE GATEWAY MESSAGE INTERMEDIATE CATCH EVENT
Modeling workflow available? No workflow available
through No
Attributes
MESSAGE REFERENCE
No workflow available
Run simulation
SCRIPT TASK
Incoming Outgoing
USER TASK MESSAGE INTERMEDIATE THROW EVENT
Prepare simulation Simulation data ready
Attributes
SCRIPT FORMAT
text/python
CODE
print("Hello world!")
Incoming Outgoing
SCRIPT TASK END EVENT
Run simulation endEvents_82d4c447-886b-2e21-71de-
ffd292eeba19
MESSAGE INTERMEDIATE CATCH EVENT
Simulation data ready
Incoming
MESSAGE INTERMEDIATE THROW EVENT
Simulation data ready
Attributes
ITEM SUBJECT REFERENCE
Table
Simulations request
MESSAGE
Attributes
ITEM SUBJECT REFERENCE
Table
Evaluation data
MESSAGE
Attributes
ITEM SUBJECT REFERENCE
Table
Simulation Data
MESSAGE
Attributes
ITEM SUBJECT REFERENCE
Table
No workflow available
MESSAGE
- Packaging Space
5. Production requirements
6. End-Of-Life requirements
- recyclability
7. Sustainability requirements
The leafspring product design specification sets out the requirements for the leafspring in all its
aspects. It includes the production volume requirement with the expected volume needs as well as
the required flexibility for higher and lower volumes.
Pricing of the leafspring is in a separate agreement document.
The leafspring is to be made out of composites and can be made using one of the following
processes, which are released:
Processes:
Preforming:
§ Preforming of dry fiber form with liquid binder
§ Molding:
High Pressure Resin Transfer Moulding (HP-RTM)
Compression Resin Transfer Molding (CRTM)
- Packaging Space
Length
400mm
Height Clamp
180mm
Bolt
Length
1100mm
Bolt
Width
70mm
60mm
§ Operating conditions. Functional performance has to be met for the temperature ranging
between -40C and +85C and Relative Humidity ranging from 10%-100%.
§ Mechanical Requirements.
§ Stiffness loaded: 300 N/mm. Minimum stiffness 285 N/mm
§ Mass Requirements.
§ Target weight: 4.5 kg. Maximum Weight: 4.8 kg
5. Production requirements
2023 25000
2024 50000
Pessimistic scenario:
2023 20000
2024 40000
2025 40000
2026 40000
2027 40000
2028 40000
Optimistic scenario:
2023 30000
2024 60000
2025 60000
2026 60000
2027 60000
2028 60000
6. End-Of-Life requirements
- recyclability
7. Sustainability requirements