Professional Documents
Culture Documents
275-284
doi: 10.2478/czoto-2020-0034
Date of submission of the article to the Editor: 20/11/2019
Date of acceptance of the article by the Editor: 18/12/2019
Abstract: The paper presents several approaches to gauge repeatability and repro-
ducibility (GRR) analysis regarding non-replicable measurements. Measurement sys-
tems have to deal with processes in which, by the nature of the measured object or by
the type of measurement itself, measurements are not repeatable. In these cases,
each sample unit can be measured only once. Such situations are referred as non-
replicable measurement systems. The aim of the paper is to map out the current ap-
proaches being used in GRR analysis in various cases of non-replicable tests and
compare each other in order to find out the suitable use of analysis application. Ap-
proaches used are subject to critical analysis so that its review can serve a useful
base for analysis of different non-replicable tests. At present, it is desirable to bring
the improving actions in order to obtain the results of high quality from such kind of
measurements. Since different non-replicable tests can measure a different quality
characteristic, it is valuable to bring the appropriate designs for various tests. Subse-
quently, this review will serve an outline how to proceed in analyzing the results ob-
tained by non-replicable tests. Specifically, GRR analysis works with two known de-
signs named as “Crossed” and “Nested” design, which statistical software normally
use. Doubtfully, crossed design is suggested to use at certain cases and nested at
other specific cases. This is assessed and improving actions designed.
Keywords: non-replicable measurement, repeatability, reproducibility, analysis
1. INTRODUCTION
Measurement system analysis (MSA) serves an assessment of a measurement sys-
tem ability to detect meaningful differences in process variables. Measurement sys-
tems refer to the collection of operators, gauges, procedures, software and opera-
tions, which are necessary for collecting the data of high quality and not to provide
distorted information leading to wrong decisions. Thus, to establish an effective
measurement system is an essential step for quality improvement (He et al., 2003).
Moreover, MSA is even strictly required in automotive industry (IATF 16949, 2016).
SYSTEM SAFETY: HUMAN - TECHNICAL FACILITY - ENVIRONMENT - CzOTO vol. 2, iss. 1, 2020 276
The most used analysis of measurement system, which makes possible to evaluate
repeatability and reproducibility of measurement system is GRR analysis. Generally,
%GRR evaluates the suitability of measurement system for process control, capability
studies, or statistical studies (Douglas and Keith, 2002).
Standardly in GRR analysis, the readings of measurement systems can be replicated
for each part. In statistics, a replicable system is one where the same or different ap-
praisers may measure any given part multiple times and the result obtained falls with-
in a predictable range of values (Miner, 2016). However, not all measurement sys-
tems have this characteristic. This is the case of non-replicable tests whose general
categories are:
destructive measurement systems (impact tests, welding tests, tensile tests etc.),
systems where the part changes during measurement process (leak tests with
qualitative data, torque tests etc.).
Herewith, the complex problem occurs in that once the measurement is obtained for a
particular part, this part is no longer available for additional measurements with the
same or different appraiser. Hence, it is difficult to measure the repeatability and re-
producibility. In order to assess the non-replicable measurement systems, few studies
have been done and are introduced in chapter 4.
tems, few approaches will be introduced in this chapter and two types of GRR design
are described in next section.
The nested arrangement shows no interactions as the samples are not criss-crossed
with the operators. In theory, these measurements are nested within sample and with-
in operator, but they are confounded with the error term treated as the gauge repeat-
ability 𝜀 k(ij), where the number of measurements is represented by n, k=1,…, n. The
nested design model for the non-replicable GRR becomes:
𝑦𝑖𝑗𝑘 = 𝜇 + 𝑎𝑖 + 𝑏𝑗(𝑖) + 𝜀𝑘(𝑖𝑗) (2)
The procedure how to properly select the right GRR design is depicted in Fig. 3.
this variation in measurements was assumed that it belonged to the gauge. The P/T
ratio was used to measure the suitability of gauge in order to make pass/fail decision
to a specification. Generally, the %P/T with two-sided specification limits is defined.
For such destructive test of pulling force (the larger the better characteristic), only one
specification limit (LSL) was considered. Hence, the P/T ratio was modified (Han and
He, 2007):
3 ∗ 𝜎𝑀𝑆𝐸
%𝑃/𝑇 = 𝑥 100% (3)
𝜇 − 𝐿𝑆𝐿
where means process mean. The variation range of measurement system becomes
6𝜎𝑀𝑆𝐸 , in this case 3𝜎𝑀𝑆𝐸 , with the probability of 99,73% when the process follows a
normal distribution. There is a small %P/T when process mean is far enough from
LSL, which means a small probability to judge a good product as a bad one or vice
versa. Generally, the %GRR is defined:
𝜎𝑀𝑆𝐸
%𝐺𝑅𝑅 = 𝑥 100%
2 2 (4)
√𝜎𝑀𝑆𝐸 + 𝜎𝑃
where 𝜎𝑝 is the variation due to parts. Through designing and analyzing the experi-
ment of pulling force testing by crossed GRR design, the conclusion is the test was
appropriate for process control.
taken from different positions of the oven belt were fixed. In I time instants, the opera-
tor can select JK biscuits from different positions. Each of J operators measured K of
these biscuits. The measurements were modeled (De Mast and Trip, 2005):
yijk − γjk = μ + ai + bj + (ab)ij + 𝜀 ijk (6)
where γjk is assumed known difference in strength (compared with the overall mean)
of biscuits from position j, k. Within-part variation among biscuits, that was not
accounted by the γjk, was confounded with error variance 𝜎𝑒2 . Given homogeneity
assumption was only met to a certain extent and confounding problem has not been
solved entirely.
generalized in order to gain the uniform methodology how to proceed in cases of non-
replicable measurement systems analysis.
Table 1
Comparison of study cases analyzes
Addition-
Conditions of non-replicable meas-
Measurement GRR design al analy-
urement systems
sis
Pulling force of Sufficient number of homogenous not re-
1 Crossed
chargers parts for multiple measurements quired
Impact strength Insufficient number of homogeneous
2 Nested required
of steel parts for multiple measurements
Core tempera- Temporal stability is violated
Crossed not re-
ture of food PTV holds
(Latin-square) quired
product
3
Robustness against measurement is
Shrinkage of Crossed not re-
violated
carpet tile (Latin-square) quired
POV holds
Insufficient homogeneity of parts
Representativeness of alternative
Strength of bis- Crossed
4 objects holds required
cuits
Temporal stability of objects holds
POV holds
Insufficient number of homogeneous
parts for multiple measurements,
Thickness of
Substitution of non-replicable test by Crossed required
copper plate
5 replicable test correlating with the
non-replicable test results
Penetration of Sufficient number of homogenous not re-
Crossed
bullet-proof vests parts for multiple measurements quired
Source: own research.
are met. Though the option of crossed design is preferred by the majority, because
nested is somehow deceptive due to samples factor is still crossed with the operators
factor, the use of nested design has its justification. Nested design is recommended to
use in cases that, firstly, the number of measured parts is not sufficient, secondly,
some of measurement conditions stated above hold and, thirdly, following the patterns
is possible. By holding these conditions, the credible results about measurement sys-
tem suitability can be reached.
ACKNOWLEDGEMENTS
The work has been supported by the specific university research of the Ministry of
Education, Youth and Sports of the Czech Republic No. SP2019/62, from ERDF „A
Research Platform focused on Industry 4.0 and Robotics in Ostrava“, No.
CZ.02.1.01/0.0/0.0/17_049/0008425 and elaborated in the framework of the grant
programme „Support for Science and Research in the Moravia-Silesia Region 2018"
(RRC/10/2018), financed from the budget of the Moravian-Silesian Region.
REFERENCES
De Mast, J. and Trip, A., 2005. Gauge R&R Studies for Destructive Measurements,
Journal of Quality Technology, 37(1), 40–49.
Douglas, G., Keith, M. B., 2002. Measurement System Analysis and Destructive Test-
ing. ASQ Six Sigma Forum Magazine, 1, 16-19.
Han, Y., He, Z., 2007. An Applied Study of Destructive, 2nd IEEE Conference on In-
dustrial Electronics and Applications, Tianjin, China, 30-34.
He, Z., Sheng, J., Shi, L., 2003. Application of Measurement System R&R Analysis in
Quality Improvement, Journal of Industrial Engineering, 6, 62-66.
IATF 16949, 2016. Norma pro systém managementu kvality v automobilovém
průmyslu, Česká společnost pro jakost, z.s. Praha, Česká republika.
Jarošová, E., 2018. Destructive R&R Study – Evaluation Problems, 17th Conference
on Applied Mathematics APLIMAT 2018, Bratislava, 535-544.
Kappele, W.D., Raffaldi, J., 2010. Gage R&R for Destructive Measurement Systems,
Quality Magazine, 5, 32-34.
Meulen, F., Koning, H., De Mast, J., 2009. Nonrepetable GRR Studies Assuming
Temporal or Patterned Object Variation, Journal of Quality Technology, 4, 41.
Mikulová, P., Plura, J., 2019. Detailed analysis of GRR study results and their visuali-
zation, 13th International Conference Quality Production Improvement QPI,
Zaborze, Poland.
Miner, G., 2016. Intro to MSA of Continuous Data – Part 6: R&R for Non-Replicable
Measurements, In Quality Forum, Miner’s blogs.
Montgomery, D. C., 2005. Design and Analysis of Experiments, 6th edition, New York,
NY: John Wiley and Sons, Inc.
MSA Group, 2010. Measurement System Analysis, Reference Manual, 4th edition,
Chrysler Group LLC, Ford Motors Corporation.
Neter, J., Wasserman, W., Kutner, M. H., 1985. Applied Linear Statistical Models, 2nd
edition, Richard D. Irwin, Inc.
Wilson, M. P., 2007. Gauge R&R Studies for Destructive and Non-destructive Testing,
Advanced Systems Consultants, Scottsdale-Arizona,USA.