GAGE REPEATABILITY AND

REPRODUCIBILITY(GRR) TEST FOR

FOOTWARE QUALITY INSPECTORs
9 t h M a r- 2 0 2 3
By Henry Ho-Asia RQM
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Purpose & Objective

Current state: Currently Practical test for Quality Inspectors (SI/SI Online Inspectors) required in Quality Personnels
Training and Certification Manual is to test their inspection for 45 defective samples and focusing on percentage of
defective detection vs required detection target(100%), which does not evaluate Repeatability and Accuracy of individual
Inspector across their multiple inspections or evaluate Reproducibility between Inspectors across their multiple
inspections with the same samples to see Overall Effectiveness of measurement system of the shipping inspection(SI)
process.

Future state: the Quality Inspectors will be tested their Repeatability and Reproducibility for their inspection to evaluate
their Repeatability/ Accuracy level for confirming their inspection effectiveness/ capability before certifying them like a SI
or SI Online Inspector and also to evaluate overall effectiveness of shipping inspection system. And Gage R&R
Methodology is used for this test. The R&R stands for Repeatability and Reproducibility.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Terminologies and Definitions

• Defect: A defect is a characteristic of the "product" that does not meet the customer's requirements (Specifications)
• Defective: A defective is a unit of product that can not be considered good due to a preponderance of failing quality characteristics (Defects), or it also
means the failing of the entire product or service. For example, if a new shoe pair in the showroom has a major yellowing on white midsole of left
shoe, then it has a defect(yellowing). And the shoe pair will be considered as a defective if one or more customers refuse to buy it on account of that
defect.
• Repeatability: means that the same inspector, inspect the same shoe samples, using the same inspection method, should get the same reading/ result
every time.
• Reproducibility: means that different Inspectors, inspect the same shoe samples, using the same inspection method, should get the same reading/ result
every time.
• MSA: Measurement System Analysis.
• Attribute data: is data that has a quality characteristic(or attribute) that meets or does not meet product specification. These characteristics can be
categorized and counted like Pass/ Fail, Good/ Bad, Agree/ Disagree…
• Continuous data: is data that can take any value from measuring things like height, weight, temperature, length..
• Accuracy: is the degree of closeness of the measurements to the target, or true or reference value. Accuracy often refer to Bias error
• Precision: is the degree of closeness of the measurements with each other. Precision often refer to Repeatability and Reproducibility error
• Agreement Percentage: stand for matched inspection results percentage of inspectors across the multiple inspections.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Compare Accuracy vs Precision

 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Why Attribute Gage R & R?

Most problematic measurement system issues come from measuring Attribute data in terms that rely on human
judgment such as Good/Bad, Pass/Fail, etc. This is because it is very difficult for all testers to apply the same
operational definition of what is “good” and what is “bad.”

However, such measurement systems are seen throughout industries. One example in our foot-ware industry is our SI
Inspectors, by visual check to determine whether a shoe pair is Pass or Fail during their shipping inspection(SI).
Hence, it is important to quantify how well such measurement systems are working. The tool used for this kind of
analysis is called Attribute Gage R&R. The R&R stands for Repeatability and Reproducibility.

Attribute Gage R&R reveals two important findings – percentage of Repeatability and percentage of Reproducibility.
Ideally, both percentages should be 100 percent, but generally, the rule of thumb is anything above 90 percent is quite
adequate.

Obtaining these percentages can be done using simple mathematics by Excel or Minitab has a module called Attribute
Agreement Analysis (in Minitab 13, it was called Attribute Gage R&R) that does the same and much more, and this
makes analysts’ lives easier.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Steps to do Attribute Gage R&R

Before we do the Attribute Gage R&R, you should have completed all the pre-works, which means, you have selected
the correct testing samples(called as “Master Defect Samples” in this Guideline) for performing Gage R&R, you have
numbered the samples, you have identified the Quality inspectors for this test, and you have the data collection
template ready. Below-Table 1, is a simple data collection template that we will use in this study.

Select between 30 to 40 testing samples that represent the full range of defect types encountered in actual production
runs in our factories. In this study, We decided to have 36 samples (shoe pairs), including 34 Defective pairs
representing for 23 NB Standardized Defect types and 2 A-grade shoe pairs, called “Master Defect samples” or
Standard for Gage R&R and we will also assume that you have already prepared, defined the standard of Defective or
A-grade for each shoe sample of these 36 samples, and they are also reviewed and approved by NB Quality
Authorities-RQM, or QMs/ AQMs or QE- based in the factories.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Steps to do Attribute Gage R&R

Key notes for preparing the Master Defect Samples:
-At least 3 different styles or more are prepared for these samples. Never prepare the same style for all 36 pairs as it looks easy for the
testing.

-Standard (Level) of master defect per sample: need to define the standard of defect like minor or major which exactly reflect actual defects
of production shoes, but they are not too minor which are too difficult to detect or too majors which are very visible to detect. Refer to
Worksheet “Master defect pictures” for reference.

-For common quality issues/ defects frequently happen in the foot-ware industry like Cleanliness, Bonding or Stitching, they are required to
duplicate per each out of 36prs samples. For example, refer to the master defect samples”, you can see we did prepare 2 samples for
Cleanliness, 4 samples for stitching, 2 samples for Bonding, etc. And you can follow this Master Defect Samples/ or Standard to prepare
the shoe samples for your GRR test.

-For major quality issues/ defects frequently happen or escaped from Quality Inspection in a specific factory, then the factory can prepare
the 36 samples with duplicating samples per that major defect to test the inspector.
-After prepared the 36prs of master defect samples, pls take all their pictures and include it in the Worksheet-Master defect pictures as in
the next slide.

-The Master Defect Samples need to be prepared NEW for each GRR Test and keep it confidential. Mean that after you complete the test
and certify the inspectors and when you need to re-certify them, you need to replace a new set of Master Defect Samples (not re-use it due
to confidentiality and the defects/quality issues should be up-to-date). As appropriate, the Factories can exchange their Master defect
samples each other for GRR Test but it should be decided and coordinated by NB QM/AQM.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Steps to do Attribute Gage R&R-Master Defect pictures

36prs-MASTER DEFECT SAMPLE PICTURES

1. Leather-cutting marks (L) 2. Leather-veins/ scars on toebox (L) 3-Leather-suede hair mismatching 4. Textile-damaged at heel (L) 5. A-Grade

6. Component- N Logo scratches 7. Soleunit-Midsole web chipped off 8. Color Variation- at vamp(L&R) 9. Cutting-N logo cut edge(L) 10. Trimming- top edge eyesrow(L)

11-Embossing-NB logo is not clear on heel(R) 12. Printing-peeling off at heel(R) 13-Stitching-tension loose (L) 14-Stitching-broken thread(L) 15-Stitching Skipped stitches(R)
 N E W B A L A N C E A s i a Q u a l i t y

Steps to do Attribute Gage R&R-Master Defect pictures(cont.)

G A G E R & R

16-Stitching-margin failure (L) 17. Punching-a blind hole 18-Upper-eyestay off(L) 19. Tongue length-mismatching 20. Hardware-BOA broken/ wire twisted(L)

21.Hardware- Eyelet underneath cover

22. Heel lasting- Heel shape off (L) 23. Toe spring-mismatching 24. Rouging- roughing exposed (R) 25. Cementing-Overcement (L)
missing(R)

26. A-Grade 27-Bonding gap(L) 28-Outsole Delamination(L) 29-Insert-wrong size (R) 30. Lace-damged lace tip(L)

31. Lace- scratch/ frayed(L) 32. Cleanliness-Lace dirty(L) 33. Cleanliness-Glue on toebox(L) 34-Label-wrong Width on size label (R) 35. Label-tongue size label peeling off (R)
 N E W B A L A N C E A s i a Q u a l i t y

Steps to do Attribute Gage R&R

G A G E R & R

Table 1

ATTRIBUTE GAGE R&R FOR SI/ SI ONLINE INSPECTORS TEMPLATE

Test date: _____________________
OVERALL EFFECTIVENESS OF
Tested by: _____________________________ REPEATABILITY ACCURACY REPEATABILITY ACCURACY REPEATABILITY ACCURACY REPRODUCIBILITY
MEASUREMENT SYSTEM

MASTER DEFECT OF TEST SAMPLE/ or INSPECTOR#1 INSPECTOR#2 INSPECTOR#3

TEST SAMPLE# WITHIN INSPECTOR#1 WITHIN INSPECTOR#2 WITHIN INSPECTOR#3 BETWEEN
NB STD DEFECT TYPE STANDARD ALL INSPECTORS vs STD
(SHOE PAIR#) INSPECTOR#1 vs STD INSPECTOR#2 vs STD INSPECTOR#3 vs STD INSPECTORS
(approved by NB QM) 1st INSP 2nd INSP 3rd INSP 1st INSP 2nd INSP 3rd INSP 1st INSP 2nd INSP 3rd INSP

1 1. Materials - Leathers / Synthetics Damaged leather(L)

2 2. Materials - Textiles Scrach at heel(L)
3 3. Materials - Components N logo scratch(L), no sole's logo(R)
4 4. Materials - Soleunits Damaged M/S web(L)
5 5. Color Variation Color Variation at heel(R)
6 6. Cutting Damaged cutting edge (L)
7 7. Skiving / Folding / Trimming Damaged leather edge (R)
8 8. Embroidery / Embossing / Printing Printing peel off at heel(R )
9 9. Stitching - Open / Tension / Trimming Broken stitching(L)
10 10.Stitching - Margin / Stitches / Needle Holes Broken stitching loop(L)
25 A-GRADE A-GRADE SHOE
26 A-GRADE A-GRADE SHOE
27 A-GRADE A-GRADE SHOE
28 A-GRADE A-GRADE SHOE
29 A-GRADE A-GRADE SHOE
30 A-GRADE A-GRADE SHOE

#Matched 0 0 #Matched 0 0 #Matched 0 0 0 0

#Inspected 30 30 #Inspected 30 30 #Inspected 30 30 30 30
%Agree 0.0% 0.0% %Agree 0.0% 0.0% %Agree 0.0% 0.0% 0.0% 0.0%
N E W B A L A N C E A s i a Q u a l i t y

Steps to do Attribute Gage R&R

G A G E R & R

Step 1: Inspector#1 inspects the 36 selected shoe pairs and write down Defect name in Inspection Form .

Step 2 : Inspector#2 inspects the 36 selected shoe pairs and write down Defect name in Inspection Form .

Step 3 : Inspector#3 inspects the 36 selected shoe pairs and write down Defect name in Inspection Form .

Refer to Table 1 in the slide#13 for Inspection Form

The inspectors must strictly follow NB 60sec+ Inspection Method for this inspection. Let’s say 60sec + 20sec max to
complete inspecting a shoe pair. So, it takes Max 48 minutes to complete this 1st round of 36-shoes inspection per Inspector.

We can accept for Inspector to write down max 3 defect names per shoe pair into the Inspection Form if they found more than
1 defect per shoe pair.

Notes: To shorten the 1st inspection round, we can divide the 36 samples into 3 sections of samples (12 prs per section), then
the 3 inspectors can inspect their assigned 12prs-section at the same time.
For example:
- The inspector#1 inspects from sample #1-12,
- The inspector#2 inspects from sample #13-24,
-The inspector#3 inspects from sample #25-36 and each Inspector will continue to complete 36 prs inspection for the 1st
round.
N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Steps to do Attribute Gage R&R

Step 4 :
-All inspectors need to have sufficient breaktime (at least 1hour) before repeating the 2nd inspection, and the 3rd inspection, to
let them not be nervous, or tired in inspecting many samples within constraining test time. Or we can arrange the 2nd
inspection and 3rd inspection at different days not to impact to Factory inspection/ shipping schedule rather than gathering 3
inspectors for 3 inspections at the same day.

- Disorder sequence of testing samples for the 2nd inspection and the 3rd inspection to increase difficult level of test.

- Repeat step 1 to 3 with the same testing samples and same inspectors for 2nd Inspection and 3rd Inspection. Ensure that you
do not let the Inspectors see each others results as well as their own 1st Inspection results while doing this exercise as it may
influence their decisions. So you need to re-print a new Inspection form for the 2nd inspection, and 3rd inspection.

Step 5 : Now you have the results of 3 times of Inspection for each Inspector for all 36 samples, including the Master Defect
standard.

The reporter will report the inspection result and compare the Defect Name found by Inspectors vs Master Defect of sample
to decide if it’s Pass (matching) or Fail (mismatching) then records Inspector assessment on Acceptability (Pass or Fail ) of
test samples in the column – Inspector#1 – 1st INSP, 2nd INSP, 3rd INSP. Similarly, to report the inspection results for
Inspector#2 and Inspector#3 to Inspection Report Template.
Refer to Table 2 in the slide#14.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Steps to do Attribute Gage R&R Table 1

TEST SAMPLE INSPECTION FORM
(print for inspector)
Inspection Form: to be printed for
Test date:
Inspector per inspection to record their
______________________________

Tested by:
inspection result
_______________________________

INSPECTOR NAME# :_________________ INSPECTION TIME: ______

TEST SAMPLE
(SHOE PAIR#)
DEFECTS FOUND FROM INSPECTION

1 Ex: Damage Leather

25

26

27

28

29

30
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Steps to do Attribute Gage R&R

Table 2
TEST SAMPLE INSPECTION REPORT PER QUALITY INSPECTOR
Test date: ______14th FEB-2023________

Tested by:_______Henry/ Johnny_______

INSPECTOR#1 :_____AN__________________

TEST 1st INSPECTION 2nd INSPECTION 3rd INSPECTION

MASTER DEFECT
SAMPLE#
SAMPLES/ or STANDARD
(SHOE Defects found by Inspector
(approved by NB QM) Acceptability Defects found by Inspector Acceptability Defects found by Inspector Acceptability
PAIR#) (input from Inspector's report)
1 Leather-cutti ng mark at heel (L) Leather-cutting mark at heel (L) Pass Leather-cutting mark at heel (L) Pass Leather-cutting mark at heel (L) Pass

2 Leather-veins/scars on toe box(L) Leather-veins/scars on toe box(L) Pass Cleanliness(L) Fail Leather-veins/scars on toe box(L) Pass

3 Leather-suede hair mismatching Glue stain(L) Fail Glue stain(L) Fail Glue stain(L) Fail

4 Textile-damaged at heel (L) Textile-damaged at heel (L) Pass Textile-damaged at heel (L) Pass Textile-damaged at heel (L) Pass

5 A-GRADE SHOE A-GRADE SHOE Pass Glue(L) Pass A-GRADE SHOE Pass

6 Component-N logo scratch(L) Component-N logo scratch(L) Pass Component-N logo scratch(L) Pass Component-N logo scratch(L) Pass

7 Soleunit-Midsole web chipped off (L) Soleunit-Midsole web chipped off (L) Pass Soleunit-Midsole web chipped off (L) Pass Soleunit-Midsole web chipped off (L) Pass

8 Color Variation- at vamp (L&R) Color Variation- at vamp (L&R) Pass Color Variation- at vamp (L&R) Pass Dirty Fail

9 Cutti ing- N Logo cutti ng edge (L) Cuttiing- N Logo cutting edge (L) Pass Cuttiing- N Logo cutting edge (L) Pass Cuttiing- N Logo cutting edge (L) Pass

10 Trimming-top edge eyesrow Trimming-top edge eyesrow Pass Trimming-top edge eyesrow Pass Trimming-top edge eyesrow Pass
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-TEST

Now that you have the required data of inspections, it’s time to do the GRR test.

You can use any statistical analysis software(Minitab), or an Excel with macro enabled template
to do the test.

Propose to use Minitab, one of the preferred statistical analysis software for Lean Six
Sigma practitioners. However, the results and the takeaways will stay the same irrespective of
what software or excel template you use.

In this Guideline, the author uses an excel template to calculate the Agreement Percentage(%) of
all 4 test parameters. Please refer to the embedded object in this slide for the GRR test template.

Microsoft Excel
Worksheet
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-RESULT

What you need to check in these results is the Agreement Percentage(%) . As a ground rule,
everything that has an Agreement of 90% or more is good, everything that has an Agreement of
less than 90% is bad.

Simply put, for you to accept your measurement system, the Within Appraiser, Each
Appraiser vs standard, Between Appraisers, All Appraisers vs standard and the agreements
have to be 90% or above. In such cases you conclude that you have the right measurement
system in place and proceed to confirm and certify the inspectors. Now, look at each of these
parameters in the following slides.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-RESULT

Within Appraiser(or Inspector)-also called as Individual Repeatability

This is a comparison of the results of each inspection of a single Inspector and shows if the Inspector
is able to repeat her own results across 3 inspection times. This is called Repeatability.

Refer to the column “Repeatability” in GRR Test file, you can see in the results of Within Inspector #1
or #2 or #3 on their assessment agreement(%).

Overall, all Inspectors’ assessment agreement stands at 90% or more and hence is acceptable. This
means, your measurement system or Inspectors do not have Repeatability issues.

If anyone or more percentages drop below 90%, we will conclude that our measurement system has
Repeatability issues and the MSA will be rejected. In such cases, we will need to further coach the
Inspector on correctly assessing the samples for Acceptability and redo GRR.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-RESULT

Each Appraiser(Inspector) vs Standard( also called as Accuracy or Individual Effectiveness)

In this section, the inspection results for each Inspector across 3 inspections are compared with the
Standard response and agreement percentage is displayed. This is Accuracy of Individual Inspector or
measurement system.

Refer to the column “Accuracy” in GRR Test file, you can see in the results of Each Inspector #1 or #2
or #3 vs Standard on their assessment agreement(%).

If the Agreement percentage drops below 90% for any inspector, we will reject this measurement
system or can say the Inspector is failed this GRR test, correct any disconnects that Inspector #1, #2
and #3 have and redo GRR till the percentage reach above 90%.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-RESULT

Between Appraisers(Inspectors)-also called Reproducibility

This is the comparison of results of each testing sample across all Inspectors and all 3 Inspections.
Ideally, all Inspectors should give the same results for each sample across all Inspections. This is
called Reproducibility.

Refer to the column “Reproducibility” in GRR Test file, you can see in the results of Between
Inspectors on their assessment agreement(%).

You need to see, out of 36prs, all the Inspectors were able to match how many pairs in all their 3
inspections. If this is below 90% and hence is an issue. We have Reproducibility problem in our
Measurement System or our shoe inspection process. This needs to be corrected before we can use
this measurement system to collect data or confirm/ certify our inspectors.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-RESULT

All Appraisers(Inspectors) Vs Standard- also called Overall Effectiveness of Measurement System

The previous comparison was between each Inspector for all inspections for each sample item, whereas this test
compares the result of all Inspectors collectively with the standard. That means, it will show a particular sample as
matched only when all Inspectors across all Inspections give the same result for the sample as the standard.

Refer to the column “Overall Effectiveness of Measurement System” in GRR Test file, you can see in the results
of all Inspector #1 or #2 or #3 vs Standard on their assessment agreement(%).

This percentage gives the Overall effectiveness of the measurement system. It is the percent of time all inspectors
agreed and their agreement matches with the standard. If this is below 90%, the measurement system is not good to
proceed and needs to be corrected.

Refer Table 3 below for all results of Attribute GRR.

 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-RESULT

Table 3

ATTRIBUTE GAGE R&R FOR SI/ SI ONLINE INSPECTORS TEMPLATE

Test date: ______14th FEB-2023________
OVERALL EFFECTIVENESS OF
Tested by: _______Henry/ Johnny_______ REPEATABILITY ACCURACY REPEATABILITY ACCURACY REPEATABILITY ACCURACY REPRODUCIBILITY
MEASUREMENT SYSTEM

INSPECTOR#1 INSPECTOR#2 INSPECTOR#3

TEST SAMPLE# MASTER DEFECT SAMPLES/ or STANDARD WITHIN INSPECTOR#1 WITHIN INSPECTOR#2 WITHIN INSPECTOR#3 BETWEEN
NB STANDARDIZED DEFECT TYPE ALL INSPECTORS vs STD
(SHOE PAIR#) (approved by NB QM) INSPECTOR#1 vs STD INSPECTOR#2 vs STD INSPECTOR#3 vs STD INSPECTORS
1st INSP 2nd INSP 3rd INSP 1st INSP 2nd INSP 3rd INSP 1st INSP 2nd INSP 3rd INSP

1 1. Materials - Leathers / Synthetics Leather-cutting mark at heel (L) Pass Pass Pass 1 1 Pass Pass Pass 1 1 Pass Pass Pass 1 1 1 1
2 Leather-veins/scars on toe box(L) Pass Fail Pass 0 0 Pass Pass Pass 1 1 Pass Pass Pass 1 1 0 0
3 Leather-suede hair mismatching Fail Fail Fail 1 0 Pass Pass Pass 1 1 Pass Pass Pass 1 1 0 0
4 2. Materials - Textiles Textile-damaged at heel (L) Pass Pass Pass 1 1 Pass Pass Pass 1 1 Fail Fail Fail 1 0 0 0
5 A-GRADE A-GRADE SHOE Pass Pass Pass 1 1 Pass Fail Pass 0 0 Pass Pass Pass 1 1 0 0
31 Lace-scratches Fail Pass Pass 0 0 Pass Pass Pass 1 1 Pass Pass Pass 1 1 0 0
32 21. Cleanliness Cleanliness-lace dirty (L) Pass Pass Pass 1 1 Pass Pass Pass 1 1 Pass Pass Pass 1 1 1 1
33 Cleanliness- Glue on toebox (R) Pass Pass Pass 1 1 Pass Pass Pass 1 1 Pass Pass Pass 1 1 1 1
34 22. Labeling / Packing Labeling-wrong Width on size label (R) Pass Pass Pass 1 1 Pass Pass Pass 1 1 Pass Pass Pass 1 1 1 1
35 Labeling-tongue size label peeling of (R) Pass Pass Pass 1 1 Pass Pass Pass 1 1 Pass Pass Pass 1 1 1 1
36 23. Evenness Eveness- HF Component position uneven Pass Pass Pass 1 1 Pass Pass Pass 1 1 Pass Pass Pass 1 1 1 1

#Matched 30 29 #Matched 31 31 #Matched 35 34 22 22

#Inspected 36 36 #Inspected 36 36 #Inspected 36 36 36 36
%Agree 83.3% 80.6% %Agree 86.1% 86.1% %Agree 97.2% 94.4% 61.1% 61.1%
N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Attribute Gage R&R-EVALUATION

What Gage R&R test parameters are used to evaluate for certifying the Quality Inspectors

We need to assess Individual Quality Inspector capability through her Agreement Percentage of
Repeatability and Accuracy, called as Individual Inspection effectiveness, which are to be
greater than 90% for certifying them.

What Gage R&R test parameters are used to evaluate for Overall Effectiveness of Quality
Inspection system(or measurement system)

We need to assess Shipping Inspection System capability through Agreement Percentage of

Between Inspectors(Reproducibility) and All Inspectors vs standard, which are to be greater
than 90% for an effective inspection system.
.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

What if the Attribute Gage R&R is not acceptable

As mentioned earlier, if any of the above assessment agreement percentage is below 90%, we say that the measurement system is
not good. Or the inspectors, who have Repeatability and Accuracy are below 90%, are failed this GRR test. What should we do
in such cases?

For Attribute Gage R&R, the issue mostly lies with the Inspectors not able to evaluate the required attributes(Defective or OK)
correctly. What you need to do is further refine the Inspector definition of the said attribute (in this case, Acceptability of the
testing samples including Defective and OK) and make is more robust for everyone to understand. Master defect samples should
be crystal clear leaving no doubt in the Inspectors mind.

Next, coach and train the Inspectors who are failed GRR(below 90%) for the 3 key contents: Global NB Standard, NB 60sec+
Inspection Method, Common defects escaped from the quality inspections(like EOL QC, SI/SI Online, the 3rd party inspection,
NB WH IQC or QIRs) and more other contents if needed. Ensure that they all are on the same page with regards to the attribute
of defective samples, what is acceptable, what is not.

Once this is done, repeat the whole GRR again and check the agreement percentage. You will need to keep repeating this process
till the agreement percentage for all assessments above reach 90% or more.

While repeating the GRR test for the failed Inspectors, these inspectors are not allowed to inspect a NB PO independently but
under/ being supervised and confirmed the PO inspection result by Factory SI Leader/ or Supervisor. As appropriate, NB QA/QE
needs to follow up and randomly re-inspect the POs done by them until the inspectors will have been re-tested GRR with “PASS”
result.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

GAGE R&R TEST-FREQUENCY

The Gage R&R test is included in Factory QC Personnels Train and Certify Program. Therefore, It’s required
to proceed once per year or whenever a factory hires a new inspector or the current inspector’s certificate is
expired.

However, for new starting-up Factories making NB products within 2 years or quality concerning factories
appointed by QD or RQM, this Gage R&R test is required to proceed each 6 months to re-certify the
inspectors.
 N E W B A L A N C E A s i a Q u a l i t y
G A G E R & R

Reference document and Internet sources

https://quality-one.com/grr/
Attribute Gage R&R - A Step by Step approach – LSSSimplified
https://bigscoots.isixsigma.com/measurement-systems-analysis-msa-gage-rr/making-sense-attribute-gage-rr-calculations/