Attribute Gage RR Ridgway

Attribute Gage R&R
An Overview
Presented to ASQ Section 1302 August 18, 2011

by Jon Ridgway
Copyright: JC Quality Business Solutions LLC
Overview
What is an Attribute Gage R&R? Why is it worth the work? What are the caveats? How do I perform it? How do I understand the results?
My Attribute Gage R&R Experience

First Data
Credit Card mailings (packages)
Airlite Plastics:
Mold & Print Quality Print Quality, Cup & Lid Decoration
WHY conduct a Gage R&R????

Some processes require subjective decision making:
Inspection Validation
Subjectivity creates the potential for variation Measurement System variation impacts process capability:
Type I Errors Type II Errors
So, Why Conduct a Gage R&R?

To understand:
How likely Appraiser will agree with himself / herself: WITHIN / Repeatability How likely all Appraisers will agree with each other: BETWEEN / Reproducibility
Understanding R&R allows you to:

Predict probability (%) of agreement / disagreement Implement training to improve that probability Reduce Type I and Type II Errors = $$$
MSA
The Foundation of everything in Quality is measurement Measure for two primary reasons:
To make a decision As the basis for process improvement
Can we trust our measurement system to give us reliable data?

CONFIDENCE
Ultimate purpose of the Attribute Agreement Analysis

To determine if your measurement system can distinguish between a good & bad part Accuracy & Precision:
Accuracy:
Absence of bias, or agreeing with the standard.
Precision:
Ability of different Appraisers to reach the same conclusion several times.
Accurate, But Not Precise
Precise, But Not Accurate
Which is Easier to Remedy?
Accurate, but not Precise
Precise, but not Accurate
Gage R&R Review

Measurement System Analysis (MSA)
1st R: Repeatability 2nd R: Reproducibility
Data in General:
Continuous / Variables Attribute / Discrete
Attribute vs. Continuous

Attribute Data:
Categorical, named only, arbitrary scales Also known as Discrete Data
Continuous Data:
Allows for infinitely finer sub-divisions Also known as Variables Data
Basic Data Types

Nominal:
Literally, name Represents categories
Ordinal:
Ordered or ranked data Not scaled
Interval:
Measured / scaled data: Each position equidistant 0 can be relevant (temperature)
Ratio:
Numbers compared as multiples of one another
Hierarchy of Data Types

Nominal Ordinal Interval Ratio
Classified Data
Quantified Data
DISCRETE / ATTRIBUTE
CONTINUOUS / VARIABLE
Non-parametric
Parametric
2 Main Attribute Gage R&R Types

1) Binary / Nominal
GO / NO GO Data are Categorical and mutually exclusive Kappa statistic is relevant
2) Ordinal
Rank, not categorical Data are not mutually exclusive Kendalls statistic more relevant than Kappa
Kappa Statistic
Proportion of agreement between evaluators after chance agreement has been removed:
Kappa = P observed P chance / P chance
Expressed as a number:
From 0 (expected by chance) Up to +1 (complete agreement)
Kendalls Statistics
Two different Kendalls for different tests:
Kendalls Coefficient of Concordance:
Rankings without a known Standard
Kendalls Correlation Coefficient:

Rankings with a known Standard
Expressed as 0 (weaker agreement) to +1 (stronger agreement)
Kappa & Kendalls Summary

Kappa:
Nominal / Binary Only Match or No Match
Kendalls Coefficient of Concordance:

Ordinal but not using a known Standard
Kendalls Correlation Coefficient:

Ordinal and using a known Standard
Attribute Gage R&R Considerations

Study Purpose Destructiveness Precision vs. Time Binomial / Nominal vs. Ordinal
MSA Factors Impacting Variation

Gage Appraiser Method Part Environment
Controlling MSA Factors

Ideally:
1. Use the same Assessment Method 2. Require all Appraisers to assess the same dimension / feature / sample 3. Conduct the study under the normal assessment conditions
Controlling MSA Factors, Cont.

1) Appraisers: Select from group that normally appraises the part. 2) Number of parts should cover the entire range of variation. 3) More than one appraisal per Appraiser should be done. 4) The presentation of the samples within the Trial should be randomized.
Nominal / Binary Study

Two Appraisers 50 Parts 2 Trials
Output: Within
Output: Within vs. Standard
Assessment Agreement
Date of study: Reported by: Name of product: Misc:
Within Appraisers
100
95.0% C I P ercent
Appraiser vs Standard
100
95.0% C I P ercent
95 Percent Percent Lee Appraiser Fred
95
90
90
85
85
80
80 Lee Appraiser Fred
Output: Between
Output: Between vs. Standard
Ordinal Case Study: Print Quality
What did we want to know?

Do all Appraisers of Print Quality:
Agree consistently with Themselves? Agree consistently with Each Other? Given our world, we have an ordinal system:
Accept Accept but Adjust Reject
How was it Done?

10 samples, Good & Bad Random Order, Same for All 2 Trials per person All people in the study Environment
Ensure Gage R&R Consistency
Spanish Version
Vietnamese Version
Trial Order
My Checklist
Results
Sample QA1-1 QA1-2 1 2 3 4 5 6 7 8 9 10 1 2 1 2 2 1 2 2 1 1 1 2 1 2 1 1 1 2 1 1 QA2-1 2 2 2 3 3 2 3 2 2 1 QA2-2 2 2 2 3 3 2 3 2 2 1 QA4-1 2 3 2 2 2 2 3 2 3 2 QA4-2 2 3 2 2 3 2 3 2 3 2 Standard
2 3 2 3 2 2 3 3 1 1
False Alarms & Misses

Assess Fail when Standard = Pass:
False Alarm Type I Error
Assess Pass when Standard = Fail:

Miss Type II Error
Results
Sample QA1-1 QA1-2 1 2 3 4 5 6 7 8 9 10 1 2 1 2 2 1 2 2 1 1 1 2 1 2 1 1 1 2 1 1 QA2-1 2 2 2 3 3 2 3 2 2 1 QA2-2 2 2 2 3 3 2 3 2 2 1 QA4-1 2 3 2 2 3 2 2 3 2 3 2 3 2
False Alarms
QA4-2 Standard
MISSES
2 2 3 2 3 2
2 3 2 3 2 2 3 3 1 1
Minitab 15
Four Results:
1. 2. 3. 4. Within Within vs. Standard Between Between vs. Standard
Check Here
Assessment Agreement
Date of study : Reported by : Name of product: Misc:
Within Appraisers
100
95.0% C I P ercent
Appraiser vs Standard
100
95.0% C I P ercent
80
80
Percent
40
Percent QA-2 Appraiser QA-4
60
60
40
20
20
0 QA-1
0 QA-1
QA-2 Appraiser
QA-4
Two Big Lessons

You cant trust your data until it is proven to be trustworthy. A single, one-time Gage R&R study is not enough
Questions?
Thank You!

Attribute Gage RR Ridgway

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Attribute Gage RR Ridgway

Uploaded by

Copyright:

Available Formats

Attribute Gage R&R

Presented to ASQ Section 1302 August 18, 2011

Copyright: JC Quality Business Solutions LLC

Copyright: JC Quality Business Solutions LLC

My Attribute Gage R&R Experience

Copyright: JC Quality Business Solutions LLC

WHY conduct a Gage R&R????

Copyright: JC Quality Business Solutions LLC

So, Why Conduct a Gage R&R?

Understanding R&R allows you to:

Copyright: JC Quality Business Solutions LLC

Can we trust our measurement system to give us reliable data?

Ultimate purpose of the Attribute Agreement Analysis

Copyright: JC Quality Business Solutions LLC

Accurate, But Not Precise

Copyright: JC Quality Business Solutions LLC

Precise, But Not Accurate

Copyright: JC Quality Business Solutions LLC

Which is Easier to Remedy?

Accurate, but not Precise

Precise, but not Accurate

Copyright: JC Quality Business Solutions LLC

Gage R&R Review

Copyright: JC Quality Business Solutions LLC

Attribute vs. Continuous

Copyright: JC Quality Business Solutions LLC

Basic Data Types

Hierarchy of Data Types

Copyright: JC Quality Business Solutions LLC

2 Main Attribute Gage R&R Types

Copyright: JC Quality Business Solutions LLC

Kendalls Correlation Coefficient:

Expressed as 0 (weaker agreement) to +1 (stronger agreement)

Copyright: JC Quality Business Solutions LLC

Kappa & Kendalls Summary

Kendalls Coefficient of Concordance:

Kendalls Correlation Coefficient:

Copyright: JC Quality Business Solutions LLC

Attribute Gage R&R Considerations

Copyright: JC Quality Business Solutions LLC

MSA Factors Impacting Variation

Copyright: JC Quality Business Solutions LLC

Controlling MSA Factors

Copyright: JC Quality Business Solutions LLC

Controlling MSA Factors, Cont.

Nominal / Binary Study

Copyright: JC Quality Business Solutions LLC

Copyright: JC Quality Business Solutions LLC

Copyright: JC Quality Business Solutions LLC

Copyright: JC Quality Business Solutions LLC

Output: Within vs. Standard

Copyright: JC Quality Business Solutions LLC

Date of study: Reported by: Name of product: Misc:

95 Percent Percent Lee Appraiser Fred

80 Lee Appraiser Fred

Copyright: JC Quality Business Solutions LLC

Copyright: JC Quality Business Solutions LLC

Output: Between vs. Standard

Copyright: JC Quality Business Solutions LLC

Ordinal Case Study: Print Quality

Copyright: JC Quality Business Solutions LLC

What did we want to know?

Copyright: JC Quality Business Solutions LLC