MSA-4 Gauge Study, Attribute - Kappa

Page: 1 of 4

Part Number xxxxx Appraiser A Nick

Part Name dfrg hjyeww Appraiser B Kaz
Characteristic Colour Appraiser C Ori
No. of Parts 50
Gauge Number D-0123 No. of Appraiser 3
Gauge Name D-123 Colour Gage No. of Trials 3
Gauge Type Sample Reported By Nick P
Date 20-May-13

Appraiser A-1 A-2 A-3 B-1 B-2 B-3 C-1 C-2 C-3 Reference Ref Value Code
+ All Acc
1 = Acc
Part Kamatchi Nora Yenni - All Rej
0 = Rej
x Mismatched
1 1 1 1 1 1 1 1 1 1 1 +
2 1 1 1 1 1 1 1 1 1 1 +
3 0 0 0 0 0 0 0 0 0 0 -
4 0 0 0 0 0 0 0 0 0 0 -
5 0 0 0 0 0 0 0 0 0 0 -
6 1 1 0 1 1 0 1 0 0 1 x
7 1 1 1 1 1 1 1 0 1 1 x
8 1 1 1 1 1 1 1 1 1 1 +
9 0 0 0 0 0 0 0 0 0 0 -
10 1 1 1 1 1 1 1 1 1 1 +
11 1 1 1 1 1 1 1 1 1 1 +
12 0 0 0 0 0 0 0 1 0 0 x
13 1 1 1 1 1 1 1 1 1 1 +
14 1 1 0 1 1 1 1 0 0 1 x
15 1 1 1 1 1 1 1 1 1 1 +
16 1 1 1 1 1 1 1 1 1 1 +
17 1 1 1 1 1 1 1 1 1 1 +
18 1 1 1 1 1 1 1 1 1 1 +
19 1 1 1 1 1 1 1 1 1 1 +
20 1 1 1 1 1 1 1 1 1 1 +
21 1 1 0 1 0 1 0 1 0 1 x
22 0 0 1 0 1 0 1 1 0 0 x
23 1 1 1 1 1 1 1 1 1 1 +
24 1 1 1 1 1 1 1 1 1 1 +
25 0 0 0 0 0 0 0 0 0 0 -
26 0 1 0 0 0 0 0 0 1 0 x
27 1 1 1 1 1 1 1 1 1 1 +
28 1 1 1 1 1 1 1 1 1 1 +
29 1 1 1 1 1 1 1 1 1 1 +
30 0 0 0 0 0 1 0 0 0 0 x
31 1 1 1 1 1 1 1 1 1 1 +
32 1 1 1 1 1 1 1 1 1 1 +
33 1 1 1 1 1 1 1 1 1 1 +
34 0 0 1 0 0 1 0 1 1 0 x
35 1 1 1 1 1 1 1 1 1 1 +
36 1 1 0 1 1 1 1 0 1 1 x
37 0 0 0 0 0 0 0 0 0 0 -
38 1 1 1 1 1 1 1 1 1 1 +
39 0 0 0 0 0 0 0 0 0 0 -
40 1 1 1 1 1 1 1 1 1 1 +
41 1 1 1 1 1 1 1 1 1 1 +
42 0 0 0 0 0 0 0 0 0 0 -
43 1 0 1 1 1 1 1 1 0 1 x
44 1 1 1 1 1 1 1 1 1 1 +
45 0 0 0 0 0 0 0 0 0 0 -
46 1 1 1 1 1 1 1 1 1 1 +
47 1 1 1 1 1 1 1 1 1 1 +
48 0 0 0 0 0 0 0 0 0 0 -
49 1 1 1 1 1 1 1 1 1 1 +
 50 0 0 0 0 0 0 0 0 0 0 -
Total Acc 100 103 99 34 39
Total Rej 50 47 51 16 11
 MSA-4 Gauge Study, Attribute - Kappa
Page: 2 of 4

Part Number xxxxx Appraiser A Nick

Part Name dfrg hjyeww Appraiser B Kaz
Characteristic Colour Appraiser C Ori
No. of Parts 50
Gauge Number D-0123 No. of Appraiser 3
Gauge Name D-123 Colour Gage No. of Trials 3
Gauge Type Sample Reported By Nick P
Date 20-May-13

A * B Crosstabualtion B * C Crosstabualtion A * C Crosstabualtion

Inspector B Inspector C Inspector C

# Rej # Acc Total # Rej # Acc Total # Rej # Acc Total
# Rej 44 6 # Rej 42 5 # Rej 43 7
Inspector A

Inspector B

Inspector A
50 47 50
Expect 15.7 34.3 Expect 16.0 31.0 Expect 17.0 33.0
# Acc 3 97 # Acc 9 94 # Acc 8 92
100 103 100
Expect 31.3 68.7 Expect 35.0 68.0 Expect 34.0 66.0
Total 47 103 150 Total 51 99 150 Total 51 99 150
150 150 150

Observed p value Observed p value Observed p value

Inspector B Inspector C Inspector C
# Rej # Acc Total # Rej # Acc Total # Rej # Acc Total
Inspector A

Inspector B

# Rej 0.293 0.040 0.333 # Rej 0.280 0.033 0.313 Inspector A # Rej 0.287 0.047 0.333

# Acc 0.020 0.647 0.667 # Acc 0.060 0.627 0.687 # Acc 0.053 0.613 0.667

Total 0.313 0.687 1 Total 0.340 0.660 1 Total 0.340 0.660 1

Expected p value Expected p value Expected p value

Inspector B Inspector C Inspector C
# Rej # Acc Total # Rej # Acc Total # Rej # Acc Total
Inspector A

Inspector B

Inspector A

# Rej 0.104 0.229 0.333 # Rej 0.107 0.207 0.313 # Rej 0.113 0.220 0.333

# Acc 0.209 0.458 0.667 # Acc 0.233 0.453 0.687 # Acc 0.227 0.440 0.667

Total 0.313 0.687 1 Total 0.340 0.660 1 Total 0.340 0.660 1

Appriasers Crosstabualtion Results

Appraiser A Appraiser B Appraiser B

pe = 0.562 pe = 0.560 pe = 0.553
po = 0.940 po = 0.907 po = 0.9

kappa = 0.863 kappa = 0.788 kappa = 0.776

150 #REF! #REF!

(Rule of thumb: kappa value > 0.75 indicate good to excellent agreement)
 MSA-4 Gauge Study, Attribute - Kappa
Page: 3 of 4

Part Number xxxxx Appraiser A Nick

Part Name dfrg hjyeww Appraiser B Kaz
Characteristic Colour Appraiser C Ori
No. of Parts 50
Gauge Number D-0123 No. of Appraiser 3
Gauge Name D-123 Colour Gage No. of Trials 3
Gauge Type Sample Reported By Nick P
Date 20-May-13

A * Reference Crosstabualtion B * Reference Crosstabualtion C * Reference Crosstabualtion

Reference Reference Reference

# Rej # Acc Total # Rej # Acc Total # Rej # Acc Total
# Rej 45 5 # Rej 45 2 # Rej 42 9
Inspector A

Inspector A

Inspector A
50 47 51
Expect 16.0 34.0 Expect 15.0 32.0 Expect 16.3 34.7
# Acc 3 97 # Acc 3 100 # Acc 6 93
100 103 99
Expect 32.0 68.0 Expect 33.0 70.0 Expect 31.7 67.3
Total 48 102 150 Total 48 102 150 Total 48 102 150
150 150 150

Observed p value Observed p value Observed p value

Reference Reference Reference
# Rej # Acc Total # Rej # Acc Total # Rej # Acc Total
Inspector A

Inspector B

# Rej 0.300 0.033 0.333 # Rej 0.300 0.013 0.313 Inspector A # Rej 0.280 0.060 0.340

# Acc 0.020 0.647 0.667 # Acc 0.020 0.667 0.687 # Acc 0.040 0.620 0.660

Total 0.320 0.680 1 Total 0.320 0.680 1 Total 0.320 0.680 1

Expected p value Expected p value Expected p value

Reference Reference Reference
# Rej # Acc Total # Rej # Acc Total # Rej # Acc Total
Inspector A

Inspector B

Inspector A

# Rej 0.107 0.227 0.333 # Rej 0.100 0.213 0.313 # Rej 0.109 0.231 0.340

# Acc 0.213 0.453 0.667 # Acc 0.220 0.467 0.687 # Acc 0.211 0.449 0.660

Total 0.320 0.680 1 Total 0.320 0.680 1 Total 0.320 0.680 1

Appriasers Crosstabualtion Results

Appraiser A Appraiser B Appraiser B

pe = 0.560 pe = 0.567 pe = 0.558
po = 0.947 po = 0.967 po = 0.9

kappa = 0.879 kappa = 0.923 kappa = 0.774

0 #REF!
(Rule of thumb: kappa value > 0.75 indicate good to excellent agreement)
 MSA-4 Gauge Study, Attribute - Kappa
Page: 4 of 4

Part Number xxxxx Appraiser A Nick

Part Name dfrg hjyeww Appraiser B Kaz
Characteristic Colour Appraiser C Ori
No. of Parts 50
Gauge Number D-0123 No. of Appraiser 3
Gauge Name D-123 Colour Gage No. of Trials 3
Gauge Type Sample Reported By Nick P
Date 20-May-13

% Appraiser % Appraiser

Appraiser agreed with him/herself on all trials Appraiser agreed on all trials with standard

Source Appraiser A Appraiser B Appraiser C Appraiser A Appraiser B Appraiser C

Total Inspected 50 50 50 50 50 50
# Matched 42 45 40 42 45 40
False Negative / Over Reject (appraiser biased toward rejection) 0 0 0
False Positive / Under Reject (appraiser biased toward acceptance) 0 0 0
Mixed 8 5 10
95% UCI 92.8% 96.7% 90.0% 92.8% 96.7% 90.0%
Calc. Score 84.0% 90.0% 80.0% 84.0% 90.0% 80.0%
95% LCI 70.9% 78.2% 66.3% 70.9% 78.2% 66.3%

System % Effective Score System % Effective Score

All appraisers agreed within and between themselves AND
All appraisers agreed within and between themselves
agreed with standard

Total Inspected 50 50
# in Agreement 39 39

95% UCI 88.5% 88.5%

Calculated Score 78.0% 78.0%
95% LCI 64.0% 64.0%

Appraiser A Appraiser B Appraiser C

Count of Under Reject 0 0 0
Total Reject opportunities 48 48 48
Count of Over Reject 0 0 0
Total Accept opportunities 102 102 102
Effectiveness 84.0% 90.0% 80.0%
Miss Rate (Under Reject) 0.0% 0.0% 0.0%
False Alarm Rate (Over Reject) 0.0% 0.0% 0.0%

** There is no theory-based decision criteria on acceptable risk