FORUMLA FOR CALCULATING Kappa (Attribute)

Kappa is a measure of interrater agreement that tests if the counts in the diagonal cells (the parts
that receive the same rating) differ from those expected by chance alone.

Let

p0 = the sum of the observed proportions in the diagonal cells

pe = the sum of the expected proportion in the diagonal cells.

then
p0  pe
kappa 
1  pe

Example - values taken from MSA Manual 3rd Edition:

Calculating Expected Count:

(44 + 6) (44 + 3) / 150 = 15.7

(44 + 6)(6 + 97) / 150 = 34.3

Calculating p0 & pe:

= = 0.94 = = 0.56
P0 44  97 Pe 15.7  68.7
150
150