Resumen de Measurement System Analysis for Categorical Measurements: Agreement and Kappa-Type Indices

Jeroen De Mast, Wessel N. Van Wieringen

• The standard method for the assessment of the precision of measurement systems that measure on a metric scale is the gauge R&R method, but this method is not applicable for measurement systems that measure on a nominal scale. For nominal measurements, the agreement method, which expresses precision in the form of a kappa index, may be used. A consistent framework for the kappa method is described, based on statistical modeling. The defined probability models are used to study the statistical properties of proposed estimators. Alternative forms of kappa are discussed, as well as their relationship to the paradoxes of kappa.