Weighted Kappas for 3×3 Tables

Weighted kappa is a widely used statistic for summarizing inter-rater agreement on a categorical scale. For rating scales with three categories, there are seven versions of weighted kappa. It is shown analytically how these weighted kappas are related. Several conditional equalities and inequalities...

Full description

Saved in:
Bibliographic Details
Main Author: Matthijs J. Warrens
Format: Article
Language:English
Published: Wiley 2013-01-01
Series:Journal of Probability and Statistics
Online Access:http://dx.doi.org/10.1155/2013/325831
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Weighted kappa is a widely used statistic for summarizing inter-rater agreement on a categorical scale. For rating scales with three categories, there are seven versions of weighted kappa. It is shown analytically how these weighted kappas are related. Several conditional equalities and inequalities between the weighted kappas are derived. The analytical analysis indicates that the weighted kappas are measuring the same thing but to a different extent. One cannot, therefore, use the same magnitude guidelines for all weighted kappas.
ISSN:1687-952X
1687-9538