Weighted Kappas for 3×3 Tables
Weighted kappa is a widely used statistic for summarizing inter-rater agreement on a categorical scale. For rating scales with three categories, there are seven versions of weighted kappa. It is shown analytically how these weighted kappas are related. Several conditional equalities and inequalities...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2013-01-01
|
| Series: | Journal of Probability and Statistics |
| Online Access: | http://dx.doi.org/10.1155/2013/325831 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850226950471155712 |
|---|---|
| author | Matthijs J. Warrens |
| author_facet | Matthijs J. Warrens |
| author_sort | Matthijs J. Warrens |
| collection | DOAJ |
| description | Weighted kappa is a widely used statistic for summarizing inter-rater agreement on a categorical scale. For rating scales with three categories, there are seven versions of weighted kappa. It is shown analytically how these weighted kappas are related. Several conditional equalities and inequalities between the weighted kappas are derived. The analytical analysis indicates that the weighted kappas are measuring the same thing but to a different extent. One cannot, therefore, use the same magnitude guidelines for all weighted kappas. |
| format | Article |
| id | doaj-art-559c49a8169448b0a623a5b4b93e6d8b |
| institution | OA Journals |
| issn | 1687-952X 1687-9538 |
| language | English |
| publishDate | 2013-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Probability and Statistics |
| spelling | doaj-art-559c49a8169448b0a623a5b4b93e6d8b2025-08-20T02:04:57ZengWileyJournal of Probability and Statistics1687-952X1687-95382013-01-01201310.1155/2013/325831325831Weighted Kappas for 3×3 TablesMatthijs J. Warrens0Unit of Methodology and Statistics, Institute of Psychology, Leiden University, P.O. Box 9555, 2300 RB Leiden, The NetherlandsWeighted kappa is a widely used statistic for summarizing inter-rater agreement on a categorical scale. For rating scales with three categories, there are seven versions of weighted kappa. It is shown analytically how these weighted kappas are related. Several conditional equalities and inequalities between the weighted kappas are derived. The analytical analysis indicates that the weighted kappas are measuring the same thing but to a different extent. One cannot, therefore, use the same magnitude guidelines for all weighted kappas.http://dx.doi.org/10.1155/2013/325831 |
| spellingShingle | Matthijs J. Warrens Weighted Kappas for 3×3 Tables Journal of Probability and Statistics |
| title | Weighted Kappas for 3×3 Tables |
| title_full | Weighted Kappas for 3×3 Tables |
| title_fullStr | Weighted Kappas for 3×3 Tables |
| title_full_unstemmed | Weighted Kappas for 3×3 Tables |
| title_short | Weighted Kappas for 3×3 Tables |
| title_sort | weighted kappas for 3 3 tables |
| url | http://dx.doi.org/10.1155/2013/325831 |
| work_keys_str_mv | AT matthijsjwarrens weightedkappasfor33tables |