Format

Send to

Choose Destination
J Clin Epidemiol. 1993 Sep;46(9):1055-62.

The analysis of ordinal agreement data: beyond weighted kappa.

Author information

1
Department of Community Health and General Practice, Christchurch School of Medicine, New Zealand.

Abstract

The weighted kappa statistic has been used as an agreement index for ordinal data. Using data on the comparability of primary and proxy respondent reports of alcohol drinking frequency we show that the value of weighted kappa can be sensitive to the choice of weights. The distinction between association and agreement is clarified and it is shown that in some respects weighted kappa behaves more like a measure of association than an index of agreement. In particular, it is demonstrated that the weighted kappa statistic is not always sensitive to differences in the observed proportion in exact agreement and that high values of weighted kappa can be observed even when the level of agreement is low. We illustrate the use of statistical models in the analysis of epidemiologic agreement data and conclude that modelling ordinal agreement data produces insights which cannot be obtained through the use of weighted kappa statistics.

PMID:
8263578
DOI:
10.1016/0895-4356(93)90173-x
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center