Format

Send to:

Choose Destination
See comment in PubMed Commons below
Stat Med. 1990 Sep;9(9):1103-15.

Measuring interrater reliability among multiple raters: an example of methods for nominal data.

Author information

  • 1Department of Anesthesiology, University of Washington, Seattle 98195.

Erratum in

  • Stat Med 1992 Jul;11(10):1401.

Abstract

This paper reviews and critiques various approaches to the measurement of reliability among multiple raters in the case of nominal data. We consider measurement of the overall reliability of a group of raters (using kappa-like statistics) as well as the reliability of individual raters with respect to a group. We introduce modifications of previously published estimators appropriate for measurement of reliability in the case of stratified sampling frames and we interpret these measures in view of standard errors computed using the jackknife. Analyses of a set of 48 anaesthesia case histories in which 42 anaesthesiologists independently rated the appropriateness of care on a nominal scale serve as an example.

PMID:
2244082
[PubMed - indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Loading ...
    Write to the Help Desk