Send to

Choose Destination
Radiology. 2003 Aug;228(2):303-8. Epub 2003 Jun 20.

Measurement of observer agreement.

Author information

Department of Radiology and MCP Hahnemann School of Public Health, University of Pennsylvania Medical Center, 3600 Market St, Suite 370, Philadelphia, PA 19104, USA.


Statistical measures are described that are used in diagnostic imaging for expressing observer agreement in regard to categorical data. The measures are used to characterize the reliability of imaging methods and the reproducibility of disease classifications and, occasionally with great care, as the surrogate for accuracy. The review concentrates on the chance-corrected indices, kappa and weighted kappa. Examples from the imaging literature illustrate the method of calculation and the effects of both disease prevalence and the number of rating categories. Other measures of agreement that are used less frequently, including multiple-rater kappa, are referenced and described briefly.

[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Atypon
Loading ...
Support Center