Biometrics. 1977 Mar;33(1):159-74.

The measurement of observer agreement for categorical data.

Abstract

This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.

PMID:: 843571; [PubMed - indexed for MEDLINE]

Publication Types, MeSH Terms

Publication Types

MeSH Terms

LinkOut - more resources

Other Literature Sources

COS Scholar Universe

Medical

Libraries

LinkOut Holdings

Supplemental Content

Save items

Related citations in PubMed

A computer program for the generalized chi-square analysis of categorical data using weighted least squares (GENCAT). [Comput Programs Biomed. 1976]
A computer program for the generalized chi-square analysis of categorical data using weighted least squares (GENCAT).
Landis JR, Stanish WM, Freeman JL, Koch GG. Comput Programs Biomed. 1976 Dec; 6(4):196-231.
Some general methods for the analysis of categorical data in longitudinal studies. [Stat Med. 1988]
Some general methods for the analysis of categorical data in longitudinal studies.
Landis JR, Miller ME, Davis CS, Koch GG. Stat Med. 1988 Jan-Feb; 7(1-2):109-37.
Homogeneity of kappa statistics in multiple samples. [Comput Methods Programs Biomed...]
Homogeneity of kappa statistics in multiple samples.
Reed JF 3rd. Comput Methods Programs Biomed. 2000 Aug; 63(1):43-6.
Review Use and misuse of statistics for epidemiological studies of multiple sclerosis. [Ann Neurol. 1994]
Review Use and misuse of statistics for epidemiological studies of multiple sclerosis.
Hibberd PL. Ann Neurol. 1994 Dec; 36 Suppl 2:S218-30.
Review Statistical methods in epidemiology. v. Towards an understanding of the kappa coefficient. [Disabil Rehabil. 2000]
Review Statistical methods in epidemiology. v. Towards an understanding of the kappa coefficient.
Rigby AS. Disabil Rehabil. 2000 May 20; 22(8):339-44.

See reviews... See all...

Cited by over 100 PubMed Central articles

Assessment of Single-Word Production for Children under Three Years of Age: Comparison of Children with and without Cleft Palate. [Int J Otolaryngol. 2012]
Assessment of Single-Word Production for Children under Three Years of Age: Comparison of Children with and without Cleft Palate.
Scherer NJ, Williams L, Stoel-Gammon C, Kaiser A. Int J Otolaryngol. 2012; 2012:724214. Epub 2012 Apr 30.
Effect of age on variability in the production of text-based global inferences. [PLoS One. 2012]
Effect of age on variability in the production of text-based global inferences.
Williams LJ, Dunlop JP, Abdi H. PLoS One. 2012; 7(5):e36161. Epub 2012 May 8.
Development of an indoor air quality checklist for risk assessment of indoor air pollutants by semiquantitative score in nonindustrial workplaces. [Risk Manag Healthc Policy. 2012]
Development of an indoor air quality checklist for risk assessment of indoor air pollutants by semiquantitative score in nonindustrial workplaces.
Syazwan A, Rafee BM, Hafizan J, Azman A, Nizar A, Izwyn Z, Muhaimin A, Yunos MS, Anita A, Hanafiah JM, et al. Risk Manag Healthc Policy. 2012; 5:17-23. Epub 2012 Apr 13.

See all...

Related information

Related Citations
Calculated set of PubMed citations closely related to the selected article(s) retrieved using a word weight algorithm. Related articles are displayed in ranked order from most to least relevant, with the “linked from” citation displayed first.
Cited in PMC
Full-text articles in the PubMed Central Database that cite the current articles.
Cited in Books
NCBI Bookshelf books that cite the current articles.

Recent activity

Clear Turn Off Turn On

The measurement of observer agreement for categorical data.
The measurement of observer agreement for categorical data.
Biometrics. 1977 Mar ;33(1):159-74.

PubMed
The synthesis of IL-1 receptor antagonist (IL-1ra) by synovial fibroblasts is ma...
The synthesis of IL-1 receptor antagonist (IL-1ra) by synovial fibroblasts is markedly increased by the cytokines TNF-alpha and IL-1.
Biochim Biophys Acta. 1993 Feb 17 ;1175(3):302-5.

PubMed
Plasma corticosterone concentrations in diabetic (db) mice.
Plasma corticosterone concentrations in diabetic (db) mice.
Diabetologia. 1977 Jan ;13(1):25-6.

PubMed
Dietary omega-3 polyunsaturated fatty acids inhibit phosphoinositide formation a...
Dietary omega-3 polyunsaturated fatty acids inhibit phosphoinositide formation and chemotaxis in neutrophils.
J Clin Invest. 1993 Feb ;91(2):651-60.

PubMed
The effect of ascorbic acid on uric acid excretion with a commentary on the rena...
The effect of ascorbic acid on uric acid excretion with a commentary on the renal handling of ascorbic acid.
Am J Med. 1977 Jan ;62(1):71-6.

PubMed

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

PubMed

Result Filters

Display Settings:

Send to: