Biometrics. 1975 Sep;31(3):651-9.

Measuring agreement between two judges on the presence or absence of a trait.

Abstract

At least a dozen indexes have been proposed for measuring agreement between two judges on a categorical scale. Using the binary (positive-negative) case as a model, this paper presents and critically evaluates some of these proposed measures. The importance of correcting for chance-expected agreement is emphasized, and identities with intraclass correlation coefficients are pointed out.

PMID:: 1174623; [PubMed - indexed for MEDLINE]

Publication Types, MeSH Terms

Publication Types

Research Support, U.S. Gov't, Non-P.H.S.

MeSH Terms

Supplemental Content

Save items

Related citations in PubMed

Review Agreement measurement and the judgment process. [J Nerv Ment Dis. 1979]
Review Agreement measurement and the judgment process.
Janes CL. J Nerv Ment Dis. 1979 Jun; 167(6):343-7.
Coefficients of agreement for fixed observers. [Stat Methods Med Res. 2006]
Coefficients of agreement for fixed observers.
Haber M, Barnhart HX. Stat Methods Med Res. 2006 Jun; 15(3):255-71.
An analysis-of-variance model for the assessment of configural cue utilization in clinical judgment. [Psychol Bull. 1968]
An analysis-of-variance model for the assessment of configural cue utilization in clinical judgment.
Hoffman PJ, Slovic P, Rorer LG. Psychol Bull. 1968 May; 69(5):338-49.
A generalized concordance correlation coefficient for continuous and categorical data. [Stat Med. 2001]
A generalized concordance correlation coefficient for continuous and categorical data.
King TS, Chinchilli VM. Stat Med. 2001 Jul 30; 20(14):2131-47.
Review Measuring agreement in medical informatics reliability studies. [J Biomed Inform. 2002]
Review Measuring agreement in medical informatics reliability studies.
Hripcsak G, Heitjan DF. J Biomed Inform. 2002 Apr; 35(2):99-110.

See reviews... See all...

Cited by 18 PubMed Central articles

On Association Coefficients for 2x2 Tables and Properties That Do Not Depend on the Marginal Distributions. [Psychometrika. 2008]
On Association Coefficients for 2x2 Tables and Properties That Do Not Depend on the Marginal Distributions.
Warrens MJ. Psychometrika. 2008 Dec; 73(4):777-789. Epub 2008 Jul 23.
Cell sorting-assisted microarray profiling of host cell response to Cryptosporidium parvum infection. [Infect Immun. 2010]
Cell sorting-assisted microarray profiling of host cell response to Cryptosporidium parvum infection.
Yang YL, Buck GA, Widmer G. Infect Immun. 2010 Mar; 78(3):1040-8. Epub 2009 Dec 28.
On Similarity Coefficients for 2x2 Tables and Correction for Chance. [Psychometrika. 2008]
On Similarity Coefficients for 2x2 Tables and Correction for Chance.
Warrens MJ. Psychometrika. 2008 Sep; 73(3):487-502. Epub 2008 Mar 1.

See all...

Related information

Related Citations
Calculated set of PubMed citations closely related to the selected article(s) retrieved using a word weight algorithm. Related articles are displayed in ranked order from most to least relevant, with the “linked from” citation displayed first.
Cited in PMC
Full-text articles in the PubMed Central Database that cite the current articles.

Recent activity

Clear Turn Off Turn On

Measuring agreement between two judges on the presence or absence of a trait.
Measuring agreement between two judges on the presence or absence of a trait.
Biometrics. 1975 Sep ;31(3):651-9.

PubMed
Missing link in firefly bioluminescence revealed: NO regulation of photocyte res...
Missing link in firefly bioluminescence revealed: NO regulation of photocyte respiration.
Bioessays. 2001 Nov ;23(11):992-5.

PubMed
Karyotype, phenotype and parental origin in 19 cases of triploidy.
Karyotype, phenotype and parental origin in 19 cases of triploidy.
Prenat Diagn. 2001 Dec ;21(12):1034-48.

PubMed
Detection of a decrease in green fluorescent protein fluorescence for the monito...
Detection of a decrease in green fluorescent protein fluorescence for the monitoring of cell death: an assay amenable to high-throughput screening technologies.
Cytometry. 2001 Dec 1 ;45(4):237-43.

PubMed
Perinatal hypophosphatasia: radiology, pathology and molecular biology studies i...
Perinatal hypophosphatasia: radiology, pathology and molecular biology studies in a family harboring a splicing mutation (648+1A) and a novel missense mutation (N400S) in the tissue-nonspecific alkaline phosphatase (TNSALP) gene.
Am J Med Genet. 2001 Oct 15 ;103(3):235-40.

PubMed

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

PubMed

Result Filters

Display Settings:

Send to:

Measuring agreement between two judges on the presence or absence of a trait.

Abstract

Publication Types, MeSH Terms

Publication Types

MeSH Terms

Supplemental Content

Save items

Related citations in PubMed

Cited by 18 PubMed Central articles

Related information

Recent activity

Simple NCBI Directory

Getting Started

Resources

Popular

Featured

NCBI Information