Format

Send to

Choose Destination
J Clin Epidemiol. 2013 Nov;66(11):1296-301. doi: 10.1016/j.jclinepi.2013.06.003. Epub 2013 Sep 8.

Calibration of clinical prediction rules does not just assess bias.

Author information

1
Clinical Epidemiology, Institute of Medical Biometry and Medical Informatics, Freiburg University Medical Center, Freiburg, Germany. Electronic address: wv@imbi.uni-freiburg.de.

Abstract

OBJECTIVES:

Calibration is often thought to assess the bias of a clinical prediction rule. In particular, if the rule is based on a linear logistic model, it is often assumed that an overestimation of all coefficients results in a calibration slope less than 1 and an underestimation in a slope larger than 1.

STUDY DESIGN AND SETTING:

We investigate the relation of the bias and the residual variation of clinical prediction rules with the typical behavior of calibration plots and calibration slopes, using some artificial examples.

RESULTS:

Calibration is not only sensitive to the bias of the clinical prediction rule but also to the residual variation. In some circumstances, the effects may cancel out, resulting in a misleading perfect calibration.

CONCLUSION:

Poor calibration is a clear indication of limited usefulness of a clinical prediction rule. However, a perfect calibration should be interpreted with care as this may happen even for a biased prediction rule.

KEYWORDS:

Bias; Calibration; External validation; Prognosis; Prognostic model; Residual variation

PMID:
24021610
DOI:
10.1016/j.jclinepi.2013.06.003
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center