Format

Send to

Choose Destination
J Clin Epidemiol. 2016 Oct;78:73-82. doi: 10.1016/j.jclinepi.2016.03.022. Epub 2016 Apr 21.

Partial verification bias and incorporation bias affected accuracy estimates of diagnostic studies for biomarkers that were part of an existing composite gold standard.

Author information

1
Institute for Biostatistics, Hannover Medical School, Carl-Neuberg-Str. 1, 30625 Hannover, Germany.
2
Department of Medical Statistics, University Göttingen, Humboldtallee 32, 37073 Göttingen, Germany.
3
National Reference Centre for TSE, Department for Neurology, University Göttingen, Robert-Koch-Str. 40, 37075 Göttingen, Germany.
4
National Reference Centre for TSE, Department for Neurology, University Göttingen, Robert-Koch-Str. 40, 37075 Göttingen, Germany; Department of Epidemiology, Helmholtz Centre for Infection Research, Inhoffenstr. 7, 38124 Braunschweig, Germany; German Center for Infection Research, Hannover-Braunschweig Site, Feodor-Lynen-Str. 7, 30625 Hannover, Germany. Electronic address: andre.karch@helmholtz-hzi.de.

Abstract

OBJECTIVE:

To investigate how choice of gold standard biases estimates of sensitivity and specificity in studies reassessing the diagnostic accuracy of biomarkers that are already part of a lifetime composite gold standard (CGS).

STUDY DESIGN AND SETTING:

We performed a simulation study based on the real-life example of the biomarker "protein 14-3-3" used for diagnosing Creutzfeldt-Jakob disease. Three different types of gold standard were compared: perfect gold standard "autopsy" (available in a small fraction only; prone to partial verification bias), lifetime CGS (including the biomarker under investigation; prone to incorporation bias), and "best available" gold standard (autopsy if available, otherwise CGS).

RESULTS:

Sensitivity was unbiased when comparing 14-3-3 with autopsy but overestimated when using CGS or "best available" gold standard. Specificity of 14-3-3 was underestimated in scenarios comparing 14-3-3 with autopsy (up to 24%). In contrast, overestimation (up to 20%) was observed for specificity compared with CGS; this could be reduced to 0-10% when using the "best available" gold standard.

CONCLUSION:

Choice of gold standard affects considerably estimates of diagnostic accuracy. Using the "best available" gold standard (autopsy where available, otherwise CGS) leads to valid estimates of specificity, whereas sensitivity is estimated best when tested against autopsy alone.

KEYWORDS:

14-3-3; Autopsy; Creutzfeldt–Jakob disease; Diagnostic validity; Incorporation bias; Partial verification bias

PMID:
27107877
DOI:
10.1016/j.jclinepi.2016.03.022
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center