AMIA Annu Symp Proc. 2005:161-5.

Deriving the expected utility of a predictive model when the utilities are uncertain.

Source

Center for Biomedical Informatics and the Intelligent Systems Program, University of Pittsburgh, Pennsylvania, USA.

Abstract

Predictive models are often constructed from clinical databases with the goal of eventually helping make better clinical decisions. Evaluating models using decision theory is therefore natural. When constructing a model using statistical and machine learning methods, however, we are often uncertain about precisely how the model will be used. Thus, decision-independent measures of classification performance, such as the area under an ROC curve, are popular. As a complementary method of evaluation, we investigate techniques for deriving the expected utility of a model under uncertainty about the model's utilities. We demonstrate an example of the application of this approach to the evaluation of two models that diagnose coronary artery disease.

PMID:: 16779022; [PubMed - indexed for MEDLINE]
PMCID: PMC1560537

Free PMC Article

Images from this publication.See all images (4) Free text

Publication Types, MeSH Terms, Grant Support

Publication Types

MeSH Terms

Grant Support

R01-LM008374/LM/NLM NIH HHS/United States

LinkOut - more resources

Full Text Sources

Other Literature Sources

COS Scholar Universe

Supplemental Content

Related citations

Three-class ROC analysis--a decision theoretic approach under the ideal observer framework. [IEEE Trans Med Imaging. 2006]
Three-class ROC analysis--a decision theoretic approach under the ideal observer framework.
He X, Metz CE, Tsui BM, Links JM, Frey EC. IEEE Trans Med Imaging. 2006 May; 25(5):571-81.
Decision analysis in forensic science. [J Forensic Sci. 2005]
Decision analysis in forensic science.
Taroni F, Bozza S, Aitken C. J Forensic Sci. 2005 Jul; 50(4):894-905.
Predicting carcinoid heart disease with the noisy-threshold classifier. [Artif Intell Med. 2007]
Predicting carcinoid heart disease with the noisy-threshold classifier.
van Gerven MA, Jurgelenaite R, Taal BG, Heskes T, Lucas PJ. Artif Intell Med. 2007 May; 40(1):45-55. Epub 2006 Nov 13.
Review Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. [Clin Chem. 2008]
Review Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve.
Cook NR. Clin Chem. 2008 Jan; 54(1):17-23. Epub 2007 Nov 16.
Review Cost-effectiveness of using prognostic information to select women with breast cancer for adjuvant systemic therapy. [Health Technol Assess. 2006]
Review Cost-effectiveness of using prognostic information to select women with breast cancer for adjuvant systemic therapy.
Williams C, Brunskill S, Altman D, Briggs A, Campbell H, Clarke M, Glanville J, Gray A, Harris A, Johnston K, et al. Health Technol Assess. 2006 Sep; 10(34):iii-iv, ix-xi, 1-204.

See reviews... See all...

Related information

Related Citations
Calculated set of PubMed citations closely related to the selected article(s) retrieved using a word weight algorithm. Related articles are displayed in ranked order from most to least relevant, with the “linked from” citation displayed first.
References for this PMC Article
Citation referenced in PubMed article. Only valid for PubMed citations that are also in PMC.
Free in PMC
Free full text articles in PMC

Recent activity

Clear Turn Off Turn On

Deriving the expected utility of a predictive model when the utilities are uncer...
Deriving the expected utility of a predictive model when the utilities are uncertain.
AMIA Annu Symp Proc. 2005 :161-5.

PubMed
Is cataract surgery cost-effective among older patients with a low predicted pro...
Is cataract surgery cost-effective among older patients with a low predicted probability for improvement in reported visual functioning?
Med Care. 2006 Nov ;44(11):982-9.

PubMed
Retrieval and classification of dental research articles.
Retrieval and classification of dental research articles.
Adv Dent Res. 2003 Dec ;17:115-20.

PubMed
Serotype 14 variants of the France 9V(-3) clone from Baltimore, Maryland, can be...
Serotype 14 variants of the France 9V(-3) clone from Baltimore, Maryland, can be differentiated by the cpsB gene.
J Clin Microbiol. 2004 Jan ;42(1):250-6.

PubMed
Crude-oil biodegradation via methanogenesis in subsurface petroleum reservoirs.
Crude-oil biodegradation via methanogenesis in subsurface petroleum reservoirs.
Nature. 2008 Jan 10 ;451(7175):176-80. Epub 2007 Dec 12 .

PubMed

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

PubMed

Display Settings:

Send to: