Format

Send to:

Choose Destination
See comment in PubMed Commons below
Stat Med. 2010 Oct 15;29(23):2438-52. doi: 10.1002/sim.3991.

Evaluating health risk models.

Author information

  • 1Department of Health Research and Policy, Stanford University School of Medicine, Stanford, CA 94305-5405, USA. alicesw@stanford.edu

Abstract

Interest in targeted disease prevention has stimulated development of models that assign risks to individuals, using their personal covariates. We need to evaluate these models and quantify the gains achieved by expanding a model to include additional covariates. This paper reviews several performance measures and shows how they are related. Examples are used to show that appropriate performance criteria for a risk model depend upon how the model is used. Application of the performance measures to risk models for hypothetical populations and for US women at risk of breast cancer illustrate two additional points. First, model performance is constrained by the distribution of risk-determining covariates in the population. This complicates the comparison of two models when applied to populations with different covariate distributions. Second, all summary performance measures obscure model features of relevance to its utility for the application at hand, such as performance in specific subgroups of the population. In particular, the precision gained by adding covariates to a model can be small overall, but large in certain subgroups. We propose new ways to identify these subgroups and to quantify how much they gain by measuring the additional covariates. Those with largest gains could be targeted for cost-efficient covariate assessment.

PMID:
20623821
[PubMed - indexed for MEDLINE]
PMCID:
PMC2990501
Free PMC Article
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for John Wiley & Sons, Inc. Icon for PubMed Central
    Loading ...
    Write to the Help Desk