Display Settings:

Format

Send to:

Choose Destination
Biometrics. 2011 Sep;67(3):1057-65. doi: 10.1111/j.1541-0420.2010.01523.x. Epub 2010 Dec 14.

Two criteria for evaluating risk prediction models.

Author information

  • 1Biostatistics Branch, National Cancer Institute, 6120 Executive Boulevard, Bethesda, Maryland 20892, USA. pfeiffer@mail.nih.gov

Abstract

We propose and study two criteria to assess the usefulness of models that predict risk of disease incidence for screening and prevention, or the usefulness of prognostic models for management following disease diagnosis. The first criterion, the proportion of cases followed PCF (q), is the proportion of individuals who will develop disease who are included in the proportion q of individuals in the population at highest risk. The second criterion is the proportion needed to follow-up, PNF (p), namely the proportion of the general population at highest risk that one needs to follow in order that a proportion p of those destined to become cases will be followed. PCF (q) assesses the effectiveness of a program that follows 100q% of the population at highest risk. PNF (p) assess the feasibility of covering 100p% of cases by indicating how much of the population at highest risk must be followed. We show the relationship of those two criteria to the Lorenz curve and its inverse, and present distribution theory for estimates of PCF and PNF. We develop new methods, based on influence functions, for inference for a single risk model, and also for comparing the PCFs and PNFs of two risk models, both of which were evaluated in the same validation data.

© 2010, The International Biometric Society No claim to original US Federal works.

PMID:
21155746
[PubMed - indexed for MEDLINE]
PMCID:
PMC3135785
Free PMC Article

Images from this publication.See all images (1)Free text

Figure 1
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Blackwell Publishing Icon for PubMed Central
    Loading ...
    Write to the Help Desk