Format

Send to

Choose Destination
See comment in PubMed Commons below
J Am Med Inform Assoc. 2012 Jun;19(e1):e137-44. Epub 2012 Apr 4.

A patient-driven adaptive prediction technique to improve personalized risk estimation for clinical decision support.

Author information

1
Division of Biomedical Informatics, University of California at San Diego, La Jolla, California 92093-0728, USA. xiaoqian@cs.cmu.edu

Abstract

OBJECTIVE:

Competing tools are available online to assess the risk of developing certain conditions of interest, such as cardiovascular disease. While predictive models have been developed and validated on data from cohort studies, little attention has been paid to ensure the reliability of such predictions for individuals, which is critical for care decisions. The goal was to develop a patient-driven adaptive prediction technique to improve personalized risk estimation for clinical decision support.

MATERIAL AND METHODS:

A data-driven approach was proposed that utilizes individualized confidence intervals (CIs) to select the most 'appropriate' model from a pool of candidates to assess the individual patient's clinical condition. The method does not require access to the training dataset. This approach was compared with other strategies: the BEST model (the ideal model, which can only be achieved by access to data or knowledge of which population is most similar to the individual), CROSS model, and RANDOM model selection.

RESULTS:

When evaluated on clinical datasets, the approach significantly outperformed the CROSS model selection strategy in terms of discrimination (p<1e-14) and calibration (p<0.006). The method outperformed the RANDOM model selection strategy in terms of discrimination (p<1e-12), but the improvement did not achieve significance for calibration (p=0.1375).

LIMITATIONS:

The CI may not always offer enough information to rank the reliability of predictions, and this evaluation was done using aggregation. If a particular individual is very different from those represented in a training set of existing models, the CI may be somewhat misleading.

CONCLUSION:

This approach has the potential to offer more reliable predictions than those offered by other heuristics for disease risk estimation of individual patients.

PMID:
22493049
PMCID:
PMC3392846
DOI:
10.1136/amiajnl-2011-000751
[Indexed for MEDLINE]
Free PMC Article
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Silverchair Information Systems Icon for PubMed Central
    Loading ...
    Support Center