Display Settings:

Format

Send to:

Choose Destination
See comment in PubMed Commons below
Stat Med. 2011 Jan 15;30(1):11-21. doi: 10.1002/sim.4085. Epub 2010 Nov 5.

Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers.

Author information

  • 1Department of Biostatistics, Boston University, 801 Massachusetts Ave, Boston, MA 02118, USA. mpencina@bu.edu

Abstract

Appropriate quantification of added usefulness offered by new markers included in risk prediction algorithms is a problem of active research and debate. Standard methods, including statistical significance and c statistic are useful but not sufficient. Net reclassification improvement (NRI) offers a simple intuitive way of quantifying improvement offered by new markers and has been gaining popularity among researchers. However, several aspects of the NRI have not been studied in sufficient detail. In this paper we propose a prospective formulation for the NRI which offers immediate application to survival and competing risk data as well as allows for easy weighting with observed or perceived costs. We address the issue of the number and choice of categories and their impact on NRI. We contrast category-based NRI with one which is category-free and conclude that NRIs cannot be compared across studies unless they are defined in the same manner. We discuss the impact of differing event rates when models are applied to different samples or definitions of events and durations of follow-up vary between studies. We also show how NRI can be applied to case-control data. The concepts presented in the paper are illustrated in a Framingham Heart Study example. In conclusion, NRI can be readily calculated for survival, competing risk, and case-control data, is more objective and comparable across studies using the category-free version, and can include relative costs for classifications. We recommend that researchers clearly define and justify the choices they make when choosing NRI for their application.

Copyright © 2010 John Wiley & Sons, Ltd.

Comment in

PMID:
21204120
[PubMed - indexed for MEDLINE]
PMCID:
PMC3341973
Free PMC Article

Images from this publication.See all images (1)Free text

PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for John Wiley & Sons, Inc. Icon for PubMed Central
    Loading ...
    Write to the Help Desk