Practical p-value adjustment for optimally selected cutpoints

Stat Med. 1996 Jan 15;15(1):103-12. doi: 10.1002/(SICI)1097-0258(19960115)15:1<103::AID-SIM156>3.0.CO;2-Y.

Abstract

This paper concerns a series of simulations undertaken to examine the effects of two data features--number of cutpoints and true marker prognostic effect size--on three methods of p-value adjustment (asymptotic, P(acor); improved Bonferroni, P(bon); and empirical permutation, P(emp)). H(o) rejection rates for P(emp) and P(bon) are almost indistinguishable from those for an independent validation sample (P(vld)), while those of P(acor) are somewhat conservative, especially when the number of cutpoints is small. Analysis of a new breast cancer prognostic marker, heat shock protein 70, illustrates the methods. These results underscore many of the problems associated with data-derived cutpoints in general, and the need for p-value adjustment.

Publication types

  • Research Support, U.S. Gov't, P.H.S.

MeSH terms

  • Bias
  • Biomarkers*
  • Breast Neoplasms / blood
  • Breast Neoplasms / mortality
  • Data Interpretation, Statistical*
  • Effect Modifier, Epidemiologic
  • Female
  • HSP70 Heat-Shock Proteins / blood
  • Humans
  • Prognosis
  • Proportional Hazards Models
  • Reproducibility of Results
  • Survival Analysis*

Substances

  • Biomarkers
  • HSP70 Heat-Shock Proteins