Format

Send to

Choose Destination
Ann Epidemiol. 2012 May;22(5):364-8. doi: 10.1016/j.annepidem.2012.02.007. Epub 2012 Mar 3.

Nonsignificance plus high power does not imply support for the null over the alternative.

Author information

1
Department of Epidemiology, University of California, Los Angeles, USA. lesdomes@ucla.edu

Abstract

This article summarizes arguments against the use of power to analyze data, and illustrates a key pitfall: Lack of statistical significance (e.g., p > .05) combined with high power (e.g., 90%) can occur even if the data support the alternative more than the null. This problem arises via selective choice of parameters at which power is calculated, but can also arise if one computes power at a prespecified alternative. As noted by earlier authors, power computed using sample estimates ("observed power") replaces this problem with even more counterintuitive behavior, because observed power effectively double counts the data and increases as the P value declines. Use of power to analyze and interpret data thus needs more extensive discouragement.

PMID:
22391267
DOI:
10.1016/j.annepidem.2012.02.007
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center