Format

Send to

Choose Destination
PLoS One. 2009;4(3):e4922. doi: 10.1371/journal.pone.0004922. Epub 2009 Mar 17.

Factors influencing the statistical power of complex data analysis protocols for molecular signature development from microarray data.

Author information

1
Center of Health Informatics and Bioinformatics, New York University, New York, New York, United States of America. constantin.aliferis@nyumc.org

Abstract

BACKGROUND:

Critical to the development of molecular signatures from microarray and other high-throughput data is testing the statistical significance of the produced signature in order to ensure its statistical reproducibility. While current best practices emphasize sufficiently powered univariate tests of differential expression, little is known about the factors that affect the statistical power of complex multivariate analysis protocols for high-dimensional molecular signature development.

METHODOLOGY/PRINCIPAL FINDINGS:

We show that choices of specific components of the analysis (i.e., error metric, classifier, error estimator and event balancing) have large and compounding effects on statistical power. The effects are demonstrated empirically by an analysis of 7 of the largest microarray cancer outcome prediction datasets and supplementary simulations, and by contrasting them to prior analyses of the same data.

CONCLUSIONS/SIGNIFICANCE:

THE FINDINGS OF THE PRESENT STUDY HAVE TWO IMPORTANT PRACTICAL IMPLICATIONS: First, high-throughput studies by avoiding under-powered data analysis protocols, can achieve substantial economies in sample required to demonstrate statistical significance of predictive signal. Factors that affect power are identified and studied. Much less sample than previously thought may be sufficient for exploratory studies as long as these factors are taken into consideration when designing and executing the analysis. Second, previous highly-cited claims that microarray assays may not be able to predict disease outcomes better than chance are shown by our experiments to be due to under-powered data analysis combined with inappropriate statistical tests.

PMID:
19290050
PMCID:
PMC2654113
DOI:
10.1371/journal.pone.0004922
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Public Library of Science Icon for PubMed Central
Loading ...
Support Center