Principles: when there should be no difference--how to fail to reject the null hypothesis

Trends Pharmacol Sci. 2006 May;27(5):274-8. doi: 10.1016/j.tips.2006.03.006. Epub 2006 Apr 3.

Abstract

It is common to perform experiments in which a 'success' is claimed when the null hypothesis is discarded. However, there is a category of experiment that has become important in which a success is when the null hypothesis is not rejected. Failing to discard the null hypothesis is different from proving it to be valid, a distinction that is particularly important in experiments in which any inadequacy of experimental design or implementation enhances the likelihood of a success. The appropriate analysis of such experiments tests for evidence of the validity of the null hypothesis rather than simply failing to find evidence against it.

Publication types

  • Review

MeSH terms

  • Confidence Intervals
  • Humans
  • Monte Carlo Method*
  • Pharmacology / methods
  • Pharmacology / trends*
  • Reproducibility of Results
  • Research Design