Display Settings:

Format

Send to:

Choose Destination
See comment in PubMed Commons below
Behav Res Methods. 2006 Feb;38(1):24-7.

SNOOP:a program for demonstrating the consequences of premature and repeated null hypothesis testing.

Author information

  • Department of Psychology, Box 1125, One Brookings Drive, Washington University, St. Louis, MO 63130, USA. mjstrube@wustl.edu

Abstract

The ease with which data can be collected and analyzed via personal computer makes it potentially attractive to "peek" at the data before a target sample size is achieved. This tactic might seem appealing because data collection could be stopped early, which would save valuable resources, if a peek revealed a significant effect. Unfortunately, such data snooping comes with a cost. When the null hypothesis is true, the Type I error rate is inflated, sometimes quite substantially. If the null hypothesis is false, premature significance testing leads to inflated estimates of power and effect size. This program provides simulation results for a wide variety of premature and repeated null hypothesis testing scenarios. It gives researchers the ability to know in advance the consequences of data peeking so that appropriate corrective action can be taken.

PMID:
16817510
[PubMed - indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Loading ...
    Write to the Help Desk