Format

Send to

Choose Destination
Psychol Sci. 2015 May;26(5):559-69. doi: 10.1177/0956797614567341. Epub 2015 Mar 23.

Small telescopes: detectability and the evaluation of replication results.

Author information

1
The Wharton School, University of Pennsylvania uws@wharton.upenn.edu.

Abstract

This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, assessing the extent to which the replication results are consistent with an effect size big enough to have been detectable in the original study. The approach is demonstrated by examining replications of three well-known findings. Its benefits include the following: (a) differentiating "unsuccessful" replication attempts (i.e., studies yielding p > .05) that are too noisy from those that actively indicate the effect is undetectably different from zero, (b) "protecting" true findings from underpowered replications, and (c) arriving at intuitively compelling inferences in general and for the revisited replications in particular.

KEYWORDS:

hypothesis testing; open materials; replication; statistical power

PMID:
25800521
DOI:
10.1177/0956797614567341
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Atypon
Loading ...
Support Center