Format

Send to

Choose Destination
Trials. 2014 Sep 17;15:364. doi: 10.1186/1745-6215-15-364.

Correcting for multiple-testing in multi-arm trials: is it necessary and is it done?

Author information

1
MRC Biostatistics Unit Hub for Trials Methodology Research, Institute of Public Health, Robinson Way, Cambridge CB2 0SR, UK. james.wason@mrc-bsu.cam.ac.uk.

Abstract

BACKGROUND:

Multi-arm trials enable the evaluation of multiple treatments within a single trial. They provide a way of substantially increasing the efficiency of the clinical development process. However, since multi-arm trials test multiple hypotheses, some regulators require that a statistical correction be made to control the chance of making a type-1 error (false-positive). Several conflicting viewpoints are expressed in the literature regarding the circumstances in which a multiple-testing correction should be used. In this article we discuss these conflicting viewpoints and review the frequency with which correction methods are currently used in practice.

METHODS:

We identified all multi-arm clinical trials published in 2012 by four major medical journals. Summary data on several aspects of the trial design were extracted, including whether the trial was exploratory or confirmatory, whether a multiple-testing correction was applied and, if one was used, what type it was.

RESULTS:

We found that almost half (49%) of published multi-arm trials report using a multiple-testing correction. The percentage that corrected was higher for trials in which the experimental arms included multiple doses or regimens of the same treatments (67%). The percentage that corrected was higher in exploratory than confirmatory trials, although this is explained by a greater proportion of exploratory trials testing multiple doses and regimens of the same treatment.

CONCLUSIONS:

A sizeable proportion of published multi-arm trials do not correct for multiple-testing. Clearer guidance about whether multiple-testing correction is needed for multi-arm trials that test separate treatments against a common control group is required.

PMID:
25230772
PMCID:
PMC4177585
DOI:
10.1186/1745-6215-15-364
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for BioMed Central Icon for PubMed Central
Loading ...
Support Center