Format

Send to

Choose Destination
J Clin Epidemiol. 2012 Jun;65(6):602-9. doi: 10.1016/j.jclinepi.2011.10.016. Epub 2012 Mar 16.

Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols.

Author information

1
Division and Center for Evidence-Based Medicine and Outcomes Research, Department of Internal Medicine, Clinical and Translational Science Institute, Morsani College of Medicine, University of South Florida, Tampa, FL 33612, USA.

Abstract

OBJECTIVES:

To assess whether the reported methodological quality of randomized controlled trials (RCTs) reflects the actual methodological quality and to evaluate the association of effect size (ES) and sample size with methodological quality.

STUDY DESIGN AND SETTING:

Systematic review. This is a retrospective analysis of all consecutive phase III RCTs published by eight National Cancer Institute Cooperative Groups up to 2006. Data were extracted from protocols (actual quality) and publications (reported quality) for each study.

RESULTS:

Four hundred twenty-nine RCTs met the inclusion criteria. Overall reporting of methodological quality was poor and did not reflect the actual high methodological quality of RCTs. The results showed no association between sample size and actual methodological quality of a trial. Poor reporting of allocation concealment and blinding exaggerated the ES by 6% (ratio of hazard ratio [RHR]: 0.94; 95% confidence interval [CI]: 0.88, 0.99) and 24% (RHR: 1.24; 95% CI: 1.05, 1.43), respectively. However, actual quality assessment showed no association between ES and methodological quality.

CONCLUSION:

The largest study to date shows that poor quality of reporting does not reflect the actual high methodological quality. Assessment of the impact of quality on the ES based on reported quality can produce misleading results.

PMID:
22424985
PMCID:
PMC3637913
DOI:
10.1016/j.jclinepi.2011.10.016
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Elsevier Science Icon for PubMed Central
Loading ...
Support Center