Format

Send to

Choose Destination
J Clin Epidemiol. 2014 Dec;67(12):1320-6. doi: 10.1016/j.jclinepi.2014.07.002. Epub 2014 Sep 4.

Publication bias is underreported in systematic reviews published in high-impact-factor journals: metaepidemiologic study.

Author information

1
Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501 Japan. Electronic address: aonishi@med.kobe-u.ac.jp.
2
Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501 Japan.

Abstract

OBJECTIVES:

To examine how often a significant publication bias (PB) existed when the assessment of PB was not reported in systematic reviews.

STUDY DESIGN AND SETTING:

All systematic reviews with meta-analyses of interventions and risk/prognostic factors published in the general medical journals with the top 10 impact factors in 2011 and 2012 were included. The results regarding PB were extracted. When the assessment of PB was not reported, we examined the presence of PB using the Egger test and contour-enhanced funnel plot and the impact of unreported PB by regression-based method.

RESULTS:

Among all the identified 116 reviews, the assessment of PB was not reported in 36 reviews (31.0%), particularly in reviews without a comprehensive literature search. Of these 36 reviews, seven (19.4%) were found to have a significant PB. The original pooled results may have been overestimated by a median of 50.9% if corrected for PB. Among the 28 reviews with PB including both reviews that did or did not report the assessment of PB, seven reviews (25.0%) did not report the presence of PB.

CONCLUSION:

Significant PB was underreported in systematic reviews published in high-impact-factor journals (eg, 19.4% of those that did not report assessment of PB had significant PB). Readers of systematic reviews should not assume that PB does not exist when not reported whereas researchers should report the results of assessments for PB.

KEYWORDS:

Funnel plot symmetry; Impact factor; Meta-analysis; Publication bias; Small-study effects; Systematic review

PMID:
25194857
DOI:
10.1016/j.jclinepi.2014.07.002
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center