Format

Send to

Choose Destination
BMJ. 2019 Nov 6;367:l5896. doi: 10.1136/bmj.l5896.

Effect of revealing authors' conflicts of interests in peer review: randomized controlled trial.

Author information

1
Harvard Business School, Harvard University, Boston, MA, USA ljohn@hbs.edu.
2
Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA].
3
Harvard Business School, Harvard University, Boston, MA, USA.
4
Emergency Medicine, University of California at San Francisco, San Francisco, CA, USA.

Abstract

OBJECTIVE:

To assess the effect of disclosing authors' conflict of interest declarations to peer reviewers at a medical journal.

DESIGN:

Randomized controlled trial.

SETTING:

Manuscript review process at the Annals of Emergency Medicine. PARTICIPANTS: Reviewers (n=838) who reviewed manuscripts submitted between 2 June 2014 and 23 January 2018 inclusive (n=1480 manuscripts).

INTERVENTION:

Reviewers were randomized to either receive (treatment) or not receive (control) authors' full International Committee of Medical Journal Editors format conflict of interest disclosures before reviewing manuscripts. Reviewers rated the manuscripts as usual on eight quality ratings and were then surveyed to obtain "counterfactual scores"-that is, the scores they believed they would have given had they been assigned to the opposite arm-as well as attitudes toward conflicts of interest.

MAIN OUTCOME MEASURE:

Overall quality score that reviewers assigned to the manuscript on submitting their review (1 to 5 scale). Secondary outcomes were scores the reviewers submitted for the seven more specific quality ratings and counterfactual scores elicited in the follow-up survey.

RESULTS:

Providing authors' conflict of interest disclosures did not affect reviewers' mean ratings of manuscript quality (Mcontrol=2.70 (SD 1.11) out of 5; Mtreatment=2.74 (1.13) out of 5; mean difference 0.04, 95% confidence interval -0.05 to 0.14), even for manuscripts with disclosed conflicts (Mcontrol= 2.85 (1.12) out of 5; Mtreatment=2.96 (1.16) out of 5; mean difference 0.11, -0.05 to 0.26). Similarly, no effect of the treatment was seen on any of the other seven quality ratings that the reviewers assigned. Reviewers acknowledged conflicts of interest as an important matter and believed that they could correct for them when they were disclosed. However, their counterfactual scores did not differ from actual scores (Mactual=2.69; Mcounterfactual=2.67; difference in means 0.02, 0.01 to 0.02). When conflicts were reported, a comparison of different source types (for example, government, for-profit corporation) found no difference in effect.

CONCLUSIONS:

Current ethical standards require disclosure of conflicts of interest for all scientific reports. As currently implemented, this practice had no effect on any quality ratings of real manuscripts being evaluated for publication by real peer reviewers.

PMID:
31694810
DOI:
10.1136/bmj.l5896
[Indexed for MEDLINE]
Free full text

Conflict of interest statement

Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organization for the submitted work; no financial relationships with any organizations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

Supplemental Content

Full text links

Icon for HighWire
Loading ...
Support Center