Format

Send to:

Choose Destination
See comment in PubMed Commons below
BMC Med Res Methodol. 2010 Apr 25;10:34. doi: 10.1186/1471-2288-10-34.

Missing the forest (plot) for the trees? A critique of the systematic review in tobacco control.

Author information

  • 1Dept. of Health Promotion, School of Public Health, Sackler Faculty of Medicine, Tel Aviv University, POB 39040, Ramat Aviv 69978, Israel. rosenl@post.tau.ac.il

Abstract

BACKGROUND:

The systematic review (SR) lies at the core of evidence-based medicine. While it may appear that the SR provides a reliable summary of existing evidence, standards of SR conduct differ. The objective of this research was to examine systematic review (SR) methods used by the Cochrane Collaboration ("Cochrane") and the Task Force on Community Preventive Services ("the Guide") for evaluation of effectiveness of tobacco control interventions.

METHODS:

We searched for all reviews of tobacco control interventions published by Cochrane (4th quarter 2008) and the Guide. We recorded design rigor of included studies, data synthesis method, and setting.

RESULTS:

About a third of the Cochrane reviews and two thirds of the Guide reviews of interventions in the community setting included uncontrolled trials. Most (74%) Cochrane reviews in the clinical setting, but few (15%) in the community setting, provided pooled estimates from RCTs. Cochrane often presented the community results narratively. The Guide did not use inferential statistical approaches to assessment of effectiveness.

CONCLUSIONS:

Policy makers should be aware that SR methods differ, even among leading producers of SRs and among settings studied. The traditional SR approach of using pooled estimates from RCTs is employed frequently for clinical but infrequently for community-based interventions. The common lack of effect size estimates and formal tests of significance limit the contribution of some reviews to evidence-based decision making. Careful exploration of data by subgroup, and appropriate use of random effects models, may assist researchers in overcoming obstacles to pooling data.

PMID:
20416114
[PubMed - indexed for MEDLINE]
PMCID:
PMC2873512
Free PMC Article
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for BioMed Central Icon for PubMed Central
    Loading ...
    Write to the Help Desk