Format

Send to

Choose Destination
See comment in PubMed Commons below
J Clin Epidemiol. 2012 Sep;65(9):934-9. doi: 10.1016/j.jclinepi.2011.11.014. Epub 2012 Jun 27.

Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement.

Author information

1
University of Queensland, Herston Road, Herston, Brisbane, QLD 4006, Australia. damehoy@yahoo.com.au

Abstract

OBJECTIVE:

In the course of performing systematic reviews on the prevalence of low back and neck pain, we required a tool to assess the risk of study bias. Our objectives were to (1) modify an existing checklist and (2) test the final tool for interrater agreement.

STUDY DESIGN AND SETTING:

The final tool consists of 10 items addressing four domains of bias plus a summary risk of bias assessment. Two researchers tested the interrater agreement of the tool by independently assessing 54 randomly selected studies. Interrater agreement overall and for each individual item was assessed using the proportion of agreement and Kappa statistic.

RESULTS:

Raters found the tool easy to use, and there was high interrater agreement: overall agreement was 91% and the Kappa statistic was 0.82 (95% confidence interval: 0.76, 0.86). Agreement was almost perfect for the individual items on the tool and moderate for the summary assessment.

CONCLUSION:

We have addressed a research gap by modifying and testing a tool to assess risk of study bias. Further research may be useful for assessing the applicability of the tool across different conditions.

PMID:
22742910
DOI:
10.1016/j.jclinepi.2011.11.014
[Indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Elsevier Science
    Loading ...
    Support Center