Format

Send to

Choose Destination
J Gen Intern Med. 2019 Mar 18. doi: 10.1007/s11606-019-04925-8. [Epub ahead of print]

Real-world Performance of Meta-analysis Methods for Double-Zero-Event Studies with Dichotomous Outcomes Using the Cochrane Database of Systematic Reviews.

Author information

1
Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN, USA.
2
Department of Statistics, Florida State University, Tallahassee, FL, USA.
3
School of Statistics, University of Minnesota, Minneapolis, MN, USA.
4
Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN, USA. chux0051@umn.edu.

Abstract

BACKGROUND:

Meta-analysis combines multiple independent studies, which can increase power and provide better estimates. However, it is unclear how best to deal with studies with zero events; such studies are also known as double-zero-event studies (DZS). Several statistical methods have been proposed, but the agreement among different approaches has not been systematically assessed using real-world published systematic reviews.

METHODS:

The agreement of five commonly used methods (i.e., the inverse-variance, Mantel-Haenszel, Peto, Bayesian, and exact methods) was assessed using the Cohen's κ coefficients using 368 meta-analyses with rare events selected from the Cochrane Database of Systematic Reviews. Three continuity corrections, including the correction of a constant 0.5, the treatment arm continuity correction (TACC), and the empirical (EMP) correction, were used to handle DZS when applying inverse-variance and Mantel-Haenszel methods.

RESULTS:

When the proportion of DZS studies was lower than 50% in a meta-analysis, different methods had moderately high agreement. However, when this proportion was increased to be over 50%, the agreement among the methods decreased to different extents. For the Bayesian, exact, and Peto methods and the inverse-variance and Mantel-Haenszel methods using the EMP correction, their agreement coefficients with the inverse-variance and Mantel-Haenszel methods using a constant 0.5 and TACC decreased from larger than 0.70 to smaller than 0.30. In contrast, the agreement coefficients only decreased slightly among the Bayesian, exact, and Peto methods and the inverse-variance and Mantel-Haenszel methods using the EMP correction.

CONCLUSIONS:

To utilize all available information and reduce research waste and avoid overestimating the effect, meta-analysts should incorporate DZS, rather than simply removing them. The Peto and other conventional methods with continuity correction should be avoided when the proportion of DZS is extremely high. The exact and Bayesian methods are highly recommended, except when none of the included studies have an event in one or both treatment arms.

KEYWORDS:

Cochrane Database of Systematic Reviews; Cohen’s κ coefficient; double-zero-event studies; meta-analysis; rare event

PMID:
30887438
DOI:
10.1007/s11606-019-04925-8

Supplemental Content

Full text links

Icon for Springer
Loading ...
Support Center