Format

Send to

Choose Destination
Stat Methods Med Res. 2019 Sep;28(9):2768-2786. doi: 10.1177/0962280218785504. Epub 2018 Jul 23.

A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes.

Author information

1
1 Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.
2
2 Cochrane Netherlands, University Medical Center Utrecht, Utrecht, The Netherlands.
3
3 Research Institute for Primary Care and Health Sciences, Keele University, Staffordshire, UK.
4
4 Centre for Statistics in Medicine, University of Oxford, Oxford, UK.

Abstract

It is widely recommended that any developed-diagnostic or prognostic-prediction model is externally validated in terms of its predictive performance measured by calibration and discrimination. When multiple validations have been performed, a systematic review followed by a formal meta-analysis helps to summarize overall performance across multiple settings, and reveals under which circumstances the model performs suboptimal (alternative poorer) and may need adjustment. We discuss how to undertake meta-analysis of the performance of prediction models with either a binary or a time-to-event outcome. We address how to deal with incomplete availability of study-specific results (performance estimates and their precision), and how to produce summary estimates of the c-statistic, the observed:expected ratio and the calibration slope. Furthermore, we discuss the implementation of frequentist and Bayesian meta-analysis methods, and propose novel empirically-based prior distributions to improve estimation of between-study heterogeneity in small samples. Finally, we illustrate all methods using two examples: meta-analysis of the predictive performance of EuroSCORE II and of the Framingham Risk Score. All examples and meta-analysis models have been implemented in our newly developed R package "metamisc".

KEYWORDS:

Meta-analysis; aggregate data; calibration; discrimination; evidence synthesis; prediction; prognosis; systematic review; validation

Supplemental Content

Full text links

Icon for Atypon Icon for PubMed Central
Loading ...
Support Center