Format

Send to

Choose Destination
BMC Psychiatry. 2016 Jul 26;16:263. doi: 10.1186/s12888-016-0963-x.

Can mental health diagnoses in administrative data be used for research? A systematic review of the accuracy of routinely collected diagnoses.

Author information

1
Department of Psychological Medicine, Institute of Psychiatry Psychology and Neuroscience, Kings College London, London, UK.
2
South London and Maudsley NHS Foundation Trust, Maudsley Hospital, Denmark Hill, London, SE5 8AZ, UK.
3
Department of Psychological Medicine, Institute of Psychiatry Psychology and Neuroscience, Kings College London, London, UK. matthew.hotopf@kcl.ac.uk.
4
Department of Psychological Medicine and SLaM/IoPPN BRC, Kings College London, PO62, Weston Education Centre, Cutcombe Road, London, SE5 9RJ, UK. matthew.hotopf@kcl.ac.uk.

Abstract

BACKGROUND:

There is increasing availability of data derived from diagnoses made routinely in mental health care, and interest in using these for research. Such data will be subject to both diagnostic (clinical) error and administrative error, and so it is necessary to evaluate its accuracy against a reference-standard. Our aim was to review studies where this had been done to guide the use of other available data.

METHODS:

We searched PubMed and EMBASE for studies comparing routinely collected mental health diagnosis data to a reference standard. We produced diagnostic category-specific positive predictive values (PPV) and Cohen's kappa for each study.

RESULTS:

We found 39 eligible studies. Studies were heterogeneous in design, with a wide range of outcomes. Administrative error was small compared to diagnostic error. PPV was related to base rate of the respective condition, with overall median of 76 %. Kappa results on average showed a moderate agreement between source data and reference standard for most diagnostic categories (median kappa = 0.45-0.55); anxiety disorders and schizoaffective disorder showed poorer agreement. There was no significant benefit in accuracy for diagnoses made in inpatients.

CONCLUSIONS:

The current evidence partly answered our questions. There was wide variation in the quality of source data, with a risk of publication bias. For some diagnoses, especially psychotic categories, administrative data were generally predictive of true diagnosis. For others, such as anxiety disorders, the data were less satisfactory. We discuss the implications of our findings, and the need for researchers to validate routine diagnostic data.

KEYWORDS:

Administrative data; Case registers; Diagnosis; Electronic health records; Hospital episode statistics; Population research; Psychiatry

PMID:
27455845
PMCID:
PMC4960739
DOI:
10.1186/s12888-016-0963-x
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for BioMed Central Icon for PubMed Central
Loading ...
Support Center