Send to

Choose Destination
EGEMS (Wash DC). 2016 Nov 30;4(1):1239. doi: 10.13063/2327-9214.1239. eCollection 2016.

Multisite Evaluation of a Data Quality Tool for Patient-Level Clinical Data Sets.

Author information

National Institute of Health; National Library of Medicine.
Janssen Research & Development.
Janssen Research & Development; Observational Health Data Sciences and Informatics.
Department of Biomedical Informatics, Columbia University.
Department of Biomedical Informatics, Ajou University.
Department of Biomedical Informatics, University of Pittsburgh.
Regenstrief Institute.
Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia.



Data quality and fitness for analysis are crucial if outputs of analyses of electronic health record data or administrative claims data should be trusted by the public and the research community.


We describe a data quality analysis tool (called Achilles Heel) developed by the Observational Health Data Sciences and Informatics Collaborative (OHDSI) and compare outputs from this tool as it was applied to 24 large healthcare datasets across seven different organizations.


We highlight 12 data quality rules that identified issues in at least 10 of the 24 datasets and provide a full set of 71 rules identified in at least one dataset. Achilles Heel is a freely available software that provides a useful starter set of data quality rules with the ability to add additional rules. We also present results of a structured email-based interview of all participating sites that collected qualitative comments about the value of Achilles Heel for data quality evaluation.


Our analysis represents the first comparison of outputs from a data quality tool that implements a fixed (but extensible) set of data quality rules. Thanks to a common data model, we were able to compare quickly multiple datasets originating from several countries in America, Europe and Asia.


Common Data Model; Data Use and Quality; Electronic Health Record (EHR); Informatics

Supplemental Content

Full text links

Icon for PubMed Central
Loading ...
Support Center