Send to

Choose Destination
J Healthc Qual. 2013 Jul-Aug;35(4):16-24. doi: 10.1111/j.1945-1474.2011.195.x.

Automated quality measurement in Department of the Veterans Affairs discharge instructions for patients with congestive heart failure.

Author information

Department of Biomedical Informatics, University of Utah School of Medicine, UT, USA.


Quality measurement is an important issue for the United States Department of Veterans Affairs (VA). In this study, we piloted the use of an informatics tool, the Multithreaded Clinical Vocabulary Server (MCVS), which extracted automatically whether the VA Office of Quality and Performance measures of quality of care were met for the completion of discharge instructions for inpatients with congestive heart failure. We used a single document, the discharge instructions, from one section of the medical records for 152 patients and developed a reference standard using two independent reviewers to assess performance. When evaluated against the reference standard, MCVS achieved a sensitivity of 0.87, a specificity of 0.86, and a positive predictive value of 0.90. The automated process using the discharge instruction document worked effectively. The use of the MCVS tool for concept-based indexing resulted in mostly accurate data capture regarding quality measurement, but improvements are needed to further increase the accuracy of data extraction.


evaluation of health information technology; natural language processing (NLP); performance measurement

[Indexed for MEDLINE]

Supplemental Content

Loading ...
Support Center