Display Settings:

Format

Send to:

Choose Destination
J Biomed Inform. 2013 Feb;46(1):33-9. doi: 10.1016/j.jbi.2012.07.006. Epub 2012 Jul 27.

A human-computer collaborative approach to identifying common data elements in clinical trial eligibility criteria.

Author information

  • 1Department of Biomedical Informatics, Columbia University, New York, NY 10032, United States.

Abstract

OBJECTIVE:

To identify Common Data Elements (CDEs) in eligibility criteria of multiple clinical trials studying the same disease using a human-computer collaborative approach.

DESIGN:

A set of free-text eligibility criteria from clinical trials on two representative diseases, breast cancer and cardiovascular diseases, was sampled to identify disease-specific eligibility criteria CDEs. In this proposed approach, a semantic annotator is used to recognize Unified Medical Language Systems (UMLSs) terms within the eligibility criteria text. The Apriori algorithm is applied to mine frequent disease-specific UMLS terms, which are then filtered by a list of preferred UMLS semantic types, grouped by similarity based on the Dice coefficient, and, finally, manually reviewed.

MEASUREMENTS:

Standard precision, recall, and F-score of the CDEs recommended by the proposed approach were measured with respect to manually identified CDEs.

RESULTS:

Average precision and recall of the recommended CDEs for the two diseases were 0.823 and 0.797, respectively, leading to an average F-score of 0.810. In addition, the machine-powered CDEs covered 80% of the cardiovascular CDEs published by The American Heart Association and assigned by human experts.

CONCLUSION:

It is feasible and effort saving to use a human-computer collaborative approach to augment domain experts for identifying disease-specific CDEs from free-text clinical trial eligibility criteria.

Copyright © 2012 Elsevier Inc. All rights reserved.

PMID:
22846169
[PubMed - indexed for MEDLINE]
PMCID:
PMC3524400
Free PMC Article

Images from this publication.See all images (1)Free text

Figure 1
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Elsevier Science Icon for PubMed Central
    Loading ...
    Write to the Help Desk