Send to

Choose Destination
Med Phys. 2018 May;45(5):2089-2096. doi: 10.1002/mp.12835. Epub 2018 Mar 23.

Quality assurance tool for organ at risk delineation in radiation therapy using a parametric statistical approach.

Author information

Department of Radiation Oncology, University of Virginia School of Medicine, Charlottesville, VA, USA.
Department of Radiation Oncology, Mayo Clinic, Jacksonville, FL, USA.



To develop a quality assurance (QA) tool that identifies inaccurate organ at risk (OAR) delineations.


The QA tool computed volumetric features from prior OAR delineation data from 73 thoracic patients to construct a reference database. All volumetric features of the OAR delineation are computed in three-dimensional space. Volumetric features of a new OAR are compared with respect to those in the reference database to discern delineation outliers. A multicriteria outlier detection system warns users of specific delineation outliers based on combinations of deviant features. Fifteen independent experimental sets including automatic, propagated, and clinically approved manual delineation sets were used for verification. The verification OARs included manipulations to mimic common errors. Three experts reviewed the experimental sets to identify and classify errors, first without; and then 1 week after with the QA tool.


In the cohort of manual delineations with manual manipulations, the QA tool detected 94% of the mimicked errors. Overall, it detected 37% of the minor and 85% of the major errors. The QA tool improved reviewer error detection sensitivity from 61% to 68% for minor errors (P = 0.17), and from 78% to 87% for major errors (P = 0.02).


The QA tool assists users to detect potential delineation errors. QA tool integration into clinical procedures may reduce the frequency of inaccurate OAR delineation, and potentially improve safety and quality of radiation treatment planning.


OAR ; delineation; normal tissue; quality assurance; segmentation

[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Wiley
Loading ...
Support Center