Format

Send to

Choose Destination
See comment in PubMed Commons below
J Speech Lang Hear Res. 2011 Jun;54(3):803-12. doi: 10.1044/1092-4388(2010/10-0083). Epub 2010 Nov 16.

Comparing two methods for reducing variability in voice quality measurements.

Author information

1
University of California, Los Angeles, USA. jkreiman@ucla.edu

Abstract

PURPOSE:

Interrater disagreements in ratings of quality plague the study of voice. This study compared 2 methods for handling this variability.

METHOD:

Listeners provided multiple breathiness ratings for 2 sets of pathological voices, one including 20 male and 20 female voices unselected for quality and one including 20 breathy female voices. Ratings for each listener were averaged together, mean ratings were z transformed, and the likelihood that 2 listeners would agree exactly in their ratings was calculated as a function of averaging and standardizing condition. Data were also multidimensionally scaled to examine similarities among listeners in perceptual strategy. Results were compared with parallel analyses of existing breathiness ratings of the same voices gathered using a method-of-adjustment task.

RESULTS:

Three-way interactions between the mean rating for a voice, standardization condition, and the number of voices averaged together were observed, but no main effect of averaging condition emerged. Multidimensional scaling revealed significant residual differences in perceptual strategy across listeners after averaging and standardizing. Ratings from the method-of-adjustment task showed both high agreement levels and consistent perceptual strategies across listeners, as theoretically predicted.

CONCLUSION:

Averaging multiple ratings and standardizing the mean are inadequate in addressing variations in voice quality perception.

PMID:
21081673
PMCID:
PMC3107357
DOI:
10.1044/1092-4388(2010/10-0083)
[Indexed for MEDLINE]
Free PMC Article
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Silverchair Information Systems Icon for PubMed Central
    Loading ...
    Support Center