Send to

Choose Destination
Multivariate Behav Res. 2019 Jul-Aug;54(4):593-611. doi: 10.1080/00273171.2018.1563520. Epub 2019 Apr 19.

The Assessment and Impact of Careless Responding in Routine Outcome Monitoring within Mental Health Care.

Author information

a Research Institute of Child Development and Education , University of Amsterdam , Amsterdam , the Netherlands.
b Institute of Psychology, Leiden University , Leiden , the Netherlands.
c Tilburg School of Social and Behavioral Sciences , Tilburg University , Tilburg , the Netherlands.
d Department of Psychiatry , Leiden University Medical Centre , Leiden , the Netherlands.


Careless responding by mental health patients on self-report assessments is rarely investigated in routine care despite the potential for serious consequences such as faulty clinical decisions. We investigated validity indices most appropriate for detecting careless responding in routine outcome monitoring (ROM) in mental health-care. First, we reviewed indices proposed in previous research for their suitability in ROM. Next, we evaluated six selected indices using data of the Brief Symptom Inventory and the Mood and Anxiety Symptom Questionnaire from 3,483 outpatients. Simulations showed that for typical ROM scales the Lmax index, Mahalanobis distance, and inter-item standard deviation may be too strongly confounded with the latent trait value to compare careless responding across patients with different symptom severity. Application of two different classification methods to the validity indices did not converge in similar prevalence estimates of careless responding. Finally, results suggest that careless responding does not have a substantial biasing effect on scale-score statistics. We recommend the lzp person-fit index to screen for random careless responding in large ROM data sets. However, additional research should further investigate methods for detecting repetitive responding in typical ROM data and assess whether there are specific circumstances in which simpler validity statistics or direct screening methods perform similarly as the lzp index.


Careless responding; mental health care; person-fit indices; routine outcome monitoring; validity indices

[Indexed for MEDLINE]

Supplemental Content

Loading ...
Support Center