A Monte Carlo study of the impact of missing data and differential item functioning on theta estimates from two polytomous Rasch family models

J Appl Meas. 2007;8(4):388-403.

Abstract

This paper examines the impact of differential item functioning (DIF), missing item values, and different methods for handling missing item values on theta estimates with data simulated from the partial credit model and Andrich's rating scale model. Both Rasch family models are commonly used when obtaining an estimate of a respondent's attitude. The degree of missing data, DIF magnitude, and the percentage of DIF items were varied in MCAR data conditions in which the focal group was 10% of the total population. Four methods for handling missing data were compared: complete-case analysis, mean substitution, hot-decking, and multiple imputation. Bias, RMSE, means, and standard errors of the theta estimates for the focal group were adversely affected by the amount and magnitude of DIF items. RMSE and fidelity coefficients for both the reference and focal group were adversely impacted by the amount of missing data. While all methods of handling missing data performed fairly similarly, multiple imputation and hot-decking showed slightly better performance.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Bias*
  • Data Interpretation, Statistical*
  • Humans
  • Models, Psychological*
  • Monte Carlo Method*
  • Psychometrics / methods
  • Psychometrics / statistics & numerical data
  • United States