Likert Scaling Using Continuous, Censored, and Graded Response Models: Effects on Criterion-Related Validity

This study examined how three item response models performed when they were applied to data collected from a conventionally developed Likert-type personality scale. Each model examined isbased on a different response assumption: the multiple linear factor analysis model (continuous responses), the TOBIT factor analysis model (censored responses), and the multidimensional graded response model. The item and examinee parameters of the models were estimated using different discrepancy functions and current software implementations. Comparisons were made in terms of the goodness-of-fit of the model, parameter estimates, and criterion-related validity. Results showed that the models’ response assumptions were reasonably tenable and that the solutions obtained in all cases were similar. More complex models did not lead to substantial improvement in predictive validity.