Individual differences make a difference: On the use and the psychometric properties of difference scores in social psychology

Abstract Much social psychological research is concerned with the question whether and how behavior changes because of a “treatment” (e.g., a situation that triggers a psychological reaction). One easy way to investigate such changes would be to analyze intraindividual differences before (Time 1) and after the treatment (Time 2). Interestingly, many scholars refrain from using difference scores because they think they are inherently unreliable. However, the bad reputation of difference scores is, in many cases, unwarranted: difference scores can be sufficiently reliable when standard deviations differ between measurement occasions, and standard deviations are likely to differ between measurement occasions because of differential treatment effects (i.e., interindividual differences in responsiveness to a treatment) and/or “strong situation” treatments. In the present article, we will (1) summarize classic and current arguments regarding the reliability of difference scores, (2) discuss the use of residual change scores as an alternative to difference scores, and (3) argue that latent difference score models are a particularly useful tool that social psychologists should consider using more frequently. Copyright © 2014 John Wiley & Sons, Ltd.