‘We're not going to start lifting stones now…’: Stakeholder perspectives on the role of psychometric methods in outcome measurement

Abstract Objectives Psychological outcome measures guide research and clinical decision‐making, yet many widely used tools were developed with limited psychometric rigour. Although advanced methods (e.g., item response theory, structural equation modelling) are now widely available, their added value in applied research remains uncertain and applied researcher perspective regarding such are unexplored. We aimed to address this gap in knowledge by examining key stakeholder perspective. Method To explore how these methods are perceived, we conducted semi‐structured interviews with 21 stakeholders spanning psychometrics, clinical practice, applied research, statistics and academia. Data were analysed using reflexive thematic analysis. Results Analysis identified three overarching themes: (1) growing recognition that heterogeneity in latent traits challenges assumptions underlying many measures, (2) the enduring use of entrenched but psychometrically weak tools and (3) nuanced views on when advanced methods meaningfully influence research findings. Participants acknowledged gaps in psychometric literacy and emphasised the need for more training and collaboration with psychometricians. Conclusion These findings highlighted persistent limitations in measurement practice, clarify contexts where psychometric methods add genuine value, and point to opportunities for strengthening outcome measurement in psychology and psychiatry research.