Answers are grounded in this paper and cite their sources.
Methodological analysis reveals poor alignment between factorial surveys and real-world hiring decisions among employers, suggesting caution when using hypothetical vignettes to predict behavior.
In Forster and Neugebauer (2024), we examine to what extent a factorial survey (FS) on invitations of fictitious applicants can replicate the findings of a nearly identical field experiment conducted with the same employers. In addition to exploring the conditions under which FSs provide valid behavioral predictions, we varied the topic sensitivity and tested whether behavioral predictions were more accurate after filtering out respondents who provided socially desirable answers or did not exert sufficient effort in responding to FS vignettes. Across these conditions, the FS results did not align well with the real-world benchmark. We conclude that researchers must exercise caution when using FSs to study (hiring) behavior. In this rejoinder, we respond to the critique of our study by Pickett (2025).
No takes yet. Share an insight, caveat, or question.
Förster et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: