A consistent pattern emerges from the history of psychology: Technological advances change the way that we understand ourselves. We argue that, in addition to various uses that are already common (e.g., qualitative coding), large language models can be integrated into survey software and act as a virtual research assistant that can generate tailored stimuli on the fly. This creates unprecedented flexibility in developing materials for psychological theory testing. We present an illustrative case study to show how a major lingering debate in the field—that is, whether people really change their mind according to evidence or, instead, rely on motivated reasoning—was pushed forward by using artificial intelligence (AI) to administer personalized experimental treatments. We discuss various potential uses of AI to test hypotheses in psychological science and argue that psychologists should seriously consider using AI to better understand human intelligence.
Pennycook et al. (Wed,) studied this question.