To collect feedback in the early stages of research when researchers have to work with expert users, we propose a method based on the large language models and careful elaboration of personas. This method enables low-cost simulation of answers to interviews and provides inputs for decisions on preliminary research directions. To evaluate our method, we propose to simulate two existing studies in the aviation domain. These studies focus on concerns and expectations of airline pilots about future single pilot operations and higher level of automation in the cockpit. Our results show similar level of concerns to human participants in these two simulated studies. However, the results of the simulations include approximations, errors in the actual work of pilots and over-and underestimations of some potential problems of single pilot operations. We conclude that our method can help guide the preliminary stages of research if researchers have sufficient prior knowledge of the work domain and if this method is complemented by human-in-the-loop methods.
No takes yet. Share an insight, caveat, or question.
Bouzékri et al. (2024) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: