Answers are grounded in this paper and cite their sources.
Researchers are increasingly asked this question: On what basis can one have confidence in the applicability of behavioral research findings? Two answers are typically offered. One is to draw confidence from establishing effects. Pre-registration and replication are often advocated as ways of increasing confidence in effects. Thus, the criterion for claiming confidence is reproducible effects. A second answer is to draw confidence in applicability by identifying moderators and mediators of effects. Moderator variables are typically used to distinguish the conditions when effects do or do not occur, and mediators contribute to identifying how effects occur in a given setting. Thus, the criterion for claiming confidence is the demonstration of contingent effects. A third answer entails drawing confidence by introducing additional theoretical constructs to account for variable relationships. Here the criterion for claiming confidence in applicability is explained effects. The three criteria for confidence are often considered alternative solutions in both methodological discussions and research practice. We apply the three criteria to studies of the endowment effect. We show that the first two criteria are inadequate for assessing research progress and that the explained effects criterion can build on the other two criteria to enhance confidence in research findings and applicability.
No takes yet. Share an insight, caveat, or question.
Gal et al. (2023) studied this question.