This is the authors' abstract. We don't add key points for this paper.
Motivation and Objective of the IS Replication ProjectHaving confidence that findings reported in a peer-reviewed study published in a reputable journal is generalizable to some current or future context is critical for scientific progress (Open Science Collaboration 2015).If empirical results are not reproducible, how can we have confidence in the ability of our theories to explain and predict behavior?Research has shown that about one third or more of research published in leading psychology and science journals is not reproducible (Camerer et al. 2016;Camerer et al. 2018; Open Science Collaboration 2015).This has led to arguments that there is a replication crisis in Psychology (for discussions of this, see Camerer et al. 2018;Pashler and Wagenmakers 2012;Stroebe and Strack al. 2014). 1 Do we have a replication crisis in the Information Systems (IS) discipline?In 2014, Alan Dennis and Joe Valacich launched AIS Transactions on Replication Research (TRR) with a goal of having a dedicated outlet for replication research, thereby promoting replication in the IS discipline (Dennis and Valacich 2014).In October 2018, MIS Quarterly (MISQ) and TRR came together to launch the IS Replication Project, with the goal of replicating 25 articles published in MISQ and other top IS journals to understand the extent to which IS research is reproducible.We posted a call for participation on AIS World and invited all interested researchers to submit proposals for a replication study.We received 31 proposals, which ultimately turned into 21 papers published or accepted for publication in TRR by July 1, 2020.In this editorial, we present the profile of the replication studies, analysis, and results comparing the replications to the original studies, and recommendations for replication research. Profile of Studies in the IS Replication ProjectThe 21 replications represent 59 different authors from 29 different universities in the United States, Germany, China, Brazil, and Austria.Fourteen of the studies replicated work from MISQ, three from Information Systems Research, and one each from Journal of MIS, Journal of the AIS, Communications of the ACM, and Computers & Security.The majority of the original studies were surveys (16), although there were also four experiments and one Web scraping paper replicated.The methods used in the replications were consistent with the original study, with only one of the studies employing a minor adjustment (i.e., from field survey to online survey).( See Table 1.) 1 Some of this is due to researcher fraud but the vast majority of cases are not (Stroebe and Strack 2014).
Answers are grounded in this paper and cite their sources.
No takes yet. Share an insight, caveat, or question.
Dennis et al. (2020) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: