Answers are grounded in this paper and cite their sources.
A recurring theme in the space of reproducibility and replicability is: who should verify completeness, robustness, and correctness of artifacts in support of computational reproducibility, beyond the regular to and fro in the scientific literature?I (Lars Vilhuber, the Column Editor of this Reinforcing Reproducibility and Replicability column) also happen to be in charge of reproducibility verifications at the journals of a disciplinary society, and journals and societies are often seen as key players in this space (see Kim Weeden's recent article on this in sociology).I am therefore always intrigued when reproducibility verification emerges organically within other institutions.In the present piece, Limor Peer describes here the history and current status of verification efforts at the Institution for Social and Policy Studies at Yale, the motivating vision and how it emerged, and what they currently do to support researchers in improving the reproducibility of their computational work.Of particular interest is the deep and exemplary university-wide support for this work.The corollary of such work, as Limor points out, are the new competencies that researchers, but also university research support specialists of all types, must develop, and continue developing.Limor
No takes yet. Share an insight, caveat, or question.
Limor Peer (2024) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: