SIGMOD 2008 was the first database conference that offered to test submitters' programs against their data to verify the repeatability of the experiments published [1]. Given the positive feedback concerning the SIGMOD 2008 repeatability initiative, SIGMOD 2009 modified and expanded the initiative with a workability assessment.
No takes yet. Share an insight, caveat, or question.
Manegold et al. (2010) studied this question.
Synapse has enriched one closely related paper. Consider it for comparative context: