The reproducibility of experimental results is a key characteristic of the scientific method. Despite that, in robotics and artificial intelligence (AI)—maybe for good reason—replicating experiments in many cases has, so far, been limited or outright lacking. Reporting practices and formats are a key issue if we want to have reproducible robotics and AI papers. After years of discussions in a long series of workshops, the time is ripe for addressing this issue. The first-ever special issue of a high level, reputable robotics publication claiming the reproducibility of the published results was in this magazine in September 2015. Reproducibility is now a priority for the IEEE, as shown by the fact that the organization recently decided to integrate the Code Ocean platform in the websites of several magazines and journals.
No takes yet. Share an insight, caveat, or question.
Fabio Bonsignorio (2017) studied this question.
Synapse has enriched 5 related papers. Consider them for comparative context: