Bug-fix benchmarks are essential for evaluating methodologies in automatic program repair (APR) and fault localization (FL).However, existing benchmarks, exemplified by Defects4J, need to evolve to incorporate recent bug-fixes aligned with contemporary development practices.Moreover, reproducibility, a key scientific principle, has been lacking in bug-fix benchmarks.To address these gaps, we present GitBug-Java, a reproducible benchmark of recent Java bugs.GitBug-Java features 199 bugs extracted from the 2023 commit history of 55 notable open-source repositories.The methodology for building GitBug-Java ensures the preservation of bug-fixes in fully-reproducible environments.We publish GitBug-Java at https://github.com/gitbugactions/gitbug-java.
No takes yet. Share an insight, caveat, or question.
Silva et al. (2024) studied this question.
Synapse has enriched 4 closely related papers on similar clinical questions. Consider them for comparative context: