Systematic analysis reveals effective comparison metrics for fuzz-testing tools, suggesting improved evaluations.
A systematic analysis of methods for evaluating the effectiveness of fuzzers is conducted. A minimal but complete set of metrics is identified: branch coverage, number of unique crashes, and time to first crash. A normalized integral indicator is proposed that allows post hoc comparison of the results of different tools without reruns.
No takes yet. Share an insight, caveat, or question.
Ognev et al. (2025) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: