Answers are grounded in this paper and cite their sources.
Researchers and software developers require effective performance evaluation. Researchers must evaluate optimizations or measure overhead. Software developers use automatic performance regression tests to discover when changes improve or degrade performance. The standard methodology is to compare execution times before and after applying changes.
No takes yet. Share an insight, caveat, or question.
Curtsinger et al. (2013) studied this question.