Answers are grounded in this paper and cite their sources.
The evaluation of retrieval effectiveness has played and is playing a central role in Information Retrieval (IR). A specific issue is that there are literally dozens (most likely more than one hundred) IR effectiveness metrics, and counting.
No takes yet. Share an insight, caveat, or question.
Busin et al. (2013) studied this question.