This Method Note presents an integrative review of 117 Research on Evaluation (RoE) studies published in the American Journal of Evaluation (2014–2024). We combined thematic analysis with a structured quality appraisal using established critical appraisal tools. Findings show that RoE literature focused primarily on studies on evaluation activities and professional issues, with far fewer examining evaluation outcomes or contexts. Qualitative descriptive designs were most common, whereas experimental designs were rare. Overall methodological quality was moderate to high, but with recurring weaknesses, including limited theoretical grounding and reflexivity in qualitative studies, limited attention to confounding and sampling issues in quantitative studies, uneven quality between qualitative and quantitative strands in mixed-methods studies, and limited application of systematic review techniques. We discuss implications for improving RoE research, such as broadening study foci and adopting more rigorous design and reporting standards to strengthen the evidence base for evaluation practice.
Stephanos et al. (Sat,) studied this question.