Answers are grounded in this paper and cite their sources.
Meta-analysis investigates mechanisms explaining effect size differences in researcher and independently developed outcomes.
Differences in effect sizes between researcher-developed (RD) and independently developed (ID) outcome measures are widely documented but poorly understood in education research. We conduct a meta-analysis using item-level outcome data to test potential mechanisms that explain differences in effects by RD or ID outcome type. Our analysis of 54 effect sizes from 32 studies shows that greater standard deviations of item-specific treatment effects predict larger effect sizes and reduce the observed difference between RD and ID measures from 0.14 SDs to 0.12 SDs, leaving the remainder attributable to other factors. The findings advance our understanding of how item properties predict educational intervention outcomes and underscore the importance of considering item-level data for building theory in education research.
No takes yet. Share an insight, caveat, or question.
Gilbert et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: