Analysis demonstrates methods for testing sign congruence in heterogeneous treatment effects, suggesting improved efficacy in hypothesis testing.
We test the null hypothesis that two parameters have the same sign, assuming that (asymptotically) normal estimators are available. Examples of this problem include the analysis of heterogeneous treatment effects, causal interpretation of reduced‐form estimands, meta‐studies, and mediation analysis. A number of tests were recently proposed. We recommend a test that is simple and rejects more often than many of these recent proposals. Like all other tests in the literature, it is conservative if the truth is near and therefore also biased. To clarify whether these features are avoidable, we also provide a test that is unbiased and has exact size control on the boundary of the null hypothesis, but which has counterintuitive properties and hence we do not recommend. We show how to improve ‐values in an existing paper from information contained in that paper's main text, and we revisit an empirical analysis of the effect of trade on voter behavior.
No takes yet. Share an insight, caveat, or question.
Miller et al. (2025) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: