PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 23, 2026Journal of Management2 citations

Controlling the Control Condition: A Critical Methodological Review of Control Conditions in Experimental Management Research

View Full Paper
JSJohannes StarkCTChristian TrösterNQNiels Van Quaquebeke

Key Points

  • This review aims to evaluate the selection and design of control conditions in experimental management research.
  • Reviewed 958 experiments from 421 study papers published from 2021 to 2023.
  • Categorized control conditions into true and pseudo types.
  • Analyzed biases in causal claims related to study designs.
  • 20% of studies presented unsupported causal claims due to design issues.
  • Lack of method transparency and construct validity was prevalent.
  • Guidelines were proposed for researchers and reviewers to improve control condition designs.

Abstract

Control conditions are essential to establishing causal relationships in experimental management research, yet they receive little attention compared to treatments. This study thus examines the current state of control-condition selection and design in top-tier management journals, reviewing 958 experiments from 421 study papers published from 2021 to 2023. Our review shows that researchers use true and pseudo-control conditions. True control conditions—such as no-treatment, all-but-treatment, and treatment-as-usual controls—provide a baseline for interpreting the effect of the treatment condition. In contrast, pseudo-control conditions (e.g., opposite-treatment-level or alternative-treatment designs) allow relative comparisons across conditions without providing a baseline. Notably, 20% of the studies we examined presented causal claims that were not supported by their designs, opening the risk of their results being misinterpreted and their effect sizes being exaggerated. These issues were further exacerbated by a lack of method transparency and construct validity. In response, we offer guidelines not only for primary study researchers to support the selection and design of control conditions, thereby enhancing transparency and yielding valid interpretations of causal claims, but also for research synthesists, reviewers, and editors to evaluate the same.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Stark et al. (2026) studied this question.

synapsesocial.com/papers/69c08bb5a48f6b84677f94cehttps://doi.org/10.1177/01492063261424849
Ask AI
Helpful
Bookmark
Share
View Full Paper