Answers are grounded in this paper and cite their sources.
Calibration and scope choices determine what set-theoretic estimands represent, yet applied studies often treat them as neutral preprocessing. We benchmark the recovery and false-detection behaviour of Necessary Condition Analysis (NCA) and fuzzy-set Qualitative Comparative Analysis (fsQCA) using a public-service measurement framework motivated by five rural services in Vietnam. The evaluation uses 456,000 synthetic datasets from 456 scenarios with 1,000 replications each. Scenarios vary sample size, measurement error, condition correlation, cellwise missingness, outcome resolution, missingness mechanism and two data-generating processes: a two-condition gate and a substitutive non-gate. Across the 432-scenario missing-completely-at-random factorial, fsQCA calibrated with substantive 2/3/4 anchors recovered the programmed gate in 0.749 of replications and falsely detected the pair in 0.015 of non-gate replications. Raw-score NCA yielded rates of 0.673 and 0.087, respectively. NCA applied to 2/3/4 fuzzy memberships was conservative (0.049 recovery), whereas percentile-calibrated fsQCA was less specific (0.519 recovery; 0.162 false detection). In matched scenarios, increasing sample size improved semantic-anchor fsQCA recovery but reduced raw NCA recovery as observations filled the ceiling region. These results show that calibration anchors and NCA scope definitions are part of the estimand. Applied studies should preregister external anchors, report scope and algorithmic non-results, and test recovery against a plausible counterfactual data-generating process. The benchmark evaluates analytical workflows; it does not estimate how Vietnamese residents assess public services.
No takes yet. Share an insight, caveat, or question.
Vu et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: