Monte Carlo simulation study reveals that standard recognition memory metrics inflate false discovery rates due to response bias, indicating da should serve as the default sensitivity measure.
In this article, we address the high prevalence of false discoveries in recognition memory research. Using Monte Carlo simulations, our goal was to find a valid measure of performance that reliably separates the contribution of sensitivity (accuracy) from that of bias . Relevant to myriad tasks, most notably old–new recognition memory, the simulations revealed that common measures confound sensitivity with bias, a finding termed the “measurement crisis.” As a solution, we propose a version of d-sub-a ( d a ). We ran comprehensive simulations to evaluate the validity of sensitivity measures, including P r = HR − FAR, A ′, d ′, and AUC g , in addition to d a . Memory “signals” were randomly sampled from lure and target distributions. Sensitivity measures generated from iso-sensitive conditions that differed in bias were compared using t -tests, across thousands of simulations. For bias-independent measures, the rate of significant results should be 5%. We manipulated several parameters, including the form of the distributions (i.e., from three prominent models of recognition–memory: unequal variance signal detection [UVSD], double-high threshold [2HT], dual-process signal detection [DPSD]), the distance between their means, their relative variance, the placement of response criteria, the sample size, and the number of simulated trials. Results demonstrated that under most experimental scenarios, only d a was unaffected by changes in bias. In contrast, all common measures typically exhibited alarmingly high false discovery rates, exceeding 5%. The rates rose to 100% with larger sample sizes and a large number of trials. These findings indicate that d a warrants serious consideration as the default measure of sensitivity.
No takes yet. Share an insight, caveat, or question.
Levi et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: