Answers are grounded in this paper and cite their sources.
A score that is significantly below the level of chance on a forced choice (FC) performance validity test results from the deliberate production of wrong answers. In order to increase the power of significance testing of a below chance result on standardized FC tests with empirically derived cutoff scores, we recommend using one-tailed tests of significance and selecting probability levels greater than .05 (.20 for most standardized FC tests with empirically derived cutoff scores). Under certain circumstances, we also recommend combining scores from different sections of the same FC test and combining scores across different FC tests. These recommendations require modifications when applied to non-standardized FC tests that lack empirically derived cutoff scores or to FC tests with a non-random topographical distribution of correct and incorrect answers.
No takes yet. Share an insight, caveat, or question.
Binder et al. (2014) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: