Answers are grounded in this paper and cite their sources.
SUMMARY Repeatability estimates applied to panel selection enable the experimenter to predict the proportion of judges whose sensitivity can satisfy established specifications. Repeatability estimates of different test designs indicated paired comparison to be more sensitive than the 3‐sample binomial design. Studies on sessions of extended length indicate that protracted testing may provide a more reliable basis of panel selection than short‐period testing does.
No takes yet. Share an insight, caveat, or question.
Sawyer et al. (1962) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: