Answers are grounded in this paper and cite their sources.
The replication variance of individual stimulus evaluations and scale utilization across a panelist's stimulus profile are simultaneously employed to develop statistics for assessing performance of panelists. The approach provides opportunities for comparison of panelists to each other, determination of attributes for which panelist confusion is observed, isolation of stimuli presenting unstable properties, and engagement of influence weights (based on relative precision) in subsequent analyses of data. Although the methodology has been developed for applications involving sensory panelists, the statistical concepts may be extended to other data collection scenarios involving replicated determinations from bounded quantitative measurement scales.
No takes yet. Share an insight, caveat, or question.
PATRICIA A. PRITCHETT. MANGAN (1992) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: