Answers are grounded in this paper and cite their sources.
It is very common to examine reliability of triage scales using (weighted) kappa statistics. The point is that weighted kappa has grossly underestimated disagreements by one category and put more emphasis on extreme category disagreements; therefore, low prevalence of critically-ill and non-urgent patients has excluded the effect of extreme categories disagreement from calculated kappa coefficient and also contributed to significant overestimation. As a result, weighted kappa coefficient as an estimate of scale reliability is overestimated by the anchoring effect.
No takes yet. Share an insight, caveat, or question.
Amir Mirhaghi (2015) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: