Answers are grounded in this paper and cite their sources.
Survey-based evaluations inform high-stakes ranking and performance decisions, yet scores often reflect non-instructional influences. This paper introduces PROMSET (Preference Ranking Organization Method for Student Evaluation of Teaching), a bias-mitigated outranking method that integrates robust multiple linear regression for bias identification with a comparison-dependent extension of PROMETHEE II. The method is validated on Student Evaluation of Teaching (SET) data from a Spanish university (45,357 surveys; 879 course evaluations; four knowledge areas). PROMSET incorporates a comparison-dependent activation mechanism that applies bias-calibrated indifference thresholds only when pairwise comparisons involve bias-favored alternatives. The results show that grade leniency bias and professor gender bias are no longer statistically detectable at conventional significance levels (p > 0.05) under PROMSET, while the discriminating power of the ranking increases substantially. Benchmarks against the traditional method and PROMETHEE II confirm that bias remains statistically significant under conventional approaches but not under PROMSET. PROMSET improves the informational quality and fairness of survey-based rankings for institutional decision-making.
No takes yet. Share an insight, caveat, or question.
Barrera-Jimenez et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: