A Critical Analysis of Studies Comparing Behaviorally Anchored Rating Scales (Bars) and Other Rating Formats¹

All published studies comparing behaviorally anchored rating scales (BARS) with other rating formats were reviewed. Results indicate that BARS and other formats appear to differ relatively little (if at all) with regard to psychometric characteristics (leniency, halo, interrater agreement, ratee discriminability, validity and “accuracy”). Other variables, such as degree of rater participation in scale construction and rater preferences for different rating scale formats, also exhibited relatively little differences between BARS and other formats. A close examination of the studies, however, reveals numerous methodological problems confounding interpretations of results, making conclusions about the superiority or inferiority of BARS quite tenuous. Suggestions are made for more appropriate research directions and questions which seem more appropriate for rating scale investigations.