Background: Simulation-based assessments use faculty and simulated participants (SPs) to evaluate communication skills, offering distinct perspectives.Purpose: To examine longitudinal differences in Kalamazoo Communication Skills Assessment-Adapted (KCSK) scores and instrument reliability.Methods: A total of 203 medical students completed 24 scenarios over three years.Linear mixed-effects models assessed evaluator differences, time trends, and demographics.Results: SPs scored lower than faculty, with differences narrowing over time ( p < .00 01).Gender and race predicted scores; female and White students' communication was rated higher ( p < .001).Reliability was strong (Cronbach's : faculty = 0.83; SP = 0.88); SP-faculty agreement was moderate (intraclass correlation coefficient ICC = 0.71).Conclusion: Multisource feedback captures complementary dimensions of communication competence.
Thompson et al. (Wed,) studied this question.