Answers are grounded in this paper and cite their sources.
Randomized trial evaluates calibration program impacts on agreement in paediatric dentistry, suggesting improved assessment reliability.
OBJECTIVE: While faculty calibration efforts within predoctoral dental education are recognizable, no studies have addressed this issue among curricula using the entrustable professional activity (EPA) framework. In this study, we describe findings of a calibration program undertaken among a paediatric dentistry faculty/graduate teaching assistant cohort for a predoctoral program using EPAs. METHODS: We analysed de-identified data from a calibration program within a paediatric dentistry department and among a cohort of six graduate teaching assistants and 10 faculty. The calibration program encompassed a diagnostic survey and four calibration sessions with post-assessments using an entrustment system (i.e., procedural skills [PS] and independence [IND]) for the EPAs: performing an exam, diagnosis and risk assessment, sealants, and stainless steel crowns. We descriptively compared the frequency of agreement and occurrence of a threshold effect across sessions. Finally, pooled weighted Kappa scores for each session were estimated. RESULTS: Highest levels of disagreement were observed among neighbouring levels of entrustment for PS. Across calibration sessions, there was important improvement in observed agreement (23%-100%) and resolution of threshold effects (55%-100%) for PS. Notably, similar improvements were observed and reflected via Kappa scores (range 0.8-1.0). Since the initial session, independence showed the highest level of agreement and reliability. CONCLUSIONS: Results of this calibration program suggest possible resolution effects on disagreement among instructors in the context of a new clinical assessment framework in paediatric dentistry. Future studies integrating instructors' perspectives on this framework and validating these results in different disciplines should be undertaken.
No takes yet. Share an insight, caveat, or question.
Lee et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: