Key result
Novel Global Rating Scale effectively differentiates expert from novice teams in emergency medical simulations.
Why the study?
In emergency medicine and anesthesia, there is a lack of validated assessment tools for technical skills in structured simulation-based trainings.
Observational (n=36)
Open-label
None
No
The novel Global Rating Scale is a valid and reliable tool for objectively assessing technical skills in emergency medical simulation training.
Answers are grounded in this paper and cite their sources.
May support objective skill assessment in emergency simulations; leaves open larger validation before clinical adoption.
BACKGROUND: Medical simulation trainings lead to an improvement in patient care by increasing technical and non-technical skills, procedural confidence and medical knowledge. For structured simulation-based trainings, objective assessment tools are needed to evaluate the performance during simulation and the learning progress. In surgical education, objective structured assessment of technical skills (OSATS) are widely used and validated. However, in emergency medicine and anesthesia there is a lack of validated assessment tools for technical skills. Thus, the aim of the present study was to develop and validate a novel Global Rating Scale (GRS) for emergency medical simulation trainings. METHODS: Following the development of the GRS, 12 teams of different experience in emergency medicine (4th year medical students, paramedics, emergency physicians) were involved in a pre-hospital emergency medicine simulation scenario and assessed by four independent raters. Subsequently, interrater reliability and construct validity of the GRS were analyzed. Moreover, the results of the GRS were cross-checked with a task specific check list. Data are presented as median (minimum; maximum). RESULTS: The GRS consists of ten items each scored on a 5-point Likert scale yielding a maximum of 50 points. The median score achieved by novice teams was 22.75 points (17;30), while experts scored 39.00 points (32;47). The GRS overall scores significantly discriminated between student-guided teams and expert teams of emergency physicians (p = 0.005). Interrater reliability for the GRS was high with a Kendall's coefficient of concordance W ranging from 0.64 to 0.90 in 9 of 10 items and 0.88 in the overall score. CONCLUSION: The GRS represents a promising novel tool to objectively assess technical skills in simulation training with high construct validity and interrater reliability in this pilot study.
No takes yet. Share an insight, caveat, or question.
Zöller et al. (2021) conducted an observational in Emergency medical simulation training (n=36). Global Rating Scale (GRS) vs. Task Specific Checklist (TSC) / Novice teams was evaluated on GRS overall score (construct validity) (p=0.005). The novel Global Rating Scale significantly discriminated between student-guided novice teams (median score 22.75) and physician-guided expert teams (median score 39.00) in an emergency medical simulation scenario.
Synapse has enriched 10 related papers. Consider them for comparative context: