Key result
Objective metrics capturing surgical tool tip movement smoothness produced statistically significant correlations with observation-based assessments and differentiated skill among participants.
Why the study?
Do objective metrics of tool tip movement smoothness correlate with subjective global rating scale assessments in evaluating endovascular surgical skill?
Observational (n=20)
Do objective metrics of tool tip movement smoothness correlate with subjective global rating scale assessments in evaluating endovascular surgical skill?
Objective metrics of tool tip movement smoothness can reliably assess endovascular surgical skill, correlating well with subjective expert ratings.
Objective metrics may aid endovascular skill assessment; leaves open impact on training outcomes or patient safety.
Current performance assessment techniques in endovascular surgery are subjective or limited to grading scales based solely on an expert's observation of a novice's task execution. Since most endovascular procedures involve performing fine motor control tasks that require complex dexterous movements, this paper evaluates objective and quantitative metrics of performance that capture movement quality through the computation of tool tip movement smoothness. An experiment was designed that involved recording the catheter tip movement from 20 subjects performing four fundamental endovascular tasks in each of three sessions using manual catheterization on a physical model and in a simulation environment. Several motion-based performance measures that have been shown to reliably assess skill in other domains were computed and tested for correlation with subjective data that were simultaneously obtained from the global rating scale assessment tool. Metrics that captured movement smoothness produced statistically significant correlations with the observation-based assessment metrics and were able to differentiate skill among participants. In particular, submovement analysis led to metrics that captured statistically significant differences across ability group, session, experimental platform, and task. Objective and quantitative metrics that capture movement smoothness could be incorporated into future training protocols to provide detailed feedback on trainee performance.
No takes yet. Share an insight, caveat, or question.
Estrada et al. (2016) conducted an observational in Endovascular surgery skill assessment (n=20). Tool tip movement smoothness metrics vs. Subjective global rating scale assessment was evaluated on Correlation with subjective global rating scale assessment and skill differentiation. Objective metrics capturing surgical tool tip movement smoothness produced statistically significant correlations with observation-based assessments and differentiated skill among participants.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: