Why the study?
Current automatic approaches for surgical workflow analysis use video alone and do not incorporate speech, which is inherently linked to the ongoing cognitive process.
Incorporating both speech and video into neural network-based surgical workflow analysis enables detailed automatic assessment of procedural skills during laparoscopic cholecystectomy.
Answers are grounded in this paper and cite their sources.
May aid objective surgical skill assessment; leaves open prospective validation before clinical adoption.
Automatic surgical workflow analysis (SWA) plays an important role in the modelling of surgical processes. Current automatic approaches for SWA use videos (with accuracies varying from 0.8 and 0.9), but they do not incorporate speech (inherently linked to the ongoing cognitive process). The approach followed in this study uses both video and speech to classify the phases of laparoscopic cholecystectomy, based on neural networks and machine learning. The automatic application implemented in this study uses this information to calculate the total time spent in surgery, the time spent in each phase, the number of occurrences, the minimal, maximal and average time whenever there is more than one occurrence, the timeline of the surgery and the transition probability between phases. This information can be used as an assessment method for surgical procedural skills.
No takes yet. Share an insight, caveat, or question.
Guzmán-García et al. (2022) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: