Machine and deep learning techniques can analyze surgical activities using endoscopic or ceiling-mounted cameras to enable AI-based assistance tools in the operating room.
Machine and deep learning techniques can be used to analyze surgical workflows from video feeds to develop AI assistance tools in the operating room.
Recent years have seen tremendous progress in artificial intelligence (AI), such as with the automatic and real-time recognition of objects and activities in videos in the field of computer vision. Due to its increasing digitalization, the operating room (OR) promises to directly benefit from this progress in the form of new assistance tools that can enhance the abilities and performance of surgical teams. Key for such tools is the recognition of the surgical workflow, because efficient assistance by an AI system requires this system to be aware of the surgical context, namely of all activities taking place inside the operating room. We present here how several recent techniques relying on machine and deep learning can be used to analyze the activities taking place during surgery, using videos captured from either endoscopic or ceiling-mounted cameras. We also present two potential clinical applications that we are developing at the University of Strasbourg with our clinical partners.
Nicolas Padoy (Mon,) conducted a review in Surgery. Machine and deep learning for workflow recognition was evaluated. Machine and deep learning techniques can analyze surgical activities using endoscopic or ceiling-mounted cameras to enable AI-based assistance tools in the operating room.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: