Deep learning-based classification of coronary arteries and left ventricle using multimodal data for autonomous protocol selection or adjustment in angiography

Figures

• 

  Fig. 1. Typical coronary angiography acquisitions. (left), right coronary artery (RCA) displays blurry vessels due to motion blur, which is because of non-optimal parametrization (right), RCA that has been parameterized correctly shows a clear vessel structure.

• 

  Fig. 2. Illustration of different pixel representations and the X-ray acquisition setup with standard terminology for C-arm angulation. (a) Plot depicting the effects of the square root and log transformation on the displayed brightness8. (b) Orientation angles of the C-arm9.

• 

  Fig. 3. Comparison of class-wise F1 scores for the image data model across different preprocessing techniques, alongside results from the angulation data and multimodal data models.

• 

  Fig. 4. Confusion Matrices obtained from the model evaluation on (a) Standard image and (b) Log transformed image.

• 

  Fig. 5. Confusion Matrices obtained from the model evaluation on (a) Square-root image and (b) Scatter corrected Log transformed image.

• 

  Fig. 6. Angiographic frame after injection of contrast agent. (a) Angiogram of the left coronary artery (b) Angiogram of right coronary artery (c) Angiogram of the left ventricle.

• 

  Fig. 7. Confusion Matrices obtained from the model evaluation on (a) Angulation data and (b) Multimodal data model trained from scratch (c), Multimodal data model trained with pre-trained weights.

• 

  Fig. 8. Plot depicting the distribution of the angulation data for all three class labels LCA, RCA, and LV.

• 

  Fig. 9. Comparison of class-wise AUC for the image data model across different preprocessing techniques, alongside results from the angulation data and multimodal data models.

• 

  Fig. 10. Class-wise F1-score presenting a comparison between the image data model, angulation data model, multimodal data model, and clinical expert prediction.

• 

  Fig. 11. Overview of the methodology.

• 

  Fig. 12. Angiographic frame just before the injection of contrast agent. (a) Angiogram of the left coronary artery (b) Angiogram of right coronary artery (c) Angiogram of the left ventricle.