The proposed multi-attention enhanced encoder-decoder network achieved superior segmentation accuracy, reaching a Dice Similarity Coefficient of 92.25% for the left ventricle endocardium in four-chamber views, outperforming pure CNN and transformer-based models.
A novel hybrid CNN-transformer deep learning architecture improves the accuracy of automatic 2D echocardiogram segmentation compared to existing models.
Absolute Event Rate: 92.25% vs 91.81%
Automatic segmentation of 2D echocardiograms is a critical step in diagnosing and assessing heart diseases. Convolutional Neural Networks (CNNs), such as U-Net, have proven effective for medical image segmentation, but they often fall short in capturing long-range dependencies because convolution operations are inherently local. While transformer models capture the global context, they also may not be good in fine-grained localization. This study aims to develop a novel deep learning architecture that addresses these limitations by combining the strengths of CNNs and transformers for improved segmentation accuracy in 2D echocardiograms. We propose a novel encoder-decoder framework enriched with multiple attention mechanisms and hybrid bottleneck combining a Vision Transformer (ViT) and a Multi Receptive Field Block (MRFB). The integration of a ViT enables the modeling of long-range dependencies, while the MRFB improves multi-scale feature extraction and is specifically designed to improve the representation of spatial features and reduce the loss of spatial information. Enhanced by multiple attention mechanisms and deep supervision with Atrous Spatial Pyramid Pooling (ASPP), our model robustly captures both local and global contexts. Trained and validated on the CAMUS dataset, it achieves Dice Similarity Coefficients of 91. 11±0. 19, 87. 60±0. 11, and 87. 85±0. 29 for left ventricle endocardium, epicardium, and left atrium in two-chamber views, and 92. 25±0. 17, 87. 29±0. 17, and 91. 71±0. 10 in four-chamber views. Our model outperforms pure CNN-based (such as UNet), pure transformer-based (such as Swin-unet), and CNN-Transformer hybrid (such as UNETR-2d) architectures, achieving superior segmentation accuracy and robustness. Code is publicly available on the paper's https: //github. com/saeedchamani/CAMUSSegmentationHybridBottleneck repository.
Chamani et al. (Tue,) conducted a other in Echocardiography image segmentation (n=500). Multi-attention enhanced encoder-decoder network with hybrid transformer bottleneck vs. UNet, UNETR-2d, and Swin-unet was evaluated on Dice Similarity Coefficient (DSC) for left ventricle endocardium (LVendo) in four-chamber (4CH) view. The proposed multi-attention enhanced encoder-decoder network achieved superior segmentation accuracy, reaching a Dice Similarity Coefficient of 92.25% for the left ventricle endocardium in four-chamber views, outperforming pure CNN and transformer-based models.