Abstract:Left ventricular ejection fraction (LVEF) plays as an essential role in the assessment of cardiac function, providing quantitative data support for the medical diagnosis of heart disease. Robust evaluation of the ejection fraction relies on accurate left ventricular (LV) segmentation of echocardiograms. Because human bias and expensive labor cost exist in manual echocardiographic analysis, computer algorithms of deep-learning have been developed to help human experts in segmentation tasks. Most of the previous work is based on the convolutional neural networks (CNN) structure and has achieved good results. However, the region occupied by the left ventricle is large for echocardiography. Therefore, the limited receptive field of CNN leaves much room for improvement in the effectiveness of LV segmentation. In recent years, Vision Transformer models have demonstrated their effectiveness and universality in traditional semantic segmentation tasks. Inspired by this, we propose two models that use two different pure Transformers as the basic framework for LV segmentation in echocardiography: one combines Swin Transformer and K-Net, and the other uses Segformer. We evaluate these two models on the EchoNet-Dynamic dataset of LV segmentation and compare the quantitative metrics with other models for LV segmentation. The experimental results show that the mean Dice similarity of the two models scores are 92.92% and 92.79%, respectively, which outperform most of the previous mainstream CNN models. In addition, we found that for some samples that were not easily segmented, whereas both our models successfully recognized the valve region and separated left ventricle and left atrium, the CNN model segmented them together as a single part. Therefore, it becomes possible for us to obtain accurate segmentation results through simple post-processing, by filtering out the parts with the largest circumference or pixel square. These promising results prove the effectiveness of the two models and reveal the potential of Transformer structure in echocardiographic segmentation.

CoST-UNet: Convolution and swin transformer based deep learning architecture for cardiac segmentation

TF-Unet:An Automatic Cardiac MRI Image Segmentation Method

Mixed Transformer U-Net for Medical Image Segmentation

Automatic segmentation of echocardiographic images using a Shifted Windows Vision Transformer architecture

Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation

SAttisUNet: UNet-like Swin Transformer with Attentive Skip Connections for Enhanced Medical Image Segmentation

Vision Transformers increase efficiency of 3D cardiac CT multi-label segmentation

TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

Left Ventricle Segmentation in Echocardiography with Transformer

DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentation

STM-UNet: An Efficient U-shaped Architecture Based on Swin Transformer and Multi-scale MLP for Medical Image Segmentation

3D TransUNet: Advancing Medical Image Segmentation through Vision Transformers

ST-Unet: Swin Transformer boosted U-Net with Cross-Layer Feature Enhancement for medical image segmentation

The Study of Echocardiography of Left Ventricle Segmentation Combining Transformer and Convolutional Neural Networks

Optimizing Vision Transformers for Medical Image Segmentation

ConvWin-UNet: UNet-like hierarchical vision Transformer combined with convolution for medical image segmentation.

DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation

TSCA-Net: Transformer based spatial-channel attention segmentation network for medical images

RotCAtt-TransUNet++: Novel Deep Neural Network for Sophisticated Cardiac Segmentation

Transformer-based heart organ segmentation using a novel axial attention and fusion mechanism