Abstract:Objective. Cardiovascular disease (CVD) is a group of diseases affecting cardiac and blood vessels, and the short-axis cardiac magnetic resonance (CMR) images are considered the gold standard for diagnosis and assessment of CVD. In CMR images, accurate segmentation of cardiac structures (e.g, left ventricle) assists in the parametric quantification of cardiac function. However, the dynamic beating of the heart renders the location of the heart with respect to other tissues difficult to resolve, and the myocardium and its surrounding tissues are similar in gray scale. This makes it challenging to accurately segment the cardiac images. Our goal is to develop a more accurate CMR image segmentation approach. Approach. In this work, we propose a regional perception and multi-scale feature fusion network (RMFNet) for CMR image segmentation. We design two regional perception modules, window selection Transformer (WST) module and grid extraction Transformer (GET) module. The WST module introduces a window selection block to adaptively select the window of interest to perceive information, and a windowed Transformer block to enhance global information extraction within each feature window. The WST module enhances the network performance by improving the window of interest. The GET module grids the feature maps to decrease the redundant information in the feature maps and enhances the extraction of latent feature information of the network. The RMFNet further introduces a novel multi-scale feature extraction (MsFE) module to improve the ability to retain detailed information. Main results. The RMFNet is validated with experiments on three cardiac datasets. The results show the RMFNet outperforms other advanced methods in overall performance. The RMFNet is further validated for generalizability on a multi-organ dataset. The results show the RMFNet also surpasses other comparison methods. Significance. Accurate medical image segmentation can reduce the stress of radiologists and play an important role in image-guided clinical procedures.

Cardiac Medical Image Segmentation Based on Parallel Fusion Network Architecture

TF-Unet:An Automatic Cardiac MRI Image Segmentation Method

Regional perception and multi-scale feature fusion network for cardiac segmentation

ViT-UperNet: a hybrid vision transformer with unified-perceptual-parsing network for medical image segmentation

Enhancing Cardiac MRI Segmentation via Classifier-Guided Two-Stage Network and All-Slice Information Fusion Transformer

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

Attention Based Encoder-decoder Network for Cardiac Semantic Segmentation

Dilated convolution network with edge fusion block and directional feature maps for cardiac MRI segmentation

NVTrans-UNet: Neighborhood vision transformer based U-Net for multi-modal cardiac MR image segmentation

TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation

Automatic Segmentation of Cardiac Magnetic Resonance Images Based on Multi-Input Fusion Network.

Medical Image Segmentation Using Dual Branch Networks with Embedded Attention Mechanism.

Sfe-Transunet: A Transformer-Based U-Net With Skipped Features Enhancer For Medical Image Segmentation

RotCAtt-TransUNet++: Novel Deep Neural Network for Sophisticated Cardiac Segmentation

Cardiac LGE MRI Segmentation with Cross-Modality Image Augmentation and Improved U-Net

CFATransUnet: Channel-wise cross fusion attention and transformer for 2D medical image segmentation

Multi-Scale Feature Fusion Convolutional Neural Network for Concurrent Segmentation of Left Ventricle and Myocardium in Cardiac MR Images

Deep Dual-Stream Convolutional Neural Networks for Cardiac Image Semantic Segmentation

FTUNet: A Feature-Enhanced Network for Medical Image Segmentation Based on the Combination of U-Shaped Network and Vision Transformer

Automated cardiac segmentation of cross-modal medical images using unsupervised multi-domain adaptation and spatial neural attention structure

CardSegNet: An adaptive hybrid CNN-vision transformer model for heart region segmentation in cardiac MRI