Abstract:Objective. Cardiovascular disease (CVD) is a group of diseases affecting cardiac and blood vessels, and the short-axis cardiac magnetic resonance (CMR) images are considered the gold standard for diagnosis and assessment of CVD. In CMR images, accurate segmentation of cardiac structures (e.g, left ventricle) assists in the parametric quantification of cardiac function. However, the dynamic beating of the heart renders the location of the heart with respect to other tissues difficult to resolve, and the myocardium and its surrounding tissues are similar in gray scale. This makes it challenging to accurately segment the cardiac images. Our goal is to develop a more accurate CMR image segmentation approach. Approach. In this work, we propose a regional perception and multi-scale feature fusion network (RMFNet) for CMR image segmentation. We design two regional perception modules, window selection Transformer (WST) module and grid extraction Transformer (GET) module. The WST module introduces a window selection block to adaptively select the window of interest to perceive information, and a windowed Transformer block to enhance global information extraction within each feature window. The WST module enhances the network performance by improving the window of interest. The GET module grids the feature maps to decrease the redundant information in the feature maps and enhances the extraction of latent feature information of the network. The RMFNet further introduces a novel multi-scale feature extraction (MsFE) module to improve the ability to retain detailed information. Main results. The RMFNet is validated with experiments on three cardiac datasets. The results show the RMFNet outperforms other advanced methods in overall performance. The RMFNet is further validated for generalizability on a multi-organ dataset. The results show the RMFNet also surpasses other comparison methods. Significance. Accurate medical image segmentation can reduce the stress of radiologists and play an important role in image-guided clinical procedures.

Regional perception and multi-scale feature fusion network for cardiac segmentation

Cardiac MRI Segmentation with Focal Loss Constrained Deep Residual Networks

Enhancing Cardiac MRI Segmentation via Classifier-Guided Two-Stage Network and All-Slice Information Fusion Transformer

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

Cardiac Medical Image Segmentation Based on Parallel Fusion Network Architecture

CRMEFNet: A coupled refinement, multiscale exploration and fusion network for medical image segmentation

Deep Learning Based Multi-modal Cardiac MR Image Segmentation

Multi-Modality Pathology Segmentation Framework: Application to Cardiac Magnetic Resonance Images

Automated cardiac segmentation of cross-modal medical images using unsupervised multi-domain adaptation and spatial neural attention structure

Two-Stage CNN Whole Heart Segmentation Combining Image Enhanced Attention Mechanism and Metric Classification

A cascaded framework with cross-modality transfer learning for whole heart segmentation

Sub-pixel multi-scale fusion network for medical image segmentation

An Improved Combination of Faster R-CNN and U-Net Network for Accurate Multi-Modality Whole Heart Segmentation

A Multi-Scope Convolutional Neural Network for Automatic Left Ventricle Segmentation from Magnetic Resonance Images: Deep-Learning at Multiple Scopes.

Toward Right Ventricle Segmentation in Cardiac MRIs via Feature Multiplexing and Multiscale Weighted Convolution

Multiscale attention guided U-Net architecture for cardiac segmentation in short-axis MRI images

DAFNet: A dual attention-guided fuzzy network for cardiac MRI segmentation

CardSegNet: An adaptive hybrid CNN-vision transformer model for heart region segmentation in cardiac MRI

Multiple Attention Fully Convolutional Network for Automated Ventricle Segmentation in Cardiac Magnetic Resonance Imaging

Enhanced multi-label cardiology diagnosis with channel-wise recurrent fusion