Abstract:Objective. Cardiovascular disease (CVD) is a group of diseases affecting cardiac and blood vessels, and the short-axis cardiac magnetic resonance (CMR) images are considered the gold standard for diagnosis and assessment of CVD. In CMR images, accurate segmentation of cardiac structures (e.g, left ventricle) assists in the parametric quantification of cardiac function. However, the dynamic beating of the heart renders the location of the heart with respect to other tissues difficult to resolve, and the myocardium and its surrounding tissues are similar in gray scale. This makes it challenging to accurately segment the cardiac images. Our goal is to develop a more accurate CMR image segmentation approach. Approach. In this work, we propose a regional perception and multi-scale feature fusion network (RMFNet) for CMR image segmentation. We design two regional perception modules, window selection Transformer (WST) module and grid extraction Transformer (GET) module. The WST module introduces a window selection block to adaptively select the window of interest to perceive information, and a windowed Transformer block to enhance global information extraction within each feature window. The WST module enhances the network performance by improving the window of interest. The GET module grids the feature maps to decrease the redundant information in the feature maps and enhances the extraction of latent feature information of the network. The RMFNet further introduces a novel multi-scale feature extraction (MsFE) module to improve the ability to retain detailed information. Main results. The RMFNet is validated with experiments on three cardiac datasets. The results show the RMFNet outperforms other advanced methods in overall performance. The RMFNet is further validated for generalizability on a multi-organ dataset. The results show the RMFNet also surpasses other comparison methods. Significance. Accurate medical image segmentation can reduce the stress of radiologists and play an important role in image-guided clinical procedures.

Multi-class Object Recognition and Segmentation Based on Multi-feature Fusion Modeling

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Multi-View Feature Fusion and Rich Information Refinement Network for Semantic Segmentation of Remote Sensing Images

Learning Cross-Modal Deep Representations for Multi-Modal MR Image Segmentation

Context Multi-scale Fusion Network for Magnetic Resonance Image

Multi-class Object Segmentation Based on Jointly Integrating Segment-Level and Image-Level Object Priors

Multi-task Attribute-Fusion Model for Fine-Grained Image Recognition

Multiobjective multiple features fusion: A case study in image segmentation

CRMEFNet: A coupled refinement, multiscale exploration and fusion network for medical image segmentation

A Transformer-based Multi-Modal Fusion Network for Semantic Segmentation of High-Resolution Remote Sensing Imagery

Object Recognition via Adaptive Multi-level Feature Integration

MCFusion: infrared and visible image fusion based multiscale receptive field and cross-modal enhanced attention mechanism

Efficient Multi-Object Recognition Using GMM Segmentation Feature Fusion Approach

Regional perception and multi-scale feature fusion network for cardiac segmentation

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

CMRFusion: A cross-domain multi-resolution fusion method for infrared and visible image fusion

SFMRNet: Specific Feature Fusion and Multibranch Feature Refinement Network for Land Use Classification

A Crossmodal Multiscale Fusion Network for Semantic Segmentation of Remote Sensing Data

Cascaded Multi-3D-view Fusion for 3D-Oriented Object Detection

Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation

Contextual-wise Discriminative Feature Extraction and Robust Network Learning for Subcortical Structure Segmentation