Abstract:Objective. Cardiovascular disease (CVD) is a group of diseases affecting cardiac and blood vessels, and the short-axis cardiac magnetic resonance (CMR) images are considered the gold standard for diagnosis and assessment of CVD. In CMR images, accurate segmentation of cardiac structures (e.g, left ventricle) assists in the parametric quantification of cardiac function. However, the dynamic beating of the heart renders the location of the heart with respect to other tissues difficult to resolve, and the myocardium and its surrounding tissues are similar in gray scale. This makes it challenging to accurately segment the cardiac images. Our goal is to develop a more accurate CMR image segmentation approach. Approach. In this work, we propose a regional perception and multi-scale feature fusion network (RMFNet) for CMR image segmentation. We design two regional perception modules, window selection Transformer (WST) module and grid extraction Transformer (GET) module. The WST module introduces a window selection block to adaptively select the window of interest to perceive information, and a windowed Transformer block to enhance global information extraction within each feature window. The WST module enhances the network performance by improving the window of interest. The GET module grids the feature maps to decrease the redundant information in the feature maps and enhances the extraction of latent feature information of the network. The RMFNet further introduces a novel multi-scale feature extraction (MsFE) module to improve the ability to retain detailed information. Main results. The RMFNet is validated with experiments on three cardiac datasets. The results show the RMFNet outperforms other advanced methods in overall performance. The RMFNet is further validated for generalizability on a multi-organ dataset. The results show the RMFNet also surpasses other comparison methods. Significance. Accurate medical image segmentation can reduce the stress of radiologists and play an important role in image-guided clinical procedures.

Multi-view Cardiac Image Segmentation via Trans-Dimensional Priors

Segmentation of Cardiac Tissues and Organs for CCTA Images Based on a Deep Learning Model

Pseudo-3D Network for Multi-sequence Cardiac MR Segmentation

Multi-Planar Deep Segmentation Networks for Cardiac Substructures from MRI and CT

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

3D Consistent & Robust Segmentation of Cardiac Images by Deep Learning with Spatial Propagation

A Two-Stage Fully Automatic Segmentation Scheme Using Both 2D and 3D U-Net for Multi-sequence Cardiac MR.

Multivariate Mixture Model for Cardiac Segmentation from Multi-Sequence MRI.

Compositional Segmentation of Cardiac Images Leveraging Metadata

Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge

Consistency Based Co-segmentation for Multi-view Cardiac MRI Using Vision Transformer

Deep Learning Based Multi-modal Cardiac MR Image Segmentation

Transforming Heart Chamber Imaging: Self-Supervised Learning for Whole Heart Reconstruction and Segmentation

CardiacSeg: Customized Pre-training Volumetric Transformer with Scaling Pyramid for 3D Cardiac Segmentation.

A Multi-Task Network For Cardiac Magnetic Resonance Image Segmentation And Classification

Multi-Source and Multi-Sequence Myocardial Pathology Segmentation Using a Cascading Refinement CNN

Toward Right Ventricle Segmentation in Cardiac MRIs via Feature Multiplexing and Multiscale Weighted Convolution

Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Images

A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI

Multi-Modality Pathology Segmentation Framework: Application to Cardiac Magnetic Resonance Images

Regional perception and multi-scale feature fusion network for cardiac segmentation