Abstract:Objective. Cardiovascular disease (CVD) is a group of diseases affecting cardiac and blood vessels, and the short-axis cardiac magnetic resonance (CMR) images are considered the gold standard for diagnosis and assessment of CVD. In CMR images, accurate segmentation of cardiac structures (e.g, left ventricle) assists in the parametric quantification of cardiac function. However, the dynamic beating of the heart renders the location of the heart with respect to other tissues difficult to resolve, and the myocardium and its surrounding tissues are similar in gray scale. This makes it challenging to accurately segment the cardiac images. Our goal is to develop a more accurate CMR image segmentation approach. Approach. In this work, we propose a regional perception and multi-scale feature fusion network (RMFNet) for CMR image segmentation. We design two regional perception modules, window selection Transformer (WST) module and grid extraction Transformer (GET) module. The WST module introduces a window selection block to adaptively select the window of interest to perceive information, and a windowed Transformer block to enhance global information extraction within each feature window. The WST module enhances the network performance by improving the window of interest. The GET module grids the feature maps to decrease the redundant information in the feature maps and enhances the extraction of latent feature information of the network. The RMFNet further introduces a novel multi-scale feature extraction (MsFE) module to improve the ability to retain detailed information. Main results. The RMFNet is validated with experiments on three cardiac datasets. The results show the RMFNet outperforms other advanced methods in overall performance. The RMFNet is further validated for generalizability on a multi-organ dataset. The results show the RMFNet also surpasses other comparison methods. Significance. Accurate medical image segmentation can reduce the stress of radiologists and play an important role in image-guided clinical procedures.

Multi-Modality Pathology Segmentation Framework: Application to Cardiac Magnetic Resonance Images

Myocardial Pathology Segmentation Combining Multi-Sequence Cardiac Magnetic Resonance Images: First Challenge, MyoPS 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 4, 2020, Proceedings

Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentation

A Multi-Task Network For Cardiac Magnetic Resonance Image Segmentation And Classification

Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

Improving myocardial pathology segmentation with U-Net++ and EfficientSeg from multi-sequence cardiac magnetic resonance images

MyoPS-Net: Myocardial pathology segmentation with flexible combination of multi-sequence CMR images

AWSnet: An Auto-weighted Supervision Attention Network for Myocardial Scar and Edema Segmentation in Multi-sequence Cardiac Magnetic Resonance Images

A Multi-Scale Network with the Encoder-Decoder Structure for CMR Segmentation

Multi-Source and Multi-Sequence Myocardial Pathology Segmentation Using a Cascading Refinement CNN

Medical Image Segmentation Based on Multi-Modal Convolutional Neural Network: Study on Image Fusion Schemes

A cascaded framework with cross-modality transfer learning for whole heart segmentation

Regional perception and multi-scale feature fusion network for cardiac segmentation

Cardiac MRI Segmentation with Focal Loss Constrained Deep Residual Networks

Multi-Modality Cardiac Image Analysis with Deep Learning

Deep U-Net architecture with curriculum learning for myocardial pathology segmentation in multi-sequence cardiac magnetic resonance images

Automated cardiac segmentation of cross-modal medical images using unsupervised multi-domain adaptation and spatial neural attention structure

Fully automated deep learning based segmentation of normal, infarcted and edema regions from multiple cardiac MRI sequences

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

Multi Task Learning Using Attention Based Convolutional Encoder Decoder for Dilated Cardiomyopathy CMR Segmentation and Classification

Automatic Segmentation of Different Pathologies from Cardiac Cine MRI Using Registration and Multiple Component EM Estimation