Abstract:Automatic segmentation of multi-sequence (multi-modal) cardiac MR (CMR) images plays a significant role in diagnosis and management for a variety of cardiac diseases. However, the performance of relevant algorithms is significantly affected by the proper fusion of the multi-modal information. Furthermore, particular diseases, such as myocardial infarction, display irregular shapes on images and occupy small regions at random locations. These facts make pathology segmentation of multi-modal CMR images a challenging task. In this paper, we present the Max-Fusion U-Net that achieves improved pathology segmentation performance given aligned multi-modal images of LGE, T2-weighted, and bSSFP modalities. Specifically, modality-specific features are extracted by dedicated encoders. Then they are fused with the pixel-wise maximum operator. Together with the corresponding encoding features, these representations are propagated to decoding layers with U-Net skip-connections. Furthermore, a spatial-attention module is applied in the last decoding layer to encourage the network to focus on those small semantically meaningful pathological regions that trigger relatively high responses by the network neurons. We also use a simple image patch extraction strategy to dynamically resample training examples with varying spacial and batch sizes. With limited GPU memory, this strategy reduces the imbalance of classes and forces the model to focus on regions around the interested pathology. It further improves segmentation accuracy and reduces the mis-classification of pathology. We evaluate our methods using the Myocardial pathology segmentation (MyoPS) combining the multi-sequence CMR dataset which involves three modalities. Extensive experiments demonstrate the effectiveness of the proposed model which outperforms the related baselines.

Whole Heart Segmentation of Cardiac MRI Using Multiple Path Propagation Strategy.

A Registration-Based Propagation Framework for Automatic Whole Heart Segmentation of Cardiac MRI

A Registration and Atlas Propagation Based Framework for Automatic Whole Heart Segmentation of CT Volumes

Multi-Scale Patch and Multi-Modality Atlases for Whole Heart Segmentation of Mri

Automatic Whole Heart Segmentation Based on Atlas Propagation with A Priori Anatomical Information

A cascaded framework with cross-modality transfer learning for whole heart segmentation

Multi-Modality Pathology Segmentation Framework: Application to Cardiac Magnetic Resonance Images

Automatic Segmentation of Different Pathologies from Cardiac Cine MRI Using Registration and Multiple Component EM Estimation

Multi-Planar Deep Segmentation Networks for Cardiac Substructures from MRI and CT

An Improved Combination of Faster R-CNN and U-Net Network for Accurate Multi-Modality Whole Heart Segmentation

An Atlas-Based Segmentation Propagation Framework Using Locally Affine Registration - Application to Automatic Whole Heart Segmentation

Enhancing Cardiac MRI Segmentation via Classifier-Guided Two-Stage Network and All-Slice Information Fusion Transformer

Multi-view Cardiac Image Segmentation via Trans-Dimensional Priors

Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

Improving myocardial pathology segmentation with U-Net++ and EfficientSeg from multi-sequence cardiac magnetic resonance images

Transforming Heart Chamber Imaging: Self-Supervised Learning for Whole Heart Reconstruction and Segmentation

Toward Right Ventricle Segmentation in Cardiac MRIs via Feature Multiplexing and Multiscale Weighted Convolution

Registration-based Propagation for Whole Heart Segmentation from Compounded 3D Echocardiography

Two-Stage CNN Whole Heart Segmentation Combining Image Enhanced Attention Mechanism and Metric Classification

A Two-Stage Fully Automatic Segmentation Scheme Using Both 2D and 3D U-Net for Multi-sequence Cardiac MR.