Abstract:Background and objective. Acute stroke lesion segmentation tasks are of great clinical interest as they can help doctors make better informed time-critical treatment decisions. Magnetic resonance imaging (MRI) is time demanding but can provide images that are considered the gold standard for diagnosis. Automated stroke lesion segmentation can provide with an estimate of the location and volume of the lesioned tissue, which can help in the clinical practice to better assess and evaluate the risks of each treatment.Methods. We propose a deep learning methodology for acute and sub-acute stroke lesion segmentation using multimodal MR imaging. We pre-process the data to facilitate learning features based on the symmetry of brain hemispheres. The issue of class imbalance is tackled using small patches with a balanced training patch sampling strategy and a dynamically weighted loss function. Moreover, a combination of whole patch predictions, using a U-Net based CNN architecture, and high degree of overlapping patches reduces the need for additional post-processing.Results. The proposed method is evaluated using two public datasets from the 2015 Ischemic Stroke Lesion Segmentation challenge (ISLES 2015). These involve the tasks of sub-acute stroke lesion segmentation (SISS) and acute stroke penumbra estimation (SPES) from multiple diffusion, perfusion and anatomical MRI modalities. The performance is compared against state-of-the-art methods with a blind online testing set evaluation on each of the challenges. At the time of submitting this manuscript, our approach is the first method in the online rankings for the SISS (DSC=0.59 ± 0.31) and SPES sub-tasks (DSC=0.84 ± 0.10). When compared with the rest of submitted strategies, we achieve top rank performance with a lower Hausdorff distance.Conclusions. Better segmentation results are obtained by leveraging the anatomy and pathophysiology of acute stroke lesions and using a combined approach to minimize the effects of class imbalance. The same training procedure is used for both tasks, showing the proposed methodology can generalize well enough to deal with different unrelated tasks and imaging modalities without hyper-parameter tuning. In order to promote the reproducibility of our results, a public version of the proposed method has been released to the scientific community.

Feasibility and benefits of joint learning from MRI databases with different brain diseases and modalities for segmentation

Feasibility of Federated Learning from Client Databases with Different Brain Diseases and MRI Modalities

Mutual Information-Based Graph Co-Attention Networks for Multimodal Prior-Guided Magnetic Resonance Imaging Segmentation

Simultaneous reconstruction and segmentation of MRI image by manifold learning

MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

Segmentation of Brain Metastases in MRI: A Two-Stage Deep Learning Approach with Modality Impact Study

Generative Learning-Based Lightweight MRI Brain Tumor Segmentation with Missing Modalities

Cross-modality Guidance-aided Multi-modal Learning with Dual Attention for MRI Brain Tumor Grading

Learning multi-modal brain tumor segmentation from privileged semi-paired MRI images with curriculum disentanglement learning

MVSI-Net: Multi-view attention and multi-scale feature interaction for brain tumor segmentation

Multicenter Privacy-Preserving Model Training for Deep Learning Brain Metastases Autosegmentation

The Method of Multimodal MRI Brain Image Segmentation Based on Differential Geometric Features

Acute and sub-acute stroke lesion segmentation from multimodal MRI

Modality-Pairing Learning for Brain Tumor Segmentation

Brain Tumor Segmentation via Multi-Modalities Interactive Feature Learning

Robust Divergence Learning for Missing-Modality Segmentation

Learning intra-inter-modality complementary for brain tumor segmentation

Uncertainty-Aware Multi-Dimensional Mutual Learning for Brain and Brain Tumor Segmentation

Enhancing Incomplete Multi-modal Brain Tumor Segmentation with Intra-modal Asymmetry and Inter-modal Dependency

Pancreatic cancer segmentation in unregistered multi-parametric MRI with adversarial learning and multi-scale supervision