Abstract:Accurate segmentation of glioma and its subregions plays an important role in radiotherapy treatment planning. Due to a very populated multiparameter magnetic resonance imaging image, manual segmentation tasks can be very time-consuming, meticulous, and prone to subjective errors. Here, we propose a novel deep learning framework based on mutual enhancing networks to automatically segment brain tumor subregions. The proposed framework is suitable for the segmentation of brain tumor subregions owing to the contribution of Retina U-Net followed by the implementation of a mutual enhancing strategy between the classification localization map (CLM) module and segmentation module. Retina U-Net is trained to accurately identify view-of-interest and feature maps of the whole tumor (WT), which are then transferred to the CLM module and segmentation module. Subsequently, CLM generated by the CLM module is integrated with the segmentation module to bring forth a mutual enhancing strategy. In this way, our proposed framework first focuses on WT through Retina U-Net, and since WT consists of subregions, a mutual enhancing strategy then further aims to classify and segment subregions embedded within WT. We implemented and evaluated our proposed framework on the BraTS 2020 dataset consisting of 369 cases. We performed a 5-fold cross-validation on 200 datasets and a hold-out test on the remaining 169 cases. To demonstrate the effectiveness of our network design, we compared our method against the networks without Retina U-Net, mutual enhancing strategy, and a recently published Cascaded U-Net architecture. Results of all four methods were compared to the ground truth for segmentation and localization accuracies. Our method yielded significantly (P < 0.01) better values of dice-similarity-coefficient, center-of-mass-distance, and volume difference compared to all three competing methods across all tumor labels (necrosis and non-enhancing, edema, enhancing tumor, WT, tumor core) on both validation and hold-out dataset. Overall quantitative and statistical results of this work demonstrate the ability of our method to both accurately and automatically segment brain tumor subregions.

Multimodal Brain Tumor Segmentation Boosted by Monomodal Normal Brain Images

Brain Tumor Segmentation via Multi-Modalities Interactive Feature Learning

Effective Multipath Feature Extraction 3D CNN for Multimodal Brain Tumor Segmentation

Brain Tumor Segmentation in Multimodal MRI Via Pixel-Level and Feature-Level Image Fusion.

Modality-Pairing Learning for Brain Tumor Segmentation

Feature-enhanced generation and multi-modality fusion based deep neural network for brain tumor segmentation with missing MR modalities

Brain Tumor Segmentation Network Using Attention-based Fusion and Spatial Relationship Constraint

Brain tumor image segmentation algorithm based on multimodal feature fusion of Bayesian weight distribution

Cross-modality deep feature learning for brain tumor segmentation

A Deep Multi-Task Learning Framework for Brain Tumor Segmentation

Robust Multimodal Brain Tumor Segmentation via Feature Disentanglement and Gated Fusion

Multi -Modality Brain Tumor Segmentation Network Based on Collaborative Feature Fusion

Segmentation of Brain Gliomas Based on a Multi-modal Multi-scale Double-pathway 3D Residual CNN

Cascaded Mutual Enhancing Networks for Brain Tumor Subregion Segmentation in Multiparametric MRI

Prototype-Driven and Multiexpert Integrated Multimodal MR Brain Tumor Image Segmentation

Multiscale Cnns For Brain Tumor Segmentation And Diagnosis

An Improved Multi-Modal Brain Tumor Segmentation Hybrid Algorithm

Modality-level cross-connection and attentional feature fusion based deep neural network for multi-modal brain tumor segmentation

Multimodality-Assisted Semi-Supervised Brain Tumor Segmentation in Nondominant Modality Based on Consistency Learning

Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans

Learning rich features with hybrid loss for brain tumor segmentation