Abstract:Background: Accurate and automated brain tumor segmentation from multi-modality MR images plays a significant role in tumor treatment. However, the existing approaches mainly focus on the fusion of multi-modality while ignoring the correlation between single-modality and tumor subcomponents. For example, T2-weighted images show good visualization of edema, and T1-contrast images have a good contrast between enhancing tumor core and necrosis. In the actual clinical process, professional physicians also label tumors according to these characteristics. We design a method for brain tumors segmentation that utilizes both multi-modality fusion and single-modality characteristics. Methods: A multi-modality and single-modality feature recalibration network (MSFR-Net) is proposed for brain tumor segmentation from MR images. Specifically, multi-modality information and single-modality information are assigned to independent pathways. Multi-modality network explicitly learns the relationship between all modalities and all tumor sub-components. Single-modality network learns the relationship between single-modality and its highly correlated tumor subcomponents. Then, a dual recalibration module (DRM) is designed to connect the parallel single-modality network and multi-modality network at multiple stages. The function of the DRM is to unify the two types of features into the same feature space. Results: Experiments on BraTS 2015 dataset and BraTS 2018 dataset show that the proposed method is competitive and superior to other state-of-the-art methods. The proposed method achieved the segmentation results with Dice coefficients of 0.86 and Hausdorff distance of 4.82 on BraTS 2018 dataset, with dice coefficients of 0.80, positive predictive value of 0.76, and sensitivity of 0.78 on BraTS 2015 dataset. Conclusions: This work combines the manual labeling process of doctors and introduces the correlation between single-modality and the tumor subcomponents into the segmentation network. The method improves the segmentation performance of brain tumors and can be applied in the clinical practice. The code of the proposed method is available at: https://github.com/xiangQAQ/MSFR-Net.

Mixture-of-experts and semantic-guided network for brain tumor segmentation with missing MRI modalities

Mmformer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

Feature-enhanced generation and multi-modality fusion based deep neural network for brain tumor segmentation with missing MR modalities

M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

TransSea: Hybrid CNN–Transformer With Semantic Awareness for 3-D Brain Tumor Segmentation

Multimodal Transformer of Incomplete MRI Data for Brain Tumor Segmentation.

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

Brain Tumor Segmentation on MRI with Missing Modalities

Multi-modal Brain Tumor Segmentation via Missing Modality Synthesis and Modality-level Attention Fusion

Feature fusion and latent feature learning guided brain tumor segmentation and missing modality recovery network

ME-Net: Multi-encoder Net Framework for Brain Tumor Segmentation.

Multi -Modality Brain Tumor Segmentation Network Based on Collaborative Feature Fusion

Prototype-Driven and Multiexpert Integrated Multimodal MR Brain Tumor Image Segmentation

Modality-Pairing Learning for Brain Tumor Segmentation

Brain tumor segmentation by combining MultiEncoder UNet with wavelet fusion

Brain tumor segmentation based on the fusion of deep semantics and edge information in multimodal MRI

A Multimodal Feature Distillation with CNN-Transformer Network for Brain Tumor Segmentation with Incomplete Modalities

MSFR-Net: Multi-modality and single-modality feature recalibration network for brain tumor segmentation

Prototype-Driven and Multi-Expert Integrated Multi-Modal MR Brain Tumor Image Segmentation

Remu-Net: Multi-Branch Net Framework for 3D Brain Tumor Segmentation