Abstract:Background: Accurate and automated brain tumor segmentation from multi-modality MR images plays a significant role in tumor treatment. However, the existing approaches mainly focus on the fusion of multi-modality while ignoring the correlation between single-modality and tumor subcomponents. For example, T2-weighted images show good visualization of edema, and T1-contrast images have a good contrast between enhancing tumor core and necrosis. In the actual clinical process, professional physicians also label tumors according to these characteristics. We design a method for brain tumors segmentation that utilizes both multi-modality fusion and single-modality characteristics. Methods: A multi-modality and single-modality feature recalibration network (MSFR-Net) is proposed for brain tumor segmentation from MR images. Specifically, multi-modality information and single-modality information are assigned to independent pathways. Multi-modality network explicitly learns the relationship between all modalities and all tumor sub-components. Single-modality network learns the relationship between single-modality and its highly correlated tumor subcomponents. Then, a dual recalibration module (DRM) is designed to connect the parallel single-modality network and multi-modality network at multiple stages. The function of the DRM is to unify the two types of features into the same feature space. Results: Experiments on BraTS 2015 dataset and BraTS 2018 dataset show that the proposed method is competitive and superior to other state-of-the-art methods. The proposed method achieved the segmentation results with Dice coefficients of 0.86 and Hausdorff distance of 4.82 on BraTS 2018 dataset, with dice coefficients of 0.80, positive predictive value of 0.76, and sensitivity of 0.78 on BraTS 2015 dataset. Conclusions: This work combines the manual labeling process of doctors and introduces the correlation between single-modality and the tumor subcomponents into the segmentation network. The method improves the segmentation performance of brain tumors and can be applied in the clinical practice. The code of the proposed method is available at: https://github.com/xiangQAQ/MSFR-Net.

MRF-Net: A multi-branch residual fusion network for fast and accurate whole-brain MRI segmentation

Deep Convolutional Neural Network with a Multi-Scale Attention Feature Fusion Module for Segmentation of Multimodal Brain Tumor.

Simultaneous reconstruction and segmentation of MRI image by manifold learning

APRNet: A 3D Anisotropic Pyramidal Reversible Network with Multi-Modal Cross-Dimension Attention for Brain Tissue Segmentation in MR Images.

A Multi-channel Network with Image Retrieval for Accurate Brain Tissue Segmentation

MSFR-Net: Multi-modality and single-modality feature recalibration network for brain tumor segmentation

MFD-Net: Modality Fusion Diffractive Network for Segmentation of Multimodal Brain Tumor Image

A multi-path adaptive fusion network for multimodal brain tumor segmentation

Accurate Whole-Brain Segmentation for Bimodal PET/MR Images Via a Cross-Attention Mechanism

RFTNet: Region–Attention Fusion Network Combined with Dual-Branch Vision Transformer for Multimodal Brain Tumor Image Segmentation

mResU-Net: multi-scale residual U-Net-based brain tumor segmentation from multimodal MRI

Learning High-Resolution and Efficient Non-local Features for Brain Glioma Segmentation in MR Images

Whole brain segmentation with full volume neural network

MRS‐Net: Brain tumour segmentation network based on feature fusion and attention mechanism

Self-Supervised Multi-Modal Hybrid Fusion Network for Brain Tumor Segmentation.

Multi-Scale Networks For Segmentation Of Brain Magnetic Resonance Images

Multi -Modality Brain Tumor Segmentation Network Based on Collaborative Feature Fusion

RFNet: Region-aware Fusion Network for Incomplete Multi-modal Brain Tumor Segmentation

Res‐MulFra: Multilevel and Multiscale Framework for Brain Tumor Segmentation

Remu-Net: Multi-Branch Net Framework for 3D Brain Tumor Segmentation

Subcortical Brain Segmentation in MR Image Based on Residual Fully Convolutional Networks