Abstract:Background: Accurate and automated brain tumor segmentation from multi-modality MR images plays a significant role in tumor treatment. However, the existing approaches mainly focus on the fusion of multi-modality while ignoring the correlation between single-modality and tumor subcomponents. For example, T2-weighted images show good visualization of edema, and T1-contrast images have a good contrast between enhancing tumor core and necrosis. In the actual clinical process, professional physicians also label tumors according to these characteristics. We design a method for brain tumors segmentation that utilizes both multi-modality fusion and single-modality characteristics. Methods: A multi-modality and single-modality feature recalibration network (MSFR-Net) is proposed for brain tumor segmentation from MR images. Specifically, multi-modality information and single-modality information are assigned to independent pathways. Multi-modality network explicitly learns the relationship between all modalities and all tumor sub-components. Single-modality network learns the relationship between single-modality and its highly correlated tumor subcomponents. Then, a dual recalibration module (DRM) is designed to connect the parallel single-modality network and multi-modality network at multiple stages. The function of the DRM is to unify the two types of features into the same feature space. Results: Experiments on BraTS 2015 dataset and BraTS 2018 dataset show that the proposed method is competitive and superior to other state-of-the-art methods. The proposed method achieved the segmentation results with Dice coefficients of 0.86 and Hausdorff distance of 4.82 on BraTS 2018 dataset, with dice coefficients of 0.80, positive predictive value of 0.76, and sensitivity of 0.78 on BraTS 2015 dataset. Conclusions: This work combines the manual labeling process of doctors and introduces the correlation between single-modality and the tumor subcomponents into the segmentation network. The method improves the segmentation performance of brain tumors and can be applied in the clinical practice. The code of the proposed method is available at: https://github.com/xiangQAQ/MSFR-Net.

SVF-Net: spatial and visual feature enhancement network for brain structure segmentation

EA-Net: Edge-aware network for brain structure segmentation via decoupled high and low frequency features

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

STF-Net: sparsification transformer coding guided network for subcortical brain structure segmentation

Contextual-wise Discriminative Feature Extraction and Robust Network Learning for Subcortical Structure Segmentation

SARFNet: Selective Layer and Axial Receptive Field Network for Multimodal Brain Tumor Segmentation

An efficient memory reserving-and-fading strategy for vector quantization based 3D brain segmentation and tumor extraction using an unsupervised deep learning network

MVSI-Net: Multi-view attention and multi-scale feature interaction for brain tumor segmentation

Sparse Dynamic Volume TransUNet with multi-level edge fusion for brain tumor segmentation

FECC-Net: A Novel Feature Enhancement and Context Capture Network Based on Brain MRI Images for Lesion Segmentation

MSDEnet: Multi-scale detail enhanced network based on human visual system for medical image segmentation

Region-based U-net for accelerated training and enhanced precision in deep brain segmentation

A Comprehensive Framework for Automated Segmentation of Perivascular Spaces in Brain MRI with the nnU-Net

Multi-Modality Reconstruction Attention and Difference Enhancement Network for Brain MRI Image Segmentation

Neighbouring-slice Guided Multi-View Framework for brain image segmentation

A Multi-channel Network with Image Retrieval for Accurate Brain Tissue Segmentation

Adaptable Global Network for Whole-Brain Segmentation with Symmetry Consistency Loss

Semi-supervised interactive fusion network for MR image segmentation

nnSegNeXt: A 3D Convolutional Network for Brain Tissue Segmentation Based on Quality Evaluation

Spatial-Frequency Dual Progressive Attention Network For Medical Image Segmentation

MSFR-Net: Multi-modality and single-modality feature recalibration network for brain tumor segmentation