Abstract:Accurate medical image segmentation of brain tumors is necessary for the diagnosing, monitoring, and treating disease. In recent years, with the gradual emergence of multi-sequence magnetic resonance imaging (MRI), multi-modal MRI diagnosis has played an increasingly important role in the early diagnosis of brain tumors by providing complementary information for a given lesion. Different MRI modalities vary significantly in context, as well as in coarse and fine information. As the manual identification of brain tumors is very complicated, it usually requires the lengthy consultation of multiple experts. The automatic segmentation of brain tumors from MRI images can thus greatly reduce the workload of doctors and buy more time for treating patients. In this paper, we propose a multi-modal brain tumor segmentation framework that adopts the hybrid fusion of modality-specific features using a self-supervised learning strategy. The algorithm is based on a fully convolutional neural network. Firstly, we propose a multi-input architecture that learns independent features from multi-modal data, and can be adapted to different numbers of multi-modal inputs. Compared with single-modal multi-channel networks, our model provides a better feature extractor for segmentation tasks, which learns cross-modal information from multi-modal data. Secondly, we propose a new feature fusion scheme, named hybrid attentional fusion. This scheme enables the network to learn the hybrid representation of multiple features and capture the correlation information between them through an attention mechanism. Unlike popular methods, such as feature map concatenation, this scheme focuses on the complementarity between multi-modal data, which can significantly improve the segmentation results of specific regions. Thirdly, we propose a self-supervised learning strategy for brain tumor segmentation tasks. Our experimental results demonstrate the effectiveness of the proposed model against other state-of-the-art multi-modal medical segmentation methods.

Multi-scale Strategy Based 3D Dual-Encoder Brain Tumor Segmentation Network with Attention Mechanism.

Shape-Scale Co-Awareness Network for 3D Brain Tumor Segmentation.

Multi -Modality Brain Tumor Segmentation Network Based on Collaborative Feature Fusion

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

Automatic Brain Tumor Segmentation Using Multi-scale Features and Attention Mechanism

Deep Cascaded Attention Network for Multi-task Brain Tumor Segmentation.

Multimodal MRI brain tumor segmentation using 3D attention UNet with dense encoder blocks and residual decoder blocks

Automatic Brain Tumor Segmentation with Scale Attention Network

Multiscale Cnns For Brain Tumor Segmentation And Diagnosis

ME-Net: Multi-encoder Net Framework for Brain Tumor Segmentation.

Deep Convolutional Neural Network with a Multi-Scale Attention Feature Fusion Module for Segmentation of Multimodal Brain Tumor.

MRI Brain Tumour Segmentation Using Multiscale Attention U-Net

HybridCANet: UNet-like Network Bridging CNN and Attention for Multimodal Brain Image Segmentation.

Multiscale lightweight 3D segmentation algorithm with attention mechanism: Brain tumor image segmentation

MLRD-Net: 3D multiscale local cross-channel residual denoising network for MRI-based brain tumor segmentation

Brain tumor segmentation by combining MultiEncoder UNet with wavelet fusion

3D dense connectivity network with atrous convolutional feature pyramid for brain tumor segmentation in magnetic resonance imaging of human heads

Segmentation of Brain Gliomas Based on a Multi-modal Multi-scale Double-pathway 3D Residual CNN

Combined 3D CNN for Brain Tumor Segmentation

Three-Dimensional Parallel Convolution Neural Network Brain Tumor Segmentation Based on Dilated Convolution

Self-Supervised Multi-Modal Hybrid Fusion Network for Brain Tumor Segmentation.