Abstract:Accurate medical image segmentation of brain tumors is necessary for the diagnosing, monitoring, and treating disease. In recent years, with the gradual emergence of multi-sequence magnetic resonance imaging (MRI), multi-modal MRI diagnosis has played an increasingly important role in the early diagnosis of brain tumors by providing complementary information for a given lesion. Different MRI modalities vary significantly in context, as well as in coarse and fine information. As the manual identification of brain tumors is very complicated, it usually requires the lengthy consultation of multiple experts. The automatic segmentation of brain tumors from MRI images can thus greatly reduce the workload of doctors and buy more time for treating patients. In this paper, we propose a multi-modal brain tumor segmentation framework that adopts the hybrid fusion of modality-specific features using a self-supervised learning strategy. The algorithm is based on a fully convolutional neural network. Firstly, we propose a multi-input architecture that learns independent features from multi-modal data, and can be adapted to different numbers of multi-modal inputs. Compared with single-modal multi-channel networks, our model provides a better feature extractor for segmentation tasks, which learns cross-modal information from multi-modal data. Secondly, we propose a new feature fusion scheme, named hybrid attentional fusion. This scheme enables the network to learn the hybrid representation of multiple features and capture the correlation information between them through an attention mechanism. Unlike popular methods, such as feature map concatenation, this scheme focuses on the complementarity between multi-modal data, which can significantly improve the segmentation results of specific regions. Thirdly, we propose a self-supervised learning strategy for brain tumor segmentation tasks. Our experimental results demonstrate the effectiveness of the proposed model against other state-of-the-art multi-modal medical segmentation methods.

Hierarchical Cascaded Multi-Axis Window Self-Attention and Layer Feature Fusion for Brain Glioma Segmentation

Improved UNet‐based Magnetic Resonance Imaging Segmentation of Demyelinating Diseases with Small Lesion Regions

Application of U-Net Network Utilizing Multiattention Gate for MRI Segmentation of Brain Tumors

Deep Convolutional Neural Network with a Multi-Scale Attention Feature Fusion Module for Segmentation of Multimodal Brain Tumor.

Exploration of Multi-Scale Image Fusion Systems in Intelligent Medical Image Analysis

Cascaded Hybrid Residual U-Net for Glioma Segmentation.

2D-3D cascade network for glioma segmentation in multisequence MRI images using multiscale information

Advance Brain Tumor Segmentation Using Feature Fusion Methods with Deep U-Net Model with CNN for MRI Data

Learning High-Resolution and Efficient Non-local Features for Brain Glioma Segmentation in MR Images

Application of Deep Learning Technology in Glioma

HybridCANet: UNet-like Network Bridging CNN and Attention for Multimodal Brain Image Segmentation.

Brain tumor magnetic resonance image segmentation by a multiscale contextual attention module combined with a deep residual UNet (MCA-ResUNet)

Self-Supervised Multi-Modal Hybrid Fusion Network for Brain Tumor Segmentation.

Glioma Segmentation with Cascaded Unet

Multi-view Hierarchical Split Network for Brain Tumor Segmentation.

Multi -Modality Brain Tumor Segmentation Network Based on Collaborative Feature Fusion

LGMSU-Net: Local Features, Global Features, and Multi-Scale Features Fused the U-Shaped Network for Brain Tumor Segmentation

DAUnet: A U-shaped network combining deep supervision and attention for brain tumor segmentation

Multi-level Glioma Segmentation Using 3D U-Net Combined Attention Mechanism with Atrous Convolution.

Medical image segmentation based on self-supervised hybrid fusion network

Automatic Semantic Segmentation of Brain Gliomas from MRI Images Using a Deep Cascaded Neural Network