Abstract:ABSTRACT Brain tumor segmentation is paramount in medical diagnostics. This study presents a multistage segmentation model consisting of two main steps. First, the fusion of magnetic resonance imaging (MRI) modalities creates new and more effective tumor imaging modalities. Second, the semantic segmentation of the original and fused modalities, utilizing various modified architectures of the U‐Net model. In the first step, a residual network with multi‐scale backbone architecture (Res2Net) and guided filter are employed for pixel‐by‐pixel image fusion tasks without requiring any training or learning process. This method captures both detailed and base elements from the multimodal images to produce better and more informative fused images that significantly enhance the segmentation process. Many fusion scenarios were performed and analyzed, revealing that the best fusion results are attained when combining T2‐weighted (T2) with fluid‐attenuated inversion recovery (FLAIR) and T1‐weighted contrast‐enhanced (T1CE) with FLAIR modalities. In the second step, several models, including the U‐Net and its many modifications (adding attention layers, residual connections, and depthwise separable connections), are trained using both the original and fused modalities. Further, a “Model Selection‐based” fusion of these individual models is also considered for more enhancement. In the preprocessing step, the images are resized by cropping them to decrease the pixel count and minimize background interference. Experiments utilizing the brain tumor segmentation (BraTS) 2020 dataset were performed to verify the efficiency and accuracy of the proposed methodology. The “Model Selection‐based” fusion model achieved an average Dice score of 88.4%, an individual score of 91.1% for the whole tumor (WT) class, an average sensitivity score of 86.26%, and a specificity score of 91.7%. These results prove the robustness and high performance of the proposed methodology compared to other state‐of‐the‐art methods.

Brain tumor image segmentation algorithm based on multimodal feature fusion of Bayesian weight distribution

Brain tumor segmentation by combining MultiEncoder UNet with wavelet fusion

Brain Tumor Segmentation in Multimodal MRI Via Pixel-Level and Feature-Level Image Fusion.

MM-UNet: A multimodality brain tumor segmentation network in MRI images

Multimodal brain tumor image segmentation based on DenseNet

Brain Tumor Segmentation Based on Attention Mechanism and Multi-model Fusion

Modality-level cross-connection and attentional feature fusion based deep neural network for multi-modal brain tumor segmentation

Multi -Modality Brain Tumor Segmentation Network Based on Collaborative Feature Fusion

Brain Tumor Image Segmentation Network Based on Dual Attention Mechanism.

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

A Novel End-to-end Brain Tumor Segmentation Method Using Improved Fully Convolutional Networks.

Magnetic Resonance Brain Tumor Image Segmentation Based on Attention U-Net

Multimodal Fusion for Enhanced Semantic Segmentation in Brain Tumor Imaging: Integrating Deep Learning and Guided Filtering Via Advanced 3D Semantic Segmentation Architectures

SF-Net: A Multi-Task Model for Brain Tumor Segmentation in Multimodal MRI via Image Fusion

Deep Convolutional Neural Network with a Multi-Scale Attention Feature Fusion Module for Segmentation of Multimodal Brain Tumor.

Brain Tumor Segmentation Network Using Attention-based Fusion and Spatial Relationship Constraint

Brain tumor pathological image segmentation based on residual U-net ++ network

MRI Brain Tumour Segmentation Using Multiscale Attention U-Net

SEResU-Net for Multimodal Brain Tumor Segmentation

Automatic Brain Tumor Segmentation By Exploring The Multi-Modality Complementary Information And Cascaded 3d Lightweight Cnns

Learning rich features with hybrid loss for brain tumor segmentation