Abstract:Brain Tumor Segmentation (BraTS) plays a critical role in clinical diagnosis, treatment planning, and monitoring the progression of brain tumors. However, due to the variability in tumor appearance, size, and intensity across different MRI modalities, automated segmentation remains a challenging task. In this study, we propose a novel Transformer-based framework, multiPI-TransBTS, which integrates multi-physical information to enhance segmentation accuracy. The model leverages spatial information, semantic information, and multi-modal imaging data, addressing the inherent heterogeneity in brain tumor characteristics. The multiPI-TransBTS framework consists of an encoder, an Adaptive Feature Fusion (AFF) module, and a multi-source, multi-scale feature decoder. The encoder incorporates a multi-branch architecture to separately extract modality-specific features from different MRI sequences. The AFF module fuses information from multiple sources using channel-wise and element-wise attention, ensuring effective feature recalibration. The decoder combines both common and task-specific features through a Task-Specific Feature Introduction (TSFI) strategy, producing accurate segmentation outputs for Whole Tumor (WT), Tumor Core (TC), and Enhancing Tumor (ET) regions. Comprehensive evaluations on the BraTS2019 and BraTS2020 datasets demonstrate the superiority of multiPI-TransBTS over the state-of-the-art methods. The model consistently achieves better Dice coefficients, Hausdorff distances, and Sensitivity scores, highlighting its effectiveness in addressing the BraTS challenges. Our results also indicate the need for further exploration of the balance between precision and recall in the ET segmentation task. The proposed framework represents a significant advancement in BraTS, with potential implications for improving clinical outcomes for brain tumor patients.

Segmentation then Prediction: A Multi-task Solution to Brain Tumor Segmentation and Survival Prediction

Tri-PANet: Triplanar Ensemble Network with Parallelly Aggregating Global and Local Information for Brain Tumor Segmentation

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning

Multi-task learning for concurrent survival prediction and semi-supervised segmentation of gliomas in brain MRI

Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features

A Deep Multi-Task Learning Framework for Brain Tumor Segmentation

Domain Knowledge Based Brain Tumor Segmentation and Overall Survival Prediction

Glioma Prognosis: Segmentation of the Tumor and Survival Prediction using Shape, Geometric and Clinical Information

A Novel Brain Tumor Segmentation Method Based on Im-proved Spatial Attention Mechanism and Multi-path Deep Neural Network

Exploring Task Structure for Brain Tumor Segmentation from Multi-modality MR Images.

Leveraging segmentation-guided spatial feature embedding for overall survival prediction in glioblastoma with multimodal magnetic resonance imaging

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

A Deep-Learning Model with Learnable Group Convolution and Deep Supervision for Brain Tumor Segmentation

multiPI-TransBTS: A Multi-Path Learning Framework for Brain Tumor Image Segmentation Based on Multi-Physical Information

Brain Tumor Segmentation and Survival Prediction

Ensemble of CNNs for Segmentation of Glioma Sub-regions with Survival Prediction

Learning Contextual and Attentive Information for Brain Tumor Segmentation

Modality-Pairing Learning for Brain Tumor Segmentation

One-Pass Multi-task Convolutional Neural Networks for Efficient Brain Tumor Segmentation.

Deep Cascaded Attention Network for Multi-task Brain Tumor Segmentation.

Segmentation of Brain Gliomas Based on a Multi-modal Multi-scale Double-pathway 3D Residual CNN