Abstract:Accurate segmentation of brain tumors in multimodal magnetic resonance imaging (MRI) plays a crucial role in clinical quantitative assessments, diagnostic processes, and the planning of therapeutic strategies. Both convolutional neural networks (CNNs) with strong local information extraction capacities and Transformers with excellent global representation capacities have achieved remarkable performance in medical image segmentation. However, considering the inherent semantic disparities between local and global features, effectively combining convolutions and Transformers presents a significant challenge in medical image segmentation. To address this issue, through integrating the merits of these two paradigms in a well-designed encoder–decoder architecture, we propose a hybrid CNN–Transformer network with semantic awareness, named TransSea, for an accurate 3-D brain tumor segmentation task. Our network incorporates a semantic mutual attention (SMA) module at the encoding stage, seamlessly integrating global and local features. Furthermore, our design includes a multiscale semantic guidance (SG) module that introduces semantic priors in the encoder through semantic supervision, enabling focused segmentation in relevant areas. In the decoding process, a semantic integration (SI) module is presented to further integrate various feature mappings from the encoder and semantic priors, thereby enhancing the propagation of semantic information and achieving semantically aware querying. Extensive experiments on two brain tumor datasets, BraTS2020 and BraTS2021, demonstrate that our model significantly outperforms existing state-of-the-art methods. The source code of the proposed method will be made available at https://github.com/yuliu316316.

Rethinking Deep Supervision for Brain Tumor Segmentation

A Deep-Learning Model with Learnable Group Convolution and Deep Supervision for Brain Tumor Segmentation

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

DTASUnet: a local and global dual transformer with the attention supervision U-network for brain tumor segmentation

TransSea: Hybrid CNN–Transformer With Semantic Awareness for 3-D Brain Tumor Segmentation

Learning Contextual and Attentive Information for Brain Tumor Segmentation

A Deep Multi-Task Learning Framework for Brain Tumor Segmentation

3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation

Segmentation then Prediction: A Multi-task Solution to Brain Tumor Segmentation and Survival Prediction

TransBTS: Multimodal Brain Tumor Segmentation Using Transformer

Ensemble Learning with Residual Transformer for Brain Tumor Segmentation

A novel deep learning model DDU-net using edge features to enhance brain tumor segmentation on MR images

Automatic Segmentation of MRI of Brain Tumor Using Deep Convolutional Network

DAUnet: A U-shaped network combining deep supervision and attention for brain tumor segmentation

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

An Intelligent Diagnosis Method of Brain MRI Tumor Segmentation Using Deep Convolutional Neural Network and SVM Algorithm

DRRNet: Dense Residual Refine Networks for Automatic Brain Tumor Segmentation

Modality-Pairing Learning for Brain Tumor Segmentation

Gradient-assisted deep model for brain tumor segmentation by multi-modality MRI volumes

Brain Tumor Segmentation Based on Deep Learning, Attention Mechanisms, and Energy-Based Uncertainty Prediction

CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer with Modality-Correlated Cross-Attention for Brain Tumor Segmentation