Abstract:Brain tumors are one of the leading causes of cancer death; screening early is the best strategy to diagnose and treat brain tumors. Magnetic Resonance Imaging (MRI) is extensively utilized for brain tumor diagnosis; nevertheless, achieving improved accuracy and performance, a critical challenge in most of the previously reported automated medical diagnostics, is a complex problem. The study introduces the Dual Vision Transformer-DSUNET model, which incorporates feature fusion techniques to provide precise and efficient differentiation between brain tumors and other brain regions by leveraging multi-modal MRI data. The impetus for this study arises from the necessity of automating the segmentation process of brain tumors in medical imaging, a critical component in the realms of diagnosis and therapy strategy. The BRATS 2020 dataset is employed to tackle this issue, an extensively utilized dataset for segmenting brain tumors. This dataset encompasses multi-modal MRI images, including T1-weighted, T2-weighted, T1Gd (contrast-enhanced), and FLAIR modalities. The proposed model incorporates the dual vision idea to comprehensively capture the heterogeneous properties of brain tumors across several imaging modalities. Moreover, feature fusion techniques are implemented to augment the amalgamation of data originating from several modalities, enhancing the accuracy and dependability of tumor segmentation. The Dual Vision Transformer-DSUNET model's performance is evaluated using the Dice Coefficient as a prevalent metric for quantifying segmentation accuracy. The results obtained from the experiment exhibit remarkable performance, with Dice Coefficient values of 91.47 % for enhanced tumors, 92.38 % for core tumors, and 90.88 % for edema. The cumulative Dice score for the entirety of the classes is 91.29 %. In addition, the model has a high level of accuracy, roughly 99.93 %, which underscores its durability and efficacy in segmenting brain tumors. Experimental findings demonstrate the integrity of the suggested architecture, which has quickly improved the detection accuracy of many brain diseases.

Dual-branch Brain Tumor Classification Based on CNN and Transformer

Attention transformer mechanism and fusion-based deep learning architecture for MRI brain tumor classification system

RFTNet: Region–Attention Fusion Network Combined with Dual-Branch Vision Transformer for Multimodal Brain Tumor Image Segmentation

CSU-Net: A CNN-Transformer Parallel Network for Multimodal Brain Tumour Segmentation

Synergy Factorized Bilinear Network with a Dual Suppression Strategy for Brain Tumor Classification in MRI

CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer with Modality-Correlated Cross-Attention for Brain Tumor Segmentation

ResMT: A Hybrid CNN-transformer Framework for Glioma Grading with 3D MRI

Combining the Transformer and Convolution for Effective Brain Tumor Classification Using MRI Images

Brain Tumor MRI Classification Using a Novel Deep Residual and Regional CNN

A Multi-Task Transformer with Local-Global Feature Interaction and Multiple Tumoral Region Guidance for Breast Cancer Diagnosis

Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration

TransSea: Hybrid CNN–Transformer With Semantic Awareness for 3-D Brain Tumor Segmentation

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

Brain Tumor Classification with Tumor Segmentations and a Dual Path Residual Convolutional Neural Network from MRI and Pathology Images

Dual vision Transformer-DSUNET with feature fusion for brain tumor segmentation

MRI brain tumor detection and classification using parallel deep convolutional neural networks

DTASUnet: a local and global dual transformer with the attention supervision U-network for brain tumor segmentation

TransResUNet: Revolutionizing Glioma Brain Tumor Segmentation Through Transformer-Enhanced Residual UNet

BTSC-TNAS: A Neural Architecture Search-Based Transformer for Brain Tumor Segmentation and Classification.

TransBTS: Multimodal Brain Tumor Segmentation Using Transformer

An efficient R-Transformer network with dual encoders for brain glioma segmentation in MR images