Abstract:Brain tumor detection and classification are crucial steps in evaluating life-threatening abnormal tissues to provide appropriate treatment plans. For clinical assessment, Magnetic resonance imaging (MRI) is normally used because of its excellent quality and lack of ionizing radiation. However, as the volume of the data grows, manual processing of MRI images becomes expensive, time-taking, and error prone. Also, traditional automated detection systems struggle to handle complex image patterns, leading to reduced classification accuracy. So, this paper designs a reliable and effective brain tumor detection mechanism as a solution to these problems. The proposed "Vision Transformer with Attention and Linear Transformation module (VITALT)" system is a combination of modules such as Vision Transformer (ViT), Split bidirectional feature pyramid network (S-BiFPN), linear transformation module (LTM) and soft-quantization that effectively extracts features from complex brain structures. At first, to mitigate the training inaccuracies developed by dimension and quality constraints, the preprocessing steps such as resizing and normalization are executed. The preprocessed images are divided into number of patches and embedded into high-dimensional vector to provide more compact image representation. Subsequently, the global and local features in the image are captured through ViT module by learning the relationship between image patches. The multi-scale spatial features formed are then fused using S-BiFPN to increase the accuracy of prediction. By using LTM to improve the linear expression capability of the design, the characteristics that are most important for the classification of brain tumors are discovered. Also, soft quantization is used to minimize memory footprint and minimize quantization errors in detection. Finally, the head module with set of fully connected layers accurately classifies different classes of brain tumors. The experimental analysis conducted using four different benchmark brain tumor datasets shows the viability and reliability of the suggested VITALT system in predicting brain tumors, as measured by multiple evaluation metrics. The proposed system achieves classification accuracy of 99.08% for Dataset A, 98.97% for Dataset B, 98.82% for Dataset C and 99.15% for Dataset D. A high level of classification accuracy attained by the suggested system highlights its potential in medical imaging applications and its ability to contribute to improved surgical treatments.

A fine-tuned transformer model for brain tumor detection and classification

Exploring the Power of Deep Learning: Fine-Tuned Vision Transformer for Accurate and Efficient Brain Tumor Detection in MRI Scans

Combining the Transformer and Convolution for Effective Brain Tumor Classification Using MRI Images

Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration

Attention transformer mechanism and fusion-based deep learning architecture for MRI brain tumor classification system

VITALT: a robust and efficient brain tumor detection system using vision transformer with attention and linear transformation

Creating a deep learning model using a Swin Transformer and tree growth optimisation to classify brain tumour

Dual vision Transformer-DSUNET with feature fusion for brain tumor segmentation

Detection and classification of brain tumor using hybrid deep learning models

A Linear time shrinking-SL(t)-ViT approach for brain tumor identification and categorization

Brain Tumor Classification using Vision Transformer with Selective Cross-Attention Mechanism and Feature Calibration

Advancing brain tumor detection: harnessing the Swin Transformer’s power for accurate classification and performance analysis

Highly accurate brain tumor detection with high sensitivity using transform-based functions and machine learning algorithms

ViT-CB: Integrating hybrid Vision Transformer and CatBoost to enhanced brain tumor detection with SHAP

Brain tumor classification using fine-tuned transfer learning models on magnetic resonance imaging (MRI) images

3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation

Feature Extraction Using a Residual Deep Convolutional Neural Network (ResNet-152) and Optimized Feature Dimension Reduction for MRI Brain Tumor Classification

Deep Fusion Model for Brain Tumor Classification Using Fine-Grained Gradient Preservation

Adaptive fuzzy deformable fusion and optimized CNN with ensemble classification for automated brain tumor diagnosis

BMO based improved Lite Swin transformer for brain tumor detection using MRI images

Refining neural network algorithms for accurate brain tumor classification in MRI imagery