Abstract:Autism spectrum disorder (ASD) is a condition observed in children who display abnormal patterns of interaction, behavior, and communication with others. Despite extensive research efforts, the underlying causes of this neurodevelopmental disorder and its biomarkers remain unknown. However, advancements in artificial intelligence and machine learning have improved clinicians' ability to diagnose ASD. This review paper investigates various MRI modalities to identify distinct features that characterize individuals with ASD compared to typical control subjects. The review then moves on to explore deep learning models for ASD diagnosis, including convolutional neural networks (CNNs), autoencoders, graph convolutions, attention networks, and other models. CNNs and their variations are particularly effective due to their capacity to learn structured image representations and identify reliable biomarkers for brain disorders. Computer vision transformers often employ CNN architectures with transfer learning techniques like fine-tuning and layer freezing to enhance image classification performance, surpassing traditional machine learning models. This review paper contributes in three main ways. Firstly, it provides a comprehensive overview of a recommended architecture for using vision transformers in the systematic ASD diagnostic process. To this end, the paper investigates various pre-trained vision architectures such as VGG, ResNet, Inception, InceptionResNet, DenseNet, and Swin models that were fine-tuned for ASD diagnosis and classification. Secondly, it discusses the vision transformers of 2020th like BiT, ViT, MobileViT, and ConvNeXt, and applying transfer learning methods in relation to their prospective practicality in ASD classification. Thirdly, it explores brain transformers that are pre-trained on medically rich data and MRI neuroimaging datasets. The paper recommends a systematic architecture for ASD diagnosis using brain transformers. It also reviews recently developed brain transformer-based models, such as METAFormer, Com-BrainTF, Brain Network, ST-Transformer, STCAL, BolT, and BrainFormer, discussing their deep transfer learning architectures and results in ASD detection. Additionally, the paper summarizes and discusses brain-related transformers for various brain disorders, such as MSGTN, STAGIN, and MedTransformer, in relation to their potential usefulness in ASD. The study suggests that developing specialized transformer-based models, following the success of natural language processing (NLP), can offer new directions for image classification problems in ASD brain biomarkers learning and classification. By incorporating the attention mechanism, treating MRI modalities as sequence prediction tasks trained on brain disorder classification problems, and fine-tuned on ASD datasets, brain transformers can show a great promise in ASD diagnosis.

Deep Multi-Instance Conv-Transformer Frameworks for Landmark-Based Brain MRI Classification

Autism spectrum disorders detection based on multi-task transformer neural network

Classifying ASD based on time-series fMRI using spatial-temporal transformer

Diagnosis of Alzheimer's disease via optimized lightweight convolution-attention and structural MRI

Joint transformer architecture in brain 3D MRI classification: its application in Alzheimer's disease classification

Enhancing MRI-Based Classification of Alzheimer's Disease with Explainable 3D Hybrid Compact Convolutional Transformers

A transformer-based unified multimodal framework for Alzheimer's disease assessment

Do it the transformer way: A comprehensive review of brain and vision transformers for autism spectrum disorder diagnosis and classification

A 3D Multiscale View Convolutional Neural Network with Attention for Mental Disease Diagnosis on MRI Images.

Multi-site MRI Harmonization Via Attention-Guided Deep Domain Adaptation for Brain Disorder Identification.

Multi-Slice Generation sMRI and fMRI for Autism Spectrum Disorder Diagnosis Using 3D-CNN and Vision Transformers

Multimodal transformer network for incomplete image generation and diagnosis of Alzheimer's disease

A Multiview Brain Network Transformer Fusing Individualized Information for Autism Spectrum Disorder Diagnosis

MDH-Net: Advancing 3D Brain MRI Registration with Multi-Stage Transformer and Dual-Stream Feature Refinement Hybrid Network

Classification and Diagnosis of Autism Spectrum Disorder Using Swin Transformer.

Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs

Introducing Vision Transformer for Alzheimer's Disease classification task with 3D input

Unsupervised brain imaging 3D anomaly detection and segmentation with transformers

Attention transformer mechanism and fusion-based deep learning architecture for MRI brain tumor classification system

Efficiently Training Vision Transformers on Structural MRI Scans for Alzheimer's Disease Detection

3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation