Abstract:For brain diseases, e.g., autism spectrum disorder (ASD), with unclear biological characteristics, the detection of imaging-based biomarkers is a critical task for diagnosis. Several landmark-based categorization approaches have been developed for the computer-aided diagnosis of brain diseases, such as Alzheimer's disease (AD), utilizing structural magnetic resonance imaging (sMRI). With the automatic detection of the landmarks of brain disease, more detailed brain features were identified for clinical diagnosis. Multi-instance learning is an effective technique for classifying brain diseases based on landmarks. The multiple-instance learning approach relies on the assumption of independent distribution hypotheses and is mostly focused on local information, thus the correlation among different brain regions may be ignored. However, according to previous research on ASD and AD, the abnormal development of different brain regions is highly correlated. Vision Transformers, with self-attention modules to capture the relationship between embedded patches from a whole image, have recently demonstrated superior performances in many computer vision tasks. Nevertheless, the utilization of 3D brain MRIs imposes a substantial computational load, especially while training with Vision Transformer. To address the challenges mentioned above, in this research, we proposed a landmark-based multi-instance Conv-Transformer (LD-MILCT) framework as a solution to the aforementioned issues in brain disease diagnosis. In this network, a two-stage multi-instance learning strategy was proposed to explore both spatial and morphological information between different brain regions; the Vision Transformer utilizes a multi-instance learning head (MIL head) to fully utilize the features that are not involved in the ultimate classification. We assessed our proposed framework using T1-weighted MRI images from both AD and ASD databases. Our method outperformed existing deep learning and landmark-based methods in terms of brain MRI classification tasks.

Autism spectrum disorders detection based on multi-task transformer neural network

Classifying ASD based on time-series fMRI using spatial-temporal transformer

ST-ASDNET: A BLSTM-FCN-Transformer basedASD Classification Model for Time-series fMRI

Identification of autism spectrum disorder using multi-regional resting-state data through an attention learning approach

AIMAFE: Autism Spectrum Disorder Identification with Multi-Atlas Deep Feature Representation and Ensemble Learning

Multi-scale Convolutional Network for fMRI-Based Diagnosis of Autism Spectrum Disorder

Classification and Diagnosis of Autism Spectrum Disorder Using Swin Transformer.

Autistic Spectrum Disorder Detection and Structural Biomarker Identification Using Self-Attention Model and Individual-Level Morphological Covariance Brain Networks

Self-Supervised Pre-training Tasks for an fMRI Time-series Transformer in Autism Detection

A Multiview Brain Network Transformer Fusing Individualized Information for Autism Spectrum Disorder Diagnosis

Multi-site Diagnostic Classification of Autism Spectrum Disorder Using Adversarial Deep Learning on Resting-State Fmri.

Multi-task Diagnosis for Autism Spectrum Disorders Using Multi-Modality Features: A Multi-Center Study.

Hierarchical feature extraction on functional brain networks for autism spectrum disorder identification with resting-state fMRI data

Multi-Class ASD Classification Based on Functional Connectivity and Functional Correlation Tensor via Multi-Source Domain Adaptation and Multi-View Sparse Representation

Multipattern graph convolutional network-based autism spectrum disorder identification

A multi-view convolutional neural network method combining attention mechanism for diagnosing autism spectrum disorder

Deep Multi-Instance Conv-Transformer Frameworks for Landmark-Based Brain MRI Classification

Autism Spectrum Disorder Detection by Hybrid Convolutional Recurrent Neural Networks from Structural and Resting State Functional MRI Images

Pretraining is All You Need: A Multi-Atlas Enhanced Transformer Framework for Autism Spectrum Disorder Classification

Multi-head Self-Attention Mechanism-Based Global Feature Learning Model for ASD Diagnosis

Dynamic graph transformer network via dual-view connectivity for autism spectrum disorder identification