Abstract:Graph neural networks (GNNs) have received increasing interest in the medical imaging field given their powerful graph embedding ability to characterize the non-Euclidean structure of brain networks based on magnetic resonance imaging (MRI) data. However, previous studies are largely node-centralized and ignore edge features for graph classification tasks, resulting in moderate performance of graph classification accuracy. Moreover, the generalizability of GNN model is still far from satisfactory in brain disorder [e.g., autism spectrum disorder (ASD)] identification due to considerable individual differences in symptoms among patients as well as data heterogeneity among different sites. In order to address the above limitations, this study proposes a novel adversarial learning-based node-edge graph attention network (AL-NEGAT) for ASD identification based on multimodal MRI data. First, both node and edge features are modeled based on structural and functional MRI data to leverage complementary brain information and preserved in the constructed weighted adjacent matrix for individuals through the attention mechanism in the proposed NEGAT. Second, two AL methods are employed to improve the generalizability of NEGAT. Finally, a gradient-based saliency map strategy is utilized for model interpretation to identify important brain regions and connections contributing to the classification. Experimental results based on the public Autism Brain Imaging Data Exchange I (ABIDE I) data demonstrate that the proposed framework achieves a classification accuracy of 74.7% between ASD and typical developing (TD) groups based on 1007 subjects across 17 different sites and outperforms the state-of-the-art methods, indicating satisfying classification ability and generalizability of the proposed AL-NEGAT model. Our work provides a powerful tool for brain disorder identification.

Connecting Patients with Pre-diagnosis: A Multiple Graph Regularized Method for Mental Disorder Diagnosis

Attention-Like Multimodality Fusion With Data Augmentation for Diagnosis of Mental Disorders Using MRI

Multi-View and Multimodal Graph Convolutional Neural Network for Autism Spectrum Disorder Diagnosis

Graph Attention Model Embedded With Multi-Modal Knowledge For Depression Detection

Multi-Modal Diagnosis of Alzheimer's Disease using Interpretable Graph Convolutional Networks

Detecting Mental and Physical Disorders Using Multi-Task Learning Equipped with Knowledge Graph Attention Network

MM-GTUNets: Unified Multi-Modal Graph Deep Learning for Brain Disorders Prediction

DeepASD: a deep adversarial-regularized graph learning method for ASD diagnosis with multimodal data

Dynamic multi-site graph convolutional network for autism spectrum disorder identification

Constructing a Confidence-guided Multigraph Model for Cognitive Diagnosis in Personalized Learning

AMA-GCN: Adaptive Multi-layer Aggregation Graph Convolutional Network for Disease Prediction

Multipattern graph convolutional network-based autism spectrum disorder identification

HAGCN: A hybrid-order brain network-based graph convolution learning framework with multi-head attention for brain disorder classification

An adaptive multi-graph neural network with multimodal feature fusion learning for MDD detection

A Hybrid Graph Network Model for ASD Diagnosis Based on Resting-state EEG Signals

Knowledge-aware Multisite Adaptive Graph Transformer for Brain Disorder Diagnosis

Autism spectrum disorder diagnosis using the relational graph attention network

Adversarial Learning Based Node-Edge Graph Attention Networks for Autism Spectrum Disorder Identification

Toward Robust Early Detection of Alzheimer's Disease via an Integrated Multimodal Learning Approach

Population Graph-Based Multi-Model Ensemble Method for Diagnosing Autism Spectrum Disorder

Joint multi-site domain adaptation and multi-modality feature selection for the diagnosis of psychiatric disorders