Abstract:In recent years, deep learning approaches have gained significant attention in predicting brain disorders using neuroimaging data. However, conventional methods often rely on single-modality data and supervised models, which provide only a limited perspective of the intricacies of the highly complex brain. Moreover, the scarcity of accurate diagnostic labels in clinical settings hinders the applicability of the supervised models. To address these limitations, we propose a novel self-supervised framework for extracting multiple representations from multimodal neuroimaging data to enhance group inferences and enable analysis without resorting to labeled data during pre-training. Our approach leverages Deep InfoMax (DIM), a self-supervised methodology renowned for its efficacy in learning representations by estimating mutual information without the need for explicit labels. While DIM has shown promise in predicting brain disorders from single-modality MRI data, its potential for multimodal data remains untapped. This work extends DIM to multimodal neuroimaging data, allowing us to identify disorder-relevant brain regions and explore multimodal links. We present compelling evidence of the efficacy of our multimodal DIM analysis in uncovering disorder-relevant brain regions, including the hippocampus, caudate, insula, - and multimodal links with the thalamus, precuneus, and subthalamus hypothalamus. Our self-supervised representations demonstrate promising capabilities in predicting the presence of brain disorders across a spectrum of Alzheimer's phenotypes. Comparative evaluations against state-of-the-art unsupervised methods based on autoencoders, canonical correlation analysis, and supervised models highlight the superiority of our proposed method in achieving improved classification performance, capturing joint information, and interpretability capabilities. The computational efficiency of the decoder-free strategy enhances its practical utility, as it saves compute resources without compromising performance. This work offers a significant step forward in addressing the challenge of understanding multimodal links in complex brain disorders, with potential applications in neuroimaging research and clinical diagnosis.

Modularity-Constrained Dynamic Representation Learning for Interpretable Brain Disorder Analysis with Functional MRI.

Leveraging Brain Modularity Prior for Interpretable Representation Learning of fMRI

Modeling Brain Functional Dynamics Via Hidden Markov Models

Multi-Scale Dynamic Graph Learning for Brain Disorder Detection with Functional MRI

Function MRI Representation Learning via Self-supervised Transformer for Automated Brain Disorder Analysis.

Dynamic functional connections analysis with spectral learning for brain disorder detection

Connectional-Style-Guided Contextual Representation Learning for Brain Disease Diagnosis

Modeling dynamic characteristics of brain functional connectivity networks using resting-state functional MRI

Motif-Matching Based Sub-Braingraph Level Networks for Noisy Resting-State fMRI Analysis.

State-space model with deep learning for functional dynamics estimation in resting-state fMRI

Multi-Connectivity Representation Learning Network for Major Depressive Disorder Diagnosis

Towards Disease-Aware Self-Supervised Dynamic Brain Network Learning for Mental Diagnosis

Deep sr-DDL: Deep structurally regularized dynamic dictionary learning to integrate multimodal and dynamic functional connectomics data for multidimensional clinical characterizations

Functional2Structural: Cross-Modality Brain Networks Representation Learning

Unsupervised Contrastive Graph Learning for Resting‐state Functional MRI Analysis and Brain Disorder Detection

Reveal Consistent Spatial-Temporal Patterns from Dynamic Functional Connectivity for Autism Spectrum Disorder Identification.

Multimodal Brain Disease Classification with Functional Interaction Learning from Single fMRI Volume

Modeling the dynamic brain network representation for autism spectrum disorder diagnosis

Self-supervised multimodal learning for group inferences from MRI data: Discovering disorder-relevant brain regions and multimodal links