Abstract:Structural magnetic resonance imaging (sMRI) provides accurate estimates of the brain's structural organization and learning invariant brain representations from sMRI is an enduring issue in neuroscience. Previous deep representation learning models ignore the fact that the brain, as the core of human cognitive activity, is distinct from other organs whose primary attribute is anatomy. Therefore, capturing the semantic structure that dominates interindividual cognitive variability is key to accurately representing the brain. Given that this high-level semantic information is subtle, distributed, and interdependently latent in the brain structure, sMRI-based models need to capture fine-grained details and understand how they relate to the overall global structure. However, existing models are optimized by simple objectives, making features collapse into homogeneity and worsening simultaneous representation of fine-grained information and holistic semantics, causing a lack of biological plausibility and interpretation of cognition. Here, we propose MCIAT, a unified framework that combines Multi-task Collaborative pre-training and Individual-Adaptive-Tokens fine-tuning. Specifically, we first synthesize restorative learning, age prediction auxiliary learning and adversarial learning as a joint proxy task for deep semantic representation learning. Then, a mutual-attention-based token selection method is proposed to highlight discriminative features. The proposed MCIAT achieves state-of-the-art diagnosis performance on the ADHD-200 dataset compared with several sMRI-based approaches and shows superior generalization on the MCIC and OASIS datasets. Moreover, we studied 12 behavioral tasks and found significant associations between cognitive functions and MCIAT-established representations, which verifies the interpretability of our proposed framework.

Extendable supervised dictionary learning for exploring diverse and concurrent brain activities in task-based fMRI

Supervised Dictionary Learning for Inferring Concurrent Brain Networks

Supervised Brain Network Learning Based on Deep Recurrent Neural Networks.

Task Fmri Data Analysis Based on Supervised Stochastic Coordinate Coding.

Characterizing And Differentiating Task-Based And Resting State Fmri Signals Via Two-Stage Dictionary Learning

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

A Hybrid Spatiotemporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multilevel Core Functional Components in Decoding Multitask Fmri Signals.

Multitask Fmri Data Classification Via Group-Wise Hybrid Temporal and Spatial Sparse Representations

Sparse representation of higher-order functional interaction patterns in task-based FMRI data.

Modeling Task FMRI Data via Supervised Stochastic Coordinate Coding.

Characterizing task-evoked and intrinsic functional networks from task-based fMRI data via two-stage sparse dictionary learning

Spatio-temporal Modeling of Connectome-Scale Brain Network Interactions Via Time-Evolving Graphs

Discovering and Characterizing Dynamic Functional Brain Networks in Task FMRI

Dual Temporal and Spatial Sparse Representation for Inferring Group-Wise Brain Networks from Resting-State Fmri Dataset

Modeling Cognitive Processes Via Multi-stage Consistent Functional Response Detection.

Decoding Task Sub-type States with Group Deep Bidirectional Recurrent Neural Network

Multi-task Collaborative Pre-training and Individual-adaptive-tokens Fine-tuning: A Unified Framework for Brain Representation Learning

Deep sr-DDL: Deep structurally regularized dynamic dictionary learning to integrate multimodal and dynamic functional connectomics data for multidimensional clinical characterizations

A Semi-Blind Online Dictionary Learning Approach for Fmri Data.

Sparse Representation of Group-Wise FMRI Signals

Modeling dynamic characteristics of brain functional connectivity networks using resting-state functional MRI