Abstract:Functional magnetic resonance imaging (fMRI) is a powerful technique with the potential to estimate individual variations in behavioral and cognitive traits. Joint learning of multiple datasets can utilize their complementary information so as to improve learning performance, but it also gives rise to the challenge for data fusion to effectively integrate brain patterns elicited by multiple fMRI data. However, most of the current data fusion methods analyze each single dataset separately and further infer the relationship among them, which fail to utilize the multidimensional structure inherent across modalities and may ignore complex but important interactions. To address this issue, we propose a novel sparse tensor decomposition method to integrate multiple task-stimulus (paradigm) fMRI data. Seeing each paradigm fMRI as one modality, our proposed method considers the relationships across subjects and modalities simultaneously. In specific, a third-order tensor is first modeled by using the functional network connectivity (FNC) of subjects in multiple fMRI paradigms. A novel sparse tensor decomposition with the regularization terms is designed to factorize the tensor into a series of rank-one components, which can extract the shared components across modalities as the embedded features. The $L_{2,1}$-norm regularizer (i.e., group sparsity) is enforced to select a few common features among multiple subjects. Validation of the proposed method is performed on realistic three paradigm fMRI datasets from the Philadelphia Neurodevelopmental Cohort (PNC) study, for the study of the relationship between the FNC and human cognitive abilities. Experimental results show our method outperforms several other competing methods in the prediction of individuals with different cognitive behaviors via the wide range achievement test (WRAT). Furthermore, our method discovers the FNC related to the cognitive beha-iors, such as the connectivity associated with the default mode network (DMN) for three paradigms, and the connectivity between DMN and visual (VIS) domains within the emotion task.

Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks

Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks

Multi-scale and Multimodal Fusion of Tract-tracing, Myelin Stain and DTI-derived Fibers in Macaque Brains

Multi-faceted Neuroimaging Data Integration via Analysis of Subspaces

Inferring Group-Wise Consistent Multimodal Brain Networks Via Multi-View Spectral Clustering

Multi-Paradigm fMRI Fusion via Sparse Tensor Decomposition in Brain Functional Connectivity Study

Multiscale and multimodal fusion of tract-tracing and DTI-derived fibers in macaque brains

Exploring the Brain Characteristics of Structure-informed Functional Connectivity through Graph Attention Network

Anatomy-Guided Discovery of Large-Scale Consistent Connectivity-Based Cortical Landmarks

Brain Functional Connectivity Analysis via Graphical Deep Learning

Construction of Multi-Scale Consistent Brain Networks: Methods and Applications

Multi-graph Fusion for Functional Neuroimaging Biomarker Detection

Anatomy-Guided Spatio-Temporal Graph Convolutional Networks (Ag-Stgcns) for Modeling Functional Connectivity Between Gyri and Sulci Across Multiple Task Domains.

Brain Connectivity Analysis Methods for Better Understanding of Coupling

A Joint Analysis of Multi-Paradigm fMRI Data With Its Application to Cognitive Study

A Novel Interpretable Fusion Analytic Framework for Investigating Functional Brain Connectivity Differences in Cognitive Impairments

Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI

Evaluating the effects of high-throughput structural neuroimaging predictors on whole-brain functional connectome outcomes via network-based vector-on-matrix regression

A Framework for Exploring Non-Linear Functional Connectivity and Causality in the Human Brain: Mutual Connectivity Analysis (MCA) of Resting-State Functional MRI with Convergent Cross-Mapping and Non-Metric Clustering

Brain Imaging-to-Graph Generation using Adversarial Hierarchical Diffusion Models for MCI Causality Analysis

Integrating Multimodal Neuroimaging and Genetics: A Structurally-Linked Sparse Canonical Correlation Analysis Approach