Abstract:In this article, we proposed a multimodal fusion approach for joint analysis between multiple rest functional magnetic resonance imaging (fMRI) networks and MRI gray matter using multilink joint independent component analysis (jICA). There are several novel aspects of this study including joint relationship between multiple rest fMRI networks and gray matter, alternating learning of jICA parameters, etc. Results show significant differences in joint coupling between Alzheimer's disease and controls. In this article, we focus on estimating the joint relationship between structural magnetic resonance imaging (sMRI) gray matter (GM), and multiple functional MRI (fMRI) intrinsic connectivity networks (ICNs). To achieve this, we propose a multilink joint independent component analysis (ml‐jICA) method using the same core algorithm as jICA. To relax the jICA assumption, we propose another extension called parallel multilink jICA (pml‐jICA) that allows for a more balanced weight distribution over ml‐jICA/jICA. We assume a shared mixing matrix for both the sMRI and fMRI modalities, while allowing for different mixing matrices linking the sMRI data to the different ICNs. We introduce the model and then apply this approach to study the differences in resting fMRI and sMRI data from patients with Alzheimer's disease (AD) versus controls. The results of the pml‐jICA yield significant differences with large effect sizes that include regions in overlapping portions of default mode network, and also hippocampus and thalamus. Importantly, we identify two joint components with partially overlapping regions which show opposite effects for AD versus controls, but were able to be separated due to being linked to distinct functional and structural patterns. This highlights the unique strength of our approach and multimodal fusion approaches generally in revealing potentially biomarkers of brain disorders that would likely be missed by a unimodal approach. These results represent the first work linking multiple fMRI ICNs to GM components within a multimodal data fusion model and challenges the typical view that brain structure is more sensitive to AD than fMRI.

Copula-Linked Parallel ICA: A Method for Coupling Structural and Functional MRI brain Networks

Parallel Multilink Group Joint ICA: Fusion of 3D Structural and 4D Functional Data Across Multiple Resting fMRI Networks

Parallel Group ICA+ICA: Joint Estimation of Linked Functional Network Variability and Structural Covariation with Application to Schizophrenia

Multimodal fusion of multiple rest fMRI networks and MRI gray matter via parallel multilink joint ICA reveals highly significant function/structure coupling in Alzheimer's disease

A spatially constrained independent component analysis jointly informed by structural and functional network connectivity

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Accurate estimation of functional brain connectivity via Bayesian ICA with population-derived priors

Functional Connectivity Network Estimation with an Inter-Similarity Prior for Mild Cognitive Impairment Classification

Enhancing Performance of Linked Independent Component Analysis: Investigating the Influence of Subjects and Modalities

A CCA+ICA Based Model for Multi-Task Brain Imaging Data Fusion and Its Application to Schizophrenia

Simultaneous EEG-fMRI: Trial level spatio-temporal fusion for hierarchically reliable information discovery

Multi-set canonical correlation analysis for the fusion of concurrent single trial ERP and functional MRI

Constrained Bayesian ICA for Brain Connectome Inference

A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data

Deep Fusion of Brain Structure-Function in Mild Cognitive Impairment

A hierarchical independent component analysis model for longitudinal Neuroimaging studies

Multi-Paradigm fMRI Fusion via Sparse Tensor Decomposition in Brain Functional Connectivity Study

A Framework for Exploring Non-Linear Functional Connectivity and Causality in the Human Brain: Mutual Connectivity Analysis (MCA) of Resting-State Functional MRI with Convergent Cross-Mapping and Non-Metric Clustering

Multi-subject Fmri Analysis Via Combined Independent Component Analysis and Shift-Invariant Canonical Polyadic Decomposition

Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI