Abstract:In this article, we proposed a multimodal fusion approach for joint analysis between multiple rest functional magnetic resonance imaging (fMRI) networks and MRI gray matter using multilink joint independent component analysis (jICA). There are several novel aspects of this study including joint relationship between multiple rest fMRI networks and gray matter, alternating learning of jICA parameters, etc. Results show significant differences in joint coupling between Alzheimer's disease and controls. In this article, we focus on estimating the joint relationship between structural magnetic resonance imaging (sMRI) gray matter (GM), and multiple functional MRI (fMRI) intrinsic connectivity networks (ICNs). To achieve this, we propose a multilink joint independent component analysis (ml‐jICA) method using the same core algorithm as jICA. To relax the jICA assumption, we propose another extension called parallel multilink jICA (pml‐jICA) that allows for a more balanced weight distribution over ml‐jICA/jICA. We assume a shared mixing matrix for both the sMRI and fMRI modalities, while allowing for different mixing matrices linking the sMRI data to the different ICNs. We introduce the model and then apply this approach to study the differences in resting fMRI and sMRI data from patients with Alzheimer's disease (AD) versus controls. The results of the pml‐jICA yield significant differences with large effect sizes that include regions in overlapping portions of default mode network, and also hippocampus and thalamus. Importantly, we identify two joint components with partially overlapping regions which show opposite effects for AD versus controls, but were able to be separated due to being linked to distinct functional and structural patterns. This highlights the unique strength of our approach and multimodal fusion approaches generally in revealing potentially biomarkers of brain disorders that would likely be missed by a unimodal approach. These results represent the first work linking multiple fMRI ICNs to GM components within a multimodal data fusion model and challenges the typical view that brain structure is more sensitive to AD than fMRI.

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Enhancing Performance of Linked Independent Component Analysis: Investigating the Influence of Subjects and Modalities

Copula-Linked Parallel ICA: A Method for Coupling Structural and Functional MRI brain Networks

Parallel Multilink Group Joint ICA: Fusion of 3D Structural and 4D Functional Data Across Multiple Resting fMRI Networks

Parallel Group ICA+ICA: Joint Estimation of Linked Functional Network Variability and Structural Covariation with Application to Schizophrenia

Multimodal fusion of multiple rest fMRI networks and MRI gray matter via parallel multilink joint ICA reveals highly significant function/structure coupling in Alzheimer's disease

Incomplete multi-modal brain image fusion for epilepsy classification

Multimodal medical image fusion based on IHS and PCA

ICA-based Feature Extraction and Automatic Classification of AD-related MRI Data

Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease

A CCA+ICA Based Model for Multi-Task Brain Imaging Data Fusion and Its Application to Schizophrenia

Multi-source Feature Learning for Joint Analysis of Incomplete Multiple Heterogeneous Neuroimaging Data

Persistent Feature Analysis of Multimodal Brain Networks Using Generalized Fused Lasso for EMCI Identification

A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data

Inter-modality Dependence Induced Data Recovery for MCI Conversion Prediction

A Review of Multivariate Methods in Brain Imaging Data Fusion

Alzheimer's disease diagnosis from multi-modal data via feature inductive learning and dual multilevel graph neural network

CIRF: Coupled Image Reconstruction and Fusion Strategy for Deep Learning Based Multi-Modal Image Fusion

A hierarchical independent component analysis model for longitudinal Neuroimaging studies

Improved FastICA Algorithm in Fmri Data Analysis Using the Sparsity Property of the Sources

Alzheimer’s Disease Diagnosis from Multi-Modal Data Via Feature Inductive Learning and Dual Multilevel Graph Neural Network