Abstract:Fusing complementary information from different modalities can lead to the discovery of more accurate diagnostic biomarkers for psychiatric disorders. However, biomarker discovery through data fusion is challenging since it requires extracting interpretable and reproducible patterns from data sets, consisting of shared/unshared patterns and of different orders. For example, multi-channel electroencephalography (EEG) signals from multiple subjects can be represented as a third-order tensor with modes: subject, time, and channel, while functional magnetic resonance imaging (fMRI) data may be in the form of subject by voxel matrices. Traditional data fusion methods rearrange higher-order tensors, such as EEG, as matrices to use matrix factorization-based approaches. In contrast, fusion methods based on coupled matrix and tensor factorizations (CMTF) exploit the potential multi-way structure of higher-order tensors. The CMTF approach has been shown to capture underlying patterns more accurately without imposing strong constraints on the latent neural patterns, i.e., biomarkers. In this paper, EEG, fMRI, and structural MRI (sMRI) data collected during an auditory oddball task (AOD) from a group of subjects consisting of patients with schizophrenia and healthy controls, are arranged as matrices and higher-order tensors coupled along the subject mode, and jointly analyzed using structure-revealing CMTF methods [also known as advanced CMTF (ACMTF)] focusing on unique identification of underlying patterns in the presence of shared/unshared patterns. We demonstrate that joint analysis of the EEG tensor and fMRI matrix using ACMTF reveals significant and biologically meaningful components in terms of differentiating between patients with schizophrenia and healthy controls while also providing spatial patterns with high resolution and improving the clustering performance compared to the analysis of only the EEG tensor. We also show that these patterns are reproducible, and study reproducibility for different model parameters. In comparison to the joint independent component analysis (jICA) data fusion approach, ACMTF provides easier interpretation of EEG data by revealing a single summary map of the topography for each component. Furthermore, fusion of sMRI data with EEG and fMRI through an ACMTF model provides structural patterns; however, we also show that when fusing data sets from multiple modalities, hence of very different nature, preprocessing plays a crucial role.

Coupled canonical polyadic decomposition of multi-group fMRI data with spatial reference and orthonormality constraints

Clustered Cnmf for Fmri Data Analysis

Shift-Invariant Canonical Polyadic Decomposition of Complex-Valued Multi-Subject Fmri Data with a Phase Sparsity Constraint

Multi-subject Fmri Analysis Via Combined Independent Component Analysis and Shift-Invariant Canonical Polyadic Decomposition

Coupled CP tensor decomposition with shared and distinct components for multi-task fMRI data fusion

Constrained CPD of Complex-Valued Multi-Subject Fmri Data Via Alternating Rank-R and Rank-1 Least Squares

Dynamic functional network connectivity analysis in schizophrenia based on a spatiotemporal CPD framework

Shift-invariant rank-( L , L , 1, 1) BTD with 3D spatial pooling and orthonormalization: Application to multi-subject fMRI data

A Joint Constrained CCA Model for Network-Dependent Brain Subregion Parcellation

A CCA+ICA Based Model for Multi-Task Brain Imaging Data Fusion and Its Application to Schizophrenia

Multi-Paradigm fMRI Fusion via Sparse Tensor Decomposition in Brain Functional Connectivity Study

Multi-subject Fmri Data Analysis: Shift-invariant Tensor Factorization Vs. Group Independent Component Analysis

Separating 4D Multi-Task Fmri Data of Multiple Subjects by Independent Component Analysis with Projection.

Harmonization of Multi-Site Functional MRI Data with Dual-Projection Based ICA Model

Multi-set canonical correlation analysis for the fusion of concurrent single trial ERP and functional MRI

The Application of Independent Component Analysis with Projection Method to Two-Task Fmri Data over Multiple Subjects

Tucker Decomposition for Extracting Shared and Individual Spatial Maps from Multi-Subject Resting-State Fmri Data

FCNCP: A Coupled Nonnegative CANDECOMP/PARAFAC Decomposition Based on Federated Learning

Constrained Canonical Correlation Analysis for fMRI Analysis Utilizing Experimental Paradigm Information.

MG-TCCA: Tensor Canonical Correlation Analysis across Multiple Groups

Unraveling Diagnostic Biomarkers of Schizophrenia Through Structure-Revealing Fusion of Multi-Modal Neuroimaging Data