Abstract:Fusing complementary information from different modalities can lead to the discovery of more accurate diagnostic biomarkers for psychiatric disorders. However, biomarker discovery through data fusion is challenging since it requires extracting interpretable and reproducible patterns from data sets, consisting of shared/unshared patterns and of different orders. For example, multi-channel electroencephalography (EEG) signals from multiple subjects can be represented as a third-order tensor with modes: subject, time, and channel, while functional magnetic resonance imaging (fMRI) data may be in the form of subject by voxel matrices. Traditional data fusion methods rearrange higher-order tensors, such as EEG, as matrices to use matrix factorization-based approaches. In contrast, fusion methods based on coupled matrix and tensor factorizations (CMTF) exploit the potential multi-way structure of higher-order tensors. The CMTF approach has been shown to capture underlying patterns more accurately without imposing strong constraints on the latent neural patterns, i.e., biomarkers. In this paper, EEG, fMRI, and structural MRI (sMRI) data collected during an auditory oddball task (AOD) from a group of subjects consisting of patients with schizophrenia and healthy controls, are arranged as matrices and higher-order tensors coupled along the subject mode, and jointly analyzed using structure-revealing CMTF methods [also known as advanced CMTF (ACMTF)] focusing on unique identification of underlying patterns in the presence of shared/unshared patterns. We demonstrate that joint analysis of the EEG tensor and fMRI matrix using ACMTF reveals significant and biologically meaningful components in terms of differentiating between patients with schizophrenia and healthy controls while also providing spatial patterns with high resolution and improving the clustering performance compared to the analysis of only the EEG tensor. We also show that these patterns are reproducible, and study reproducibility for different model parameters. In comparison to the joint independent component analysis (jICA) data fusion approach, ACMTF provides easier interpretation of EEG data by revealing a single summary map of the topography for each component. Furthermore, fusion of sMRI data with EEG and fMRI through an ACMTF model provides structural patterns; however, we also show that when fusing data sets from multiple modalities, hence of very different nature, preprocessing plays a crucial role.

Combination of Resting State fMRI, DTI, and sMRI Data to Discriminate Schizophrenia by N-way MCCA + jICA.

Combining Multi-Modality Data for Searching Biomarkers in Schizophrenia

Classification of First-Episode Schizophrenia Using Multimodal Brain Features: A Combined Structural and Diffusion Imaging Study

A CCA+ICA Based Model for Multi-Task Brain Imaging Data Fusion and Its Application to Schizophrenia

A Multimodal Fusion Analysis of Pretreatment Anatomical and Functional Cortical Abnormalities in Responsive and Non-responsive Schizophrenia.

Fusion Analysis of Gray Matter and White Matter in Subjective Cognitive Decline and Mild Cognitive Impairment by Multimodal CCA-joint ICA

Discussion on the Application of Multi-modal Magnetic Resonance Imaging Fusion in Schizophrenia

Linked 4-Way Multimodal Brain Differences in Schizophrenia in a Large Chinese Han Population.

Multimodal Neuromarkers in Schizophrenia Via Cognition-Guided MRI Fusion

Multimodal classification of drug-naïve first-episode schizophrenia combining anatomical, diffusion and resting state functional resonance imaging.

Unraveling Diagnostic Biomarkers of Schizophrenia Through Structure-Revealing Fusion of Multi-Modal Neuroimaging Data

Multimodal fusion of multiple rest fMRI networks and MRI gray matter via parallel multilink joint ICA reveals highly significant function/structure coupling in Alzheimer's disease

Structural Covariance of Depth-Dependent Intracortical Myelination in the Human Brain and Its Application to Drug-Naive Schizophrenia: a T1w/T2w MRI Study

In Search of Multimodal Neuroimaging Biomarkers of Cognitive Deficits in Schizophrenia.

Multimodal MRI assessment for first episode psychosis: A major change in the thalamus and an efficient stratification of a subgroup

Discriminative Analysis of Schizophrenia Patients Using Topological Properties of Structural and Functional Brain Networks: A Multimodal Magnetic Resonance Imaging Study

Parallel Group ICA+ICA: Joint Estimation of Linked Functional Network Variability and Structural Covariation with Application to Schizophrenia

Multimodal Analysis of Structural and Functional MRI for Schizophrenia Diagnosis

Identification of MCI individuals using structural and functional connectivity networks

Identification of Amnestic Mild Cognitive Impairment Using Multi-Modal Brain Features: A Combined Structural MRI and Diffusion Tensor Imaging Study.

Adaptive Structured Sparse Multiview Canonical Correlation Analysis for Multimodal Brain Imaging Association Identification