Abstract:Functional magnetic resonance imaging (fMRI) is a powerful technique with the potential to estimate individual variations in behavioral and cognitive traits. Joint learning of multiple datasets can utilize their complementary information so as to improve learning performance, but it also gives rise to the challenge for data fusion to effectively integrate brain patterns elicited by multiple fMRI data. However, most of the current data fusion methods analyze each single dataset separately and further infer the relationship among them, which fail to utilize the multidimensional structure inherent across modalities and may ignore complex but important interactions. To address this issue, we propose a novel sparse tensor decomposition method to integrate multiple task-stimulus (paradigm) fMRI data. Seeing each paradigm fMRI as one modality, our proposed method considers the relationships across subjects and modalities simultaneously. In specific, a third-order tensor is first modeled by using the functional network connectivity (FNC) of subjects in multiple fMRI paradigms. A novel sparse tensor decomposition with the regularization terms is designed to factorize the tensor into a series of rank-one components, which can extract the shared components across modalities as the embedded features. The $L_{2,1}$-norm regularizer (i.e., group sparsity) is enforced to select a few common features among multiple subjects. Validation of the proposed method is performed on realistic three paradigm fMRI datasets from the Philadelphia Neurodevelopmental Cohort (PNC) study, for the study of the relationship between the FNC and human cognitive abilities. Experimental results show our method outperforms several other competing methods in the prediction of individuals with different cognitive behaviors via the wide range achievement test (WRAT). Furthermore, our method discovers the FNC related to the cognitive beha-iors, such as the connectivity associated with the default mode network (DMN) for three paradigms, and the connectivity between DMN and visual (VIS) domains within the emotion task.

Epidemiology of malaria and MSP-2 gene-based genetic diversity of Plasmodium falciparum from patients attending community health centre, Jiribam, Manipur

Multiscale and multimodal fusion of tract-tracing and DTI-derived fibers in macaque brains

Three-dimensional Simultaneous Brain Mapping of T1, T2, T2*and Magnetic Susceptibility with MR Multitasking

A Unified Global Tractography Framework for Automatic Visual Pathway Reconstruction.

Imaging the structural connectome with hybrid diffusion MRI-microscopy tractography

Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks

Unifying the analyses of anatomical and diffusion tensor images using volume-preserved warping.

Fusing DTI and fMRI data: A survey of methods and applications

Mapping brain-wide excitatory projectome of primate prefrontal cortex at submicron resolution and comparison with diffusion tractography

Optimization and Validation of Diffusion MRI-based Fiber Tracking with Neural Tracer Data as a Reference

Construction of Multi-Scale Consistent Brain Networks: Methods and Applications

Voxel-Wise Fusion of 3T and 7T Diffusion MRI Data to Extract more Accurate Fiber Orientations

Multi-Paradigm fMRI Fusion via Sparse Tensor Decomposition in Brain Functional Connectivity Study

Interplay between MRI-based axon diameter and myelination estimates in macaque and human brain

Multiscale Multimodal Medical Imaging - First International Workshop, MMMI 2019, Held in Conjunction with MICCAI 2019, Shenzhen, China, October 13, 2019, Proceedings

Multi-Modality Conditioned Variational U-Net for Field-of-View Extension in Brain Diffusion MRI

Study the Relationship of both Structure and Function in Visual System by Combining DTI and fMRI

Computing the variance of interval and fuzzy data

Quantitative mapping of the brain's structural connectivity using diffusion MRI tractography: a review

Resting State Fmri-Guided Fiber Clustering: Methods and Applications