Abstract:Functional and structural magnetic resonance imaging (fMRI and sMRI) are complementary approaches that can be used to study longitudinal brain changes in adolescents. Each individual modality offers distinct insights into the brain. Each individual modality may overlook crucial aspects of brain analysis. By combining them, we can uncover hidden brain connections and gain a more comprehensive understanding. In previous work, we identified multivariate patterns of change in whole-brain function during adolescence. In this work, we focus on linking functional change patterns (FCPs) to brain structure. We introduce two approaches and applied them to data from the Adolescent Brain and Cognitive Development (ABCD) dataset. First, we evaluate voxelwise sMRI-FCP coupling to identify structural patterns linked to our previously identified FCPs. Our approach revealed multiple interesting patterns in functional network connectivity (FNC) and gray matter volume (GMV) data that were linked to subject level variation. FCP components 2 and 4 exhibit extensive associations between their loadings and voxel-wise GMV data. Secondly, we leveraged a symmetric multimodal fusion technique called multiset canonical correlation analysis (mCCA) + joint independent component analysis (jICA). Using this approach, we identify structured FCPs such as one showing increased connectivity between visual and sensorimotor domains and decreased connectivity between sensorimotor and cognitive control domains, linked to structural change patterns (SCPs) including alterations in the bilateral sensorimotor cortex. Interestingly, females exhibit stronger coupling between brain functional and structural changes than males, highlighting sex-related differences. The combined results from both asymmetric and symmetric multimodal fusion methods underscore the intricate sex-specific nuances in neural dynamics. By utilizing two complementary multimodal approaches, our study enhances our understanding of the dynamic nature of brain connectivity and structure during the adolescent period, shedding light on the nuanced processes underlying adolescent brain development.

Explainable Multimodal Deep Dictionary Learning to Capture Developmental Differences From Three fMRI Paradigms

An Explainable Autoencoder with Multi-Paradigm Fmri Fusion for Identifying Differences in Dynamic Functional Connectivity During Brain Development

Sparse deep dictionary learning identifies differences of time-varying functional connectivity in brain neuro-developmental study

Deep Learning with Explainability for Characterizing Age-Related Intrinsic Differences in Dynamic Brain Functional Connectivity.

Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopment

Longitudinal Correlation Analysis for Decoding Multi-Modal Brain Development

Deep Multimodal Learning for the Diagnosis of Autism Spectrum Disorder

Modeling And Analysis Brain Development Via Discriminative Dictionary Learning

Spatio–Temporal Multimodal Developmental Learning

Analysis of Longitudinal Change Patterns in Developing Brain Using Functional and Structural Magnetic Resonance Imaging via Multimodal Fusion

Multimodal foundation models are better simulators of the human brain

Multi-Paradigm fMRI Fusion via Sparse Tensor Decomposition in Brain Functional Connectivity Study

Identifying individual brain development using multimodality brain network

Deep sr-DDL: Deep structurally regularized dynamic dictionary learning to integrate multimodal and dynamic functional connectomics data for multidimensional clinical characterizations

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

Multimodal functional deep learning for multiomics data

An Explainable Unified Framework of Spatio-Temporal Coupling Learning with Application to Dynamic Brain Functional Connectivity Analysis

Interpretable Multimodal Fusion Networks Reveal Mechanisms of Brain Cognition

Supervised Dictionary Learning for Inferring Concurrent Brain Networks

Characterizing And Differentiating Task-Based And Resting State Fmri Signals Via Two-Stage Dictionary Learning

A Joint Analysis of Multi-Paradigm fMRI Data With Its Application to Cognitive Study