Abstract:How an individual's unique brain connectivity determines that individual's cognition, behavior, and risk for pathology is a fundamental question in basic and clinical neuroscience. In seeking answers, many have turned to machine learning, with some noting the particular promise of deep neural networks in modelling complex non-linear functions. However, it is not clear that complex functions actually exist between brain connectivity and behavior, and thus if deep neural networks necessarily outperform simpler linear models, or if their results would be interpretable. Here we show that, across 52 subject measures of cognition and behavior, deep neural networks fit to each brain region's connectivity outperform linear regression, particularly for the brain's connector hubs--regions with diverse brain connectivity--whereas the two approaches perform similarly when fit to brain systems. Critically, averaging deep neural network predictions across brain regions results in the most accurate predictions, demonstrating the ability of deep neural networks to easily model the various functions that exists between regional brain connectivity and behavior, carving the brain at its joints. Finally, we shine light into the black box of deep neural networks using multislice network models. We determined that the relationship between connector hubs and behavior is best captured by modular deep neural networks. Our results demonstrate that both simple and complex relationships exist between brain connectivity and behavior, and that deep neural networks can fit both. Moreover, deep neural networks are particularly powerful when they are first fit to the various functions of a system independently and then combined. Finally, deep neural networks are interpretable when their architectures are structurally characterized using multislice network models.

Deep latent variable joint cognitive modeling of neural signals and human behavior

Deep Latent Variable Modeling of Physiological Signals

Extracting Semantic-Dynamic Features for Long-Term Stable Brain Computer Interface.

Bayesian Models of Functional Connectomics and Behavior

Network modeling of dynamic brain interactions predicts emergence of neural information that supports human cognitive behavior

Bayesian Joint Modeling of Multiple Brain Functional Networks

Deep multivariate autoencoder for capturing complexity in Brain Structure and Behaviour Relationships

Deep Learning for Cognitive Neuroscience

Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics

Learnable latent embeddings for joint behavioural and neural analysis

Learning Neural Representations of Human Cognition across Many fMRI Studies

Modeling dynamic neural activity by combining naturalistic video stimuli and stimulus-independent latent factors

Deep Neural Networks Carve the Brain at its Joints

Modelling variability in dynamic functional brain networks using embeddings

Learning identifiable and interpretable latent models of high-dimensional neural activity using pi-VAE

Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRI

Modeling Cognitive Processes Via Multi-stage Consistent Functional Response Detection.

A QR Code for the Brain: A dynamical systems framework for computing neurophysiological biomarkers

Dynamic Causal Modeling in Probabilistic Programming Languages

Learning low-dimensional dynamics from whole-brain data improves task capture

Machine Learning on Dynamic Functional Connectivity: Promise, Pitfalls, and Interpretations