Abstract:A bstract Connectome-based neural mass modelling is the emerging computational neuroscience paradigm for simulating large-scale network dynamics observed in whole-brain activity measurements such as fMRI, M/EEG, and related techniques. Estimating physiological parameters by fitting these models to empirical data is challenging however, due to large network sizes, often physiologically detailed fast-timescale system equations, and the need for long (e.g. tens of minutes) simulation runs. Here we introduce a novel approach to connectome-based neural mass model parameter estimation by employing optimization tools developed for deep learning. We cast the system of differential equations representing both neural and haemodynamic activity dynamics as a deep neural network, implemented within a widely used machine learning programming environment (PyTorch). This allows us to use robust industry-standard optimization algorithms, automatic differentiation for computation of gradients, and other useful functionality. The approach is demonstrated using a connectome-based network with nodal dynamics specified by the two-state RWW mean-field neural mass model equations, which we use here as a model of fMRI-measured activity and correlation fluctuations. Additional optimization constraints are explored and prove fruitful, including restricting the model to domains of parameter space near a bifurcation point that yield metastable dynamics. Using these techniques, we first show robust recovery of physiological model parameters in synthetic data and then, as a proof-of-principle, apply the framework to modelling of empirical resting-state fMRI data from the Human Connectome Project database. For resting state activity, the system can be understood as a deep net that receives uncorrelated noise on its input layer, which is transformed into network-wide modelled functional connectivity on its output layer. This is consistent with the prevailing conception in theoretical neuroscience of resting-state functional connectivity patterns as an emergent phenomenon that is driven by (effectively) random activity fluctuations, which are then in turn spatiotemporally filtered by anatomical connectivity and local neural dynamics.

Gradient Diffusion: Enhancing Multicompartmental Neuron Models for Gradient-Based Self-Tuning and Homeostatic Control

Efficient optimization of ODE neuron models using gradient descent

A Differentiable Approach to Multi-scale Brain Modeling

A Robust Evolutionary Optimisation Approach For Parameterising A Neural Mass Model

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

Brain-like learning with exponentiated gradients

Gradient-Free Neural Network Training via Synaptic-Level Reinforcement Learning

Multitask learning of a biophysically-detailed neuron model

Using NEURON for Reaction-Diffusion Modeling of Extracellular Dynamics

Deep Learning-Based Parameter Estimation for Neurophysiological Models of Neuroimaging Data

Gradient Guidance for Diffusion Models: An Optimization Perspective

AdjointDEIS: Efficient Gradients for Diffusion Models

A Gradient Descent Method for Optimization of Model Microvascular Networks

Differentiable simulation enables large-scale training of detailed biophysical models of neural dynamics

An electrodiffusive neuron-extracellular-glia model for exploring the genesis of slow potentials in the brain

Augmenting Differentiable Simulators with Neural Networks to Close the Sim2Real Gap

Gradient Routing: Masking Gradients to Localize Computation in Neural Networks

Gradients of Brain Organization: Smooth Sailing from Methods Development to User Community

Fitting Stochastic Lattice Models Using Approximate Gradients

Gradient matching accelerates mixed-effects inference for biochemical networks