Abstract:The computational properties of neural systems are often thought to be implemented in terms of their network dynamics. Hence, recovering the system dynamics from experimentally observed neuronal time series, like multiple single-unit (MSU) recordings or neuroimaging data, is an important step toward understanding its computations. Ideally, one would not only seek a state space representation of the dynamics, but would wish to have access to its governing equations for in-depth analysis. Recurrent neural networks (RNNs) are a computationally powerful and dynamically universal formal framework which has been extensively studied from both the computational and the dynamical systems perspective. Here we develop a semi-analytical maximum-likelihood estimation scheme for piecewise-linear RNNs (PLRNNs) within the statistical framework of state space models, which accounts for noise in both the underlying latent dynamics and the observation process. The Expectation-Maximization algorithm is used to infer the latent state distribution, through a global Laplace approximation, and the PLRNN parameters iteratively. After validating the procedure on toy examples, the approach is applied to MSU recordings from the rodent anterior cingulate cortex obtained during performance of a classical working memory task, delayed alternation. A model with 5 states turned out to be sufficient to capture the essential computational dynamics underlying task performance, including stimulus-selective delay activity. The estimated models were rarely multi-stable, but rather were tuned to exhibit slow dynamics in the vicinity of a bifurcation point. In summary, the present work advances a semi-analytical (thus reasonably fast) maximum-likelihood estimation framework for PLRNNs that may enable to recover the relevant dynamics underlying observed neuronal time series, and directly link them to computational properties.

Expressive architectures enhance interpretability of dynamics-based neural population models

Expressive dynamics models with nonlinear injective readouts enable reliable recovery of latent features from neural activity

Learning low-dimensional dynamics from whole-brain data improves task capture

Sparsity in Continuous-Depth Neural Networks

Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Understanding Latent Timescales in Neural Ordinary Differential Equation Models for Advection-Dominated Dynamical Systems

Inferring single-trial neural population dynamics using sequential auto-encoders

Exploiting Chaotic Dynamics as Deep Neural Networks

Identification of Recurrent Dynamics in Distributed Neural Populations

Deep learning incorporating biologically-inspired neural dynamics

Lyapunov-Guided Representation of Recurrent Neural Network Performance

Partial observation can induce mechanistic mismatches in data-constrained models of neural dynamics

Parsing neural dynamics with infinite recurrent switching linear dynamical systems

Can neural networks predict dynamics they have never seen?

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

Linearly Recurrent Autoencoder Networks for Learning Dynamics

A State Space Approach for Piecewise-Linear Recurrent Neural Networks for Reconstructing Nonlinear Dynamics from Neural Measurements

Interpretability as Compression: Reconsidering SAE Explanations of Neural Activations with MDL-SAEs

Interpretable statistical representations of neural population dynamics and geometry

Linearly-Recurrent Autoencoder Networks for Learning Dynamics