Abstract:A major tenet in theoretical neuroscience is that cognitive and behavioral processes are ultimately implemented in terms of the neural system dynamics. Accordingly, a major aim for the analysis of neurophysiological measurements should lie in the identification of the computational dynamics underlying task processing. Here we advance a state space model (SSM) based on generative piecewise-linear recurrent neural networks (PLRNN) to assess dynamics from neuroimaging data. In contrast to many other nonlinear time series models which have been proposed for reconstructing latent dynamics, our model is easily interpretable in neural terms, amenable to systematic dynamical systems analysis of the resulting set of equations, and can straightforwardly be transformed into an equivalent continuous-time dynamical system. The major contributions of this paper are the introduction of a new observation model suitable for functional magnetic resonance imaging (fMRI) coupled to the latent PLRNN, an efficient stepwise training procedure that forces the latent model to capture the 'true' underlying dynamics rather than just fitting (or predicting) the observations, and of an empirical measure based on the Kullback-Leibler divergence to evaluate from empirical time series how well this goal of approximating the underlying dynamics has been achieved. We validate and illustrate the power of our approach on simulated 'ground-truth' dynamical systems as well as on experimental fMRI time series, and demonstrate that the learnt dynamics harbors task-related nonlinear structure that a linear dynamical model fails to capture. Given that fMRI is one of the most common techniques for measuring brain activity non-invasively in human subjects, this approach may provide a novel step toward analyzing aberrant (nonlinear) dynamics for clinical assessment or neuroscientific research.

Dynamical system simulation with attention and recurrent neural networks

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Recurrent neural networks for dynamical systems: Applications to ordinary differential equations, collective motion, and hydrological modeling

Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networks

Identification of Recurrent Dynamics in Distributed Neural Populations

Ensemble of Multi-time Resolution Recurrent Neural Networks for Enhanced Feature Extraction in High-Rate Time Series

Non-linear system modeling using LSTM neural networks

A Novel Recurrent Neural Network for Dynamic Process Modeling with Inertia and Delay.

Nonlinear Dynamical System Simulation Based on Recurrent Wavelet Neural Network

Predictive Non-linear Dynamics via Neural Networks and Recurrence Plots

Identifying nonlinear dynamical systems with multiple time scales and long-range dependencies

On human motion prediction using recurrent neural networks

Deconstructing Recurrence, Attention, and Gating: Investigating the transferability of Transformers and Gated Recurrent Neural Networks in forecasting of dynamical systems

Deep Recurrent Stochastic Configuration Networks for Modelling Nonlinear Dynamic Systems

Long Short-Term Memory Networks with Attention Learning for High-Rate Structural Health Monitoring

Joint Modeling of Event Sequence and Time Series with Attentional Twin Recurrent Neural Networks

Data-Driven Predictive Modeling of Neuronal Dynamics using Long Short-Term Memory

Attention-enhanced neural network models for turbulence simulation

Online Multi-Target Tracking Using Recurrent Neural Networks

Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRI

Design, Verification, and Application of New Discrete-Time Recurrent Neural Network for Dynamic Nonlinear Equations Solving