Abstract:Understanding how the collective activity of neural populations relates to computation and ultimately behavior is a key goal in neuroscience. To this end, statistical methods which describe high-dimensional neural time series in terms of low-dimensional latent dynamics have played a fundamental role in characterizing neural systems. Yet, what constitutes a successful method involves two opposing criteria: (1) methods should be expressive enough to capture complex nonlinear dynamics, and (2) they should maintain a notion of interpretability often only warranted by simpler linear models. In this paper, we develop an approach that balances these two objectives: the Gaussian Process Switching Linear Dynamical System (gpSLDS). Our method builds on previous work modeling the latent state evolution via a stochastic differential equation whose nonlinear dynamics are described by a Gaussian process (GP-SDEs). We propose a novel kernel function which enforces smoothly interpolated locally linear dynamics, and therefore expresses flexible -- yet interpretable -- dynamics akin to those of recurrent switching linear dynamical systems (rSLDS). Our approach resolves key limitations of the rSLDS such as artifactual oscillations in dynamics near discrete state boundaries, while also providing posterior uncertainty estimates of the dynamics. To fit our models, we leverage a modified learning objective which improves the estimation accuracy of kernel hyperparameters compared to previous GP-SDE fitting approaches. We apply our method to synthetic data and data recorded in two neuroscience experiments and demonstrate favorable performance in comparison to the rSLDS.

What problem does this paper attempt to address?

The paper aims to address the complex dynamics of how neural population activity evolves over time in neuroscience, focusing on better understanding and modeling these dynamics. Specifically, the research goal is to ensure that the model is expressive enough to capture complex nonlinear dynamics while maintaining interpretability, which is crucial for understanding neural computation. To achieve this goal, the paper proposes a new model—the Gaussian Process Switching Linear Dynamical System (gpSLDS). This model combines the powerful expressiveness of the Gaussian Process Stochastic Differential Equation (GP-SDE) model with the good interpretability of the Switching Linear Dynamical System (rSLDS). The gpSLDS achieves this balance by introducing a novel kernel function that can describe locally linear dynamics with smooth transitions, thereby ensuring interpretability while maintaining flexibility. The paper addresses several key limitations of the rSLDS, including: 1. **Dynamic Uncertainty**: rSLDS models typically do not capture the posterior uncertainty of inferred dynamics, making it difficult to assess the importance of specific model features. 2. **Dynamic Discontinuity**: rSLDS tends to produce artificial oscillatory behavior near the boundaries of different dynamic states, affecting the model's interpretability and predictive performance. 3. **Continuity Assumption**: rSLDS does not impose smoothness or continuity assumptions on the dynamics, which are often natural and useful for modeling real neural systems. By using the gpSLDS model, researchers were able to validate its superiority on synthetic data and apply it to two real neuroscience experimental datasets, demonstrating better performance compared to rSLDS. Additionally, the paper proposes an improved learning algorithm to enhance the accuracy of model hyperparameter estimation and shows how to recover predictive dynamics from the model and quantify the model's confidence in the dynamics. In summary, the main contribution of this paper is the development of a new statistical method—gpSLDS—to address the problem of modeling neural population dynamics in neuroscience, particularly how to balance the trade-off between model expressiveness and interpretability.

Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems

Parsing neural dynamics with infinite recurrent switching linear dynamical systems

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

Recurrent switching linear dynamical systems

Recurrent Switching Dynamical Systems Models for Multiple Interacting Neural Populations

Neural Dynamics Discovery via Gaussian Process Recurrent Neural Networks

Modeling communication and switching nonlinear dynamics in multi-region neural activity

Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Linear Time GPs for Inferring Latent Trajectories from Neural Spike Trains

Structure-Exploiting variational inference for recurrent switching linear dynamical systems

Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics

Latent Variable Double Gaussian Process Model for Decoding Complex Neural Data

Identification of Gaussian Process State Space Models

Linear dynamical neural population models through nonlinear embeddings

Extended Poisson Gaussian-Process Latent Variable Model for Unsupervised Neural Decoding

Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRI

Latent Gaussian Process Regression

Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systems