Abstract:Objective. Realizing neurotechnologies that enable long-term neural recordings across multiple spatial-temporal scales during naturalistic behaviors requires new modeling and inference methods that can simultaneously address two challenges. First, the methods should aggregate information across all activity scales from multiple recording sources such as spiking and field potentials. Second, the methods should detect changes in the regimes of behavior and/or neural dynamics during naturalistic scenarios and long-term recordings. Prior regime detection methods are developed for a single scale of activity rather than multiscale activity, and prior multiscale methods have not considered regime switching and are for stationary cases. Approach. Here, we address both challenges by developing a Switching Multiscale Dynamical System model and the associated filtering and smoothing methods. This model describes the encoding of an unobserved brain state in multiscale spike-field activity. It also allows for regime-switching dynamics using an unobserved regime state that dictates the dynamical and encoding parameters at every time-step. We also design the associated switching multiscale inference methods that estimate both the unobserved regime and brain states from simultaneous spike-field activity. Main results. We validate the methods in both extensive numerical simulations and prefrontal spike-field data recorded in a monkey performing saccades for fluid rewards. We show that these methods can successfully combine the spiking and field potential observations to simultaneously track the regime and brain states accurately. Doing so, these methods lead to better state estimation compared with single-scale switching methods or stationary multiscale methods. Also, for single-scale linear Gaussian observations, the new switching smoother can better generalize to diverse system settings compared to prior switching smoothers. Significance. These modeling and inference methods effectively incorporate both regime-detection and multiscale observations. As such, they could facilitate investigation of latent switching neural population dynamics and improve future brain-machine interfaces by enabling inference in naturalistic scenarios where regime-dependent multiscale activity and behavior arise.

Tree-Structured Recurrent Switching Linear Dynamical Systems for Multi-Scale Modeling

Recurrent switching linear dynamical systems

A Generalized Framework for Multiscale State-Space Modeling with Nested Nonlinear Dynamics: An Application to Bayesian Learning under Switching Regimes

Relational State-Space Model for Stochastic Multi-Object Systems

Bayesian Inference of Recurrent Switching Linear Dynamical Systems with Higher-Order Dependence

Structure-Exploiting variational inference for recurrent switching linear dynamical systems

Modeling and inference methods for switching regime-dependent dynamical systems with multiscale neural observations

Recurrent Switching Dynamical Systems Models for Multiple Interacting Neural Populations

Parsing neural dynamics with infinite recurrent switching linear dynamical systems

Modeling communication and switching nonlinear dynamics in multi-region neural activity

Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems

Discovering group dynamics in coordinated time series via hierarchical recurrent switching-state models

Graph Switching Dynamical Systems

Data-driven Effective Modeling of Multiscale Stochastic Dynamical Systems

Dynamical Systems Trees

Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Markov Chain Monte Carlo for Continuous-Time Switching Dynamical Systems

Efficient Neural Hybrid System Learning and Transition System Abstraction for Dynamical Systems

Identification of Recurrent Dynamics in Distributed Neural Populations

Naïve Bayes switching linear dynamical system: A model for dynamic system modelling, classification, and information fusion