Abstract:Objective. Realizing neurotechnologies that enable long-term neural recordings across multiple spatial-temporal scales during naturalistic behaviors requires new modeling and inference methods that can simultaneously address two challenges. First, the methods should aggregate information across all activity scales from multiple recording sources such as spiking and field potentials. Second, the methods should detect changes in the regimes of behavior and/or neural dynamics during naturalistic scenarios and long-term recordings. Prior regime detection methods are developed for a single scale of activity rather than multiscale activity, and prior multiscale methods have not considered regime switching and are for stationary cases. Approach. Here, we address both challenges by developing a Switching Multiscale Dynamical System model and the associated filtering and smoothing methods. This model describes the encoding of an unobserved brain state in multiscale spike-field activity. It also allows for regime-switching dynamics using an unobserved regime state that dictates the dynamical and encoding parameters at every time-step. We also design the associated switching multiscale inference methods that estimate both the unobserved regime and brain states from simultaneous spike-field activity. Main results. We validate the methods in both extensive numerical simulations and prefrontal spike-field data recorded in a monkey performing saccades for fluid rewards. We show that these methods can successfully combine the spiking and field potential observations to simultaneously track the regime and brain states accurately. Doing so, these methods lead to better state estimation compared with single-scale switching methods or stationary multiscale methods. Also, for single-scale linear Gaussian observations, the new switching smoother can better generalize to diverse system settings compared to prior switching smoothers. Significance. These modeling and inference methods effectively incorporate both regime-detection and multiscale observations. As such, they could facilitate investigation of latent switching neural population dynamics and improve future brain-machine interfaces by enabling inference in naturalistic scenarios where regime-dependent multiscale activity and behavior arise.

Hierarchical models for neural population dynamics in the presence of non-stationarity

Recurrent Switching Dynamical Systems Models for Multiple Interacting Neural Populations

Stable Neural Population Dynamics in the Regression Subspace for Continuous and Categorical Task Parameters in Monkeys.

Dynamic Modeling of Spike Count Data With Conway-Maxwell Poisson Variability

Analysis and modelling of variability and covariability of population spike trains across multiple time scales

Bayesian Bi-clustering of Neural Spiking Activity with Latent Structures

Identification of Recurrent Dynamics in Distributed Neural Populations

Inferring Population Dynamics in Macaque Cortex

Hierarchical Bayesian Inference and Learning in Spiking Neural Networks.

Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations

Statistical modeling of adaptive neural networks explains coexistence of avalanches and oscillations in resting human brain

Linear dynamical neural population models through nonlinear embeddings

Characterizing the nonlinear structure of shared variability in cortical neuron populations using latent variable models

Modeling and inference methods for switching regime-dependent dynamical systems with multiscale neural observations

Modeling Heterogeneity and Dependence for Analysis of Neuronal Data.

The determining role of covariances in large networks of stochastic neurons

Modeling cortex network: a spatio-temporal population approach

Hierarchical Bayesian Modeling of Inter-Trial Variability and Variational Bayesian Learning of Common Spatial Patterns from Multichannel EEG

Joint Learning of Full-structure Noise in Hierarchical Bayesian Regression Models

Adaptive modeling and inference of higher-order coordination in neuronal assemblies: A dynamic greedy estimation approach