Abstract:Objective. Realizing neurotechnologies that enable long-term neural recordings across multiple spatial-temporal scales during naturalistic behaviors requires new modeling and inference methods that can simultaneously address two challenges. First, the methods should aggregate information across all activity scales from multiple recording sources such as spiking and field potentials. Second, the methods should detect changes in the regimes of behavior and/or neural dynamics during naturalistic scenarios and long-term recordings. Prior regime detection methods are developed for a single scale of activity rather than multiscale activity, and prior multiscale methods have not considered regime switching and are for stationary cases. Approach. Here, we address both challenges by developing a Switching Multiscale Dynamical System model and the associated filtering and smoothing methods. This model describes the encoding of an unobserved brain state in multiscale spike-field activity. It also allows for regime-switching dynamics using an unobserved regime state that dictates the dynamical and encoding parameters at every time-step. We also design the associated switching multiscale inference methods that estimate both the unobserved regime and brain states from simultaneous spike-field activity. Main results. We validate the methods in both extensive numerical simulations and prefrontal spike-field data recorded in a monkey performing saccades for fluid rewards. We show that these methods can successfully combine the spiking and field potential observations to simultaneously track the regime and brain states accurately. Doing so, these methods lead to better state estimation compared with single-scale switching methods or stationary multiscale methods. Also, for single-scale linear Gaussian observations, the new switching smoother can better generalize to diverse system settings compared to prior switching smoothers. Significance. These modeling and inference methods effectively incorporate both regime-detection and multiscale observations. As such, they could facilitate investigation of latent switching neural population dynamics and improve future brain-machine interfaces by enabling inference in naturalistic scenarios where regime-dependent multiscale activity and behavior arise.

Sequential Detection of Regime Changes in Neural Data

Online Neural Sequence Detection with Hierarchical Dirichlet Point Process

A New Approach to Detect and Study Spatial-Temporal Intracranial EEG Frames

Tracking Functional Changes in Nonstationary Signals with Evolutionary Ensemble Bayesian Model for Robust Neural Decoding

Quickest Change Detection in Statistically Periodic Processes with Unknown Post-Change Distribution

Sequential (Quickest) Change Detection: Classical Results and New Directions

Modeling and inference methods for switching regime-dependent dynamical systems with multiscale neural observations

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Detecting Regime Shifts: Neurocomputational Substrates for Over- and Underreactions to Change

Sequential Changepoint Detection in Neural Networks with Checkpoints

Neural Decoding Using a Parallel Sequential Monte Carlo Method on Point Processes with Ensemble Effect.

Data-driven perception of neuron point process with unknown unknowns

Sequential Event Detection Using Multimodal Data in Nonstationary Environments

Change-point analysis of neuron spike train data

A Change Dynamic Model for the Online Detection of Gradual Change

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Multi-Sensor Sequential Change Detection with Unknown Change Propagation Pattern

Detecting Abrupt Change In Neuronal Tuning Via Adaptive Point Process Estimation

Automatic Change-Point Detection in Time Series via Deep Learning

Sequential change-point detection based on nearest neighbors

Detecting Change Points in fMRI Data via Bayesian Inference and Genetic Algorithm Model.