Abstract:Objective.Learning dynamical latent state models for multimodal spiking and field potential activity can reveal their collective low-dimensional dynamics and enable better decoding of behavior through multimodal fusion. Toward this goal, developing unsupervised learning methods that are computationally efficient is important, especially for real-time learning applications such as brain-machine interfaces (BMIs). However, efficient learning remains elusive for multimodal spike-field data due to their heterogeneous discrete-continuous distributions and different timescales.Approach.Here, we develop a multiscale subspace identification (multiscale SID) algorithm that enables computationally efficient learning for modeling and dimensionality reduction for multimodal discrete-continuous spike-field data. We describe the spike-field activity as combined Poisson and Gaussian observations, for which we derive a new analytical SID method. Importantly, we also introduce a novel constrained optimization approach to learn valid noise statistics, which is critical for multimodal statistical inference of the latent state, neural activity, and behavior. We validate the method using numerical simulations and with spiking and local field potential population activity recorded during a naturalistic reach and grasp behavior.Main results.We find that multiscale SID accurately learned dynamical models of spike-field signals and extracted low-dimensional dynamics from these multimodal signals. Further, it fused multimodal information, thus better identifying the dynamical modes and predicting behavior compared to using a single modality. Finally, compared to existing multiscale expectation-maximization learning for Poisson-Gaussian observations, multiscale SID had a much lower training time while being better in identifying the dynamical modes and having a better or similar accuracy in predicting neural activity and behavior.Significance.Overall, multiscale SID is an accurate learning method that is particularly beneficial when efficient learning is of interest, such as for online adaptive BMIs to track non-stationary dynamics or for reducing offline training time in neuroscience investigations.

P.733 Atomoxetine Alters Stopping Networks in Healthy Controls and Participants with Cocaine Use Disorder Without Affecting Stopping Performance

Jitter-adaptive dictionary learning-application to multi-trial neuroelectric signals

Deep sr-DDL: Deep structurally regularized dynamic dictionary learning to integrate multimodal and dynamic functional connectomics data for multidimensional clinical characterizations

Adversarial dictionary learning for a robust analysis and modelling of spontaneous neuronal activity

Neurogenesis-Inspired Dictionary Learning: Online Model Adaption in a Changing World

Integrating Neural Networks and Dictionary Learning for Multidimensional Clinical Characterizations from Functional Connectomics Data

The dynamics of multiword sequence extraction

Supervised Dictionary Learning for Inferring Concurrent Brain Networks

Multimodal Task-Driven Dictionary Learning for Image Classification

Online Dictionary Learning with Confidence

Robust multimodal dictionary learning

Explainable Multimodal Deep Dictionary Learning to Capture Developmental Differences From Three fMRI Paradigms

A multi-class structured dictionary learning method using discriminant atom selection

Distributed rank-1 dictionary learning: Towards fast and scalable solutions for fMRI big data analytics

Neural Changes in the Cortico-Basal Ganglia Network During Online Statistical Sequence Learning: an Fmri Study

Multi-subject dictionary learning to segment an atlas of brain spontaneous activity

A Semi-Blind Online Dictionary Learning Approach for Fmri Data.

Sparse coding for multitask and transfer learning

Massively Multitask Networks for Drug Discovery

Multimodal subspace identification for modeling discrete-continuous spiking and field potential population activity

Assessing the Effects of Cocaine Dependence and Pathological Gambling Using Group-Wise Sparse Representation of Natural Stimulus FMRI Data