Abstract:The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets. Extracting insight from data into the dynamic processes that produce observed phenomena is a ubiquitous challenge in biology. For example, brain functions are generated by the collective activity of many neurons. Extracting insight from biological time-series data can be challenging because the number of observations can be large, activities can be noisy, and collective dynamics can be complex. Here, we developed a new latent processes Bayesian regression model, the orthogonal stochastic linear mixing model (OSLMM) to address these challenges. Compared to competing methods, we demonstrate that OSLMM has superior recovery performance of latent trajectories in synthetic experiments and is computationally efficient. In two diverse neural data sets, we find that the latent spaces extracted from OSLMM are directly structured by task parameters. Our results demonstrate that latent dynamics can be structured by representations and suggest that OSLMM will be useful for data-driven discovery in large-scale biological time-series data.

Neural Latent Aligner: Cross-trial Alignment for Learning Representations of Complex, Naturalistic Neural Data

Extraction and Recovery of Spatio-Temporal Structure in Latent Dynamics Alignment with Diffusion Models

Comparing high-dimensional neural recordings by aligning their low-dimensional latent representations

ALIGNING BRAINS INTO A SHARED SPACE IMPROVES THEIR ALIGNMENT TO LARGE LANGUAGE MODELS

Learnable latent embeddings for joint behavioural and neural analysis

Achieving More Human Brain-Like Vision via Human EEG Representational Alignment

Transfer Learning for Brain-Computer Interfaces: A Euclidean Space Data Alignment Approach.

Latent Alignment with Deep Set EEG Decoders

Discrimination of Movement-Related Cortical Potentials Exploiting Unsupervised Learned Representations From ECoGs

Evaluating alignment between humans and neural network representations in image-based learning tasks

CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals

Reducing Intraspecies and Interspecies Covariate Shift in Traumatic Brain Injury EEG of Humans and Mice Using Transfer Euclidean Alignment

Brainnetformer: Decoding Brain Cognitive States with Spatial-Temporal Cross Attention

Wills Aligner: A Robust Multi-Subject Brain Representation Learner

Neural-MCRL: Neural Multimodal Contrastive Representation Learning for EEG-based Visual Decoding

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

RTify: Aligning Deep Neural Networks with Human Behavioral Decisions

SIMPL: Scalable and hassle-free optimization of neural representations from behaviour

Exploiting correlations across trials and behavioral sessions to improve neural decoding

Latent Representation Learning for Multimodal Brain Activity Translation

Brain-Like Language Processing via a Shallow Untrained Multihead Attention Network