Abstract:Modern applications often leverage multiple views of a subject of study. Within neuroscience, there is growing interest in large-scale simultaneous recordings across multiple brain regions. Understanding the relationship between views (e.g., the neural activity in each region recorded) can reveal fundamental principles about the characteristics of each representation and about the system. However, existing methods to characterize such relationships either lack the expressivity required to capture complex nonlinearities, describe only sources of variance that are shared between views, or discard geometric information that is crucial to interpreting the data. Here, we develop a nonlinear neural network-based method that, given paired samples of high-dimensional views, disentangles low-dimensional shared and private latent variables underlying these views while preserving intrinsic data geometry. Across multiple simulated and real datasets, we demonstrate that our method outperforms competing methods. Using simulated populations of lateral geniculate nucleus (LGN) and V1 neurons we demonstrate our model's ability to discover interpretable shared and private structure across different noise conditions. On a dataset of unrotated and corresponding but randomly rotated MNIST digits, we recover private latents for the rotated view that encode rotation angle regardless of digit class, and places the angle representation on a 1-d manifold, while shared latents encode digit class but not rotation angle. Applying our method to simultaneous Neuropixels recordings of hippocampus and prefrontal cortex while mice run on a linear track, we discover a low-dimensional shared latent space that encodes the animal's position. We propose our approach as a general-purpose method for finding succinct and interpretable descriptions of paired data sets in terms of disentangled shared and private latent variables.

Discovering Low-Dimensional Descriptions of Multineuronal Dependencies

The copula approach to characterizing dependence structure in neural populations

Neural Dependencies Emerging from Learning Massive Categories.

Extracting low-dimensional dynamics from multiple large-scale neural population recordings by learning to predict correlations

Neural Copula: A Unified Framework for Estimating Generic High-Dimensional Copula Functions

Nonparametric Covariance Regression for Massive Neural Data on Restricted Covariates via Graph

Data on Copula Modeling of Mixed Discrete and Continuous Neural Time Series

Joint Statistics of Strongly Correlated Neurons via Dimensional Reduction

Learning dynamic representations of the functional connectome in neurobiological networks

gCoda: Conditional Dependence Network Inference for Compositional Data.

Joint analysis of spikes and local field potentials using copula

Learning Cortico-Muscular Dependence through Orthonormal Decomposition of Density Ratios

Bayesian Nonparametric Modelling of Conditional Multidimensional Dependence Structures

Characterizing the nonlinear structure of shared variability in cortical neuron populations using latent variable models

Discovering and Deciphering Relationships Across Disparate Data Modalities

Unsupervised discovery of the shared and private geometry in multi-view data

Low-resolution descriptions of model neural activity reveal hidden features and underlying system properties

Subspace Projection Approaches To Classification And Visualization Of Neural Network-Level Encoding Patterns

Effect of Synaptic Heterogeneity on Neuronal Coordination

Comparing high-dimensional neural recordings by aligning their low-dimensional latent representations

Gaussian Process Vine Copulas for Multivariate Dependence