Abstract:Dimensionality reduction is widely used in modern Neuroscience to process massive neural recordings data. Despite the development of complex non-linear techniques, linear algorithms, in particular Principal Component Analysis (PCA), are still the gold standard. However, there is no consensus on how to estimate the optimal number of latent variables to retain. In this study, we addressed this issue by testing different criteria on simulated data. Parallel analysis and cross validation proved to be the best methods, being largely unaffected by the number of units and the amount of noise. Parallel analysis was quite conservative and tended to underestimate the number of dimensions especially in low-noise regimes, whereas in these conditions cross validation provided slightly better estimates. Both criteria consistently estimate the ground truth when 100+ units were available. As an exemplary application to real data, we estimated the dimensionality of the spiking activity in two macaque parietal areas during different phases of a delayed reaching task. We show that different criteria can lead to different trends in the estimated dimensionality. These apparently contrasting results are reconciled when the implicit definition of dimensionality underlying the different criteria is considered. Our findings suggest that the term "dimensionality" needs to be defined carefully and, more importantly, that the most robust criteria for choosing the number of dimensions should be adopted in future works. To help other researchers with the implementation of such an approach on their data, we provide a simple software package, and we present the results of our simulations through a simple Web based app to guide the choice of latent variables in a variety of new studies.

Multiple Output Regression with Latent Noise

RMoR-Aion: Robust Multioutput Regression by Simultaneously Alleviating Input and Output Noises

Multiplicative noise and heavy tails in stochastic optimization

Analyzing and Improving Supervised Nonlinear Dynamical Probabilistic Latent Variable Model for Inferential Sensors

Joint Learning of Full-structure Noise in Hierarchical Bayesian Regression Models

Robust sparse regression by modeling noise as a mixture of gaussians

Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics

Latent variable model for high-dimensional point process with structured missingness

Low-rank Hypergraph Feature Selection for Multi-Output Regression

Efficient Marginalization of Discrete and Structured Latent Variables via Sparsity

Economic Forecasts Using Many Noises

Learning Multi-Layer Latent Variable Model with Short Run MCMC Inference Dynamics

Latent variable modeling with random features

More or fewer latent variables in the high-dimensional data space? That is the question

Benign Overfitting of Non-Sparse High-Dimensional Linear Regression with Correlated Noise

When predict can also explain: few-shot prediction to select better neural latents

An extended latent factor framework for ill-posed linear regression

Bayesian Active Learning for Discrete Latent Variable Models

Combined modeling of sparse and dense noise for improvement of Relevance Vector Machine

Learning Latent Causal Structures with a Redundant Input Neural Network

Multiple Hypothesis Dropout: Estimating the Parameters of Multi-Modal Output Distributions