Abstract:Dimensionality reduction tools like t-SNE and UMAP are widely used for high-dimensional data analysis. For instance, these tools are applied in biology to describe spiking patterns of neuronal populations or the genetic profiles of different cell types. Here, we show that when data include noise points that are randomly scattered within a high-dimensional space, a "scattering noise problem" occurs in the low-dimensional embedding where noise points overlap with the cluster points. We show that a simple transformation of the original distance matrix by computing a distance between neighbor distances alleviates this problem and identifies the noise points as a separate cluster. We apply this technique to high-dimensional neuronal spike sequences, as well as the representations of natural images by convolutional neural network units, and find an improvement in the constructed low-dimensional embedding. Thus, we present an improved dimensionality reduction technique for high-dimensional data containing noise points. Biological datasets are often high-dimensional, e.g. the genetic profile of cells or the firing pattern of neural populations. Dimensionality reduction methods like t-SNE are commonly used to represent the high-dimensional data in a low-dimensional embedding space. The visualization helps us to identify the underlying clustering patterns and shed light on the information hidden within the data. We show that in situations where there exist scattering noise points, clustering patterns in the data tend to be heavily distorted. Here, we show that using a distance-of-distance (DoD) transformation of the dissimilarity matrix between data points, the influence of scattering noise is effectively removed. This neighborhood-based transformation is most effective when the dimensionality of the dataset is high. We show that this technique improves low-dimensional embedding for several high-dimensional datasets, such as the convolutional neural network representation of natural images or the neuronal population representation of visual stimuli.

A biological model of nonlinear dimensionality reduction

Neural Network Emulation of Spatio-temporal Data Using Linear and Nonlinear Dimensionality Reduction

Normative and mechanistic model of an adaptive circuit for efficient encoding and feature extraction

Application on Classification of One Dimension Sequence Using Nonlinear Model Based on Olfactory System

A Normative Theory of Adaptive Dimensionality Reduction in Neural Networks

A lightweight data-driven spiking neuronal network model of Drosophila olfactory nervous system with dedicated hardware support

Biological Mechanisms for Learning: A Computational Model of Olfactory Learning in the Manduca sexta Moth, with Applications to Neural Nets

Developmental and evolutionary constraints on olfactory circuit selection

Dimensionality reduction simplifies synaptic partner matching in an olfactory circuit

A neural algorithm for Drosophila linear and nonlinear decision-making

A descriptive analysis of olfactory sensation and memory in Drosophila and its relation to artificial neural networks

Inferring community architectures of multisensory pathways in Drosophila via unsupervised network embedding

From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction

Nonlinear dimensionality reduction using a temporal coherence principle

Design Principles of the Sparse Coding Network and the Role of "sister Cells" in the Olfactory System of Drosophila.

Short-Term Plasticity Regulates Both Divisive Normalization and Adaptive Responses in Drosophila Olfactory System.

Model Order Reduction in Neuroscience

Extracting low-dimensional dynamics from multiple large-scale neural population recordings by learning to predict correlations

Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Analyzing neural responses to natural signals: Maximally informative dimensions

Improved visualization of high-dimensional data using the distance-of-distance transformation