Abstract:The task of dimensionality reduction and visualization of high-dimensional datasets remains a challenging problem since long. Modern high-throughput technologies produce newer high-dimensional datasets having multiple views with relatively new data types. Visualization of these datasets require proper methodology that can uncover hidden patterns in the data without affecting the local and global structures within the data. To this end, however, very few such methodology exist, which can realise this task. In this work, we have introduced a novel unsupervised deep neural network model, called NeuroDAVIS, for data visualization. NeuroDAVIS is capable of extracting important features from the data, without assuming any data distribution, and visualize effectively in lower dimension. It has been shown theoritically that neighbourhood relationship of the data in high dimension remains preserved in lower dimension. The performance of NeuroDAVIS has been evaluated on a wide variety of synthetic and real high-dimensional datasets including numeric, textual, image and biological data. NeuroDAVIS has been highly competitive against both t-Distributed Stochastic Neighbor Embedding (t-SNE) and Uniform Manifold Approximation and Projection (UMAP) with respect to visualization quality, and preservation of data size, shape, and both local and global structure. It has outperformed Fast interpolation-based t-SNE (Fit-SNE), a variant of t-SNE, for most of the high-dimensional datasets as well. For the biological datasets, besides t-SNE, UMAP and Fit-SNE, NeuroDAVIS has also performed well compared to other state-of-the-art algorithms, like Potential of Heat-diffusion for Affinity-based Trajectory Embedding (PHATE) and the siamese neural network-based method, called IVIS. Downstream classification and clustering analyses have also revealed favourable results for NeuroDAVIS-generated embeddings.

Nonlinear Dimensionality Reduction for Data Visualization: An Unsupervised Fuzzy Rule-based Approach

Deep Manifold Computing and Visualization

An Unsupervised Fuzzy Rule-Based Method for Structure Preserving Dimensionality Reduction with Prediction Ability

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

Consistent Representation Learning for High Dimensional Data Analysis

Dimensionality Reduction and Data Visualisation

Nonlinear dimensionality reduction and data visualization: A review

A Perception-Driven Approach to Supervised Dimensionality Reduction for Visualization

Clustering-Based Nonlinear Dimensionality Reduction On Manifold

Non-Linear Dimensionality Reduction Techniques of Distance-Preserving Projection for Visualization and Classification

NeuroDAVIS: A neural network model for data visualization

Supervised nonlinear dimensionality reduction for visualization and classification

Local Nonlinear Dimensionality Reduction via Preserving the Geometric Structure of Data

Spectral Overlap and a Comparison of Parameter-Free, Dimensionality Reduction Quality Metrics

Homology-Preserving Dimensionality Reduction via Manifold Landmarking and Tearing

Dimension Reduction with Non-degrading Generalization

High-Dimensional Data Visualization Based On User Knowledge

Nonlinear Dimension Reduction Via Local Tangent Space Alignment

Supervised nonlinear dimensionality reduction for visualization and classification.

Adaptive Nonlinear Dimensionality Reduction with a Local Metric.