Abstract:Dimensionality reduction techniques aim at representing high-dimensional data in low-dimensional spaces to extract hidden and useful information or facilitate visual understanding and interpretation of the data. However, few of them take into consideration the potential cluster information contained implicitly in the high-dimensional data. In this paper, we propose Lap tSNE, a new graph-layout nonlinear dimensionality reduction method based on t-SNE, one of the best techniques for visualizing high-dimensional data as 2D scatter plots. Specifically, Lap tSNE leverages the eigenvalue information of the graph Laplacian to shrink the potential clusters in the low-dimensional embedding when learning to preserve the local and global structure from high-dimensional space to low-dimensional space. It is nontrivial to solve the proposed model because the eigenvalues of normalized symmetric Laplacian are functions of the decision variable. We provide a majorization-minimization algorithm with convergence guarantee to solve the optimization problem of Lap tSNE and show how to calculate the gradient analytically, which may be of broad interest when considering optimization with Laplacian-composited objective. We evaluate our method by a formal comparison with state-of-the-art methods on seven benchmark datasets, both visually and via established quantitative measurements. The results demonstrate the superiority of our method over baselines such as t-SNE and UMAP. We also provide out-of-sample extension, large-scale extension, and mini-batch extension for our Lap tSNE to facilitate dimensionality reduction in various scenarios.

Laplacian Eigenmaps for Dimensionality Reduction and Data Representation

Laplacian Eigenmap for Image Retrieval

Image retrieval using dimensionality reduction

Locality Preserving Projections (LPP)

Face recognition using laplacianfaces.

Locality Pursuit Embedding

Learning a Locality Preserving Subspace for Visual Recognition.

Effective Dimensionality Reduction for Visualizing Neural Dynamics by Laplacian Eigenmaps

An Improved Laplacian Eigenmaps Algorithm for Nonlinear Dimensionality Reduction

On the regularized Laplacian eigenmaps

Relative Distance-Based Laplacian Eigenmaps

Constrained Laplacian Eigenmap for Dimensionality Reduction

A survey on Laplacian eigenmaps based manifold learning methods.

Incremental Laplacian Eigenmaps by Preserving Adjacent Information Between Data Points

Distortion-Free Nonlinear Dimensionality Reduction

Proper Laplacian Representation Learning

Laplacian PCA and Its Applications

Laplacian-based Cluster-Contractive t-SNE for High-Dimensional Data Visualization

A kernel-based analysis of Laplacian Eigenmaps

A General Exponential Framework for Dimensionality Reduction

Quantum Laplacian Eigenmap