Abstract:Dimensionality reduction techniques aim at representing high-dimensional data in low-dimensional spaces to extract hidden and useful information or facilitate visual understanding and interpretation of the data. However, few of them take into consideration the potential cluster information contained implicitly in the high-dimensional data. In this paper, we propose Lap tSNE, a new graph-layout nonlinear dimensionality reduction method based on t-SNE, one of the best techniques for visualizing high-dimensional data as 2D scatter plots. Specifically, Lap tSNE leverages the eigenvalue information of the graph Laplacian to shrink the potential clusters in the low-dimensional embedding when learning to preserve the local and global structure from high-dimensional space to low-dimensional space. It is nontrivial to solve the proposed model because the eigenvalues of normalized symmetric Laplacian are functions of the decision variable. We provide a majorization-minimization algorithm with convergence guarantee to solve the optimization problem of Lap tSNE and show how to calculate the gradient analytically, which may be of broad interest when considering optimization with Laplacian-composited objective. We evaluate our method by a formal comparison with state-of-the-art methods on seven benchmark datasets, both visually and via established quantitative measurements. The results demonstrate the superiority of our method over baselines such as t-SNE and UMAP. We also provide out-of-sample extension, large-scale extension, and mini-batch extension for our Lap tSNE to facilitate dimensionality reduction in various scenarios.

Generalized T 3 -plot for testing high-dimensional normality

A hypothesis test for independence of sets of variates in high dimensions

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

New normality test in high dimension with kernel methods

Distance Correlation Test for High-Dimensional Independence

A Normality Test for High-dimensional Data Based on the Nearest Neighbor Approach

Laplacian-based Cluster-Contractive t-SNE for High-Dimensional Data Visualization

Testing Multivariate Normality Based on Beta-Representative Points

Testing for normality in any dimension based on a partial differential equation involving the moment generating function

Two Sample Testing in High Dimension via Maximum Mean Discrepancy

High-dimensional general linear hypothesis tests via non-linear spectral shrinkage

Testing the Graph of a Gaussian Graphical Model

Projection Test for Mean Vector in High Dimensions

Generalized Independence Test for Modern Data

Testing for High-Dimensional Geometry in Random Graphs

Nonparametric High-Dimensional Multi-Sample Tests based on Graph Theory

A More Powerful Two-Sample Test in High Dimensions using Random Projection

An Adaptive Test on High-dimensional Parameters in Generalized Linear Models

Testing high-dimensional multinomials with applications to text analysis

Model-Free Statistical Inference on High-Dimensional Data

A Shrinkage Likelihood Ratio Test for High-Dimensional Subgroup Analysis with a Logistic-Normal Mixture Model