Seeing data as t-SNE and UMAP do

Vivien Marx

DOI: https://doi.org/10.1038/s41592-024-02301-x

IF: 48

2024-05-26

Nature Methods

Abstract:Dimension reduction helps to visualize high-dimensional datasets. These tools should be used thoughtfully and with tuned parameters. Sometimes, these methods take a second thought.

biochemical research methods

What problem does this paper attempt to address?

ActUp: Analyzing and Consolidating tSNE and UMAP

Andrew Draganov,Jakob Rødsgaard Jørgensen,Katrine Scheel Nellemann,Davide Mottin,Ira Assent,Tyrus Berry,Cigdem Aslay

DOI: https://doi.org/10.48550/arXiv.2305.07320

2023-05-12

Abstract:tSNE and UMAP are popular dimensionality reduction algorithms due to their speed and interpretable low-dimensional embeddings. Despite their popularity, however, little work has been done to study their full span of differences. We theoretically and experimentally evaluate the space of parameters in both tSNE and UMAP and observe that a single one -- the normalization -- is responsible for switching between them. This, in turn, implies that a majority of the algorithmic differences can be toggled without affecting the embeddings. We discuss the implications this has on several theoretic claims behind UMAP, as well as how to reconcile them with existing tSNE interpretations. Based on our analysis, we provide a method (\ourmethod) that combines previously incompatible techniques from tSNE and UMAP and can replicate the results of either algorithm. This allows our method to incorporate further improvements, such as an acceleration that obtains either method's outputs faster than UMAP. We release improved versions of tSNE, UMAP, and \ourmethod that are fully plug-and-play with the traditional libraries at <a class="link-external link-https" href="https://github.com/Andrew-Draganov/GiDR-DUN" rel="external noopener nofollow">this https URL</a>

Machine Learning
Relating tSNE and UMAP to Classical Dimensionality Reduction

Andrew Draganov,Simon Dohn

2024-06-14

Abstract:It has become standard to use gradient-based dimensionality reduction (DR) methods like tSNE and UMAP when explaining what AI models have learned. This makes sense: these methods are fast, robust, and have an uncanny ability to find semantic patterns in high-dimensional data without supervision. Despite this, gradient-based DR methods lack the most important quality that an explainability method should possess: themselves being explainable. That is, given a UMAP output, it is currently unclear what one can say about the corresponding input. We work towards closing this question by relating UMAP to classical DR techniques. Specifically, we show that one can fully recover methods like PCA, MDS, and ISOMAP in the modern DR paradigm: by applying attractions and repulsions onto a randomly initialized dataset. We also show that, with a small change, Locally Linear Embeddings (LLE) can indistinguishably reproduce UMAP outputs. This implies that the UMAP effective objective is minimized by this modified version of LLE (and vice versa). Given this, we discuss what must be true of UMAP emebddings and present avenues for future work.

Machine Learning,Artificial Intelligence
Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualization

Yingfan Wang,Haiyang Huang,Cynthia Rudin,Yaron Shaposhnik

DOI: https://doi.org/10.48550/arXiv.2012.04456

2021-08-24

Abstract:Dimension reduction (DR) techniques such as t-SNE, UMAP, and TriMAP have demonstrated impressive visualization performance on many real world datasets. One tension that has always faced these methods is the trade-off between preservation of global structure and preservation of local structure: these methods can either handle one or the other, but not both. In this work, our main goal is to understand what aspects of DR methods are important for preserving both local and global structure: it is difficult to design a better method without a true understanding of the choices we make in our algorithms and their empirical impact on the lower-dimensional embeddings they produce. Towards the goal of local structure preservation, we provide several useful design principles for DR loss functions based on our new understanding of the mechanisms behind successful DR methods. Towards the goal of global structure preservation, our analysis illuminates that the choice of which components to preserve is important. We leverage these insights to design a new algorithm for DR, called Pairwise Controlled Manifold Approximation Projection (PaCMAP), which preserves both local and global structure. Our work provides several unexpected insights into what design choices both to make and avoid when constructing DR algorithms.

Machine Learning
An Analysis of the t-SNE Algorithm for Data Visualization

Wei Hu,Sanjeev Arora,Pravesh Kothari

2018-03-05

Abstract:A first line of attack in exploratory data analysis is data visualization, i.e., generating a 2-dimensional representation of data that makes clusters of similar points visually identifiable. Standard Johnson-Lindenstrauss dimensionality reduction does not produce data visualizations. The t-SNE heuristic of van der Maaten and Hinton, which is based on non-convex optimization, has become the de facto standard for visualization in a wide range of applications. This work gives a formal framework for the problem of data visualization - finding a 2-dimensional embedding of clusterable data that correctly separates individual clusters to make them visually identifiable. We then give a rigorous analysis of the performance of t-SNE under a natural, deterministic condition on the "ground-truth" clusters (similar to conditions assumed in earlier analyses of clustering) in the underlying data. These are the first provable guarantees on t-SNE for constructing good data visualizations. We show that our deterministic condition is satisfied by considerably general probabilistic generative models for clusterable data such as mixtures of well-separated log-concave distributions. Finally, we give theoretical evidence that t-SNE provably succeeds in partially recovering cluster structure even when the above deterministic condition is not met.

Mathematics,Computer Science
Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE

Aditya Ravuri,Neil D. Lawrence

2024-05-28

Abstract:This paper shows that the dimensionality reduction methods, UMAP and t-SNE, can be approximately recast as MAP inference methods corresponding to a generalized Wishart-based model introduced in ProbDR. This interpretation offers deeper theoretical insights into these algorithms, while introducing tools with which similar dimensionality reduction methods can be studied.

Machine Learning,Artificial Intelligence
Understanding High Dimensional Spaces through Visual Means Employing Multidimensional Projections

Haseeb Younis,Paul Trust,Rosane Minghim

DOI: https://doi.org/10.48550/arXiv.2207.10800

2022-07-13

Abstract:Data visualisation helps understanding data represented by multiple variables, also called features, stored in a large matrix where individuals are stored in lines and variable values in columns. These data structures are frequently called multidimensional <a class="link-external link-http" href="http://spaces.In" rel="external noopener nofollow">this http URL</a> this paper, we illustrate ways of employing the visual results of multidimensional projection algorithms to understand and fine-tune the parameters of their mathematical framework. Some of the common mathematical common to these approaches are Laplacian matrices, Euclidian distance, Cosine distance, and statistical methods such as Kullback-Leibler divergence, employed to fit probability distributions and reduce dimensions. Two of the relevant algorithms in the data visualisation field are t-distributed stochastic neighbourhood embedding (t-SNE) and Least-Square Projection (LSP). These algorithms can be used to understand several ranges of mathematical functions including their impact on datasets. In this article, mathematical parameters of underlying techniques such as Principal Component Analysis (PCA) behind t-SNE and mesh reconstruction methods behind LSP are adjusted to reflect the properties afforded by the mathematical formulation. The results, supported by illustrative methods of the processes of LSP and t-SNE, are meant to inspire students in understanding the mathematics behind such methods, in order to apply them in effective data analysis tasks in multiple applications.

Human-Computer Interaction,Machine Learning
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction

Leland McInnes,John Healy,James Melville

DOI: https://doi.org/10.48550/arXiv.1802.03426

2020-09-18

Abstract:UMAP (Uniform Manifold Approximation and Projection) is a novel manifold learning technique for dimension reduction. UMAP is constructed from a theoretical framework based in Riemannian geometry and algebraic topology. The result is a practical scalable algorithm that applies to real world data. The UMAP algorithm is competitive with t-SNE for visualization quality, and arguably preserves more of the global structure with superior run time performance. Furthermore, UMAP has no computational restrictions on embedding dimension, making it viable as a general purpose dimension reduction technique for machine learning.

Machine Learning,Computational Geometry
Laplacian-based Cluster-Contractive t-SNE for High-Dimensional Data Visualization

Yan Sun,Yi Han,Jicong Fan

DOI: https://doi.org/10.1145/3612932

IF: 4.157

2023-08-03

ACM Transactions on Knowledge Discovery from Data

Abstract:Dimensionality reduction techniques aim at representing high-dimensional data in low-dimensional spaces to extract hidden and useful information or facilitate visual understanding and interpretation of the data. However, few of them take into consideration the potential cluster information contained implicitly in the high-dimensional data. In this paper, we propose Lap tSNE, a new graph-layout nonlinear dimensionality reduction method based on t-SNE, one of the best techniques for visualizing high-dimensional data as 2D scatter plots. Specifically, Lap tSNE leverages the eigenvalue information of the graph Laplacian to shrink the potential clusters in the low-dimensional embedding when learning to preserve the local and global structure from high-dimensional space to low-dimensional space. It is nontrivial to solve the proposed model because the eigenvalues of normalized symmetric Laplacian are functions of the decision variable. We provide a majorization-minimization algorithm with convergence guarantee to solve the optimization problem of Lap tSNE and show how to calculate the gradient analytically, which may be of broad interest when considering optimization with Laplacian-composited objective. We evaluate our method by a formal comparison with state-of-the-art methods on seven benchmark datasets, both visually and via established quantitative measurements. The results demonstrate the superiority of our method over baselines such as t-SNE and UMAP. We also provide out-of-sample extension, large-scale extension, and mini-batch extension for our Lap tSNE to facilitate dimensionality reduction in various scenarios.

computer science, information systems, software engineering
Modern Dimension Reduction

Philip D. Waggoner

DOI: https://doi.org/10.48550/arXiv.2103.06885

2021-03-11

Abstract:Data are not only ubiquitous in society, but are increasingly complex both in size and dimensionality. Dimension reduction offers researchers and scholars the ability to make such complex, high dimensional data spaces simpler and more manageable. This Element offers readers a suite of modern unsupervised dimension reduction techniques along with hundreds of lines of R code, to efficiently represent the original high dimensional data space in a simplified, lower dimensional subspace. Launching from the earliest dimension reduction technique principal components analysis and using real social science data, I introduce and walk readers through application of the following techniques: locally linear embedding, t-distributed stochastic neighbor embedding (t-SNE), uniform manifold approximation and projection, self-organizing maps, and deep autoencoders. The result is a well-stocked toolbox of unsupervised algorithms for tackling the complexities of high dimensional data so common in modern society. All code is publicly accessible on Github.

Machine Learning,Computers and Society,Applications
DimVis: Interpreting Visual Clusters in Dimensionality Reduction With Explainable Boosting Machine

Parisa Salmanian,Angelos Chatzimparmpas,Ali Can Karaca,Rafael M. Martins

2024-02-10

Abstract:Dimensionality Reduction (DR) techniques such as t-SNE and UMAP are popular for transforming complex datasets into simpler visual representations. However, while effective in uncovering general dataset patterns, these methods may introduce artifacts and suffer from interpretability issues. This paper presents DimVis, a visualization tool that employs supervised Explainable Boosting Machine (EBM) models (trained on user-selected data of interest) as an interpretation assistant for DR projections. Our tool facilitates high-dimensional data analysis by providing an interpretation of feature relevance in visual clusters through interactive exploration of UMAP projections. Specifically, DimVis uses a contrastive EBM model that is trained in real time to differentiate between the data inside and outside a cluster of interest. Taking advantage of the inherent explainable nature of the EBM, we then use this model to interpret the cluster itself via single and pairwise feature comparisons in a ranking based on the EBM model's feature importance. The applicability and effectiveness of DimVis are demonstrated through two use cases involving real-world datasets, and we also discuss the limitations and potential directions for future research.

Machine Learning,Human-Computer Interaction,Computation
Improved visualization of high-dimensional data using the distance-of-distance transformation

Jinke Liu,Martin Vinck

DOI: https://doi.org/10.1371/journal.pcbi.1010764

2022-12-22

PLoS Computational Biology

Abstract:Dimensionality reduction tools like t-SNE and UMAP are widely used for high-dimensional data analysis. For instance, these tools are applied in biology to describe spiking patterns of neuronal populations or the genetic profiles of different cell types. Here, we show that when data include noise points that are randomly scattered within a high-dimensional space, a "scattering noise problem" occurs in the low-dimensional embedding where noise points overlap with the cluster points. We show that a simple transformation of the original distance matrix by computing a distance between neighbor distances alleviates this problem and identifies the noise points as a separate cluster. We apply this technique to high-dimensional neuronal spike sequences, as well as the representations of natural images by convolutional neural network units, and find an improvement in the constructed low-dimensional embedding. Thus, we present an improved dimensionality reduction technique for high-dimensional data containing noise points. Biological datasets are often high-dimensional, e.g. the genetic profile of cells or the firing pattern of neural populations. Dimensionality reduction methods like t-SNE are commonly used to represent the high-dimensional data in a low-dimensional embedding space. The visualization helps us to identify the underlying clustering patterns and shed light on the information hidden within the data. We show that in situations where there exist scattering noise points, clustering patterns in the data tend to be heavily distorted. Here, we show that using a distance-of-distance (DoD) transformation of the dissimilarity matrix between data points, the influence of scattering noise is effectively removed. This neighborhood-based transformation is most effective when the dimensionality of the dataset is high. We show that this technique improves low-dimensional embedding for several high-dimensional datasets, such as the convolutional neural network representation of natural images or the neuronal population representation of visual stimuli.

biochemical research methods,mathematical & computational biology
GiDR-DUN; Gradient Dimensionality Reduction -- Differences and Unification

Andrew Draganov,Tyrus Berry,Jakob Rødsgaard Jørgensen,Katrine Scheel Nellemann,Ira Assent,Davide Mottin

DOI: https://doi.org/10.48550/arXiv.2206.09689

2022-06-20

Abstract:TSNE and UMAP are two of the most popular dimensionality reduction algorithms due to their speed and interpretable low-dimensional embeddings. However, while attempts have been made to improve on TSNE's computational complexity, no existing method can obtain TSNE embeddings at the speed of UMAP. In this work, we show that this is indeed possible by combining the two approaches into a single method. We theoretically and experimentally evaluate the full space of parameters in the TSNE and UMAP algorithms and observe that a single parameter, the normalization, is responsible for switching between them. This, in turn, implies that a majority of the algorithmic differences can be toggled without affecting the embeddings. We discuss the implications this has on several theoretic claims underpinning the UMAP framework, as well as how to reconcile them with existing TSNE interpretations. Based on our analysis, we propose a new dimensionality reduction algorithm, GDR, that combines previously incompatible techniques from TSNE and UMAP and can replicate the results of either algorithm by changing the normalization. As a further advantage, GDR performs the optimization faster than available UMAP methods and thus an order of magnitude faster than available TSNE methods. Our implementation is plug-and-play with the traditional UMAP and TSNE libraries and can be found at <a class="link-external link-http" href="http://github.com/Andrew-Draganov/GiDR-DUN" rel="external noopener nofollow">this http URL</a>.

Machine Learning
Nonlinear Dimensionality Reduction for Data Visualization: An Unsupervised Fuzzy Rule-based Approach

Suchismita Das,Nikhil R. Pal

DOI: https://doi.org/10.1109/TFUZZ.2021.3076583

2020-04-08

Abstract:Here, we propose an unsupervised fuzzy rule-based dimensionality reduction method primarily for data visualization. It considers the following important issues relevant to dimensionality reduction-based data visualization: (i) preservation of neighborhood relationships, (ii) handling data on a non-linear manifold, (iii) the capability of predicting projections for new test data points, (iv) interpretability of the system, and (v) the ability to reject test points if required. For this, we use a first-order Takagi-Sugeno type model. We generate rule antecedents using clusters in the input data. In this context, we also propose a new variant of the Geodesic c-means clustering algorithm. We estimate the rule parameters by minimizing an error function that preserves the inter-point geodesic distances (distances over the manifold) as Euclidean distances on the projected space. We apply the proposed method on three synthetic and three real-world data sets and visually compare the results with four other standard data visualization methods. The obtained results show that the proposed method behaves desirably and performs better than or comparable to the methods compared with. The proposed method is found to be robust to the initial conditions. The predictability of the proposed method for test points is validated by experiments. We also assess the ability of our method to reject output points when it should. Then, we extend this concept to provide a general framework for learning an unsupervised fuzzy model for data projection with different objective functions. To the best of our knowledge, this is the first attempt to manifold learning using unsupervised fuzzy modeling.

Machine Learning,Human-Computer Interaction
Comparison of Data Visualization, Outlier Detection and Data Dimensionality Reduction Methods

Xingyu Zhao

DOI: https://doi.org/10.54097/wgchmc87

2024-03-13

Abstract:With the deepening of the digital age of information, people's daily data is getting larger and larger, and it is more and more difficult to quantify and process. At this time, the data processing means becomes particularly important. This paper compares and analyzes some methods from data visualization to data dimensionality reduction to outlier detection. In this paper, two different types of datasets, ModelNet40, and red wine quality, are used to introduce the visualization method of the Farthest Point Sampling (FPS). This method can have a clear visual effect on the data dimension and scale, and allow users to observe the structure, type, and scale of the data. In data dimensionality reduction, the study uses Principal Component Analysis (PCA), T-Distributed Stochastic Neighbor Embedding (t-SNE), Triplets Manifold Approximation and Projection (TriMAP), Uniform Manifold Approximation and Projection (UMAP), Pairwise Controlled Manifold Approximation Projection (PaCMAP), and Autoencoder to compare their dimensionality reduction effects. Through these methods, this paper finds that different methods have different effects on different datasets. Therefore, in data dimensionality reduction, it can get twice the result with half the effort by choosing the appropriate method. Finally, this paper also detects outliers. Outliers in datasets will make it difficult for people to process data and make subsequent results inaccurate, so it is necessary to identify outliers. This paper involves methods such as isolation forest and Density-Based Spatial Clustering of Applications with Noise (DBSCAN). Through this paper, the methods of different datasets are analyzed and summarized.
Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey

Benyamin Ghojogh,Ali Ghodsi,Fakhri Karray,Mark Crowley

DOI: https://doi.org/10.48550/arXiv.2109.02508

2021-08-25

Abstract:Uniform Manifold Approximation and Projection (UMAP) is one of the state-of-the-art methods for dimensionality reduction and data visualization. This is a tutorial and survey paper on UMAP and its variants. We start with UMAP algorithm where we explain probabilities of neighborhood in the input and embedding spaces, optimization of cost function, training algorithm, derivation of gradients, and supervised and semi-supervised embedding by UMAP. Then, we introduce the theory behind UMAP by algebraic topology and category theory. Then, we introduce UMAP as a neighbor embedding method and compare it with t-SNE and LargeVis algorithms. We discuss negative sampling and repulsive forces in UMAP's cost function. DensMAP is then explained for density-preserving embedding. We then introduce parametric UMAP for embedding by deep learning and progressive UMAP for streaming and out-of-sample data embedding.

Human-Computer Interaction,Machine Learning
T-Sne for Complex Multi-Manifold High-Dimensional Data

Bian Rongzheng,Zhang Jian,Zhou Liang,Jiang Peng,Chen Baoquan,Wang Yunhai

DOI: https://doi.org/10.3724/sp.j.1089.2021.18806

2021-01-01

Journal of Computer-Aided Design & Computer Graphics

Abstract:To solve the problem that the t-SNE method cannot distinguish multiple manifolds that intersect each other well, a visual dimensionality reduction method is proposed. Based on the t-SNE method, Euclidean metric and local PCA are considered when calculating high-dimensional probability to distinguish different manifolds. Then the t-SNE gradient solution method can be directly used to get the dimensionality reduction result. Finally, three generated data and two real data are used to test proposed method, and quantitatively evaluate the discrimination of different manifolds and the degree of neighborhood preservation within the manifold in the dimensionality reduction results. These results show that proposed method is more useful when processing multi-manifold data, and can keep the neighborhood structure of each manifold well.
Joint Characterization of Multiscale Information in High Dimensional Data

Daniel Sousa,Christopher Small

DOI: https://doi.org/10.54364/AAIML.2021.1113

2021-02-19

Abstract:High dimensional data can contain multiple scales of variance. Analysis tools that preferentially operate at one scale can be ineffective at capturing all the information present in this cross-scale complexity. We propose a multiscale joint characterization approach designed to exploit synergies between global and local approaches to dimensionality reduction. We illustrate this approach using Principal Components Analysis (PCA) to characterize global variance structure and t-stochastic neighbor embedding (t-sne) to characterize local variance structure. Using both synthetic images and real-world imaging spectroscopy data, we show that joint characterization is capable of detecting and isolating signals which are not evident from either PCA or t-sne alone. Broadly, t-sne is effective at rendering a randomly oriented low-dimensional map of local clusters, and PCA renders this map interpretable by providing global, physically meaningful structure. This approach is illustrated using imaging spectroscopy data, and may prove particularly useful for other geospatial data given robust local variance structure due to spatial autocorrelation and physical interpretability of global variance structure due to spectral properties of Earth surface materials. However, the fundamental premise could easily be extended to other high dimensional datasets, including image time series and non-image data.

Machine Learning,Data Analysis, Statistics and Probability,Geophysics
Dimensionality Reduction for Visual Data Mining of Earth Observation Archives

Andreea Griparis,Daniela Faur,Mihai Datcu

DOI: https://doi.org/10.1109/lgrs.2016.2604919

IF: 5.343

2016-11-01

IEEE Geoscience and Remote Sensing Letters

Abstract:Modern knowledge discovery systems, empowered by visual data exploration techniques, enable the user to discover and understand the data content. Considering patch-level processing, the visual exploration of Earth Observation archives aims to identify groups of items sharing similar semantic content. Each patch is further represented by certain descriptors, i.e., spectral signatures or Weber local descriptors, to capture structural signature. Later on, the content of the archive is illustrated by a 3-D projection of the high-dimensional space of the descriptors. Aspiring to prove the visual data mining potential, this letter intends to determine the capability of dimensionality reduction techniques to achieve a meaningful 3-D projection of the high-dimensional space. Several real-world data sets were used, i.e., University of California, Merced Land Use data set and a Landsat 7 Enhanced Thematic Mapper Plus image tiled into patches.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Navigating Perplexity: A linear relationship with the data set size in t-SNE embeddings

Martin Skrodzki,Nicolas F. Chaves-de-Plaza,Thomas Höllt,Elmar Eisemann,Klaus Hildebrandt

2024-12-05

Abstract:Widely used pipelines for analyzing high-dimensional data utilize two-dimensional visualizations. These are created, for instance, via t-distributed stochastic neighbor embedding (t-SNE). A crucial element of the t-SNE embedding procedure is the perplexity hyperparameter. That is because the embedding structure varies when perplexity is changed. A suitable perplexity choice depends on the data set and the intended usage for the embedding. Therefore, perplexity is often chosen based on heuristics, intuition, and prior experience. This paper uncovers a linear relationship between perplexity and the data set size. Namely, we show that embeddings remain structurally consistent across data set samples when perplexity is adjusted accordingly. Qualitative and quantitative experimental results support these findings. This informs the visualization process, guiding the user when choosing a perplexity value. Finally, we outline several applications for the visualization of high-dimensional data via t-SNE based on this linear relationship.

Machine Learning,Artificial Intelligence,Quantitative Methods
MDS-Tree and MDS-Matrix for High Dimensional Data Visualization

X Yuan,Z Wang,C Guo

2011-01-01

Abstract:In this work, we propose MDS-Tree and MDS-Matrix as novel high dimensional data visualization methods to gain insight in both the data aspect and dimension aspect of the data. Dimension metrics of the high dimensional dataset are first computed to create a hierarchy. In an MDS-Tree, each node is an MDS projection of the original data items on a specific subset of dimensions associated with the dimension hierarchy. While the MDS-Tree visualizes the subspace structure of the data under exploration, MDSMatrix provides cross comparison between different combination of subspaces. In the MDS-Matrix construction, each pair of the subspaces are plotted as an MDS plot in the MDS-Matrix. In both MDS-Tree and MDS-Matrix, a full spectrum of user interaction has been designed, including drilling down to explore different levels of the data, merging or splitting the nodes to adjust the dimension hierarchy, applying brushing to select data clusters. Our proposed MDS-Tree and MDS-Matrix reveal the data from different aspects. They enable a simultaneous exploration on the data correlation and dimension correlation for data with high dimensions.

Seeing data as t-SNE and UMAP do

ActUp: Analyzing and Consolidating tSNE and UMAP

Relating tSNE and UMAP to Classical Dimensionality Reduction

Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualization

An Analysis of the t-SNE Algorithm for Data Visualization

Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE

Understanding High Dimensional Spaces through Visual Means Employing Multidimensional Projections

UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction

Laplacian-based Cluster-Contractive t-SNE for High-Dimensional Data Visualization

Modern Dimension Reduction

DimVis: Interpreting Visual Clusters in Dimensionality Reduction With Explainable Boosting Machine

Improved visualization of high-dimensional data using the distance-of-distance transformation

GiDR-DUN; Gradient Dimensionality Reduction -- Differences and Unification

Nonlinear Dimensionality Reduction for Data Visualization: An Unsupervised Fuzzy Rule-based Approach

Comparison of Data Visualization, Outlier Detection and Data Dimensionality Reduction Methods

Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey

T-Sne for Complex Multi-Manifold High-Dimensional Data

Joint Characterization of Multiscale Information in High Dimensional Data

Dimensionality Reduction for Visual Data Mining of Earth Observation Archives

Navigating Perplexity: A linear relationship with the data set size in t-SNE embeddings

MDS-Tree and MDS-Matrix for High Dimensional Data Visualization