Abstract:Dimensionality reduction methods are employed to decrease data dimensionality, either to enhance machine learning performance or to facilitate data visualization in two or three-dimensional spaces. These methods typically fall into two categories: feature selection and feature transformation. Feature selection retains significant features, while feature transformation projects data into a lower-dimensional space, with linear and nonlinear methods. While nonlinear methods excel in preserving local structures and capturing nonlinear relationships, they may struggle with interpreting global structures and can be computationally intensive. Recent algorithms, such as the t-SNE, UMAP, TriMap, and PaCMAP prioritize preserving local structures, often at the expense of accurately representing global structures, leading to clusters being spread out more in lower-dimensional spaces. Moreover, these methods heavily rely on hyperparameters, making their results sensitive to parameter settings. To address these limitations, this study introduces a clustering-based approach, namely CBMAP (Clustering-Based Manifold Approximation and Projection), for dimensionality reduction. CBMAP aims to preserve both global and local structures, ensuring that clusters in lower-dimensional spaces closely resemble those in high-dimensional spaces. Experimental evaluations on benchmark datasets demonstrate CBMAP's efficacy, offering speed, scalability, and minimal reliance on hyperparameters. Importantly, CBMAP enables low-dimensional projection of test data, addressing a critical need in machine learning applications. CBMAP is made freely available at <a class="link-external link-https" href="https://github.com/doganlab/cbmap" rel="external noopener nofollow">this https URL</a> and can be installed from the Python Package Directory (PyPI) software repository with the command pip install cbmap.

Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE

Relating tSNE and UMAP to Classical Dimensionality Reduction

Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualization

A Unifying Probabilistic Perspective for Spectral Dimensionality Reduction: Insights and New Models

UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction

ActUp: Analyzing and Consolidating tSNE and UMAP

On Probabilistic Embeddings in Optimal Dimension Reduction

Seeing data as t-SNE and UMAP do

Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey

Dimensionality reduction by UMAP to visualize physical and genetic interactions

Improved T-Sne Based Manifold Dimensional Reduction for Remote Sensing Data Processing

Dimensionality Reduction by T-Distribution Adaptive Manifold Embedding.

Probabilistic distribution model based on Wasserstein distance for nonlinear dimensionality reduction

GiDR-DUN; Gradient Dimensionality Reduction -- Differences and Unification

Dimensionality reduction by UMAP reinforces sample heterogeneity analysis in bulk transcriptomic data

Towards a Comprehensive Evaluation of Dimension Reduction Methods for Transcriptomic Data Visualization

Probabilistic PCA for T Distributions.

From High Dimensions to Human Insight: Exploring Dimensionality Reduction for Chemical Space Visualization

Fuzzy Information Discrimination Measures and Their Application to Low Dimensional Embedding Construction in the UMAP Algorithm

On some limitations of probabilistic models for dimension-reduction: Illustration in the case of probabilistic formulations of partial least squares

CBMAP: Clustering-based manifold approximation and projection for dimensionality reduction