Abstract:The t-Distributed Stochastic Neighbor Embedding (t-SNE) has emerged as a popular dimensionality reduction technique for visualizing high-dimensional data. It computes pairwise similarities between data points by default using an RBF kernel and random initialization (in low-dimensional space), which successfully captures the overall structure but may struggle to preserve the local structure efficiently. This research proposes a novel approach called the Modified Isolation Kernel (MIK) as an alternative to the Gaussian kernel, which is built upon the concept of the Isolation Kernel. MIK uses adaptive density estimation to capture local structures more accurately and integrates robustness measures. It also assigns higher similarity values to nearby points and lower values to distant points. Comparative research using the normal Gaussian kernel, the isolation kernel, and several initialization techniques, including random, PCA, and random walk initializations, are used to assess the proposed approach (MIK). Additionally, we compare the computational efficiency of all $3$ kernels with $3$ different initialization methods. Our experimental results demonstrate several advantages of the proposed kernel (MIK) and initialization method selection. It exhibits improved preservation of the local and global structure and enables better visualization of clusters and subclusters in the embedded space. These findings contribute to advancing dimensionality reduction techniques and provide researchers and practitioners with an effective tool for data exploration, visualization, and analysis in various domains.

Breaking the Curse of Dimensionality with Isolation Kernel

Is It Possible to Find the Single Nearest Neighbor of a Query in High Dimensions?

Isolation Kernel and Its Effect on SVM

Kernel-based Clustering Via Isolation Distributional Kernel

Improving the Effectiveness and Efficiency of Stochastic Neighbour Embedding with Isolation Kernel

Distance-Based Classifier Via the Kernel Trick.

Isolation Distributional Kernel: A New Tool for Kernel Based Anomaly Detection

Isolation Distributional Kernel: A New Tool for Point & Group Anomaly Detection.

Towards Breaking the Curse of Dimensionality for High-Dimensional Privacy: An Extended Version

Isolation Kernel: The X Factor in Efficient and Effective Large Scale Online Kernel Learning

MIK: Modified Isolation Kernel for Biological Sequence Visualization, Classification, and Clustering

Isolation Graph Kernel.

Improving Stochastic Neighbour Embedding Fundamentally with a Well-Defined Data-Dependent Kernel.

An Infinite Dimensional Analysis of Kernel Principal Components

Parsimonious Mahalanobis Kernel for the Classification of High Dimensional Data

Dimensionality's Blessing: Clustering Images by Underlying Distribution.

Kernel Interpolation of High Dimensional Scattered Data

On the optimality of kernels for high-dimensional clustering

Kernelization for Orthogonality Dimension

Effect of dimensionality on convergence rates of kernel ridge regression estimator

High--Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality