Abstract:<p>Dimensionality reduction techniques aim to transform the high-dimensional data into a meaningful reduced representation and have been consistently playing a fundamental role in the study of intrinsic dimensionality estimation and the design of an intelligent expert system towards real-world applications. From the perspective of manifold learning, locality preserving projections is a classical and commonly used dimensionality reduction method and it essentially learns the low-dimensional embedding under the constraint of preserving the local geometry of data. However, since it determines the neighborhood relationships in the original feature space that probably contains noisy and irrelevant features, the derived similarity between the neighbors are unreliable and the corresponding local data manifold tends to be error-prone, which inevitably leads to degraded performance for subsequent data analyses. Hence, how to accurately identify the true neighbor relationships for each sample remains crucial to the robustness improvement. In this work, we propose a novel approach, termed locality adaptive preserving projections (LAPP), to adaptively determine the neighbors and their relationships in the optimal subspace rather than in the original space. Specifically, due to the absence of prior knowledge of local properties of the underlying manifold, LAPP adopts a coarse-to-fine strategy to iteratively update the projected low-dimensional subspace and optimize the identification of the local structure of the data. Moreover, an iterative algorithm with fast convergence is utilized to solve the transformation matrix for explicit out-of-sample extension. Besides, LAPP is easy to implement and its key idea can be potentially extended to other methods for neighbor-finding and similarity measurement. To evaluate the performance of LAPP, we conduct comparative experiments on numerous synthetic and real-world datasets. Experimental results show that seeking the local structure in the original feature space misleads the selection of neighbors and the calculation of similarity and that the proposed method helps alleviate the negative effect of noisy and irrelevant features, which demonstrates its effectiveness. Besides, this study has the potential to enlighten relevant studies to consider the problem of optimizing the neighborhood relationships.</p>

A Projective Noise Reduction Algorithm Based on Laplacian Smoothing

Manifold-based Denoising, Outlier Detection, and Dimension Reduction Algorithm for High-Dimensional Data

A Manifold-Based Dimension Reduction Algorithm Framework for Noisy Data Using Graph Sampling and Spectral Graph.

Dataset Denoising Based on Manifold Assumption

Local Smoothing For Manifold Learning

Noisy Manifold Learning Using Neighborhood Smoothing Embedding

LOCAL LINEAR SMOOTHING FOR NONLINEAR MANIFOLD LEARNING

Robust Dimensionality Reduction via Low-rank Laplacian Graph Learning

Analytical Noise Treatment for Low-Dose Ct Projection Data by Penalized Weighted Least-Square Smoothing in the K-L Domain

Denoising for 3D Point Cloud Based on Regularization of a Statistical Low-Dimensional Manifold

Nonlinear Locality-Preserving Projections with Dynamic Graph Learning

Edge-Aware Volume Smoothing Using L0 Gradient Minimization

Manifold Fitting under Unbounded Noise

Multi-Sample Incremental Manifold Learning Algorithm Based on Isogonal Mapping

Nonlinear Noise Reduction Method by Local Projection with Adaptive Neighborhood Selection

A point cloud denoising network based on manifold in an unknown noisy environment

Design a Metric Robust to Complicated High Dimensional Noise for Efficient Manifold Denoising

Locality adaptive preserving projections for linear dimensionality reduction

Dynamic Point Cloud Denoising via Manifold-to-Manifold Distance

Impulsive Noise and Gaussian-Impulsive Mixed Noise 1 Removal by Low Dimensional Manifold Model ∗

Improving The Robustness Of Isomap By De-Noising