Abstract:When performing visualization and classification, people often confront the problem of dimensionality reduction. Isomap is one of the most promising nonlinear dimensionality reduction techniques. However, when Isomap is applied to real-world data, it shows some limitations, such as being sensitive to noise. In this paper, an improved version of Isomap, namely S-Isomap, is proposed. S-Isomap utilizes class information to guide the procedure of nonlinear dimensionality reduction. Such a kind of procedure is called supervised nonlinear dimensionality reduction. In S-Isomap, the neighborhood graph of the input data is constructed according to a certain kind of dissimilarity between data points, which is specially designed to integrate the class information. The dissimilarity has several good properties which help to discover the true neighborhood of the data and, thus, makes S-Isomap a robust technique for both visualization and classification, especially for real-world problems. In the visualization experiments, S-Isomap is compared with Isomap, LLE, and WeightedIso. The results show that S-Isomap performs the best. In the classification experiments, S-Isomap is used as a preprocess of classification and compared with Isomap, WeightedIso, as well as some other well-established classification methods, including the K-nearest neighbor classifier, BP neural network, J4.8 decision tree, and SVM. The results reveal that S-Isomap excels compared to Isomap and WeightedIso in classification, and it is highly competitive with those well-known classification methods.

Self-Organizing Isometric Embedding

Nonlinear Dimensionality Reduction Based on Statistical Criterions

Locality Pursuit Embedding

Self-organized locally linear embedding for nonlinear dimensionality reduction

Locally Adaptive Nonlinear Dimensionality Reduction

Adaptively incremental self-organizing isometric embedding

Local Neighborhood Embedding for Unsupervised Nonlinear Dimension Reduction.

Dynamic Neighborhood Selection for Nonlinear Dimensionality Reduction

Relative transformation-based neighborhood optimization for isometric embedding

Global structure-guided neighborhood preserving embedding for dimensionality reduction

Unsupervised and Semi-supervised Dimensionality Reduction with Self-Organizing Incremental Neural Network and Graph Similarity Constraints.

Neighborhood Balance Embedding for Unsupervised Dimensionality Reduction

Adaptive Local Embedding Learning for Semi-Supervised Dimensionality Reduction

Nonlinear Dimensionality Reduction by Locally Linear Inlaying

Supervised nonlinear dimensionality reduction for visualization and classification.

Non-Euclidean Self-Organizing Maps

Efficient Isometric Multi-Manifold Learning Based on the Self-Organizing Method.

Robust Neighborhood Embedding for Unsupervised Feature Selection.

Dimensionality Reduction By Using Sparse Reconstruction Embedding

Local Linear Embedding with Adaptive Neighbors.

Self-Supervised Embedding for Subspace Clustering