Abstract:When performing visualization and classification, people often confront the problem of dimensionality reduction. Isomap is one of the most promising nonlinear dimensionality reduction techniques. However, when Isomap is applied to real-world data, it shows some limitations, such as being sensitive to noise. In this paper, an improved version of Isomap, namely S-Isomap, is proposed. S-Isomap utilizes class information to guide the procedure of nonlinear dimensionality reduction. Such a kind of procedure is called supervised nonlinear dimensionality reduction. In S-Isomap, the neighborhood graph of the input data is constructed according to a certain kind of dissimilarity between data points, which is specially designed to integrate the class information. The dissimilarity has several good properties which help to discover the true neighborhood of the data and, thus, makes S-Isomap a robust technique for both visualization and classification, especially for real-world problems. In the visualization experiments, S-Isomap is compared with Isomap, LLE, and WeightedIso. The results show that S-Isomap performs the best. In the classification experiments, S-Isomap is used as a preprocess of classification and compared with Isomap, WeightedIso, as well as some other well-established classification methods, including the K-nearest neighbor classifier, BP neural network, J4.8 decision tree, and SVM. The results reveal that S-Isomap excels compared to Isomap and WeightedIso in classification, and it is highly competitive with those well-known classification methods.

Learning Orthogonal Projections for Isomap

Orthogonal Isometric Projection

Orthogonal Locality Preserving Indexing

Orthogonal projection analysis

Discriminant Isomap projection

Linearization of Isomap

Orthogonal Self-Guided Similarity Preserving Projections

Supervised Isomap Based on Pairwise Constraints

Approximate Orthogonal Sparse Embedding for Dimensionality Reduction

Supervised nonlinear dimensionality reduction for visualization and classification.

Study on the Low-Dimensional Embedding and the Embedding Dimensionality of Manifold of High-Dimensional Data

Learning discriminant isomap for dimensionality reduction

Local Feature Discriminant Projection

Semi-supervised Discriminant Isomap with Application to Visualization, Image Retrieval and Classification

Learnable Subspace Orthogonal Projection for Semi-supervised Image Classification

Non-Linear Dimensionality Reduction Techniques of Distance-Preserving Projection for Visualization and Classification

Extended ISOMAP Based on Neighborhood Sets Relation

Robust Bi-Orthogonal Projection Learning: An Enhanced Dimensionality Reduction Method and Its Application in Unsupervised Learning †

Semi-supervised Orthogonal Graph Embedding with Recursive Projections.

Multi-Instance Dimensionality Reduction via Sparsity and Orthogonality

Isometric Multi-manifold Learning for Feature Extraction