Abstract:Neighborhood reconstruction methods have been widely applied to feature engineering. Existing reconstruction-based discriminant analysis methods normally project high-dimensional data into a low-dimensional space while preserving the reconstruction relationships among samples. However, there are three limitations: 1) the reconstruction coefficients are learned based on the collaborative representation of all sample pairs, which requires the training time to be the cube of the number of samples; 2) these coefficients are learned in the original space, ignoring the interference of the noise and redundant features; and 3) there is a reconstruction relationship between heterogeneous samples; this will enlarge the similarity of heterogeneous samples in the subspace. In this article, we propose a fast and adaptive discriminant neighborhood projection model to tackle the above drawbacks. First, the local manifold structure is captured by bipartite graphs in which each sample is reconstructed by anchor points derived from the same class as that sample; this can avoid the reconstruction between heterogeneous samples. Second, the number of anchor points is far less than the number of samples; this strategy can reduce the time complexity substantially. Third, anchor points and reconstruction coefficients of bipartite graphs are updated adaptively in the process of dimensionality reduction, which can enhance the quality of bipartite graphs and extract discriminative features simultaneously. An iterative algorithm is designed to solve this model. Extensive results on toy data and benchmark datasets show the effectiveness and superiority of our model.

Fast and Robust Unsupervised Dimensionality Reduction with Adaptive Bipartite Graphs

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

Adaptive Flexible Optimal Graph for Unsupervised Dimensionality Reduction

Unsupervised Adaptive Bipartite Graph Embedding

Structure Preserved Fast Dimensionality Reduction

Fast Anchor Graph Preserving Projections

Unsupervised dimensionality reduction based on fractal dimension and genetic algorithm

Graph optimization for unsupervised dimensionality reduction with probabilistic neighbors

Discriminative Unsupervised Dimensionality Reduction.

Unsupervised Adaptive Embedding for Dimensionality Reduction

Kernel alignment unsupervised discriminative dimensionality reduction

Locality Sensitive Discriminative Unsupervised Dimensionality Reduction

Fast local representation learning with adaptive anchor graph

Fast Unsupervised Embedding Learning with Anchor-Based Graph

Flexible Adaptive Graph Embedding for Semi-supervised Dimension Reduction

Discriminative Unsupervised 2D Dimensionality Reduction with Graph Embedding

Fast and Flexible Large Graph Embedding Based on Anchors

Projective Unsupervised Flexible Embedding with Optimal Graph.

Unsupervised Optimized Bipartite Graph Embedding

Linear Manifold Regularization with Adaptive Graph for Semi-Supervised Dimensionality Reduction

Fast Discriminant Analysis with Adaptive Reconstruction Structure Preserving