Abstract:Dimensionality reduction is an important method to analyze high-dimensional data and has many applications in pattern recognition and computer vision. In this paper, we propose a robust nonnegative patch alignment for dimensionality reduction, which includes a reconstruction error term and a whole alignment term. We use correntropy-induced metric to measure the reconstruction error, in which the weight is learned adaptively for each entry. For the whole alignment, we propose locality-preserving robust nonnegative patch alignment (LP-RNA) and sparsity-preserviing robust nonnegative patch alignment (SP-RNA), which are unsupervised and supervised, respectively. In the LP-RNA, we propose a locally sparse graph to encode the local geometric structure of the manifold embedded in high-dimensional space. In particular, we select large p-nearest neighbors for each sample, then obtain the sparse representation with respect to these neighbors. The sparse representation is used to build a graph, which simultaneously enjoys locality, sparseness, and robustness. In the SP-RNA, we simultaneously use local geometric structure and discriminative information, in which the sparse reconstruction coefficient is used to characterize the local geometric structure and weighted distance is used to measure the separability of different classes. For the induced nonconvex objective function, we formulate it into a weighted nonnegative matrix factorization based on half-quadratic optimization. We propose a multiplicative update rule to solve this function and show that the objective function converges to a local optimum. Several experimental results on synthetic and real data sets demonstrate that the learned representation is more discriminative and robust than most existing dimensionality reduction methods.

A Unifying Framework For Spectral Analysis Based Dimensionality Reduction

Patch Alignment for Dimensionality Reduction

Dimensionality reduction based on spectral graph and its application

A Transductive Framework of Distance Metric Learning by Spectral Dimensionality Reduction.

A Manifold-Based Dimension Reduction Algorithm Framework for Noisy Data Using Graph Sampling and Spectral Graph.

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

A Unified Framework for Semi-Supervised Dimensionality Reduction

Stable Local Dimensionality Reduction Approaches

Dimensionality Reduction: an Interpretation from Manifold Regularization Perspective.

Unsupervised attribute reduction algorithm framework based on spectral clustering and attribute significance function

Spectral regression: a regression framework for efficient regularized subspace learning

A Unified Framework for Discrete Spectral Clustering.

A unified semi-supervised dimensionality reduction framework for manifold learning

Spectral Regression: A Unified Approach for Sparse Subspace Learning

Robust Nonnegative Patch Alignment for Dimensionality Reduction

A Unifying Probabilistic Perspective for Spectral Dimensionality Reduction: Insights and New Models

Spectral Regression Based Marginal Fisher Analysis Dimensionality Reduction Algorithm.

Dimensionality Reduction for Hyperspectral Data Based on Class-Aware Tensor Neighborhood Graph and Patch Alignment

A General Framework for Manifold Reconstruction from Dimensionality Reduction.

A Spectral Clustering Algorithm Based on Manifold Distance Kernel

A General Framework for Dimensionality Reduction of K-Means Clustering