Abstract:Sparse discriminative projection learning has attracted much attention due to its good performance in recognition tasks. In this article, a framework called generalized embedding regression (GER) is proposed, which can simultaneously perform low-dimensional embedding and sparse projection learning in a joint objective function with a generalized orthogonal constraint. Moreover, the label information is integrated into the model to preserve the global structure of data, and a rank constraint is imposed on the regression matrix to explore the underlying correlation structure of classes. Theoretical analysis shows that GER can obtain the same or approximate solution as some related methods with special settings. By utilizing this framework as a general platform, we design a novel supervised feature extraction approach called jointly sparse embedding regression (JSER). In JSER, we construct an intrinsic graph to characterize the intraclass similarity and a penalty graph to indicate the interclass separability. Then, the penalty graph Laplacian is used as the constraint matrix in the generalized orthogonal constraint to deal with interclass marginal points. Moreover, the L2,1 -norm is imposed on the regression terms for robustness to outliers and data's variations and the regularization term for jointly sparse projection learning, leading to interesting semantic interpretability. An effective iterative algorithm is elaborately designed to solve the optimization problem of JSER. Theoretically, we prove that the subproblem of JSER is essentially an unbalanced Procrustes problem and can be solved iteratively. The convergence of the designed algorithm is also proved. Experimental results on six well-known data sets indicate the competitive performance and latent properties of JSER.

Unsupervised feature extraction by low-rank and sparsity preserving embedding

Learning Latent Low-Rank and Sparse Embedding for Robust Image Feature Extraction

Approximate Low-Rank Projection Learning for Feature Extraction.

Low-rank Unsupervised Graph Feature Selection Via Feature Self-Representation.

Low-Rank Projection Learning Via Graph Embedding

Generalized Embedding Regression: A Framework for Supervised Feature Extraction

Locality Preserving Projection with Symmetric Graph Embedding for Unsupervised Dimensionality Reduction.

Discriminative feature extraction based on sparse and low-rank representation

Locality and similarity preserving embedding for feature selection

Local structure based supervised feature extraction

Supervised Neighborhood Preserving Embedding for Feature Extraction and Its Application for Soft Sensor Modeling

Unsupervised Feature Selection Via Local Structure Learning and Sparse Learning

Structure Preserving Projections Learning Via Low-Rank Embedding for Image Classification

Unsupervised Spectral Feature Selection with Dynamic Hyper-graph Learning

Rapid and brief communication: Local structure based supervised feature extraction

Low-Rank Preserving Projection Via Graph Regularized Reconstruction

Robust sparse low-rank embedding for image dimension reduction

Sparse Graph Embedding Unsupervised Feature Selection.

Unsupervised Robust Projection Learning by Low-Rank and Sparse Decomposition for Hyperspectral Feature Extraction

Unsupervised Feature Extraction for Hyperspectral Images Using Combined Low Rank Representation and Locally Linear Embedding

Low-rank 2D Local Discriminant Graph Embedding for Robust Image Feature Extraction