Abstract:Sparse discriminative projection learning has attracted much attention due to its good performance in recognition tasks. In this article, a framework called generalized embedding regression (GER) is proposed, which can simultaneously perform low-dimensional embedding and sparse projection learning in a joint objective function with a generalized orthogonal constraint. Moreover, the label information is integrated into the model to preserve the global structure of data, and a rank constraint is imposed on the regression matrix to explore the underlying correlation structure of classes. Theoretical analysis shows that GER can obtain the same or approximate solution as some related methods with special settings. By utilizing this framework as a general platform, we design a novel supervised feature extraction approach called jointly sparse embedding regression (JSER). In JSER, we construct an intrinsic graph to characterize the intraclass similarity and a penalty graph to indicate the interclass separability. Then, the penalty graph Laplacian is used as the constraint matrix in the generalized orthogonal constraint to deal with interclass marginal points. Moreover, the L2,1 -norm is imposed on the regression terms for robustness to outliers and data's variations and the regularization term for jointly sparse projection learning, leading to interesting semantic interpretability. An effective iterative algorithm is elaborately designed to solve the optimization problem of JSER. Theoretically, we prove that the subproblem of JSER is essentially an unbalanced Procrustes problem and can be solved iteratively. The convergence of the designed algorithm is also proved. Experimental results on six well-known data sets indicate the competitive performance and latent properties of JSER.

Feature Extraction Using Class-Oriented Regression Embedding

Generalized Embedding Regression: A Framework for Supervised Feature Extraction

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

Decompose Learning: Combine Feature Extraction and Classification

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

Low-rank Representation Based Discriminative Projection for Robust Feature Extraction

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Robust non-negative supervised low-rank discriminant embedding (NSLRDE) for feature extraction

Feature Extraction Based on Low-rank Affinity Matrix for Biological Recognition

Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Locality-regularized Linear Regression Discriminant Analysis for Feature Extraction

Supervised Neighborhood Preserving Embedding for Feature Extraction and Its Application for Soft Sensor Modeling

Collaborative Representation Based Local Discriminant Projection for Feature Extraction

Robust Neighborhood Embedding for Unsupervised Feature Selection.

Enhancing Continual Relation Extraction Via Classifier Decomposition

Feature Extraction via Sparse Fuzzy Difference Embedding (SFDE) for Robust Subspace Learning

Feature Extraction By Locality-Based Linear Discriminant Analysis

Unsupervised feature extraction by low-rank and sparsity preserving embedding

Feature extraction based on graph discriminant embedding and its applications to face recognition

Discriminant projection embedding for face and palmprint recognition.

Low-rank 2D Local Discriminant Graph Embedding for Robust Image Feature Extraction