Abstract:Recursive concave-convex Fisher Linear Discriminant (RPFLD) is a novel efficient dimension reduction method and has been successfully applied to image recognition. However, RPFLD suffers from singularity problem and may lose some useful discriminant information when applied to high-dimensional data. Moreover, RPFLD is computationally expensive because it has to solve a series of quadratic programming (QP) problems to obtain optimal solution. In order to improve the generalization performance of RPFLD and at the same time reduce its training burden, we propose a novel method termed as regularized least squares Fisher linear discriminant (RLS-FLD) in this paper. The central idea is to introduce regularization into RPFLD and simultaneously use the 2-norm loss function. In doing so, the objective function of RLS-FLD turns out to be positive-definite, thus avoiding singularity problem. To solve RLS-FLD, the concave-convex programming (CCP) algorithm is employed to convert the original nonconvex problem to a series of equality-constrained convex QP problems. Each optimization problem in this series has a closed-form solution in its primal formulation via classic Lagrangian method. The resulting RLS-FLD thus leads to much fast training speed and does not need any optimization packages. Meanwhile, theoretical analysis is provided to uncover the connections between RLS-FLD and regularized linear discriminant analysis (RLDA), thus giving more insight into the principle of RLS-FLD. The effectiveness of the proposed RLS-FLD is demonstrated by experimental results on some real-world handwritten digit, face and object recognition datasets.

A regularized least square based discriminative projections for feature extraction.

Sparsity Regularization Discriminant Projection for Feature Extraction

Low-rank Representation Based Discriminative Projection for Robust Feature Extraction

Regularized Least Square Discriminant Projection and Feature Selection

Local Feature Discriminant Projection

Collaborative Representation Based Local Discriminant Projection for Feature Extraction

Sparse Two-Dimensional Local Discriminant Projections for Feature Extraction

Locality-regularized Linear Regression Discriminant Analysis for Feature Extraction

Reweighted Robust and Discriminative Latent Subspace Projection for Face Recognition

A collaborative representation based projections method for feature extraction.

Supervised Sparsity Preserving Projections for Face Recognition.

Sparse Local Discriminant Projections for Feature Extraction

Two-Dimensional Exponential Sparse Discriminant Local Preserving Projections

Regularized Scatter Measure for Linear Feature Extraction

Discriminant Sparse Locality Preserving Projection for Face Recognition.

Locality-based Linear Discriminant Projection

Sparse Fuzzy Two-Dimensional Discriminant Local Preserving Projection (SF2DDLPP) for Robust Image Feature Extraction

Regularized Locality Preserving Discriminant Analysis

Rapid and brief communication: Local structure based supervised feature extraction

Regularized least squares fisher linear discriminant with applications to image recognition

Feature Selective Projection with Low-Rank Embedding and Dual Laplacian Regularization