Abstract:Classification of high-dimensional data is usually not amenable to standard pattern recognition techniques owing to lack of necessary, underlying structured information of data. In this paper, we propose a new discriminant analysis based on three-step sparse residuals measurement called DA-TSSR to address this problem. Specifically, in the first stage of the proposed method, the contribution in presenting the test sample of any chosen class is respectively calculated by adding up the total contributions of all the training samples of this class, and then a certain class with the smallest contribution score is eliminated from the set of the training samples. This procedure is iteratively carried out for the set of the training samples of the remaining classes till the predefined termination condition is satisfied. The second stage of DA-TSSR seeks to represent the test sample as a linear combination of all the remaining training samples and exploits the representation ability of each training sample to determine M “nearest neighbors” for the test sample. By this means, it generates unequal number of training samples on each candidate class. The third stage of DA-TSSR again determines a new weighted sum of all unequal numbers of training samples from candidate classes, which is approximately equal to the test sample. We use the new weighted sum to perform the designing of sparse residuals grades, which can be incorporated into the typical discriminant analysis criterion. The proposed method not only has a high accuracy but also can be clearly interpreted. Experimental results conducted on the ORL, XM2VTS, FERET and AR face databases demonstrate the effectiveness of the proposed method.

Weighted orthogonal reconstructive discriminant analysis algorithm

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Orthogonal Discriminant Analysis Revisited

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Reconstructive discriminant analysis: A feature extraction method induced from linear regression classification.

Order-Preserving Wasserstein Discriminant Analysis

Robust Adaptive Linear Discriminant Analysis With Bidirectional Reconstruction Constraint

Robust Discriminant Analysis with Feature Selective Projection and Between-Classes Structural Incoherence

Linear and Deep Order-Preserving Wasserstein Discriminant Analysis

Parameterless Reconstructive Discriminant Analysis for Feature Extraction

Projection-optimal Local Fisher Discriminant Analysis for Feature Extraction

A Least-Squares Model To Orthogonal Linear Discriminant Analysis

Uncorrelated linear discriminant analysis based on weighted pairwise Fisher criterion

An efficient method for computing orthogonal discriminant vectors

A Linear Discriminant Analysis Framework Based on Random Subspace for Face Recognition.

Adaptive Weighted Multiclass Linear Discriminant Analysis

Reversible Discriminant Analysis

Supervised Orthogonal Discriminant Subspace Projects Learning for Face Recognition.

Orthogonal neighborhood preserving discriminant analysis for face recognition

Direct Orthogonal Discriminant Analysis

Using Idea of Three-Step Sparse Residuals Measurement to Perform Discriminant Analysis