Abstract:Conceptual illustration of the proposed approach. Subjects A and B are two different classes, and they contain two subclasses respectively. The subclasses are clustered by the RNN structure, the eigenspace of the RNN‐based scatter matrix are regularised by the eigenspectrum regularisation models, finally discriminative learning is implemented. Linear discriminant analysis is a classical method for solving problems of dimensional reduction and pattern classification. Although it has been extensively developed, however, it still suffers from various common problems, such as the Small Sample Size (SSS) and the multimodal problem. Neighbourhood linear discriminant analysis (nLDA) was recently proposed to solve the problem of multimodal class caused by the contravention of independently and identically distributed samples. However, due to the existence of many small‐scale practical applications, nLDA still has to face the SSS problem, which leads to instability and poor generalisation caused by the singularity of the within‐neighbourhood scatter matrix. The authors exploit the eigenspectrum regularisation techniques to circumvent the singularity of the within‐neighbourhood scatter matrix of nLDA, which is called Eigenspectrum Regularisation Reverse Neighbourhood Discriminative Learning (ERRNDL). The algorithm of nLDA is reformulated as a framework by searching two projection matrices. Three eigenspectrum regularisation models are introduced to our framework to evaluate the performance. Experiments are conducted on the University of California, Irvine machine learning repository and six image classification datasets. The proposed ERRNDL‐based methods achieve considerable performance.

Spectral Clustering Based Null Space Linear Discriminant Analysis (Snlda)

Semi-Supervised Nonparametric Discriminant Analysis

Multiclass Spectral Clustering Based on Discriminant Analysis

Neighborhood linear discriminant analysis

Neighbor Class Linear Discriminate Analysis

From NLDA to LDA/GSVD: a Modified NLDA Algorithm

Unsupervised Feature Selection Using Nonnegative Spectral Analysis.

Nonnegative Spectral Clustering with Discriminative Regularization.

Discriminative Nonnegative Spectral Clustering with Out-of-Sample Extension

Network linear discriminant analysis

Eigenspectrum regularisation reverse neighbourhood discriminative learning

Two-dimensional Nearest Neighbor Discriminant Analysis

Nearest neighbour line nonparametric discriminant analysis for feature extraction

Representative Null Space LDA for Discriminative Dimensionality Reduction

Subspace Clustering by Directly Solving Discriminative K-means

Null Space-Based LDA with Weighted Dual Personal Subspaces for Face Recognition.

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Multimodal Linear Discriminant Analysis Via Structural Sparsity

Reverse nearest neighbors Bhattacharyya bound linear discriminant analysis for multimodal classification

Unsupervised Linear Discriminant Analysis for Jointly Clustering and Subspace Learning

A Bi-level Nonlinear Eigenvector Algorithm for Wasserstein Discriminant Analysis