Abstract:Conceptual illustration of the proposed approach. Subjects A and B are two different classes, and they contain two subclasses respectively. The subclasses are clustered by the RNN structure, the eigenspace of the RNN‐based scatter matrix are regularised by the eigenspectrum regularisation models, finally discriminative learning is implemented. Linear discriminant analysis is a classical method for solving problems of dimensional reduction and pattern classification. Although it has been extensively developed, however, it still suffers from various common problems, such as the Small Sample Size (SSS) and the multimodal problem. Neighbourhood linear discriminant analysis (nLDA) was recently proposed to solve the problem of multimodal class caused by the contravention of independently and identically distributed samples. However, due to the existence of many small‐scale practical applications, nLDA still has to face the SSS problem, which leads to instability and poor generalisation caused by the singularity of the within‐neighbourhood scatter matrix. The authors exploit the eigenspectrum regularisation techniques to circumvent the singularity of the within‐neighbourhood scatter matrix of nLDA, which is called Eigenspectrum Regularisation Reverse Neighbourhood Discriminative Learning (ERRNDL). The algorithm of nLDA is reformulated as a framework by searching two projection matrices. Three eigenspectrum regularisation models are introduced to our framework to evaluate the performance. Experiments are conducted on the University of California, Irvine machine learning repository and six image classification datasets. The proposed ERRNDL‐based methods achieve considerable performance.

Enhanced Iterative Projection for Subclass Analysis under EM Framework

Enhanced Iterative Projection for Subclass Discriminant Analysis under EM-alike Framework.

Multi-class AdaBoost ELM

Global subclass discriminant analysis

Kernel subclass discriminant analysis

Letters: Kernel subclass discriminant analysis

Structured Semi-Supervised Discriminant Analysis

3E-LDA

Multiclass Discriminant Analysis Via Adaptive Weighted Scheme

Understanding and Evaluating Sparse Linear Discriminant Analysis

MBLDA: A Novel Multiple Between-Class Linear Discriminant Analysis

A Modified Super-Efficiency Dea Approach for Solving Multi-Groups Classification Problems

LDA Revisited

Linear discriminant analysis based on genetic algorithm

Eigenspectrum regularisation reverse neighbourhood discriminative learning

SRDA: an Efficient Algorithm for Large-Scale Discriminant Analysis

Complete large margin linear discriminant analysis using mathematical programming approach

Robust Discriminant Analysis with Feature Selective Projection and Between-Classes Structural Incoherence

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

Generalized Discriminant Analysis: A Matrix Exponential Approach

Ensemble Learning Method for Classification: Integrating Data Envelopment Analysis with Machine Learning