Feature Extraction By Locality-Based Linear Discriminant Analysis

Pu Huang,Caikou Chen
2010-01-01
Abstract:In this paper, we present a novel feature extraction technique, called locality-based linear discriminant analysis (LLDA), for multi-class discriminant tasks. The proposed method can be regarded as an improved version of the classical linear discriminant analysis (LDA), which is one of the most popular feature extraction methods. LLDA has at least two distinct advantages compared with LDA. Firstly, LDA may fail to discover the potential structure in the data, while LLDA integrates both class label information and neighborhood relationships between samples, so LLDA has the ability to reveal the intrinsic structure in the data which is more helpful to solve such nonlinear problem as recognition tasks than LDA. Secondly, LDA usually can only extract at most C-1 (C is the number of sample classes) features in a real situation, which doesn't suffice to categorized all samples, while LLDA is able to obtain much more features. Therefore, LLDA has more powerful discriminant ability than LDA. We carry out LLDA and LDA, as well as other current popular algorithms such as PCA, LPP and MFA on the ORL face database and the CENPARPARMI handwritten numerical database, and the experimental results show that LLDA can achieve much higher recognition rate.
What problem does this paper attempt to address?