Abstract:Linear feature extraction methods have become indispensable tools in pattern recognition. The linear dimensionality reduction optimizes some objective to produce a linear transformation and derives the discriminative low-dimensional transformed data wherein the similarly labeled samples cluster tightly and the differently labeled samples keep away from one another. In the past, most of the methods achieve between-class distance by maximizing between-class-center-mean to make the differently labeled samples separated from each other. However, the samples in this study located in the class margin or within the other classes called hard samples often move slowly, which results in a small between-class distance and deteriorates the classification performance. Hence, we utilize the large margin nearest neighbor (LMNN) to quickly push only the hard samples toward the center of the class to get the large class margin instead of between-class, further improving the performance of classification. Combined with the linear discriminant analysis (LDA), a novel linear feature extraction method called LDA-LMNN is proposed. The method can address the limitations of LDA. Furthermore, the dropout is employed to the learning of linear transform matrix to improve the generalization ability and overcome the overfitting. The comparative experiments on various real-world datasets by using the state-of-the-art feature extraction methods demonstrate the effectiveness of the proposed method.

An Improved Linear Feature Extraction Method Based on Fisher Criterion

A New Feature Extraction Method Based on Fisher Discriminant Minimal Criterion

Feature extraction based on a linear separability criterion

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Improved kernel direct Fisher discriminant analysis and face recognition

Linear Laplacian Discrimination for Feature Extraction

An Improved Linear Discriminant Analysis with L1-Norm for Robust Feature Extraction

Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

A novel method for Fisher discriminant analysis

Uncorrelated linear discriminant analysis based on weighted pairwise Fisher criterion

Efficient Linear Feature Extraction Based on Large Margin Nearest Neighbor.

Feature Selection Based on Sparse Fisher Discrimimant Analysis

Feature Extraction Method Based on the Generalised Fisher Discriminant Criterion and Facial Recognition

New Linear Discriminant Analysis Based on Gaussian Mixture Model

Median Fisher Discriminator: a Robust Feature Extraction Method with Applications to Biometrics

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Theory of Fisher Linear Discriminant Analysis and Its Application

Feature extraction by dynamically revising the discriminant information in the objective space

Regularized Scatter Measure for Linear Feature Extraction

Face Recognition Based on Adaptively Weighted Fisherface

Feature Extraction Using Fuzzy Inverse Fda