Abstract:Linear discriminant analysis (LDA) is a notable classification algorithm thanks to its major success in many applications of the real-world. In spite of its successfulness for low-dimensional data, a dimension reduction is inevitable for its achievement with high-dimensional data, especially in which the number of features is more than the training sample size or close to the training sample size. Principal component analysis (PCA) plus LDA (PCA+LDA), a quite popular technique, is widely used for raising the classification performance of LDA over high-dimensional data. However, PCA ignores the label information in the data. On the other hand, the reduced dimensional data through PCA still includes indiscriminate (i.e., irrelevant) features. To cope with the dimensionality problem of LDA, a hybrid dimension reduction approach of supervised and unsupervised algorithms is proposed in this study. In the supervised part of the proposed hybrid dimension reduction method, called DBDERF+PCA, we propose to combine an ensemble classifier (i.e., random forest) with dichotomous binary differential evolution (DBDE), a recently proposed variant of binary differential evolution, by introducing a robust wrapper feature selection. On the other hand, unsupervised part of the proposed hybrid dimension reduction method utilizes PCA. The experimental results show that DBDERF+PCA outperforms PCA in terms of dimension reduction. Thereupon, this hybrid dimension reduction based LDA, called DBDERF+PCA+LDA, performs better than PCA+LDA and LDA in terms of run-time and classification performances.

L-PCA-based dimensionality reduction algorithm for high dimension images

Image retrieval using dimensionality reduction

Laplacian Eigenmap for Image Retrieval

Image retrieval based on incremental subspace learning

Learning a Locality Preserving Subspace for Visual Recognition.

An Efficient Dual Dimensionality Reduction Scheme of Features for Image Classification.

A High Accuracy Nonlinear Dimensionality Reduction Optimization Method.

A Hybrid PCA-LDA Model for Dimension Reduction.

An MPCA/LDA Based Dimensionality Reduction Algorithm for Face Recognition

Improved Algorithms for High-Dimensional Robust Pca

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

Dimension Reduction Algorithm Based on Locality and Discriminant Characteristics

A Hybrid Dimension Reduction Based Linear Discriminant Analysis for Classification of High-Dimensional Data

Divergent Projection Analysis for Unsupervised Dimensionality Reduction

Image Classification Based on Laplacian PCA

Dimension Reduction of Image Deep Feature Using PCA.

PCA-KL: a parametric dimensionality reduction approach for unsupervised metric learning

Improved Discriminate Analysis for High-Dimensional Data and Its Application to Face Recognition.

Laplacian PCA and Its Applications

Facial recognition by PCA-LDA algorithm based on parallel clone selection algorithm

Joint Principal Component and Discriminant Analysis for Dimensionality Reduction