Abstract:Because of high dimensionality, correlation among covariates, and noise contained in data, dimension reduction (DR) techniques are often employed to the application of machine learning algorithms. Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), and their kernel variants (KPCA, KLDA) are among the most popular DR methods. Recently, Supervised Kernel Principal Component Analysis (SKPCA) has been shown as another successful alternative. In this paper, brief reviews of these popular techniques are presented first. We then conduct a comparative performance study based on three simulated datasets, after which the performance of the techniques are evaluated through application to a pattern recognition problem in face image analysis. The gender classification problem is considered on MORPH-II and FG-NET, two popular longitudinal face aging databases. Several feature extraction methods are used, including biologically-inspired features (BIF), local binary patterns (LBP), histogram of oriented gradients (HOG), and the Active Appearance Model (AAM). After applications of DR methods, a linear support vector machine (SVM) is deployed with gender classification accuracy rates exceeding 95% on MORPH-II, competitive with benchmark results. A parallel computational approach is also proposed, attaining faster processing speeds and similar recognition rates on MORPH-II. Our computational approach can be applied to practical gender classification systems and generalized to other face analysis tasks, such as race classification and age prediction.

A Fast Feature-Based Dimension Reduction Algorithm for Kernel Classifiers

A Fast Kernel Dimension Reduction Algorithm with Applications to Face Recognition

Distance-Based Classifier Via the Kernel Trick.

Face recognition using a kernel fractional-step discriminant analysis algorithm

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Kernel optimization-based discriminant analysis for face recognition

Improved kernel direct Fisher discriminant analysis and face recognition

A Modification of Kernel Discriminant Analysis for High-Dimensional Data—with Application to Face Recognition

Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

A Comparison Study on Nonlinear Dimension Reduction Methods with Kernel Variations: Visualization, Optimization and Classification.

Kernel-based Improved Discriminant Analysis and Its Application to Face Recognition.

Multiple Kernel Dimensionality Reduction Based on Linear Regression Virtual Reconstruction for Image Set Classification

An MPCA/LDA Based Dimensionality Reduction Algorithm for Face Recognition

Kernel-based optimized feature vectors selection and discriminant analysis for face recognition

Joint Dimensionality Reduction for Face Recognition Based on D-KSVD.

A New Kernel Direct Discriminant Analysis (KDDA) Algorithm for Face Recognition

Space Transformation-based Kernel Fisher Discriminant Analysis

An efficient renovation on kernel Fisher discriminant analysis and face recognition experiments

Kernel discriminant analysis with weighted schemes and its application to face recognition

Clustering-Based Dimensionality Reduction for Kernel Matrix