Abstract:Because of high dimensionality, correlation among covariates, and noise contained in data, dimension reduction (DR) techniques are often employed to the application of machine learning algorithms. Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), and their kernel variants (KPCA, KLDA) are among the most popular DR methods. Recently, Supervised Kernel Principal Component Analysis (SKPCA) has been shown as another successful alternative. In this paper, brief reviews of these popular techniques are presented first. We then conduct a comparative performance study based on three simulated datasets, after which the performance of the techniques are evaluated through application to a pattern recognition problem in face image analysis. The gender classification problem is considered on MORPH-II and FG-NET, two popular longitudinal face aging databases. Several feature extraction methods are used, including biologically-inspired features (BIF), local binary patterns (LBP), histogram of oriented gradients (HOG), and the Active Appearance Model (AAM). After applications of DR methods, a linear support vector machine (SVM) is deployed with gender classification accuracy rates exceeding 95% on MORPH-II, competitive with benchmark results. A parallel computational approach is also proposed, attaining faster processing speeds and similar recognition rates on MORPH-II. Our computational approach can be applied to practical gender classification systems and generalized to other face analysis tasks, such as race classification and age prediction.

RESEARCH AND IMPLEMENT OF A SHAPE DIMENSION REDUCTION MODEL

Improved pyramid matching kernel for high dimension

Face Recognition Based on Fuzzy Rough Set Reduction

Research on 3D Object Recognition Algorithm Based on PCA and Moment Invariant

Kernel Principal Component Analysis and its Applications in Face Recognition and Active Shape Models

Improved Algorithms for High-Dimensional Robust Pca

Hyperspectral Remote Sensing Image Dimensionality Reduction by Kernel PCA Method Based on Nystrm Algorithm

Improved kernel direct Fisher discriminant analysis and face recognition

A Comparison Study on Nonlinear Dimension Reduction Methods with Kernel Variations: Visualization, Optimization and Classification.

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Automatic determining optimal parameters in multi-kernel collaborative fuzzy clustering based on dimension constraint

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Phase Space Reconstruction of Nonlinear Time Series Based on Kernel Method

Supervised Dimensionality Reduction Technology of Generalized Discriminant Component Analysis and Its Kernelization Forms

Kernel optimization-based discriminant analysis for face recognition

To Solve Kernel Principal Component Analysis Using Iterative Method

A General Kernelization Framework for Learning Algorithms Based on Kernel PCA.

Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

A critical feature extraction by kernel PCA in stock trading model

Sparse Unsupervised Dimensionality Reduction Algorithms

Determining the Optimal Kernel Parameter in KPCA Based on Sample Reconstruction