Abstract:Linear discriminant analysis (LDA) has been a popular method for extracting features which preserve class separability. The projection vectors are commonly obtained by maximizing the between class covariance and simultaneously minimizing the within class covariance. LDA can be performed either in the original input space or in the reproducing kernel Hilbert space (RKHS) into which data points are mapped, which leads to Kernel Discriminant Analysis (KDA). When the data are highly nonlinear distributed, KDA can achieve better performance than LDA. However, computing the projective functions in KDA involves eigen-decomposition of kernel matrix, which is very expensive when a large number of training samples exist. In this paper, we present a new algorithm for kernel discriminant analysis, called spectral regression kernel discriminant analysis (SRKDA). By using spectral graph analysis, SRKDA casts discriminant analysis into a regression framework which facilitates both efficient computation and the use of regularization techniques. Specifically, SRKDA only needs to solve a set of regularized regression problems and there is no eigenvector computation involved, which is a huge save of computational cost. Our computational analysis shows that SRKDA is 27 times faster than the ordinary KDA. Moreover, the new formulation makes it very easy to develop incremental version of the algorithm which can fully utilize the computational results of the existing training samples. Experiments on face recognition demonstrate the effectiveness and efficiency of the proposed algorithm.

Kernel optimization-based discriminant analysis for face recognition

An Efficient Reformative Kernel Discriminant Analysis for Face Recognition

Improved kernel direct Fisher discriminant analysis and face recognition

Face recognition using a kernel fractional-step discriminant analysis algorithm

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Kernel-based optimized feature vectors selection and discriminant analysis for face recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Optimal Discriminant Analysis Based on Kernel Extension of Graph Embedding and Face Recognition

Kernel-based Nonlinear Discriminant Analysis for Face Recognition

A Kernel Function Optimization And Selection Algorithm Based On Cost Function Maximization

Discriminant analysis based on kernelized decision boundary for face recognition

Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

A Kernel Fractional-Step Nonlinear Discriminant Analysis for Pattern Recognition

Adaptive quasiconformal kernel discriminant analysis

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Kernel discriminant analysis based on support vectors

Face Recognition Using Gabor-based Complete Kernel Fisher Discriminant Analysis with Fractional Power Polynomial Models

Research on Optimizing Kernel Discriminant Analysis

Efficient Kernel Discriminant Analysis via Spectral Regression