Abstract:Linear discriminant analysis (LDA) has been a popular method for extracting features which preserve class separability. The projection vectors are commonly obtained by maximizing the between class covariance and simultaneously minimizing the within class covariance. LDA can be performed either in the original input space or in the reproducing kernel Hilbert space (RKHS) into which data points are mapped, which leads to Kernel Discriminant Analysis (KDA). When the data are highly nonlinear distributed, KDA can achieve better performance than LDA. However, computing the projective functions in KDA involves eigen-decomposition of kernel matrix, which is very expensive when a large number of training samples exist. In this paper, we present a new algorithm for kernel discriminant analysis, called spectral regression kernel discriminant analysis (SRKDA). By using spectral graph analysis, SRKDA casts discriminant analysis into a regression framework which facilitates both efficient computation and the use of regularization techniques. Specifically, SRKDA only needs to solve a set of regularized regression problems and there is no eigenvector computation involved, which is a huge save of computational cost. Our computational analysis shows that SRKDA is 27 times faster than the ordinary KDA. Moreover, the new formulation makes it very easy to develop incremental version of the algorithm which can fully utilize the computational results of the existing training samples. Experiments on face recognition demonstrate the effectiveness and efficiency of the proposed algorithm.

A NEW ALGORITHM FOR COMPUTING OPTIMAL DISCRIMINANT VECTORS IN CONDITION OF HIGH-DIMENSIONAL DATA

Discriminative analysis of direct linear discriminant analysis for face recognition

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

A novel optimal discriminant principle in high dimensional spaces

Discriminant Common Vectors in Principal Component Analysis Transformed Space for Face Recognition

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Constrained Linear Discrimination Analysis and Face Recognition

Improved kernel direct Fisher discriminant analysis and face recognition

Two Dimension Linear Discriminant Analysis Based on Image Sampling and Regroupment

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

A New Algorithm for Generalized Optimal Discriminant Vectors

Face Recognition Using Novel LDA-Based Algorithms.

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Kernel optimization-based discriminant analysis for face recognition

Local Feature Discriminant Projection

Null Space-Based LDA with Weighted Dual Personal Subspaces for Face Recognition.

An Efficient Greedy Search Algorithm for High-Dimensional Linear Discriminant Analysis

Discriminant Local Feature Analysis of Facial Images

Discriminant Local Feature Analysis with Applications to Face Recognition

Efficient Kernel Discriminant Analysis via Spectral Regression

Adaptive Linear Discriminant Regression Classification for Face Recognition