Abstract:Linear discriminant analysis (LDA) has been a popular method for dimensionality reduction, which preserves class separability. The projection vectors are commonly obtained by maximizing the between-class covariance and simultaneously minimizing the within-class covariance. LDA can be performed either in the original input space or in the reproducing kernel Hilbert space (RKHS) into which data points are mapped, which leads to kernel discriminant analysis (KDA). When the data are highly nonlinear distributed, KDA can achieve better performance than LDA. However, computing the projective functions in KDA involves eigen-decomposition of kernel matrix, which is very expensive when a large number of training samples exist. In this paper, we present a new algorithm for kernel discriminant analysis, called Spectral Regression Kernel Discriminant Analysis (SRKDA). By using spectral graph analysis, SRKDA casts discriminant analysis into a regression framework, which facilitates both efficient computation and the use of regularization techniques. Specifically, SRKDA only needs to solve a set of regularized regression problems, and there is no eigenvector computation involved, which is a huge save of computational cost. The new formulation makes it very easy to develop incremental version of the algorithm, which can fully utilize the computational results of the existing training samples. Moreover, it is easy to produce sparse projections (Sparse KDA) with a L 1 -norm regularizer. Extensive experiments on spoken letter, handwritten digit image and face image data demonstrate the effectiveness and efficiency of the proposed algorithm.

A Direct Method to Solve the Biased Discriminant Analysis in Kernel Feature Space for Content Based Image Retrieval

Kernel full-space biased discriminant analysis

Direct Kernel Biased Discriminant Analysis: A New Content-Based Image Retrieval Relevance Feedback Algorithm.

Nonparametric discriminant analysis in relevance feedback for content-based image retrieval

Discriminative analysis of direct linear discriminant analysis for face recognition

Improved kernel direct Fisher discriminant analysis and face recognition

2-Dimensional Kernel Discriminant Analysis Based on Image Sampling and Regrouping

Distance-Based Classifier Via the Kernel Trick.

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Biased Discriminant Euclidean Embedding for Content-Based Image Retrieval.

Kernel optimization-based discriminant analysis for face recognition

Adaptive quasiconformal kernel discriminant analysis

Discriminant Kernel Assignment for Image Coding

Similarity Measure Learning for Image Retrieval Using Binary Component Discriminating Function

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Face recognition using a kernel fractional-step discriminant analysis algorithm

Asymmetric Bagging and Random Subspace for Support Vector Machines-Based Relevance Feedback in Image Retrieval

An Efficient Reformative Kernel Discriminant Analysis for Face Recognition

Efficient Kernel Discriminant Analysis via Spectral Regression

Speed up kernel discriminant analysis

Discriminant analysis based on kernelized decision boundary for face recognition