Abstract:Nonlinear discriminant analysis may be transformed into the form of kernel-based discriminant analysis. Thus, the corresponding discriminant direction can be solved by linear equations. From the view of feature space, the nonlinear discriminant analysis is still a linear method, and it is provable that in feature space the method is equivalent to Fisher discriminant analysis. We consider that one linear combination of parts of training samples, called ''significant nodes'', can replace the total training samples to express the corresponding discriminant vector in feature space to some extent. In this paper, an efficient algorithm is proposed to determine ''significant nodes'' one by one. The principle of determining ''significant nodes'' is simple and reasonable, and the consequent algorithm can be carried out with acceptable computation cost. Depending on the kernel functions between test samples and all ''significant nodes'', classification can be implemented. The proposed method is called fast kernel-based nonlinear method (FKNM). It is noticeable that the number of ''significant nodes'' may be much smaller than that of the total training samples. As a result, for two-class classification problems, the FKNM will be much more efficient than the naive kernel-based nonlinear method (NKNM). The FKNM can be also applied to multi-class via two approaches: one-against-the-rest and one-against-one. Although there is a view that one-against-one is superior to one-against-the-rest in classification efficiency, it seems that for the FKNM one-against-the-rest is more efficient than one-against-one. Experiments on benchmark and real datasets illustrate that, for two-class and multi-class classifications, the FKNM is effective, feasible and much efficient.

Distance-Based Classifier Via the Kernel Trick.

A Novel Kernel Possibitistic Fuzzy C-Means Clustering Algorithm For Large Scale Data Sets

Kernel Fisher Discriminants and Kernel Nearest Neighbor Classifiers: A Comparative Study for Large-Scale Learning Problems

Improved kernel direct Fisher discriminant analysis and face recognition

Face recognition using a kernel fractional-step discriminant analysis algorithm

The Geometry of Nonlinear Embeddings in Kernel Discriminant Analysis

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

An Improved Kernel Fisher Discriminant Classifier and Its Applications

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Kernel discriminant analysis based on support vectors

A Fast Kernel-Based Nonlinear Discriminant Analysis for Multi-Class Problems.

Discriminant analysis based on kernelized decision boundary for face recognition

Adaptive quasiconformal kernel discriminant analysis

A Novel Kernel-Based Maximum a Posteriori Classification Method

Kernel optimization-based discriminant analysis for face recognition

Kernel Grassmannian Distances and Discriminant Analysis for Face Recognition from Image Sets

Face Recognition Using Kernel Based Fisher Discriminant Analysis

Graph kernel by spectral transform in kernel fisher discriminant analysis

Kernel Inverse Fisher Discriminant Analysis for Face Recognition