Abstract:Nonlinear discriminant analysis may be transformed into the form of kernel-based discriminant analysis. Thus, the corresponding discriminant direction can be solved by linear equations. From the view of feature space, the nonlinear discriminant analysis is still a linear method, and it is provable that in feature space the method is equivalent to Fisher discriminant analysis. We consider that one linear combination of parts of training samples, called ''significant nodes'', can replace the total training samples to express the corresponding discriminant vector in feature space to some extent. In this paper, an efficient algorithm is proposed to determine ''significant nodes'' one by one. The principle of determining ''significant nodes'' is simple and reasonable, and the consequent algorithm can be carried out with acceptable computation cost. Depending on the kernel functions between test samples and all ''significant nodes'', classification can be implemented. The proposed method is called fast kernel-based nonlinear method (FKNM). It is noticeable that the number of ''significant nodes'' may be much smaller than that of the total training samples. As a result, for two-class classification problems, the FKNM will be much more efficient than the naive kernel-based nonlinear method (NKNM). The FKNM can be also applied to multi-class via two approaches: one-against-the-rest and one-against-one. Although there is a view that one-against-one is superior to one-against-the-rest in classification efficiency, it seems that for the FKNM one-against-the-rest is more efficient than one-against-one. Experiments on benchmark and real datasets illustrate that, for two-class and multi-class classifications, the FKNM is effective, feasible and much efficient.

Fast Neighborhood Component Analysis.

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

Non-linear neighborhood component analysis based on constructive neural networks

Fast Best Neighborhood Matching Algorithm Based on Successive Elimination

Convolutional Nonlinear Neighbourhood Components Analysis for Time Series Classification.

A Fast Neighbor Prototype Selection Algorithm Based on Local Mean and Class Global Information

Fast Neighborhood Reconstruction with Adaptive Weights Learning

Face recognition using fast neighborhood component analysis with spatially smooth regularizer

Fast Neighbourhood Component Analysis with Spatially Smooth Regulariser for Robust Noisy Face Recognition

Modern Neighborhood Components Analysis: A Deep Tabular Baseline Two Decades Later

A Fast Kernel-Based Nonlinear Discriminant Analysis for Multi-Class Problems.

Neighborhood-Exact Nearest Neighbor Search for Face Retrieval

Fast Feature Matching Based on R-Nearest K-Means Searching

A Local Mean Representation-based K-Nearest Neighbor Classifier

Orthogonal Component Analysis: A Fast Dimensionality Reduction Algorithm

Unsupervised Neighborhood Component Analysis for Clustering.

Adaptive Nearest Neighbor: A General Framework for Distance Metric Learning

Parameter Free Large Margin Nearest Neighbor For Distance Metric Learning

Nearest Feature Space Analysis for Classification

Coarse to Fine K Nearest Neighbor Classifier

AN IMPROVEMENT TO THE NEAREST NEIGHBOR CLASSIFIER AND F ACE RECOGNITION EXPERIMENTS