Abstract:This paper presents a novel locally linear KNN model with the goal of not only developing efficient representation and classification methods, but also establishing a relation between them so as to approximate some classification rules, e.g. the Bayes decision rule. Towards that end, first, the proposed model represents the test sample as a linear combination of all the training samples and derives a new representation by learning the coefficients considering the reconstruction, locality and sparsity constraints. The theoretical analysis shows that the new representation has the grouping effect of the nearest neighbors, which is able to approximate the "ideal representation". And then the locally linear KNN model based classifier (LLKNNC), which shows its connection to the Bayes decision rule for minimum error in the view of kernel density estimation, is proposed for classification. Besides, the locally linear nearest mean classifier (LLNMC), whose relation to the LLKNNC is just like the nearest mean classifier to the KNN classifier, is also derived. Furthermore, to provide reliable kernel density estimation, the shifted power transformation and the coefficients cut-off method are applied to improve the performance of the proposed method. The effectiveness of the proposed model is evaluated on several visual recognition tasks such as face recognition, scene recognition, object recognition and action recognition. The experimental results show that the proposed model is effective and outperforms some other representative popular methods.

A New Locally Linear KNN Method with an Improved Marginal Fisher Analysis for Image Classification

Learning a Locality Preserving Subspace for Visual Recognition.

A Novel Locally Linear Knn Model For Visual Recognition

A Novel Locally Linear KNN Method With Applications to Visual Recognition.

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Improved kernel direct Fisher discriminant analysis and face recognition

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Constrained Linear Discrimination Analysis and Face Recognition

A New Discriminative Coding Method for Image Classification

Local Mean Representation Based Classifier and Its Applications for Data Classification.

Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

A Fast Document Classification Algorithm Based on Improved KNN

Nearest-neighbor Classifier Motivated Marginal Discriminant Projections for Face Recognition

Face Recognition Using Gabor-based Complete Kernel Fisher Discriminant Analysis with Fractional Power Polynomial Models

Saliency-Aware Image-To-Class Distances for Image Classification

ICNN: an Inter-class Nearest Neighbor Method for Face Recognition

Probability-Based Locally Linear Embedding for Classification

Local median based linear regression classification for biometric recognition

Feature Extraction By Locality-Based Linear Discriminant Analysis

Locality Discriminative Coding for Image Classification