Abstract:State-of-the-art image classification methods require an intensive learning/training stage (using SVM, Boosting, etc.) In contrast, non-parametric Nearest-Neighbor (NN) based image classifiers require no training time and have other favorable properties. However, the large performance gap between these two families of approaches rendered NN-based image classifiers useless. We claim that the effectiveness of non-parametric NN-based image classification has been considerably under-valued. We argue that two practices commonly used in image classification methods, have led to the inferior performance of NN-based image classifiers: (i) Quantization of local image descriptors (used to generate “bags-of-words”, codebooks). (ii) Computation of ‘Image-to-Image’ distance, instead of ‘Image-to-Class’ distance. We propose a trivial NN-based classifier - NBNN, (Naive-Bayes Nearest-Neighbor), which employs NN-distances in the space of the local image descriptors (and not in the space of images). NBNN computes direct ‘Image-to-Class’ distances without descriptor quantization. We further show that under the Naive-Bayes assumption, the theoretically optimal image classifier can be accurately approximated by NBNN. Although NBNN is extremely simple, efficient, and requires no learning/training phase, its performance ranks among the top leading learning-based image classifiers. Empirical comparisons are shown on several challenging databases (Caltech-101, Caltech-256 and Graz-01).

Nonlinear Nearest Subspace Classifier

K-Ns: A Classifier by the Distance to the Nearest Subspace.

The Nearest-Farthest Subspace Classification for Face Recognition

Nearest Feature Space Analysis for Classification

Kernel Representation-Based Nearest Neighbor Classifier

Intrinsic Dimension Estimation Via Nearest Constrained Subspace Classifier

Two-dimensional Nearest Neighbor Discriminant Analysis

Nearest Intra-Class Space Classifier for Face Recognition

Novel nonlinear method used for face recognition

Face recognition using an NNSRM classifier in LDA subspace

Affine Subspace Nearest Points Classification Algorithm

Nearest Feature Line Classifier Based on Collaborative Representation with Nearest Neighbour Search Algorithm

Nonlinear subspace clustering for image clustering.

Gabor Wavelets Transform and Extended Nearest Feature Space Classifier for Face Recognition

Nearest neighbour line nonparametric discriminant analysis for feature extraction

Nonlinear subspace clustering by functional link neural networks

Image Recognition Via Two-Dimensional Random Projection and Nearest Constrained Subspace

Classification by Nearness in Complementary Subspaces.

An Improvement To The Nearest Neighbor Classifier And Face Recognition Experiments

In defense of Nearest-Neighbor based image classification

Nonlinear and Nonparametric Extensions