Abstract:State-of-the-art image classification methods require an intensive learning/training stage (using SVM, Boosting, etc.) In contrast, non-parametric Nearest-Neighbor (NN) based image classifiers require no training time and have other favorable properties. However, the large performance gap between these two families of approaches rendered NN-based image classifiers useless. We claim that the effectiveness of non-parametric NN-based image classification has been considerably under-valued. We argue that two practices commonly used in image classification methods, have led to the inferior performance of NN-based image classifiers: (i) Quantization of local image descriptors (used to generate “bags-of-words”, codebooks). (ii) Computation of ‘Image-to-Image’ distance, instead of ‘Image-to-Class’ distance. We propose a trivial NN-based classifier - NBNN, (Naive-Bayes Nearest-Neighbor), which employs NN-distances in the space of the local image descriptors (and not in the space of images). NBNN computes direct ‘Image-to-Class’ distances without descriptor quantization. We further show that under the Naive-Bayes assumption, the theoretically optimal image classifier can be accurately approximated by NBNN. Although NBNN is extremely simple, efficient, and requires no learning/training phase, its performance ranks among the top leading learning-based image classifiers. Empirical comparisons are shown on several challenging databases (Caltech-101, Caltech-256 and Graz-01).

Rectified Nearest Feature Line Segment for Pattern Classification.

Extended Nearest Feature Line Classifier

Nearest Feature Line Classifier Based on Collaborative Representation with Nearest Neighbour Search Algorithm

Uncorrelated Discriminant Nearest Feature Line Analysis for Face Recognition

Nearest Feature Space Analysis for Classification

Nearest neighbour line nonparametric discriminant analysis for feature extraction

K-Ns: A Classifier by the Distance to the Nearest Subspace.

Key-Frame ExtractionBased Improved Nearest Feature Line(NFL) Classification Algorithm

The Nearest-Farthest Subspace Classification for Face Recognition

Tunable Nearest Neighbor Classifier

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Two-dimensional Nearest Neighbor Discriminant Analysis

Neighbourhood Sensitive Preserving Embedding for Pattern Classification.

A New Enhanced Nearest Feature Space (ENFS) Classifier for Gabor Wavelets Features-Based Face Recognition

K Nearest Neighbor Based Local Sparse Representation Classifier

PPL-net: Convolutional Neural Network-Based Polymorphic Points-Line verification framework.

Nearest-neighbor Classifier Motivated Marginal Discriminant Projections for Face Recognition

In defense of Nearest-Neighbor based image classification

An improved nearest neighbor searching method for classification problems

Active and Passive Nearest Neighbor Algorithm: A Newly-Developed Supervised Classifier

A Novel Separating Hyperplane Classification Framework to Unify Nearest-Class-Model Methods for High-Dimensional Data