Abstract:State-of-the-art image classification methods require an intensive learning/training stage (using SVM, Boosting, etc.) In contrast, non-parametric Nearest-Neighbor (NN) based image classifiers require no training time and have other favorable properties. However, the large performance gap between these two families of approaches rendered NN-based image classifiers useless. We claim that the effectiveness of non-parametric NN-based image classification has been considerably under-valued. We argue that two practices commonly used in image classification methods, have led to the inferior performance of NN-based image classifiers: (i) Quantization of local image descriptors (used to generate “bags-of-words”, codebooks). (ii) Computation of ‘Image-to-Image’ distance, instead of ‘Image-to-Class’ distance. We propose a trivial NN-based classifier - NBNN, (Naive-Bayes Nearest-Neighbor), which employs NN-distances in the space of the local image descriptors (and not in the space of images). NBNN computes direct ‘Image-to-Class’ distances without descriptor quantization. We further show that under the Naive-Bayes assumption, the theoretically optimal image classifier can be accurately approximated by NBNN. Although NBNN is extremely simple, efficient, and requires no learning/training phase, its performance ranks among the top leading learning-based image classifiers. Empirical comparisons are shown on several challenging databases (Caltech-101, Caltech-256 and Graz-01).

A fast nearest neighbor classifier based on self-organizing incremental neural network

A Nearest-Neighbour Method with Self-organizing Incremental Neural Network

A Fast Prototype-Based Nearest-Neighbor Classifier with Self-Organizing Incremental Neural Network

Self-Organizing Incremental Neural Network And Its Application

An Online Semi-Supervised Clustering Algorithm Based on a Self-organizing Incremental Neural Network.

An enhanced self-organizing incremental neural network for online unsupervised learning.

An Online Semi-supervised Active Learning Algorithm with Self-organiing Incremental Neural Network.

Fast Incremental Learning Method for One-Class Support Vector Machine

An incremental online semi-supervised active learning algorithm based on self-organizing incremental neural network

Fuzzy Self-Organizing Incremental Neural Network for Fuzzy Clustering

How to Use the SOINN Software: User’s Guide (Version 1.0)

K-Ns: A Classifier by the Distance to the Nearest Subspace.

Using self-organizing incremental neural network (SOINN) For radial basis function networks

An Enhanced Incremental Prototype Classifier using Subspace Representation Scheme

Discriminative Learning of the Prototype Set for Nearest Neighbor Classification

Active and Passive Nearest Neighbor Algorithm: A Newly-Developed Supervised Classifier

PCNN: Probable-Class Nearest-Neighbor Explanations Improve Fine-Grained Image Classification Accuracy for AIs and Humans

FANNC: A Fast Adaptive Neural Network Classifier

ICNN: an Inter-class Nearest Neighbor Method for Face Recognition

In defense of Nearest-Neighbor based image classification

A Fast KNN Algorithm Based on Simulated Annealing