Abstract:The k-nearest neighbor (k-NN) decision rule is the basis of a well-established, high-performance pattern-recognition technique but its sequential implementation is inherently slow. More recently, feedforward neural networks trained on error backpropagation have been widely used to solve a variety of pattern-recognition problems. However, it is arguably unnecessary to learn such a computationally intensive solution when one (i.e., the k-NN rule) is effectively available a priori, especially given the well-known pitfalls of backpropagation. Accordingly, there is some interest in the literature in network implementations of this rule, so as to combine its known, good performance with the speed of a massively parallel realization. In this paper, we present a novel neural-network architecture which implements the L-NN rule and whose distinctive feature relative to earlier work is its synchronous (i.e., clocked) nature. Essentially, it has a layered, feedforward structure but, in its basic form, also incorporates feedback to control sequential selection of the k neighbors. The principal advantages of this new scheme are the avoidance of the stability problems which can arise with alternative asynchronous feedback (lateral-inhibition) circuits, the restriction of analog weights to the first hidden layer and the fact that network design uses noniterative weight calculations rather than iterative backpropagation. Analysis of the network shows that it will converge to the desired solution (faithfully classifying the input pattern according to the k-NN rule) within (2k - 1) clock cycles. Apart from minor changes which can be effected externally, the same design serves for any value of X. The space complexity of the ('brute-force'' network implementation is O(N-2) units, where N is the number of training patterns, and it has O(N(2)d) analog weights where d is the dimensionality of these patterns. Thus, some modifications to reduce the required number of units (and, thereby, weighted connections) are considered. Overall, this paper affords for high-speed, parallel implementations of proven pattern-classification techniques.

A Fast Prototype-Based Nearest-Neighbor Classifier with Self-Organizing Incremental Neural Network

A fast nearest neighbor classifier based on self-organizing incremental neural network

A Nearest-Neighbour Method with Self-organizing Incremental Neural Network

A Fast Neighbor Prototype Selection Algorithm Based on Local Mean and Class Global Information

A Neighbor Prototype Selection Method Based on CCHPSO for Intrusion Detection

An Efficient Nearest Neighbor Classifier Algorithm Based on Pre-classify

K-Ns: A Classifier by the Distance to the Nearest Subspace.

Intra-Class Structure Aware Networks For Screen Defect Detection

Discriminative Learning of the Prototype Set for Nearest Neighbor Classification

An automatic selection method of??in??-NN classifier

An Online Semi-Supervised Clustering Algorithm Based on a Self-organizing Incremental Neural Network.

Fast Prototype Selection Algorithm Based on Adjacent Neighbourhood and Boundary Approximation.

Active and Passive Nearest Neighbor Algorithm: A Newly-Developed Supervised Classifier

PCNN: Probable-Class Nearest-Neighbor Explanations Improve Fine-Grained Image Classification Accuracy for AIs and Humans

On Neural-Network Implementations of K-Nearest Neighbor Pattern Classifiers

Self-representation Nearest Neighbor Search for Classification

Non-Contrastive Nearest Neighbor Identity-Guided Method for Unsupervised Object Re-identification

FANNC: A Fast Adaptive Neural Network Classifier

An Enhanced Incremental Prototype Classifier using Subspace Representation Scheme

An Adaptive Large Margin Nearest Neighbor Classification Algorithm

Doubly Approximate Nearest Neighbor Classification