Abstract:The k-nearest neighbor (k-NN) decision rule is the basis of a well-established, high-performance pattern-recognition technique but its sequential implementation is inherently slow. More recently, feedforward neural networks trained on error backpropagation have been widely used to solve a variety of pattern-recognition problems. However, it is arguably unnecessary to learn such a computationally intensive solution when one (i.e., the k-NN rule) is effectively available a priori, especially given the well-known pitfalls of backpropagation. Accordingly, there is some interest in the literature in network implementations of this rule, so as to combine its known, good performance with the speed of a massively parallel realization. In this paper, we present a novel neural-network architecture which implements the L-NN rule and whose distinctive feature relative to earlier work is its synchronous (i.e., clocked) nature. Essentially, it has a layered, feedforward structure but, in its basic form, also incorporates feedback to control sequential selection of the k neighbors. The principal advantages of this new scheme are the avoidance of the stability problems which can arise with alternative asynchronous feedback (lateral-inhibition) circuits, the restriction of analog weights to the first hidden layer and the fact that network design uses noniterative weight calculations rather than iterative backpropagation. Analysis of the network shows that it will converge to the desired solution (faithfully classifying the input pattern according to the k-NN rule) within (2k - 1) clock cycles. Apart from minor changes which can be effected externally, the same design serves for any value of X. The space complexity of the ('brute-force'' network implementation is O(N-2) units, where N is the number of training patterns, and it has O(N(2)d) analog weights where d is the dimensionality of these patterns. Thus, some modifications to reduce the required number of units (and, thereby, weighted connections) are considered. Overall, this paper affords for high-speed, parallel implementations of proven pattern-classification techniques.

Implementing the k-nearest neighbour rule via a neural network

On Neural-Network Implementations of K-Nearest Neighbor Pattern Classifiers

Faster Nearest Neighbor Machine Translation

K-Ns: A Classifier by the Distance to the Nearest Subspace.

A Neurally Inspired Pattern Recognition Approach with Latency-Phase Encoding and Precise-Spike-driven Rule in Spiking Neural Network.

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Improving NeuCube Spiking Neural Network for EEG-based Pattern Recognition Using Transfer Learning

Nearest Feature Line Classifier Based on Collaborative Representation with Nearest Neighbour Search Algorithm

Neural Nearest Neighbors Networks

Neural Networks: Computational Models and Applications - ReadingSample

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

A Neural Network Approach to Real-Time Pattern Recognition

A Spiking Neural Network System for Robust Sequence Recognition

Neural Embeddings for Knn Search in Biological Sequence

Flexible Neural Network for Fast and Accurate Road Scene Perception.

A New Method of the Image Pattern Recognition Based on Neural Networks.

Rethinking Nearest Neighbors for Visual Classification

$k$-Nearest Neighbor Augmented Neural Networks for Text Classification

The Implementation of A Knn Classifier on Fpga with A Parallel and Pipelined Architecture Based on Predetermined Range Search

FLEX: A Fast and Light-weight Learned Index for kNN Search in High-Dimensional Space

Neural Network Used for the Fusion of Predictions Obtained by the K-Nearest Neighbors Algorithm Based on Independent Data Sources