Abstract:The k-nearest neighbor (k-NN) decision rule is the basis of a well-established, high-performance pattern-recognition technique but its sequential implementation is inherently slow. More recently, feedforward neural networks trained on error backpropagation have been widely used to solve a variety of pattern-recognition problems. However, it is arguably unnecessary to learn such a computationally intensive solution when one (i.e., the k-NN rule) is effectively available a priori, especially given the well-known pitfalls of backpropagation. Accordingly, there is some interest in the literature in network implementations of this rule, so as to combine its known, good performance with the speed of a massively parallel realization. In this paper, we present a novel neural-network architecture which implements the L-NN rule and whose distinctive feature relative to earlier work is its synchronous (i.e., clocked) nature. Essentially, it has a layered, feedforward structure but, in its basic form, also incorporates feedback to control sequential selection of the k neighbors. The principal advantages of this new scheme are the avoidance of the stability problems which can arise with alternative asynchronous feedback (lateral-inhibition) circuits, the restriction of analog weights to the first hidden layer and the fact that network design uses noniterative weight calculations rather than iterative backpropagation. Analysis of the network shows that it will converge to the desired solution (faithfully classifying the input pattern according to the k-NN rule) within (2k - 1) clock cycles. Apart from minor changes which can be effected externally, the same design serves for any value of X. The space complexity of the ('brute-force'' network implementation is O(N-2) units, where N is the number of training patterns, and it has O(N(2)d) analog weights where d is the dimensionality of these patterns. Thus, some modifications to reduce the required number of units (and, thereby, weighted connections) are considered. Overall, this paper affords for high-speed, parallel implementations of proven pattern-classification techniques.

Neural networks with functional inputs for multi-class supervised classification of replicated point patterns

Neural Networks as Functional Classifiers

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Spatial point patterns generation on remote sensing data using convolutional neural networks with further statistical analysis

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Supervised functional classification: A theoretical remark and some comparisons

On Neural-Network Implementations of K-Nearest Neighbor Pattern Classifiers

Supervised learning of spatial features with STDP and homeostasis using Spiking Neural Networks on SpiNNaker

Finding Interpretable Class-Specific Patterns through Efficient Neural Search

Data-driven perception of neuron point process with unknown unknowns

Inherently interpretable position-aware convolutional motif kernel networks for biological sequencing data

Implementing the k-nearest neighbour rule via a neural network

Deep Learning With Functional Inputs

SynapsNet: Enhancing Neuronal Population Dynamics Modeling via Learning Functional Connectivity

Modelling Irregular Spatial Patterns Using Graph Convolutional Neural Networks

Assessing similarities between spatial point patterns with a Siamese neural network discriminant model

Neural Point Process for Learning Spatiotemporal Event Dynamics

Selective Kernel Networks

Neural Network Modelling for Sports Performance Classification as a Complex Socio-Technical System

Pattern Recognition and Classification of Remotely Sensed Images by Artificial Neural Networks

Spatiotemporal Information Processing with a Reservoir Decision-making Network