Abstract:The k-nearest neighbor (k-NN) decision rule is the basis of a well-established, high-performance pattern-recognition technique but its sequential implementation is inherently slow. More recently, feedforward neural networks trained on error backpropagation have been widely used to solve a variety of pattern-recognition problems. However, it is arguably unnecessary to learn such a computationally intensive solution when one (i.e., the k-NN rule) is effectively available a priori, especially given the well-known pitfalls of backpropagation. Accordingly, there is some interest in the literature in network implementations of this rule, so as to combine its known, good performance with the speed of a massively parallel realization. In this paper, we present a novel neural-network architecture which implements the L-NN rule and whose distinctive feature relative to earlier work is its synchronous (i.e., clocked) nature. Essentially, it has a layered, feedforward structure but, in its basic form, also incorporates feedback to control sequential selection of the k neighbors. The principal advantages of this new scheme are the avoidance of the stability problems which can arise with alternative asynchronous feedback (lateral-inhibition) circuits, the restriction of analog weights to the first hidden layer and the fact that network design uses noniterative weight calculations rather than iterative backpropagation. Analysis of the network shows that it will converge to the desired solution (faithfully classifying the input pattern according to the k-NN rule) within (2k - 1) clock cycles. Apart from minor changes which can be effected externally, the same design serves for any value of X. The space complexity of the ('brute-force'' network implementation is O(N-2) units, where N is the number of training patterns, and it has O(N(2)d) analog weights where d is the dimensionality of these patterns. Thus, some modifications to reduce the required number of units (and, thereby, weighted connections) are considered. Overall, this paper affords for high-speed, parallel implementations of proven pattern-classification techniques.

Bipolar Pattern Association Using a Two-Layer Feedforward Neural Network

Efficient algorithm for the design of multilayer feedforward neural networks

On the Design of Feedforward Neural Networks for Binary Mappings

EEG Recognition Based on Multiple Types of Information by Using Wavelet Packet Transform and Neural Networks

Study of a Bionic Pattern Classifier Based on Olfactory Neural System

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Dense Associative Memory for Pattern Recognition

A Biologically Inspired Auto-Associative Network with Sparse Temporal Population Coding.

Optical implementation of a 2-D three-layer neural associative memory

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms

Pattern Storage and Hopfield Neural Associative Memory with Hidden Structure.

On Neural-Network Implementations of K-Nearest Neighbor Pattern Classifiers

On the associative ability of a feedback neural network with nonlinearly connected input elements

Generalized hetero-associative neural networks

Multistability of State-Dependent Switched Fractional-Order Hopfield Neural Networks With Mexican-Hat Activation Function and Its Application in Associative Memories

A Bidirectional Interaction-based Hybrid Network Architecture for EEG Cognitive Recognition

Bidirectional Associative Memory Utilizing Maximum Likelihood

Dynamic Properties and a New Learning Mechanism in Higher Order Neural Networks

Efficient supervised learning in networks with binary synapses