Abstract:The k-nearest neighbor (k-NN) decision rule is the basis of a well-established, high-performance pattern-recognition technique but its sequential implementation is inherently slow. More recently, feedforward neural networks trained on error backpropagation have been widely used to solve a variety of pattern-recognition problems. However, it is arguably unnecessary to learn such a computationally intensive solution when one (i.e., the k-NN rule) is effectively available a priori, especially given the well-known pitfalls of backpropagation. Accordingly, there is some interest in the literature in network implementations of this rule, so as to combine its known, good performance with the speed of a massively parallel realization. In this paper, we present a novel neural-network architecture which implements the L-NN rule and whose distinctive feature relative to earlier work is its synchronous (i.e., clocked) nature. Essentially, it has a layered, feedforward structure but, in its basic form, also incorporates feedback to control sequential selection of the k neighbors. The principal advantages of this new scheme are the avoidance of the stability problems which can arise with alternative asynchronous feedback (lateral-inhibition) circuits, the restriction of analog weights to the first hidden layer and the fact that network design uses noniterative weight calculations rather than iterative backpropagation. Analysis of the network shows that it will converge to the desired solution (faithfully classifying the input pattern according to the k-NN rule) within (2k - 1) clock cycles. Apart from minor changes which can be effected externally, the same design serves for any value of X. The space complexity of the ('brute-force'' network implementation is O(N-2) units, where N is the number of training patterns, and it has O(N(2)d) analog weights where d is the dimensionality of these patterns. Thus, some modifications to reduce the required number of units (and, thereby, weighted connections) are considered. Overall, this paper affords for high-speed, parallel implementations of proven pattern-classification techniques.

Evolving Recurrent Neural Networks for Pattern Classification

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

On Neural-Network Implementations of K-Nearest Neighbor Pattern Classifiers

Towards Interpreting Recurrent Neural Networks Through Probabilistic Abstraction

Adaptive RBF Neural Networks for Pattern Classifications

Evaluating Recurrent Neural Network Explanations

Evolving Deep Convolutional Neural Networks for Image Classification

Learning Decision Trees Recurrently Through Communication

Evolving Long Short-Term Memory Network-Based Text Classification

EGNN-C+: Interpretable Evolving Granular Neural Network and Application in Classification of Weakly-Supervised EEG Data Streams

Learning and Unlearning: Bridging classification, memory and generative modeling in Recurrent Neural Networks

Combining contextual neural networks for time series classification

Explainable Neural Networks: Achieving Interpretability in Neural Models

Pattern Classification using Simplified Neural Networks

Explaining Deep Neural Networks by Leveraging Intrinsic Methods

Backpropagation through time learning for recurrence-aware long-term cognitive networks

Recurrent Spectral Network (RSN): shaping the basin of attraction of a discrete map to reach automated classification

Finding Interpretable Class-Specific Patterns through Efficient Neural Search

Neural Reasoning Networks: Efficient Interpretable Neural Networks With Automatic Textual Explanations

An NMF-Based Building Block for Interpretable Neural Networks With Continual Learning

Case-based selection of explanation methods for neural network image classifiers