Abstract:The k-nearest neighbor (k-NN) decision rule is the basis of a well-established, high-performance pattern-recognition technique but its sequential implementation is inherently slow. More recently, feedforward neural networks trained on error backpropagation have been widely used to solve a variety of pattern-recognition problems. However, it is arguably unnecessary to learn such a computationally intensive solution when one (i.e., the k-NN rule) is effectively available a priori, especially given the well-known pitfalls of backpropagation. Accordingly, there is some interest in the literature in network implementations of this rule, so as to combine its known, good performance with the speed of a massively parallel realization. In this paper, we present a novel neural-network architecture which implements the L-NN rule and whose distinctive feature relative to earlier work is its synchronous (i.e., clocked) nature. Essentially, it has a layered, feedforward structure but, in its basic form, also incorporates feedback to control sequential selection of the k neighbors. The principal advantages of this new scheme are the avoidance of the stability problems which can arise with alternative asynchronous feedback (lateral-inhibition) circuits, the restriction of analog weights to the first hidden layer and the fact that network design uses noniterative weight calculations rather than iterative backpropagation. Analysis of the network shows that it will converge to the desired solution (faithfully classifying the input pattern according to the k-NN rule) within (2k - 1) clock cycles. Apart from minor changes which can be effected externally, the same design serves for any value of X. The space complexity of the ('brute-force'' network implementation is O(N-2) units, where N is the number of training patterns, and it has O(N(2)d) analog weights where d is the dimensionality of these patterns. Thus, some modifications to reduce the required number of units (and, thereby, weighted connections) are considered. Overall, this paper affords for high-speed, parallel implementations of proven pattern-classification techniques.

New Neural Network Realization Algorithm for Neyman-Person Criterion

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

A Neural Network Model For General Minimax Problem

A New Probabilistic Neural Network Model Based on Backpropagation Algorithm

On Neural-Network Implementations of K-Nearest Neighbor Pattern Classifiers

A Novel Genetic Neural Network Algorithm with Link Switches and Its Application in University Professional Course Evaluation

A neural-based nonlinear L 1 -norm optimization algorithm for diagnosis of networks

Neyman-Pearson (NP) classification algorithms and NP receiver operating characteristics (NP-ROC)

A New Neural Network Algorithm for Adaptive Pattern-Recognition

Implementing the k-nearest neighbour rule via a neural network

An Extension of Fisher's Criterion: Theoretical Results with a Neural Network Realization

A New Likelihood Ratio Method for Training Artificial Neural Networks

Chi-Square Test Neural Network: A New Binary Classifier based on Backpropagation Neural Network

MPCE: A Maximum Probability Based Cross Entropy Loss Function for Neural Network Classification

Analysis of Algorithms and Error Evaluation Criteria in Chaotic Neural Network Predictions

PCNN: Probable-Class Nearest-Neighbor Explanations Improve Fine-Grained Image Classification Accuracy for AIs and Humans

Neural network integration of classical statistical tests for processing small samples of biometrics data

Optimal Classification-based Anomaly Detection with Neural Networks: Theory and Practice

A Gegenbauer Neural Network with Regularized Weights Direct Determination for Classification

A Novel Neural Network Learning Method for Dynamically Tuning Regularization Coefficient

Batch and online learning algorithms for nonconvex neyman-pearson classification