Abstract:The K-nearest neighbor (KNN) rule is one of the most useful supervised classification methods, and is widely used in many pattern classification applications due to its simplicity. However, it faces prohibitive computational and storage requirements when dealing with large datasets. A reasonable way of alleviating this problem is to extract a small representative subset from the original dataset without reducing the classification accuracy. This means the most internal patterns are removed and the boundary patterns that can contribute to better classification accuracy are retained. To achieve this purpose, a new algorithm based on binary tree technique and some reduction operations is presented. The key issues of the proposed algorithm are how to build binary nearest neighbor search tree and design reduction strategies to keep the high classification accuracy patterns. In particular, firstly, we utilize several tree control rules and KNN rule to build a binary nearest neighbor tree of each random pattern. Secondly, according to the node locations in each binary nearest neighbor tree and the strategies of selection and replacement, different kinds of patterns as prototypes are obtained, which are close to class boundary regions or locate in the interior regions, and some internal patterns are generated. Finally, experimental results show that the proposed algorithm effectively reduces the number of prototypes while maintaining the same level of classification accuracy as the traditional KNN algorithm and other prototype algorithms. Moreover, it is a simple and fast hybrid algorithm for prototype reduction.

Adaptive Edited Natural Neighbor Algorithm

An Efficient Reduction Algorithm Based on Natural Neighbor and Nearest Enemy

Natural Neighbor Reduction Algorithm for Instance-based Learning

Extend Natural Neighbor: a Novel Classification Method with Self-Adaptive Neighborhood Parameters in Different Stages.

Adaptive Nearest Neighbor Algorithm with Dynamic Neighborhood

Natural Neighbor: A Self-Adaptive Neighborhood Method Without Parameter K

Adaptive evidential K-NN classification: Integrating neighborhood search and feature weighting

Natural Neighborhood-Based Classification Algorithm Without Parameter K.

Natural Neighborhood Graph-Based Instance Reduction Algorithm Without Parameters

EVOLVING EDITED K-Nearest NEIGHBOR CLASSIFIERS

Constraint Nearest Neighbor for Instance Reduction.

A new fast reduction technique based on binary nearest neighbor tree.

Natural Image Denoising Using Evolved Local Adaptive Filters.

Editing Training Data for kNN Classifiers with Neural Network Ensemble

A neighborhood classifier based on adaptive radius selection and attribute reduction

Classification Algorithm Based on Natural Nearest Neighbor

A New Locally Adaptive K-Nearest Neighbor Algorithm Based on Discrimination Class

A New Adaptive Elastic Net Method for Cluster Analysis.

An Adaptive K-Nearest Neighbor Algorithm

Evidential Editing K-Nearest Neighbor Classifier

Tri-Training Algorithm for Adaptive Nearest Neighbor Density Editing and Cross Entropy Evaluation.