Abstract:The k nearest neighbor (KNN) classifier is one of the well-known instance-based classifiers. Nevertheless, the low efficiency in both running time and memory usage is a great challenge in the KNN classifier and its improvements due to noise and redundant samples. Although hybrid instance reduction approaches have been postulated as a good solution, they still suffer from the following issues: (a) adopted edition methods in existing hybrid instance reduction approaches are susceptible to harmful samples around the tested sample; (b) existing hybrid instance reduction approaches retain many internal samples, which contributes little to the classification accuracy and (or) leading to the low reduction rate; (c) existing hybrid instance reduction approaches rely on more than one parameter. The chief contributions of this article are that (a) a novel heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering (HIRRDKM) is proposed against the above issues; (b) a novel concept, i.e., the adaptive relative distance, is first proposed and calculated for each sample; (c) a novel edition method based on adaptive relative distance in HIRRDKM is second proposed to filter out harmful samples; (d) a novel condensing method based on adaptive relative distance and k-means clustering in HIRRDKM is third proposed to obtain condensed borderline samples from the training set without harmful samples. Experiments have proved that (a) HIRRDKM outperforms 6 state-of-the-art hybrid instance reduction methods on real data sets from various fields in weighing reduction rate and classification accuracy of KNN-based classifiers; (b) the running time of HIRRDKM is competitive.

An Efficient Reduction Algorithm Based on Natural Neighbor and Nearest Enemy

A new fast reduction technique based on binary nearest neighbor tree.

Natural Neighbor Reduction Algorithm for Instance-based Learning

Adaptive Edited Natural Neighbor Algorithm

Fast Prototype Selection Algorithm Based on Adjacent Neighbourhood and Boundary Approximation.

A Nearest Prototype Selection Algorithm Using Multi-objective Optimization and Partition

A Fast Neighbor Prototype Selection Algorithm Based on Local Mean and Class Global Information

Adaptive Boundary Approximation Prototype Selection Algorithm

Discriminative Learning of the Prototype Set for Nearest Neighbor Classification

Support vector based prototype selection method for nearest neighbor rules

Constraint Nearest Neighbor for Instance Reduction.

A Neighbor Prototype Selection Method Based on CCHPSO for Intrusion Detection

Prototype selection based on multi-objective optimisation and partition strategy

Attribute Reduction with Personalized Information Granularity of Nearest Mutual Neighbors

Prototype Generation Using Multiobjective Particle Swarm Optimization for Nearest Neighbor Classification.

An Efficient Nearest Neighbor Classifier Algorithm Based on Pre-classify

HQProtoPNet: an Evidence-Based Model for Interpretable Image Recognition.

A relative position view-based instances set reduction algorithm

A heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering

Fast Reduction Algorithm Research Based on k-Nearest Neighbor Fuzzy Rough Set

The Reduction Algorithm of Hybrid Decision System Based on Neighborhood Granulation and Niche Clone Selection