Abstract:The k nearest neighbor (KNN) classifier is one of the well-known instance-based classifiers. Nevertheless, the low efficiency in both running time and memory usage is a great challenge in the KNN classifier and its improvements due to noise and redundant samples. Although hybrid instance reduction approaches have been postulated as a good solution, they still suffer from the following issues: (a) adopted edition methods in existing hybrid instance reduction approaches are susceptible to harmful samples around the tested sample; (b) existing hybrid instance reduction approaches retain many internal samples, which contributes little to the classification accuracy and (or) leading to the low reduction rate; (c) existing hybrid instance reduction approaches rely on more than one parameter. The chief contributions of this article are that (a) a novel heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering (HIRRDKM) is proposed against the above issues; (b) a novel concept, i.e., the adaptive relative distance, is first proposed and calculated for each sample; (c) a novel edition method based on adaptive relative distance in HIRRDKM is second proposed to filter out harmful samples; (d) a novel condensing method based on adaptive relative distance and k-means clustering in HIRRDKM is third proposed to obtain condensed borderline samples from the training set without harmful samples. Experiments have proved that (a) HIRRDKM outperforms 6 state-of-the-art hybrid instance reduction methods on real data sets from various fields in weighing reduction rate and classification accuracy of KNN-based classifiers; (b) the running time of HIRRDKM is competitive.

Natural Neighborhood Graph-Based Instance Reduction Algorithm Without Parameters

Natural Neighbor Reduction Algorithm for Instance-based Learning

Constraint Nearest Neighbor for Instance Reduction.

Quick attribute reduct algorithm for neighborhood rough set model

Adaptive Edited Natural Neighbor Algorithm

Fast Data Reduction with Granulation-Based Instances Importance Labeling.

Attribute Reduction with Personalized Information Granularity of Nearest Mutual Neighbors

A Network Anomaly Detection Algorithm Based on Natural Neighborhood Graph.

A Parameterless Clustering Algorithm Based on Strict Neighborhood Graph

Tri-level attribute reduction based on neighborhood rough sets

A parameter-free hybrid instance selection algorithm based on local sets with natural neighbors

A heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering

Unsupervised attribute reduction based on neighborhood dependency

Weighted Natural Neighborhood Graph: an Adaptive Structure for Clustering and Outlier Detection with No Neighborhood Parameter

Neighborhood Attribute Reduction: a Multi-Criterion Approach

Natural Neighbor: A Self-Adaptive Neighborhood Method Without Parameter K

Natural Neighborhood-Based Classification Algorithm Without Parameter K.

A relative position view-based instances set reduction algorithm

An Efficient Reduction Algorithm Based on Natural Neighbor and Nearest Enemy

Heuristic Attribute Reduction Based on Neighborhood Knowledge Granularity

Efficient Neighborhood Covering Reduction With Submodular Function Optimization