Abstract:The k nearest neighbor (KNN) classifier is one of the well-known instance-based classifiers. Nevertheless, the low efficiency in both running time and memory usage is a great challenge in the KNN classifier and its improvements due to noise and redundant samples. Although hybrid instance reduction approaches have been postulated as a good solution, they still suffer from the following issues: (a) adopted edition methods in existing hybrid instance reduction approaches are susceptible to harmful samples around the tested sample; (b) existing hybrid instance reduction approaches retain many internal samples, which contributes little to the classification accuracy and (or) leading to the low reduction rate; (c) existing hybrid instance reduction approaches rely on more than one parameter. The chief contributions of this article are that (a) a novel heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering (HIRRDKM) is proposed against the above issues; (b) a novel concept, i.e., the adaptive relative distance, is first proposed and calculated for each sample; (c) a novel edition method based on adaptive relative distance in HIRRDKM is second proposed to filter out harmful samples; (d) a novel condensing method based on adaptive relative distance and k-means clustering in HIRRDKM is third proposed to obtain condensed borderline samples from the training set without harmful samples. Experiments have proved that (a) HIRRDKM outperforms 6 state-of-the-art hybrid instance reduction methods on real data sets from various fields in weighing reduction rate and classification accuracy of KNN-based classifiers; (b) the running time of HIRRDKM is competitive.

The Problem of Multiple-instance Classification Based on the Integration Hausdorff Distance

Instance-Ranking: A New Perspective to Consider the Instance Dependency for Classification

Combining Multiple K-Nearest Neighbor Classifiers Using Different Distance Functions

Decision by Maximum of Posterior Probability Average with Weights: a Method of Multiple Classifiers Combination

Multiple Layer Classifiers Integration Based on Specialists' Fields

Multiple Classifiers Combination Based on Specialists' FIelds

Multi-hypothesis nearest-neighbor classifier based on class-conditional weighted distance metric.

Md-knn: an Instance-based Approach for Multi-Dimensional Classification

A heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering

Combination of Multiple Classifier Using Feature Space Partitioning

Optimal Combination of Feature Weight Learning and Classification Based on Local Approximation

Combination of Multiple K-NNCS by Fuzzy Integral

Robust and Discriminative Distance for Multi-Instance Learning

Learning Instance Specific Distance for Multi-Instance Classification.

Multiple Instance Boosting with Global Smoothness Regularization

Combining the Strength of Pattern Frequency and Distance for Classification

Dynamic Double Classifiers Approximation for Cross-Domain Recognition

Combining KNN algorithm and other classifiers.

Multiple instance learning from similarity-confidence bags

Combination Of Multiple Real-Valued Nearest Neighbor Classifiers Based On Different Feature Subsets With Fuzzy Integral

Hierarchical Distance Metric Learning for Large Margin Nearest Neighbor Classification.