Abstract:Many instance selection algorithms have been introduced to reduce the high storage requirements and computation complexity of K-nearest neighbor (K-NN) classification rules. However, the information provided by the neighbors of one instance was still not completely utilized in many studies. The information is usually in the form of a quantitative metric for determining whether an instance can be selected. Thus, many instances may have the same quality, which confuses the selection results. In addition, the proposed metrics are simply added without deeper fusion and the information loss has further negative effects. To address these issues, we propose a new instance selection algorithm for K-NN rules in the evidence theory framework called evidential instance selection (EIS). The basic idea is that all neighbors of every instance first provide distinct items of evidence regarding the estimated value of the label (called the estimation label) for each instance. After fusing the items of evidence and computing the conflicts among them, instances with higher conflict are considered more likely to be near the class boundaries. Finally, the selection of boundary instances is formalized as solving an optimal problem, where the objective function considers both the reduction rate and classification accuracy. When dealing with big data sets, EIS is enhanced as a distributed and parallel version called EIS-AS by applying Apache Spark to alleviate the computational bottleneck. We tested EIS and EIS-AS with 30 small data sets and six big data sets, respectively, which contained up to 11 million instances. The experimental results showed that EIS performed well at simplifying the raw training data and EIS-AS could cope with big data sets in an appropriate manner.

A Sparse Reconstructive Evidential K-Nearest Neighbor Classifier for High-Dimensional Data

A Sparse Reconstructive Evidential -Nearest Neighbor Classifier for High-dimensional Data

Eclipse: Generalizing Knn and Skyline

A Distributed Rough Evidential K-NN Classifier: Integrating Feature Reduction and Classification

A Distributed Rough Evidential K -NN Classifier: Integrating Feature Reduction and Classification

Adaptive evidential K-NN classification: Integrating neighborhood search and feature weighting

Distributed EK-NN Classification

A New Evidential K-Nearest Neighbors Data Classification Method

Evidential instance selection for K-nearest neighbor classification of big data

Joint Evidential K-Nearest Neighbor Classification

K-Ns: A Classifier by the Distance to the Nearest Subspace.

Sparse Coefficient-Based K-Nearest Neighbor Classification.

A New Data Clustering Algorithm Based on the NEK-NN Rule

K Nearest Neighbor Based Local Sparse Representation Classifier

Eeknn: K-Nearest Neighbor Classifier With An Evidential Editing Procedure For Training Samples

A Fuzzy-Evidential k Nearest Neighbor Classification Algorithm

Efficient kNN Algorithm Based on Graph Sparse Reconstruction.

A Novel Spark-Based Attribute Reduction and Neighborhood Classification for Rough Evidence

A depth-based nearest neighbor algorithm for high-dimensional data classification

FLEX: A Fast and Light-weight Learned Index for kNN Search in High-Dimensional Space

Development and evaluation of a novel framework to enhance k-NN algorithm's accuracy in data sparsity contexts