Abstract:Background and objectives: In machine learning, the accuracy of the system depends upon classification result. Classification accuracy plays an imperative role in various domains. Non-parametric classifier like K-Nearest Neighbor (KNN) is the most widely used classifier for pattern analysis. Besides its easiness, simplicity and effectiveness characteristics, the main problem associated with KNN classifier is the selection of a number of nearest neighbors i.e. "k" for computation. At present, it is hard to find the optimal value of "k" using any statistical algorithm, which gives perfect accuracy in terms of low misclassification error rate. Method: Motivated by the prescribed problem, a new sample space reduction weighted voting mathematical rule (AVNM) is proposed for classification in machine learning. The proposed AVNM rule is also non-parametric in nature like KNN. AVNM uses the weighted voting mechanism with sample space reduction to learn and examine the predicted class label for unidentified sample. AVNM is free from any initial selection of predefined variable and neighbor selection as found in KNN algorithm. The proposed classifier also reduces the effect of outliers. Results: To verify the performance of the proposed AVNM classifier, experiments are made on 10 standard datasets taken from UCI database and one manually created dataset. The experimental result shows that the proposed AVNM rule outperforms the KNN classifier and its variants. Experimentation results based on confusion matrix accuracy parameter proves higher accuracy value with AVNM rule. Conclusions: The proposed AVNM rule is based on sample space reduction mechanism for identification of an optimal number of nearest neighbor selections. AVNM results in better classification accuracy and minimum error rate as compared with the state-of-art algorithm, KNN, and its variants. The proposed rule automates the selection of nearest neighbor selection and improves classification rate for UCI dataset and manually created dataset.

Novel General KNN Classifier and General Nearest Mean Classifier for Visual Classification

A Novel Locally Linear Knn Model For Visual Recognition

Rethinking Nearest Neighbors for Visual Classification

A Novel Locally Linear KNN Method With Applications to Visual Recognition.

PCNN: Probable-Class Nearest-Neighbor Explanations Improve Fine-Grained Image Classification Accuracy for AIs and Humans

K-Ns: A Classifier by the Distance to the Nearest Subspace.

A Novel Two-Channel Classification Approach Using Graph Attention Network with K-Nearest Neighbor

Hypergraph-Induced Convolutional Networks for Visual Classification

A New Locally Linear KNN Method with an Improved Marginal Fisher Analysis for Image Classification

In defense of Nearest-Neighbor based image classification

AVNM: A Voting based Novel Mathematical Rule for Image Classification

A Fast Document Classification Algorithm Based on Improved KNN

A novel statistical approach to analyze image classification

Novel Data Classification Method Based on Radial Basis Function Networks

A Novel Pseudo Nearest Neighbor Classification Method Using Local Harmonic Mean Distance

Visual Recognition with Deep Nearest Centroids

Design and implementation of a parallel geographically weighted k-nearest neighbor classifier

Saliency-Aware Image-To-Class Distances for Image Classification

Local Naive Bayes Nearest Neighbor for Image Classification

Design and implementation of a parallel geographically weighted -nearest neighbor classifier.

Information Modified K-Nearest Neighbor