Abstract:k is the most important parameter in a text categorization system based on the k -nearest neighbor algorithm ( k NN). To classify a new document, the k -nearest documents in the training set are determined first. The prediction of categories for this document can then be made according to the category distribution among the k nearest neighbors. Generally speaking, the class distribution in a training set is not even; some classes may have more samples than others. The system's performance is very sensitive to the choice of the parameter k . And it is very likely that a fixed k value will result in a bias for large categories, and will not make full use of the information in the training set. To deal with these problems, an improved kNN strategy, in which different numbers of nearest neighbors for different categories are used instead of a fixed number across all categories, is proposed in this article. More samples (nearest neighbors) will be used to decide whether a test document should be classified in a category that has more samples in the training set. The numbers of nearest neighbors selected for different categories are adaptive to their sample size in the training set. Experiments on two different datasets show that our methods are less sensitive to the parameter k than the traditional ones, and can properly classify documents belonging to smaller classes with a large k . The strategy is especially applicable and promising for cases where estimating the parameter k via cross-validation is not possible and the class distribution of a training set is skewed.

A simple and efficient classifying algorithm

A New Classification Algorithm Research

Rough set based hybrid algorithm for text classification

Multi-functional Nearest-Neighbour Classification

An improved nearest neighbor searching method for classification problems

Classifying Algorithm Based on P-SVM

A New Method of Class Centriod Vectors Classification Based on the Feedback

Two-level hierarchical combination method for text classification

An Efficient Centroid Based Chinese Web Page Classifier

Classification Algorithm Research Based on Support Vector Machine and Reverse K-nearest Neighbor

K-Nearest Neighbour and Support Vector Machine Hybrid Classification

An Experimental Comparative Study on Three Classification Algorithms

An Efficient Centroid Based Chinese Web

Improved Document Feature Selection with Categorical Parameter for Text Classification.

A Classification Method Based on Self-Adaptive Artificial Bee Colony

A quick evidential classification algorithm based on k-nearest neighbor rule

An empirical study of a simple incremental classifier based on vector quantization and adaptive resonance theory

SVM-KNN Classifier--A New Method of Improving the Accuracy of SVM Classifier

A Local Mean Representation-based K-Nearest Neighbor Classifier

A Kind of Hybrid Classification Algorithm Based on Rough Set and Support Vector Machine

An adaptive k-nearest neighbor text categorization strategy