Abstract:k is the most important parameter in a text categorization system based on the k -nearest neighbor algorithm ( k NN). To classify a new document, the k -nearest documents in the training set are determined first. The prediction of categories for this document can then be made according to the category distribution among the k nearest neighbors. Generally speaking, the class distribution in a training set is not even; some classes may have more samples than others. The system's performance is very sensitive to the choice of the parameter k . And it is very likely that a fixed k value will result in a bias for large categories, and will not make full use of the information in the training set. To deal with these problems, an improved kNN strategy, in which different numbers of nearest neighbors for different categories are used instead of a fixed number across all categories, is proposed in this article. More samples (nearest neighbors) will be used to decide whether a test document should be classified in a category that has more samples in the training set. The numbers of nearest neighbors selected for different categories are adaptive to their sample size in the training set. Experiments on two different datasets show that our methods are less sensitive to the parameter k than the traditional ones, and can properly classify documents belonging to smaller classes with a large k . The strategy is especially applicable and promising for cases where estimating the parameter k via cross-validation is not possible and the class distribution of a training set is skewed.

A Fast Document Classification Algorithm Based on Improved KNN

RW.KNN: a proposed random walk KNN algorithm for multi-label classification.

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

Faster Nearest Neighbor Machine Translation

A multiclass classification framework for document categorization

A Fast KNN Algorithm Based on Simulated Annealing

A Fast and Easy Regression Technique for k-NN Classification Without Using Negative Pairs

K-Ns: A Classifier by the Distance to the Nearest Subspace.

An adaptive k-nearest neighbor text categorization strategy

An Improved K-Nearest Neighbor Algorithm for Text Categorization

Active and Passive Nearest Neighbor Algorithm: A Newly-Developed Supervised Classifier

Accurate Knn Chinese Text Classification Via Multiple Strategies

Document Classification With Cc4 Neural Network

Remote Sensing Image Classification Based on Evidence Theory and Neural Networks

A Fast Pen Gesture Matching Method Based on Nonlinear Embedding

A Novel Classification Algorithm Based on the Synergy Between Dynamic Clustering with Adaptive Distances and K-Nearest Neighbors

A New Locally Linear KNN Method with an Improved Marginal Fisher Analysis for Image Classification

A Non-VSM kNN algorithm for text classification

Efficient KNN Text Categorization Based on Multiedit and Condensing Techniques

Chinese Documents Categorization Based on N-gram Information

Combining KNN algorithm and other classifiers.