Abstract:k is the most important parameter in a text categorization system based on k-Nearest Neighbor algorithm (kNN).In the classification process, k nearest documents to the test one in the training set are determined firstly. Then, the predication can be made according to the category distribution among these k nearest neighbors. Generally speaking, the class distribution in the training set is uneven. Some classes may have more samples than others. Therefore, the system performance is very sensitive to the choice of the parameter k. And it is very likely that a fixed k value will result in a bias on large categories. To deal with these problems, we propose an improved kNN algorithm, which uses different numbers of nearest neighbors for different categories, rather than a fixed number across all categories. More samples (nearest neighbors) will be used for deciding whether a test document should be classified to a category, which has more samples in the training set. Preliminary experiments on Chinese text categorization show that our method is less sensitive to the parameter k than the traditional one, and it can properly classify documents belonging to smaller classes with a large k. The method is promising for some cases, where estimating the parameter k via cross-validation is not allowed.

An Improved Condensing Algorithm

Efficient KNN Text Categorization Based on Multiedit and Condensing Techniques

Documents Sampling Based on Feature Selection and Condensing Techniques

An Improved KNN Text Classification Algorithm Based on Clustering

Improved KNN Algorithm based on Probability and Adaptive K Value.

A Gorder-Based Condensing Nearest Neighbor Algorithm

Improved KNN using clustering algorithm

An Improved K-Nearest Neighbor Algorithm for Text Categorization

A text classification method based on improved KNN algorithm

An Improved Knn Algorithm – Fuzzy Knn

Improving KNN based text classifications

The Analysis and Optimization of KNN Algorithm Space-Time Efficiency for Chinese Text Categorization

An adaptive fuzzy kNN text classifier

Based on the simulated annealing algorithm for improved KNN categorization algorithm

Improved KNN Text Categorization

An Improved KNN Algorithm in Text Classification

A New Image Classification Method Based on Modified Condensed Nearest Neighbor and Convolutional Neural Networks

Improvement of Density-Based Method for Reducing Training Data in KNN Text Classification

Accurate Knn Chinese Text Classification Via Multiple Strategies

An Improved KNN Classification Method Based on Variable Precision Rough Set

2-Stage Instance Selection Algorithm for KNN Based on Nearest Unlike Neighbors