Abstract:k is the most important parameter in a text categorization system based on the k -nearest neighbor algorithm ( k NN). To classify a new document, the k -nearest documents in the training set are determined first. The prediction of categories for this document can then be made according to the category distribution among the k nearest neighbors. Generally speaking, the class distribution in a training set is not even; some classes may have more samples than others. The system's performance is very sensitive to the choice of the parameter k . And it is very likely that a fixed k value will result in a bias for large categories, and will not make full use of the information in the training set. To deal with these problems, an improved kNN strategy, in which different numbers of nearest neighbors for different categories are used instead of a fixed number across all categories, is proposed in this article. More samples (nearest neighbors) will be used to decide whether a test document should be classified in a category that has more samples in the training set. The numbers of nearest neighbors selected for different categories are adaptive to their sample size in the training set. Experiments on two different datasets show that our methods are less sensitive to the parameter k than the traditional ones, and can properly classify documents belonging to smaller classes with a large k . The strategy is especially applicable and promising for cases where estimating the parameter k via cross-validation is not possible and the class distribution of a training set is skewed.

Particle swarm optimization based nearest neighbor algorithm on Chinese text categorization

An Improved K-Nearest Neighbor Algorithm for Text Categorization

An adaptive k-nearest neighbor text categorization strategy

Efficient KNN Text Categorization Based on Multiedit and Condensing Techniques

A multiclass classification framework for document categorization

Prototype Generation Using Multiobjective Particle Swarm Optimization for Nearest Neighbor Classification.

SA-CNN: Application to text categorization issues using simulated annealing-based convolutional neural network optimization

Modified particle swarm optimization with dynamic performance

Multi-label text categorization using k-nearest neighbor approach with m-similarity

Chinese Document Categorization without Dictionary Support and Segmentation Processing

Learning outliers to refine a corpus for chinese webpage categorization

An improved nearest neighbor searching method for classification problems

Fast text categorization based on collaborative work in the semantic and class spaces

An Efficient Text Categorization Algorithm Based on Category Memberships

Accurate Knn Chinese Text Classification Via Multiple Strategies

Multi-objective Particle Swarm Optimization Algorithm Based on Crowding Distance Sorting and Its Application

An kNN Algorithm Based on Vector Angle for Multi-label Text Categorization

Improving Text Categorization Using the Importance of Words in Different Categories

A High Performance Two-Class Chinese Text Categorization Method

Exploratory Study of Sorting Particle Swarm Optimizer for Multiobjective Design Optimization

Chinese Documents Categorization Based on N-gram Information