Abstract:k is the most important parameter in a text categorization system based on the k -nearest neighbor algorithm ( k NN). To classify a new document, the k -nearest documents in the training set are determined first. The prediction of categories for this document can then be made according to the category distribution among the k nearest neighbors. Generally speaking, the class distribution in a training set is not even; some classes may have more samples than others. The system's performance is very sensitive to the choice of the parameter k . And it is very likely that a fixed k value will result in a bias for large categories, and will not make full use of the information in the training set. To deal with these problems, an improved kNN strategy, in which different numbers of nearest neighbors for different categories are used instead of a fixed number across all categories, is proposed in this article. More samples (nearest neighbors) will be used to decide whether a test document should be classified in a category that has more samples in the training set. The numbers of nearest neighbors selected for different categories are adaptive to their sample size in the training set. Experiments on two different datasets show that our methods are less sensitive to the parameter k than the traditional ones, and can properly classify documents belonging to smaller classes with a large k . The strategy is especially applicable and promising for cases where estimating the parameter k via cross-validation is not possible and the class distribution of a training set is skewed.

A Strategy for Parameter Selecting in KNN Based on Greedy Search

Novel Linear Search for Support Vector Machine Parameter Selection

The Optimization for Parameter of Kernel Function with GA

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

An adaptive k-nearest neighbor text categorization strategy

Constrained All-k-Nearest-Neighbor Search

An Improved K-Nearest Neighbor Algorithm for Text Categorization

A comprehensive unsupervised feature selection method of two-stage strategy

An Effective Feature Selection Method For Text Categorization

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Revisiting K-Nn for Fine-Tuning Pre-trained Language Models

A Fast Document Classification Algorithm Based on Improved KNN

An kNN Algorithm Based on Vector Angle for Multi-label Text Categorization

Efficient KNN Text Categorization Based on Multiedit and Condensing Techniques

Introduction to Machine Learning: K-Nearest Neighbors

Optimal parameter selection for unsupervised neural network using genetic algorithm

Efficient Estimation of k for the Nearest Neighbors Class of Methods

Bayesian Model Selection Methods for Mutual and Symmetric $k$-Nearest Neighbor Classification

kNN Algorithm for Conditional Mean and Variance Estimation with Automated Uncertainty Quantification and Variable Selection

K-Ns: A Classifier by the Distance to the Nearest Subspace.

Accurate Knn Chinese Text Classification Via Multiple Strategies