Abstract:Among various document algorithms, K-means is a classical one. However it is a greedy algorithm, which is sensitive to the choice of cluster center and is much easier to result in local optimization. As genetic algorithm (GA) is a global convergence algorithm and the best cluster center can be found easily, a new dynamic document clustering method based on GA is presented in this paper. Reviewing all kinds of traditional document clustering methods, the partial similarity of kcywords was not taken into account, so the document similar matrix is a sparse matrix. To some extent, the accuracy of document similarity is influenced. In this paper, some new formulas are given which are improved based on the traditional method. The formulas take the partial similarity of keywords into account, thus improving the accuracy of the calculation of similarity. In this algorithm, the single individual is presented by a matrix which consists of K cluster centers. All individuals are encoded by floating-point numbers. The reciprocal of the sum of mean square deviation of intra-class distance plus one is adopted as the fitness function. The smaller the fitness function, the littler probability that the individual can be selected to enter the next generation. The optimal cluster center is finally found by the following iteration process: selection, crossover, mutation and so on. The simulation results show that the accuracy of this classification can reach over 98 percent and the algorithm is superior to K-means in performance. Thus, the algorithm of this paper is an effective method of document clustering.

Text Clustering Based on Automatic Partition of Feature Item Weight

Text clustering based on term weights automatic partition

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

A Novel Feature Selection Approach and Feature Weight Adjustment Technique in Text Classification

Improving Short Text Classification Through Better Feature Space Selection

CWC: A Clustering-Based Feature Weighting Approach for Text Classification

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering

Improved GA-based Text Clustering Algorithm

Application of Genetic Algorithm in Document Clustering

Text Stream Clustering Algorithm Based on Adaptive Feature Selection.

Feature Dimension Reduction Short Text Clustering Combined with Semantic and Statistics

Design and simulation of a document clustering algorithm based on genetic algorithm

Grouped Text Clustering Using Non-Parametric Gaussian Mixture Experts

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

An Effective Dimension Reduction Approach to Chinese Document Classification Using Genetic Algorithm.

Study on Topic Partition Based on Genetic Algorithm

A Linguistic Feature Based Text Clustering Method.

A Novel Text Clustering Algorithm Based on Niching Technique

An Evaluation on Feature Selection for Text Clustering

A New Feature Selection Method for Text Clustering