Abstract:Among various document algorithms, K-means is a classical one. However it is a greedy algorithm, which is sensitive to the choice of cluster center and is much easier to result in local optimization. As genetic algorithm (GA) is a global convergence algorithm and the best cluster center can be found easily, a new dynamic document clustering method based on GA is presented in this paper. Reviewing all kinds of traditional document clustering methods, the partial similarity of kcywords was not taken into account, so the document similar matrix is a sparse matrix. To some extent, the accuracy of document similarity is influenced. In this paper, some new formulas are given which are improved based on the traditional method. The formulas take the partial similarity of keywords into account, thus improving the accuracy of the calculation of similarity. In this algorithm, the single individual is presented by a matrix which consists of K cluster centers. All individuals are encoded by floating-point numbers. The reciprocal of the sum of mean square deviation of intra-class distance plus one is adopted as the fitness function. The smaller the fitness function, the littler probability that the individual can be selected to enter the next generation. The optimal cluster center is finally found by the following iteration process: selection, crossover, mutation and so on. The simulation results show that the accuracy of this classification can reach over 98 percent and the algorithm is superior to K-means in performance. Thus, the algorithm of this paper is an effective method of document clustering.

Text clustering based on term weights automatic partition

Text Clustering Based on Automatic Partition of Feature Item Weight

CWC: A Clustering-Based Feature Weighting Approach for Text Classification

Grouped Text Clustering Using Non-Parametric Gaussian Mixture Experts

A Novel Term Weighting Scheme for Automated Text Categorization

Improved GA-based Text Clustering Algorithm

A Novel Text Clustering Algorithm Based on Inner Product Space Model of Semantic

An Evaluation on Feature Selection for Text Clustering

A Text Clustering Algorithm to Detect Basic Level Categories in Texts

Design and simulation of a document clustering algorithm based on genetic algorithm

A Novel Text Clustering Algorithm Based on Niching Technique

A Lda-Based Algorithm For Length-Aware Text Clustering

Web Service Clustering Method Based on Word Vector and Biterm Topic Model

Research on dynamic self-adaptive term weighting for multi-class text classification algorithm

Algorithm and Experiment Research of Textual Document Clustering Based on Improved K-means

A Text Clustering Algorithm Using an Online Clustering Scheme for Initialization

Concept chain based text clustering

A Clustering Algorithm for Short Documents Based On Concept Similarity

Enhancing Web Text Clustering Accuracy and Efficiency With a Maximum Entropy Function Model: Overcoming High-Dimensional and Directional Challenges

Clustering Algorithm on Block Division of Documents

Modified DFS-based term weighting scheme for text classification