Abstract:Along with the fast evolvement of internet technology, internet users have to face the large amount of textual data every day. Apparently, organizing texts into categories can help users dig the useful information from large-scale text collection. Clustering is one of the most promising tools for categorizing texts due to its unsupervised characteristic. Unfortunately, most of traditional clustering algorithms lose their high qualities on large-scale text collection, which mainly attributes to the high-dimensional vector space and semantic similarity among texts. To effectively and efficiently cluster large-scale text collection, this paper puts forward a vector reconstruction based clustering algorithm. Only the features that can represent the cluster are preserved in cluster's representative vector. This algorithm alternately repeats two sub-processes until it converges. One process is partial tuning sub-process, where feature's weight is fine-tuned by iterative process similar to self-organizing-mapping (SOM) algorithm. To accelerate clustering velocity, an intersection based similarity measurement and its corresponding neuron adjustment function are proposed and implemented in this sub-process. The other process is overall tuning sub-process, where the features are reallocated among different clusters. In this sub-process, the features useless to represent the cluster are removed from cluster's representative vector. Experimental results on the three text collections (including two small-scale and one large-scale text collections) demonstrate that our algorithm obtains high-quality performances on both small-scale and large-scale text collections.

VSM-based Text Clustering Algorithm

Research on Text Clustering Based on Chameleon Algorithm

VRCA: A Clustering Algorithm for Massive Amount of Texts

A Vector Reconstruction Based Clustering Algorithm Particularly for Large-Scale Text Collection

An Improved Text Categorization Algorithm Based on VSM

Text Clustering Approach Based on Maximal Frequent Term Sets

A Novel Clustering Algorithm for Large-Scale Text Collection and Its Incremental Version.

The heavy frequency vector-based text clustering

V-SOM: A text clustering method based on dynamic SOM model

A Novel Text Clustering Algorithm Based on Inner Product Space Model of Semantic

A New Document Clustering Algorithm Based on Association Rule

Research on Neural Network Clustering Algorithm for Short Text

Grouped Text Clustering Using Non-Parametric Gaussian Mixture Experts

A Text Clustering Algorithm to Detect Basic Level Categories in Texts

A Linguistic Feature Based Text Clustering Method.

A Hash-Based Hierarchical Algorithm For Massive Text Clustering

Text Stream Clustering Algorithm Based on Adaptive Feature Selection.

An improved clustering algorithm based support vectors

Research on Chinese Text Automatic Categorization Based on VSM

Quality Evaluation for Three Textual Document Clustering Algorithms

The Clustering of Author's Texts of English Fiction in the Vector Space of Semantic Fields