Abstract:Document clustering, which is used for topic discovery and similarity computation, has received a great deal of attention in text data management. Methods that have been adopted in traditional clustering, particularly for multi-topic documents, are not viable because the contents that are distinguished by the sub topical structure may not be pertinent across the entire documents. In this paper, a sub-document based framework for clustering multiple documents is proposed in which LDA is used for document segmentation. The proposed improvised framework is a two-way approach to address the clustering problem. First, instead of applying a clustering algorithm to the entire data sets, documents are partitioned into cohesive sub-documents along topic boundaries through text segmentation to establish a two-level representation of text data, i.e., topics and words. Second, the proposed framework is compared to existing clustering methods, both traditional and segment based clustering through different clustering algorithms using the F-measure as the measurement metric. In addition, various real-time data sets that contain multi-topic documents are applied to validating the clustering algorithms through the proposed sub-document based framework. Each sub-document is clustered within a document and the resulting clusters are further clustered across the documents. Experimental results show that the proposed framework outperforms existing clustering approaches in terms of the F-measure as well as efficiency at least 73% with LDA segmentation and bisecting LDA in comparison to TextTiling.

Document Clustering Method Based on Frequent Co-occurring Words.

Document Clustering Using Locality Preserving Indexing

A New Documents Clustering Method Based on Frequent Itemsets

An Efficient Hybrid Hierarchical Document Clustering Method

Extended Strategies For Document Clustering With Word Co-Occurrences

A frequent term-based multiple clustering approach for text documents

A Clustering Algorithm for Short Documents Based On Concept Similarity

A feature selection algorithm for document clustering based on word co-occurrence frequency

Waf-Based Document Clustering Algorithm

A Feature Selection Method for Document Clustering Based on Part-of-speech and Word Co-Occurrence

Document Clustering Based on Word Sense Cluster

Compound Method Based on Frequent Terms for Near Duplicate Documents Detection

An Improvised Sub-Document Based Framework for Efficient Document Clustering

Sparse Poisson coding for high dimensional document clustering

A New Partitioning Based Algorithm for Document Clustering.

Document Clustering in Personal Dataspace

A Document Ensemble Clustering Approach Via Dimensionality Reduction

Enriching Document Representation with the Deviations of Word Co-occurrence Frequencies

Adaptive Centroid-Based Clustering Algorithm for Text Document Data.

Document Clustering Description Based on Combination Strategy

Document clustering using locality preserving indexing and support vector machines